CN101019090A - User interface for multi-device control - Google Patents

User interface for multi-device control Download PDF

Info

Publication number
CN101019090A
CN101019090A CN 200480038345 CN200480038345A CN101019090A CN 101019090 A CN101019090 A CN 101019090A CN 200480038345 CN200480038345 CN 200480038345 CN 200480038345 A CN200480038345 A CN 200480038345A CN 101019090 A CN101019090 A CN 101019090A
Authority
CN
China
Prior art keywords
unit
user interface
controlling object
control
controlled environment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200480038345
Other languages
Chinese (zh)
Other versions
CN100480962C (en
Inventor
戴维·基莲
格兰·哈特
贾斯汀·弗罗瑞斯
保罗·克瑞扎诺斯基
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Corp
Microsoft Technology Licensing LLC
Original Assignee
OpenPeak Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by OpenPeak Inc filed Critical OpenPeak Inc
Publication of CN101019090A publication Critical patent/CN101019090A/en
Application granted granted Critical
Publication of CN100480962C publication Critical patent/CN100480962C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

A control server, or similar central processor, manages the distribution of data (including audio and video), voice, and control signals among a plurality of system components (102-120) connected via a wired and/or wireless communications network (180). The system components (102-120) include audio/visual components (such as, televisions, monitors, PDAs, notepads, notebooks, MP3, portable stereo, etc.) as well as household appliances (such as, lighting, ovens, alarm clocks, etc.). A portable controller (108) allows a user to access and control the system components (102-120) from any location within a controlled residential and/or non-residential environment (100), including its surrounding areas. The portable controller (108) includes a user and management interface (e.g., 200, 600) that contains customized control screens (e.g., 204, 700) for the system components. The control screens are stored in a hierarchical architecture that is searchable by region (e.g., 200) or component (e.g., 600) type.

Description

The user interface that is used for many device control
Technical field
The present invention relates generally to user interface, relate more specifically to the user interface of using in conjunction with the remote control unit that comprises a plurality of consumer electronics.
Background technology
User interface provides the dirigibility and the versatility of increase for remote control unit, and can be used for controlling consumer electronics (CE) equipment, such as TV, digital-video equipment (DVD) player and CD (CD) player.Most of remote control unit comprise fixing " hardkey " form, and this form can not easily be reconfigured as the multiple CE equipment of supporting.
Particularly when a plurality of equipment of must programming are supported single output, even the remote control unit of supporting plurality of devices able to programme also can make us fearing, obscuring and be difficult to operation concerning the general user.For example, equipment can be accepted from the not input of homology such as picture output device (for example TV).Yet the user may be not easy clear available input source.In addition, when a plurality of equipment was indicated in configuration multifunction remote-control unit, the user found to be difficult to discern the correct coding that is used to instruct control module usually.
The problem of equipment control and control is not only comprising a plurality of equipment but also is comprising in the environment of a plurality of device systems groups and begin to manifest additional complexity.
Required is is used to the technology that allows user interface to manage many equipment in clear, directly perceived and simple mode.
Summary of the invention
Provide method, system and computer program to come managing controlled environment, such as a plurality of equipment and/or the application in family, enterprise, school or the like and the neighboring area thereof.Control center comprises one or more servers or other data processing equipment, and the centralized command of permission equipment and/or application and control.
In an embodiment of the present invention, portable controller (such as personal digital assistant, wireless notepad or the like) allows user and control center to carry out alternately.This configuration and the performance that comprises change miscellaneous equipment and/or application alternately.Therefore, portable controller provides the remote access to miscellaneous equipment and/or application, and allows their function of any position control and/or the operation of user in the environment.
In one embodiment, portable controller is the hand-held platform with graphic alphanumeric display, and this hand-held platform has the wireless connectivity of the control center of miscellaneous equipment in wireless network (for example by ieee standard 802.11a, 802.11b, 802.11g or the like appointment) and control controlled environment and/or application.In another embodiment, control center is built in the portable controller.In another embodiment, portable controller is through infrared (IR) coded signal, with miscellaneous equipment and/or application direct communication.
According to embodiments of the invention, portable controller is convenient to control and is comprised the have a plurality of input blocks system of output block (for example TV, monitor or the like) of (for example DVD, VCR, satellite tuner, digital video recorder (DVR) or the like).According to the present invention, the user at first selects output block via the graphic user interface that is presented on the portable controller (GUI).Then, present control flow, select to specify the ability of input block for this user provides use " mark " interface to him or she.When selecting that input, present the control flow that is used for that system unit.
Description of drawings
Be included in wherein and form accompanying drawing example explanation the present invention of the part of instructions, and in conjunction with instructions, further be used for explaining principle of the present invention and allow the those skilled in the art to make and use the present invention.In the accompanying drawings, usually, identical mark represent identical or function on or similar parts on the structure.In addition, usually, the figure that this reference marker of the most left digit recognition of reference marker at first occurs.
Fig. 1 example illustrates dwelling house controlled system according to an embodiment of the invention.
Fig. 2 example illustrates hierarchical control interface according to an embodiment of the invention.
Fig. 3 example illustrates room control flow according to an embodiment of the invention.
Fig. 4 example illustrates unit control screen according to an embodiment of the invention.
Fig. 5 example explanation unit control screen according to another embodiment of the present invention.
Fig. 6 example illustrates component type hierarchical control interface according to an embodiment of the invention.
Fig. 7 example explanation control flow that throws light on according to an embodiment of the invention.
The explanation of Fig. 8 example is based on the process flow diagram that comes display control interface according to the room level of the embodiment of the invention.
The explanation of Fig. 9 example is based on the process flow diagram that comes display control interface according to the component-type hierarchy of the embodiment of the invention.
The explanation of Figure 10 example is according to the definition control flow of the embodiment of the invention.
The explanation of Figure 11 example defines control flow according to another embodiment of the present invention.
The explanation of Figure 12 example is according to the tuner definition control flow of the embodiment of the invention.
The explanation of Figure 13 example is according to the audio-video parts definition control flow of the embodiment of the invention.
Figure 14 is used to realize exemplary computer system of the present invention.
Embodiment
The present invention relates to controlled environment, such as a plurality of equipment in dwelling house, enterprise, school or the like and/or the centralized command and the control of application.The dwelling house controlled environment comprises the scope of family, room, movable dwellings, yacht or other type dwelling house.Yet in an embodiment, residential environment comprises the neighboring area of dwelling house, and any shelter, building, reconstruction in the designated perimeter or the like.
In other embodiments, the present invention realizes in non-residential environment.Non-residential environment includes but not limited to office's synthesis, a cover small office, photographic studio, warehouse, public place of entertainment, school or university, health care facility, hotel, holiday resort, aircraft, steamer, automobile or the like.In an embodiment, the controlled environment that is used for non-dwelling house embodiment not only comprises the actual boundary of said structure, and is included in their environment in the designated perimeter.
The example of controlled embodiment is at application " Method; System; and ComputerProgram Product for Managing Controlled Residential orNon-Residential Environments " (U.S. patent application serial number 10/382 by name, 897), and application " Method; System; and Computer Program Produce forManaging Controlled Residential or Non-Residential Environment " (U.S. patent application serial number 10/180 by name, 500) described in, all introduced for your guidance at this.As described in these applications, can provide the whole bag of tricks and system to manage information (comprising video, audio frequency, voice, text, figure, control messages or the like) is distributed to controlled environment interior miscellaneous equipment and/or application.These equipment and/or application include but not limited to that communicator is (such as phone, intercom or the like), entertainment systems is (such as TV, the CD/DVD player, recreation is used, stereo or the like), supervisory system is (such as security cameras, baby monitor or the like), the safety/security system is (such as fire alarm, automatic water system, lock on door or the window or the like), personal computer is (such as desktop computer, notebook, personal digital assistant or the like), cooking utensils are (such as baking box, coffee pot, electricity food well heater or the like), amenity facilities is (such as heating and air-conditioning (HVAC), humidifier, moisture separator, air purifier, photoswitch, light modulator or the like), power outlet, power supply or the like.
The example of these controlled environments as shown in Figure 1, example illustrates dwelling house control system 100 according to an embodiment of the invention.System 100 comprises communication network 180, this communication network and the interconnection of a plurality of system unit.System unit comprises positioning unit 102, two TVs 104 (being shown TV 104 (a) and 104 (b)), two computer client (being shown computer client 106 (a) and 106 (b)), portable controller 108, light fixture 110, the thermostat 112 that is used for the HVAC system, tuner 114, media player 116, cable box 118 and DSS boxes 120.Miscellaneous equipment and/or application also can be included as system unit.
Positioning unit 102 is specified the locus as the premises of the hosted environment of system 100.Positioning unit 102 is coupled to other system unit (for example portable controller 108) through wired and/or wave point.Positioning unit 102 is used for specifying the floor or the room of premises.Positioning unit 102 also is used for ad-hoc location or zone in designated floor or the room.In addition, positioning unit 102 also can be positioned at outside the dwelling house, thereby specifies the perimeter of dwelling house.
Computer client 106 comprises wired and/or radio individual computing machine, PDA(Personal Digital Assistant), enhancing phone, personal TV or is linked to other data processing equipment of communication network 180.As personal computer, individual client's machine 106 can be desktop computer, notebook, above-knee or the like.
Portable controller 108 is to allow user and other system unit alternately, transmit control message and/or the wired and/or wireless data treatment facility of the distribution of management information (comprising audio frequency, video, voice and other data) in other system unit to other system unit.Portable controller 108 can be a portable type of classifying the equipment of computer client 106 as.For example, portable controller 108 can be individual notebook or notebook, PDA, enhancing phone or be linked to communication network 180 and comprise the miscellaneous equipment that has with the display of the interactive ability of other system unit.Therefore, portable controller 108 allows the operation of each parts of user's telechirics 100.In an embodiment, being used for the display of portable controller 108 can be from other system unit receiver, video and/or audio frequency.In one embodiment, portable controller 108 comprises the flash ROM that allows wireless downloading and/or upload.
TV 104 is conventional television.In an embodiment, TV 104 is enhanced to support interactive mode and/or individual service.Individual service comprises virtually to be recorded, programme, suspends/rewinding on-the-spot broadcasting or the like.For example, TV 104 can be enhanced to support that by WebTV Networks (Mountain View, the support that CA) provides can be from Microsoft (Redmond, the personal TV of the MSN  TV service of the WEBTV  that WA) obtains service for Inc..As shown, TV 104 can be connected to cable set-top box 118, DSS set-top box 120 and/or media player 116 (for example PVR, VCR or DVD player).
The said system parts are not planned exhaustive.Can realize miscellaneous equipment (comprising instrument), use or the like, include but not limited to refrigerator, stove, microwave, baker, coffee pot, alarm clock, humidifier, automatic water system, illumination, light modulator or the like.In an embodiment, the operation and/or the function of these parts of portable controller 108 control are such as ON/OFF, timer, modulation (for example oven temperature or the like), suspend, doze off or the like.
As described, communication network 180 transmission medium that is provided in system unit, communicating.Communication network 180 is wired and/or WLAN (wireless local area network) (LAN).Therefore, communication network 180 comprises wired, wireless or two kinds of transmission mediums, comprises satellite, land (for example optical fiber, copper, UTP, STP, coaxial, Hybrid Fiber Coax (HFC) or the like), radio, microwave, free space optical system and/or other form or transmission method.
In an embodiment, all communication services in other system unit of server controls.Similarly, come message exchange in route or the control system parts through server.In another embodiment, communication network 180 is supported peer-to-peer communications.Similarly, system unit is directly exchange audio, video, voice, other data and/or control messages each other, and is not subjected to the centralized management of server.
In the embodiment that uses the wire transmission medium, communication network 180 is to have to be distributed to each system unit, such as the ethernet lan of the CAT-5 cable of TV 104, media player etc. etc.System unit comprises that response receives audio/video (AV) connector of cable.In an embodiment, communication network 180 comprises telephone wire and/or power lead (such as can be from the home telephone communication technology that alliance (HomePNA) or the like obtains of networking).
In the embodiment that uses wireless transmission medium, communication network 180 is supported ieee standard 802.11 (a), and its appointment is used for the wireless ethernet agreement of large-scale video.In another wireless embodiment, communication network 180 is supported IEEE802.11 (b), and its appointment is used for the wireless ethernet agreement of miniature video.In another wireless embodiment, communication network 180 is supported ieee standard 802.11 (g).In another embodiment, use bluetooth TMWireless technology (by BluetoothSIG, the Inc. exploitation) is supported the short-range wireless interface with system 100.
As shown in Figure 1, communication network 180 comprises wireless network access point 182, such as can (Irvine, CA) or Cisco Systems, (San Jose CA) obtains, as the platform that is used for system unit Inc. from Linksys Group Inc..WAP 182 is provided for the required logical internuncial central point of length of state of connectivity in the wireless network and tracker parts.In addition, WAP 182 can provide the tie point between wired and the wireless network.In the embodiment that uses server, as mentioned above, WAP 182 is as the platform of server.In another embodiment of the present invention based on server, except that WAP (such as at the WAP shown in 180 182), in fact server can be positioned on a plurality of distinct device platforms, comprises bridging device (such as bridge 130 (a)-(e)), personal digital assistant (such as 108), personal computer (such as 106) or the like.
System 100 also comprises a plurality of infrared/serial bridge 130 (a)-(d), and these bridges meet IEEE802.11 (b) standard that is used for radio communication.Each infrared/serial bridge 130 is carried out with one or more parts alternately.As shown, infrared/serial bridge 130 (a) is mutual with TV 104 (a), cable box 118 and media player 116.The specialized equipment of infrared/serial bridge 130 (b) and tuner 114 or conspicuous as those skilled in the relevant art, as to depend on infrared/serial communication protocols any kind is mutual.Infrared/serial bridge 130 (c) is mutual with thermostat 112.Infrared/serial bridge 130 (d) is mutual with light fixture 110.Wireless ethernet bridge 130 (e) is mutual with TV 104 (b) and DSS box 120.Wireless ethernet bridge 130 (e) can be supported any IP addressable device.Similarly, TV 104 (b) and DSS box 120 are " next generation " UPnP equipment with IP address.
Therefore, the present invention can be in conjunction with legacy equipment (for example depending on consumer electronics (CE) equipment of infrared/serial communication protocols), and by the UPNP of universal plug and play (UPnP) forum definition TMEquipment and application are as system unit.Application (U.S. patent application serial number 10/387 at " Legacy DeviceBridge for Residential or Non-Residential Networks " by name, 590, submission on March 14th, 2003) described the example of the controlled environment of realization IEEE802.11 (b) infrared/serial bridge in, be incorporated herein for your guidance.
As mentioned above, portable controller 108 (such as personal digital assistant, wireless notebook or the like) allows the user remotely to change the configuration and the performance of miscellaneous equipment and/or application from any position in the controlled environment.In an embodiment, portable controller 108 is the hand-held platforms with graphic alphanumeric display, and described hand-held platform has through the wireless connections of cordless communication network 180 (for example by ieee standard 802.11b specify) with the central server that can control miscellaneous equipment in the controlled environment and/or application.In another embodiment, server is built in the portable controller 108.In another embodiment, through infrared (IR) coded signal, portable controller 108 direct and miscellaneous equipment and/or application communications.
In an embodiment, the system that control comprises and have a plurality of input system parts the output system parts (for example TV, monitor, loudspeaker or the like) of (for example DVD, VCR, satellite tuner, digital video recorder, stereo or the like) is convenient in the present invention.According to the present invention, the user at first selects output block via GUI shown on the portable controller 108.Then, present control flow, select to specify the ability of input block for the user provides use " mark " interface to the user.When selecting that input, present the control flow that is used for those parts.
Fig. 2 example illustrates hierarchical control interface 200 according to an embodiment of the invention.This control interface 200 has corresponding to the room in the controlled environment based on the layer representation of controlled environment (for example user's house), is the basic interface sub level of the system unit in each room then.As being advised that by interface level identification field 202 control interface 200 allows the user to select the room to be positioned at the system unit in this room with control.
Control interface 200 comprises the several Control object relevant with a series of executable commands.Controlling object comprises navigation object 208a-208b and a plurality of room controlling object 206a-206n in home object 210, inter-level navigational object 212, the level.
When being activated, home object 210 provides the overall situation or " home-ranges " control flow for the user, such as below with reference to control shown in Figure 6 and described interface 600.With reference to figure 2, control flow 204 is the main panels of presenting to the user again, and the permission user checks a plurality of room controlling object 206a-206n corresponding to the room in the controlled environment.Each room controlling object 206a-206n is corresponding to a room, and relevant to show that identification is positioned at the executable command of screen of controllable system components in this room with retrieval basic interface sub level.By activating among the room controlling object 206a-206n, the user can select particular room thus so that controlling packet is contained in the system unit in that room.
Activate the interior navigation object 208a-208b of level so that horizontal rolling screen 204.If can not see all room controlling object 206a-206n in the front view, navigation object 208a-208b roll screen 204 is so that make the sightless controlling object 206a-206n can be in sight.
Inter-level navigational object 212 allows the user to move to the next one from an interface sublevel.For example, visit lower level view if the user activates room controlling object 206, then the user can activate inter-level navigational object 212 and return that next is more senior.
As mentioned above, when activating room controlling object 206a-206n, present the control flow that is used for corresponding room.Fig. 3 example explanation after activating room controlling object 206a-206n, the embodiment of the room control flow 300 that presents by portable controller 108.Room control flow 300 is provided for controlling the control option in family room, as shown in the interface level identification field 302.
Room control flow 300 comprises video controlling object 304a, audio frequency controlling object 304b, illumination controlling object 304c and environment controlling object 304d.Video controlling object 304a is relevant with the executable command of the video system that is used for controlling the room.Audio frequency controlling object 304b is relevant with the executable command of the audio system that is used for controlling the room.Illumination controlling object 304c is relevant with the executable command that is used to control room illumination.Environment controlling object 304d is relevant with the executable command of the HVAC system that is used for controlling the room.Can comprise that other controlling object controls the equipment and/or the application of other type in the particular room.
As mentioned above, inter-level navigational object 212 allows the user to switch to next higher interface level.For example, being used for next of control flow 300 more senior is top control flow 200.
Switch object 306 is relevant with the executable command of opening or closing all system units in the room.Therefore, can be by clicking, or more particularly, open or close all system units in the room by activating a controlling object (being switch object 306).
As mentioned above, when activating part controlling object (such as controlling object 304a-304d), present the control flow that is used for the corresponding system parts.The explanation of Fig. 4 example is according to the unit control screen 400 of the embodiment of the invention.Particularly, when the user when Fig. 3 activates video controlling object 304a, present unit control screen 400.Unit control screen 400 shows the control panel of the TV of the father that is used for being controlled to be the video system that is used for the room or main system parts.Highlighted father's icon 402 is so that be appointed as parent system components with this system unit.Can show to come highlighted father's icon 402 such as green by with brighter intensity or designated color.If system unit is son or affiliate system component, then not highlighted father's icon 402.
The control panel that is used for unit control screen 400 comprises that menu shows upward menu omniselector/selector switch 414 of activator appliance 406 and screen on digital channel keyboard 416, keyboard input activator appliance 420, the screen.Control flow 400 also comprises several special controlling object, such as the channel object of liking 418, display object 408, electronic guide object 410 and a last channel object 412.
Switch object 404 is relevant with the executable command of unlatching or closing television/parent system components.Inter-level navigational object 212 allows the user to switch to next higher interface level.For example, being used for next of unit control screen 400 more senior is room control flow 300.
Unit control screen 400 also comprises the side label 422 of the field form of can rolling, the diagrammatically shown subsystem component that is connected to parent system components of this side label.Subsystem component is represented by subassembly controlling object 426a-426n.Fig. 4 illustrates three sub-unit control objects, promptly be used to control DVD player DVD controlling object 426a, be used to control the VHS controlling object 426b of VHS player and be used to control the PVR player, such as the PVR controlling object 426c of the TIVO  digital video recorder (DVR) that can obtain from TiVo Inc. (USA).By activating navigation object 424a and following navigation object 424b, the side of rolling up or down label 422 can show other subassembly controlling object 426a-426n.
In one embodiment, unit control screen 400 is customized to and is suitable for portable controller 108.For example, screen shown in Figure 4 can with can be used for some basic function from having of obtaining of Philips Consumer Electronics, use together such as the PhilipsIPRONTO  of the hard button (not shown) of volume.Similarly, control flow of the present invention can comprise and be used to specify function, such as the combination of the soft key and the hardkey of volume.
As mentioned above, when activating subassembly controlling object 426a-426n, present the control flow that is used for the corresponding system parts.The explanation of Fig. 5 example is according to embodiments of the invention, by activating the unit control screen 500 that subassembly controlling object 426a-426n produces.Unit control screen 500 shows the control option that is used for DVD player.For example, if the user wants to watch the film of just playing on DVD player, the user can activate DVD player object 426a, so show DVD unit control screen 500.Highlighted DVD controlling object 426a has selected to be used for the control flow of DVD player to inform the user.Not highlighted other subassembly controlling object 426a-426n.
DVD unit control screen 500 shows the option of the function that is used to control DVD player.Described option comprises rewinding object 510, jump and to move back object 512, jump into object 522, F.F. object 524, to play object 528, slow play object 518, suspend object 516 and stop object 520.Chapters and sections omniselector 508 allows the particular chapter in the user-selected number word record.DVD unit control screen 500 comprises that also screen is gone up menu demonstration activator appliance 506 and screen is gone up menu omniselector/selector switch 514.
Not highlighted father's icon 402 on control flow 500 is because the system unit of controlled screen 500 controls is subsystem components.Switch object 504 is relevant with the executable command of opening or closing DVD player.Inter-level navigational object 212 allows the user to switch to next higher interface level.For example, next the more senior father's of the being unit control screen 400 that is used for subassembly control flow 500.
As mentioned above, the user interface that is used for portable controller 108 can be organized by hierarchical layout.Yet layout is not limited to house-room level.In one embodiment, for ease of control, user interface is come the organization system parts by unit type.Fig. 6 example has illustrated the embodiment based on the control interface 600 of unit type control hierarchy.This control interface 600 is provided for assembling the option with the control of all system units of the specific component type coupling shown in the interface level identification field 602.The basic interface sub level is corresponding to the type of the system unit that is arranged in whole controlled environment.Control interface 600 comprises six unit type controlling object 604a-604f, six kinds of system units in these object representation controlled environments.Especially, all available illuminators are linked and are formed illuminace component type controlling object 604a.All environment/comfort system are linked and are formed environment component type controlling object 604b.The audio available parts are combined and are linked to acoustic component type controlling object 604c-604d.The alarm components that is used for the safety/security system is linked and is formed safety/security component type controlling object 604e.At last, the video components that is used for the safety/security system is combined and is linked to safety/security component type controlling object 604f.
Switch object 606 is relevant with the executable command of opening or closing all system units that are complementary with specific component type.For example, if select illuminace component type controlling object 604a, then can activator switch object 606 so that open or close the illuminator that is linked to controlling object 604a.Can by use mouse or similarly input block cursor is placed on the controlling object 604a, and right click or left click mouse once come " selection " controlling object 604a.Can use two left clicks to come " activation " controlling object 604a.If the use touch-screen then can use to click and select controlling object and can use double-click to activate object.Also can use drop-down menu to distinguish " selection " and " activation " of controlling object.
The activation of component type controlling object 604a-604f sends order and presents next basic interface sub level, all available system components that its identification and corresponding unit type are complementary.The explanation of Fig. 7 example shows the embodiment of the illumination control flow 700 of all controllable lightings in the controlled environment house.Illuminator in each room of a plurality of illumination controlling object 706a-706n and controlled environment is relevant.If a more than illuminator (for example lamp, ceiling light or the like) is arranged in the room, then activates illumination controlling object 706a-706n and call the sub level screen that shows each illuminator in the corresponding room.In an embodiment, activating lighting object 706a-706n (for example by double-clicking object or double-click) calls the level of giving that shows the available control option that is used for illuminator and shields.The control option comprises deepening, timing controlled or the like.
Switch object 708 is with unlatching or close relevant with the executable command of the relevant illuminator of controlling object 706a-706n of throwing light on.In an embodiment, the user selects one or more illumination controlling object 706a-706n with the operation inputting part part, and selector switch object 708 is operated relevant illuminator then.In an embodiment, the user can be by " closing all illuminations " as the house scope or the switch object 708 of " open all illumination " switching manipulation, opens or close all illuminations in the house for example.
Activate the interior navigation object 208a-208b of level and come roll screen 704 so that sightless illumination controlling object 706a-706n can be checked.Inter-level navigational object 212 allows the user to switch to next higher interface level.For example, be used to throw light on next of control flow 700 more senior be component type hierarchical control interface 600.
In an embodiment, highlighted illumination controlling object 706a-706n (for example intensity, color or the like) represents that illuminator opens or closes.So, as seen control of the present invention interface is represented for open/close convenience for the user is provided at which system unit in the controlled environment (for example lamp, TV, security cameras, baking box or the like).In addition, according to the quantity of controlling object, can on single screen or the single screen that rolls, provide visible expression.This uses a main screen to control the ability of these parts for the user provides, rather than requires the user to navigate between several rooms control flow, is controlling illumination on the basis, room one by one.For example, in Fig. 7, light in the family room and garage lights light representations are " opening " state.The user can close light in those rooms by the deactivation controlling object 706a-706n that throws light on accordingly, or by activating the light in any other room that illumination controlling object 706a-706n corresponding to this room opens the house.
Support of the present invention be used to show the hierarchical control interface in case a plurality of system units of control in the controlled environment variety of protocol.With reference to figure 8, process flow diagram 800 expressions are used for the general operation flow process of the embodiment of display control interface.More particularly, process flow diagram 800 expression is used to present the example based on the control stream at the hierarchical control interface of room level.
With reference to figure 8, the control of process flow diagram 800 stream begins in step 801, and is delivered to step 803 immediately.In step 803, visit and present control flow so that show.Control flow shows all available rooms in the controlled environment.With reference to the control flow among the figure 2 200, the example based on the hierarchical control screen in room has been described above.Control flow 200 is shown as controlling object 206a-206n with available rooms.Yet available rooms also can be rendered as the tabulation based on hypertext.Appointment or each room relevant with controlling object 206a-206n are linked to basic screen in tabulation, and this shields the controllable system components in the identification room substantially.
In step 806, visit and present the room control flow, so that show the one or more system units that are positioned at selected room.Response activates control corresponding object 206a-206n or the like, and visit room control flow is as described in step 803.The example of room control flow has been described with reference to the room control flow 300 of figure 3 above.The room control flow is shown as unit control object 304a-304d with all available system components or is presented in the tabulation based on hypertext, and both all are linked to basic screen.Basic screen identification is used for the control option of related system parts.
In step 809, visit and present unit control and shield so that show the control option that is used for the related system parts.As described, response activates corresponding unit control object 304a-304d or the like and visits the unit control screen.The unit control screen allows the user to select various control options to come the operation and/or the function of management system parts.With reference to the screen of the unit control in the Figure 4 and 5 400 and 500, giving an example of unit control screen described above.
In step 812, verification and the relevant system unit of unit control screen are so that determine whether it is parent system components.If control is delivered to step 815.Otherwise control is delivered to step 821.
In step 815, on identical unit control screen, show that all are subordinate to or subsystem component, so that the chance of the other system unit of control is provided for the user.For example, if select and the system unit of control is parent system components (a for example TV) in step 809, so in step 812, the user can control and/or be provided with affiliate system component (for example DVD player).
In step 818, if affiliate system component can with and wish Be Controlled, then control stream and turn back to step 809, wherein, present the unit control screen that is used for selected affiliate system component so that show.Response activates and is subordinate to unit control object 426a-426n or the like accordingly, visit subassembly control flow.Manage the operation and/or the function of affiliate system component through this control flow.As above described with reference to figure 4 and Fig. 5, unit control screen 500 presents and is used to control the control interface of being shielded the affiliate system component of 400 parent system components of controlling by unit control.
On the other hand, if the non-selected affiliate system component that is used to control, control stream is delivered to step 821.
In step 821, carry out specific control option and control relevant system unit.For example, if the father and son's system unit of having programmed comes the DVD playing back video recording, then carry out relevant order control signal is sent to each system unit, for example TV/father and DVD player/son.After being provided with and carrying out the control interface, shown in step 895, control stream finishes.
With reference to figure 9, process flow diagram 900 expressions are used for the general operation stream of another embodiment of display control interface.More particularly, process flow diagram 900 expressions are used for presenting based on the component type control hierarchy example of the control stream at hierarchical control interface.
With reference to figure 9, the control of process flow diagram 900 stream is in step 901 beginning and be delivered to step 903 immediately.In step 903, visit and present control flow so that show.Control flow is presented at all available available unit types in the controlled environment.With reference to the control interface 600 among the figure 6 example that shields based on the hierarchical control of unit type has been described above.Control interface 600 is shown as controlling object 604a-604f with the available unit type.Yet, also the available unit type can be rendered as tabulation based on hypertext.Each unit type (appointment, controlling object or the like in tabulation) is linked to basic screen, and this shields the identification controllable system components relevant with each unit type substantially.
In step 906, visit and present the unit type control flow so that opsition dependent (for example room) shows the system unit that is complementary with selected unit type.Response activates control corresponding object 604a-604f or the like, and access component type control flow is as described in step 903.With reference to the unit type control flow 700 among the figure 7, the example of unit type control flow has been described above.All available system components are shown as unit control object 706a-706n to the unit type control flow or in the tabulation based on hypertext, both all are linked to basic screen.Basic screen identification is used for the control option of related system parts.
In step 909, visit and present unit control and shield so that show the control option that is used for the related system parts.As described, response activates corresponding unit control object 706a-706n or the like, access component control flow.The unit control screen allows the user to select various control options to come the operation and/or the function of management system parts.With reference to the screen of the unit control among figure 4 and Fig. 5 400 and 500, the unit control screen has been described above.
In step 912, the system unit that verification is relevant with the unit control screen is so that determine whether it is parent system components.If control is delivered to step 915.Otherwise control is delivered to step 921.
In step 915, on same unit control screen, show all affiliate system component, so that the chance of the other system unit of control is provided for the user.For example, if select and the system unit of control is parent system components (a for example TV) in step 909, then in step 912, the user can control and/or be provided with and be subordinate to or subsystem component (for example DVD player).
In step 918, if affiliate system component can with and wish Be Controlled, then control stream and turn back to step 909, wherein, present the unit control screen that is used for selected son or affiliate system component so that show.Response activates corresponding subassembly controlling object 426a-426n or the like, visit subassembly control flow.Come the operation and/or the function of ADMINISTRATION SUBSYSTEM parts via this control flow.As above described with reference to figure 4 and Fig. 5, unit control screen 500 presents and is used to control the control interface of being shielded the affiliate system component of 400 parent system components of controlling by unit control.
On the other hand, if the non-selected affiliate system component that is used to control is delivered to step 921 at control stream.
In step 921, carry out specific control option and control relevant system unit.For example, if the father and son's system unit of having programmed comes the DVD playing back video recording, then carry out relevant order control signal is sent to each system unit, for example TV/father and DVD player/son.After being provided with and carrying out the control interface, shown in step 995, control stream finishes.
The present invention includes and allow the user to add and/or dispose the various control flows of the system unit that is used for controlled environment.In an embodiment, provide and guide is set allows the user to add or configure system components.The explanation of Figure 10 example is according to the definition control flow 1000 of the embodiment of the invention.This definition control flow 100 can be included as the part that guide is set, and is used for adding and/or configure system components, as shown in the define field 1002.Control flow 1000 comprises a plurality of control fields of being filled by the user.As shown, control field comprises type field 1004, manufacturer's field 1006, model field 1008, room field 1010, network extender field 1012, display field 1014, gets rid of field 1016 and name field 1018.
Type field 1004 specified parts types.As mentioned above, the unit type hierarchical control shows, organizes system unit in the controlled environment such as control interface 600 and control flow 700 by unit type, thereby allows the user to control all system units that are complementary with specific component type from same screen.Type field 1004 allows the user to specify the unit type of support based on the above-mentioned hierarchical control user interface of unit type.Exemplary list of component types as shown in figure 11, another embodiment of example explanation control flow 1000.In Figure 11, type field 1004 expression unit types can be amplifier, audio frequency device, cable box, DSS box, DVD player, illuminator, thermostat, PVR equipment or TV.Tabulation in the type field 1004 is not exhaustive.Other system component types can specify and comprise in the present invention, includes but not limited to video server, messaging system, safety or peripheral camera, residential equipment or the like.
With reference to Figure 10, manufacturer's field 1006 allows the manufacturer of user's appointing system parts again, and model field 1008 allows the pattern number of user's appointing system parts.In one embodiment, one or more software modules are relevant with control of the present invention interface, and search in look-up table, database or the like and be sent out so that the IR sign indicating number of control system parts.Come Query Database or the like by software module use specified message in manufacturer's field 1006 and model field 1008.
Room field 1010 is specified the wherein room or the zone of the controlled environment of place system parts.Information in the room field 1010 is used for supporting the hierarchical control based on the room of the present invention to show (for example controlling interface 200 and control flow 300).Although initially specify this information by the user, also can or dynamically update the content of room field 1010 by positioning unit 102 initial setting up through guide is set.At " Method; System; and Computer ProgramProduct for Managing Controlled Residential or Non-ResidentialEnvironments " (U.S. patent application serial number 10/382 by name, 897) application, and the example of having described the position of the system unit in the dynamic tracking controlled environment in the application of " Method; System; and Computer Program Produce for ManagingControlled Residential or Non-Residential Environment " (U.S. patent application serial number 10/180,500) by name in more detail.
Comprise that name field 1018 allows the title of customization system unit.The user can specify personalized descriptor to recall being convenient to.
Definition control flow 1000 also comprises network extender field 1012, to allow the user system unit is associated with suitable bridge.As described in reference to figure 1, infrared/serial bridge 130 can be coupled to system unit so that the radio communication of support and other system unit.As described, system 100 can have a plurality of infrared/serial bridge 130 (a)-130 (e) (for example every layer or each room one).
Display field 1014 allows the user to comprise and/or dispose the affiliate system component of one or more " hiding " of being linked to parent system components.The system unit of hiding (such as amplifier) is configured in the system 100, but control flow of the present invention (for example control flow 400) can be configured to not present the hiding system that is subordinate to the user, because the affiliate system component of hiding operation invisibly concerning the user.But, the affiliate system component of hiding is linked to one or more other parent system components.For example, amplifier chain can be received TV, DVD player and CD Player.When selecting any one of these parent system components, will activate amplifier automatically by screen 100.The volume control of for example setting up for these parent system components automatically is redirected to hiding amplifier.Therefore, whether display field 1014 checks the ability (for example side label 422 on the control flow 400) of affiliate system component for the user provides selection on the unit control screen.In one embodiment,, then show affiliate system component if the value of display field 1014 is " very ", and if the value of display field 1014 be " vacation ", then affiliate system component keep to be hidden and not to be shown.
Definition control flow 1000 also comprises gets rid of field 1016, allow the user from " full cut-off,, or get rid of particular system component in " standard-sized sheet " (room or family) order.As mentioned above, for example, switch object 306,606 and 708 and can be performed so that close or open in the specific region, or the global command of all system units in (for example system 100) in the whole controlled environment (or with all system units of the specific component type coupling) is relevant.Yet eliminating field 1016 permission users get rid of the system unit in particular system component, particular system component type or the appointed area from these global commands.For example, when activator switch object 306, the user can get rid of the TV of closing in the room.
The notion of control flow 1000 overlay device chains.When coming configure system components, set up the chain (system unit) of relevant or affiliate system component with I/O correlativity according to the present invention.For example, a kind of this chain can be DVD player, amplifier and TV.Another kind of chain can be CD Player and amplifier.The third chain can be TV and tuner.The present invention includes all system units of being used for opening or closing closed chain (for example when starting CD Player, amplifier is opened), and the method and/or the technology of the suitable affiliate system component of agency's control (for example the volume request turns to amplifier, or chapters and sections select to turn to DVD player).
Control flow 1000 also comprises next object 1020, and it calls next control flow that is provided with in the guide.Inter-level navigational object 212 call again be provided with in the guide at preceding screen.
Control of the present invention interface is provided for from common platform control parent system components and is subordinate to the convenience and the effective means of (comprising hiding) system unit.With reference to figure 4, side label 422 is diagrammatically shown rolled fields of giving controlling object 426a-426n relevant with subsystem component again.As described, subsystem component is under the jurisdiction of the parent system components that is subjected to 400 controls of unit control screen.In an embodiment, each single subsystem component of forming side label 422 is used by the user and guide is set disposes.Guide is set allows the user to specify the system unit that is connected to TV/parent system components, and this information is transmitted to the software module of supporting control of the present invention interface.
The explanation of Figure 12 example allows the user to specify the definition control flow 1200 of the affiliate system component of parent system components according to embodiments of the invention.This definition control flow 1200 allows to establish the specification that is used for tuner apparatus, as shown in define field 1202.Definition control flow 1200 comprises father field 1204, input field 1206, audio device field 1208, audio frequency input field 1210 and digital input word section 1212.
Father field 1204 designated tuners equipment are parent system components or subsystem component.If system unit is a parent system components, then father field 1204 comprises input " nothing ".If system unit is a subsystem component, then father field 1204 is listed the title of parent system components.
The input of input field 1206 specified channels.Channel input is used for the tuning system parts, so that receive the decode vision signal from channel correlation.
Whether audio field 1208 identification audio output system parts are under the jurisdiction of tuner apparatus.For example, output is fed to auxiliary speaker system or note amplifier if the user plans audio frequency, and the system unit title that is used for speaker system so is transfused to audio field 1208.In this case, speaker system will be the subsystem component of tuner/parent system components.
Audio frequency input field 1210 is identified in the suitable inputting channel on the speaker system of appointment in the audio field 1208.
Digital input word section 1212 is specified the quantity of the required numeral of the channel on the change tuner.For example, some tuners are only accepted double figures (promptly being limited to channel 01 to 99).Other tuner can accept to reach four figures.The quantity of channel digit depends on the pattern and the model of the system unit (for example tuner) that just is being configured.Therefore, the metadata of unique control behavior of digital input word section 1212 identification descriptive system parts.In one embodiment, portable controller 108 is able to programme so that extract the channel digit metadata that is used for this tuner from metadata database.By name " Device Control Database " application (U.S. patent application serial number TBD; Attorney No.2100.0070000) described the example that is used for extracting the system and method for channel digit metadata in, all introduced for your guidance at this from metadata database.Yet,, from digital input word section 1212, read the channel digit metadata if metadata database does not comprise these information.Perhaps, can use digital input word section 1212 to replace the data of storing in the metadata database.
Next object 1020 calls next control flow that is provided with in the guide.Be invoked at preceding control flow at preceding object 1222.Inter-level navigational object 212 allows the user to switch to next higher interface level by guide is set.For example, if the user has disposed the parent system components on the one-level, and currently just disposing second, the affiliate system component of next stage, then the user can be by activating navigation object 212, turn back to the first order that is used for parent system components, or the user by activate at preceding object 1222, turn back to be used to define partial affiliate system component at preceding screen.
The explanation of Figure 13 example allows the user affiliate system component to be linked to another embodiment of the definition control flow 1300 of parent system components.Definition control flow 1300 allows to establish the specification that is used for the audio-video system unit, as shown in define field 1302.Control flow 1300 can be used for making the audio-video system unit to be under the jurisdiction of the tuner of configuration in control flow 1200.So, control flow 1300 will be represented the child level of control flow 1200.Therefore, the activation of inter-level navigational object 212 will be called next higher interface level, and promptly screen 1300.Yet, activate preceding object 1222 call in a series of control flows at preceding control flow, be used to dispose audio frequency-visual system component.
Fig. 1-the 13rd allows to explain conceptual illustrations of the present invention.It will be appreciated that embodiments of the invention can be realized with hardware, firmware, software or its combination.In this embodiment, will realize that each parts and step are so that carry out function of the present invention with hardware, firmware and/or software.That is, same hardware, firmware or software module can be carried out one or more illustrated blocks (being parts or step).
In addition, can in can carrying out functional one or more computer systems described herein or other disposal system, realize the present invention.With reference to Figure 14, show and be used in the exemplary computer system 1400 that realizes among the present invention.According to this exemplary computer system 1400, each embodiment is described.After reading this instructions, how to use other computer system and/or Computer Architecture to persons skilled in the relevant art, realize that the present invention will become apparent.
Computer system 1400 comprises one or more processors, such as processor 1404.Processor 1404 can be special use or nextport universal digital signal processor NextPort.Processor 1404 is connected to the communications infrastructure 1406 (for example communication bus, cross bar or network).
Computer system 1400 can comprise the display interface 1402 of transmitting figure, text and other data from the communications infrastructure 1406 (or from unshowned frame buffer), is used for showing on display unit 1430.
Computer system 1400 also comprises primary memory 1408, random-access memory (ram) preferably, and can also comprise supplementary storage 1410.Supplementary storage 1410 can comprise for example hard disk drive 1412 and/or removable memory driver 1414, and these drivers are represented floppy disk, tape drive, CD drive or the like.Removable memory driver 1414 reads and/or writes removable memory module 1418 from removable memory module 1418 in known manner.Removable memory module 1418 expression floppy disks, tape, CD or the like are read and are write by removable memory driver 1414.As recognizing, removable memory module 1418 is included in wherein storage computation machine software (for example program or other instruction) and/or data computing machine usable storage medium.
In a further embodiment, supplementary storage 1410 comprises other similar device, is used for allowing with software and/or data load to computer system 1400.These devices comprise for example removable memory module 1422 and interface 1420.The example of these devices comprises programming box and cartridge interface (such as what found), removable memory chip (such as EPROM or PROM) and associated socket in video game device, and permission is sent to software and data other removable memory module 1422 and the interface 1420 of computer system 1400 from removable memory module 1422.
Computer system 1400 can also comprise communication interface 1424.Communication interface 1424 allows to transmit software and/or data between computer system 1400 and external unit.The example of communication interface 1424 comprises modulator-demodular unit, network interface (such as Ethernet card), communication port, PCMCIA slot and card etc.Software that transmits through communication interface 1424 and data can be signal 1428 forms of electronics, electromagnetism, light or other signal that can be received by communication interface 1424.Via communication path (being channel) 1426, these signals 1428 are offered communication interface 1424.Communication path 1426 transmits signals 1428 and can use wired or cable, optical fiber, telephone wire, cellular phone link, RF link, Free Space Optics equipment and other communication channel realize.
In this application, term " computer program medium " and " computer usable medium,, be used for being often referred to such as removable memory module 1418, removable memory module 1422, be installed in the hard disk in the hard disk drive 1412 and the medium of signal 1428.These computer programs are the unit that are used for providing to computer system 1400 software.In an embodiment, the present invention is directed to these computer programs.
Computer program (being also referred to as computer control logic or computer readable program code) is stored in primary memory 1408 and/or the supplementary storage 1410.Also can be through communication interface 1424 receiving computer programs.These computer programs allow computer system 1400 to realize the present invention as described herein when being performed.Especially, computer program is when being performed, allow processor 1404 to realize process of the present invention, such as using for example method of other system unit realization of portable controller 108, control flow 200, control flow 400, control flow 700, control flow 1000 and/or said system 100, such as method 800 and/or 900.Therefore, these computer programs are represented the controller of computer system 1400.
In using software realization embodiments of the invention, software can be stored in the computer program and use removable memory driver 1414, hard disk drive 1412 or communication interface 1424, is loaded in the computer system 1400.Steering logic (software) makes processor 1404 carry out function of the present invention described herein when being carried out by processor 1404.
In another embodiment, use for example hardware component,, mainly realize the present invention with hardware such as special IC (ASIC).Realize that hardware state machine will be apparent so that carry out function described herein for those skilled in the relevant art.
In another embodiment, use the combination of hardware and software to realize the present invention.
Although described each embodiment of the present invention above, will appreciate that by example rather than restriction provides them.To persons skilled in the relevant art, under the situation that does not deviate from the spirit and scope of the present invention, the various changes that can make form and details are conspicuous.In addition, as previously mentioned, it will be appreciated that method of the present invention, system and computer program do not should be limited to residential environment.Be used for distribution medium and will order and/or control signal sends to the various environment of the center processing system of a plurality of equipment that are distributed on the appointed area and/or application having, can realize the present invention.Except that dwelling house, the appointed area includes but not limited to office's synthesis, a cover small office, photographic studio, warehouse, public place of entertainment, school or university, health care facility, hotel, holiday resort, aircraft, steamer, automobile or the like.Therefore, the present invention should not be subjected to above-mentioned exemplary embodiment any one limit, and only should limit according to following claim and their equivalence.

Claims (30)

1. a graphic user interface is used for a plurality of system units in the managing controlled environment, comprising:
First controlling object set, wherein, the interior system unit of described controlling object and controlled environment is associated; And
The unit control interface, be used to present the control option that is used for selected system unit, wherein, activation is indicated described selected system unit and is filled user interface with described control option from the controlling object of described first set, wherein, each control option is associated with command sequence, when carrying out described command sequence, sends operation or function that described selected system unit is controlled in instruction.
2. graphic user interface as claimed in claim 1 further comprises:
The set of second controlling object, expression can provide the affiliate system component of input to described selected system unit, wherein, activation uses the control option of the affiliate system component that is associated with the controlling object that is activated to fill user interface from the controlling object of described second set, wherein, each the control option that is used for described affiliate system component is associated with command sequence, when carrying out described command sequence, sends operation or function that described affiliate system component is controlled in instruction.
3. graphic user interface as claimed in claim 1, wherein, a plurality of zones in described first controlling object set expression controlled environment, wherein, each zone comprises one or more system units.
4. graphic user interface as claimed in claim 3 further comprises:
The set of second controlling object, represent the available system components in the selected zone, wherein, activation is indicated described selected zone and is filled user interface with described second set from the controlling object of described first set, wherein, activation is indicated described selected system unit and is filled user interface with described control option from the controlling object of second set.
5. graphic user interface as claimed in claim 1, wherein, a plurality of unit types in described first controlling object set expression controlled environment.
6. graphic user interface as claimed in claim 5 further comprises:
The set of second controlling object, Free Region in the expression controlled environment, wherein, each zone comprises one or more system units of selected unit type, wherein, activation is indicated described selected unit type and is filled user interface with described second set from the controlling object of described first set, wherein, activates from the controlling object of described second set and indicates described selected system unit and fill user interface with described control option.
7. graphic user interface as claimed in claim 1 further comprises:
With global command's associated switch object, be used for when carrying out described global command, sending the ON-OFF that the appointing system parts are changed in instruction, wherein, from described first set, select one or more controlling object to indicate described appointing system parts.
8. graphic user interface as claimed in claim 7, wherein, described switch object is associated with global command, when carrying out described global command, send instruction and change the ON-OFF of the one or more system units that are complementary with the specified parts type, wherein, from described first set, select controlling object to indicate described specified parts type.
9. graphic user interface as claimed in claim 7, wherein, described switch object is associated with global command, when carrying out described global command, send instruction and change the ON-OFF of at least one system unit of the appointed area that is positioned at controlled environment, wherein, from described first set, select controlling object to indicate described appointed area.
10. graphic user interface as claimed in claim 7 further comprises:
Remover, be used for from described global command get rid of one or more appointing system parts, one or more system units of one or more system units of being complementary with the specified parts type and the specific region that is positioned at controlled environment at least one, wherein, carry out the ON-OFF that described global command does not send one or more system units that instruction is excluded with change.
11. graphic user interface as claimed in claim 1 further comprises:
The device definition device, being used to specify inputing or outputing in one or more affiliate system component and the main system parts links or correlativity, thereby set up the system unit chain that comprises described main system parts and described one or more affiliate system component, wherein, described main system parts with from described first the set the main control object be associated.
12. graphic user interface as claimed in claim 11, wherein, the activation of described main control object is filled user interface with the control option, and described control option is used for fill order, so that send operation or function that described system unit chain is controlled in instruction.
13. a method that is used for a plurality of system units in the managing controlled environment comprises:
Present first controlling object set on user interface, the interior one or more system units of each object and controlled environment are associated;
Response receives and the activation signal that is associated from described first controlling object of gathering, selective system parts;
Fill described user interface by the control option that is used for selected system unit; And
Each control option is associated with the executable command sequence, and described executable command sequence sends instruction so that control the operation or the function of selected system unit.
14. method as claimed in claim 13 further comprises:
Presenting expression on described user interface can provide second controlling object set of the affiliate system component of input to selected system unit.
15. method as claimed in claim 14 further comprises:
Response activates the controlling object from described second set, fills described user interface by the control option that is used for affiliate system component; And
Each control option that will be used for described affiliate system component with send to instruct so that control the operation of described affiliate system component or the executable command sequence of function is associated.
16. method as claimed in claim 14 further comprises:
Fill described user interface by the control option,, and hide described affiliate system component and on described user interface, further do not checked so that affiliate system component is linked to selected system unit.
17. method as claimed in claim 13, wherein, a plurality of zones of described first controlling object set expression, each zone comprises the one or more system units in the controlled environment.
18. method as claimed in claim 17, wherein, described selection step comprises:
Response receives and the activation signal that is associated from described first controlling object of gathering, and selects the zone;
Gather by second controlling object and to fill described user interface, to represent the available system components in the selected zone; And
Response receives and the activation signal that is associated from described second controlling object of gathering, selective system parts.
19. method as claimed in claim 13, wherein, a plurality of unit types in described first controlling object set expression controlled environment.
20. method as claimed in claim 19, wherein, described selection step comprises:
Response receives the activation signal that is associated with described first set, alternative pack type;
Gather with second controlling object and to fill user interface representing Free Region, each zone comprises one or more system units of the selected unit type in the controlled environment; And
Response receives the activation signal that is associated with described second set, selective system parts.
21. method as claimed in claim 13 further comprises:
From described first set, select one or more controlling object to come the appointing system parts;
On described user interface, present switch object, when described switch object is activated, carry out the global command that is used to specify system unit; And
Carry out described global command so that send the instruction of the ON-OFF of change appointing system parts.
22. method as claimed in claim 13 further comprises:
From described first set, select one or more controlling object to come the specified parts type;
On described user interface, present switch object, when described switch object is activated, carry out the global command be used for one or more system units of being complementary with described unit type; And
Carry out described global command, to send the instruction of the ON-OFF of changing the described one or more system units that are complementary with described unit type.
23. method as claimed in claim 13 further comprises:
The one or more controlling object of selection are specified the zone in the controlled environment from described first set;
On described user interface, present switch object, when described switch object is activated, carry out the global command of the one or more system units be used to be positioned at described zone; And
Carry out described global command, to send the instruction of the ON-OFF of changing the described one or more system units that are positioned at described zone.
24. method as claimed in claim 13 further comprises:
From described first set, select one or more controlling object to come the appointing system parts;
On described user interface, present switch object, when described switch object is activated, carry out the global command that is used to specify system unit;
At least one of one or more system units of the one or more system units from described global command, getting rid of one or more appointing system parts, be complementary with the specified parts type and the appointed area that is positioned at controlled environment; And
Carry out described global command, to send the instruction of the ON-OFF of changing all the appointing system parts except one or more system units of being got rid of.
25. method as claimed in claim 13 further comprises:
Specify inputing or outputing between one or more affiliate system component and main system parts to link or correlativity, thereby set up the system unit chain that comprises described main system parts and described one or more affiliate system component, wherein, described main system parts with from described first the set the main control object be associated.
26. method as claimed in claim 25, wherein, the activation of described main control object is filled described user interface with the control option, and described control option is used for fill order, with the operation of the described system unit chain of transmission control or the instruction of function.
27. a computer program that comprises computer usable medium has the computer readable program code unit that embeds in described medium, be used to make a plurality of system units in the computer management controlled environment, described computer program comprises:
The first computer readable program code unit is used for presenting first controlling object set on user interface, the interior one or more system units of each object and controlled environment are associated;
The second computer readable program code unit is used to respond and receives and from the activation signal that is associated of controlling object of described first set, selective system parts;
The 3rd computer readable program code unit is used for filling described user interface by the control option that is used for selected system unit; And
The 4th computer readable program code unit is used for each control option is associated with the operation of controlling selected system unit or the executable command sequence of function with send instructing.
28. computer program as claimed in claim 27 further comprises:
The 5th computer readable program code unit is used for presenting the set of second controlling object on described user interface, its expression can provide the affiliate system component of input to selected system unit.
29. computer program as claimed in claim 27, wherein, a plurality of zones of described first controlling object set expression, each zone comprises the one or more system units in the controlled environment, described computer program further comprises:
The 5th computer readable program code unit is used to respond and receives and from the activation signal that is associated of controlling object of described first set, select the zone; And
The 6th computer readable program code unit, be used for gathering and fill described user interface to represent to select the available system components in the zone with second controlling object, wherein, response receives and the activation signal that is associated from described second controlling object of gathering, and selects selected system unit.
30. computer program as claimed in claim 27, wherein, a plurality of unit types in described first controlling object set expression controlled environment, described computer program further comprises:
The 5th computer readable program code unit is used to respond receive with described first and gathers the activation signal that is associated, alternative pack type; And
The 6th computer readable program code unit, be used for gathering and fill user interface to represent Free Region with second controlling object, each zone comprises one or more system units of the selected unit type in the controlled environment, wherein, response receives the activation signal that is associated with described second set, selects selected system unit.
CNB2004800383450A 2003-11-03 2004-11-03 User interface for multi-device control Expired - Fee Related CN100480962C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US51630203P 2003-11-03 2003-11-03
US60/516,302 2003-11-03
US10/783,511 2004-02-23

Publications (2)

Publication Number Publication Date
CN101019090A true CN101019090A (en) 2007-08-15
CN100480962C CN100480962C (en) 2009-04-22

Family

ID=38727247

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2004800383450A Expired - Fee Related CN100480962C (en) 2003-11-03 2004-11-03 User interface for multi-device control

Country Status (1)

Country Link
CN (1) CN100480962C (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101877724A (en) * 2009-04-28 2010-11-03 英特尔公司 Intuitive data transfer between connected devices
CN102713814A (en) * 2009-11-23 2012-10-03 Lg电子株式会社 Apparatus for controlling multimedia device and method for providing graphic user interface
CN101995828B (en) * 2009-08-24 2012-11-21 厦门立林科技有限公司 Building method of user operating interface of intelligent home control device
CN104137474A (en) * 2011-12-21 2014-11-05 英特尔公司 Mechanism for facilitating proxy user interface-based remote management and control of computing and non-computing devices
CN104374193A (en) * 2013-08-13 2015-02-25 义获嘉伟瓦登特公司 A dental furnace equipped with an indication and operation device
CN104756506A (en) * 2012-10-24 2015-07-01 索尼公司 HDMI device control via IP
CN104780460A (en) * 2015-03-20 2015-07-15 广东欧珀移动通信有限公司 Method for displaying navigation buttons and mobile terminal
CN104777986A (en) * 2015-03-20 2015-07-15 广东欧珀移动通信有限公司 Navigation processing method and mobile terminal
CN105874749A (en) * 2014-09-12 2016-08-17 松下电器(美国)知识产权公司 Information device control method and program
CN106104420A (en) * 2014-01-07 2016-11-09 开放电视公司 Show the system and method for integrated home automation module
CN106292407A (en) * 2015-06-02 2017-01-04 兆利丰股份有限公司 Built-in graphic user interface is described in the autocontrol method of Internet of things device
CN110087112A (en) * 2013-05-14 2019-08-02 谷歌有限责任公司 The method and system of remote media control

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160373529A1 (en) * 2014-04-04 2016-12-22 Panasonic Intellectual Property Management Co., Ltd. Electric apparatus management method, management apparatus, and electric apparatus management program
CN106839343B (en) * 2017-03-27 2019-09-13 广东美的制冷设备有限公司 Display device and method based on mobile terminal

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1175623C (en) * 2001-07-25 2004-11-10 台均实业有限公司 Comprehensive remote control method and device for household appliance via remote control code

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9160814B2 (en) 2008-11-10 2015-10-13 Intel Corporation Intuitive data transfer between connected devices
CN101877724A (en) * 2009-04-28 2010-11-03 英特尔公司 Intuitive data transfer between connected devices
CN101877724B (en) * 2009-04-28 2013-09-11 英特尔公司 Intuitive data transfer between connected devices
TWI485613B (en) * 2009-04-28 2015-05-21 Intel Corp Communication apparatus,communication method and non-transitory computer readable medium
CN101995828B (en) * 2009-08-24 2012-11-21 厦门立林科技有限公司 Building method of user operating interface of intelligent home control device
CN102713814A (en) * 2009-11-23 2012-10-03 Lg电子株式会社 Apparatus for controlling multimedia device and method for providing graphic user interface
CN102713814B (en) * 2009-11-23 2015-05-13 Lg电子株式会社 Apparatus for controlling multimedia device and method for providing graphic user interface
CN104137474A (en) * 2011-12-21 2014-11-05 英特尔公司 Mechanism for facilitating proxy user interface-based remote management and control of computing and non-computing devices
CN104756506A (en) * 2012-10-24 2015-07-01 索尼公司 HDMI device control via IP
US11954306B2 (en) 2013-05-14 2024-04-09 Google Llc System for universal remote media control in a multi-user, multi-platform, multi-device environment
CN110087112A (en) * 2013-05-14 2019-08-02 谷歌有限责任公司 The method and system of remote media control
CN110087112B (en) * 2013-05-14 2021-09-03 谷歌有限责任公司 Method, system and storage medium for remote media control
CN104374193A (en) * 2013-08-13 2015-02-25 义获嘉伟瓦登特公司 A dental furnace equipped with an indication and operation device
CN104374193B (en) * 2013-08-13 2019-01-15 义获嘉伟瓦登特公司 It is equipped with the dental furnace of instruction and operating device
CN106104420A (en) * 2014-01-07 2016-11-09 开放电视公司 Show the system and method for integrated home automation module
CN105874749A (en) * 2014-09-12 2016-08-17 松下电器(美国)知识产权公司 Information device control method and program
CN105874749B (en) * 2014-09-12 2020-06-09 松下电器(美国)知识产权公司 Information device control method and program
CN104777986A (en) * 2015-03-20 2015-07-15 广东欧珀移动通信有限公司 Navigation processing method and mobile terminal
CN104780460B (en) * 2015-03-20 2017-11-24 广东欧珀移动通信有限公司 A kind of the navigation button display methods and mobile terminal
CN104780460A (en) * 2015-03-20 2015-07-15 广东欧珀移动通信有限公司 Method for displaying navigation buttons and mobile terminal
CN106292407A (en) * 2015-06-02 2017-01-04 兆利丰股份有限公司 Built-in graphic user interface is described in the autocontrol method of Internet of things device

Also Published As

Publication number Publication date
CN100480962C (en) 2009-04-22

Similar Documents

Publication Publication Date Title
JP5557798B2 (en) User interface for multi-device control
CN101124530B (en) Method, and system for setup of multi-device control
JP5231480B2 (en) Method, system, and computer program for managing a controlled residential or non-residential environment
CN101583931B (en) Product for managing controlled residential or non-residential environments
CN101379817B (en) Programmable multimedia controller with programmable services
US7024256B2 (en) Method, system, and computer program product for automatically managing components within a controlled environment
CN100480962C (en) User interface for multi-device control
CN1679019B (en) Method, device and system for managing controlled residential or non-residential environments
JP2005531206A (en) Programmable general-purpose remote control device for individuals
CN102204215A (en) Touch-sensitive wireless device and on screen display for remotely controlling a system
CN100394383C (en) Method, system, and computer program product for automatically managing components within a controlled environment
US20030227485A1 (en) Method and apparatus for controlling and receiving data from connected devices

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: ID8 GROUP R2 STUDIOS, INC.

Free format text: FORMER OWNER: OPENPEAK INC.

Effective date: 20140410

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20140410

Address after: American California

Patentee after: ID8 Group R2 Studios, Inc.

Address before: American Florida

Patentee before: Openpeak Inc.

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20180214

Address after: Washington State

Patentee after: MICROSOFT TECHNOLOGY LICENSING, LLC

Address before: Washington State

Patentee before: Microsoft Corp.

Effective date of registration: 20180214

Address after: Washington State

Patentee after: Microsoft Corp.

Address before: American California

Patentee before: ID8 Group R2 Studios, Inc.

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090422

Termination date: 20191103

CF01 Termination of patent right due to non-payment of annual fee