WO2007109566A2 - User control interface for convergence and automation system - Google Patents
User control interface for convergence and automation system Download PDFInfo
- Publication number
- WO2007109566A2 WO2007109566A2 PCT/US2007/064211 US2007064211W WO2007109566A2 WO 2007109566 A2 WO2007109566 A2 WO 2007109566A2 US 2007064211 W US2007064211 W US 2007064211W WO 2007109566 A2 WO2007109566 A2 WO 2007109566A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user
- convergence
- configuration
- automation system
- pane
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/2818—Controlling appliance services of a home automation network by calling their functionalities from a device located outside both the home and the home network
Definitions
- the invention is directed to an automation convergence system user control interface, and more particularly to a user control interface using Web services for devices in an automation convergence system. '
- CD/DVD player Household, academic facility and/or business spaces now more commonly have more than one audio or video device such as CD/DVD player, portable MP3 player, tuner, preamp, power amp, speakers, VCR 1 DVR, computers running media players or connected to some other source of audio or video (e.g., Internet radio, satellite radio and the like), etc.
- a CD/DVD player from one company comes with its own remote control and an amplifier by an entirely different company comes with its own remote control.
- the same space may have a PC with its keyboard and mouse, and yet another company's portable MP3 player with its own control switches.
- each audio device While each audio device is doing precisely what it was designed to do, each operates completely independent from the others with the possible exception of the portable MP3 player that may be connected to a PC for synchronization. As a result, a user ends up going from one keypad to another or juggling a series of remote controls in order to control the devices.
- these audio/video and similar devices are not designed to communicate with each other or their communication is very limited, access to these audio/video devices is limited by their physical locations. For example, it is difficult to play an MP3 file saved in a PC hard disk drive in one room or area (a child's bedroom) on speakers located in another room or area (an entertainment room). Thus, in order for a user to enjoy music of his or her choice whenever and wherever he or she wants, each room needs to be equipped with all the necessary audio/video equipment and digital audio/video content.
- the audio/video devices are not designed to communicate with other home devices (e.g., TV, lighting, security system, etc.).
- other home devices e.g., TV, lighting, security system, etc.
- the user in order to watch a movie, the user must turn on a TV, a DVD player and an audio amplifier by using three different remote controls. Then the user must set the TV to receive a video signal from the DVD player, set the audio amplifier to receive an audio signal from the DVD
- a convergence and automation system includes an internet-protocol based (IP) network implemented with a web service for devices (WSD) protocol, a plurality of devices connected to the network, wherein each device is configured to perform at least one service, a server implemented with the WSD protocol, connected to the network and configured to control the devices for converging and automating the services thereof, and at least one client implemented with the WSD protocol, connected to the network and configured to control at least a portion of the services of the devices.
- IP internet-protocol based
- WSD web service for devices
- an article includes a machine readable medium having embodied thereon a program executable by a machine to allow a user to configure a convergence and automation system.
- the convergence and automation system includes an internet-protocol based network, hardware implemented with a web service for devices (WSD) protocol and software implemented with the WSD protocol and configured to establish communication in the hardware and perform a logging function to record said events and errors.
- WSD web service for devices
- FIG. 1 shows an overview of an automation convergence system for use with a portable remote control, communications and media consumption device constructed according to the principles of the invention
- FIG. 2 shows a screen capture image of a control panel for configuring a convergence and automation system (CAS), constructed according to the principles of the invention
- Figs. 3(A) and 3(B) show screen capture images of the control panel of Fig. 2 being used for locating and activating a configuration, respectively;
- FIGS. 4(A) and 4(B) show screen capture images of the control panel of Fig. 2 being used for adding and editing a component, respectively;
- Fig. 5 shows a screen capture image of the control panel of Fig. 2 being used for adding or editing a zone
- Fig. 6 shows a screen capture image of the control panel of Fig. 2 being used for adding or editing a source
- Figs. 7(A), 7(B), 7(C) and 7(D) show screen capture images of the control panel of Fig. 2 being used for adding, discovering and controlling a device, and viewing device manufacturer information, respectively;
- Figs. 8(A) and 8(B) show screen capture images of the control panel of Fig. 2 being used for adding and editing a device control group, respectively;
- Fig. 9 shows a screen capture image of the control panel of Fig. 2 being used for creating a script
- Figs. 10(A) and 10(B) show screen capture images of the control panel of Fig. 2 being used for creating and editing a trigger, respectively;
- Fig, 11 (A) shows a relationship between a script and schedule
- Fig. 11(B) shows a timing line showing how the scheduled script shown in Fig.
- 11(A) operates as a function of time
- FIG. 11 (C) shows a screen capture image of the control panel of Fig. 2 being used for creating a Schedule
- Figs. 12(A) and 12(B) show screen capture images of the control panel of Fig, 2 being used for starting and stopping/restarting a service, respectively;
- Figs. 13(A), 13(B), 13(C), 13(D), 13(E) and 13(F) show screen capture images of the control panel of Fig. 2 being used for setting up a new template;
- Figs. 14(A), 14(B), 14(C) and 14(D) show screen capture images of the control panel of Fig. 2 being used for defining a command in setting up a new template;
- Figs. 15(A), 15(B) and 15(C) show screen capture images of the control panel of Fig. 2 being used for adding a new template to a configuration and testing functionality thereof.
- Fig. 1 shows an overview of a convergence and automation system (CAS) for use with a portable remote control, communications and media consumption device constructed according to the principles of the invention.
- the CAS solution may be a combination of hardware and software.
- the hardware may include a server 100 connected to a network 102 (e.g. IP based wired or wireless network such as an Ethernet network) and may possibly be connected to the internet 104, devices 120 (e.g. audio 121 , video 122, intercom 123, lighting 124, security system 125, HVAC 126, and the like) and clients 110 (e.g. TV 112, personal computer (PC) 111 , personal digital assistance (PDA)
- PC personal computer
- PDA personal digital assistance
- the clients 110 may include a remote control 115 or a portable device 106 for remote control, communications and media consumption, which may be configured to function as both the client and device.
- the server 100 may be any type of computer, such as a PC connected to the network 102.
- the clients 110 such as clients 111 , 112, 113, 114 provide a user with control over the devices 120 such as devices 121, 122, 123, 124, 125, 126.
- the software i.e. application
- the application enables the hardware devices 120 and/or clients 110 to communicate with each other despite their different proprietary languages and communication protocols, and may provide the user with control over most or all the devices 120 from a single client.
- the application may utilize at least one portion of the hardware to send commands to the devices 120 and receive feedback from them.
- the application integrates centralized device control into a PC based media environment (e.g., Microsoft Windows XP Media CenterTM or Microsoft Windows VistaTM environment) that may store, organize and play digital media content.
- the user may use the remote control 115 or the portable device 106 to listen to music, watch and record television, enjoy family photographs and home movies, as well as adjust the lighting, secure the home, adjust the temperature, distribute music throughout the house, check surveillance cameras and the like.
- the portable device 106 has further communication features as noted below.
- the application may be implemented with Web Services.
- Web Services use standard Internet protocol (IP) and are based on standard XML-related technologies such as SOAP (Simple Object Access Protocol) for communications and WSDL (Web Services Device Language) to describe interfaces.
- SOAP Simple Object Access Protocol
- WSDL Web Services Device Language
- the devices implemented with Web Service for Devices (WSD) become black boxes on the network, providing services to any application, on any platform, written in any language.
- WSD Web Service for Devices
- UPD Universal Plug and Play
- the application maximizes flexibility and scalability with an elegant n-tiered, service oriented architecture that allows loosely coupled components to easily interact with each other across the network.
- the application may be created using MicrosoftTM NET framework and coded primarily in C#.
- the application accordingly embraces the tremendous benefits of web services for the control of the devices.
- the device / software modules, methods or implementations described herein are intended for operation with dedicated hardware implementations including, but not limited to, semiconductors, application specific integrated circuits, programmable logic
- V149I890 arrays and other hardware devices constructed to implement the software modules, methods or implementation functionality described below.
- various embodiments of the invention described herein are intended for operation as software programs running on a computer processor such as PC running the WindowsTM operating system as is well known in the art.
- the functional and operational description of the various device / software modules, methods or implementations described herein may be used together, separately, or in various combinations thereof.
- the application as implemented in the device / software modules will now be described in detail. [0034]
- the invention is directed to a user interface for configuring CAS to maximize its convergence and automation capabilities.
- Fig. 2 shows an exemplary user interface configuration window 10, which will be referred to as a control panel, constructed according to the principles of the invention.
- the control panel of the invention may be integrated with the control panel of a WindowsTM operating system.
- the control panel application may be started by opening Windows ExplorerTM, navigating to the applications folder in the automation convergence folder on the local drive, and double-clicking the corresponding executable file or program (e.g., controlpanel.exe).
- the user may navigate the control panel 10 using a mouse, keyboard, input device, or the like. As shown in Rg.
- the control panel 10 of the invention may include several elements such as a menu bar 12, navigation pane 14, functional area pane 16, definition pane 18, device control buttons 20, control pane 22, server pane 24 and/or component/device name bar 26 and the like that provides control of all of the devices and clients.
- the menu bar 12 may provide menus for the control panel 10, such as "File” (i.e., save, save all, and/or exit functions and/or the like), "Edit” (i.e. new configuration, new component, new device, new schedule, new script and/or delete functions and/or the like), "View” (i.e., server function and/or the like), "help” (i.e. about function and/or the like).
- the navigation pane 14 may contain configurations, devices, schedules and/or scripts and/or the like in a tree view. As well known, if a navigation item has a plus (+) sign next to it, the user may click the item to view additional sub items. If a navigation item has a minus (-) sign next to it, the user may click the item to hide the additional sub items. [0038]
- the functional area pane 16 may contain several buttons for "Configuration,” “Devices,” “Scheduling,” “Scripting,” “Triggers,' “Templates,” and/or the like.
- the “Configuration” button allows the user to add and edit configurations on servers.
- the “Devices” button allows the user to view original manufacturer information, test devices, and control devices.
- the “Scheduling” button allows the user to set up schedules to run scripts.
- the "Scripting” button allows the user to create and edit scripts for running components and devices.
- the “Triggers” button allows the user to identify a specific device status and condition as a trigger to automatically execute a script when it occurs.
- the “Templates” button allows the user to add control for certain non-certified devices (CD players, DVD players, audio receivers, displays, and so on).
- the definition pane 18 may display the definitions and descriptions of component, communication, and device settings associated when the user clicks in the setting field in the control pane 22.
- the device control buttons 20 may be provided to ⁇ enable the user to control and test the devices and may include "start,” “stop” and/or “restart” buttons and/or the like.
- the control pane 20 may display the information about
- the control pane 20 may be where the user completes the majority of the work including adding or editing settings.
- the server pane 24 may display all of the servers (service providers) on the automation network. The servers with a check mark next to them are selected and displayed in the Navigation pane 14. To select a server and display it in the Navigation pane, the user may click the server in the Server pane 24.
- the component/device name bar 26 displays the name of the component or device selected by the user selected from the Navigation pane 14. To exit the control panel 10, the user may click the close X in the upper-right corner of the control panel 10. If the user has made changes to a configuration, he or she may be prompted to save the configuration before closing. Next, each of the features of the functional pane 16 will be discussed.
- a configuration is a collection of components, devices, menus, scripts, and schedules and corresponding properties for a particular installation.
- the user Before using the convergence system, the user may need to create a configuration for the network that he or she is working with. This configuration may run on the convergence system and may become part of the interface that the user interacts with daily. Before working with a configuration, the user may need to review the product sheets and other information provided by the convergence system installers to determine friendly names, communications settings, and device settings, so the information in the configuration matches the information provided by the installers.
- the user may start the control panel 10 as previously mentioned, click the "Configurations” button in the functional area pane 16, click the name of the server displayed in the Servers pane 24 that he or she wants to add the configuration to. Subsequently, the selected server may appear in the navigation pane 14 where the user may select the server that he or she wants to add the configuration to and, and click "New" and "Configuration.” Then, the user may, in the control pane 22, under "Configuration Name,” highlight the name in the field and type the new name for the configuration, which results in changing of the name in the navigation pane 14.
- the user may select "Configuration" in the functional area pane 16.
- the user may select the name of the server that contains the configuration. If the user is unsure of which server contains the configuration, the user may click each server to place a check mark next to the server name to display the server in the Navigation pane 14 so that the user can view all configurations on the network.
- the server name the name of the server that contains the configuration.
- VtW 890 selected server may be displayed in the Navigation pane 14, as shown in Fig 3(A).
- the user may select the server that contains the configuration and further select the name of the configuration the user wants to view.
- the Configuration Name field may be displayed in the Control pane 22. If the configuration contains components, devices, scripts, and schedules, a plus (+ ⁇ sign may be displayed next to the configuration name. Otherwise, no plus (+) nor minus (- ) sign may be displayed next to the configuration name. If a plus (+) sign is displayed, the user may select the item to view additional sub items. If a navigation item has a minus (-) sign next to it, the user may click the item to hide the additional sub items.
- Editing a configuration may involve adding, editing, or deleting components, devices, scripts or schedules. Editing a configuration in the control panel enables the user to change the name of the configuration.
- the user may start the control panel 10 and select "Configuration" in the functional area pane 16. Then, the user may select the name of the server that contains the configuration 5 to be edited in the Servers pane 24, which may cause the selected server to be displayed in the Navigation pane 14.
- the user may select the server that contains the configuration to be edited and select the configuration to view the configuration contents in the Navigation pane 14. Then, the user may, in the Control pane 22, under "Configuration Name," highlight the name of the configuration and type the new 0 configuration name, if required. Otherwise, the user may need to follow other appropriate procedures to make the changes.
- the user may need to save the configuration for the changes to be applied. If the user makes a change and does not save the configuration before closing the control panel, the user may be prompted to save 5 changes. To save a configuration, after making changes to the configuration, the user may select "File" and "Save” in the menu bar 12. The control panel 10 may display messages regarding verifying the number of devices and verifying the number of scripts if these numbers do not exceed the maximum counts. The configuration is then saved. If the configuration is not the active configuration, the user may not be able to view the D changes. To view the changes, the user may need to set the configuration as the active configuration.
- Activating a configuration may set one configuration as the running configuration on the server (i.e., service provider).
- Each service provider may have multiple configurations, but may have only one active configuration.
- 5 the user may click "Configuration" in the functional area pane 16. Then, the user may select the name of the server In the Servers pane 24 that contains the configuration to be
- ⁇ 4491890 activated, which may result in the server being displayed in the Navigation pane 14.
- the user may select the server name containing the configuration to be activated. Then, the user may, in the Control pane 22, under Active Configuration, select the configuration to activate from the drop-down list, as shown in Fig 3(B). The configuration is then activated, and the next time the user starts the configuration tool, this configuration may be displayed as the active configuration.
- Configurations may become obsolete over time as components change and the home network grows. When this occurs, the user may delete a configuration that is no longer useful. If the user deletes a configuration and has no archived copies of the configuration, he or she may lose all information in the configuration. If the user deletes an active configuration on a server (i.e., service provider), the user may have to activate a different configuration.
- a server i.e., service provider
- the user may need to verify that the configuration to be deleted is not the active configuration on the server. If the configuration to be deleted is the active configuration on the server, the user may need to make a different configuration active on the server. Then, the user may need to verify that he or she wants to permanently delete the configuration.
- the process of deleting a configuration from a server may start by selecting "Configuration" in the functional area pane 16. Then, in the Servers pane 24, the user may select the name of the server that contains the configuration to be deleted. In the Navigation pane 14, the user may select the plus (+) sign next to the server name containing the configuration to be deleted to display all configurations on that server. Then, in the Navigation pane 14, the user may select the configuration to be deleted and select "Delete.”
- the control panel 10 may display a verify deletion message. By verifying deletion, the configuration may be deleted from the server.
- Components are the basic building block of a CAS configuration that may include a centralized intelligent system and the devices regulated by the intelligent system.
- a component may be any one of the devices 120 or client 110 shown in Fig. 1.
- a component may be an HVAC system controller (i.e., intelligent system) combined with the thermostats (i.e., devices) regulated by the intelligent system.
- the user Before adding devices, creating scripts or schedules, or using CAS, the user may need to add components to a configuration. After creating a new configuration, the user may continue adding components as systems are added to the network. To add a component to a configuration, the user may select "Configuration" in the functional area
- the user may click the name of the server that contains the configuration that he or she wants to which to add a component. Then, the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may select the plus (+) sign next to the server name containing the configuration he or she wants to add a component, which may result in all configurations on the server being displayed in the Navigation pane 14. In the Navigation pane 14, the user may select the configuration that he or she wants to add a component to. Then, the user may select "New,” select the component category, and then select the component to be added to the configuration, as shown in Fig 4(A). The component is then added to the configuration and the component settings may be displayed in the control pane 22.
- the user may need to edit a component in an existing configuration to meet the user's needs. The user may not need to create a new configuration to make a change to the component because he or she may simply edit the existing component.
- the user may select "Configuration" in the functional area pane 16.
- the user may select the name of the server that contains the configuration with the component to be edited, which may result in the server being displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration and component to be edited, which may result in all available configurations on the server being displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the configuration containing the component to be edited and then select the component category containing the component to be edited.
- the user may make any changes to the component settings by double-clicking in a setting name and type a new value or making a new selection from a list, as shown in Fig 4(B). After making all changes, the user may save the configuration by selecting "File” and "Save” in the menu bar 12.
- the user may open the configuration and delete the component from the configuration.
- the user may select "Configuration" in the functional area pane 16.
- the user may select the name of the server that contains the configuration with the component to be deleted, which may result in the server being displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration and component to be deleted. Then the user may click the plus (+) sign next to the configuration containing the
- the user may right-click the component category containing the component to be deleted and select "Delete.”
- the control panel 10 may display a deletion verification message. By clicking "Yes,” the selected component may be deleted.
- a zone is an area of coverage for an audio component, a security system component and/or the like.
- one security camera component may cover a back door and patio area (zone 1) and a second security camera component may cover a front door area (zone 2).
- more than one zone may be associated with a component.
- the user may select "Configuration" in the functional area pane 16.
- the user may select the name of the server that contains the configuration with the component he or she wants to add a zone to. Then, the server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration and component he or she wants to add a zone.
- the user may click the plus (+) sign next to the configuration containing the component that he or she wants to add a zone.
- the user may select the component category containing the component that he or she wants to a zone.
- the user may select "Zones” and then select a button next to "Collection,” which may open a zone configuration collection editor, as shown in Fig. 4(B).
- the user may select "Add" which causes the zone to be added to the Members list.
- the user may edit the zone.
- the user may edit the zone.
- the user may click the name of the server that contains the configuration with the component of the zone to be edited, which may result in the server being displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration and component of the zone to be edited.
- the user may click the plus (+) sign next to the configuration containing the component of the
- VM9I890 zone to be edited In the Navigation pane 14, the user may click the component category containing the component of the zone to be edited. In the Control pane 22, the user may select "Zones" and then select the button next to "Collection,” which may open a zone configuration collection editor, as shown in Fig. 4(B). In the zone configuration collection editor, under “Members,” the user may select the zone to be edited. In the Properties pane, the user may select "ID” and type the new ID for the zone, and then select "Name” and type the new name of the zone. After making changes, the user may need to save the configuration. [0055] As the network changes and audio and security components are added and deleted from the network, the user may delete zones to fit the users' needs.
- the user may select "Configuration" in the functional area pane 16.
- the user may click the name of the server that contains the configuration with the component of the zone to be deleted, and the server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration and component of the zone to be deleted.
- the user may click the plus (+) sign next to the configuration containing the component zone to be deleted.
- the user may select the component category containing the component of the zone to be deleted.
- the user may select “Zones” and then click the button next to "Collection,” and the zone configuration collection editor may open.
- the zone configuration collection editor under “Members,” the user may select the zone to be deleted. By clicking “Remove,” the selected zone is removed. After making the changes, the user may need to save the configuration.
- Sources are hardware elements, such as receivers, CD players and the like, that provide audio content to the audio devices in the CAS.
- the user adds an audio component, he or she may need to associate a source with the component so that the component may be able to access the audio content.
- the user may change the source associated with the audio component if necessary.
- the user may select "Configuration" in the functional area pane 16.
- the user may select the name of the server that contains the configuration with the component that he or she wants to add a source to, and then the server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration and
- the user may click the plus (+) sign next to the configuration containing the component that he or she wants to add a source to.
- the user may select the component category containing the component that he or she wants to add a source to.
- the user may select "Sources” and then click the button next to "Collection,” which may open the source configuration collection editor.
- the user may select "Add” which result in the source being added to the Members list. Under “Members,” the user may select the source that has been just added.
- the user may double-click each of the settings shown in Table 2 and provide a value for the setting. After adding all sources, the user may need to save the configuration.
- the user may select "Configuration" in the functional area pane 16.
- the user may select the name of the server that contains the configuration with the component that he or she wants to edit a source, and then the server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration and component that he or she wants to edit a source.
- the user may click the plus (+) sign next to the configuration containing the component that he or she wants to edit a source.
- the user may select the component category containing the component that he or she wants to edit a source for.
- the user may select "Sources" and then click the button next to
- “Collection” which may open the source configuration collection editor, as shown in Fig. 6.
- the user may select the name the source to edit.
- the user may double-click each of-the settings shown in Table 2 and provide a value for the setting. After editing all sources, the user may need to save the configuration.
- the Servers pane 24 the name of the server that contains the configuration with the component that he or she wants to delete a source from, which may result in the selected server being displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration and component that he or she wants to delete a source from and then click the plus (+) sign next to "Configuration.”
- the user may click the component category containing the component that he or she wants to delete a source from.
- the user may select "Sources” and then click the button next to "Collection” which opens the source configuration collection editor. In the editor, the user may select "Remove” which may result in the source being removed from the Members list. After deleting the sources, the user may need to save the configuration.
- Devices may be individual hardware elements in a home network such as a light, thermostat and the like. Figuratively speaking, the devices are one half of a component in the CAS, with the other half being a centralized intelligence system, which regulates the operation of the device.
- the user may need to have components in the configuration.
- the user may add a component and device during the same process, but in the configuration tool these tasks may need to be separate processes.
- the user may only be able to associate a device that is compatible with the specific component.
- the user may not be able to add a lighting device to an HVAC component as these two are may not be compatible.
- the user may be able to include the device in a script to run automatically (i.e., on a schedule) or manually (i.e , by button).
- the user may also be able to associate a device with a sub menu to display the device in the room menu for a specified room.
- the user may have to use the configuration tool to work with menus.
- Adding a device may be associating the device with a component controller (i.e., the intelligent system).
- the user when the user adds a lighting device, he or she may associate the specific light with the intelligent lighting system, which may receive the commands from the CAS server and regulates the light. As time passes, the user may be able to add new devices due to remodeling, additions, or other changes. The user may not need to create a new configuration to add a new device. [0062] To add a device to a configuration, after starting the control panel 10 and selecting "Configuration" in the functional area pane 16, the user may select, in the
- the name of the server that contains the configuration he or she wants to add a device to and the server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration he or she wants to add a device to, and then click the plus (+) sign next to the configuration.
- the user may select the component that he or she wants to add a device to and select "New,” and select the device he or she wants to add to the component.
- the device may be added to the configuration directly beneath the component in the Navigation pane and the device settings may be displayed in the Control pane 22.
- the user may select a setting to activate the setting and make a change to the setting value. After completing all of the changes to the settings, the user may need to save the configuration.
- a device is produced in a manner that enables it to be discovered on a network, the user may be able to discover the device along with all of the properties associated with the device.
- Discovery is the ability of CAS to automatically detect components on the same network and retrieve information about the devices. If the user adds a light to a network that supports automatic discovery, he or she may not have to add properties manually to the configuration to support the light because all of the information related to the light may be automatically recognized and placed into the proper files for use in the CAS. Not all components or devices may be produced to be discovered. If a component or device cannot be discovered, a Discovery button may not appear.
- the user may select, in the Servers pane 24, the name of the server that contains the configuration and component that he or she wants to discover devices for and the server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration that contains the component that he or she wants to discover devices, and then click the plus (+) sign next to the configuration.
- the user may click the component that he or she wants to discover devices.
- the user may select the Discover button in the lower right of the window, as shown in Fig. 7(B).
- the devices may be discovered and added to the Navigation pane 14 under the component, and the user may be able to edit the device settings, if required, After discovering the devices, the user may need to save the configuration.
- the user may select, in the Servers pane 24, the name of the server that contains the configuration containing the device to be edited, and the
- VM9I890 server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration that contains the device to be edited, and then click the plus (+) sign next to the configuration.
- the user may click the plus (+) sign next the component containing the device to be edited.
- the user may select the device to be edited, as shown in Fig. 7(B), and the device settings may be displayed in the Control pane 22.
- the user may select a setting to activate the setting and make a change to the setting value. After completing all of the changes to the settings, the user may need to save the configuration. [0066] To delete a device, after starting the control panel 10 and selecting
- the user may select, in the Servers pane 24, the name of the server that contains the configuration containing the device to be deleted and then the server may be displayed in the Navigation pane 14.
- click the plus (+) sign next to the server name containing the configuration that contains the device to be deleted and then click the plus (+) sign next to the configuration.
- the user may select the plus (+) sign next the component containing the device to be deleted. Under the component, the user may select the device to be deleted.
- “Delete” the device may be deleted, A deletion verification message may occur to make sure the user wants to delete the device. After completing all of the changes to the settings, the user may need to save the configuration.
- Controlling a device may be useful when the user has added a new device and wants to test it to ensure that device is working properly.
- the user may select "Devices" in the functional area pane 16. Then, the user may select, in the Servers pane 24, the name of the server that contains the configuration containing the device he or she wants to control, and the server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration that contains the device he or she wants to control, and then click the plus (+) sign next to the configuration.
- the user may click the plus (+) sign next the component containing the device that he or she wants to control.
- the user may select, under the component, the device he or she wants to control, and the device controls may be displayed in the Control pane 22.
- the user may click a Control tab to ensure that the device controls display.
- the user may type new values or make selections from lists to control the device. For example, if the user is controlling or testing a thermostat, he can change the heat temperature set point to a new value, change the
- VM9I890 mode of operation from OFF to AUTO 1 and turn the fan ON, as shown in Fig. 7(C).
- the changes made by the user may control the device appropriately. If there is an issue, the user may need to ensure that the configuration is the active configuration and that the communication connection between the device and the computer is not experiencing errors.
- Viewing the Original Equipment Manufacturer (OEM) device information may be useful when the user needs to contact the manufacturer with a question or to find the serial number or firmware version used with the device.
- the user may select, in the Servers pane 24, the name of the server that contains the configuration containing the device for which he or she wants to view the OEM information, and then the server may be displayed in the Navigation pane.
- the user may click the plus (+) sign next to the server name containing the configuration that contains the device for which the user wants to view the OEM information, and then click the plus (+) sign next to the configuration.
- the user may click the plus (+) sign next the component containing the device for which he or she wants to view the OEM information.
- the user may select the device for which he or she wants to view the OEM information, and the device controls may be displayed in the Control pane 22.
- the user may select a "Description" tab to view the OEM information, as shown in Fig. 7(D). The user may not able to edit the OEM information from this page.
- Device Control Groups For certain control categories such as lighting, audio, shades, thermostats, ovens, and contact closures, the user may be able to group devices within the same component into a device control group. According to the invention, all of the devices in a control group may be controlled as a single device using the feedback provided by one device in the group that the user designates as the master device. In fact, device control groups may be configured to look just like a single device in the menu. When the user makes a change to a control group's settings, all of the devices in that group may be affected.
- the user may need to have components with devices already defined in the configuration.
- the user may access a component which supports device control groups, select a "Device Control Group” option, give the control group a "Friendly Name,” select the devices to include, set parameters for the devices, and designate a master device.
- the user may select, in the Navigation pane 14, select the desired configuration and then click the (+) sign beside the name of the component containing the devices he or she wants to group together. Then, the user may select the "Control Groups" option and select "New,” and then select the option that may appear highlighted.
- the user may type in the "Friendly Name.” For “Enabled,” the user may select “True” to enable the device control group. For “Log Tracing,” the user may select “True” to allow logging. For “Manipulation,” the user may select either "Relative” or “Absolute.” The user may be viewing the state of the master device when he or she accesses the control group to change its state. If the user wants the other devices to follow the master device exactly, he or she may select “Absolute.” If the user wants the other devices to change based on their current state, the user may select "Relative,” and the other devices may incrementally change to the same degree that he or she changes the master device.
- the user may click the down arrow to access a devices choice list, and select the checkbox beside the names of the devices he or she wants to group together.
- the user may click the down arrow to access the choice list of devices.
- the user may select the checkbox beside the name of the device he or she wants to be the master device for this group.
- the user may select the "Configuration" in the functional area panel 16.
- the user may select the desired configuration and then click the (+) sign beside the name of the component containing the device control group to be edited, as shown in Fig. 8(B). Then, the user may select the "Control Groups” option and select the control group to edit, and the settings for that control group may appear on the screen.
- the user may type in the "Friendly Name.” For “Enabled,” the user may select “True” to enable the device control group. For "Log Tracing,” the user may select “True” to allow logging.
- the user may select either “Relative” or “Absolute.”
- the user may be able to view the state of the master device when he or she accesses the control group to change its state. If the user wants the other devices to follow the master device exactly, he or she may select “Absolute.” If the user wants the other devices to change based on their current state, he or she may select "Relative,” and the other devices may incrementally change to the same degree that the user changes the master device.
- the user may click the down arrow to access the devices choice list, and select the checkbox beside the names of the devices he or she wants to group together.
- the user may click the down arrow to access the choice list of devices. The user may select the checkbox beside the name of the device he or she wants to be the master device for this group.
- the Servers pane 24 may show all of the servers (i.e., service providers) on the network. If the user has a complex installation, he or she may have several servers listed. Otherwise, less complex installations may have only one or two servers listed.
- the list of servers may be built dynamically from network information when the user starts the control panel 10. The user may not be able to add a server or delete a server from the list in the Servers pane 24. The user may, however, be able to choose which servers to display in the Navigation pane for better control over the amount of information and devices listed in the Navigation at one time. This may be useful in complex installations with several servers and hundreds of devices, which could cause the contents of the Navigation pane to become unwieldy.
- the user may select "Configuration" in the functional area pane 16.
- the user may select the name of the server he or she wants to view in the Navigation pane 14, and then the server may be displayed in the Navigation pane 14, thereby enabling the user to add, edit, or delete the configurations on the server. If the Servers pane 24 displays, but the user does not want
- the Severs pane 24 may be able to hide the Servers pane 24.
- the user may select "View” and "Servers” from the menu bar 12. Then, the Servers pane 24 may no longer be displayed in the control panel 10. If the Servers pane 24 is not displayed and the user wants to display the Servers pane 24, the user may change the setting to display the Servers pane 24. For example, to display the Servers pane 24 in the control panel, the user may select "View" and "Servers" from the menu bar 12. A check mark may be displayed next to "Servers" and the Servers pane 24 may be displayed in the control panel 10.
- a script may be a string of commands that sends actions to a variety of devices for a predetermined effect.
- the user may be able to simultaneously control different types of devices. For example, the user may have a script that sends a command to turn on the lights in the foyer, lower the audio volume, and then ramp up the temperature on the thermostat.
- Scripts may be triggered either manually (i.e., button activated) or automatically (i.e., scheduled).
- the user may only be able to create a script only after he or she adds all of the components and devices to a configuration. If the user changes a component or device after the script is created, the user may need to change the script to reflect the change.
- the user may create commands, which are instructions that he or she wants the CAS to follow.
- a command may consist of an action and the action properties.
- An action may specify what the user wants to happen and the action properties may specify how the user wants the action to occur. For example, bringing a light up to 50 percent brightness may involve the action of bringing the light up and the action property of 50 percent.
- Scripts may run in the order that the commands display in the script itself.
- the user Before creating a script, the user may need to add the components and devices that he or she wants to use in the script to the configuration that the user is adding the script to. If the user changes a component or device, or adds a new component that he or she wants to add to the script, the user may edit the script to reflect the changes. The user may add only one action to a command at a time and only one command to a device at a time. If the user wants to make a device do more than one action, he or she may need to break the action into single actions.
- thermostat For example, if the user wants a thermostat to set to 70 degrees and turn the fan on, he or she may need to create two separate commands: one for the thermostat to be set to 70 degrees and then a second command for the thermostat to turn on the fan. These separate commands may be displayed in the script as separate items.
- the user may select "Scripting" from the functional area pane 16.
- the user may click the name of the server that contains the configuration that he or she wants to add a script, and the server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration that he or she wants to add a script to.
- the user may select the name of the configuration that he or she wants to add a script to, and select click "New" and "Script Template.”
- the script may be added under the configuration name and the "New Script template" may be displayed in the control pane 22, as shown in Fig. 9.
- script Name the user may highlight the field value and type a new script name, which may be descriptive and unique for easier administration.
- the user may select the programming language to use for the script from the drop-down list, either C# or VisualBasicTM.
- Type the Sc ⁇ pt Body the user may type the script in the previously selected programming language. After adding all information to the script, the user may save the configuration. The user may now be able to schedule the script to run automatically, or run the script manually, depending on the situation. [0079] After creating a script, the user may test the script before placing it into operation. This will ensure that the devices are working as expected and the sequence of the commands is correct in the script.
- the user may, in the Servers pane 24, select the name of the server that contains the configuration containing the script to test.
- the server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration containing the script to test.
- the user may click the plus (+) sign next to the name of the configuration containing the script to test.
- the user may click the name of the script to test, and the script information may be displayed in the Control pane 22. Then, the user may click the "Execute” button in the lower right of the Control pane 22, as shown in Fig, 9.
- the devices may well be controlled by the script. If the script works properly, but continuously fails at the same spot, it may necessary to verify that the device that fails is installed and configured correctly, and that the script actions are appropriate for the device. [0080]
- the user may select "Scripting" from the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the
- the server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration containing the script to edit.
- the user may click the plus (+) sign next to the name of the configuration containing the script to edit.
- the user may click the name of the script to edit, and the script information may be displayed in the Control pane 22.
- the Control pane 22 under "Script Name," the user may highlight the field value and type the new script name. The user may make this script name descriptive and unique for easier administration. The user may need to avoid selecting a different programming language under "Language" to use for the script from the drop-down list.
- the existing script code may be deleted. Under "Type the Script Body," the user may make changes to the script in the previously selected programming language. After saving the configuration, the user may schedule the script to run automatically, or run the script manually, depending on the situation. [0081] To delete a script, the user may select "Scripting" from the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the configuration containing the script to delete, and the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration containing the script to delete. In the Navigation pane 14, the user may click the plus (+) sign next to the name of the configuration containing the script to delete. In the Navigation pane 14, the user may select the name of the script to delete and confirm the deletion.
- Triggers The user may identify a specific device status and condition as a trigger to automatically execute a "scene" when it occurs.
- a scene is the operation or script for a particular situation.
- One trigger may execute multiple scripts. However, only one trigger may be used per script. Possible status and conditions may differ depending on the type of device and include "greater than,” “less than,” “equal to,” and “not equal to.” For example, if a dimmer's load level (i.e., status) is set to "greater than” condition 50%, a scene may be automatically executed.
- the user may select "Triggers" from the functional area pane 16, which may open a new trigger template pane in the control pane 22, as shown in Fig.
- the user may, under "Trigger Details,” type in a friendly name for the trigger, and select “Enabled” to enable the trigger.
- Trigger Details type in a friendly name for the trigger
- End to enable the trigger.
- Device Details in the "Category” field
- the user may select the down arrow to access the Category choice list and select the category of device he or she wants. In the "Devices"
- the user may click the down arrow to access the choice list of devices, and select the name of the device that will trigger the script.
- Condition Details in the "Status” field, the user may select the down arrow to view the Status choice list, and select the desired status then select the "Condition” (i.e., greater than, less than, equal to, or not equal to) to be met.
- the user may select the "Value” or adjust to the desired value.
- the user may select a script to execute from the choice list of scripts in the left column, and select the right arrow to move the script into the right column. This script may be the first to execute when the condition the user specified is met. If the user wants this condition to trigger to execute multiple scripts, the user may repeat this step for each script you want the trigger to execute, in the order he or she wants the scripts to execute.
- the user may select "Triggers” in the functional area pane 16.
- the user may select the machine (i.e., service provider), configuration, and the trigger to edit.
- the Trigger pane under “Trigger Details,” the user may edit the desired parameters for the trigger, and select “Enabled” to enable the trigger.
- the user may click the down arrow to access the Category choice list and select the category of device he or she wants.
- the user may click the down arrow to access the choice list of devices, and select the name of the device that will trigger the script.
- the user may click the down arrow to view the Status choice list, select the desired "Status,” and then select the "Condition” (i.e., greater than, less than, equal to, or not equal to) to be met. From the “Values” choice list, the user may select the "Value” or adjust to the desired Value.
- the user may select a script to execute from the choice list of scripts in the left-hand column, and select the right arrow to move the script into the right column. To move scripts out of the right hand list, the user may select the script and then the left arrow to remove the script from the list. Scripts may execute in the order they appear in the list. Thus, the user may need to use the left and right arrows to move scripts around in the list.
- Schedules are time periods in which a script is to run.
- a schedule may consist of a schedule type (e.g., start time and date, or day) and an action (i.e., script to run).
- a schedule type e.g., start time and date, or day
- an action i.e., script to run.
- the user may need to add the components and devices to the configuration and create the script that he or she wants to run on the schedule the user is creating. The user may not need to create a schedule for each script immediately after
- Types of schedules include Daily (i.e., Schedule runs every day at the time specified), Weekly (i.e.. Schedule runs one time a week on the specified day and at the time specified), Monthly (i.e., Schedule runs one time a month on the specified date and at the time specified), OneTime (i.e., Schedule runs one time only on the specified date and at time specified) and/or the like.
- Daily i.e., Schedule runs every day at the time specified
- Weekly i.e.. Schedule runs one time a week on the specified day and at the time specified
- Monthly i.e., Schedule runs one time a month on the specified date and at the time specified
- OneTime i.e., Schedule runs one time only on the specified date and at time specified
- 11 (A) and 11 (B) show how scripts and schedules work together, in which a script involving a light, audio and thermostat are scheduled to be activated daily at 7:00 a.m.
- a script involving a light, audio and thermostat are scheduled to be activated daily at 7:00 a.m.
- the user wants to have a schedule run every other day, or only four days out of the week, he or she may need to set up individual schedules for the script to run. For example, if the user wants a script to run on Tuesday, Wednesday, and Friday, he or she may set up three separate weekly schedules, one schedule for Tuesday, one for Wednesday, and one for Friday.
- the user may create a new schedule for each script that he or she creates for a configuration.
- the schedules change the user may easily edit the schedules to meet the user's requirements.
- the user may select "Schedules" in the functional area pane 16.
- the user may click the name of the server that contains the configuration containing the script he or she wants to schedule, and the server may be displays in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration that contains the script to be scheduled.
- the user may select the name of the configuration containing the script to be scheduled and select "New" and "Schedule.”
- the user may select the name of the schedule he or she just added, and the schedule information may be displayed in the Control pane 22, as shown in Fig. 11(C).
- the user may, in the "Name” field, highlight the value and type the new name for the schedule.
- the name may be unique, brief, and descnptive of the schedule, such as "Good Morning.”
- the Script field the user may select the script to run on the schedule from the list. The user may need to have at least one script in the configuration before adding a schedule. If the list in the Script field is blank, the user may need to create the script to schedule before scheduling the script. After creating the script, the script may be displayed in the Script field list. Under “Trigger Details,” in the "Start Date” field, the user may select the date for the schedule to start from the drop-down list.
- the user may type the hour and minutes for the schedule to start, preferably in the format of "hh:mm° and then select AM (morning) or PM (evening) from the list.
- AM morning
- PM evening
- V4491890 options shown in Table 4 that he or she wants to use with this schedule. After completing all of the schedule settings, the user may save the configuration.
- the user may select "Scheduling" in the functional area pane 16.
- the user may select the name of the server that contains the configuration containing the schedule to be edited, and the server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration that contains the schedule to be edited.
- the user may click the name of the configuration containing the schedule to be edited.
- the user may click the name of the schedule to be edited, and the schedule information may be displayed in the Control pane 22, as shown in Fig.
- the user may highlight the value and type the new name for the schedule.
- the name may be unique, brief, and descriptive of the schedule.
- the user may select the script to run on the schedule from the list. The user may need to have at least one script in the configuration prior to adding a schedule. If the list in the Script field is blank, the user may need to create the script to schedule before scheduling the script. After creating the script, the script may be displayed in the Script field list.
- the user may need, in the "Start Time field, " to type the hour and minutes for the schedule to start in the format such as "hlrmm” and then select AM (morning) or PM (evening) from the list.
- AM morning
- PM evening
- the user may select one of the options described in Table 4 that he or she wants to use with this schedule. After completing all of the schedule settings, the user may save the configuration.
- the user may select the name of the server that contains the configuration containing the schedule to delete, and the server may display in the Navigation pane 14. In the Navigation pane 14, the user may click the
- the user may click the plus (+) sign next to the name of the configuration containing the schedule to delete. Then, the user may select the name of the schedule to delete and select "delete.”
- the schedule may be deleted from the configuration. The script may still remain and may not be impacted by the schedule deletion. If the user wants to run the script, he or she may need to either create a new schedule to run the script automatically or run the script manually.
- Each device configuration page may contain Stop, Start, and Restart buttons in the Device Control area of the Control pane 22. Using these buttons, the user may stop, start, or restart the device-specific portion of the software that enables control of the device. This may be useful when the user changes a device configuration and needs to restart the service before the new configuration can be used.
- the user may select "Configuration" from the functional area pane 16.
- the user may select the name of the server that contains the configuration containing the device he or she wants to start, and the server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration that contains the device to start and then click the plus (+) sign next to the configuration.
- the user may click the plus (+) sign next the component containing the device to start.
- the user may select the device to start, and the device settings may be displayed in the Control pane 22, as shown in Fig. 12(A).
- the user may click "Start" and then "Close” in the Service Control window, which may start the service.
- the user may select "Configuration" from the functional area pane 16.
- the user may select the name of the server that contains the configuration containing the device to stop, and the server may display in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration that contains the device to stop, and then click the plus (+) sign next to the configuration.
- the user may click the plus (+) sign next the component containing the device to stop.
- the user may select the device to stop, and the device settings may be displayed in the Control pane 22.
- the user may click "Stop" and "Close” in the Service Control window, which may stop the service.
- the user may select "Configuration" from the functional area pane 16.
- the user may select the name of the server that contains the configuration containing the device to restart, and the server may be displayed in the Navigation pane 14.
- the user may click the plus (+) sign next to the server name containing the configuration that contains the device to restart, and then click the plus (+) sign next to the configuration.
- the user may click the plus (+) sign next the component containing the device to restart.
- the user may select the device to restart, and the device settings may be displayed in the Control pane 22, as shown in 12(B).
- the user may select "Restart” and then "Close” in the Service Control window, which may restart the service.
- Templates may be used to create device interfaces for non-certified devices, such as, for example, CD player, DVD player, audio receiver, display (e.g., T. V., monitor) and the like. You can use either IR or one-way serial communication to control these devices.
- CD players may be configured as sources that can be controlled through the CAS and used in the scenes.
- DVD players, audio receivers and displays may also be used in scripts although they may not be fully controlled individually in the CAS.
- the user may select "Templates” from the functional area pane 16, then select "Edit,” “New” and “Component Template” from the menu bar 12, a shown in Fig. 13(A).
- the user may enter the new component properties and select the type of communication to use with this component (e.g., either IR or serial port), as shown in Fig. 13(B).
- the user may select "Edit” and "New” from the menu bar 12 and select the type of device template to create, which causes the control panel 10 to populate the default properties of the template according to the type of the selected device.
- the user may enter the properties of the new device and create a catalogue of commands, as shown in Fig. 13(C). There may be two possible methods to use to create the command set. As shown in Fig. 13(D), the first method may follow the procedure for incorporating new devices. The user may select the new device template, and by hovering over "New,"
- VW9I80O the "Command” options may become available. Then the user may select the desired "Command.” In using this method, the user may need to configure commands one by one.
- the second method may involve the "Properties” and "Create Contracts" button. After specifying which properties are supported by the device, the user may select the "Create Contracts” button, and the system may automatically create a catalogue of commands based on the properties supported. [0095] Using either of the previous methods, the user may create the command catalog, and then define the commands by selecting the expandable tree menu for the individual command as shown in Figs.
- IR commands may be transmitted through an IR bug and the ASCII commands may be delivered through a serial connection. Failure to choose the correct command type may result in an unresponsive device. If an IR learner is available, the user may select "Learn IR Codes" as shown in Fig. 14(D). The IR learner may need to be connected to an available serial port on the local machine.
- the control panel 10 may guide the user through the process of learning the IR codes by text in the box above the "Learn IR Codes" button.
- the user may save the new component and add it to the configuration. Then, the user may select "Configuration” in the functional area pane, select the active configuration and select the new component by friendly name. The user may need to check the configuration setting specified for the template and select "Save.” To test the command catalog, the user may select "Start” on the component and verify that the service starts, and the device may be available to test under Devices. Then the user may be able to incorporate the devices into CAS using scripting commands. [0096] The user may add the new template component to the configuration. After saving the changes made to the template, the user may select "Configuration,” and select the active configuration. The new template component may need to be added to the configuration by selecting it from the list of components.
- the component may populate in the list by friendly name.
- the system may require the definition of fields pertaining to the configuration file name and friendly name for logging purposes, as shown in Fig. 15(A).
- Usually standard 1:1 component: device configuration may be required.
- the exception to this rule may be when using a network adapter and multiple devices may be associated to the single component.
- the user can check the settings previously specified and then select "Save” to complete the configuration process, as shown in Fig. 15(B). To test the command catalogue, the user may select "Start” on the component and verify the service starts, and the device may be available in the Devices to test.
- the system may provide
- ⁇ 4491890 transport controls based on the set of commands configured, as shown in Fig. 15(C).
- the user may verify the performance of the device in order to identify any potential errors in setup. Then the user may now incorporate the devices into the CAS environment via scripting commands.
- the methodologies described herein may be implemented by various means depending upon the application. For example, these methodologies may be implemented in hardware, firmware, software, or a combination thereof.
- the processing units may be implemented within one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, electronic devices, other electronic units designed to perform the functions described herein, or a combination thereof.
- ASICs application specific integrated circuits
- DSPs digital signal processors
- DSPDs digital signal processing devices
- PLDs programmable logic devices
- FPGAs field programmable gate arrays
- processors controllers, micro-controllers, microprocessors, electronic devices, other electronic units designed to perform the functions described herein, or a combination thereof.
- the methodologies may be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described herein. Any machine readable medium tangibly embodying instructions may be used in implementing the methodologies described herein.
- software codes may be stored in a memory, for example the memory of client or device, and executed by a processor, for example a general-purpose processor.
- Memory may be implemented within the processor or external to the processor.
- the term "memory" refers to any type of long term, short term, volatile, nonvolatile, or other memory and is not to be limited to any particular type of memory or number of memories, or type of media upon which memory is stored.
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Computer And Data Communications (AREA)
Abstract
A convergence and automation system includes (a) an internet-protocol based (IP) network implemented with a web service for devices (WSD) protocol, (b) a plurality of devices connected to the network, wherein each device is configured to perform at least one service, (c) a server implemented with the WSD protocol, connected to the network and configured to control the devices for converging and automating the services thereof, and (d) at least one client implemented with the WSD protocol, connected to the network and configured to control at least a portion of the services of the devices. One of the server and the at least one client is configured to establish communication with the devices and further configured with a control panel application allowing a user to configure and test the convergence and automation system.
Description
USER CONTROL INTERFACE FOR CONVERGENCE AND AUTOMATION SYSTEM
BACKGROUND OF THE INVENTION
1. Field of the Invention
[0001] The invention is directed to an automation convergence system user control interface, and more particularly to a user control interface using Web services for devices in an automation convergence system. '
2. Related Art
[0002] Household, academic facility and/or business spaces now more commonly have more than one audio or video device such as CD/DVD player, portable MP3 player, tuner, preamp, power amp, speakers, VCR1 DVR, computers running media players or connected to some other source of audio or video (e.g., Internet radio, satellite radio and the like), etc. Typically, a CD/DVD player from one company comes with its own remote control and an amplifier by an entirely different company comes with its own remote control. The same space may have a PC with its keyboard and mouse, and yet another company's portable MP3 player with its own control switches. While each audio device is doing precisely what it was designed to do, each operates completely independent from the others with the possible exception of the portable MP3 player that may be connected to a PC for synchronization. As a result, a user ends up going from one keypad to another or juggling a series of remote controls in order to control the devices. [0003] Since these audio/video and similar devices are not designed to communicate with each other or their communication is very limited, access to these audio/video devices is limited by their physical locations. For example, it is difficult to play an MP3 file saved in a PC hard disk drive in one room or area (a child's bedroom) on speakers located in another room or area (an entertainment room). Thus, in order for a user to enjoy music of his or her choice whenever and wherever he or she wants, each room needs to be equipped with all the necessary audio/video equipment and digital audio/video content.
[0004] Also, the audio/video devices are not designed to communicate with other home devices (e.g., TV, lighting, security system, etc.). Thus, it is difficult, if not impossible, to converge the devices for common control for certain occasions. For example, in order to watch a movie, the user must turn on a TV, a DVD player and an audio amplifier by using three different remote controls. Then the user must set the TV to receive a video signal from the DVD player, set the audio amplifier to receive an audio signal from the DVD
1
V1491890
SUBSTITUTE SHEET (RΛJLE 26)
player and use another control unit to adjust the lighting of the room. Even when a user utilizes a universal remote, as is known in the art, the result is a plurality of devices that are separately operated and are operated separately from a single universal remote. These devices do not converge and further there is no way to control their convergence as described above.
[0005] Accordingly, there is a need for a solution for the aforementioned accessibility, connectability, controllability and convergence issues.
SUMMARY OF THE INVENTION [0006] The invention meets the foregoing needs using an automation specific IP based automation protocol, which results in a significant increase in convergence and communications between devices and other advantages apparent from the discussion herein. [0007] In one aspect of the invention, a convergence and automation system includes an internet-protocol based (IP) network implemented with a web service for devices (WSD) protocol, a plurality of devices connected to the network, wherein each device is configured to perform at least one service, a server implemented with the WSD protocol, connected to the network and configured to control the devices for converging and automating the services thereof, and at least one client implemented with the WSD protocol, connected to the network and configured to control at least a portion of the services of the devices. One of the server and the at least one client is configured to establish communication with the devices and further configured with a control panel application allowing a user to configure and test the convergence and automation system. [0008] In another aspect of the invention, an article includes a machine readable medium having embodied thereon a program executable by a machine to allow a user to configure a convergence and automation system. The convergence and automation system includes an internet-protocol based network, hardware implemented with a web service for devices (WSD) protocol and software implemented with the WSD protocol and configured to establish communication in the hardware and perform a logging function to record said events and errors.
[0009] Additional features, advantages, and embodiments of the invention may be set forth or apparent from consideration of the following detailed description, drawings, and claims. Moreover, it is to be understood that both the foregoing summary of the invention and the following detailed description are exemplary and intended to provide further explanation without limiting the scope of the invention as claimed.
VM91890
BRIEF DESCRIPTION OF THE DRAWINGS
[0010] The accompanying drawings, which are included to provide a further understanding of the invention, are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the detailed description serve to explain the principles of the invention. No attempt is made to show structural details of the invention in more detail than may be necessary for a fundamental understanding of the invention and the various ways in which it may be practiced. In the drawings:
[0011] Fig. 1 shows an overview of an automation convergence system for use with a portable remote control, communications and media consumption device constructed according to the principles of the invention;
[0012] Fig. 2 shows a screen capture image of a control panel for configuring a convergence and automation system (CAS), constructed according to the principles of the invention; [0013] Figs. 3(A) and 3(B) show screen capture images of the control panel of Fig. 2 being used for locating and activating a configuration, respectively;
[0014J Figs. 4(A) and 4(B) show screen capture images of the control panel of Fig. 2 being used for adding and editing a component, respectively;
[0015] Fig. 5 shows a screen capture image of the control panel of Fig. 2 being used for adding or editing a zone;
[0016] Fig. 6 shows a screen capture image of the control panel of Fig. 2 being used for adding or editing a source;
[0017] Figs. 7(A), 7(B), 7(C) and 7(D) show screen capture images of the control panel of Fig. 2 being used for adding, discovering and controlling a device, and viewing device manufacturer information, respectively;
[0018] Figs. 8(A) and 8(B) show screen capture images of the control panel of Fig. 2 being used for adding and editing a device control group, respectively;
[0019] Fig. 9 shows a screen capture image of the control panel of Fig. 2 being used for creating a script; [0020] Figs. 10(A) and 10(B) show screen capture images of the control panel of Fig. 2 being used for creating and editing a trigger, respectively;
[0021] Fig, 11 (A) shows a relationship between a script and schedule;
[0022] Fig. 11(B) shows a timing line showing how the scheduled script shown in Fig.
11(A) operates as a function of time;
V449I 890
[0023] Fig. 11 (C) shows a screen capture image of the control panel of Fig. 2 being used for creating a Schedule;
[0024] Figs. 12(A) and 12(B) show screen capture images of the control panel of Fig, 2 being used for starting and stopping/restarting a service, respectively; [0025] Figs. 13(A), 13(B), 13(C), 13(D), 13(E) and 13(F) show screen capture images of the control panel of Fig. 2 being used for setting up a new template; [0026] Figs. 14(A), 14(B), 14(C) and 14(D) show screen capture images of the control panel of Fig. 2 being used for defining a command in setting up a new template; and [0027] Figs. 15(A), 15(B) and 15(C) show screen capture images of the control panel of Fig. 2 being used for adding a new template to a configuration and testing functionality thereof.
DETAILED DESCRIPTION OF THE INVENTION [0028] The embodiments of the invention and the various features and advantageous details thereof are explained more fully with reference to the non-limiting embodiments and examples that are described and/or illustrated in the accompanying drawings and detailed in the following description. It should be noted that the features illustrated in the drawings are not necessarily drawn to scale, and features of one embodiment may be employed with other embodiments as the skilled artisan would recognize, even if not explicitly stated herein. Descriptions of well-known components and processing techniques may be omitted so as to not unnecessarily obscure the embodiments of the invention. The examples used herein are intended merely to facilitate an understanding of ways in which the invention may be practiced and to further enable those of skill in the art to practice the embodiments of the invention. Accordingly, the examples and embodiments herein should not be construed as limiting the scope of the invention, which is defined solely by the appended claims and applicable law. Moreover, it is noted that like reference numerals represent similar parts throughout the several views of the drawings. [0029] Fig. 1 shows an overview of a convergence and automation system (CAS) for use with a portable remote control, communications and media consumption device constructed according to the principles of the invention. The CAS solution may be a combination of hardware and software. The hardware may include a server 100 connected to a network 102 (e.g. IP based wired or wireless network such as an Ethernet network) and may possibly be connected to the internet 104, devices 120 (e.g. audio 121 , video 122, intercom 123, lighting 124, security system 125, HVAC 126, and the like) and clients 110 (e.g. TV 112, personal computer (PC) 111 , personal digital assistance (PDA)
4
VM9I890
113, controller 114 such as a control panel, game controller (i.e. XBox™, not shown) and the like). Moreover, the clients 110 may include a remote control 115 or a portable device 106 for remote control, communications and media consumption, which may be configured to function as both the client and device. The server 100 may be any type of computer, such as a PC connected to the network 102. The clients 110 such as clients 111 , 112, 113, 114 provide a user with control over the devices 120 such as devices 121, 122, 123, 124, 125, 126.
[0030] The software (i.e. application) enables the hardware devices 120 and/or clients 110 to communicate with each other despite their different proprietary languages and communication protocols, and may provide the user with control over most or all the devices 120 from a single client. The application may utilize at least one portion of the hardware to send commands to the devices 120 and receive feedback from them. The application integrates centralized device control into a PC based media environment (e.g., Microsoft Windows XP Media Center™ or Microsoft Windows Vista™ environment) that may store, organize and play digital media content. The user may use the remote control 115 or the portable device 106 to listen to music, watch and record television, enjoy family photographs and home movies, as well as adjust the lighting, secure the home, adjust the temperature, distribute music throughout the house, check surveillance cameras and the like. Moreover, the portable device 106 has further communication features as noted below.
[0031] The application may be implemented with Web Services. The Web Services use standard Internet protocol (IP) and are based on standard XML-related technologies such as SOAP (Simple Object Access Protocol) for communications and WSDL (Web Services Device Language) to describe interfaces. The devices implemented with Web Service for Devices (WSD) become black boxes on the network, providing services to any application, on any platform, written in any language. Moreover, the use of WSD allows for the capabilities of Universal Plug and Play (UPnP) that seamlessly connects and simply implementation as is known in the art. [0032] The application maximizes flexibility and scalability with an elegant n-tiered, service oriented architecture that allows loosely coupled components to easily interact with each other across the network. In particular the application may be created using Microsoft™ NET framework and coded primarily in C#. The application accordingly embraces the tremendous benefits of web services for the control of the devices. [0033] The device / software modules, methods or implementations described herein are intended for operation with dedicated hardware implementations including, but not limited to, semiconductors, application specific integrated circuits, programmable logic
5
V149I890
arrays, and other hardware devices constructed to implement the software modules, methods or implementation functionality described below. Moreover, various embodiments of the invention described herein are intended for operation as software programs running on a computer processor such as PC running the Windows™ operating system as is well known in the art. The functional and operational description of the various device / software modules, methods or implementations described herein may be used together, separately, or in various combinations thereof. The application as implemented in the device / software modules will now be described in detail. [0034] The invention is directed to a user interface for configuring CAS to maximize its convergence and automation capabilities.
W49I 890
Terms and Definitions [0035] The definitions for the terms used in this invention are explained in Table 1.
Table 1
V149I890
Basic Operation
[0036] Fig. 2 shows an exemplary user interface configuration window 10, which will be referred to as a control panel, constructed according to the principles of the invention. The control panel of the invention may be integrated with the control panel of a Windows™ operating system. As commonly known, the control panel application may be started by opening Windows Explorer™, navigating to the applications folder in the automation convergence folder on the local drive, and double-clicking the corresponding executable file or program (e.g., controlpanel.exe). The user may navigate the control panel 10 using a mouse, keyboard, input device, or the like. As shown in Rg. 2, the control panel 10 of the invention may include several elements such as a menu bar 12, navigation pane 14, functional area pane 16, definition pane 18, device control buttons 20, control pane 22, server pane 24 and/or component/device name bar 26 and the like that provides control of all of the devices and clients. [0037] The menu bar 12 may provide menus for the control panel 10, such as "File" (i.e., save, save all, and/or exit functions and/or the like), "Edit" (i.e. new configuration, new component, new device, new schedule, new script and/or delete functions and/or the like), "View" (i.e., server function and/or the like), "help" (i.e. about function and/or the like). The navigation pane 14 may contain configurations, devices, schedules and/or scripts and/or the like in a tree view. As well known, if a navigation item has a plus (+) sign next to it, the user may click the item to view additional sub items. If a navigation item has a minus (-) sign next to it, the user may click the item to hide the additional sub items. [0038] The functional area pane 16 may contain several buttons for "Configuration," "Devices," "Scheduling," "Scripting," "Triggers,' "Templates," and/or the like. The "Configuration" button allows the user to add and edit configurations on servers. The "Devices" button allows the user to view original manufacturer information, test devices, and control devices. The "Scheduling" button allows the user to set up schedules to run scripts. The "Scripting" button allows the user to create and edit scripts for running components and devices. The "Triggers" button allows the user to identify a specific device status and condition as a trigger to automatically execute a script when it occurs. The "Templates" button allows the user to add control for certain non-certified devices (CD players, DVD players, audio receivers, displays, and so on). [0039] The definition pane 18 may display the definitions and descriptions of component, communication, and device settings associated when the user clicks in the setting field in the control pane 22. The device control buttons 20 may be provided to ■ enable the user to control and test the devices and may include "start," "stop" and/or "restart" buttons and/or the like. The control pane 20 may display the information about
10
U491R90
the component, device, schedule, script, or configuration. The control pane 20 may be where the user completes the majority of the work including adding or editing settings. The server pane 24 may display all of the servers (service providers) on the automation network. The servers with a check mark next to them are selected and displayed in the Navigation pane 14. To select a server and display it in the Navigation pane, the user may click the server in the Server pane 24. The component/device name bar 26 displays the name of the component or device selected by the user selected from the Navigation pane 14. To exit the control panel 10, the user may click the close X in the upper-right corner of the control panel 10. If the user has made changes to a configuration, he or she may be prompted to save the configuration before closing. Next, each of the features of the functional pane 16 will be discussed.
Configurations [0040] A configuration is a collection of components, devices, menus, scripts, and schedules and corresponding properties for a particular installation. Before using the convergence system, the user may need to create a configuration for the network that he or she is working with. This configuration may run on the convergence system and may become part of the interface that the user interacts with daily. Before working with a configuration, the user may need to review the product sheets and other information provided by the convergence system installers to determine friendly names, communications settings, and device settings, so the information in the configuration matches the information provided by the installers.
[0041] To create a configuration, the user may start the control panel 10 as previously mentioned, click the "Configurations" button in the functional area pane 16, click the name of the server displayed in the Servers pane 24 that he or she wants to add the configuration to. Subsequently, the selected server may appear in the navigation pane 14 where the user may select the server that he or she wants to add the configuration to and, and click "New" and "Configuration." Then, the user may, in the control pane 22, under "Configuration Name," highlight the name in the field and type the new name for the configuration, which results in changing of the name in the navigation pane 14.
[0042] To locate a configuration, after starting the control panel 10, the user may select "Configuration" in the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the configuration. If the user is unsure of which server contains the configuration, the user may click each server to place a check mark next to the server name to display the server in the Navigation pane 14 so that the user can view all configurations on the network. Upon selecting the server name, the
11
VtW 890
selected server may be displayed in the Navigation pane 14, as shown in Fig 3(A). In the Navigation pane 14, the user may select the server that contains the configuration and further select the name of the configuration the user wants to view. Upon selecting the configuration name, the Configuration Name field may be displayed in the Control pane 22. If the configuration contains components, devices, scripts, and schedules, a plus (+} sign may be displayed next to the configuration name. Otherwise, no plus (+) nor minus (- ) sign may be displayed next to the configuration name. If a plus (+) sign is displayed, the user may select the item to view additional sub items. If a navigation item has a minus (-) sign next to it, the user may click the item to hide the additional sub items. [0043] Editing a configuration may involve adding, editing, or deleting components, devices, scripts or schedules. Editing a configuration in the control panel enables the user to change the name of the configuration. To edit a configuration in the control panel 10, the user may start the control panel 10 and select "Configuration" in the functional area pane 16. Then, the user may select the name of the server that contains the configuration 5 to be edited in the Servers pane 24, which may cause the selected server to be displayed in the Navigation pane 14. In the Navigation pane 14, the user may select the server that contains the configuration to be edited and select the configuration to view the configuration contents in the Navigation pane 14. Then, the user may, in the Control pane 22, under "Configuration Name," highlight the name of the configuration and type the new 0 configuration name, if required. Otherwise, the user may need to follow other appropriate procedures to make the changes.
[0044] After making changes to a configuration, the user may need to save the configuration for the changes to be applied. If the user makes a change and does not save the configuration before closing the control panel, the user may be prompted to save 5 changes. To save a configuration, after making changes to the configuration, the user may select "File" and "Save" in the menu bar 12. The control panel 10 may display messages regarding verifying the number of devices and verifying the number of scripts if these numbers do not exceed the maximum counts. The configuration is then saved. If the configuration is not the active configuration, the user may not be able to view the D changes. To view the changes, the user may need to set the configuration as the active configuration.
[0045] Activating a configuration may set one configuration as the running configuration on the server (i.e., service provider). Each service provider may have multiple configurations, but may have only one active configuration. To activate a configuration, 5 the user may click "Configuration" in the functional area pane 16. Then, the user may select the name of the server In the Servers pane 24 that contains the configuration to be
12
\4491890
activated, which may result in the server being displayed in the Navigation pane 14. In the Navigation pane 14, the user may select the server name containing the configuration to be activated. Then, the user may, in the Control pane 22, under Active Configuration, select the configuration to activate from the drop-down list, as shown in Fig 3(B). The configuration is then activated, and the next time the user starts the configuration tool, this configuration may be displayed as the active configuration.
[0046] Configurations may become obsolete over time as components change and the home network grows. When this occurs, the user may delete a configuration that is no longer useful. If the user deletes a configuration and has no archived copies of the configuration, he or she may lose all information in the configuration. If the user deletes an active configuration on a server (i.e., service provider), the user may have to activate a different configuration.
[0047] Before deleting a configuration, the user may need to verify that the configuration to be deleted is not the active configuration on the server. If the configuration to be deleted is the active configuration on the server, the user may need to make a different configuration active on the server. Then, the user may need to verify that he or she wants to permanently delete the configuration. The process of deleting a configuration from a server may start by selecting "Configuration" in the functional area pane 16. Then, in the Servers pane 24, the user may select the name of the server that contains the configuration to be deleted. In the Navigation pane 14, the user may select the plus (+) sign next to the server name containing the configuration to be deleted to display all configurations on that server. Then, in the Navigation pane 14, the user may select the configuration to be deleted and select "Delete." The control panel 10 may display a verify deletion message. By verifying deletion, the configuration may be deleted from the server.
Components
[0048] Components are the basic building block of a CAS configuration that may include a centralized intelligent system and the devices regulated by the intelligent system. A component may be any one of the devices 120 or client 110 shown in Fig. 1. For example, a component may be an HVAC system controller (i.e., intelligent system) combined with the thermostats (i.e., devices) regulated by the intelligent system. [0049] Before adding devices, creating scripts or schedules, or using CAS, the user may need to add components to a configuration. After creating a new configuration, the user may continue adding components as systems are added to the network. To add a component to a configuration, the user may select "Configuration" in the functional area
13
VM9I890
pane 16. In the Servers pane 24, the user may click the name of the server that contains the configuration that he or she wants to which to add a component. Then, the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may select the plus (+) sign next to the server name containing the configuration he or she wants to add a component, which may result in all configurations on the server being displayed in the Navigation pane 14. In the Navigation pane 14, the user may select the configuration that he or she wants to add a component to. Then, the user may select "New," select the component category, and then select the component to be added to the configuration, as shown in Fig 4(A). The component is then added to the configuration and the component settings may be displayed in the control pane 22.
[0050] As the network and components change, the user may need to edit a component in an existing configuration to meet the user's needs. The user may not need to create a new configuration to make a change to the component because he or she may simply edit the existing component. [0051] To edit a component in a configuration, the user may select "Configuration" in the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the configuration with the component to be edited, which may result in the server being displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration and component to be edited, which may result in all available configurations on the server being displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the configuration containing the component to be edited and then select the component category containing the component to be edited. In the Control pane 22, the user may make any changes to the component settings by double-clicking in a setting name and type a new value or making a new selection from a list, as shown in Fig 4(B). After making all changes, the user may save the configuration by selecting "File" and "Save" in the menu bar 12.
[0052] If there is a component that is not required, or if the user changes the type of component after the initial configuration, the user may open the configuration and delete the component from the configuration. To delete a component from an existing configuration, the user may select "Configuration" in the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the configuration with the component to be deleted, which may result in the server being displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration and component to be deleted. Then the user may click the plus (+) sign next to the configuration containing the
14
U49I89O
component to be deleted. In the Navigation pane 14, the user may right-click the component category containing the component to be deleted and select "Delete." The control panel 10 may display a deletion verification message. By clicking "Yes," the selected component may be deleted.
Zones
[0053] A zone is an area of coverage for an audio component, a security system component and/or the like. For example, one security camera component may cover a back door and patio area (zone 1) and a second security camera component may cover a front door area (zone 2). There may be more than one zone in an area (e.g., room) depending on the make up of the area. Also, more than one zone may be associated with a component. To add a zone to a component in a configuration, the user may select "Configuration" in the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the configuration with the component he or she wants to add a zone to. Then, the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration and component he or she wants to add a zone. In the Navigation pane 14, the user may click the plus (+) sign next to the configuration containing the component that he or she wants to add a zone. In the Navigation pane 14, the user may select the component category containing the component that he or she wants to a zone. Then, in the Control pane 22, the user may select "Zones" and then select a button next to "Collection," which may open a zone configuration collection editor, as shown in Fig. 4(B). In the zone configuration collection editor, the user may select "Add" which causes the zone to be added to the Members list. Then, under "Members," the user may select the zone that has been just added. In the Properties pane, the user may double-click "ID" and type the new ID for the zone, and then double-click Name and type the new name of the zone. After adding all new zones, the user may need to save the configuration. [0054] After adding zones to a component, the user may edit the zone. To edit a zone in a configuration, after starting the control panel 10, the user may select "Configuration" in the functional area pane 16. In the Servers pane 24, the user may click the name of the server that contains the configuration with the component of the zone to be edited, which may result in the server being displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration and component of the zone to be edited. In the Navigation pane 14, the user may click the plus (+) sign next to the configuration containing the component of the
15
VM9I890
zone to be edited. In the Navigation pane 14, the user may click the component category containing the component of the zone to be edited. In the Control pane 22, the user may select "Zones" and then select the button next to "Collection," which may open a zone configuration collection editor, as shown in Fig. 4(B). In the zone configuration collection editor, under "Members," the user may select the zone to be edited. In the Properties pane, the user may select "ID" and type the new ID for the zone, and then select "Name" and type the new name of the zone. After making changes, the user may need to save the configuration. [0055] As the network changes and audio and security components are added and deleted from the network, the user may delete zones to fit the users' needs. To delete a zone from a configuration, after starting the control panel 10, the user may select "Configuration" in the functional area pane 16. In the Servers pane 24, the user may click the name of the server that contains the configuration with the component of the zone to be deleted, and the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration and component of the zone to be deleted. In the Navigation pane 14, the user may click the plus (+) sign next to the configuration containing the component zone to be deleted. In the Navigation pane 14, the user may select the component category containing the component of the zone to be deleted. In the Control pane 22, the user may select "Zones" and then click the button next to "Collection," and the zone configuration collection editor may open. In the zone configuration collection editor, under "Members," the user may select the zone to be deleted. By clicking "Remove," the selected zone is removed. After making the changes, the user may need to save the configuration.
Sources
[0056] Sources are hardware elements, such as receivers, CD players and the like, that provide audio content to the audio devices in the CAS. When the user adds an audio component, he or she may need to associate a source with the component so that the component may be able to access the audio content. The user may change the source associated with the audio component if necessary.
[0057] To add a source to a component in a configuration, after starting the control panel 10, the user may select "Configuration" in the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the configuration with the component that he or she wants to add a source to, and then the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration and
16
W49I890
component that he or she wants to add a source to. In the Navigation pane 14, the user may click the plus (+) sign next to the configuration containing the component that he or she wants to add a source to. In the Navigation pane 14, the user may select the component category containing the component that he or she wants to add a source to. In the Control pane 22, the user may select "Sources" and then click the button next to "Collection," which may open the source configuration collection editor. In the source configuration collection editor, the user may select "Add" which result in the source being added to the Members list. Under "Members," the user may select the source that has been just added. In the Properties pane, the user may double-click each of the settings shown in Table 2 and provide a value for the setting. After adding all sources, the user may need to save the configuration.
Table 2
[0058] To edit a source for a component in a configuration, after starting the control panel 10, the user may select "Configuration" in the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the configuration with the component that he or she wants to edit a source, and then the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration and component that he or she wants to edit a source. In the Navigation pane 14, the user may click the plus (+) sign next to the configuration containing the component that he or she wants to edit a source. In the Navigation pane 14, the user may select the component category containing the component that he or she wants to edit a source for. In the Control pane 22, the user may select "Sources" and then click the button next to
"Collection" which may open the source configuration collection editor, as shown in Fig. 6. In the source configuration collection editor, under "Members," the user may select the name the source to edit. In the Properties pane, the user may double-click each of-the settings shown in Table 2 and provide a value for the setting. After editing all sources, the user may need to save the configuration.
[0059] To delete a source from a component in a configuration, after starting the control panel 10 and select "Configuration" in the functional area pane 16, the user may select, in
17
W49IS90
the Servers pane 24, the name of the server that contains the configuration with the component that he or she wants to delete a source from, which may result in the selected server being displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration and component that he or she wants to delete a source from and then click the plus (+) sign next to "Configuration." In the Navigation pane 14, the user may click the component category containing the component that he or she wants to delete a source from. In the Control pane 22, the user may select "Sources" and then click the button next to "Collection" which opens the source configuration collection editor. In the editor, the user may select "Remove" which may result in the source being removed from the Members list. After deleting the sources, the user may need to save the configuration.
Devices [0060] Devices may be individual hardware elements in a home network such as a light, thermostat and the like. Figuratively speaking, the devices are one half of a component in the CAS, with the other half being a centralized intelligence system, which regulates the operation of the device. To set up a device, the user may need to have components in the configuration. In the control panel 10, the user may add a component and device during the same process, but in the configuration tool these tasks may need to be separate processes. After the user has added components, he or she may be able to add devices at any time to an existing component. In the CAS, the user may only be able to associate a device that is compatible with the specific component. For example, the user may not be able to add a lighting device to an HVAC component as these two are may not be compatible. After adding a device to a configuration, the user may be able to include the device in a script to run automatically (i.e., on a schedule) or manually (i.e , by button). The user may also be able to associate a device with a sub menu to display the device in the room menu for a specified room. The user may have to use the configuration tool to work with menus. [0061] Adding a device may be associating the device with a component controller (i.e., the intelligent system). For example, when the user adds a lighting device, he or she may associate the specific light with the intelligent lighting system, which may receive the commands from the CAS server and regulates the light. As time passes, the user may be able to add new devices due to remodeling, additions, or other changes. The user may not need to create a new configuration to add a new device. [0062] To add a device to a configuration, after starting the control panel 10 and selecting "Configuration" in the functional area pane 16, the user may select, in the
18
VM91890
Servers pane, the name of the server that contains the configuration he or she wants to add a device to and the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration he or she wants to add a device to, and then click the plus (+) sign next to the configuration. In the Navigation pane 14, the user may select the component that he or she wants to add a device to and select "New," and select the device he or she wants to add to the component. As shown in Fig. 7(A), the device may be added to the configuration directly beneath the component in the Navigation pane and the device settings may be displayed in the Control pane 22. In the Control pane 22, the user may select a setting to activate the setting and make a change to the setting value. After completing all of the changes to the settings, the user may need to save the configuration.
[0063] If a device is produced in a manner that enables it to be discovered on a network, the user may be able to discover the device along with all of the properties associated with the device. Discovery is the ability of CAS to automatically detect components on the same network and retrieve information about the devices. If the user adds a light to a network that supports automatic discovery, he or she may not have to add properties manually to the configuration to support the light because all of the information related to the light may be automatically recognized and placed into the proper files for use in the CAS. Not all components or devices may be produced to be discovered. If a component or device cannot be discovered, a Discovery button may not appear. [0064] To discover a device, after starting the control panel 10 and selecting "Configuration" in the functional area pane 16, the user may select, in the Servers pane 24, the name of the server that contains the configuration and component that he or she wants to discover devices for and the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration that contains the component that he or she wants to discover devices, and then click the plus (+) sign next to the configuration. In the Navigation pane 14, the user may click the component that he or she wants to discover devices. In the Control pane 22, the user may select the Discover button in the lower right of the window, as shown in Fig. 7(B). Then, the devices may be discovered and added to the Navigation pane 14 under the component, and the user may be able to edit the device settings, if required, After discovering the devices, the user may need to save the configuration. [0065] To edit a device, after starting the control panel 10 and selecting "Configuration" in the functional area pane 16, the user may select, in the Servers pane 24, the name of the server that contains the configuration containing the device to be edited, and the
19
VM9I890
server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration that contains the device to be edited, and then click the plus (+) sign next to the configuration. In the Navigation pane 14, the user may click the plus (+) sign next the component containing the device to be edited. Under the component, the user may select the device to be edited, as shown in Fig. 7(B), and the device settings may be displayed in the Control pane 22. In the Control pane 22, the user may select a setting to activate the setting and make a change to the setting value. After completing all of the changes to the settings, the user may need to save the configuration. [0066] To delete a device, after starting the control panel 10 and selecting
"Configuration" in the functional area pane 16, the user may select, in the Servers pane 24, the name of the server that contains the configuration containing the device to be deleted and then the server may be displayed in the Navigation pane 14. In the Navigation pane 14, click the plus (+) sign next to the server name containing the configuration that contains the device to be deleted, and then click the plus (+) sign next to the configuration. In the Navigation pane 14, the user may select the plus (+) sign next the component containing the device to be deleted. Under the component, the user may select the device to be deleted. By selecting "Delete," the device may be deleted, A deletion verification message may occur to make sure the user wants to delete the device. After completing all of the changes to the settings, the user may need to save the configuration.
[0067] Controlling a device may be useful when the user has added a new device and wants to test it to ensure that device is working properly. To control a device, the user may select "Devices" in the functional area pane 16. Then, the user may select, in the Servers pane 24, the name of the server that contains the configuration containing the device he or she wants to control, and the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration that contains the device he or she wants to control, and then click the plus (+) sign next to the configuration. In the Navigation pane 14, the user may click the plus (+) sign next the component containing the device that he or she wants to control. Then, the user may select, under the component, the device he or she wants to control, and the device controls may be displayed in the Control pane 22. In the Control pane 22, the user may click a Control tab to ensure that the device controls display. Depending on the device to be controlled, the user may type new values or make selections from lists to control the device. For example, if the user is controlling or testing a thermostat, he can change the heat temperature set point to a new value, change the
20
VM9I890
mode of operation from OFF to AUTO1 and turn the fan ON, as shown in Fig. 7(C). The changes made by the user may control the device appropriately. If there is an issue, the user may need to ensure that the configuration is the active configuration and that the communication connection between the device and the computer is not experiencing errors.
[0068] Viewing the Original Equipment Manufacturer (OEM) device information may be useful when the user needs to contact the manufacturer with a question or to find the serial number or firmware version used with the device. To view the device OEM information, the user may select, in the Servers pane 24, the name of the server that contains the configuration containing the device for which he or she wants to view the OEM information, and then the server may be displayed in the Navigation pane. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration that contains the device for which the user wants to view the OEM information, and then click the plus (+) sign next to the configuration. In the Navigation pane 14, the user may click the plus (+) sign next the component containing the device for which he or she wants to view the OEM information. Under the component, the user may select the device for which he or she wants to view the OEM information, and the device controls may be displayed in the Control pane 22. In the Control pane 22, the user may select a "Description" tab to view the OEM information, as shown in Fig. 7(D). The user may not able to edit the OEM information from this page.
[0069] Although each device has different OEM information, the most common information displayed is shown in Table 3.
Table 3
21
Device Control Groups [0070] For certain control categories such as lighting, audio, shades, thermostats, ovens, and contact closures, the user may be able to group devices within the same component into a device control group. According to the invention, all of the devices in a control group may be controlled as a single device using the feedback provided by one device in the group that the user designates as the master device. In fact, device control groups may be configured to look just like a single device in the menu. When the user makes a change to a control group's settings, all of the devices in that group may be affected.
[0071] To set up a device control group, the user may need to have components with devices already defined in the configuration. In the control panel 10, the user may access a component which supports device control groups, select a "Device Control Group" option, give the control group a "Friendly Name," select the devices to include, set parameters for the devices, and designate a master device. To create a device control group, as shown in Fig. 8(A), the user may select, in the Navigation pane 14, select the desired configuration and then click the (+) sign beside the name of the component containing the devices he or she wants to group together. Then, the user may select the "Control Groups" option and select "New," and then select the option that may appear highlighted. In the Control Group pane, the user may type in the "Friendly Name." For "Enabled," the user may select "True" to enable the device control group. For "Log Tracing," the user may select "True" to allow logging. For "Manipulation," the user may select either "Relative" or "Absolute." The user may be viewing the state of the master device when he or she accesses the control group to change its state. If the user wants the other devices to follow the master device exactly, he or she may select "Absolute." If the user wants the other devices to change based on their current state, the user may select "Relative," and the other devices may incrementally change to the same degree that he or she changes the master device. In the "Devices" field, the user may click the down arrow to access a devices choice list, and select the checkbox beside the names of the devices he or she wants to group together. For "Master," the user may click the down arrow to access the choice list of devices. The user may select the checkbox beside the name of the device he or she wants to be the master device for this group.
22
\449I 89O
[0072] To edit a device control group, the user may select the "Configuration" in the functional area panel 16. In the Configuration pane, the user may select the desired configuration and then click the (+) sign beside the name of the component containing the device control group to be edited, as shown in Fig. 8(B). Then, the user may select the "Control Groups" option and select the control group to edit, and the settings for that control group may appear on the screen. In the Control Group pane, the user may type in the "Friendly Name." For "Enabled," the user may select "True" to enable the device control group. For "Log Tracing," the user may select "True" to allow logging. For "Manipulation," the user may select either "Relative" or "Absolute." The user may be able to view the state of the master device when he or she accesses the control group to change its state. If the user wants the other devices to follow the master device exactly, he or she may select "Absolute." If the user wants the other devices to change based on their current state, he or she may select "Relative," and the other devices may incrementally change to the same degree that the user changes the master device. In the Devices field, the user may click the down arrow to access the devices choice list, and select the checkbox beside the names of the devices he or she wants to group together. For "Master," the user may click the down arrow to access the choice list of devices. The user may select the checkbox beside the name of the device he or she wants to be the master device for this group.
Servers
[0073] The Servers pane 24 may show all of the servers (i.e., service providers) on the network. If the user has a complex installation, he or she may have several servers listed. Otherwise, less complex installations may have only one or two servers listed. The list of servers may be built dynamically from network information when the user starts the control panel 10. The user may not be able to add a server or delete a server from the list in the Servers pane 24. The user may, however, be able to choose which servers to display in the Navigation pane for better control over the amount of information and devices listed in the Navigation at one time. This may be useful in complex installations with several servers and hundreds of devices, which could cause the contents of the Navigation pane to become unwieldy.
[0074] To view the servers on the network, the user may select "Configuration" in the functional area pane 16. In the Servers pane 24, the user may select the name of the server he or she wants to view in the Navigation pane 14, and then the server may be displayed in the Navigation pane 14, thereby enabling the user to add, edit, or delete the configurations on the server. If the Servers pane 24 displays, but the user does not want
23
VM91S90
the Severs pane 24 to display, he or she may be able to hide the Servers pane 24. To hide the Servers pane 24 in the control panel 10, the user may select "View" and "Servers" from the menu bar 12. Then, the Servers pane 24 may no longer be displayed in the control panel 10. If the Servers pane 24 is not displayed and the user wants to display the Servers pane 24, the user may change the setting to display the Servers pane 24. For example, to display the Servers pane 24 in the control panel, the user may select "View" and "Servers" from the menu bar 12. A check mark may be displayed next to "Servers" and the Servers pane 24 may be displayed in the control panel 10.
Scripts
[0075] To create a script in the control panel, the user may use either the C # or Visual Basic programming language. Otherwise, the user may use a non-programming interface configuration tool to create scripts. A script may be a string of commands that sends actions to a variety of devices for a predetermined effect. Using a script, the user may be able to simultaneously control different types of devices. For example, the user may have a script that sends a command to turn on the lights in the foyer, lower the audio volume, and then ramp up the temperature on the thermostat. Scripts may be triggered either manually (i.e., button activated) or automatically (i.e., scheduled). [0076] The user may only be able to create a script only after he or she adds all of the components and devices to a configuration. If the user changes a component or device after the script is created, the user may need to change the script to reflect the change. In creating a script, the user may create commands, which are instructions that he or she wants the CAS to follow. A command may consist of an action and the action properties. An action may specify what the user wants to happen and the action properties may specify how the user wants the action to occur. For example, bringing a light up to 50 percent brightness may involve the action of bringing the light up and the action property of 50 percent. Scripts may run in the order that the commands display in the script itself. [0077] Before creating a script, the user may need to add the components and devices that he or she wants to use in the script to the configuration that the user is adding the script to. If the user changes a component or device, or adds a new component that he or she wants to add to the script, the user may edit the script to reflect the changes. The user may add only one action to a command at a time and only one command to a device at a time. If the user wants to make a device do more than one action, he or she may need to break the action into single actions. For example, if the user wants a thermostat to set to 70 degrees and turn the fan on, he or she may need to create two separate commands: one for the thermostat to be set to 70 degrees and then a second command
for the thermostat to turn on the fan. These separate commands may be displayed in the script as separate items.
[0078] To create a script, the user may select "Scripting" from the functional area pane 16. In the Servers pane 24, the user may click the name of the server that contains the configuration that he or she wants to add a script, and the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration that he or she wants to add a script to. In the Navigation pane 14, the user may select the name of the configuration that he or she wants to add a script to, and select click "New" and "Script Template." In the Navigation pane 14, the script may be added under the configuration name and the "New Script template" may be displayed in the control pane 22, as shown in Fig. 9. In the Control pane 22, under "Script Name," the user may highlight the field value and type a new script name, which may be descriptive and unique for easier administration. Under "Language," the user may select the programming language to use for the script from the drop-down list, either C# or VisualBasic™. Under "Type the Scπpt Body," the user may type the script in the previously selected programming language. After adding all information to the script, the user may save the configuration. The user may now be able to schedule the script to run automatically, or run the script manually, depending on the situation. [0079] After creating a script, the user may test the script before placing it into operation. This will ensure that the devices are working as expected and the sequence of the commands is correct in the script. To test a script, after selecting "Script" from the functional area pane 16, the user may, in the Servers pane 24, select the name of the server that contains the configuration containing the script to test. The server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration containing the script to test. In the Navigation pane 14, the user may click the plus (+) sign next to the name of the configuration containing the script to test. In the Navigation pane 14, the user may click the name of the script to test, and the script information may be displayed in the Control pane 22. Then, the user may click the "Execute" button in the lower right of the Control pane 22, as shown in Fig, 9. If the devices are all working correctly and the script is written correctly, the devices may well be controlled by the script. If the script works properly, but continuously fails at the same spot, it may necessary to verify that the device that fails is installed and configured correctly, and that the script actions are appropriate for the device. [0080] To edit a script, the user may select "Scripting" from the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the
25
'4491890
configuration containing the script to edit, and the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration containing the script to edit. In the Navigation pane 14, the user may click the plus (+) sign next to the name of the configuration containing the script to edit, In the Navigation pane 14, the user may click the name of the script to edit, and the script information may be displayed in the Control pane 22. In the Control pane 22, under "Script Name," the user may highlight the field value and type the new script name. The user may make this script name descriptive and unique for easier administration. The user may need to avoid selecting a different programming language under "Language" to use for the script from the drop-down list. If the user selects a different language, the existing script code may be deleted. Under "Type the Script Body," the user may make changes to the script in the previously selected programming language. After saving the configuration, the user may schedule the script to run automatically, or run the script manually, depending on the situation. [0081] To delete a script, the user may select "Scripting" from the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the configuration containing the script to delete, and the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration containing the script to delete. In the Navigation pane 14, the user may click the plus (+) sign next to the name of the configuration containing the script to delete. In the Navigation pane 14, the user may select the name of the script to delete and confirm the deletion.
Triggers [0082] The user may identify a specific device status and condition as a trigger to automatically execute a "scene" when it occurs. A scene is the operation or script for a particular situation. One trigger may execute multiple scripts. However, only one trigger may be used per script. Possible status and conditions may differ depending on the type of device and include "greater than," "less than," "equal to," and "not equal to." For example, if a dimmer's load level (i.e., status) is set to "greater than" condition 50%, a scene may be automatically executed. To create a trigger for a script, the user may select "Triggers" from the functional area pane 16, which may open a new trigger template pane in the control pane 22, as shown in Fig. 10(A). The, the user may, under "Trigger Details," type in a friendly name for the trigger, and select "Enabled" to enable the trigger. Under "Device Details," in the "Category" field, the user may select the down arrow to access the Category choice list and select the category of device he or she wants. In the "Devices"
26
VM9IK90
field, the user may click the down arrow to access the choice list of devices, and select the name of the device that will trigger the script. Under "Condition Details," in the "Status" field, the user may select the down arrow to view the Status choice list, and select the desired status then select the "Condition" (i.e., greater than, less than, equal to, or not equal to) to be met. From the "Values" choice list, the user may select the "Value" or adjust to the desired value. Under "Script Details," the user may select a script to execute from the choice list of scripts in the left column, and select the right arrow to move the script into the right column. This script may be the first to execute when the condition the user specified is met. If the user wants this condition to trigger to execute multiple scripts, the user may repeat this step for each script you want the trigger to execute, in the order he or she wants the scripts to execute.
[0083] To edit a trigger for a script, the user may select "Triggers" in the functional area pane 16. In Fig. 10(B), the user may select the machine (i.e., service provider), configuration, and the trigger to edit. In the Trigger pane, under "Trigger Details," the user may edit the desired parameters for the trigger, and select "Enabled" to enable the trigger. Under "Device Details," in the "Category" field, the user may click the down arrow to access the Category choice list and select the category of device he or she wants. In the "Devices" field, the user may click the down arrow to access the choice list of devices, and select the name of the device that will trigger the script. Under "Condition Details," in the "Status" field, the user may click the down arrow to view the Status choice list, select the desired "Status," and then select the "Condition" (i.e., greater than, less than, equal to, or not equal to) to be met. From the "Values" choice list, the user may select the "Value" or adjust to the desired Value. Under "Script Details," the user may select a script to execute from the choice list of scripts in the left-hand column, and select the right arrow to move the script into the right column. To move scripts out of the right hand list, the user may select the script and then the left arrow to remove the script from the list. Scripts may execute in the order they appear in the list. Thus, the user may need to use the left and right arrows to move scripts around in the list.
Schedules
[0084] Schedules are time periods in which a script is to run. A schedule may consist of a schedule type (e.g., start time and date, or day) and an action (i.e., script to run). Before creating a schedule, the user may need to add the components and devices to the configuration and create the script that he or she wants to run on the schedule the user is creating. The user may not need to create a schedule for each script immediately after
27
W49I890
creating the script. The user may add a schedule to any script that he or she creates at any time. The user may have multiple schedules associated with the same script. [0085] Types of schedules include Daily (i.e., Schedule runs every day at the time specified), Weekly (i.e.. Schedule runs one time a week on the specified day and at the time specified), Monthly (i.e., Schedule runs one time a month on the specified date and at the time specified), OneTime (i.e., Schedule runs one time only on the specified date and at time specified) and/or the like. Figs. 11 (A) and 11 (B) show how scripts and schedules work together, in which a script involving a light, audio and thermostat are scheduled to be activated daily at 7:00 a.m. If the user wants to have a schedule run every other day, or only four days out of the week, he or she may need to set up individual schedules for the script to run. For example, if the user wants a script to run on Tuesday, Wednesday, and Friday, he or she may set up three separate weekly schedules, one schedule for Tuesday, one for Wednesday, and one for Friday. The user may create a new schedule for each script that he or she creates for a configuration. In addition, when the schedules change, the user may easily edit the schedules to meet the user's requirements.
[0086] To create a schedule, the user may select "Schedules" in the functional area pane 16. In the Servers pane 24, the user may click the name of the server that contains the configuration containing the script he or she wants to schedule, and the server may be displays in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration that contains the script to be scheduled. In the Navigation pane 14, the user may select the name of the configuration containing the script to be scheduled and select "New" and "Schedule." In the Navigation pane 14, the user may select the name of the schedule he or she just added, and the schedule information may be displayed in the Control pane 22, as shown in Fig. 11(C). In the Control pane 22, under "Schedule Details," the user may, in the "Name" field, highlight the value and type the new name for the schedule. The name may be unique, brief, and descnptive of the schedule, such as "Good Morning." In the Script field, the user may select the script to run on the schedule from the list. The user may need to have at least one script in the configuration before adding a schedule. If the list in the Script field is blank, the user may need to create the script to schedule before scheduling the script. After creating the script, the script may be displayed in the Script field list. Under "Trigger Details," in the "Start Date" field, the user may select the date for the schedule to start from the drop-down list. In the "Start Time" field, the user may type the hour and minutes for the schedule to start, preferably in the format of "hh:mm° and then select AM (morning) or PM (evening) from the list. In the "Recurring" field, the user may select one of the
28
V4491890
options shown in Table 4 that he or she wants to use with this schedule. After completing all of the schedule settings, the user may save the configuration.
Table 4
[0087] To edit a schedule, the user may select "Scheduling" in the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the configuration containing the schedule to be edited, and the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration that contains the schedule to be edited. In the Navigation pane 14, the user may click the name of the configuration containing the schedule to be edited. In the Navigation pane 14, the user may click the name of the schedule to be edited, and the schedule information may be displayed in the Control pane 22, as shown in Fig. 11(C), In the Control pane 22, under "Schedule details," in the "Name" field, the user may highlight the value and type the new name for the schedule. The name may be unique, brief, and descriptive of the schedule. In the "Script" field, the user may select the script to run on the schedule from the list. The user may need to have at least one script in the configuration prior to adding a schedule. If the list in the Script field is blank, the user may need to create the script to schedule before scheduling the script. After creating the script, the script may be displayed in the Script field list. Under "Trigger Details," the user may need, in the "Start Time field, " to type the hour and minutes for the schedule to start in the format such as "hlrmm" and then select AM (morning) or PM (evening) from the list. In the "Recurring" field, the user may select one of the options described in Table 4 that he or she wants to use with this schedule. After completing all of the schedule settings, the user may save the configuration.
[0088] To delete a schedule, in the Servers pane 24, the user may select the name of the server that contains the configuration containing the schedule to delete, and the server may display in the Navigation pane 14. In the Navigation pane 14, the user may click the
29
\449189O
plus (+) sign next to the server name containing the configuration that contains the schedule to delete, In the Navigation pane 14, the user may click the plus (+) sign next to the name of the configuration containing the schedule to delete. Then, the user may select the name of the schedule to delete and select "delete." Upon confirming a delete verification message, the schedule may be deleted from the configuration. The script may still remain and may not be impacted by the schedule deletion. If the user wants to run the script, he or she may need to either create a new schedule to run the script automatically or run the script manually.
Services
[0089] Each device configuration page may contain Stop, Start, and Restart buttons in the Device Control area of the Control pane 22. Using these buttons, the user may stop, start, or restart the device-specific portion of the software that enables control of the device. This may be useful when the user changes a device configuration and needs to restart the service before the new configuration can be used.
[0090] To start a service, the user may select "Configuration" from the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the configuration containing the device he or she wants to start, and the server may be displayed in the Navigation pane 14, In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration that contains the device to start and then click the plus (+) sign next to the configuration. In the Navigation pane 14, the user may click the plus (+) sign next the component containing the device to start. Under the component, the user may select the device to start, and the device settings may be displayed in the Control pane 22, as shown in Fig. 12(A). In the Control pane, under Device Control, the user may click "Start" and then "Close" in the Service Control window, which may start the service.
[0091] To stop a service, the user may select "Configuration" from the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the configuration containing the device to stop, and the server may display in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration that contains the device to stop, and then click the plus (+) sign next to the configuration. In the Navigation pane, the user may click the plus (+) sign next the component containing the device to stop. Under the component, the user may select the device to stop, and the device settings may be displayed in the Control pane 22. In the Control pane 22, under Device Control, the user may click "Stop" and "Close" in the Service Control window, which may stop the service.
30
\449I89O
[0092] To restart a service, the user may select "Configuration" from the functional area pane 16. In the Servers pane 24, the user may select the name of the server that contains the configuration containing the device to restart, and the server may be displayed in the Navigation pane 14. In the Navigation pane 14, the user may click the plus (+) sign next to the server name containing the configuration that contains the device to restart, and then click the plus (+) sign next to the configuration. In the Navigation pane 14, the user may click the plus (+) sign next the component containing the device to restart. Under the component, the user may select the device to restart, and the device settings may be displayed in the Control pane 22, as shown in 12(B). In the Control pane 22, under Device Control, the user may select "Restart" and then "Close" in the Service Control window, which may restart the service.
Templates [0093] Templates may be used to create device interfaces for non-certified devices, such as, for example, CD player, DVD player, audio receiver, display (e.g., T. V., monitor) and the like. You can use either IR or one-way serial communication to control these devices. CD players may be configured as sources that can be controlled through the CAS and used in the scenes. DVD players, audio receivers and displays may also be used in scripts although they may not be fully controlled individually in the CAS. Once the user establishes the set of commands that the component supports, he or she may send the command directly to the device via the CAS. If no user interface exists for the devices, the user may not be able to add the devices to the menu structure. However, if the CAS can support those devices, the user may be able to add those components to the menu structure. After completing the Template setup, the next step may be to add scripts to access the component via the CAS or add to Menu.
[0094] To set up a new template, the user may select "Templates" from the functional area pane 16, then select "Edit," "New" and "Component Template" from the menu bar 12, a shown in Fig. 13(A). The user may enter the new component properties and select the type of communication to use with this component (e.g., either IR or serial port), as shown in Fig. 13(B). Then, the user may select "Edit" and "New" from the menu bar 12 and select the type of device template to create, which causes the control panel 10 to populate the default properties of the template according to the type of the selected device. The user may enter the properties of the new device and create a catalogue of commands, as shown in Fig. 13(C). There may be two possible methods to use to create the command set. As shown in Fig. 13(D), the first method may follow the procedure for incorporating new devices. The user may select the new device template, and by hovering over "New,"
31
VW9I80O
the "Command" options may become available. Then the user may select the desired "Command." In using this method, the user may need to configure commands one by one. In Fig. 13(E) and 13(F), the second method may involve the "Properties" and "Create Contracts" button. After specifying which properties are supported by the device, the user may select the "Create Contracts" button, and the system may automatically create a catalogue of commands based on the properties supported. [0095] Using either of the previous methods, the user may create the command catalog, and then define the commands by selecting the expandable tree menu for the individual command as shown in Figs. 14(A) and 14(B), selecting the menu for the individual command, and select the correct communication for the particular command (e.g., IR or ASCII), as shown in Fig. 14(C). The IR commands may be transmitted through an IR bug and the ASCII commands may be delivered through a serial connection. Failure to choose the correct command type may result in an unresponsive device. If an IR learner is available, the user may select "Learn IR Codes" as shown in Fig. 14(D). The IR learner may need to be connected to an available serial port on the local machine. The control panel 10 may guide the user through the process of learning the IR codes by text in the box above the "Learn IR Codes" button. Once the codes are added, the user may save the new component and add it to the configuration. Then, the user may select "Configuration" in the functional area pane, select the active configuration and select the new component by friendly name. The user may need to check the configuration setting specified for the template and select "Save." To test the command catalog, the user may select "Start" on the component and verify that the service starts, and the device may be available to test under Devices. Then the user may be able to incorporate the devices into CAS using scripting commands. [0096] The user may add the new template component to the configuration. After saving the changes made to the template, the user may select "Configuration," and select the active configuration. The new template component may need to be added to the configuration by selecting it from the list of components. The component may populate in the list by friendly name. The system may require the definition of fields pertaining to the configuration file name and friendly name for logging purposes, as shown in Fig. 15(A). Usually standard 1:1 component: device configuration may be required. The exception to this rule may be when using a network adapter and multiple devices may be associated to the single component. The user can check the settings previously specified and then select "Save" to complete the configuration process, as shown in Fig. 15(B). To test the command catalogue, the user may select "Start" on the component and verify the service starts, and the device may be available in the Devices to test. The system may provide
32
\4491890
transport controls based on the set of commands configured, as shown in Fig. 15(C). The user may verify the performance of the device in order to identify any potential errors in setup. Then the user may now incorporate the devices into the CAS environment via scripting commands. [0097] The methodologies described herein may be implemented by various means depending upon the application. For example, these methodologies may be implemented in hardware, firmware, software, or a combination thereof. For a hardware implementation, the processing units may be implemented within one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, electronic devices, other electronic units designed to perform the functions described herein, or a combination thereof. [0100] For a firmware and/or software implementation, the methodologies may be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described herein. Any machine readable medium tangibly embodying instructions may be used in implementing the methodologies described herein. For example, software codes may be stored in a memory, for example the memory of client or device, and executed by a processor, for example a general-purpose processor. Memory may be implemented within the processor or external to the processor. As used herein the term "memory" refers to any type of long term, short term, volatile, nonvolatile, or other memory and is not to be limited to any particular type of memory or number of memories, or type of media upon which memory is stored. [0101] While the invention has been described in terms of exemplary embodiments, those skilled in the art will recognize that the invention can be practiced with modifications in the spirit and scope of the appended claims. These examples given above are merely illustrative and are not meant to be an exhaustive list of all possible designs, embodiments, applications or modifications of the invention.
33
\449I89O
Claims
1. A convergence and automation system, comprising: an internet-protocol based (IP) network implemented with a web service for devices (WSD) protocol; a plurality of devices connected to the network, each device being configured to perform at least one service; a server implemented with the WSD protocol connected to the network and configured to control the devices for converging and automating the services thereof; at least one client implemented with the WSD protocol connected to the network and configured to control at least a portion of the services of the devices; and one of the server and the at least one client being configured to establish communication with the devices, and further configured with a control panel application allowing a user to configure and test the convergence and automation system.
2. The convergence and automation system of claim 2, wherein each of said plurality of devices is selected from the group consisting of an audio device, video device, intercom device, lighting control device, security device and HVAC device.
3. The convergence and automation system of claim 1 , wherein said at least one client is selected from the group consisting of a television, personal computer; personal data assistant and remote controller.
4. The convergence and automation system of claim 1 , wherein said control panel application is configured to allow a user to create, edit, save, activate and delete a configuration for the convergence and automation system.
5. The convergence and automation system of claim 1 , wherein said control panel application is configured to allow a user to add, edit and delete a component of the convergence and automation system.
6. The convergence and automation system of claim 1 , wherein said control panel application is configured to allow a user to add, edit and delete a zone of the convergence and automation system.
34
VM91890
7. The convergence and automation system of claim 1, wherein said control panel application is configured to allow a user to add, edit and delete a source of the convergence and automation system.
8. The convergence and automation system of claim 1 , wherein said control panel application is configured to allow a user to add, discover, edit, delete, control a device of the convergence and automation system.
9. The convergence and automation system of claim 8, wherein said control panel is configured to allow the user to view manufacturer information of the devices.
10. The convergence and automation system of claim 1, wherein said control panel is configured to allow a user to add and edit a device control group of the convergence and automation system.
11. The convergence and automation syste'm of claim 1 , wherein said control panel is configured to allow a user to create, test, edit and delete a script of the convergence and automation system.
12. The convergence and automation system of claim 1 , wherein said control panel is configured to allow a user to create and edit a trigger of the convergence and automation system.
13. The convergence and automation system of claim 1 , wherein said control panel is configured to allow a user to create, edit and delete a schedule of the convergence and automation system.
14. The convergence and automation system of claim 1 , wherein said control panel is configured to allow a user to start, stop and restart the services of the devices.
15. The convergence and automation system of claim 1, wherein said control panel is configured to allow a user to create a template for the convergence and automation system.
35
^4491890
16. The convergence and automation system of claim 16, wherein said control panel is configured to allow the user to add the template to a configuration of the convergence and automation system.
17. The convergence and automation system of claim 17, wherein said control panel is configured to allow the user to test the configuration of the convergence and automation system.
18. An article comprising a machine readable medium having embodied thereon a program, the program being executable by a machine to allow a user to configure a convergence and automation system, the convergence and automation system comprising an internet-protocol based network, hardware implemented with a web service for devices (WSD) protocol and software implemented with the WSD protocol and configured to establish communication in the hardware and perform a logging function to record said events and errors.
19, The article of claim 19, wherein said program is a control panel application.
36
\449l8θϋ
Applications Claiming Priority (18)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US78259906P | 2006-03-16 | 2006-03-16 | |
US78263406P | 2006-03-16 | 2006-03-16 | |
US78263506P | 2006-03-16 | 2006-03-16 | |
US78273406P | 2006-03-16 | 2006-03-16 | |
US78259806P | 2006-03-16 | 2006-03-16 | |
US78259506P | 2006-03-16 | 2006-03-16 | |
US78260006P | 2006-03-16 | 2006-03-16 | |
US78259606P | 2006-03-16 | 2006-03-16 | |
US60/782,598 | 2006-03-16 | ||
US60/782,599 | 2006-03-16 | ||
US60/782,635 | 2006-03-16 | ||
US60/782,634 | 2006-03-16 | ||
US60/782,734 | 2006-03-16 | ||
US60/782,595 | 2006-03-16 | ||
US60/782,600 | 2006-03-16 | ||
US60/782,596 | 2006-03-16 | ||
US11/686,893 US8001219B2 (en) | 2006-03-16 | 2007-03-15 | User control interface for convergence and automation system |
US11/686,893 | 2007-03-15 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2007109566A2 true WO2007109566A2 (en) | 2007-09-27 |
WO2007109566A3 WO2007109566A3 (en) | 2008-05-08 |
Family
ID=38523203
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2007/064211 WO2007109566A2 (en) | 2006-03-16 | 2007-03-16 | User control interface for convergence and automation system |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2007109566A2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009050373A1 (en) * | 2007-09-28 | 2009-04-23 | France Telecom | Method and system for interactive telecommunication between at least two communication devices via their respective network connection means |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030065407A1 (en) * | 2000-04-28 | 2003-04-03 | Echelon Corporation | Internet based home communications system |
US20040092282A1 (en) * | 2002-11-06 | 2004-05-13 | Samsung Electronics Co., Ltd. | Remote control system of electronic appliances and remote control method employing the same |
US20050149758A1 (en) * | 2004-01-06 | 2005-07-07 | Samsung Electronics Co., Ltd. | Authentication apparatus and method for home network devices |
-
2007
- 2007-03-16 WO PCT/US2007/064211 patent/WO2007109566A2/en active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030065407A1 (en) * | 2000-04-28 | 2003-04-03 | Echelon Corporation | Internet based home communications system |
US20040092282A1 (en) * | 2002-11-06 | 2004-05-13 | Samsung Electronics Co., Ltd. | Remote control system of electronic appliances and remote control method employing the same |
US20050149758A1 (en) * | 2004-01-06 | 2005-07-07 | Samsung Electronics Co., Ltd. | Authentication apparatus and method for home network devices |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009050373A1 (en) * | 2007-09-28 | 2009-04-23 | France Telecom | Method and system for interactive telecommunication between at least two communication devices via their respective network connection means |
Also Published As
Publication number | Publication date |
---|---|
WO2007109566A3 (en) | 2008-05-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8001219B2 (en) | User control interface for convergence and automation system | |
US8725845B2 (en) | Automation control system having a configuration tool | |
US10367912B2 (en) | System and method for automating the management, routing, and control of multiple devices and inter-device connections | |
US20230018372A1 (en) | Method for establishing a building automation system including installing a plurality of controllable devices in a plurality of rooms in a building | |
US9306763B2 (en) | Providing a user interface for devices of a home automation system | |
US10728053B2 (en) | System and method for remote monitoring and controlling of building automation devices | |
US7496627B2 (en) | Automation control system having digital logging | |
US20100138007A1 (en) | Apparatus and method for integration and setup of home automation | |
KR101378555B1 (en) | Method, system, and computer readable recording medium for automatically managing components within a controlled environment | |
JP5016670B2 (en) | System and method for managing, routing, and controlling connection between devices | |
US7966083B2 (en) | Automation control system having device scripting | |
JP2008529125A (en) | Method, system and computer program product for setting multi-device control | |
US20100241254A1 (en) | Web browser based remote control for programmable multimedia controller | |
KR20080057326A (en) | Method, system, and computer program product for managing controlled residential or non-residential environments | |
JP2011187080A (en) | User interface for multi-device control | |
Kyas | How to smart home | |
JP2012022706A (en) | Method, system and computer program product for automatically managing component in control environment | |
WO2007109566A2 (en) | User control interface for convergence and automation system | |
WO2007109550A2 (en) | Automation control system having a configuration tool | |
Goodwin et al. | Control Hubs: Bringing It All Together | |
Goodwin | Control Hubs | |
Nevado Rodríguez | Home-Automation System |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 07758731 Country of ref document: EP Kind code of ref document: A2 |
|
NENP | Non-entry into the national phase in: |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 07758731 Country of ref document: EP Kind code of ref document: A2 |