JP2007517313A - Method, system and computer program product for automatically managing components in a controlled environment - Google Patents

Abstract

A control server (122) or similar central processing unit that manages the distribution of data, voice and control signals between a plurality of system components (102-122) connected via a wired and / or wireless communication network (180) provide. The portable controller (108) allows a user to access and control system components from all locations within a controlled residential and / or non-residential environment (100) including the surrounding area. One or more control macros (eg, 400) may be constructed to control the operation and / or function of system components. The control macro includes a plurality of commands for allowing the control server to control the system components. The control macro can be manually activated by the user (503) or automatically executed when the start parameter (703) is generated. Control macros can be automatically specialized for applications in a particular context (803).

Description

  The present invention relates generally to a method for controlling a consumer electronic device, and in particular (i) can be defined to run automatically at a specific time and / or when a specific event occurs, or (ii) an application in a specific context. The present invention relates to a method for controlling a home electronic device through a sequence of command operations that can be automatically specialized.

  The dawn of the information age has provided new and exciting opportunities for computer processing functions. Personal computers have been deployed in various fields in order to improve efficiency, reduce costs, and improve productivity. Personal computers are more accessible due to their smaller size and portability, and have become more important tools in business environments. Personal computers have also become very useful tools in non-business environments, including educational institutions and homes.

  The spread of personal computer networks is expanding. At home, multiple personal computers can be connected to each other, which allows users to share files without having to manually carry a diskette from one room to another. Computer networks also allow users to share printers, facsimiles, and other devices. Similarly, an internet connection facility can be provided, allowing access to external networks and services. Thus, a user can operate a home computer to instantly access information from anywhere in the world.

  Although the network of home computers is increasing, several important problems must be solved. For example, the introduction of a home network can be time consuming and expensive to deploy. In addition, there is no easy way to integrate a network of computers with other home equipment such as televisions, stereos, DVD players, and other home electronics. Efficient distribution of digital AV data between personal computers and other audio / video (AV) devices (TVs, DVD players, PVRs, etc.) is difficult due to differences and developments in communication standards and / or formats.

  Another important issue is to be able to effectively control networked home devices. The remote control unit can be adjusted to send signals to components of entertainment centers (such as televisions, stereos, and VCRs), but communication of multiple personal computers and other analog and / or digital devices in the home And there is no known central device that can be controlled. Furthermore, there are no known devices that can communicate and control multiple home devices without user intervention. Even with the remote control unit, the user must manually activate the hard key to send commands (infrared signals) to controllable consumer electronics.

  The combination of improved computer processing capabilities and global access to information has led to significant developments in the information processing era, but it is simple and inexpensive, and multiple home devices connected to a home network There is a need for a general purpose system that can integrate these functions, and that can facilitate the operation of these devices with minimal user intervention.

  Methods, systems, and computer program products are provided for managing a plurality of devices and / or applications in a controlled environment such as a home, business, school, etc. and their surrounding areas. The control center includes one or more servers or other data processing equipment to allow for integrated command and control of equipment and / or applications.

  In an embodiment of the present invention, a portable controller (such as a portable information terminal or a wireless note pad) allows a user to exchange information with the control center. Such information exchange includes changes in the configuration and performance of other devices and / or applications. Thus, the portable controller provides remote access to other devices and / or applications, allowing the user to control their functions and / or operations from anywhere in the environment.

  In one implementation, the portable controller controls other devices and / or applications within a controlled environment via a wireless network (eg, as defined by IEEE standards 802.11a, 802.11b, 802.11g, etc.). A handheld platform with a graphic display having a wireless connection to a control center. In another embodiment, the control center is built on a portable controller. In another embodiment, the portable controller communicates directly with other devices and / or applications via infrared (IR) code signals.

  In one implementation, one or more control macros can be constructed for control of the operation and / or function of system components. The control macro includes a set of commands that allow the control center to control multiple operations and / or functions of the system components at run time. A control macro (ie, a set of commands) can be associated with a control macro filename for later recall and execution.

  A user can define a control macro by manipulating a portable controller, another computer client, or a user interface that communicates with the control center. In one embodiment, the control macro is stored in the portable controller. When the user activates the control macro, the portable controller sends a request to the control center, and the control center produces the desired result (such as turning on the DVD player and associated television, causing the DVD player to play a DVD movie). Send a sequence of command signals to perform the necessary functions.

  In another embodiment, the control macro is automatically executed with little or no user intervention. Control macros are activated through a sequence of command actions that can be defined to execute automatically when a start parameter occurs or can be automatically specialized for an application in a particular context. The start parameter can be a predetermined time, date, state, event, etc., or a combination thereof.

  The accompanying drawings, which are incorporated in and form a part of this specification, illustrate the present invention, together with the description, explain the principles of the invention and are used to enable those skilled in the art to use the invention. . In the drawings, like reference numbers generally indicate identical or functionally or structurally similar elements. In addition, typically the leftmost digit (s) of a reference number indicates the drawing in which that reference number first appears.

(table of contents)
I. System overview II. Position recognition III. Profiling portable controllers for personal use IV. Typical system implementation.

(I. System overview)
The present invention is directed to an integrated command and control for multiple devices and / or applications within a control environment such as a home, business, school, etc. and their surrounding areas. The residence control environment may include a house, a home, an apartment, a mobile house, a house boat or other type of residence. However, in an embodiment, the residential environment includes the surrounding area of the residence along with any shelter, structure, building, etc. within the designated area.

  In other embodiments, the invention is practiced in a non-residential environment. Non-residential environments include, but are not limited to, office buildings, a series of small offices, production studios, warehouses, entertainment venues, schools or universities, medical facilities, hotels, resorts, aircraft, ships, cars, and the like. In an embodiment, the control environment for the non-residential embodiment includes not only the realistic scope of the buildings described above, but also their surroundings in the designated area.

  Examples of control environments include the names “Method, System, and Computer Program Product for Managing Controlled Residential or Non-Residential Environments” (US patent application Nos. 10/382, 8Emst, Prost. for Managing Controlled Residential or Non-Residential Environments (US Patent Application No. 10 / 180,500), which is incorporated herein by reference in its entirety. As described in these applications, in order to manage the distribution of information (including video, audio, voice, text, graphics, control messages, etc.) to other devices and / or applications in the controlled environment Various methods and systems can be provided. Such devices include, but are not limited to, communication devices, (telephones, intercoms, etc.), entertainment systems (TVs, CD / DVD players, gaming applications, stereos, etc.), surveillance systems (security cameras, baby monitors, etc.) ), Safety / security systems (fire alarms, sprinkler systems, door or window locks, etc.), personal computers (desktops, notebooks, notepads, personal digital assistants, etc.), cooking utensils (ovens, coffee makers, food / vegetables) Electric heaters, etc.), comfort systems (air conditioning and air conditioning equipment (HVAC), humidifiers, dehumidifiers, air purifiers, light switches, dimmers, etc.), outlets, and power supplies.

  An example of the control environment is shown in FIG. FIG. 1 illustrates a residence control system 100 according to one embodiment of the present invention. System 100 includes a communication network 180 that interconnects a plurality of system components. The system components are shown as positioning unit 102, two televisions 104 (shown as televisions 104 (a) and 104 (b)), two computer clients 106 (computer clients 106 (a) and computer clients 106 (b). ) One or more portable controllers 108, lighting equipment 110, HVAC system thermostat 112, tuner 114, media player 116, cable box 118, DSS box 120, and one or more central servers 122. Other equipment and / or applications can also be provided in the system component.

  The positioning unit 102 specifies a spatial location within a residence that serves as a hosting environment for the system 100. The positioning unit 102 is connected to other system components (eg, portable controller 108) via a wired and / or wireless interface. The positioning unit 102 functions to designate a floor or room in the residence. The positioning unit 102 also functions to specify a particular location or area within a floor or room. Further, the positioning unit 102 can be arranged outside the residence and can designate a region outside the residence.

  The computer client 106 comprises a wired and / or wireless personal computer, a personal digital assistant (PDA), a smart phone, a personal television, or other data processing device connected to a communication network. As a personal computer, the computer client 106 can be a desktop, notebook, notepad, or the like. The display displays characters or a graphical user interface (GUI) and is connected to the computer client 106 so that the user can communicate with the server 122 in two ways. Input devices for the computer client 106 include a keyboard, mouse, voice command interface, mouse wheel, joystick, ladder pedal, touch screen, microphone, joystick, stylus, light pen, or other type of peripheral device.

  The portable controller 108 is a wired and / or wireless data processing device that allows a user to exchange information, send control messages, and / or information (audio, video, voice, and other data) among other system components. (Including). Portable controller 108 may be a portable version of the device listed as computer client 106. For example, the portable controller 108 may be a personal notebook or notepad computer, PDA, smart phone, or other device with a display connected to the communication network 180 and capable of intercommunication with other system components. it can. Thus, portable controller 108 allows a user to remotely control the operation of various components of system 100. In one implementation, the display of the portable controller 108 can receive video and / or audio from other system components. In one implementation, the portable controller 108 includes a flash ROM that enables wireless downloads and / or uploads.

  The television 104 is a normal television. In one implementation, television 104 is extended to support interactive and / or personal services. Personal services include virtual recording, programming, live broadcast pause / rewind, and the like. For example, the television 104 is compatible with the MSN (registered trademark) TV service provided by WebTV Networks (Mountain View, CA) and corresponding to the WEBTV (registered trademark) service available from Microsoft (Redmond, WA). It can be set as the personal television extended. As shown, the television 104 may be connected to a cable set top box 118, a DSS set top box 120, and / or a media player 116 (eg, a PVR, VCR, or DVD player).

  One or more servers 122 monitor all traffic between other system components. The exchange of information between system components is routed through server 122 or otherwise controlled. As such, server 122 interacts with other system components to deliver data (including audio and / or video), voice, and / or control messages directly or indirectly through communication network 180. In one implementation, the server 122 directs and controls one or more operations and / or functions of other system components. Functions managed by the server 122 include video serving, audio serving, telephony, messaging, file sharing, Internet access, and security. In accordance with an embodiment of the present invention, a user operates portable controller 108 to build or reconfigure these functions and / or receive media from server 122 or other system components (other system components). Or indirectly from system components via the server 122).

  In one implementation, the portable controller 108 includes multiple functions of the server 122 as described herein to provide information (audio, video, voice, and other information) between other system components. Manage data delivery). In another embodiment, the communication network 180 supports peer-to-peer communication. In this way, system components exchange audio, video, voice, other data, and / or control messages directly with each other and without being centrally managed by server 122.

  Not all of the system components described above. Other equipment (including devices) can be implemented including, but not limited to, refrigerators, stoves, microwaves, toasters, coffee makers, alarm clocks, humidifiers, sprinkler devices, lighting, dimmers, and the like. In one embodiment, the server 122 and / or portable controller 108 controls the operation and / or function of the component, such as on / off, timer, adjustment (such as oven temperature), pause, snooze and the like.

  As described above, the communication network 180 provides a transmission medium for communicating between system components. Communication network 180 is a wired and / or wireless local area network (LAN). Accordingly, the communication network 180 may be a satellite, terrestrial (optical fiber, copper wire, UTP, STP, coaxial cable, optical coaxial hybrid transmission, etc.), wireless, microwave, free space optical communication, and / or any other form, Alternatively, it includes wired, wireless, or both transmission media, including any other transmission method.

  In an embodiment using a wired transmission medium, the communication network 180 is an Ethernet LAN using a CAT-5 cable and is connected to the server 122 and distributed to certain locations within each room. In one implementation, the cable is distributed to each system component, such as television 104, media player 116, and the like. The system component includes an audio / video (AV) connector that receives the cable. In one implementation, the communication network 180 includes telephone lines and / or power lines (such as communication technologies that can be utilized such as Home Phoneline Networking Alliance (HomePNA)).

In an embodiment using a wireless transmission medium, the communication network 180 corresponds to IEEE standard 802.11 (a), which defines a wireless Ethernet protocol for high-capacity video. In another wireless implementation, the communication network 180 corresponds to IEEE standard 802.11 (b), which defines a wireless Ethernet protocol for small volume video. In another wireless implementation, the communication network 180 corresponds to IEEE standard 802.11 (g). In another embodiment, BLUETOOTH ^™ radio technology (developed by Bluetooth SIG) is used to support the short range radio interface by system 100.

  As shown in FIG. 1, communication network 180 is a wireless network access point 182 such as those available from Linksys Group (Irvine, Calif.) Or Cisco Systems (San Jose, Calif.) As a system component platform. including. The wireless access point 182 provides a central point for wireless network connectivity and always-on connectivity required for system component tracking status. In addition, the wireless access point 182 can provide a connection point between wired and wireless networks. In one implementation using server 122, wireless access point 182 serves as a platform for server 122 as described above. In a server-based embodiment different from the present invention, the server 122 includes a bridge device (bridges 130 (a) to 130 (e)), a personal digital assistant (such as 108), a personal computer (such as 106), and the like. In addition to a wireless access point (such as wireless access point 182 shown at 180), it can actually be deployed on a plurality of different device platforms.

  The system 100 also includes a plurality of infrared / serial bridges 130 (a) -130 (d) that conform to the wireless communication standard IEEE 802.11 (b). Each infrared / serial bridge 130 exchanges information with one or more components. As shown in the figure, the infrared / serial bridge 130 (a) exchanges information with the television 104 (a), the cable box 118, and the media player 116. It will be appreciated by those skilled in the art that infrared / serial bridge 130 (b) interacts with tuner 114 or any type of specialized equipment that relies on infrared / serial communication protocols. The infrared / serial bridge 130 (c) exchanges information with the thermostat 112. The infrared / serial bridge 130 (d) exchanges information with the lighting device 110. The wireless Ethernet (registered trademark) bridge 130 (e) exchanges information with the television 104 (b) and the DSS box 120. The wireless Ethernet (registered trademark) bridge 130 (e) can correspond to a device capable of specifying any IP address. Thus, the television 104 (b) and the DSS box 120 are “next generation” UPnP devices having IP addresses.

Accordingly, the present invention integrates legacy equipment (eg, consumer electronics (CE) that relies on infrared / serial communication protocols) as a system component along with applications defined by UPNP ^™ equipment and Universal Plug and Play (UPnP) Forum. can do. An example of a control environment that implements an infrared / serial bridge of IEEE 802.11 (b) is the name “Legacy Device Bridge for Residential or Non-Residential Networks” (US Patent Application No. 10 / 387,590, March 2003). 14 application), which is incorporated herein by reference in its entirety.

  As described above, portable controller 108 (such as a personal digital assistant, wireless notepad, etc.) allows a user to remotely change the configuration and functionality of other devices and / or applications from anywhere in the controlled environment. . In one embodiment, portable controller 108 is a handheld platform having a graphic display. The platform provides a wireless connection to the central server 122 that can control other devices and / or applications in the control environment via the wireless communication network 180 (eg, as defined by IEEE standard 802.11b). Have. In other embodiments, the server 122 is incorporated into the portable controller 108. In other embodiments, the portable controller 108 communicates directly with other equipment and / or applications via infrared (IR) code signals.

  In one embodiment, the present invention comprises one output system component (eg, television, monitor, speaker, etc.) having multiple input system components (eg, DVD, VCR, satellite tuner, digital video recorder, stereo, etc.). Facilitates system control. In accordance with the present invention, first, the user selects an output component via a GUI that appears on the portable controller 108. The user is then shown on a control screen that provides the user with the ability to select a particular input component using a “tabbed” interface. When that input is selected, the control screen for that component is shown. An example of a user interface for associating and controlling various system components is described in the name “User Interface for Multi-Device Control” (US Patent Application No. 60 / 516,302). Is incorporated herein in its entirety.

(II. Position recognition)
In an embodiment of the present invention, the network control system 100 tracks and / or monitors the location of various system components (hereinafter referred to as “target components” herein) in real time or in a short period of time. As the user moves within the control environment hosting the system 100, the present invention executes multiple protocols so that the system 100 can communicate with the target component to determine the location of the target component and thus the user's location. To. In one embodiment, the control center (such as server 122, a local processor connected to the target component) determines the current location of the target component (such as portable controller 108) and sends instructions to reconfigure the target component. Control other system components in a particular neighborhood. For example, if it is determined that the portable controller 108 is located in a cafeteria, the server 122 allows the portable controller 108 to control system components located in the cafeteria. Such components include dimmers, audio systems, heating units for food servers, and the like.

  The positioning unit 102 is used in some embodiments for tracking and / or monitoring target components. As described above with reference to FIG. 1, one or more positioning units 102 are distributed throughout the control environment that hosts the system 100. The positioning unit 102 can be connected to a target component (portable controller 108, audio client, phone, etc.) or placed as a stand-alone device in a controlled environment.

  In one implementation, positioning unit 102 is part of an RF communication system. That is, the RF transponder exchanges information with the RF interrogator to communicate positioning information. The transponder is connected to the system component and makes available identification information that uniquely identifies the system component. The transponder can make other types of information available, including the assigned location of the system component when the component is a fixed or infrequently moving device. Thus, the transponder can be connected to either the target component or the positioning component (eg, positioning unit 102).

  The transponder can be active or passive. The active transponder transmits a continuous or periodic signal containing identification information. The passive transponder remains inactive or silent until it is activated, for example by an interrogator, or manually by a user. Thus, system components (including transponders) can be operated in silent or active mode. In active mode, the location of system components (ie, target components) is monitored in real time or in a short period of time. In silent mode, the absolute certain current position of the system component (ie, the target component) is not known to the system 100 until the transponder is activated.

  When the interrogator enters the communication range of the transponder, it is connected to another system component and receives positioning information (such as identification information). The interrogator automatically receives positioning information from the active transponder or activates the passive transponder to receive the positioning information.

The exchange of information between the transponder and the interrogator is referred to by the names “Method, System, and Computer Program Product for Managing Controlled Residential or Non-Residential Environments” (US Patent No. 8 / Mr. System, and Computer Program Product for Managing Controlled Residential or Non-Resident Environmentals "(US Patent Application No. 10 / 180,500). As described above, to track and / or monitor the location of system components, for example, RF communications, Bluetooth ^™ wireless technology (developed by Bluetooth SIG), barcode technology, GPS receivers, cell phone signals, Various positioning techniques can be used in the present invention, including triangulation and the like.

  In one embodiment, positioning can be achieved without using the positioning unit 102. The portable controller 108 and the like correspond to reception and processing of commands from a user who operates the portable controller 108. Commands are entered into the portable controller 108 manually and / or by voice. The portable controller 108 processes the command or sends the command to the server 122 to determine the location. For example, a user can designate a location as “living room” and portable controller 108 is profiled to control devices and / or applications in that living room.

  However, in other implementations, voice or manual commands can be entered into the positioning unit 102 or the like. The user also enters an identifier for the target component (such as portable controller 108) to update the location record of the target component, and positioning unit 102 sends a control signal to server 122.

  As described above, the present invention supports various protocols for obtaining location information. The present invention provides a plurality of methods and / or techniques for processing position information to track and / or monitor the position or movement of various components of system 100. Please refer to FIG. Flowchart 200 represents the general operational flow of an embodiment of the present invention. More specifically, flowchart 200 illustrates an example of a control flow for tracking and / or monitoring system components within a control environment.

  Please refer to FIG. The control flow of the flowchart 200 starts from step 201 and immediately moves to step 203. At step 203, the appropriate component of system 100 accesses the identification information or locator code corresponding to the system component being tracked and / or monitored (ie, the target component). Please refer to FIG. The present invention includes, but is not limited to, positioning unit 102, television 104, computer client 106, portable controller 108, lighting device 110, tuner 114, media player 116, cable box 118, DSS box 120, server 122, telephone, security camera , Security monitors, and / or other equipment and / or applications can be used to determine the current location of any of the above system components. In addition, as described above, the present invention includes various embodiments for accessing the locator code. The locator code includes an identifier for the transmit or poll portable controller 110 or other system component. The locator code may also include other identification codes or information for polling or transmitting system components. In one implementation, other identification information includes, for example, a neighborhood identifier for the area (floor, room, etc.) of the residential environment where the transmitting or polling portable controller 108, positioning unit 102, or other system component is located.

  In one implementation, the user interacts with a text or graphical interface to manually enter the current location for the target component. In another embodiment, the voice command interface allows the user to enter voice commands for the target component. In this way, the user communicates the current position by voice.

  In another embodiment, the target component interacts with positioning unit 102 to access the locator code. For example, a target component (such as portable controller 108) can be connected to an interrogator that polls the positioning unit 102 for proximity identifiers. The neighborhood identifier includes a locator code for the current location for both system components.

  According to another example, the interrogator 406 can be integrated with the positioning unit 102. Thus, target components (such as portable controller 108) are polled by the interrogator. As a result, the interrogator receives an identifier for the polled target component. A locator code is formed by associating an identifier with a neighborhood identifier for the interrogator.

  At step 206, the locator code is sent to the command center for further positioning processing. In one embodiment, the command center is server 122. In another embodiment, the command center is at a target component (such as portable controller 108, computer client 106).

  At step 209, the locator code is matched to one region. The area may be a specific floor, corridor, corridor, balcony, room, etc. The area may be a specific area within a floor, hallway, corridor, balcony, room, etc. The area may also be a peripheral area outside the residence that hosts the system 100, or a specific area within a nearby or free-standing shelter on the residence.

  At step 212, the current region is communicated to the target component and / or recorded on the server 122 for later recall. After the system component is deployed and its positioning data has been updated, the control flow ends, as shown in step 295.

  In one implementation, the positioning information allows the system 100 to command and control specific system components based on the current location of a user interacting with the system 100. This can be explained with reference to FIG. As shown in FIG. 3, a flowchart 300 represents the general operational flow of an embodiment of the present invention. More specifically, flowchart 300 illustrates an example of a control flow for commanding and controlling system components based on a user's current location.

  Please refer to FIG. The control flow of the flowchart 300 starts from step 301 and immediately moves to steps 203 to 209. As described with reference to steps 203-209 of FIG. 2, the locator code allows the system 100 to determine the current location or area of the user interacting with the target component (eg, portable controller 108). become.

  At step 312, the region profile is accessed for the region. The region profile includes a list of devices and / or applications (ie, system components) that receive and / or control commands from servers 122 and / or portable controllers 108 in the region.

  At step 315, the region profile is processed to indicate control options for the user to check. The control options include a list of devices and / or applications that correspond to the region profile. As described with reference to FIG. 2, positioning can be determined remotely at server 122 or locally at a target component (eg, portable controller 108). If determined remotely, the server 122 may, for example, create and send a user interface to display control options on the target component (eg, the portable controller 108 or other system component operated by the user). If determined locally, the target component (such as portable controller 108) searches the region profile to create a user interface. The region profile can be sent to the target component on demand. Alternatively, the target component can be updated regularly with available area profiles.

  At step 318, the user operates a target component (such as portable controller 108) to send a request to control the system components (such as television 104, lighting device 110) identified in the region profile. A user can send a request to control the function and / or operation of a system component. The user can send a request to change the configuration or security profile of the component. Other control requests can be sent, as will be appreciated by those skilled in the art.

  In step 321, the control request is executed by the designated component. The control request can be sent directly to the designated component or indirectly via the server 122 to the designated component. After the control request is executed, the control flow ends as indicated by step 395.

  For example, if the user is operating the portable controller 108 and the system 100 determines that it is located in the “living room”, the portable controller 108 receives a user interface for controlling system components in the living room. Some system components may include a security monitor that receives video input from a security camera located at the entrance of a residence, for example. The user can interact with the portable controller 108 to turn, tilt, or focus the security camera and display an image of a visitor standing at the entrance on the security monitor. Another system component can be the television 104 and the portable controller 108 can receive a user interface for controlling the volume or channel selection of the television 104. The user can also interact with the portable controller 108 to change the settings of the HVAC (ie, thermostat 112).

(III. Profiling portable controllers for personal use)
The present invention allows a user to operate portable controller 108 to command and / or control other system components. In one implementation, the portable controller 108 allows the user to only control system components in the vicinity of the portable controller 108. In another embodiment, portable controller 108 provides an option to control system components in another area.

In an embodiment, the control of various system components is based on a preset profile that is constructed for the user. Profiles can be generic for all users and / or can be specially configured for specific users. When configured for a particular user, the present invention uses various protocols to identify or authenticate the particular user and execute the profile built for that user. In one implementation, a username and / or password is entered into a system component (such as portable controller 108). Passwords can be represented by voice commands, text, objects, pixels, and the like. In another embodiment, biometric authentication is utilized by system components. That is, retina, iris, face, palm, fingerprint, and / or voice recognition technology, etc. are used to identify and / or authenticate the user. In another embodiment, the user card is read by a system component (such as portable controller 108). Other user identification and / or authentication techniques can be used to identify and / or authenticate the user. The present invention allows the user to change the profile as needed.
The identification and / or authentication techniques described above prevent other users from changing or deleting a user profile after it has been constructed.

  In an embodiment, the present invention allows a user to build a profile to save “favorite” settings for system components. For example, favorite settings can be built for television programs, audio / video recording, room temperature, bathtub control, clock alarms, dimmer settings, websites, news broadcasts, economic channels, and the like.

  In an embodiment, a user can build a profile for creating a “playlist”. For example, a series of video or audio recordings can be prepared and / or saved for playback on a television 104 or other audio client, for example. A sequence of graphic images or photographs can be prepared and / or saved for playback on a monitor or computer client 106, for example. It will be appreciated by those skilled in the art that other schemes or media and / or multimedia playlists may be created according to embodiments of the present invention.

  In an embodiment, a profile can be created to build a security protocol for system components. For example, a profile can be created to block specified users from accessing certain content. For example, minor users may be prevented from accessing certain television channels, websites, areas (such as locked rooms, drawers, safes, etc.).

  In an embodiment, the present invention allows a user to build multiple profiles. Each of the plurality of profiles can be adjusted for behavior depending on the context. For example, a user can create a profile for evening entertainment that includes, but is not limited to, presets such as lighting, audio / video presentations, security access warnings, bathtub controls, and the like. Other profiles can be built for home office activities, including but not limited to baby monitors, classic record playlists, coffee makers, timer controls, and the like. Profiles for morning habits can be built including, but not limited to, alarm / snooze control, coffee maker timer control, lighting, news broadcasts, etc.

  Users can also build multiple profiles for use with other individuals. For example, a user may have a profile with security controls set to block certain television programs, websites, audio recordings, etc. when they are with minors. However, when with a minor, the user can recall a profile with more free security settings.

  Thus, in addition to recognizing location according to the present invention, various system components (such as portable controller 108) for recognizing a user can be used. Thus, for example, the portable controller 108 can be customized for each user based on the user profile described above. In an embodiment, the user awareness feature allows system 100 to use “follow-me” system control. For example, “follow-me” video is used to transfer a selected video product to various displays throughout the control environment. For example, the user operates the portable controller 108 to select a video product (TV program, DVD recording, etc.). The video product can be displayed on the portable controller 108 (media viewer 710 described with reference to FIG. 7). As the user moves from room to room in the controlled environment, the system 100 tracks the portable controller 108 and retrieves a region profile for each region. Thus, when the user enters a new area or room, the monitor or television 104 located within the room is automatically activated to display the video product selected by the portable controller 108.

  Similarly, “follow-me” audio can also be used in the present invention. In this way, the user can select an audio product (CD recording, wireless broadcasting, etc.) by operating the portable controller 108, for example. As the user moves from room to room, the positioning technology of the present invention allows the system 100 to transfer audio products to clients, monitors, etc. located in the vicinity of the portable controller 108.

  “Follow-me” illumination is another exemplary embodiment of the present invention. When a user having the portable controller 108 enters or exits the room, the system 100 causes the lighting (eg, the lighting device 110) to be dimmed or turned on / off based on the setting of the profile. Send a command.

  In one implementation, one or more control macros can be constructed to control the operation and / or function of system components. The control macro includes a set of commands that, when executed, allow the server 122 to control multiple operations and / or functions of one or more system components. A control macro (ie, a set of commands) can be associated with a control macro file name for later recall and execution.

  A user can define control macros through a user interface that communicates with portable controller 108, computer client 106, or server 122. In one implementation, a graphical user interface can be used to allow the user to define new control macros. FIG. 4 shows an example for defining a control macro according to an embodiment of the present invention. A flowchart 400 shows an example of a control flow for defining a control macro for viewing a moving image recorded on a DVD.

  Please refer to FIG. If the user activates a macro recording command to identify the macro recording mode from normal system operation, the control flow of flowchart 400 begins at step 401. At step 403, the user operates one of the devices described above (ie, the portable controller 108, computer client 106, or user interface to the server 122) to use the user to view the video. Select a room with the desired system components (TV 104, monitor, etc.).

  At step 406, the region profile for the selected room is recalled. As described above, the region profile identifies all system components located in the specified region. In one implementation, the region profile is stored on server 122, which searches and creates an appropriate region profile available to the user.

  At step 409, the user checks the region profile and selects a viewing system component (eg, television 104). The user also specifies video input for a DVD source (eg, media player 116). The user can specify any desired settings including, but not limited to, contrast, brightness, and the like.

  In step 412, the user specifies the desired audio settings. In one implementation, the user sets the volume level of a viewing system component (eg, television 104). In another embodiment, the user selects an external speaker or even other audio client to use, or instead selects an internal speaker for a viewing system component (eg, television 104).

  At step 415, the user selects a desired DVD movie from a DVD player (ie, media player 116). Alternatively, if the DVD player is located in the same room as the selected viewing system component (eg, television 104), the user may instruct media player 116 to start playing the currently loaded video, or simply enter the media bay. The open user can be instructed to wait for the insertion of the desired DVD.

  At step 418, the user specifies settings for the lighting device 110 shown in the area profile. The user can dim the lighting to a desired comfortable level. In one embodiment, lighting device 110 includes a RadioRA home dimming system available from Lutron Electronics (Coopersburg, PA). Thus, the present invention allows the creation of control commands for RadioRA dimming systems. Returning to FIG. 1, the illumination 110 is a typical illumination system controlled by a signal reactor 1202 of a dimming system such as Lutron's RadioRA or X-10 dimming system.

  At step 421, the control commands for implementing the specifications of the television 104, audio client 118 (if selected), media player 116, and lighting device 110 are collectively associated with a common control macro.

  In step 424, the user saves the control macro and assigns a file name such as "view movie". In one embodiment that uses portable controller 108 to create a macro “view video”, the user can associate the macro with a particular macro button or icon. Thus, when the user activates the “Watch Video” macro button, all relevant commands to perform the user-specified selection are recalled so that the television 104 is ready to play the desired movie. And executed. Once the control macro is created and saved, it can be activated and the control flow ends, as shown in step 495.

  In one embodiment, commands associated with a particular control macro are stored in server 122 or a database or library belonging to server 122. Thus, in one embodiment that uses portable controller 108 to execute a control macro, portable controller 108 allows a user to associate a control macro with a control macro button or icon. When executed, the control macro button sends a generic command to the server 122. The server 122 then retrieves the set of commands associated with the generic command and sends the set of commands to the appropriate system component for execution. That is, the present invention allows a mobile device such as portable controller 108 to send a single high level request to an integrated command center such as server 122. Server 122 translates a single request based on its environment (eg, user, location) and retrieves a corresponding sequence of commands that needs to be transmitted over communication network 180 including wireless (or power line) communication. .

  Alternatively, according to one embodiment of the present invention, when the server 122 recognizes via a stored room profile when creating a room profile or when the server 122 detects in real time, Based on the specific equipment and / or applications present in the selected room or area, the server 122 can automatically create a control macro. For example, if the server 122 detects that there is a DVD player (ie, media player 116) and television 104 in a room, such as a living room, the control server may have a basic equivalent to the macro described above that can be further customized by the user. Automatically build a “watch video” macro.

  FIG. 5 shows an example for activating a control macro according to one embodiment of the present invention. A flowchart 500 shows a control flow for starting the control macro of the flowchart 400, and relates to viewing a moving image recorded on a DVD.

  Please refer to FIG. The control flow of the flowchart 500 starts from step 501 and immediately moves to step 503. In step 503, the user activates the “view video” control macro defined in steps 401 to 495.

  At step 506, the set of commands associated with the “view movie” control macro is recalled from their storage location. The set of commands includes user-defined specifications for controlling the function and / or operation of specific system components. In this example, the set of commands related to the “view video” control macro includes commands for changing the lighting device 110, starting the media player 116, and starting the television 104. If the user wants to hear the audio of a video on a home stereo speaker system, the set of commands also includes a command for launching the appropriate audio video system component.

  In one implementation that uses the portable controller 108 to launch the control macro, the portable controller 108 sends a generic command associated with the “view video” control macro. The generic command is sent to the server 122, which recalls the set of commands associated with the generic command for the “view video” control macro.

  At step 509, room and system components (eg, television 104 or media player 116, lighting device 110, audio client) are identified by a set of commands. In the example described with reference to FIG. 4, the room is specified in the control macro. However, in another embodiment, the control macro itself need not be room specific. As described above, the present invention includes procedures and / or techniques for tracking the location of a user or portable controller 108. Thus, the user can request to activate a control macro (such as a “view video” control macro) in order to view the video in any room where the user is currently located. Thus, the server 122 specifies that the current position of the user is a room in which the control macro is executed. Similarly, the server 122 can search the room profile of the user's current location and identify viewing components, media players, and lighting components located in the designated room.

  At step 512, device access permissions are authenticated for each system component identified at step 509. As described above, restrictions on the operation of various system components are established and monitored by a security protocol executed by server 122. Accordingly, the present invention is for a user requesting a control macro for determining whether the user is permitted to operate the system components (including actual DVDs) specified in the control macro. Providing procedures and / or techniques for identifying or authenticating If the user is not authorized to access the specified system component, a message can be sent to the user notifying that access has been blocked.

  In step 515, the present invention determines which commands are associated with each system component identified in step 509. For example, control commands that specify viewer settings are queued in the television 104. Similarly, control commands for specifying lighting settings are queued in the lighting device 110.

  In one implementation, the server 122 assigns component specific commands for each system component. Component specific commands are encoded and sent to the designated system component via the appropriate protocol. Server 122 also updates its records to track the status of each system component.

  At step 518, each system component receives and executes the component specific command. In this way, the lighting in a particular room (i.e., lighting device 110) is automatically dimmed and the particular television 104 is turned on and configured as predefined. A particular DVD player (ie, media player 116) is similarly activated. Depending on the speaker options specified in the control macro, the identified audio component is also activated and waits for audio sent from the DVD player.

  At step 521, the control screen is sent to the user interface that the user has manipulated to launch the control macro. When using the portable controller 108, the control screen appears on the display and the control macro is properly executed and ready to start playing the DVD movie (or if the option is selected, the DVD player Ready to receive the desired video). Thereafter, as shown in step 595, the control flow ends.

  As described above, if the user presses a particular key on the portable controller 108 that is assigned by the user to run a basic “watch video” macro, the portable controller 108 may A request is transmitted to the server 122. The central server 122 also has a wireless network connection to various consumer electronic devices via the 802.11 / IR bridge 130. Thus, upon receiving a “view video” request from the portable controller 108, the server 122 sends a sequence of command signals to allow the user to view the DVD (eg, media player 116 and associated television). 104 or the monitor is turned on and the media player 116 is instructed to begin playback of the DVD) to perform multiple functions.

  The present invention is not limited to a hard key implemented. In one embodiment, portable controller 108 is a PDA with a screen that serves as a wireless interface to central network server 122. In this embodiment, when the user activates the “soft” or “view video” macro button or icon on the GUI for the portable controller 108, the user requests the “view video” macro. Is transferred to the server 122. Server 122 then sends appropriate commands to television 104 and media player 116, both of which have a network connection to server 122. An advantage of the present invention is that the user does not need to be on the line of sight of the controllable instrument, but with conventional IR remote control units this is necessary.

  According to one embodiment of the present invention, the user must physically begin operation of the control macro by activating a hard or soft key on the portable controller 108. In another embodiment of the present invention, the control macro is automatically executed with little user intervention. A control macro can be defined to (i) automatically execute at a specific time and / or when a specific event occurs, or (ii) a command that can be automatically specialized for an application in a specific context Performed through a sequence of actions.

(A. Time-based execution)
In one embodiment of the present invention, the predetermined sequence of control commands is automatically (ie directly by the user) when a preset time (ie clock-based) and / or date (ie calendar-based) is reached. Executed without intervention). For example, a user may have a television 104 and a satellite television tuner 114 in their bedroom. The user may wish to turn on the television 104 in the bedroom automatically at 6:30 am to tune in to a specific channel as a routine for his “wake-up”. This can be achieved by a control macro consistent with the present invention.

  If the bedroom television 104 and the lighting 110 are connected to the central server 122 via the wireless network 180, the central server 122 turns on the lighting 110 at 6:30 am and turns on the television 104 to turn it on. Can be programmed to tune the satellite TV tuner 114 to a number of channels. As described above, the user configures the control macro via a GUI that can be created by the central server 122 and displayed on the screen of the portable controller 108. The central server 122 can be physically independent of the portable controller 108, as shown in FIG. 1, or it can be a PC-based device where the central server 122 itself can reside in the portable controller 108. .

  In one embodiment where the portable controller 108 is operated on a stand-alone basis without the server 122, the portable controller 108 sends the appropriate command or commands directly to each controllable component (eg, television 104). The portable controller 108's internal clock automatically launches the control macro at 6:30 am when it is released or indirectly issued to a controllable component via the network access point 182 and / or bridge 130. Start. The user therefore configures the control macro using the GUI created by the portable controller 108.

  Alternatively, the “wake-up” control macro can be configured to run only on certain days. For example, a user may desire to run a “wake up” control macro only on weekdays. Thus, the user can program the central server 122 or portable controller 108 to execute the “wake up” control macro only on weekdays.

  FIG. 10 illustrates a user interface 1000 for configuring a time-based control macro according to one embodiment of the present invention. The user interface 1000 includes a configuration control field 1002, a name field 1004, a time field 1006, a repeat field 1008, a repeat definition field 1010, a controllable activity field 1012, and an accept activator 1014.

  The configuration control field 1002 represents a configuration level for setting a time-based control macro. As shown in configuration control field 1002, a “wake up” control macro is scheduled to occur in a bedroom in a controlled environment such as home control system 100.

  The name field 1004 allows the user to personalize the name of the control macro. In this example, the control macro is designated as “wake up”.

  The time field 1006 allows the user to specify the time to execute the control macro. The repeat field 1008 specifies whether the control macro is repeated (ie, a repeat event) or only once (ie, a non-repeat event). The options available in the iteration definition field 1010 depend on the input in the iteration field 1008. Specifying a recurring event in repeat field 1008 allows repeat user 1010 to specify the frequency of the repeat. For example, the control macro can be scheduled to repeat at a frequency of daily, biweekly, weekly, bimonthly, monthly, yearly, etc. The control macro can be scheduled to run only on weekends, weekdays only, even days only, or on specified holidays, birthdays, anniversaries, and the like. In one embodiment, fields are provided that allow the user to specify a start date and / or an end date for executing the control macro.

  Controllable activity field 1012 allows the user to identify one or more specific events that occur when the control macro is executed. For example, the user can turn on the TV 104 to a specific channel (shown as “Watch Cable TV” in FIG. 10), turn on the TV 104 and the DVD player (ie, media player 116). Watching the specified video (shown as “Watch DVD” in FIG. 10), turning on the stereo and matching to the channel of the specified frequency (shown as “Listening to satellite radio” in FIG. 10), illumination 110 Can be requested to turn on and wake up alarm.

  Options for each field (eg, time field 1006, iteration definition field 1010, controllable activity field 1012, etc.) can be pre-defined and displayed in a drop-down menu. Alternatively, the user can manually enter the desired parameters using the input device.

  Accept activator 1014 allows the user to finish the selection and instruct the central server to accept the newly defined control macro. Once the fields of the user interface 1000 are properly entered, the user can manipulate the input device (mouse, stylus, finger, etc.) to touch the accept activator 1014, and the input from the user interface 1000 is centered Processed by the server 122, the next user interface is presented as needed.

  As shown in FIG. 10, “view cable TV” is selected as the desired activity in the controllable activity field 1012. Thus, the user needs to specify the main system components and associated system components for performing the desired activity. FIG. 11 shows a user interface 1100 for configuring controllable system components to execute time-based control macros according to one embodiment of the present invention. As shown in the configuration control field 1002, the television 104 is configured to execute a “wake up” control macro in the bedroom of a control environment (eg, the residence control system 100).

  The user interface 1100 includes an input field 1104, an audio field 1103, and a caption field 1108. Input field 1104 allows the user to specify an input source for a scheduled television event. As shown, the user is prompted for input from a cable source (eg, cable box 118). Other options include satellite broadcasts sent from the DSS box 120, radio broadcasts broadcast from an antenna connected to the tuner 114 or television 104, media players 116 (PVR, VCR, DVD, etc.), and the like.

  Audio field 1106 allows the user to specify the audio level. The audio level can be muted or a predetermined decibel level.

  Caption field 1108 allows the user to request text or subtitle options. Upon appropriate completion at the user interface 1100, the user can manipulate the input device (mouse, stylus, finger, etc.) to touch the accept activator 1014, and the input from the user interface 1100 is sent to the central server 122. Processed and presented with the next user interface as needed.

  As shown in FIG. 11, “cable” is selected as the desired input source for television 104. Thus, the user needs to configure the relevant system components to provide input to the television 104 of the main system components, but in this example, the cable channel for performing the desired activity is specified. FIG. 12 illustrates a user interface 1200 for configuring related controllable system components to execute time-based control macros, according to one embodiment of the present invention. As shown in the configuration control field 1002, the cable box 118 is configured to execute a “wake-up” control macro in a bedroom of a control environment (eg, the residential control system 100).

  The user interface 1200 includes a channel field 1204 that allows the user to specify a desired channel. Upon proper completion of the channel field 1204, the user can activate the accept activator 1014 and input from the user interface 1200 is processed at the central server 122. Additional user interfaces can be presented so that the user can configure additional system components as needed.

(B. State or event-based execution)
In one embodiment of the invention, the predetermined sequence of control commands begins when a particular event occurs or when a particular system or component condition occurs. For example, a control macro is automatically executed when it is detected that a system component (eg, home electronics) is in a particular state (eg, the TV 104 in the living room is turned on). The A pending application, entitled “Legacy Device Bridge for Residential or Non-Residential Networks” (US Patent Application No. 10 / 387,590, filed March 14, 2003), which is hereby incorporated by reference in its entirety. ), The on / off state of the home electronic device can be determined by using a state detector. The condition detector can be as simple as a photoelectric probe intended for a screen for television 104 or can function as a basic on / off meter. When the photoelectric probe senses light emission from the screen of the television 104 (or alternatively, the change of the LED power indicator for the television 104 from red light to green light), the probe passes the information to the central server 122, where Determines that the television 104 is in the “on” state.

  When the server detects or determines that the living room television 104 is in the “on” state, it then automatically sends an appropriate sequence of commands to each system component that defines the desired control macro. For example, the server 122 can be programmed to execute a “view DVD” macro that turns off the light in the living room and activates the DVD or media player 116 when the television 104 is turned on.

  In another embodiment of the invention, the occurrence of a particular detectable event (as opposed to a state) can serve to immediately and automatically execute a pre-programmed macro. For example, a window (or door) may be equipped with an electrical, magnetic, or light sensor that is connected to the central server 122 and informs the central server 122 whether the window is open. When it detects that the kitchen window is open, the server 122 can automatically execute a “security” control macro. This control macro turns on the kitchen lighting 110 and / or sounds the alarm (ie, the lighting 110 and the alarm have a network connection to the central server 122). Or, for example, when a doorbell (doorbell has a network connection to the central server 122) is ringed, the server 122 can execute a control macro that turns on outdoor lighting.

  The control macro of the present invention can also be activated in response to a combination of state, event, and time. For example, the “security” macro described above can be activated only if the kitchen window is open (ie, state) after 10 pm (ie, time) on the weekend (ie, date).

  FIG. 6 shows an example for defining a control macro that is activated when a “start” parameter such as a predetermined time, date, state, event, etc. occurs. Please refer to FIG. When the user activates a macro recording command, the control flow of flowchart 600 begins at step 601.

  At step 603, the user operates one or more of the devices described above (ie, portable controller 108, computer client 106, user interface to server 122, etc.) to construct one or more control macros. Identify and specify settings for the system components. For example, the user can configure a plurality of audio-video devices to watch a video as described above by steps 403-418 of FIG. As another example, a user may configure bedroom lighting 110, television 104, and tuner 114 to create a “wake up” control macro as described above. The user can also configure the operation of the alarm system, lighting 110, security camera, and monitor to define a “security” control macro as described above. The above examples are not exhaustive. Other types of system components and combinations of system components can be configured and associated with control macros as described herein.

  As described above, in one embodiment, the control macro can be automatically created by the server 122. Thus, at step 603, the server 122 is appropriate for the selected room or region, for example, when detected from a saved room profile or when it is detected in real time that a room profile has been created. By detecting the presence of a system component, the control macro can be set to watch a DVD.

  In step 606, the user specifies start parameters that, when activated, allow the control macro specified in step 603 to be executed automatically. As described above, the start parameter can be a predetermined time, date, state, event, or the like. The start parameter can also be a combination of start parameters.

  At step 609, the control commands for executing the specifications at steps 603-606 are collectively associated with the control macro. In step 612, the control macro is given a file name and stored in a storage location. In one implementation using portable controller 108 and central server 122, control macros are stored on portable controller 108 and associated control commands are stored on central server 122. In another embodiment, control macros and associated control commands are stored on server 122. In one embodiment that does not use the central server 122 (as described above), both the control macro and associated control commands are stored on the portable controller 108.

  After the control macro is created and saved, the control macro is ready to be activated when one or more start parameters occur, and the control flow ends, as shown in step 695.

  FIG. 7 shows an example for launching an automatically executable control macro according to one embodiment of the present invention. The flowchart 700 shows a control flow for starting the control macro of the flowchart 600.

  Please refer to FIG. The control flow of the flowchart 700 starts from step 701 and immediately moves to step 703. At step 703, the occurrence of the start parameter is detected by the portable controller 108, server 122, or some other system component in communication with the portable controller 108 or server 122. When the occurrence of the start parameter is detected, in step 706, the control macro related to the occurrence of the start parameter is accessed and activated.

  For example, the start parameter may be a predetermined date / time and component status. That is, the user can set the control macro so that the room lighting is turned on when the television 104 is turned on after 8 pm in January. The starting parameters are therefore a combination of the date and time (ie, after 18:00 on January 1st to 31st) and the state of the component (ie, the TV is turned on). Thus, if someone turns on the television after 8:00 pm in January, the state detector sends a signal to the central server 122 as described above at step 703. Thereafter, in step 706, a control command is transmitted to turn on the room lighting.

  In one implementation, user roles can be established and verified prior to initiating control commands, as described in step 512. In other implementations, specific areas and / or controllable system components are identified and commanded as described in steps 509-521.

  After the control macro is automatically executed when a predetermined start parameter occurs, the control flow ends, as shown in step 795.

(C. Context-based macro)
As described above (see step 509 in FIG. 5), the control macro need not be room specific. Indeed, according to one embodiment of the present invention, a general control macro (eg, a “TV power on” macro) is automatically specialized for use in certain contexts (eg, a particular room). be able to. Unlike control macros defined by a fixed predefined sequence of commands, the “context-based” control macro of the present invention differs from the underlying commands in that it is automatic for each context to which it applies. It is dynamic in the sense that it is created automatically.

  As described above, the “Watch DVD” macro can be constructed and used to control a set of system components. Thus, a “view DVD” macro created specifically for a living room entertainment center (eg, may include a Sony TV and a PHILIPS DVD player) is a different set of system components (eg, RCA). Cannot be used in bedrooms equipped with a company TV and a SAMSUNG DVD player). Even if a user has a “generic” remote control that can control all televisions and DVD players in the residence, the user still “watches DVDs” for a specific set of system components in each room. You must program the macro.

  The present invention provides procedures and / or techniques that allow a user to program a generic macro to control consumer electronics in the user's home and other system components (system 100) for general purpose applications. Including. In one embodiment, when launching a general macro, the macro is executed by the central server 122 (home electronics and other system components) to execute the macro in line with the system components provided in a particular room. Network contact). For example, a user may turn on a “view DVD” generic macro (eg, TV 104, DVD, or media player) that can be used throughout the residence (eg, system 100), regardless of the system components being different from room to room. , Play DVD).

  As described above, the “location awareness” protocol allows the central server 122 and / or portable controller 108 to detect what room the user is entering and to control system components in that room with the portable controller 108. become able to. In the context of the present invention, when a user activates a “view DVD” general macro in his / her room, the central server 122 interprets the general macro in the room (eg, living room) in which the user currently resides. Thus, the central server 122 issues appropriate commands (eg, turn on the Sony TV and the PHILIPS DVD player in the living room) corresponding to the “view DVD” general macro activated in the living room. . Similarly, if the user activates the same “view DVD” general macro in his / her bedroom, the central server 122 detects the general macro activated in the bedroom and sends the appropriate command to the user's bedroom. It is transmitted to a certain TV of RCA and DVD player of SAMSUNG. In this way, the user need only program and maintain a single “view DVD” general macro that can be used for a different set of system components found through the control environment.

  Another example of a context-based macro is a “lights on” generic macro that is automatically executed in the room where the macro is activated. Thus, according to the present invention, when the user activates the “lights on” macro in the kitchen, the central server turns on only the lights in the kitchen. In this way, the user does not need to program and maintain a different “light on” macro for each room in the residence.

  FIG. 8 shows an example for defining a context-based control macro according to one embodiment of the present invention. Please refer to FIG. When the user activates a macro recording command, the control flow of the flowchart 800 starts at step 801.

  At step 803, the user operates one of the above-described devices (ie, user interface to portable controller 108, computer client 106, or server 122) to operate one or more system components and / or. Or build a general control macro to control the function. However, the user does not specifically identify system components, but rather specifies settings for the desired results. For example, referring to the “view video” example described in FIG. 4, the user specifies the “type” of system components that need to create the desired result (eg, view recorded DVD). Configure the settings for that component.

  In one implementation, the screen is presented to a user who only identifies the type of component, such as television 104, unrelated to a particular television 104. The user interacts with the screen and refers to step 409 above to specify the desired settings for the television 104, but certain devices (eg, a Sony television in the living room) are in control. Not identified on screen. The user completes the screen for similar types of components and specifies the desired settings for other types of system components that need to produce the desired results. Please refer to FIG. Other types of system components are audio clients, DVD / media player 116, and lighting device 110. Settings for these types of system components are built without identifying specific components. Depending on the desired result, other types of system components and combinations of system components can be associated with construction and general control macros, as described herein.

  Please refer to FIG. As described above, in one implementation, the user can specify start parameters. As described above, the user can program the general control macro to automatically execute when one or more start parameters occur.

  In step 806, the control command for executing the specification from step 803 is associated with the general control macro. In step 809, the general control macro is given a file name and stored in a storage location. In one implementation using the portable controller 108 and the central server 122, the general control macros are stored on the portable controller 108 and the associated control commands are stored on the central server 122. In another embodiment, the general control macro and associated control commands are stored on the server 122. In one embodiment that does not use the central server 122 (as described above), both the general control macro and associated control commands are stored on the portable controller 108.

  Alternatively, the context-based control macro is as described in the name “User Interface for Multi-Device Control” (US Provisional Application No. 60 / 516,302), which is incorporated by reference in its entirety. In addition, by entering information through a standard setting process for system components, associations between system components can be created when the user defines them. For example, for each experience the user desires (eg, watching a DVD, watching satellite TV, listening to a CD, etc.) which system component the user needs to activate in connection with that experience , What settings are there for each activated system component, whether each system component has inputs (eg, receiver, amplifier, television 104), what system components connect to those inputs Is asked to provide specific information, including what is being done. From this information, a set of control scripts is generated for a particular user experience. Commands in the script are triggered by actions on the user interface for that experience. The commands in the script then launch system component specific commands for the system components on which they operate (eg, launching a “Watch DVD” macro will cause the “TV 104 and DVD player (eg, media player 116“ Invoking the "on" command)).

  After the general control macro is created and saved, the control macro is ready to be activated and the control flow ends, as shown in step 895.

  FIG. 9 shows an example for invoking a context-based control macro according to one embodiment of the present invention. The flowchart 900 shows a control flow for starting the control macro of the flowchart 800.

  Please refer to FIG. The control flow of flowchart 900 begins at step 901 and immediately moves to step 903.

  In step 903, the general control macro defined in steps 801 to 895 is activated. The control macro can be activated by the user operating the portable controller 108. Alternatively, the control macro can be automatically activated when one or more start parameters occur, as shown in FIG.

  Please refer to FIG. At step 906, the set of commands associated with the general control macro is recalled from their storage location. The set of commands includes user-defined specifications for controlling the function or operation of one or more specific types of one or more system components. In the “view movie” example described in FIG. 4, the set of commands related to the “view movie” general control macro includes changes to the lighting device 110, activation of the media player 116, activation of the television 104, and Contains commands for launching the audio client, but specific system components are not identified in the commands.

  At step 909, a particular region and one or more system components (eg, television 104 or media player 116, lighting device 110, audio client, etc.) are identified for the set of commands. Please refer to FIG. As described above, the user can specify a region when building a control macro. Also, as described above, the present invention includes procedures and / or techniques for tracking the position of the user or portable controller 108. Accordingly, the user can request to activate a general control macro in order to view a moving image in any region of the control environment 100 where the user is currently located. In this way, the server 122 specifies that the current position of the user is an area in which the control macro is executed. The server 122 also searches the region profile for the user's current location and identifies system components (media player 116, lighting device 110, etc.) located in the specified region. In one implementation, user roles can be built and matched against each identified system component.

  In step 912, the present invention determines which commands are associated with each system component identified in step 909. At step 915, each identified system component receives and executes a component specific command. Refer to the example of “viewing video”. In this way, lighting within a particular area (ie, lighting device 110) is automatically dimmed, and a particular television 104 is turned on and configured as predefined. A particular DVD player (ie, media player 116) is similarly activated. Depending on the speaker options specified in the control macro, the identified audio component is similarly activated and waits for audio sent from the DVD player. After the context-based control macro is executed, the control flow ends, as shown in step 995.

(IV. Typical system implementation)
1 to 12 are conceptual diagrams for explaining the present invention. It is to be understood that embodiments of the present invention can be used in hardware, firmware, software, or a combination thereof. In such embodiments, various components and steps are used in hardware, firmware, and / or software to perform the functions of the present invention. That is, the same portion of a hardware, firmware, or software module can execute one or more illustrated blocks (ie, components or steps).

  In addition, the present invention may be used in one or more computer systems or other processing systems that can perform the functions described herein. Please refer to FIG. 1 illustrates a computer system 1000 that is an example useful for implementing the present invention. Various implementations are described in terms of this exemplary computer system 1300. After reading this description, it will become apparent to a person skilled in the art how to implement the invention using other computer systems and / or computer architectures.

  Computer system 1300 includes one or more processors, such as processor 1304. The processor 1304 may be a special purpose or general purpose digital signal processing device. The processor 1304 is connected to a communication infrastructure 1306 (eg, a communication bus, a crossover bar, or a network).

  Computer system 1300 includes a display interface 1302 that transfers graphics, text, and other data from a communications infrastructure 1306 (or frame buffer, not shown) to the display of display unit 1330.

  Computer system 1300 also includes main memory 1308, preferably random access memory (RAM), and may include secondary memory 1310. The secondary memory 1310 can include, for example, a hard disk drive 1312 and / or a removable storage drive 1314 corresponding to a floppy disk drive, magnetic tape drive, optical disk drive, and the like. The removable storage drive 1314 reads from and writes to the removable storage unit 1318 by a known method. The removable storage unit 1318 corresponds to a floppy (registered trademark) disk, a magnetic tape, an optical disk, or the like that is read and written by the removable storage drive 1314. As will be appreciated, the removable storage unit 1318 comprises a computer usable storage medium having stored therein computer software (eg, programs or other instructions) and / or data.

  In another embodiment, secondary memory 1310 comprises other similar means for causing software and / or data to be loaded into computer system 1300. Such means include, for example, a removable storage unit 1322 and an interface 1320. Examples of such means include program cartridges and cartridge interfaces (such as found in video game machines), removable memory chips and associated sockets (such as EPROM or PROM), and removable storage unit 1322 and software and data. For example, an interface 1320 that moves the computer from the removable storage unit 1322 to the computer system 1300.

  Computer system 1300 can also include a communications interface 1324. The communication interface 1324 moves software and / or data between the computer system 1300 and external devices. Examples of communication interface 1324 include a modem, a network interface (such as an Ethernet card), a communication port, a PCMCIA slot and a card. The form of software and data moved through communication interface 1324 is signal 1328, which can be electronic, electromagnetic, or other signal that the communication interface can receive. These signals 1328 are provided to communication interface 1324 via a communication path (ie, channel). Communication path 1326 carries signal 1328 and may be implemented using wires or cables, fiber optics, telephone lines, cellular telephone links, RF links, free space optical communications, and other communication channels.

  As used herein, the terms “computer program medium” and “computer usable medium” generally refer to media such as removable storage unit 1318, removable storage unit 1322, hard disk embedded in hard disk drive 1312, and signal 1328. Used to point. These computer program products are means for providing software to computer system 1300. In one embodiment, the present invention is directed to such computer program products.

  Computer programs (also called computer control logic or computer readable program code) are stored in main memory 1308 and / or secondary memory 1310. Computer programs can also be received via communication interface 1324. When executed, the computer program enables the computer system 1300 to implement the present invention as described herein. In particular, when executed, depending on the computer program, processor 1304 may cause portable controller 108, server 122, and / or methods 200, 300, 400, 500, 600, 700, 800, and / or 900, for example. The process of the present invention can now be performed, such as a method performed using other system components of the system 100 described above. Therefore, the computer program corresponds to the controller of the computer system 1300.

  In one embodiment in which the invention is implemented using software, the software can be stored in a computer program product and loaded into the computer system 1300 using a removable storage drive 1314, hard disk device 1312, or communication interface 1324. can do. When executed by the processor 1304, control logic (software) causes the processor 1304 to perform the functions of the present invention as described herein.

  In another embodiment, the invention is implemented primarily in hardware using hardware components such as, for example, application specific integrated circuits (ASICs). The use of a hardware state machine to perform the functions described herein will be apparent to those skilled in the art.

  In yet another embodiment, the present invention is implemented using a combination of hardware and software.

  While various embodiments of the present invention have been described, it should be understood that they have been presented by way of example and not limitation. It will be apparent to those skilled in the art that various modifications can be made in form and detail without departing from the spirit and scope of the invention. Further, as described above, it should be understood that the methods, systems, and computer program products of the present invention are not limited to residential environments. The invention may also be practiced in other environments having a central processing system for distributing media and transmitting command and / or control signals to multiple devices and / or applications distributed throughout a designated area. Can do. In addition to residence, designated areas include, but are not limited to, office buildings, a series of small offices, production studios, warehouses, entertainment venues, medical facilities, hotels, resorts, aircraft, ships, automobiles, etc. It is done. Accordingly, the invention is not limited to any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.

1 illustrates a control system according to one embodiment of the present invention. Fig. 4 illustrates tracking and / or monitoring of system components according to one embodiment of the present invention. FIG. 6 illustrates command and control to system components as a function of user location according to one embodiment of the present invention. FIG. Fig. 5 illustrates a definition of a control macro for viewing a video recording, according to one embodiment of the present invention. FIG. 5 illustrates activation of the control macro of FIG. 4 according to one embodiment of the present invention. FIG. Fig. 4 illustrates a definition of a control macro that can be automatically executed according to an embodiment of the present invention. FIG. 7 illustrates activation of the automatically executable control macro of FIG. 6 according to one embodiment of the present invention. Fig. 3 illustrates a context-based control macro definition according to an embodiment of the present invention. 9 illustrates activation of the context-based control macro of FIG. 8 according to one embodiment of the present invention. FIG. 4 illustrates a user interface for configuring a time-based control macro according to one embodiment of the present invention. FIG. FIG. 4 illustrates a user interface for configuring a controllable system component that executes a time-based control macro, according to one embodiment of the present invention. FIG. 6 illustrates a user interface for configuring related controllable system components that execute time-based control macros according to one embodiment of the present invention. 1 illustrates an example of a computer system useful for implementing the present invention.

Claims (20)

A method for managing system components in a controlled environment, comprising:
Detecting the occurrence of a predetermined starting parameter;
Accessing a sequence of component-specific commands associated with the start parameter;
Sending the sequence to a plurality of system components;
Executing each of the component specific commands to control the corresponding system component when a component specific command of the sequence is received by the corresponding system component of the plurality of system components; Including a method.   The method of claim 1, wherein the detecting step includes detecting a day and / or time, and the date and / or time is specified as the start parameter.   The method of claim 1, wherein the detecting step includes detecting an operational state of one of the plurality of system components, the operational state being designated as the start parameter. Determining a region within the control environment;
The method of claim 1, further comprising: identifying system components included in the region, wherein the plurality of system components includes the identified system components.   The method of claim 4, wherein the determining includes determining the region from a current position of one of the plurality of system components.   The method of claim 4, wherein the determining includes determining the region from user input, the input specifying the region.   The method of claim 1, wherein prior to performing the transmitting step, authorization for control of each system component is authenticated.   The method of claim 1, wherein the transmitting step includes transmitting the sequence over a wireless medium. A method for managing system components in a controlled environment, comprising:
Allowing a sequence of component-specific commands to control multiple system components at runtime;
Associating the sequence with the occurrence of a start parameter;
Detecting the occurrence of the start parameter;
Executing each of the component specific commands to control the corresponding system component when a component specific command of the sequence is received by the corresponding system component of the plurality of system components; Including a method.   10. The method of claim 9, wherein the detecting step includes detecting a day and / or time, and the date and / or time is specified as the start parameter.   The method of claim 9, wherein the detecting step includes detecting an operating state of one system component of the plurality of system components, the operating state being specified as the start parameter. Determining a region within the control environment;
10. The method of claim 9, further comprising: identifying system components included within the region, wherein the plurality of system components includes the identified system components. A controller for exchanging information with a plurality of system components in a control environment,
The controller functions to configure and store a sequence of component-specific commands associated with predetermined start parameters;
The controller sends component-specific commands of the sequence to control the operation or function of one or more system components of the plurality of system components in response to the occurrence of the predetermined start parameter. A controller that functions to send to a component. A system for managing a plurality of system components in a control environment,
A control center for controlling the operation and / or function of the plurality of system components;
A controller for exchanging information with the control center;
The controller functions to compose a sequence of component specific commands associated with a given start parameter;
The control center functions to store the sequence of component-specific commands and to transmit the sequence to the plurality of system components in response to the occurrence of the predetermined start parameter.   15. The control center is operable to transmit the component specific sequence of commands to one or more system components located in the vicinity of the controller as defined by inputs received from the controller. The described system. Further comprising positioning means for tracking and / or monitoring the position or movement of the controller;
The controller functions to exchange information with the positioning means;
15. The control center according to claim 14, wherein the control center is configured to send the sequence of component specific commands to one or more system components located in the vicinity of the controller defined by the positioning means. system. A computer program product comprising a medium having computer-readable program code means embedded in the computer usable medium for the computer to manage a system of components in a controlled environment,
First computer readable program code means for detecting the occurrence of a predetermined starting parameter;
Second computer readable program code means for accessing a sequence of component specific commands associated with the start parameter;
Third computer readable program code means for transmitting the sequence to a plurality of system components, each component specific command of the sequence being a corresponding system component of the plurality of system components. A computer program product executable to control each of the corresponding system components upon receipt of the component specific command.   The first computer readable program code means includes fourth computer readable program code means for detecting a date and / or time, the date and / or time being specified as the start parameter, The computer program product of claim 17. The first computer readable program code means comprises:
Fourth computer readable program code means for detecting an operating state of a system component of the plurality of system components;
The computer program product of claim 17, wherein the operating state is specified as the start parameter. Fourth computer readable program code means for determining an area in the control environment;
18. The computer of claim 17, further comprising: fifth computer readable program code means for identifying system components included in the region, wherein the plurality of system components includes the identified system components. Program product.

Images