EP1057302A1 - Systeme domotique de dispositifs distribues montes en reseau - Google Patents

Systeme domotique de dispositifs distribues montes en reseau

Info

Publication number
EP1057302A1
EP1057302A1 EP99965516A EP99965516A EP1057302A1 EP 1057302 A1 EP1057302 A1 EP 1057302A1 EP 99965516 A EP99965516 A EP 99965516A EP 99965516 A EP99965516 A EP 99965516A EP 1057302 A1 EP1057302 A1 EP 1057302A1
Authority
EP
European Patent Office
Prior art keywords
user
appliance
control
action
location
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP99965516A
Other languages
German (de)
English (en)
Inventor
Doreen Y. Cheng
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Publication of EP1057302A1 publication Critical patent/EP1057302A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2805—Home Audio Video Interoperability [HAVI] networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
    • H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2823—Reporting information sensed by appliance or service execution status of appliance services in a home automation network
    • H04L12/2827—Reporting to a device within the home network; wherein the reception of the information reported automatically triggers the execution of a home appliance functionality
    • H04L12/2829—Reporting to a device within the home network; wherein the reception of the information reported automatically triggers the execution of a home appliance functionality involving user profiles according to which the execution of a home appliance functionality is automatically triggered
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/40—Bus networks
    • H04L12/40052—High-speed IEEE 1394 serial bus
    • H04L12/40117—Interconnection of audio or video/imaging devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/2866—Architectures; Arrangements
    • H04L67/30—Profiles
    • H04L67/306—User profiles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/535—Tracking the activity of the user
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4131—Peripherals receiving signals from specially adapted client devices home appliance, e.g. lighting, air conditioning system, metering devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • H04N21/4415—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H04N21/4662—Learning process for intelligent management, e.g. learning user preferences for recommending movies characterized by learning algorithms
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L2012/2847—Home automation networks characterised by the type of home appliance used
    • H04L2012/285—Generic home appliances, e.g. refrigerators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30—Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32—Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • H04L69/322—Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
    • H04L69/329—Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]

Definitions

  • This invention relates to the field of consumer devices, and in particular to the field of automated home control systems.
  • HANi is a software architecture using IEEE 1394
  • Home API is an open industry specification that defines a standard set of software services and application programming interfaces which enable software applications to monitor and control home device.
  • Jini is a distributed software architecture (network) wherein clients see devices and services as objects. Jini has a discovery service to enable a device or service to register itself with the network. Jini has a look-up service to enable determining what objects are available. Coherence among the distributed objects is enabled through leasing of objects, i.e., providing control over an object to another object for a predetermined time period. If the system fails, the system is brought back upon termination of the lease to a well defined state.
  • Typical home automation systems are configured to provide a central control station and a number of remote controllers.
  • the central control station may be a home computer
  • the remote controllers may be sub-controllers located in particular areas of the home, such as in a master bedroom, entry foyer, and the like.
  • Typical home automation systems may also include remote sensors that are used, for example, to automatically turn lights on or off when motion is detected, or to turn a television set on or off in response to a particular sound or voice command.
  • Some home automation systems allow the desired operations to be preprogrammed, so that, for example, lights or appliances are turned on or off at different preset times, televisions are tuned to different channels at different times, and so on.
  • a preprogrammed home automation system typically utilizes a central controller to effect the preprogrammed actions.
  • the automated control is directly dependent upon the reliability and availability of the central controller.
  • the central controller in most home automation systems is typically the home computer, which is often used for other applications as well. When used as the home automation controller, care must be taken to assure that the computer remains in operation and that the controller application continues to run independent of the other applications. A "crash" of the computer or the controller application will typically disable a significant portion, if not all, of the home automation system.
  • a dedicated central controller is often utilized as the central controller, eliminating the likelihood of a crash caused by another application, but the options available on such dedicated controllers are typically limited compared to those available on a general purpose home computer.
  • a distributed network of locator devices and control devices throughout a locale such as a home.
  • Devices within the locale are controlled by detecting the presence of an identified user within different areas of the locale, and coordinating the control of appliances within the area in response to this user's presence or absence.
  • the locating and control devices may be stand-alone devices, or integrated within other electronic devices, such as televisions, stereos, computers, and so on.
  • user task modules that suggest control actions based on the location of the user, the current context, and a profile of the user based upon the user's prior actions. Communications among the modules and devices are effected using standard network systems and protocols, including IEEE 1394, X10, HANi, and HomeAPI.
  • the determination of each user's location is facilitated by the use of a tracker module that the user carries about. The user may determine the degree of automation to be applied at any time.
  • FIG. 1 is an example block diagram of a home control system in accordance with this invention.
  • FIG. 2 is an example data flow diagram of a home control system in accordance with this invention.
  • FIG. 3 is an example flow chart for a control module in a home control system in accordance with this invention.
  • FIG. 1 illustrates an example block diagram of a home control system in accordance with this invention. Illustrated in FIG. 1 are four rooms, a family room 100, a kitchen 200, an office 300, and a utility room 400. In each of these rooms are an assortment of devices; in the vocabulary of home control systems, devices that perform a function other than control are termed appliances. Appliances may include control functions, but their "primary" appliance function is not control, per se.
  • a web-tv appliance 110 In the family room 100 are located in the family room 100 a web-tv appliance 110, a television appliance 120, a stereo appliance 130, and light appliances 140.
  • the example web-tv appliance 110 has an appliance function of providing web-access via a television, and also includes a control module CM 114, a user task module UTM 116, and a locator module LM 119. Another control module CM 134 is located in the example stereo appliance 130, and another locator module, LM 190 is located in the family room 100.
  • the illustrated devices and modules are interconnected via a home network 50. To avoid unnecessary clutter, the example connections to the network 50 are illustrated by "X" - labeled terminators. In a preferred embodiment, the communications via the network are in accordance with existing standards.
  • a HANi-compliant device has, as a minimum, enough functionality to communicate with other devices in the system.
  • devices may exchange control and data in a peer-to-peer fashion. This ensures that at the communication level, none of the devices is required to act as the master or controller of the system. On the other hand, it allows a logical master or controller to impose a control structure on the basic peer-to-peer communication model.
  • copending US application "Computer-controlled Home Theater With Independent User-control", serial number
  • 08/920,751 filed 8/29/97 for Jeroen Heuvelman et al., and incorporated herein by reference, presents a home entertainment system comprising a sub-system with audio/video functionalities, a computer and a device interface that interconnects the sub-system and the computer.
  • the computer controls the sub-system through a software application
  • the computer and the sub-system have separate user-controls. In case the computer crashes, the user can still control those audio/video functionalities of the sub-system that are independent of the computer.
  • each occupant of the home possesses a tracker 10 which is configured to enable the remote identification of the associated occupant.
  • the location of the tracker 10 is assumed to coincide with the location of the associated occupant, or "user"; the tracker 10, for example, may be a small token that the user carries or wears.
  • the locators 119 and 190 are configured to recognize it; in so doing, the locator modules 119 and 190 enables the identification of the associated occupant as being located in the family room 100.
  • the trackers and locator modules are coupled via a wireless connection, thereby allowing the user to move about freely.
  • the home network 50 may be wired or wireless, or a combination of both.
  • the locating modules 119, 190 communicate the presence of the user associated with tracker 10 to the home network 50; in particular, to control modules 114, 134, and others.
  • the control modules query one or more of the user task modules, including UTM 116 and others, for an appropriate control response. For example, if the user that is associated with tracker 10 normally prefers to hear classical music in the afternoon, user task module 116 will communicate a suggestion to control module 134 to play classical music, if the time of day is the afternoon; if the time of day is morning, the user task module 116 may send a suggestion to the control module 134 to tune to the local news-radio station.
  • the control module 134 communicates the appropriate commands, if any, to the appropriate appliances to effect a chosen response from among the suggestions and rules.
  • one of the rules may be to preclude a change of mode of an appliance in the family room 100 if another user (as indicated by the presence of another tracker) is in the family room 100.
  • priority schemes can be used to determine actions to be taken if multiple trackers are in the same area.
  • non-conflicting actions are effected, such as turning lights on if at least one of the users have indicated this preference and the other user has not explicitly expressed an opposite preference
  • conflicting actions such as turning a television and a stereo on
  • each rule or preference for a user is assigned a priority. For example, a priority can be established for a particular user for turning on a light whenever the user enters an area, regardless of conflicts. A lower priority for that same user can be established for turning on a television only if no conflicts exists.
  • control modules and user task modules employ knowledge based and machine learning techniques, and others, to determine an appropriate response upon each user's arrival to, or departure from, particular areas of the home.
  • the response is based on prior experiences and feedback from each user, as well as the user's recent history. For example, the response may differ depending upon whether the user arrives in the family room 100 after having been in the kitchen 200, or the office 300. These determinations will also be dependent upon the current context, such as the time of day, the day of the week, and other factors that are determined to be correlated to the user's past behavior, or assumed typical behavior.
  • the learning techniques are multi-variate in nature, so that a synergy of control is achieved.
  • a learned response may be to lower curtains, dim lights, play soft music, and place the telephone in autoanswer mode in response to a particular set of user patterns, and to keep the area well lit and turn on the radio in response to a different set of user patterns.
  • the user will typically effect an alternative control response. For example, if the control module 134 turns the stereo 130 on, and the user disagrees with this response, the user will typically turn the stereo 130 off, or effect some other change.
  • the user responses that immediately follow a control module's execution of a command to an appliance are weighted heavily for training, to effect a potentially different selection by the control module in the future.
  • Subsequent user selections are weighted less for training as the time interval between the control module's action and the user selection increases. For example, if the user listens to the classical music that the control module 134 selects for an hour or so, and then selects popular music, the selection of popular music may be processed by the control module 134 as an independent user preference, or as a sequential preference (play classics for one hour, then switch to popular), or as a disapproval of the control module's selection of classical music, or a combination of the three rationales.
  • each control module is allocated a position in a control hierarchy with respect to each appliance.
  • Each highest ranking control module that is currently available controls each appliance.
  • the suggestions from each user task module and from among the user task modules are given decision weights relative to each appliance, to ease the decision process of each control module.
  • the example kitchen 200 of FIG. 1 includes a control unit 210, a television appliance 220, speaker appliances 230, and a microwave appliance 240.
  • the example control unit 210 is illustrated as containing a control module 214, a user task module 216, and a locator module 219, while the appliances are devoid of control devices.
  • the locator module 219 notifies the appropriate devices in the home network 50, including the control module 214.
  • the control module 214 accesses user task modules within the network 50, including the user task module 216, to determine if any actions are suggested, and accesses its internal rules to determine an action. For example, if the tracker 10 had previously been in the family room 100, and the television 120 in the family room 100 had been tuned to a particular channel, the internal rules of control module 214 would suggest turning on the television 220 in the kitchen, and tuning it to the same channel as the television 120. In like manner, in this example, the internal rules of control module 114 will suggest that television 120 be turned off, if no other users are detected in the family room 100. Note that the above sequences of suggestions are based on rules that are independent of the particular user that departs the family room 100 and enters the kitchen 200.
  • control module that is responsible for controlling the particular appliances. For example, a particular user may prefer to listen to music while in the kitchen 200, and would not desire to have the television 220 turned on, even though television 120 had been turned on by or for this user.
  • the control module that is configured to control the television 220 and the control module that is configured to control the speaker appliances 230 apply these user-specific rules and preferences and will not turn the television 220 on, and will turn the speakers 230 on; if appropriate, based on the user specific rules and current contexts, the stereo 130 will also be tuned to provide the appropriate selection of music to the speakers 230.
  • the aforementioned rules are structured so as to anticipate a user's desire, based on experience or default assumptions.
  • a default assumption would be that when a user enters an area at a particular time of day, the lights 140, 340 should be turned on, and when room is unoccupied, the lights 140, 340 and entertainment appliances 120, 130, 220, 230, 320, 330 are turned off.
  • the default assumptions may effect sequential operations.
  • the control module 114 can be structured to wait for a predetermined time period before turning off the television 120 when the user departs the family room 100, to avoid an annoying shut-down, start-up sequence every time the user moves about the areas.
  • the control modules may determine the appropriate action based upon a user's recent activities.
  • the controller effects some actions, such as turning on lights, but not others, such as turning on stereo sets or televisions.
  • some actions such as turning on lights, but not others, such as turning on stereo sets or televisions.
  • the default assumption is that the user would prefer to have light for movement through adjoining rooms, but would not prefer to have other appliances turned on and off during each transit through a room.
  • the user task modules and control modules are preprogrammed with default rules that are subsequently updated based on user experience, or direct user modification.
  • the microwave appliance 240 may include a programmable device that allows a user to preprogram the microwave to start at a particular time, for a particular duration, and so on.
  • An alternative embodiment of the microwave appliance 240 could allow the user to preprogram the start based on the return of a person to the home, rather than on a preprogrammed time.
  • the control module 214 in this example signals the microwave appliance 240 when the tracker that is associated with the specified person is next detected within the home.
  • the start could also be triggered by other events as well, such as the entry of the person to a particular room within a particular time period.
  • a configuration module 312 in a computer 310 in the home office 300 Illustrated in FIG. 1 is a configuration module 312 in a computer 310 in the home office 300.
  • the configuration module 312 enables the system to be customized for each user directly.
  • the configuration module 312 is also used to enable a user or installer to record the system configuration in terms of the location of modules and appliances throughout the house, and coordinates the allocation of controlled appliances to control modules.
  • the configuration module 312 is also used to enable an automatic or manually initiated download of the rules and preferences to the control modules and user task modules as required.
  • the knowledge base and machine learning functions are preferably effected in the user task modules 116, 316, 416 that are distributed about the network 50, while the configuration module 312 effects actions required to coordinate these activities.
  • the configuration module allocates responsibilities to balance the computational load as devices are added to or removed from the network.
  • the configuration module dynamically allocates responsibilities for appliances among the control modules, and responsibilities for users among the user task modules.
  • the configuration module 312 also responds to queries by the individual modules regarding configuration status and information.
  • the rules regarding the operation of the external control modules 114, 134, 214, and 414 are configured so as not to be dependent upon the continuos operation of the computer 310 or the configuration module 312. In this manner, the reliability of the system in accordance with this invention is not dependent upon the reliability and availability of a central controller, such as computer 310.
  • the overall system reliability may also be enhanced by utilizing the principles of copending US application "Slave DSP Reboots Stalled Master CPU", serial number 08/880,387, filed 6/23/97 for Paul Foster et al., and herein incorporated by reference.
  • This document relates to a digital home entertainment system comprising one or more slave processors, for example, digital signal processors (DSPs), for processing specific tasks, and a master processor, for example, a central processing unit (CPU), for control of the system.
  • the slave processor is capable of rebooting the master processor if the master processor has stalled. This slave- controlled rebooting avoids manual cold rebooting of the system and is particularly advantageous in open-architecture multimedia systems with asynchronously cooperating components.
  • the user task modules 116, 316, 416 may each be designed to process particular information.
  • the user task module 116 in the web-tv appliance 110 may be designed to specifically facilitate the optimization of each user's access to the web.
  • copending U.S. patent application "Customized Upgrading of Internet-Enabled Devices Based on User-Profile", attorney docket PHA 23,500, serial number 09/160,490, filed 9/25/98 for Adrian Turner et al, and incorporated by reference herein, presents a method of retrieving information from the Internet based upon a user profile.
  • the locator module 119 notifies the other modules on the network of the presence of the user associated with tracker 10.
  • the control module 114 accesses the Internet and retrieves the information based on this user profile in accordance with the above mentioned copending application.
  • the user task module 416 in the environmental control appliance 410 may be designed to facilitate the optimization of the home environment in response to user preferences and experiences.
  • the user task module 416 may know nothing about web services, and the user task module 116 may know nothing about environmental services. That is, each user task module's function can be specialized to a particular knowledge domain.
  • the user task module 316 on the other hand, being located in a computer 310, may be designed to handle all available services.
  • the resolution of conflicting suggestions from multiple task modules can be resolved using the aforementioned priority scheme, wherein each task module has a ranking of control, and the suggestions from the currently highest ranking module is given priority.
  • the user task modules communicate among themselves and consistent rules are formulated.
  • the user task module 316 in the computer 310 periodically gathers information from each of the other user task modules and attempts to resolve conflicts using conventional decision theory techniques, such as voting, prioritize voting, and the like.
  • each module can vary, and less capable devices can rely upon other devices to varying degrees.
  • the aforementioned web-optimized user task module 116 may include an ability to store an activity history corresponding to the use of the television 120 and stereo 130, and provide suggestions to the control modules 114, 134 based on these histories and a primitive level of machine learning. Periodically, the user task module 316 obtains this activity history from the user task module 116, develops more sophisticated rules and suggestions based upon these histories, and communicates these new rules and suggestions to other modules throughout the system as appropriate.
  • Differing levels of control may be included in the home automation system in accordance with this invention.
  • a tracker 11 that is associated with a different user than the one associated with tracker 10.
  • the locator module 390 detects the presence of tracker 11, and notifies the network 50.
  • the computer 310 and the environment control 410 effect different control.
  • the device command module 414 in the environment control 410 may merely send a signal to an environment network 405, such as a furnace or air conditioning system, to adjust the level of the temperature in the office 300, based on the data in the user task module 416 corresponding to the user associated with tracker 11.
  • the user task module 416 in this example may merely contain the last temperature that this user selected, with no knowledge based or learning machine capabilities.
  • the control module 314 in the computer 310 may effect a number of complex actions, such as establishing contact to an external network 305 to retrieve the user's e-mail, initiating one or more of the applications, such as a word processor, that the user typically uses, reciting the received e-mail messages via the speakers 330, accepting voice commands from the user, and so on. These actions will have been determined based on the user's prior history, the user's explicit commands, or a set of default options, as discussed above.
  • the trackers 10, 11 and locator modules 119, 190, 290, 390 are designed to operate together so as to determine the relative or absolute location of each tracker 10 in the vicinity of each module. Any number of available technologies may be employed to facilitate this determination.
  • the tracker emits a signal that is only receivable by locator modules within its vicinity, using for example infrared signaling.
  • the locator module emits a radio frequency (RF) trigger signal, and the trackers that are within the vicinity of the locator module reflect a modulated form of the RF trigger signal back to the locator modules.
  • RF radio frequency
  • the tracker may be of varying complexity. In a single-user application, the tracker need only be a device that is detectable by a locator module. In a multiple-user application, each tracker includes a means of communicating a unique identifier. In a preferred implementation, the tracker also includes user selectable options, including the options to turn the tracker off, or to enter a manual mode, wherein the locator modules continue to determine the location of the tracker, but some or all of the automated actions by the control modules are inhibited. The tracker may also be configured with a means for the user to communicate commands directly. Copending application "Remote Control Device with Location Dependent
  • Kemink presents a method and apparatus for providing the user of the apparatus differing control capabilities in dependence upon where the user is located.
  • the tracker of this invention may include some or all of the capabilities described in this copending application, such that, for example, when the user selects a manual mode, the tracker provides user options based upon the appliances within the user's immediate area.
  • FIG. 2 illustrates an example data flow diagram of a home control system in accordance with this invention.
  • the control module 540 receives input from a variety of sources in order to determine the appropriate commands 541 to communicate to appliances 550, based upon a determination 591 of the location of one or more trackers 510.
  • a controller (control module 540) is a device that acts as a host for a controlled device (appliance 550).
  • the controller hosts the abstract representation for the controlled device.
  • the control interface is exposed via the API of the abstract representation. This API is the access point for applications to control the device.
  • the controller receives commands and information via the API, and determines an appropriate device command.
  • the controlled device assumes a controlled state in response to receipt of the determined command.
  • each locator 590 determines the identity and mode of each tracker 510 within its vicinity.
  • the mode of the tracker 510 includes, for example, a manual control mode, a standby mode, and an automated mode. In the manual control mode, no automated actions are taken by the control module 540.
  • control module 540 determines the appropriate actions to be taken based upon suggestions 561 from one or more user task modules 560, as well as the defined rules 530, the context 570, and the configuration 520 of the network 50, as discussed above.
  • the control module 540 communicates a query 546 to the user task module 560, requesting one or more suggestions based upon the location of a particular user.
  • the user task module 560 communicates zero or more suggested actions 561 to the control module 540.
  • the control module 540 determines the desired actions, if any, and communicates the appropriate commands 541 to appliances 550 to effect these actions.
  • each appliance 550 communicates its status 551 to the network 50, and in particular to the control module 540, as illustrated by the dashed line in FIG. 2.
  • the control module 540 uses this communicated status to verify that the desired actions have been effected, and to determine any subsequent adjustments to the appliances, such as those performed directly by the user. If the control module 540 includes a knowledge base or learning techniques, these subsequent adjustments will be used to modify the decision criteria used to determine subsequent automated actions, as discussed above.
  • the control module actions and any user controlled actions or adjustments, and the times that each occur, are also communicated to the user task module 560 as history updates 548.
  • the history of activities contained in each user task module 560 may be used by control modules and user task modules throughout the network to refine their suggestion and decision processes based on each user's actions at varying times and locations.
  • FIG. 3 illustrates an example flow chart for the control module 540 of FIG. 2 in a home control system in accordance with this invention.
  • the location and mode data associated with each user is updated.
  • the control module 540 may contain a data base that is continually updated as each locator module 590 reports an arrival or departure of a user/tracker 510.
  • the control module 540 may query each locator module 590 in the network 50 as required. If the mode of the tracker 510 that is associated with the user has changed, at 615, the status of the user is updated, at 620.
  • the tracker 510 may include a multitude of modes, including the aforementioned manual, standby, and automated modes, as well as other user selectable modes.
  • the tracker 510 may be configured to allow the user to specify a particular mood, such as active, quiet, romantic, and so on.
  • Not all control modules will contain the ability to process the variety of tracker modes; the block 620 effects a transformation from the possible tracker modes to the states that are supported by the particular control module 540.
  • the control module 540 queries the user task modules 560, at 630 and 640, for suggestions as to the preferred actions to be taken in response to this arrival or departure. Additionally, if the context 570 has changed, at 645, the user task modules 560 are again queried for suggested actions, at 650. In a preferred embodiment, all rules and user preferences are processed to identify time dependencies, and the context 570 is deemed to change at the time of each of the identified dependencies. The context 570 is also deemed to change whenever a external sensor, such as a light or motion sensor, reports a change.
  • a external sensor such as a light or motion sensor
  • the control module 540 After receiving the user specific suggestions from the user task modules 560, the control module 540 determines the appropriate actions to be taken, at 660, based upon these suggestions, as well as the context and rules associated with this user, as well as the status and location of this user and other users, as discussed above. If, at 665, the decided actions are applicable to appliances 550 within the immediate control of this control module 540, the actions are transformed into appliance commands to effect the actions, at 670, and communicated to the controlled appliances, at 672. If, at 665, the control module 540 is in a secondary control role, such as when used as a redundant controller in a distributed control system, the control module 540 communicates its decided action to each other control module that is in direct control of each of the affected appliances.
  • the configuration module 312 may redefine the functions available to the control modules as other appliances or capabilities are added to the network.
  • the rules for controlling appliances need not be restricted to the arrival or departure of tracker's in each area.
  • one of the appliances in the home network 50 may be a motion detector, and another appliance an alarm device.
  • a control module in the home network 50 can be configured to activate the alarm device if the motion detector reports motion in a particular area, and a locator module does not report the presence of a tracker in that same area.
  • the operation of a control system in accordance with this invention may be coupled to or integrated with other automated systems. For example, copending U.S.
  • the tracker 10 may be configured to communicate its location directly to the network 50, using for example a GPS or other location determining technology.
  • the functions of the control module and user task module may be integrated into a single module.
  • the principles of this invention may be embodied in hardware, software, or a combination of both.
  • the user task modules may be software applications and memory devices, while the control module may be implemented as special purpose hardware components.

Abstract

La présente invention vise à la commande d'appareils équipant un local tel que le domicile d'un particulier, par détection de la présence d'un utilisateur dans plusieurs zones du local. La commande des appareils situés dans ces zones se fait en fonction des préférences de chaque utilisateur identifié. Les dispositifs de localisation et de commande peuvent être des dispositifs autonomes ou des dispositifs intégrés à d'autres appareils électroniques tels que du matériel de télévision, du matériel hi-fi ou du matériel informatique. L'invention concerne également des modules fonctionnels qui proposent des opérations de commande en fonction de l'emplacement de l'utilisateur, du contexte courant et d'un profil de l'utilisateur établi sur al base des actions antérieures de l'utilisateur. Un module de poursuite que l'utilisateur porte sur lui vient simplifier la détermination de l'emplacement de chaque utilisateur. L'utilisateur peut déterminer à tout instant le degré d'automatisation à mettre en oeuvre.
EP99965516A 1998-12-29 1999-12-17 Systeme domotique de dispositifs distribues montes en reseau Withdrawn EP1057302A1 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US22240398A 1998-12-29 1998-12-29
US222403 1998-12-29
PCT/EP1999/010197 WO2000039964A1 (fr) 1998-12-29 1999-12-17 Systeme domotique de dispositifs distribues montes en reseau

Publications (1)

Publication Number Publication Date
EP1057302A1 true EP1057302A1 (fr) 2000-12-06

Family

ID=22832035

Family Applications (1)

Application Number Title Priority Date Filing Date
EP99965516A Withdrawn EP1057302A1 (fr) 1998-12-29 1999-12-17 Systeme domotique de dispositifs distribues montes en reseau

Country Status (4)

Country Link
EP (1) EP1057302A1 (fr)
JP (1) JP2002534841A (fr)
KR (1) KR20010041425A (fr)
WO (1) WO2000039964A1 (fr)

Families Citing this family (72)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4731096B2 (ja) * 2000-08-23 2011-07-20 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 通信システム及びデバイス
JP2002281574A (ja) * 2001-03-15 2002-09-27 Sharp Corp 機器制御方法、機器制御装置、動作状況取得装置、機器制御システム、プログラム、プログラムを記録したコンピュータ読み取り可能な記録媒体
KR101138857B1 (ko) 2002-01-08 2012-05-14 코닌클리케 필립스 일렉트로닉스 엔.브이. 어플리케이션 디바이스들을 제어하는 방법과 시스템, 컴퓨터 시스템, 및 컴퓨터 판독가능 기록 매체
US7536437B2 (en) * 2002-02-14 2009-05-19 Avaya Inc. Presence tracking and name space interconnection techniques
KR100437796B1 (ko) * 2002-04-01 2004-06-30 엘지전자 주식회사 홈 네트워크 시스템 통합 제어 키트
US7298871B2 (en) * 2002-06-07 2007-11-20 Koninklijke Philips Electronics N.V. System and method for adapting the ambience of a local environment according to the location and personal preferences of people in the local environment
US8116889B2 (en) 2002-06-27 2012-02-14 Openpeak Inc. Method, system, and computer program product for managing controlled residential or non-residential environments
US6792323B2 (en) * 2002-06-27 2004-09-14 Openpeak Inc. Method, system, and computer program product for managing controlled residential or non-residential environments
US7933945B2 (en) 2002-06-27 2011-04-26 Openpeak Inc. Method, system, and computer program product for managing controlled residential or non-residential environments
EP1388985A1 (fr) * 2002-08-06 2004-02-11 Sony International (Europe) GmbH Méthode et le système pour manipuler des tâches de E-mail dans un réseau à la maison basé sur un système de HAVI
US7023980B2 (en) 2002-12-04 2006-04-04 Avaya Technology Corp. Outbound dialing decision criteria based
US7987489B2 (en) 2003-01-07 2011-07-26 Openpeak Inc. Legacy device bridge for residential or non-residential networks
KR20040080663A (ko) * 2003-03-12 2004-09-20 삼성전자주식회사 유비퀴터스 서비스 기능을 가지는 사설 네트워크 시스템및 그의 동작방법
KR100513292B1 (ko) * 2003-04-16 2005-09-09 삼성전자주식회사 홈 네트워크에서 홈상태 정보를 구성하고 이용하는 방법및 시스템
KR100606760B1 (ko) 2003-07-07 2006-07-31 엘지전자 주식회사 사용자 예약에 따른 홈 네트워크 시스템 및 그 제어방법
US7064675B2 (en) 2003-08-15 2006-06-20 Microsoft Corporation Context-sensitive remote controls
US20050108091A1 (en) * 2003-11-14 2005-05-19 John Sotak Methods, systems and computer program products for providing resident aware home management
JP2007520940A (ja) * 2004-01-09 2007-07-26 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ メディアオンデマンドシステムにおけるプレゼンスステータスの使用
US9398152B2 (en) 2004-02-25 2016-07-19 Avaya Inc. Using business rules for determining presence
US20050235329A1 (en) * 2004-04-19 2005-10-20 Broadcom Corporation Systems and methods for integrated control within a home entertainment system
FR2872986A1 (fr) * 2004-07-06 2006-01-13 Thomson Licensing Sa Procede de codage et de reproduction de documents audiovisuels ou radio et dispositif mettant en oeuvre le procede
JP2006033646A (ja) * 2004-07-20 2006-02-02 Sony Corp 情報処理システム及び情報処理方法、並びにコンピュータプログラム
JP4470650B2 (ja) * 2004-08-30 2010-06-02 パナソニック株式会社 ネットワーク制御端末機器
JP2006079509A (ja) * 2004-09-13 2006-03-23 Kyocera Mita Corp 節電管理装置
US8099313B2 (en) 2004-09-22 2012-01-17 Samsung Electronics Co., Ltd. Method and system for the orchestration of tasks on consumer electronics
US8185427B2 (en) 2004-09-22 2012-05-22 Samsung Electronics Co., Ltd. Method and system for presenting user tasks for the control of electronic devices
US8412554B2 (en) 2004-09-24 2013-04-02 Samsung Electronics Co., Ltd. Method and system for describing consumer electronics using separate task and device descriptions
US8510737B2 (en) 2005-01-07 2013-08-13 Samsung Electronics Co., Ltd. Method and system for prioritizing tasks made available by devices in a network
US8069422B2 (en) 2005-01-10 2011-11-29 Samsung Electronics, Co., Ltd. Contextual task recommendation system and method for determining user's context and suggesting tasks
KR100754521B1 (ko) * 2005-02-22 2007-09-03 삼성전자주식회사 홈네트워크 시스템 및 홈네트워크 시스템에서의 정보제공방법
US8205013B2 (en) 2005-05-02 2012-06-19 Samsung Electronics Co., Ltd. Method and system for aggregating the control of middleware control points
JP5055769B2 (ja) 2005-05-23 2012-10-24 ソニー株式会社 コンテンツ表示再生システム、コンテンツ表示再生方法、記録媒体、及び操作制御装置
JP2006345139A (ja) * 2005-06-08 2006-12-21 Matsushita Electric Ind Co Ltd 家庭内電気機器ネットワーク制御情報機器システム
KR101056028B1 (ko) * 2005-07-14 2011-08-10 주식회사 케이티 지식기반 홈네트워크 서비스를 위한 서비스 관리 장치
KR100743963B1 (ko) 2005-12-08 2007-07-30 한국전자통신연구원 상황인식 서비스 시스템 및 그 방법
JP4872360B2 (ja) * 2006-01-23 2012-02-08 パナソニック電工株式会社 遠隔制御システム
US8028283B2 (en) 2006-03-20 2011-09-27 Samsung Electronics Co., Ltd. Method and system for automated invocation of device functionalities in a network
KR100755710B1 (ko) 2006-05-16 2007-09-05 삼성전자주식회사 태스크 수행을 위한 장치 및 방법
WO2007144020A1 (fr) * 2006-06-12 2007-12-21 T-Cos Solutions Gmbh Procédé et système modulaire de commande et/ou contrôle de ressources distribuées
US8842818B2 (en) 2006-06-30 2014-09-23 Avaya Inc. IP telephony architecture including information storage and retrieval system to track fluency
JP4986739B2 (ja) * 2007-06-27 2012-07-25 キヤノン株式会社 コンテンツ再生装置及び情報処理方法
US10671600B1 (en) 2007-07-24 2020-06-02 Avaya Inc. Communications-enabled dynamic social network routing utilizing presence
WO2009153708A1 (fr) * 2008-06-18 2009-12-23 Koninklijke Philips Electronics N. V. Système de programmation e t procédé de programmation d'un système interactif
KR20100065812A (ko) * 2008-12-09 2010-06-17 한국전자통신연구원 건물 구조 도면을 이용한 홈 네트워크 동작 장치 및 그 방법
US9213324B2 (en) 2009-06-30 2015-12-15 Koninklijke Philips N.V. Systems and methods for managing interaction with controllable lighting networks
ES2753273T3 (es) 2009-10-08 2020-04-07 Delos Living Llc Sistema de iluminación LED
US8725828B2 (en) * 2011-07-19 2014-05-13 Nokia Corporation Method, apparatus, and computer program product for recommending interaction between devices in a local environment
DE102011052467B4 (de) * 2011-08-08 2014-12-04 tado GmbH Nutzer-zustand und -verhalten basiertes steuerungssystem und -verfahren für gebäudetechnische systeme und komponenten
EP3702685A1 (fr) 2012-08-28 2020-09-02 Delos Living LLC Système de commande environnemental et procédé de fonctionnement d'un tel système
ES2754311T3 (es) * 2012-10-17 2020-04-16 Signify Holding Bv Aseguramiento del control de un sistema compartido
CN104981963B (zh) * 2013-02-05 2018-04-27 三菱电机株式会社 家庭用电力指令装置以及家庭用电力控制系统
EP3042309A4 (fr) * 2013-09-06 2017-04-26 Hewlett-Packard Enterprise Development LP Gestion d'un facteur sensoriel
WO2015130786A1 (fr) 2014-02-28 2015-09-03 Delos Living Llc Systèmes, procédés et articles pour améliorer le bien-être associé à des environnements habitables
US9704113B2 (en) 2014-05-02 2017-07-11 Qualcomm Incorporated Method and apparatus for setting user preferences or device configuration
US9860076B2 (en) 2014-05-07 2018-01-02 Vivint, Inc. Home automation via voice control
KR102269473B1 (ko) * 2014-10-24 2021-06-28 삼성전자주식회사 제어 장치, 그의 제어 방법 및 통합 제어 시스템
US9554267B2 (en) 2014-11-21 2017-01-24 Facebook, Inc. Techniques to associate user data with a mobile device
EP3024199B1 (fr) * 2014-11-21 2019-12-11 Facebook, Inc. Procédé, support de stockage, système et programme pour associer des données d'utilisateur à un dispositif mobile
WO2016115230A1 (fr) 2015-01-13 2016-07-21 Delos Living Llc Systèmes, procédés et articles permettant de surveiller et d'améliorer le bien-être humain
KR102516111B1 (ko) * 2016-02-24 2023-03-30 삼성전자주식회사 전자 장치, 적어도 하나의 스마트 장치를 이용한 서버의 사용자 환경 제어 방법 및 서버
DK179593B1 (en) 2016-06-12 2019-02-25 Apple Inc. USER INTERFACE FOR MANAGING CONTROLLABLE EXTERNAL DEVICES
EP3504942A4 (fr) 2016-08-24 2020-07-15 Delos Living LLC Systèmes, procédés et articles permettant d'accroître le bien-être associé à des environnements habitables
KR20180102870A (ko) * 2017-03-08 2018-09-18 엘지전자 주식회사 전자 장치 및 그 전자 장치의 제어 방법
US11668481B2 (en) 2017-08-30 2023-06-06 Delos Living Llc Systems, methods and articles for assessing and/or improving health and well-being
US11005900B2 (en) 2017-09-18 2021-05-11 Microsoft Technology Licensing, Llc Notifications to all devices to update state
US10904628B2 (en) 2018-05-07 2021-01-26 Apple Inc. User interfaces for viewing live video feeds and recorded video
US11649977B2 (en) 2018-09-14 2023-05-16 Delos Living Llc Systems and methods for air remediation
WO2020176503A1 (fr) 2019-02-26 2020-09-03 Delos Living Llc Procédé et appareil d'éclairage dans un environnement de bureau
US11898898B2 (en) 2019-03-25 2024-02-13 Delos Living Llc Systems and methods for acoustic monitoring
US10904029B2 (en) 2019-05-31 2021-01-26 Apple Inc. User interfaces for managing controllable external devices
US11363071B2 (en) 2019-05-31 2022-06-14 Apple Inc. User interfaces for managing a local network
US11079913B1 (en) 2020-05-11 2021-08-03 Apple Inc. User interface for status indicators

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4321304A1 (de) * 1993-06-26 1995-03-02 Domarkas Brigitte Anlage zum Steuern und/oder Überwachen von Geräten
US5555376A (en) * 1993-12-03 1996-09-10 Xerox Corporation Method for granting a user request having locational and contextual attributes consistent with user policies for devices having locational attributes consistent with the user request
US5630159A (en) * 1994-12-29 1997-05-13 Motorola, Inc. Method and apparatus for personal attribute selection having delay management method and apparatus for preference establishment when preferences in a donor device are unavailable

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO0039964A1 *

Also Published As

Publication number Publication date
KR20010041425A (ko) 2001-05-15
WO2000039964A1 (fr) 2000-07-06
JP2002534841A (ja) 2002-10-15

Similar Documents

Publication Publication Date Title
WO2000039964A1 (fr) Systeme domotique de dispositifs distribues montes en reseau
EP1851596B1 (fr) Identification et commande d'appareils domestique dans un environnement en reseau
US7627098B2 (en) Intelligent management apparatus and method of digital home network system
US9613526B2 (en) System and method for controlling device location determination
EP2151723B1 (fr) Système de commande d'appareil ménager et procédés dans un environnement en réseau
EP1496650B1 (fr) Système et méthode pour le contrôle de réseau domotique
US20040215816A1 (en) Apparatus and methods for communication among devices
US7729282B2 (en) Home network system and its configuration system
US10952306B2 (en) Methods, systems, and products for control of electrical loads

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

17P Request for examination filed

Effective date: 20010108

RBV Designated contracting states (corrected)

Designated state(s): DE FR GB NL

17Q First examination report despatched

Effective date: 20040607

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20041019

REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1033058

Country of ref document: HK