WO2002021472A1 - Automated upload of content based on captured event - Google Patents

Automated upload of content based on captured event Download PDF

Info

Publication number
WO2002021472A1
WO2002021472A1 PCT/US2001/042073 US0142073W WO0221472A1 WO 2002021472 A1 WO2002021472 A1 WO 2002021472A1 US 0142073 W US0142073 W US 0142073W WO 0221472 A1 WO0221472 A1 WO 0221472A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
user
metadata
sensor
information
Prior art date
Application number
PCT/US2001/042073
Other languages
French (fr)
Inventor
Babak Rezvani
Jack Chen
Edward Kalin
Reza Jalili
Original Assignee
Xanboo, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=27398070&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=WO2002021472(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Xanboo, Inc. filed Critical Xanboo, Inc.
Priority to AU2001291301A priority Critical patent/AU2001291301A1/en
Priority to EP01971411A priority patent/EP1327232A4/en
Priority to CA002421772A priority patent/CA2421772A1/en
Publication of WO2002021472A1 publication Critical patent/WO2002021472A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/22Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks comprising specially adapted graphical user interfaces [GUI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/02Standardisation; Integration
    • H04L41/0233Object-oriented techniques, for representation of network management data, e.g. common object request broker architecture [CORBA]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/08Protocols specially adapted for terminal emulation, e.g. Telnet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/53Network services using third party service providers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/535Tracking the activity of the user
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/75Indicating network or usage conditions on the user display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • H04L69/322Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
    • H04L69/329Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]

Definitions

  • This invention relates to systems and methods for uploading captured content to a remote site. More particularly, this invention relates to systems and methods for capturing content in response to events and publishing the content at a remote site where it is accessible through a registered user account.
  • the present invention may provide users with opportunities to access content published on one or more remote sites, such as one or more web servers, X windows servers, or other remote computes suitable for providing access to captured content.
  • the published content may have been captured by one or more devices associated with the user's client system.
  • the client system may include one or more monitoring modules that include processes for obtaining content from the devices.
  • the devices may capture content in accordance with user commands, or may be triggered to capture content in response to events. For example, sensors may sense environmental conditions and trigger associated devices to capture content. In other suitable approaches, the devices may capture content continuously or periodically.
  • uploaded content may be published and associated with one or more user accounts, thereby establishing an affinity between the users associated with the account and the client system, monitoring module, or capture device.
  • the uploaded content may be associated with a single user account of a particular user. That user may give other users access to his or her account.
  • content may be published to the accounts of multiple users for each user's access. Any other suitable approach may be used.
  • content may be captured and uploaded to the remote site without using persistent storage in the client system. For example, content may be captured by a device, directly uploaded by the client system to the remote system, published using a web page script, and then stored for user access.
  • content may be persistently stored as the exclusive way of capturing and transmitting content. Still other embodiments may capture and automatically transmit content without persistently storing the content, and persistently store the content as a backup in case of a transmission failure.
  • Content may be wrapped with metadata that instructs the remote site how and what to do with the captured content.
  • the metadata may also include an indication of a user, the device that captured the data, an associated monitoring module, or any other aspect of the client system.
  • the remote system may associate the captured content with the user or the user's account based on the metadata.
  • FIG. 1 is an illustrative schematic block diagram of an upload system architecture in accordance with an embodiment of the present invention.
  • FIG. 2 is a schematic block diagram of the components of the illustrative upload system of FIG. 1 in accordance with an embodiment of the present invention.
  • FIG. 3 is a schematic block diagram of the components of the illustrative upload system of FIG. 1 in accordance with an embodiment of the present invention.
  • FIGS. 4a and 4b are flowcharts of illustrative steps involved in capturing, uploading, and publishing event data in accordance with an embodiment of the present invention.
  • FIG. 5 is a flowchart of illustrative steps involved in executing commands to registered devices from a remote location in accordance with an embodiment of the present invention.
  • FIG. 6 is a flow chart of illustrative steps involved in the automatic upload of automatically captured content in accordance with an embodiment of the present invention.
  • FIG. 7 is a flowchart of illustrative steps involved in allowing users to access content published to a user account in accordance with an embodiment of the present invention.
  • FIG. 8 is a flowchart of illustrative steps involved in capturing content and publishing it with a user associated account in accordance with an embodiment of the present invention.
  • FIG. 9 shows an illustrative display screen for allowing a user to log into a registered account in accordance with an embodiment of the present invention.
  • FIG. 10 shows an illustrative display screen for allowing a user to access a control panel listing registered devices in accordance with an embodiment of the present invention.
  • FIG. 11 shows an illustrative display screen for allowing a user to access a control panel for setting notifications in accordance with an embodiment of the present invention.
  • FIG. 12 shows an illustrative display screen for allowing a user to access a message board to view events in accordance with an embodiment of the present invention.
  • FIG. 13 shows an illustrative display of user options in accordance with an embodiment of the present invention.
  • FIG. 14 shows an illustrative display for providing a user with an opportunity to locally capture content in accordance with an embodiment of the present invention.
  • FIG. 15 shows an illustrative display for indicating detected devices in accordance with an embodiment of the present invention.
  • FIG. 16-18 show illustrative image gallery displays of content in accordance with an embodiment of the present invention.
  • FIG. 19 shows an illustrative display for providing users with access to uploaded content in accordance with an embodiment of the present invention.
  • FIG. 1 shows an illustrative system 10 in accordance with the present invention.
  • System 10 may include an installation 12 and a remote site 14 that may be linked via a communications network 16.
  • Remote site 14 may be any suitable remote site that may include equipment such as, for example, one or more servers, mainframes, personal computers, or any other suitable computer- based equipment.
  • Remote site 14 may include a network of suitable computers that may be interconnected in any suitable way, such as, for example, through a local area network, wide area network, telephone network, cable television network, Intranet, Internet, or any other suitable wired or wireless communications network.
  • Communications network 16 may be any suitable communications network, such as, for example, a local area network, wide area network, telephone network, cable television network, Intranet, Internet, or any other suitable wired or wireless communications network.
  • Some suitable wireless communications networks may be global system for mobile communications (GSM) , time-division multiple access (TDMA) , code- division multiple access (CDMA) , Bluetooth, or any other suitable wireless communication networks.
  • GSM global system for mobile communications
  • TDMA time-division multiple access
  • CDMA code- division multiple access
  • Bluetooth any other suitable wireless communication networks.
  • Installation 12 and remote site 14 may communicate over communications network 16 using any suitable protocol or protocol stack.
  • TCP/IP transmission control protocol/Internet protocol
  • IP version 4 or IP version 6 that supports 128-bit network addressing
  • HTTP hypertext transfer protocol
  • UPF universal plug and play
  • Any suitable request-response type of protocol and socket-based packet transport stack, or suitable peer-to-peer communications approach may be used as desired.
  • Installation 12 and remote site 14 may communicate using any suitable communications. Communications may include, for example, commands, requests, messages, remote procedure calls (e.g., using a proxy-stub pair) , or any other suitable client-server or peer-to-peer communication. Communications may also involve, for example, complex communications between application constructs running on installation 12 and ' remote site 14. Objects running on the client and server may, for example, communicate using an Object Request Broker (ORB) . Transmitted information may, for example, be encapsulated as COM objects or Javabeans and persisted to files that are transmitted over a remote access link.
  • ORB Object Request Broker
  • access communications may include hypertext markup language (HTML) formatted markup language documents (e.g., web pages), that are exchanged between installation 12 and remote site 14 via ISP 23 and communications link 16.
  • HTTP hypertext markup language
  • communications may consist of a series of HTTP posts and responses in which the parameters for the transmissions may be sent as name/value pairs in the normal post method.
  • numbered commands may be parsed out and executed at remote site 14.
  • Remote site 14 may be .responsible for parsing the command string into individual commands and executing each of. those commands.
  • remote site 14 may, for example, utilize a script language and interpreter such as Personal Home Page Tools (PHP) which is embedded within a Web page along with its Hypertext Markup Language (HTML) .
  • PHP Personal Home Page Tools
  • HTML Hypertext Markup Language
  • the Web server may call PHP to interpret and perform the operations called for.
  • PHP Hypertext Markup Language
  • Other similar technologies may also be utilized such as JavaScript, Microsoft's VBScript, or any other applicable script interpreter.
  • any other suitable client-server or peer-to-peer based approach may be used.
  • Installation 12 may be operated by a local user.
  • Installation 12 may include one or more nodes.
  • FIG. 1 illustrates an approach having two nodes, first user node 18 and second user node 20.
  • nodes 18 and 20 may be located at a single location, such as the user's main residence. If desired, nodes may be located across more than one location. For example, one node may be in a user's main residence and another at the user's vacation house. If desired, nodes of an installation may be associated with more than one user account.
  • user node 18 may include a client device 22 that may be connected to communications network 16.
  • client device 22 may be connected to the Internet via an Internet service provider (ISP) 23.
  • ISP Internet service provider
  • Client device 22 may be any device suitable for communicating with remote site 14 via communications network 16.
  • client device 22 may be a computer, a personal digital assistant
  • Client device 22 may include, for example, an Internet browser application 26 that may be used to access web pages via communications network 16. In other suitable approaches, client device 22 may run a client application that provides locally generated displays propagated with a format obtained using any suitable client-server or peer-to-peer scheme.
  • Client device 22 may communicate with ISP 23 or directly with communications network 16 using any suitable communications link.
  • the link may include a telephone dial-up link, digital subscriber line .(DSL), a cable modem link (e.g., a data over cable service interface specification (DOCSIS) link), a satellite link, a computer network link (e.g., Ethernet link, Tl line, etc.) or any other suitable communications link or combination of communications links.
  • DSL digital subscriber line .
  • cable modem link e.g., a data over cable service interface specification (DOCSIS) link
  • satellite link e.g., a satellite link, a computer network link (e.g., Ethernet link, Tl line, etc.) or any other suitable communications link or combination of communications links.
  • DOCSIS data over cable service interface specification
  • Remote site 14 may include one or more servers such as, for example, web server 46 and database server 48.
  • Database server 48 may maintain database 58.
  • remote site 14 may include an application server and any other suitable server or combination of servers.
  • server is not limited to a distinct piece of computing hardware or storage hardware, but may also be a software application or a combination of hardware and software.
  • one computer may have software that enables the computer to act as both a web server and as a database server.
  • remote site 14 may provide displays or display definitions to client device 22. In the Internet-based approach of FIG.
  • web server 46 may generate static and dynamic web pages from data supplied by database server 48. Web page 47 may be viewed by a user using Internet browser 26 running on client device 22.
  • Software applications interfacing installation 12 with remote site 14 may be created using any suitable platform and/or software development tools. For example, Java 2 Enterprise Edition, Javabeans, component object model (COM) based technologies (e.g., ActiveX, object linking and embedding (OLE), etc.), Javascript, Visual Basic, C, C++, scripting languages, or any combination of these or other suitable development tools may be used in creating the software interface between installation 12 and remote site 14 (e.g., web-page interface). Any combination of these or other suitable development tools may be used in preparing any other software modules or applications for use in any other suitable facet of the present invention.
  • COM component object model
  • OLE object linking and embedding
  • Remote site 14 may function as the master controller of the system shown in system 10.
  • users may access the system shown in system 10 via any computer, monitoring module, or remote user access device linked to communications network 16.
  • Remote user access devices (such as remote user access device 17 in FIG. 1) may include, for example, personal digital assistants, cellular telephones, set-top boxes, personal computers, or any other suitable device a user may use to access remote site 14 via communications network 14.
  • Monitoring modules 28 may serve as an interface between remote site 14 and at least one connected device 32. Monitoring modules 28 may be any suitable hardware, software, or a combination thereof and may be included at any point within the system.
  • monitoring module 28 may be a software application running on client device 22 or a separate piece of hardware that may be connected to client device 22 (as shown at node 18) or partially implemented as software on client device 22 and a separate piece of hardware.
  • monitoring module 28 may be a stand-alone appliance (as shown at node 20) connected to communications network 16, operating separately and independently from client device 22.
  • Each monitoring module may be shipped with a model identification code, or with the capacity to generate such a code, that may serve to identify each particular monitoring module's model type.
  • One or more monitoring modules may be installed at one or more locations. Monitoring modules may be installed by the user (or any other suitable person) by, for example, connecting the modules to client device 22 that may communicate with remote site 14 over communications network 16.
  • the connection between the monitoring module and the client access device and between devices and the monitoring module may be in the form of a universal serial bus (USB) connection, parallel port connection, serial connection (e.g., RS-232), Firewire connection, any combination of these, or any other suitable type of connection.
  • monitoring modules may be given the capability (e.g., processing hardware, communications equipment, etc.) to communicate, via communications network 16, without the use of a client access device.
  • Monitoring modules may link attached devices or appliances (e.g., sensors, cameras, microwaves, refrigerators, etc.) with remote site 14 via communications network 16.
  • One or more monitoring modules 28 may provide data from attached devices and appliances to remote site 14 via communications network 16.
  • the term "device,” as defined herein, shall include any suitable device or appliance.
  • At least one device 32 may be interfaced with and controlled by each monitoring module 28. Connections between monitoring module 28 and the various devices 32 may be hardwired or wireless (e.g., using Bluetooth technology) . Devices 32 may encompass any suitable device capable of being controlled or mediated by an external controller. Such devices may include, but are not limited to, a camera 34, a radio 36, a smoke or fire detector 38, a contact sensor 40, and a light switch 41.
  • suitable devices may include, for example, various audio input and output devices, infrared devices and sensors, various visual displays, washers/driers, microwave ovens, cooking ranges, car alarms, plant watering devices, sprinklers, thermostats, carbon monoxide sensors, humidity sensors, water emersion sensors, radon sensors, temperature sensors, audio sensors, radiation sensors, rain gauges, video cassette recorders, radio tuners, or any other suitable device and the like.
  • Monitoring modules may register themselves, devices, or installations with remote site 14.
  • Illustrative systems and methods for auto-registering devices with remote sites are described, for example, in Rezvani et al. United States patent application Serial No. 09/709,688, filed November 10, 2000, which is hereby incorporated by reference herein in its entirety.
  • One or more notification devices may also be incorporated into the system. As illustrated in FIG. 1, pager 43 is in wireless communication with a wireless or cellular transmitter 44 associated with remote site 14.
  • Other suitable notification devices include, for example, e-mail clients, wireless hand-held computers, wireless wearable computer units, automatic web notification via dynamic web content, telephone clients, voice mail clients, cellular telephones, instant messaging clients, and the like.
  • System 10 provides users with opportunities to remotely control and monitor devices 32 using remote user access devices 17 via communications network 16.
  • users may control devices 32 that are interfaced with monitoring modules 28 at node 18 and devices 32 interfaced with monitoring module 28 at node 20.
  • there may be a single node, or more nodes, depending on, for example, the user's equipment, number of sites, or other suitable parameters.
  • a suitable system architecture and communications network 16 may allow users, or anyone that users permit, to readily monitor and control monitoring modules 28 from any location using any suitable device that is capable of communicating with remote site 14 via communications network 16.
  • users may access installation 12 using remote user access devices 17 without the use of remote site 14.
  • remote user access devices 17 may be used to communicate with monitoring modules 28 of installation 12 via communication network 16 and ISP 23. If desired, two-way communications may be implemented using this approach.
  • Remote user access device may access installation 12 using, for example, special IP addresses assigned to a particular monitoring module, node, installation, or any other suitable element of the installation. The use of IP addresses is merely illustrative. Any other suitable addressing may be used to allow access to an installation from a remote used access device.
  • Devices 32 may be programmed at the installation in terms of how they respond to certain events (e.g., what does the camera do when the contact sensor is triggered?) . Alternatively, devices 32 may be programmed from a remote location using remote user access device 17, for example. The programming may be stored in devices 32, monitoring modules 28, or at remote site 14.
  • contact sensor 40 of FIG. 1 may be associated with the front door (not shown) of a remote location associated with second node 20.
  • Contact sensor 40 may be configured to trip whenever the front door is opened.
  • Camera 34 is also positioned to view the front door location and may be programmed to take a digital picture whenever the sensor contact 40 is tripped. This picture may be transmitted over communications network 16 and stored in database server 48.
  • an event notification or alarm trigger may be transmitted by monitoring module 28 to database server 48.
  • Database server 48 may have been previously programmed to transmit a notification event to the user's pager, for example, via cellular transmitter 44.
  • system 10 may allow a user located at one node 18 a remote site to control a device at a second node 20.
  • the user may contact web server 46 via, for example, Internet browser 26 of node 18 in order to access a database entry for light switch 41 of node 20.
  • a virtual representation of the light switch 41 may be made available to the user by web server 46 and may be manipulated by the user to remotely change the state of light switch 41 and the connected lamp 42.
  • the system may allow the user to change the state of lamp 42 from being “off” to being “on” by, for example, manipulating the virtual light switch from web server 46 and a corresponding command would be placed in the queue of waiting commands on the server component.
  • the controlling module or monitor 28 may poll remote site 14 looking for waiting commands, such as the change state command of light switch 41. Thereafter, the command may be transmitted to monitoring module 28 that would instruct the light switch to change from the "off" state to the "on” state, thus turning on lamp 46.
  • monitoring module 28 may serve, for example, as a common connection point for one or more devices 32 at an installation 12 and as the interface between devices 32 and remote site 14 via communications network 16. Monitoring module 28 may, for example, serve as a translation and brokering agent between remote site 14 and devices 32.
  • monitoring module 28 may be software made up of multiple dynamically loaded objects, or device descriptors 49, that may allow remote site 14 to interface with the devices 32.
  • the dynamically loaded device descriptors 49 may act as device drivers for devices 32, translating, in both directions, monitoring, command, and control data (i.e., via monitoring module 28) exchanged between devices 32 and remote site 14 via communications network 16.
  • Each device descriptor 49 may also translate the signals received from monitoring module 28 into the specific electrical signals that are required to communicate with (both input and output) and control its associated device 32.
  • Device descriptor 49 may be provided for each specific device 32 when, for example, different devices 32 have different interfaces and require specific sets of electrical signals for their monitor and control.
  • Device descriptors 49 may include, for example, a manufacturer identification, product identification, and driver version number to allow a device to be referenced correctly. Once a new device 32 has been detected and is to be integrated into the system, monitoring module 28 may reference, download, and run the appropriate drivers for the new device. [0054] After loading a new descriptor 49, monitoring module 28 may communicate with remote site 14 to determine whether the new device 32 has been previously catalogued. Monitoring module 28 may, for example, determine if a general description and a default state of device 32 exists at the remote site. When a device 32 has been catalogued then, for example, the default state and general parameters of device 32 may be stored at remote site 14.
  • a catalogued device 32 may eliminate the need to resend the general parameters and default state and monitoring module 28 may just communicate the instance-specific parameters.
  • monitoring module 28 may communicate its default state and static parameters directly to remote site 14. The communication from monitoring module 28 to remote site 14 may be done using name/value pairs using, for example, the normal HTTP post method discussed hereinbefore.
  • a template document may be a static parameter of device 32.
  • a template is a layout document which can specify how components, actions, and indicators are to be laid out on the user's end display (e.g., user's web page 47 at remote site 14) .
  • the template may exist anywhere on the system as either a static or dynamic parameter.
  • templates incorporating static parameters may exist as a static parameter inside the hardware of device 32, as a static parameter within the driver and setup during registration procedures, may be hard-coded into a remote server, or may be communicated through monitoring module 28 via the device drivers and stored on the user's account. Any other suitable approach may be used.
  • Templates utilizing dynamic parameters may, for example, allow updates to be sent to the template while the driver and .device are in an execution state.
  • templates may be downloaded from a remote location (e.g., from the manufacturer's server) . The ability to download templates from the device manufacturer may permit the manufacturer to incorporate desired changes and/or new aspects in the device template.
  • FIG. 3 further illustrates the relationship between devices, monitoring modules, and remote database server 48.
  • FIG. 3 shows five devices, 32,
  • Each device may be interfaced to a monitoring module 28 via a device descriptor or driver 49 (only one shown) .
  • Each device may include a customizable user interface 58 that may be viewable on remote user access device 17 over communications network 16.
  • Interfaces 58 may include virtual representations of the actual user interfaces of the devices. [0058] In some embodiments, virtual representations may be stored on, for example, web server 46.
  • Remote site 14 may use changes in device states to change the virtual representations of the devices with which the changed states are associated.
  • a virtual representation of a device may be either a text-based, symbol-based, or image- based representation of an actual device 32 from the installation as it appears to a user who accesses the remote site from a location remote to the installation using any suitable remote user access device.
  • the corresponding virtual representation may be an indicator icon that may be either green or red. If the indicator icon is green, that may denote that the actual light switch is in the "on” position. If the indicator is red, that may denote that the light switch ' is in the "off” position. If, during a heartbeat operation, remote site 14 is informed that the state of the light switch changes from “on” to "off, " then the virtual representation of the light switch may change from being green to being red.
  • User interface 58 may include at least one resource.
  • resources 60, 62, and 64 are shown. Resources may provide users with access to features specific to their associated device.
  • the device shown in FIG. 3 represents a videocassette recorder (VCR) having a recording setting resource 60, a channel selecting resource 62, and a power selecting resource 64.
  • VCR videocassette recorder
  • Typical VCRs may have other operational resources, but the resources illustrated in FIG. 3 are sufficient to illustrate the operation of the device.
  • Each resource 60, 62, 64 may include one or more display components.
  • the recording setting resource 60 includes a display component 70 and a series of pushbuttons 72, 74, 76, 78 which a user may use to activate the VCR's reverse, fast forward, stop, and play functions, respectively.
  • the channel selecting resource 62 may include a pair of pushbuttons 82 and 83 that users may use, respectively, to activate up channel and down channel functions of the VCR.
  • the power selecting resource 64 may include a toggle switch 80 that users may use to activate the VCR's power on and power off commands, and an LED indicator 81 that may indicate the power condition of the VCR.
  • Other suitable display components may include toggle buttons, radio buttons, absolute sliders, proportional sliders, edit fields, labels, images, video clips, streaming video, streaming audio, multiselect list, time fields, date fields, or any other suitable display components.
  • Display components may act as status indicators. If desired, display components allow users to toggle settings or otherwise manipulate devices 32.
  • toggle buttons may serve as indicators, showing, for example, whether a device is in the "on" position or in the "off” position.
  • Toggle buttons may allow users to change the state of a device, by, for example, turning a device on or off.
  • Sliders may act as indicators by showing, for example, the percentage complete of a particular process a device may be performing (e.g., baking a cake) , and may allow users to change the state of a device (e.g., changing the thermostat temperature). Edit fields may allow users to change textual representations of suitable elements (e.g., naming a television show to be recorded by the show's name) . Video, audio, images, or any other suitable media-based components may act as indicators showing what the devices are sensing (e.g., images may be sensed by cameras, streaming video may be sensed by camcorders, audio clips may be sensed by audio recorders, etc.) .
  • Date and time fields may act as indicators, by, for example, displaying what date and time a VCR is set to start recording. Date and time fields may allow users to set the date and time a VCR may start recording.
  • Multiselect lists may act as indicators by, for example, listing all sound sensors that are detecting noise in the house. Multiselect lists may also be used, for example, to select some of a number of available sensors to turn on. [0062]
  • a virtual representation of each device 32, 32a, 32b, 32c, 32d may be stored as a record 94, 94a, 94b, 94c, 94d in the database of database server 48 of remote site 14. Each record may contain an entry for each resource and its associated components which make up the device.
  • record 94 for VCR device 32 may contain an entry 90, 91, 92 for each resource 60, 62, and 64, respectively, and an entry 90a, 90b, 90c, 90d, 91a, 91b, 92a, and 92b for each component 72, 74, 76, 78, 82, 83, 80, and 81, respectively.
  • a web page 47 may be generated by web server 46 by extracting the associated record for that device from database server 48 and creating a graphical, textual, tactile, aural, or other suitable user interface representation of that device that the user may access via, for example, Internet browser 26.
  • monitoring module 28 may serve is to persist the state of devices 32. This may be done, for example, to allow the real-time states of devices 32 to be stored, to communicate to remote site 14, or to allow for easy recovery from a system crash.
  • the stored state of devices 32 may also be used for maintaining a synchronized relationship between an installation 12 and remote site 14.
  • remote site 14 and installation 12 may use polling and heartbeat mechanisms in order to synchronize state information between remote site 14 and installation 12.
  • Polling may refer to a process whereby monitoring module 28 obtains commands from remote site 14.
  • the commands may reside, for example, in command queue 51. Commands may be accumulated at command queue 51 as a result of any suitable action by the user, by remote site 14, or by both.
  • a user may use a remote user access device to issue a command or a request to remote site 14 to cause a change in state of one of devices 32 (e.g., to turn a lamp on) .
  • Remote site 14 may post the change in state command to a command queue 51.
  • Monitoring module 28 may communicate a request for pending commands to remote site 14. This request may be communicated periodically as part of the polling process.
  • remote site 14 may provide one or more pending commands from command queue 51, and may notify monitoring module 28 of the number of remaining pending commands in command queue 51. Monitoring module 28 may then again communicate a request for pending commands.
  • Remote site 14 may return more of the pending commands from command queue 51. This process may continue until command queue 51 at remote site 14 is empty.
  • Remote site 14 may provide commands to monitoring module 28 using any suitable algorithm. For example, remote site 14 may return commands using first-come, first-serve, round robin, first-in, first- out, weighted prioritization, or any other suitable algorithm. Remote site 14 may also proactively inform monitoring module 28 that commands are waiting in queue 51. Monitoring module 28 may then poll remote site 14 and retrieve commands from remote site 14 until the queue is empty. [0067] Commands issued on remote site 14 can be generated by the user while the user is logged on to web page 47 provided by remote site 14. If a user is not logged onto web page 47 then fewer commands are being issued and thus the need to poll remote site 14 is low. Therefore, the frequency of polls may decrease.
  • a poll frequency setting process may monitor the usage patterns of a user and make anticipatory guesses based on the user's pattern of command generation. For instance, the user may not often be logged on to web page 47 at remote site 14 from the hours of 2 7AM to 7 7AM because the user is sleeping. Therefore, the smart frequency setting process may notice this pattern and automatically decrease the poll frequency at 2 AM and increase it again at 7 AM.
  • polling process 50 is used by remote site 14 to effect state changes in devices 32 via monitoring module 28, monitoring module 28 may use heartbeat process 52 to update device state information at remote site 14.
  • a heartbeat may be a periodic communication from monitoring module 28 to remote site 14 containing updated state information for devices 32 associated with monitoring module 28.
  • monitoring module 28 may send a communication to remote site 14 in response to a change in state of a device 32, a synchronization of a device 32 with remote site 14, a triggered alert event, or in response to any other suitable event.
  • all data intended to be transmitted to remote site 14 may be transmitted to remote site 14 via communications network 16.
  • Remote site 14 may transmit an acknowledgment of receipt and successful processing of the data back to monitoring module 28.
  • Remote site 14 may direct monitoring module 28 to make changes in its own state by, for example, posting commands to data store 51. For example, remote site 14 may post commands that set or modify the polling 50 or heartbeat 52 time intervals.
  • monitoring module 28 may send a communication to remote site 14 requesting any queued commands. Monitoring module 28 may continue to poll, using a preselected communication scheme, until the queue of commands waiting for monitoring module 28 is empty. Each command received from the queue may be acted upon when the command is received and any associated state changes are effected. Remote site 14 may transmit an acknowledgment of receipt and successful processing of the data back to monitoring module 28.
  • remote site 14 may send unsolicited communications to monitoring module 28.
  • Remote site 14 may send communications to, for example, set or update the heartbeat or polling time, or to cause monitoring module 28 to issue a command to update a component of a device.
  • Remote site 14 may send unsolicited communications to monitoring module 28 for any other suitable purpose.
  • monitoring module 28 may also take care of many network level activities 56. These activities may include, but are not limited to, verifying passwords, dialing up an ISP, if necessary,, periodically uploading accounting/billing information, and performing security measures. Any other suitable network level activities may be performed by monitoring module 28.
  • Users may be provided with opportunities to access content published on remote site 14.
  • the published content may have been captured by one or more devices 32.
  • Monitoring modules 28 may obtain content from devices 32.
  • Devices 32 may capture content in accordance with user commands (e.g., user commands generated by a user using client access device 22 or remote access device 17), or may be triggered to capture content in response to events detected by other devices in an installation. In another suitable approach, devices 32 may capture content continuously or periodically.
  • uploaded content may be published and associated with a particular user account, thereby establishing an affinity between the user and the user's installation 12, monitoring module 28, or device 32. If desired, the content may be made available to only a user or users associated with the content. In one approach, one or more users may be associated with device 32. Content captured by device 32 may be published to multiple user accounts. A user associated with device 32 may setup, or restrict, to whom content captured by device 32 may be published. In some embodiments of the present invention, content may be captured and uploaded to remote site 14 without using persistent storage in client device 22. For example, content may be captured by a device 32, directly uploaded by client device 22, via monitoring module 28, to remote site 14, published using a web page script, and then stored for user access. In some embodiments, content may also be persistently stored as a back up if, for example, the upload transmission of content by client device 22 fails. In other embodiments, content may be stored persistently and then transmitted.
  • Content may be wrapped with metadata that instructs the remote site how and what to do with the captured content.
  • the metadata may include an indication of a user, the device 32 that captured the data, an associated monitoring module 28, or any other aspect of an installation.
  • the remote site 14 may associate the captured content with the user or the user's account based on the metadata.
  • Sensor device 32 such as smoke sensor 33, contact sensor 40, motion sensor, or other suitable sensor devices 32 may detect environmental occurrences or changes, sometimes referred to herein as events", and trigger capture devices 32 to capture content.
  • Monitoring module 28 may receive the content from the device 32 and upload the content to remote site 14.
  • Device 32 may capture content continuously with a user defined frequency, over a user defined period, or at a scheduled time.
  • a scheduled time may be set through client device 22 or remote site 14 using remote access device 17.
  • the user may initiate an upload of captured content by instructing device 32, through monitoring module software 28, to upload a captured image.
  • client device 22 may provide the user with a "home control" application in which the user may initiate the capture of an image by selecting a specific device and selecting applicable capture options on the application (this concept will be illustrated in FIG. 12) . Any other suitable approach may also be used.
  • Client device 22, running monitoring module software 28 may receive captured content and encapsulate it into one or more data objects to upload to remote site 14. Initially, the object may be temporarily placed in the local random access memory (RAM) of client device 22. A socket may be opened from client device 22.
  • RAM local random access memory
  • the object, or collected content, is copied across the socket to database server 48 at remote site 14.
  • the object may be persisted to a stream, transmitted, and reinstantiated at remote site 14.
  • database server 48 may signal web server 46 to process and publish the captured event to web page 47.
  • Monitoring module 28 may use any suitable communications protocol or group of protocols to communicate with remote site 14.
  • the protocol may include for example, series of HTTP posts and responses in which the parameters for the transmissions may be sent as name/value pairs in the normal HTTP post method. Multiple commands may be transmitted using a single command string in which commands are numbered. Commands may be parsed from the string and executed at remote site 14.
  • FIGS. 4a, 4b and 5-8 are flowcharts of illustrative steps involved in some embodiments of the present invention. The steps shown in FIGS. 4a, 4b and 5-8 are only illustrative and may be performed in any • suitable order. In practice, steps may be added or deleted.
  • FIGS. 4a and 4b are flowcharts of illustrative steps involved in capturing, uploading, and publishing content in accordance with one embodiment of the present invention.
  • the steps shown in FIGS. 4a and 4b are only illustrative and may be performed in any suitable order. In particular, suitable steps may be deleted and other suitable steps may be added.
  • a sensor device detects an event and triggers a capturing device.
  • the triggered device captures content at step 404 to provide the content to monitoring module 28 at step 406.
  • monitoring module 28 stores the content in non- persistent storage such as random access memory (RAM) of client device 22 or monitoring module 28 until a connection is established with remote site 14.
  • RAM random access memory
  • Monitoring module 28 then opens a socket, at step 412, to establish a connection with remote site 14 and uploads the captured content to remote site 14, at step 414.
  • Deciphering content may include, for example, unwrapping metadata that encapsulates the content.
  • metadata is structured data which describes the characteristics of the captured content being transferred ("data about data") .
  • Metadata may allow remote site 14 to determine the type of content being uploaded. For example, remote site 14 may examine the metadata to determine the user, device 32, monitoring module 28, or other elements of the installation associated with the content. The metadata may also be examined, for example, to determine the type of captured content, capturing device, or appropriate virtual interface.
  • Content wrapped with metadata may instruct the remote site on how the wrapped content may be handled or published. Metadata may also include or be supplemented by other data related to the content.
  • Metadata may include element names and elements. Elements may describe the contents, location, physical attributes, type (e.g., text, image, video, temperature, etc.), form ' (e.g., a document, electronic mail, etc.), or other attributes of the captured content.
  • Metadata elements may include, for example, usernames, identifications (ID) of sender, passwords, device identities, event names (what caused a device to be triggered) , dates and times, and any other suitable data (e.g., data describing content, an associated user, event, or 'component of an installation) .
  • All or portions of the metadata may be posted to a designated web page 47 at the remote site 14.
  • Remote site 14 may run a script and interpreter such as Personal Home Page Tools (PHP) , which may be embedded into the Hypertext Markup Language (HTML) code of a web page, that processes data for publishing.
  • PHP Personal Home Page Tools
  • HTML Hypertext Markup Language
  • the script may store the data at remote site 14 so that it may be accessed through web page 47.
  • content may be processed by first validating the userna e and password associated with a user account and the registered devices. Upon validation, the captured content may be published to (e.g., stored on web server 46 for publication in a web page) the user's account. When the user accesses his or her account, the content may be provided in a display such as a web page.
  • the metadata may indicate a notification action that is to be performed when the content is published.
  • FIG. 4b shows these illustrative metadata elements—identification, content, and event name— which may be translated and executed. More elements may be incorporated within the metadata, but only three elements are shown to avoid over-complicating the example .
  • an association may be made between the registered user and registered device (the unique affinity present between the user and device) .
  • a user identification and password element may be deciphered.
  • the affinity between the user and the capturing device 32 is established at step 428. Once verified, an association may be made between the captured event data from device 32 and the user, thus accessing the appropriate account 432 and publishing within the applicable publication environment 434.
  • a content element may be deciphered at step 422.
  • the element may include a description of the type of content, its format, or the information about the content.
  • the deciphered content element may indicate that the content is electronic mail, a plain-text message, video feed, picture media, or any other applicable content in step 424.
  • the content may be associated with the user determined at step 428 so that the user may access the content through the user's account.
  • the user logs on and accesses his or her user account at step 434 accesses the deciphered content in a publication environment (e.g. , web page).
  • Metadata event may include, for example, an event name as shown at step 430.
  • the event name may be deciphered and assigned to a captured event, and assigned an event notification instruction. Some embodiments may determine if notifications are applicable for a particular captured event based on the event name.
  • the appropriate user account may be accessed (step 432) and a reference check may be made within a notifications field to determine if there is a notification associated with the event (step 436) . If a notification is associated with the event occurrence captured, the user may be notified in step 438 via e- mail, paging, or any other suitable approach. If no notifications apply to the event then no action is executed.
  • Users may be provided with the ability to remotely monitor and control networked devices 32 via monitoring modules 28.
  • users may monitor and control devices 32 via remote site 14 using remote user access device 17, or directly using client access device 22.
  • users may monitor and control devices 32 via a remote site using client access device 22 and browser 26.
  • Client access device 22, remote user access device 17, or web server 46 may construct a suitable user interface for allowing users to monitor and control devices 32 using any suitable approach.
  • Some embodiments may use one or more templates that layout the look and position of the members of a device 32 (i.e., the features of device 32 accessed or used by a user, such as, for example, controls or displays) .
  • Members of device 32 may be defined as physical controls on device 32 such as, for example, a power push-button on a VCR.
  • Device members may correspond to any suitable controls, displays, or combination of like components made available by the virtual interface for device 32.
  • Components may also correspond to functional elements of device 32. For example, there may not be a button to program a program recording in a VCR of a regularly scheduled media but that functionality may be represented in the virtual interface.
  • components that represent device 32 may be incorporated to correspond to pieces of functionality that may not exist on the device.
  • a button represented on the user interface • through web page 47 that "locks" down a VCR, for example, may not correspond to a physical button on the VCR.
  • the unavailable functionality on the VCR may allow the user to remotely access his or her VCR to lock it for the purpose of protection.
  • a component may be created in, for example, the device driver in monitoring software 28.
  • the templates may reference components that define how the members of devices 32 are presented to and controlled by users.
  • components may be- objects that include methods and data suitable for presenting the members to users.
  • database server 48 or client access device 22 may acquire one or more of these templates and components using any suitable approach.
  • database server 48 or client device 22 may retrieve templates and components from its own storage or from another database server (e.g., from the Internet) , using URLs or other identifiers of the templates or components.
  • devices 32 may be programmed with the templates and may provide them to client access device 22 or database server 48.
  • the template may include place holders for components. Components, which may correspond to device members, can be cut and pasted into the template.
  • a push button may be generated on the user interface from the current state of a toggle component in database 58.
  • the push button component may be wrapped with javascript functions to be cut and pasted into the template.
  • the push button When a browser loads the interface (i.e., a template that has its place holders occupied by components), the push button may show up as a push button on the screen and clicking on it has the intended effects associated with the push button (e.g., turning a device on or off) .
  • Web server 46 may take the template, locate components designated to device 32 using the components' IDs, and ask the components to generate a suitable user interface representation. Web server 46 may then take the suitable representation and paste it into the template corresponding to the components' IDs.
  • the filled template may be used by web server 46 to generate a web page 47 suitable for allowing the user to monitor and control a given device.
  • the filled template may include resource and component information that represents the state of a represented device 32. This information may be provided by monitoring module 28 for propagation into the user interface. For example, the state of a light switch, volume of a speaker, or that actual video from a video camera may be provided by monitoring module 28 to client access device 22 or remote site 14 and indicated in web page 47.
  • the user interface may include interactive elements, such as sliders, buttons, etc., that allow the user to control a represented device 32.
  • the state change may be packaged as a command or other communication.
  • the command may be entered into queue 51.
  • queue 51 may be an advanced queue that operates as specialized memory.
  • a separate dequeue process may manage retrieving commands from the advanced queue in a non-first-in-first-out (non-FIFO) process for different devices, but in a FIFO process for commands for the same device.
  • multiple queues may be used for different devices, different users, or using any other suitable approach.
  • Web page 47 (or other display) may indicate to the user that a state change has been submitted and in the process of being executed.
  • database server 48 may not be updated immediately to reflect a change in state for a device made by a user. Instead, monitoring module 28 may receive packaged commands from queue 51 and provide the commands to the appropriate device descriptor 49. Device descriptor 49, as instantiated or otherwise activated by monitoring module 28, may issue a command to database server 48 to update the state of the device. If desired, this separate transmission may be the acknowledgment by monitoring module 28 that a state change was made.
  • FIG. 5 is a flowchart of illustrative steps involved in allowing users to remotely monitor and control devices in accordance with an embodiment of the present invention. In this example, the user controls a light switch and watches content automatically captured and published by a video camera.
  • the user contacts web server 46 using Internet browser 26 or remote access device 17.
  • the user may be prompted to verify his or her registration with the system by, for example, entering a user name and password.
  • the user may access a control panel display to control the light switch (or other devices) (steps 506 and 508) .
  • the control panel display may include listings for the devices 32 associated with the user.
  • a user may indicate a desire to control the light switch (e.g., by selecting a listing for the light switch in the control panel display) .
  • a virtual representation of the light switch 41 generated from the template and components for the light switch 41, may be provided to the user (step 510) .
  • the user may manipulate the virtual representation of the light switch (i.e., the display components) to command the user's desired option (e.g., on or off) and remotely change the state of light switch 41 and connected lamp 42 (step 512) .
  • the system may allow the user to change the state of lamp 42 from being "off” to being “on” by manipulating the virtual on/off switch from web server 46.
  • a command for the state change may be placed in queue 51 at step 514.
  • Monitoring module 28 may periodically poll remote site 14 to obtain waiting commands such as the state change command of light switch 41 (step 516) . If there are no commands for monitoring module 28, it will perform no state changes and continue to periodically poll remote site 14 (steps 518 and 520) .
  • monitoring module 28 may retrieve or otherwise receive its commands from queue 51 (step 522) .
  • Monitoring module 28 may communicate the command to the device 32 - in this example changing the state of light switch from off to on and thereby turning on lamp 44 (step 524) .
  • Monitoring module 28 determines whether the command is executed successfully at step 526. If not, monitoring module 28 posts an error message to remote site 14 and remote site 14 may generate a notification in accordance with the user's notification preferences or through any other suitable approach for communicating information to the user (step 528) .
  • an acknowledgment may be sent to remote site 14 (step 530) and the state of the device updated in database 48 (step 532) and indicated to the user on the control panel. The successful execution of a command may have other effects.
  • step 534 For purposes of illustration, assume that turning on lamp 44 triggers camera 34, which previously recorded nothing in the dark, to record and transmit video (step 534) .
  • the newly captured content i.e. video
  • the video may be uploaded to remote site 14 (step 536) and stored for access by the user associated with the device.
  • the video may be posted to a message board on the user's account (step 538) .
  • FIG. 6 is a flowchart of illustrative steps involved in the automatic upload of automatically captured content.
  • contact sensor 40 may be positioned so as to be linked with the front door and configured to trigger whenever the front door is opened.
  • camera 34 may be positioned to view the front door location and may be programmed to capture a digital photograph upon contact sensor 40 being triggered.
  • contact sensor 40 may be monitoring for any triggering activity at the front door. When contact sensor 40 is triggered, for example by the opening of the front door, camera 34 may be instructed to take a digital photograph of the triggering event in step 604.
  • the image content may then be transmitted, in step 606, over communications network 16, via monitoring module 28, and stored in database server 48, located at remote location 14, awaiting publication instructions.
  • the triggering event may be linked with a notification.
  • a notification procedure may be activated and the user may be informed, in addition to the publication on his or her account, of the event occurrence (steps 608 and 610) .
  • the registered user may be informed of an event through pager 43, via cellular transmitter 44.
  • the user receiving a notification may access his account to acquire additional information concerning the triggering event. If sensor 40 has not been triggered then sensor 40 maintains its current monitoring state (step 614) .
  • FIG. 7 is a more generalized flowchart of steps involved in allowing users to access content published to a user account.
  • the user accesses a web page using a web browser.
  • the page may be a login page, or a home page after which a login page is displayed (step 704), and the user logs in by entering his or her user name and password (step 706) . If the user name and password are incorrect, the login procedure restarts (step 708) . Otherwise, the user enters his or her account (step 710) and may be presented a message board display if there are waiting messages or other notifications (step 712) .
  • An illustrative message board display is shown in, for example, FIG. 12.
  • the messages may include event information, such as event names, that indicate to the user what events have occurred that caused the publication of new content (step 714) .
  • the user may select a desired event to access the content captured for that event, or additional information associated with the event (step 716) .
  • the user may also delete the event, relocate the event to another area of his or her account, or perform any other suitable action (step 718) .
  • FIG. 8 is a generalized flowchart of illustrative steps involved in capturing content and publishing it with a user associated account.
  • content is captured locally for an event.
  • the content may be any suitable content such as, for example, video, audio, pictures, data, or any other suitable content.
  • the content may be captured by any suitable capture device, such as a video or still camera, microphone, thermometer, scanner, fax, rain gauge, or any other suitable device or appliance for capturing content.
  • the content may be captured continuously, periodically, or in response to a user indication.
  • Content may be captured automatically in response to the detection of an event at step 805.
  • Metadata may include information about the content, the device that captured the content, the user associated with the capture device, or any other suitable information.
  • the metadata may include templates and components for generating a user interface for remote control and monitoring of the device.
  • the content and, if provided, the metadata are automatically transmitted to a remote computer such as web server 46, database server 48, or another suitable remote computer.
  • the remote computer automatically publishes the content for user access.
  • the content may be published based on metadata (step 825) .
  • the metadata may include information regarding the type of content (i.e., whether the content is a picture, video, text, etc.).
  • the remote computer may publish the content accordingly.
  • Still pictures may be stored, for example, as .tif files and presented as thumbnail or full-size displays.
  • Video may be stored, for example, as .mpg files and presenting the video may cause the user's access device (e.g., client access device 22 or remote user access device 17) to launch a suitable player.
  • Video may also be streamed when provided in real time.
  • Metadata may include information about the capture device.
  • the metadata may include a user-defined device name for the capture device.
  • the user display e.g., web page
  • Metadata may include user information.
  • the user information may indicate the user account to which the content is published. If applicable, the content may be published to one or more user accounts.
  • Metadata may include information about the virtual interface that will represent the capture device.
  • the metadata may include the templates or components for the capture device.
  • Metadata may include event information.
  • the event information may include an event name and time.
  • Event information may be published with the content so that the user knows what type of event occurred and when it happened.
  • the remote computer may determine what type of notification to provide the user based on the event information. This list is only illustrative, as the metadata may include any other suitable information associated with the content.
  • FIG. 9 shows an illustrative account login display 900 that may be provided when the user attempts to access his or her account.
  • the user may access his or her account from a client access device 22 or a remote access device 17.
  • system 10 may allow a user to use browser 26 to access a registered account at remote site 14. Before a user is given access they may be prompted to verify their registration with remote site 14 by entering username 902 and password 904.
  • FIG. 10 shows an illustrative control panel display 1000 that may be provided to allow the user to control devices 32 located at an installation 12 and it may also permit the user to establish device settings.
  • the user may access control panel 1000 that displays registered devices 32 at installation 12 to command light switch 41 (e.g., step 506 and 508 in FIG. 5).
  • a virtual representation of light switch 41 may be made available to the user in control panel 1000 through the selection of device listing 1002 (e.g., step 510 in FIG. 5).
  • a user may assign notifications to particular events.
  • FIG. 4b a user may assign notifications to particular events.
  • FIG. 11 shows an illustrative control panel display 1100 that may be provided to allow the user to set up notification instructions for specific events.
  • the user may select an "edit action" button 1104 for that event.
  • an event occurs the user will be notified in accordance with the notification instructions assigned to the event.
  • the user may be notified through paging device 43, electronic mail (e-mail) , or using any other suitable approach. For example, using the example demonstrated in step 612 of FIG. 6, the user may be notified through paging device 43, when his or her front door sensor is triggered (assuming that the user has assigned a notification instruction with that specific event) .
  • FIGS. 12-19 are illustrative displays for providing users with access to remote devices and captured content in accordance with one embodiment of the present invention. In practice, any suitable display and combination of passive and active user interface features may be used. In some embodiments, the displays of FIGS. 12-19 may be incorporated into web pages accessible by a browser. In such embodiments, the browser may supplement the displays with browser elements such as, for example, toolbars. FIG.
  • Message board 1200 may display event information, which may consist of, but is not limited to, a photo thumbnail 1202, date and time of event occurrence 1204, the device source 1206 the event was captured on, and a title 1208 that may have been issued in reference to the event.
  • Event titles may be user configurable. By selecting a particular event information feature the user may acquire additional information. For example, if the user selects photo thumbnail 1202 a video clip may be played back to the user of the event that triggered the upload of content.
  • FIG. 13 shows an illustrative display 1300 that may provide the user with various account options. Display 1300 provides access to control panel 1000 (discussed in FIGS. 10 and 11), message board 1200 (discussed in FIG. 12) , and additional features such as, for example, a groups feature 1302 and a "shoeboxes" feature 1304. [0109] Groups feature 1302 may allow the user an ability to share access with other parties of interest.
  • the user may want to share captured content with another registered user.
  • groups feature 1302 the user may transfer data, upload data, send a message, start a chat session, or any other applicable actions.
  • the "shoeboxes" feature 1304 may allow the user to maintain and organize collected photos, events data (i.e., captured content), or any other applicable data that the user may want to incorporate into his or her account.
  • FIG. 14 and 15 show illustrative displays 1400 and 1500 for providing a monitoring menu and detection menu, respectively, on client device 22 within installation 12.
  • "Home Control” application software may allow the user to monitor and control devices, run set-up options, and provide a link to the user's account at remote site 14.
  • "home control” software may consist of a plurality of views and menu options .
  • monitoring menu 1400 which may incorporate options such as, for example, local activity monitor 1402 for monitoring a selected device on video/image display 1404, a device menu 1406 for selecting a plurality of different devices, setup menu 1408, log menu 1410 for viewing a record of events, help menu 1412, and link menu 1414 that may provide access (e.g., through the use of a browser) . to remote site 14.
  • monitoring menu 1400 may also include system status monitor 1416.
  • System status monitor 1416 may inform the user of current uploads to remote site 14. For example, the user may capture an image or collect video feed by selecting a device from device menu 1406 and utilizing the capture buttons 1418 or 1420.
  • FIG. 15 shows illustrative detection menu 1500.
  • Detection menu 1500 may indicate detected local capture devices 32 and captured content. The content may have been stored locally in a temporary gallery on client access device 22.
  • "get video feed” buttons 1502 may be used to activate any of the detected devices 32.
  • monitoring menu 1400 may be displayed (as discussed above) to provide the user with a video display and allows the user control of that device 32.
  • monitoring menu 1400 may be displayed and the user may use capture buttons 1418 or 1420 to collect content.
  • the captured content may be stored in an temporary gallery for evaluation at a later time. If the user wishes to access the temporary gallery the user may utilize "get pictures" button 1504.
  • an illustrative display as shown in FIG. 16, may provide the user with photo gallery menu 1600.
  • Photo gallery menu 1600 may display collected image clips 1602. The user may use this menu to perform selected features such as, for example, save images 1604 locally on client device 22, delete images 1606 from the gallery, transfer images 1608 to the user's registered account on remote site 14, or perform any other applicable actions.
  • FIG. 17 shows another illustrative photo ⁇ gallery display 1600 that demonstrates upload menu 1700 which provides a user the ability to upload collected image clips to his or her account at remote site 14.
  • the upload menu 1700 may be provided.
  • the user may select specific image clips 1602 from any picture gallery using, for example, "shoebox" menu 1704 in FIG. 18. Once the user has selected which image gallery and which images he would like to upload to his or her account, the user may use the upload button 1702 to connect to remote site 14. When remote site 14 is contacted, the user's account is opened

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Computer Hardware Design (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Mining & Analysis (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

Systems (10) and methods for automatically capturing, uploading, and publishing content. The system (10) may include one or more monitoring modules (28) for providing captured content to a remote site (14).

Description

AUTOMATED UPLOAD OF CONTENT BASED ON CAPTURED EVENT
Cross Reference To Related Applications
[0001] This application claims the benefit of Rezvani et al . United States provisional patent application Serial No. 60/230,305, filed September 6, 2000, and Rezvani et al. United States provisional patent application Serial No. 60/247,183, filed November 10, 2000, which are hereby incorporated by reference herein in their entirety.
Background of the Invention [0002] This invention relates to systems and methods for uploading captured content to a remote site. More particularly, this invention relates to systems and methods for capturing content in response to events and publishing the content at a remote site where it is accessible through a registered user account.
[0003] Systems exist for allowing users to capture content and provide it to a remote system. For example, it is common today for people to take pictures with digital cameras and provide the pictures to their friends via e-mail. Even this common operation can prove difficult to some users because of the complexity of the steps involved. For example, users first take a picture with a digital camera. The user must then upload the picture to their personal computer in a particular media format, launch an e-mail program, and generate a message with the intended recipient's correct address. The user then must locate the file, attach it to the e-mail, and send the e-mail. [0004] Other schemes for providing locally captured content to a remote system can involve additional steps and complexity. Take for example, an approach for allowing people to post pictures or other locally- captured content to a web site. After a user e-mails a picture to the web site, a system administrator opens the email, accesses the attached media, performs any required formatting of the media in order to comply with the display environment of the web site, and the media may then be published to the web site. After the content is published to the web site, users may access the publicly accessible content using a web browser. [0005] Approaches may become even more cumbersome to users when, for example, content is captured for users independent of their activity. Thus, it may be desirable to automate, and perhaps simplify, the capturing and publishing of content. [0006] Whether or not automated, it may be desirable to publish locally captured content for remote access in other situations. For example, some modems allow users to set up voice-mail boxes for recording incoming messages. The messages are recorded in response to events (i.e., incoming calls). Users must, however, call into the voice-mail boxes to retrieve their messages. When the line is busy or when a failure occurs, such as when a user's personal computer loses power, the user cannot access his or her messages. Thus, for reliability, accessibility, or other reasons, it may be desirable to provide systems and methods for publishing content, which may be captured automatically or in response to user activity, on a remote system for access by the user. [0007] It is therefore an object of the present invention to provide systems and methods for capturing content and publishing the content on a remote system. The capturing of the content, publishing of the content, or both, may be automated.
Summary of the Invention
[0008] This and other objects of the invention are accomplished in accordance with the principles of the present invention by providing systems and methods for automatically capturing content, uploading the content to a remote site, associating the content with a user, and publishing content for access by a user. Various features in accordance with some embodiments of the present invention are described, for example in Rezvani et al . United States provisional patent application
Serial No. 06/247,183, filed November 10, 2000, which is hereby incorporated by reference herein in its entirety.
[0009] The present invention may provide users with opportunities to access content published on one or more remote sites, such as one or more web servers, X windows servers, or other remote computes suitable for providing access to captured content. The published content may have been captured by one or more devices associated with the user's client system. The client system may include one or more monitoring modules that include processes for obtaining content from the devices. The devices may capture content in accordance with user commands, or may be triggered to capture content in response to events. For example, sensors may sense environmental conditions and trigger associated devices to capture content. In other suitable approaches, the devices may capture content continuously or periodically.
[0010] In some embodiments of the present invention, uploaded content may be published and associated with one or more user accounts, thereby establishing an affinity between the users associated with the account and the client system, monitoring module, or capture device. For example, the uploaded content may be associated with a single user account of a particular user. That user may give other users access to his or her account. In another suitable approach, content may be published to the accounts of multiple users for each user's access. Any other suitable approach may be used. In some embodiments of the present invention, content may be captured and uploaded to the remote site without using persistent storage in the client system. For example, content may be captured by a device, directly uploaded by the client system to the remote system, published using a web page script, and then stored for user access. In some embodiments, content may be persistently stored as the exclusive way of capturing and transmitting content. Still other embodiments may capture and automatically transmit content without persistently storing the content, and persistently store the content as a backup in case of a transmission failure. [0011] Content may be wrapped with metadata that instructs the remote site how and what to do with the captured content. The metadata may also include an indication of a user, the device that captured the data, an associated monitoring module, or any other aspect of the client system. The remote system may associate the captured content with the user or the user's account based on the metadata.
Brief Description of the Drawings [0012] Further features of the invention, its nature, and various advantages will be more apparent from the accompanying drawings and the following detailed description of the preferred embodiments: [0013] FIG. 1 is an illustrative schematic block diagram of an upload system architecture in accordance with an embodiment of the present invention. [0014] FIG. 2 is a schematic block diagram of the components of the illustrative upload system of FIG. 1 in accordance with an embodiment of the present invention.
[0015] FIG. 3 is a schematic block diagram of the components of the illustrative upload system of FIG. 1 in accordance with an embodiment of the present invention. [0016] FIGS. 4a and 4b are flowcharts of illustrative steps involved in capturing, uploading, and publishing event data in accordance with an embodiment of the present invention. [0017] FIG. 5 is a flowchart of illustrative steps involved in executing commands to registered devices from a remote location in accordance with an embodiment of the present invention.
[0018] FIG. 6 is a flow chart of illustrative steps involved in the automatic upload of automatically captured content in accordance with an embodiment of the present invention.
[0019] FIG. 7 is a flowchart of illustrative steps involved in allowing users to access content published to a user account in accordance with an embodiment of the present invention.
[0020] FIG. 8 is a flowchart of illustrative steps involved in capturing content and publishing it with a user associated account in accordance with an embodiment of the present invention.
[0021] FIG. 9 shows an illustrative display screen for allowing a user to log into a registered account in accordance with an embodiment of the present invention. [0022] FIG. 10 shows an illustrative display screen for allowing a user to access a control panel listing registered devices in accordance with an embodiment of the present invention.
[0023] FIG. 11 shows an illustrative display screen for allowing a user to access a control panel for setting notifications in accordance with an embodiment of the present invention.
[0024] FIG. 12 shows an illustrative display screen for allowing a user to access a message board to view events in accordance with an embodiment of the present invention.
[0025] FIG. 13 shows an illustrative display of user options in accordance with an embodiment of the present invention. [0026] FIG. 14 shows an illustrative display for providing a user with an opportunity to locally capture content in accordance with an embodiment of the present invention.
[0027] FIG. 15 shows an illustrative display for indicating detected devices in accordance with an embodiment of the present invention.
[0028] FIG. 16-18 show illustrative image gallery displays of content in accordance with an embodiment of the present invention. [0029] FIG. 19 shows an illustrative display for providing users with access to uploaded content in accordance with an embodiment of the present invention.
Detailed Description of the Preferred Embodiments [0030] FIG. 1 shows an illustrative system 10 in accordance with the present invention. For purposes of clarity, and not by way of limitation, an illustrative client-server based embodiment of the present invention is herein described, but any suitable peer-to-peer or other distributed approach may be used. System 10 may include an installation 12 and a remote site 14 that may be linked via a communications network 16. In practice, there may be more than one remote site 14 and installation 12, but only one each is shown to avoid over-complicating the drawing. Remote site 14 may be any suitable remote site that may include equipment such as, for example, one or more servers, mainframes, personal computers, or any other suitable computer- based equipment. Remote site 14 may include a network of suitable computers that may be interconnected in any suitable way, such as, for example, through a local area network, wide area network, telephone network, cable television network, Intranet, Internet, or any other suitable wired or wireless communications network.
[0031] Communications network 16 may be any suitable communications network, such as, for example, a local area network, wide area network, telephone network, cable television network, Intranet, Internet, or any other suitable wired or wireless communications network. Some suitable wireless communications networks may be global system for mobile communications (GSM) , time-division multiple access (TDMA) , code- division multiple access (CDMA) , Bluetooth, or any other suitable wireless communication networks. Installation 12 and remote site 14 may communicate over communications network 16 using any suitable protocol or protocol stack. For example, installation 12 and remote site 14 may communicate via a transmission control protocol/Internet protocol (TCP/IP) environment using, for example, IP version 4 or IP version 6 (that supports 128-bit network addressing) and a hypertext transfer protocol (HTTP) . In another approach, universal plug and play (UPnP) technology may be used to allow communication between installation 12 and remote site 14. Any suitable request-response type of protocol and socket-based packet transport stack, or suitable peer-to-peer communications approach may be used as desired.
[0032] Installation 12 and remote site 14 may communicate using any suitable communications. Communications may include, for example, commands, requests, messages, remote procedure calls (e.g., using a proxy-stub pair) , or any other suitable client-server or peer-to-peer communication. Communications may also involve, for example, complex communications between application constructs running on installation 12 and ' remote site 14. Objects running on the client and server may, for example, communicate using an Object Request Broker (ORB) . Transmitted information may, for example, be encapsulated as COM objects or Javabeans and persisted to files that are transmitted over a remote access link. In another suitable approach, access communications may include hypertext markup language (HTML) formatted markup language documents (e.g., web pages), that are exchanged between installation 12 and remote site 14 via ISP 23 and communications link 16. For example, communications may consist of a series of HTTP posts and responses in which the parameters for the transmissions may be sent as name/value pairs in the normal post method. In order to achieve the result of transmitting multiple commands in a single command string, numbered commands may be parsed out and executed at remote site 14. Remote site 14 may be .responsible for parsing the command string into individual commands and executing each of. those commands. To parse the commands, remote site 14 may, for example, utilize a script language and interpreter such as Personal Home Page Tools (PHP) which is embedded within a Web page along with its Hypertext Markup Language (HTML) . For example, before a page is sent to the requesting user, the Web server may call PHP to interpret and perform the operations called for. Other similar technologies may also be utilized such as JavaScript, Microsoft's VBScript, or any other applicable script interpreter. If desired, any other suitable client-server or peer-to-peer based approach may be used.
[0033] Installation 12 may be operated by a local user. Installation 12 may include one or more nodes. For purposes of illustration, FIG. 1 illustrates an approach having two nodes, first user node 18 and second user node 20. It should be understood that nodes 18 and 20 may be located at a single location, such as the user's main residence. If desired, nodes may be located across more than one location. For example, one node may be in a user's main residence and another at the user's vacation house. If desired, nodes of an installation may be associated with more than one user account. [0034] In one embodiment of the present invention, user node 18 may include a client device 22 that may be connected to communications network 16. In Internet- based approaches, such as, for example, in the embodiment shown in FIG. 1, client device 22 may be connected to the Internet via an Internet service provider (ISP) 23. Client device 22 may be any device suitable for communicating with remote site 14 via communications network 16. For example, client device 22 may be a computer, a personal digital assistant
(PDA) , a terminal, a set-top box, or any other suitable device that provides access to remote site 14 via communications network 16. Client device 22 may include, for example, an Internet browser application 26 that may be used to access web pages via communications network 16. In other suitable approaches, client device 22 may run a client application that provides locally generated displays propagated with a format obtained using any suitable client-server or peer-to-peer scheme.
[0035] Client device 22 may communicate with ISP 23 or directly with communications network 16 using any suitable communications link. For example, the link may include a telephone dial-up link, digital subscriber line .(DSL), a cable modem link (e.g., a data over cable service interface specification (DOCSIS) link), a satellite link, a computer network link (e.g., Ethernet link, Tl line, etc.) or any other suitable communications link or combination of communications links.
[0036] Remote site 14 may include one or more servers such as, for example, web server 46 and database server 48. Database server 48 may maintain database 58. In other suitable approaches, such as non-Internet based approaches, remote site 14 may include an application server and any other suitable server or combination of servers. As herein used, the term "server" is not limited to a distinct piece of computing hardware or storage hardware, but may also be a software application or a combination of hardware and software. For example, one computer may have software that enables the computer to act as both a web server and as a database server. [0037] In some suitable approaches, remote site 14 may provide displays or display definitions to client device 22. In the Internet-based approach of FIG. 1, for example, web server 46 may generate static and dynamic web pages from data supplied by database server 48. Web page 47 may be viewed by a user using Internet browser 26 running on client device 22. [0038] Software applications interfacing installation 12 with remote site 14 may be created using any suitable platform and/or software development tools. For example, Java 2 Enterprise Edition, Javabeans, component object model (COM) based technologies (e.g., ActiveX, object linking and embedding (OLE), etc.), Javascript, Visual Basic, C, C++, scripting languages, or any combination of these or other suitable development tools may be used in creating the software interface between installation 12 and remote site 14 (e.g., web-page interface). Any combination of these or other suitable development tools may be used in preparing any other software modules or applications for use in any other suitable facet of the present invention.
[0039] Remote site 14 may function as the master controller of the system shown in system 10. In addition, users may access the system shown in system 10 via any computer, monitoring module, or remote user access device linked to communications network 16. Remote user access devices (such as remote user access device 17 in FIG. 1) may include, for example, personal digital assistants, cellular telephones, set-top boxes, personal computers, or any other suitable device a user may use to access remote site 14 via communications network 14. [0040] Monitoring modules 28 may serve as an interface between remote site 14 and at least one connected device 32. Monitoring modules 28 may be any suitable hardware, software, or a combination thereof and may be included at any point within the system. For example, monitoring module 28 may be a software application running on client device 22 or a separate piece of hardware that may be connected to client device 22 (as shown at node 18) or partially implemented as software on client device 22 and a separate piece of hardware. In some embodiments, monitoring module 28 may be a stand-alone appliance (as shown at node 20) connected to communications network 16, operating separately and independently from client device 22. Each monitoring module may be shipped with a model identification code, or with the capacity to generate such a code, that may serve to identify each particular monitoring module's model type. [0041] One or more monitoring modules may be installed at one or more locations. Monitoring modules may be installed by the user (or any other suitable person) by, for example, connecting the modules to client device 22 that may communicate with remote site 14 over communications network 16. The connection between the monitoring module and the client access device and between devices and the monitoring module may be in the form of a universal serial bus (USB) connection, parallel port connection, serial connection (e.g., RS-232), Firewire connection, any combination of these, or any other suitable type of connection. If desired, monitoring modules may be given the capability (e.g., processing hardware, communications equipment, etc.) to communicate, via communications network 16, without the use of a client access device. Monitoring modules may link attached devices or appliances (e.g., sensors, cameras, microwaves, refrigerators, etc.) with remote site 14 via communications network 16. One or more monitoring modules 28 may provide data from attached devices and appliances to remote site 14 via communications network 16. The term "device," as defined herein, shall include any suitable device or appliance.
[0042] At least one device 32 may be interfaced with and controlled by each monitoring module 28. Connections between monitoring module 28 and the various devices 32 may be hardwired or wireless (e.g., using Bluetooth technology) . Devices 32 may encompass any suitable device capable of being controlled or mediated by an external controller. Such devices may include, but are not limited to, a camera 34, a radio 36, a smoke or fire detector 38, a contact sensor 40, and a light switch 41. Although not illustrated, other suitable devices may include, for example, various audio input and output devices, infrared devices and sensors, various visual displays, washers/driers, microwave ovens, cooking ranges, car alarms, plant watering devices, sprinklers, thermostats, carbon monoxide sensors, humidity sensors, water emersion sensors, radon sensors, temperature sensors, audio sensors, radiation sensors, rain gauges, video cassette recorders, radio tuners, or any other suitable device and the like.
[0043] Monitoring modules may register themselves, devices, or installations with remote site 14. Illustrative systems and methods for auto-registering devices with remote sites are described, for example, in Rezvani et al. United States patent application Serial No. 09/709,688, filed November 10, 2000, which is hereby incorporated by reference herein in its entirety.
[0044] One or more notification devices, such as pager 43, may also be incorporated into the system. As illustrated in FIG. 1, pager 43 is in wireless communication with a wireless or cellular transmitter 44 associated with remote site 14. Other suitable notification devices include, for example, e-mail clients, wireless hand-held computers, wireless wearable computer units, automatic web notification via dynamic web content, telephone clients, voice mail clients, cellular telephones, instant messaging clients, and the like.
[0045] System 10 provides users with opportunities to remotely control and monitor devices 32 using remote user access devices 17 via communications network 16. In the example of FIG. 1, users may control devices 32 that are interfaced with monitoring modules 28 at node 18 and devices 32 interfaced with monitoring module 28 at node 20. In practice, there may be a single node, or more nodes, depending on, for example, the user's equipment, number of sites, or other suitable parameters. In practice, a suitable system architecture and communications network 16 may allow users, or anyone that users permit, to readily monitor and control monitoring modules 28 from any location using any suitable device that is capable of communicating with remote site 14 via communications network 16.
[0046] In another suitable approach, users may access installation 12 using remote user access devices 17 without the use of remote site 14. For example, remote user access devices 17 may be used to communicate with monitoring modules 28 of installation 12 via communication network 16 and ISP 23. If desired, two-way communications may be implemented using this approach. Remote user access device may access installation 12 using, for example, special IP addresses assigned to a particular monitoring module, node, installation, or any other suitable element of the installation. The use of IP addresses is merely illustrative. Any other suitable addressing may be used to allow access to an installation from a remote used access device. [0047] Devices 32 may be programmed at the installation in terms of how they respond to certain events (e.g., what does the camera do when the contact sensor is triggered?) . Alternatively, devices 32 may be programmed from a remote location using remote user access device 17, for example. The programming may be stored in devices 32, monitoring modules 28, or at remote site 14.
[0048] The following examples of the uses of illustrative devices will illustrate the operation of the present invention. For example, contact sensor 40 of FIG. 1 may be associated with the front door (not shown) of a remote location associated with second node 20. Contact sensor 40 may be configured to trip whenever the front door is opened. Camera 34 is also positioned to view the front door location and may be programmed to take a digital picture whenever the sensor contact 40 is tripped. This picture may be transmitted over communications network 16 and stored in database server 48. When contact sensor 40 detects that the front door has been opened, an event notification or alarm trigger may be transmitted by monitoring module 28 to database server 48. Database server 48 may have been previously programmed to transmit a notification event to the user's pager, for example, via cellular transmitter 44. As the contact sensor is tripped, camera 34 may take a picture of the front door and may transmit that picture, via monitoring module 28 and communications network 16, to database server 48. The user, having been notified via pager 42, may now access the picture using web server 46 of remote site 14 via Internet browser 26. In this way, the user may determine who has entered the front door of his or her home. [0049] As another example, system 10 may allow a user located at one node 18 a remote site to control a device at a second node 20. The user may contact web server 46 via, for example, Internet browser 26 of node 18 in order to access a database entry for light switch 41 of node 20. A virtual representation of the light switch 41 may be made available to the user by web server 46 and may be manipulated by the user to remotely change the state of light switch 41 and the connected lamp 42. For example, the system may allow the user to change the state of lamp 42 from being "off" to being "on" by, for example, manipulating the virtual light switch from web server 46 and a corresponding command would be placed in the queue of waiting commands on the server component. [0050] Periodically, the controlling module or monitor 28 may poll remote site 14 looking for waiting commands, such as the change state command of light switch 41. Thereafter, the command may be transmitted to monitoring module 28 that would instruct the light switch to change from the "off" state to the "on" state, thus turning on lamp 46. This change in state of lamp 46 may be viewed by an appropriately positioned camera, such as camera 34, which would be used to visually monitor the remote location 20 to determine whether the command had been completed successfully. If the command had not been successfully completed, then an error message may be communicated to the user, using for example, the means specified by the user's notification preferences or through any other suitable means of communicating information to the user. [0051] Referring now to FIG. 2, monitoring module 28 may serve, for example, as a common connection point for one or more devices 32 at an installation 12 and as the interface between devices 32 and remote site 14 via communications network 16. Monitoring module 28 may, for example, serve as a translation and brokering agent between remote site 14 and devices 32. [0052] In one suitable embodiment, monitoring module 28 may be software made up of multiple dynamically loaded objects, or device descriptors 49, that may allow remote site 14 to interface with the devices 32. The dynamically loaded device descriptors 49 may act as device drivers for devices 32, translating, in both directions, monitoring, command, and control data (i.e., via monitoring module 28) exchanged between devices 32 and remote site 14 via communications network 16. Each device descriptor 49 may also translate the signals received from monitoring module 28 into the specific electrical signals that are required to communicate with (both input and output) and control its associated device 32. Device descriptor 49 may be provided for each specific device 32 when, for example, different devices 32 have different interfaces and require specific sets of electrical signals for their monitor and control. [0053] Device descriptors 49 may include, for example, a manufacturer identification, product identification, and driver version number to allow a device to be referenced correctly. Once a new device 32 has been detected and is to be integrated into the system, monitoring module 28 may reference, download, and run the appropriate drivers for the new device. [0054] After loading a new descriptor 49, monitoring module 28 may communicate with remote site 14 to determine whether the new device 32 has been previously catalogued. Monitoring module 28 may, for example, determine if a general description and a default state of device 32 exists at the remote site. When a device 32 has been catalogued then, for example, the default state and general parameters of device 32 may be stored at remote site 14. A catalogued device 32 may eliminate the need to resend the general parameters and default state and monitoring module 28 may just communicate the instance-specific parameters. When a device 32 is not already catalogued, monitoring module 28 may communicate its default state and static parameters directly to remote site 14. The communication from monitoring module 28 to remote site 14 may be done using name/value pairs using, for example, the normal HTTP post method discussed hereinbefore. For example, a template document may be a static parameter of device 32. [0055] A template is a layout document which can specify how components, actions, and indicators are to be laid out on the user's end display (e.g., user's web page 47 at remote site 14) . The template may exist anywhere on the system as either a static or dynamic parameter. For example, templates incorporating static parameters may exist as a static parameter inside the hardware of device 32, as a static parameter within the driver and setup during registration procedures, may be hard-coded into a remote server, or may be communicated through monitoring module 28 via the device drivers and stored on the user's account. Any other suitable approach may be used. [0056] Templates utilizing dynamic parameters may, for example, allow updates to be sent to the template while the driver and .device are in an execution state. Furthermore, when incorporating dynamic parameters, templates may be downloaded from a remote location (e.g., from the manufacturer's server) . The ability to download templates from the device manufacturer may permit the manufacturer to incorporate desired changes and/or new aspects in the device template. [0057] FIG. 3 further illustrates the relationship between devices, monitoring modules, and remote database server 48. FIG. 3 shows five devices, 32,
32a, 32b, 32c, 32d. In practice, there may be more or fewer devices within each installation. Each device may be interfaced to a monitoring module 28 via a device descriptor or driver 49 (only one shown) . Each device may include a customizable user interface 58 that may be viewable on remote user access device 17 over communications network 16. Interfaces 58 may include virtual representations of the actual user interfaces of the devices. [0058] In some embodiments, virtual representations may be stored on, for example, web server 46. Remote site 14 may use changes in device states to change the virtual representations of the devices with which the changed states are associated. A virtual representation of a device, as previously described, may be either a text-based, symbol-based, or image- based representation of an actual device 32 from the installation as it appears to a user who accesses the remote site from a location remote to the installation using any suitable remote user access device. For example, if the device is a light switch, the corresponding virtual representation may be an indicator icon that may be either green or red. If the indicator icon is green, that may denote that the actual light switch is in the "on" position. If the indicator is red, that may denote that the light switch ' is in the "off" position. If, during a heartbeat operation, remote site 14 is informed that the state of the light switch changes from "on" to "off, " then the virtual representation of the light switch may change from being green to being red.
[0059] User interface 58 may include at least one resource. In the example of FIG. 3, resources 60, 62, and 64 are shown. Resources may provide users with access to features specific to their associated device. For example, the device shown in FIG. 3 represents a videocassette recorder (VCR) having a recording setting resource 60, a channel selecting resource 62, and a power selecting resource 64. Typical VCRs may have other operational resources, but the resources illustrated in FIG. 3 are sufficient to illustrate the operation of the device. [0060] Each resource 60, 62, 64 may include one or more display components. For example, the recording setting resource 60 includes a display component 70 and a series of pushbuttons 72, 74, 76, 78 which a user may use to activate the VCR's reverse, fast forward, stop, and play functions, respectively. The channel selecting resource 62 may include a pair of pushbuttons 82 and 83 that users may use, respectively, to activate up channel and down channel functions of the VCR. The power selecting resource 64 may include a toggle switch 80 that users may use to activate the VCR's power on and power off commands, and an LED indicator 81 that may indicate the power condition of the VCR. [0061] Other suitable display components may include toggle buttons, radio buttons, absolute sliders, proportional sliders, edit fields, labels, images, video clips, streaming video, streaming audio, multiselect list, time fields, date fields, or any other suitable display components. Display components may act as status indicators. If desired, display components allow users to toggle settings or otherwise manipulate devices 32. For example toggle buttons may serve as indicators, showing, for example, whether a device is in the "on" position or in the "off" position. Toggle buttons may allow users to change the state of a device, by, for example, turning a device on or off. Sliders may act as indicators by showing, for example, the percentage complete of a particular process a device may be performing (e.g., baking a cake) , and may allow users to change the state of a device (e.g., changing the thermostat temperature). Edit fields may allow users to change textual representations of suitable elements (e.g., naming a television show to be recorded by the show's name) . Video, audio, images, or any other suitable media-based components may act as indicators showing what the devices are sensing (e.g., images may be sensed by cameras, streaming video may be sensed by camcorders, audio clips may be sensed by audio recorders, etc.) . Date and time fields may act as indicators, by, for example, displaying what date and time a VCR is set to start recording. Date and time fields may allow users to set the date and time a VCR may start recording. Multiselect lists may act as indicators by, for example, listing all sound sensors that are detecting noise in the house. Multiselect lists may also be used, for example, to select some of a number of available sensors to turn on. [0062] A virtual representation of each device 32, 32a, 32b, 32c, 32d may be stored as a record 94, 94a, 94b, 94c, 94d in the database of database server 48 of remote site 14. Each record may contain an entry for each resource and its associated components which make up the device. For example, record 94 for VCR device 32 may contain an entry 90, 91, 92 for each resource 60, 62, and 64, respectively, and an entry 90a, 90b, 90c, 90d, 91a, 91b, 92a, and 92b for each component 72, 74, 76, 78, 82, 83, 80, and 81, respectively. In addition, a web page 47 may be generated by web server 46 by extracting the associated record for that device from database server 48 and creating a graphical, textual, tactile, aural, or other suitable user interface representation of that device that the user may access via, for example, Internet browser 26.
[0063] One of the functions that monitoring module 28 may serve is to persist the state of devices 32. This may be done, for example, to allow the real-time states of devices 32 to be stored, to communicate to remote site 14, or to allow for easy recovery from a system crash.
[0064] The stored state of devices 32 may also be used for maintaining a synchronized relationship between an installation 12 and remote site 14. In some embodiments of the present invention, remote site 14 and installation 12 may use polling and heartbeat mechanisms in order to synchronize state information between remote site 14 and installation 12. Polling may refer to a process whereby monitoring module 28 obtains commands from remote site 14. The commands may reside, for example, in command queue 51. Commands may be accumulated at command queue 51 as a result of any suitable action by the user, by remote site 14, or by both. For example, a user may use a remote user access device to issue a command or a request to remote site 14 to cause a change in state of one of devices 32 (e.g., to turn a lamp on) . Remote site 14 may post the change in state command to a command queue 51. [0065] Monitoring module 28 may communicate a request for pending commands to remote site 14. This request may be communicated periodically as part of the polling process. In response to the monitoring module's request, remote site 14 may provide one or more pending commands from command queue 51, and may notify monitoring module 28 of the number of remaining pending commands in command queue 51. Monitoring module 28 may then again communicate a request for pending commands. Remote site 14 may return more of the pending commands from command queue 51. This process may continue until command queue 51 at remote site 14 is empty.
[0066] Remote site 14 may provide commands to monitoring module 28 using any suitable algorithm. For example, remote site 14 may return commands using first-come, first-serve, round robin, first-in, first- out, weighted prioritization, or any other suitable algorithm. Remote site 14 may also proactively inform monitoring module 28 that commands are waiting in queue 51. Monitoring module 28 may then poll remote site 14 and retrieve commands from remote site 14 until the queue is empty. [0067] Commands issued on remote site 14 can be generated by the user while the user is logged on to web page 47 provided by remote site 14. If a user is not logged onto web page 47 then fewer commands are being issued and thus the need to poll remote site 14 is low. Therefore, the frequency of polls may decrease. In addition, a poll frequency setting process may monitor the usage patterns of a user and make anticipatory guesses based on the user's pattern of command generation. For instance, the user may not often be logged on to web page 47 at remote site 14 from the hours of 2 7AM to 7 7AM because the user is sleeping. Therefore, the smart frequency setting process may notice this pattern and automatically decrease the poll frequency at 2 AM and increase it again at 7 AM. [0068] Whereas polling process 50 is used by remote site 14 to effect state changes in devices 32 via monitoring module 28, monitoring module 28 may use heartbeat process 52 to update device state information at remote site 14. A heartbeat may be a periodic communication from monitoring module 28 to remote site 14 containing updated state information for devices 32 associated with monitoring module 28. In one suitable heartbeat process 52, monitoring module 28 may send a communication to remote site 14 in response to a change in state of a device 32, a synchronization of a device 32 with remote site 14, a triggered alert event, or in response to any other suitable event. In such a heartbeat operation 52, all data intended to be transmitted to remote site 14 may be transmitted to remote site 14 via communications network 16. Remote site 14 may transmit an acknowledgment of receipt and successful processing of the data back to monitoring module 28. [0069] Remote site 14 may direct monitoring module 28 to make changes in its own state by, for example, posting commands to data store 51. For example, remote site 14 may post commands that set or modify the polling 50 or heartbeat 52 time intervals. Upon reaching the end of the current polling interval, monitoring module 28 may send a communication to remote site 14 requesting any queued commands. Monitoring module 28 may continue to poll, using a preselected communication scheme, until the queue of commands waiting for monitoring module 28 is empty. Each command received from the queue may be acted upon when the command is received and any associated state changes are effected. Remote site 14 may transmit an acknowledgment of receipt and successful processing of the data back to monitoring module 28.
[0070] If desired, remote site 14 may send unsolicited communications to monitoring module 28. Remote site 14 may send communications to, for example, set or update the heartbeat or polling time, or to cause monitoring module 28 to issue a command to update a component of a device. Remote site 14 may send unsolicited communications to monitoring module 28 for any other suitable purpose. [0071] In addition to maintaining the polling and heartbeat operations and exchanging communications for events, data, and commands 54 with remote site 14, monitoring module 28 may also take care of many network level activities 56. These activities may include, but are not limited to, verifying passwords, dialing up an ISP, if necessary,, periodically uploading accounting/billing information, and performing security measures. Any other suitable network level activities may be performed by monitoring module 28.
[0072] Users may be provided with opportunities to access content published on remote site 14. The published content may have been captured by one or more devices 32. Monitoring modules 28 may obtain content from devices 32. Devices 32 may capture content in accordance with user commands (e.g., user commands generated by a user using client access device 22 or remote access device 17), or may be triggered to capture content in response to events detected by other devices in an installation. In another suitable approach, devices 32 may capture content continuously or periodically.
[0073] In some embodiments of the present invention, uploaded content may be published and associated with a particular user account, thereby establishing an affinity between the user and the user's installation 12, monitoring module 28, or device 32. If desired, the content may be made available to only a user or users associated with the content. In one approach, one or more users may be associated with device 32. Content captured by device 32 may be published to multiple user accounts. A user associated with device 32 may setup, or restrict, to whom content captured by device 32 may be published. In some embodiments of the present invention, content may be captured and uploaded to remote site 14 without using persistent storage in client device 22. For example, content may be captured by a device 32, directly uploaded by client device 22, via monitoring module 28, to remote site 14, published using a web page script, and then stored for user access. In some embodiments, content may also be persistently stored as a back up if, for example, the upload transmission of content by client device 22 fails. In other embodiments, content may be stored persistently and then transmitted.
[0074] Content may be wrapped with metadata that instructs the remote site how and what to do with the captured content. The metadata may include an indication of a user, the device 32 that captured the data, an associated monitoring module 28, or any other aspect of an installation. The remote site 14 may associate the captured content with the user or the user's account based on the metadata. [0075] Sensor device 32 such as smoke sensor 33, contact sensor 40, motion sensor, or other suitable sensor devices 32 may detect environmental occurrences or changes, sometimes referred to herein as events", and trigger capture devices 32 to capture content. Monitoring module 28 may receive the content from the device 32 and upload the content to remote site 14. [0076] Device 32 may capture content continuously with a user defined frequency, over a user defined period, or at a scheduled time. For example, a scheduled time may be set through client device 22 or remote site 14 using remote access device 17. The user may initiate an upload of captured content by instructing device 32, through monitoring module software 28, to upload a captured image. For example, client device 22 may provide the user with a "home control" application in which the user may initiate the capture of an image by selecting a specific device and selecting applicable capture options on the application (this concept will be illustrated in FIG. 12) . Any other suitable approach may also be used. [0077] Client device 22, running monitoring module software 28, may receive captured content and encapsulate it into one or more data objects to upload to remote site 14. Initially, the object may be temporarily placed in the local random access memory (RAM) of client device 22. A socket may be opened from client device 22. The object, or collected content, is copied across the socket to database server 48 at remote site 14. In one suitable approach, the object may be persisted to a stream, transmitted, and reinstantiated at remote site 14. Upon database server 48 receiving data, database server 48 may signal web server 46 to process and publish the captured event to web page 47.
[0078] Monitoring module 28 may use any suitable communications protocol or group of protocols to communicate with remote site 14. The protocol may include for example, series of HTTP posts and responses in which the parameters for the transmissions may be sent as name/value pairs in the normal HTTP post method. Multiple commands may be transmitted using a single command string in which commands are numbered. Commands may be parsed from the string and executed at remote site 14.
[0079] FIGS. 4a, 4b and 5-8 are flowcharts of illustrative steps involved in some embodiments of the present invention. The steps shown in FIGS. 4a, 4b and 5-8 are only illustrative and may be performed in any suitable order. In practice, steps may be added or deleted.
[0080] FIGS. 4a and 4b are flowcharts of illustrative steps involved in capturing, uploading, and publishing content in accordance with one embodiment of the present invention. The steps shown in FIGS. 4a and 4b are only illustrative and may be performed in any suitable order. In particular, suitable steps may be deleted and other suitable steps may be added. At step 402 a sensor device detects an event and triggers a capturing device. The triggered device captures content at step 404 to provide the content to monitoring module 28 at step 406. At step 408, monitoring module 28 stores the content in non- persistent storage such as random access memory (RAM) of client device 22 or monitoring module 28 until a connection is established with remote site 14. At step 410, the temporarily stored content is encapsulated with relevant metadata. Monitoring module 28 then opens a socket, at step 412, to establish a connection with remote site 14 and uploads the captured content to remote site 14, at step 414.
Turning to FIG. 4b, the content may be deciphered at step 420. Deciphering content may include, for example, unwrapping metadata that encapsulates the content. As used herein, metadata is structured data which describes the characteristics of the captured content being transferred ("data about data") . Metadata may allow remote site 14 to determine the type of content being uploaded. For example, remote site 14 may examine the metadata to determine the user, device 32, monitoring module 28, or other elements of the installation associated with the content. The metadata may also be examined, for example, to determine the type of captured content, capturing device, or appropriate virtual interface. [0081] Content wrapped with metadata may instruct the remote site on how the wrapped content may be handled or published. Metadata may also include or be supplemented by other data related to the content. For example, the metadata may identify a user, monitoring module 28, capturing device 32, or other components of the installation 12 in which the content was captured. This identification may establish the affinity between a particular user account and registered device 32 that captured the content, thereby associating captured content with a user account and providing a basis for executing publication schemes. [0082] Metadata may include element names and elements. Elements may describe the contents, location, physical attributes, type (e.g., text, image, video, temperature, etc.), form' (e.g., a document, electronic mail, etc.), or other attributes of the captured content. Metadata elements may include, for example, usernames, identifications (ID) of sender, passwords, device identities, event names (what caused a device to be triggered) , dates and times, and any other suitable data (e.g., data describing content, an associated user, event, or 'component of an installation) .
[0083] All or portions of the metadata may be posted to a designated web page 47 at the remote site 14. Remote site 14 may run a script and interpreter such as Personal Home Page Tools (PHP) , which may be embedded into the Hypertext Markup Language (HTML) code of a web page, that processes data for publishing. The script may store the data at remote site 14 so that it may be accessed through web page 47. For example, content may be processed by first validating the userna e and password associated with a user account and the registered devices. Upon validation, the captured content may be published to (e.g., stored on web server 46 for publication in a web page) the user's account. When the user accesses his or her account, the content may be provided in a display such as a web page. In some embodiments, the metadata may indicate a notification action that is to be performed when the content is published.
[0084] FIG. 4b shows these illustrative metadata elements—identification, content, and event name— which may be translated and executed. More elements may be incorporated within the metadata, but only three elements are shown to avoid over-complicating the example .
[0085] Before content is published on web page 47 in step 414, an association may be made between the registered user and registered device (the unique affinity present between the user and device) . At step 426, a user identification and password element may be deciphered. The affinity between the user and the capturing device 32 is established at step 428. Once verified, an association may be made between the captured event data from device 32 and the user, thus accessing the appropriate account 432 and publishing within the applicable publication environment 434. [0086] A content element may be deciphered at step 422. The element may include a description of the type of content, its format, or the information about the content. For example, the deciphered content element may indicate that the content is electronic mail, a plain-text message, video feed, picture media, or any other applicable content in step 424. The content may be associated with the user determined at step 428 so that the user may access the content through the user's account. At step 432 and 440 the user logs on and accesses his or her user account at step 434 accesses the deciphered content in a publication environment (e.g. , web page).
[0087] Metadata event may include, for example, an event name as shown at step 430. The event name may be deciphered and assigned to a captured event, and assigned an event notification instruction. Some embodiments may determine if notifications are applicable for a particular captured event based on the event name. The appropriate user account may be accessed (step 432) and a reference check may be made within a notifications field to determine if there is a notification associated with the event (step 436) . If a notification is associated with the event occurrence captured, the user may be notified in step 438 via e- mail, paging, or any other suitable approach. If no notifications apply to the event then no action is executed.
[0088] Users may be provided with the ability to remotely monitor and control networked devices 32 via monitoring modules 28. Returning to FIG. 1, users may monitor and control devices 32 via remote site 14 using remote user access device 17, or directly using client access device 22. In some embodiments, users may monitor and control devices 32 via a remote site using client access device 22 and browser 26. Client access device 22, remote user access device 17, or web server 46 may construct a suitable user interface for allowing users to monitor and control devices 32 using any suitable approach. Some embodiments may use one or more templates that layout the look and position of the members of a device 32 (i.e., the features of device 32 accessed or used by a user, such as, for example, controls or displays) .
[0089] Members of device 32 may be defined as physical controls on device 32 such as, for example, a power push-button on a VCR. Device members may correspond to any suitable controls, displays, or combination of like components made available by the virtual interface for device 32. [0090] Components may also correspond to functional elements of device 32. For example, there may not be a button to program a program recording in a VCR of a regularly scheduled media but that functionality may be represented in the virtual interface. Furthermore, components that represent device 32 may be incorporated to correspond to pieces of functionality that may not exist on the device. A button represented on the user interface • through web page 47 that "locks" down a VCR, for example, may not correspond to a physical button on the VCR. The unavailable functionality on the VCR may allow the user to remotely access his or her VCR to lock it for the purpose of protection. Such a component may be created in, for example, the device driver in monitoring software 28. [0091] The templates may reference components that define how the members of devices 32 are presented to and controlled by users. For example, components may be- objects that include methods and data suitable for presenting the members to users. Upon receiving a request or other indication from remote user access device 17 or client access device 22 that a user wishes to monitor or control a device 32, database server 48 or client access device 22 may acquire one or more of these templates and components using any suitable approach. For example, database server 48 or client device 22 may retrieve templates and components from its own storage or from another database server (e.g., from the Internet) , using URLs or other identifiers of the templates or components. In some embodiments, devices 32 may be programmed with the templates and may provide them to client access device 22 or database server 48. [0092] The template may include place holders for components. Components, which may correspond to device members, can be cut and pasted into the template. For example, a push button may be generated on the user interface from the current state of a toggle component in database 58. The push button component may be wrapped with javascript functions to be cut and pasted into the template. When a browser loads the interface (i.e., a template that has its place holders occupied by components), the push button may show up as a push button on the screen and clicking on it has the intended effects associated with the push button (e.g., turning a device on or off) .
[0093] Web server 46 may take the template, locate components designated to device 32 using the components' IDs, and ask the components to generate a suitable user interface representation. Web server 46 may then take the suitable representation and paste it into the template corresponding to the components' IDs.
The filled template may be used by web server 46 to generate a web page 47 suitable for allowing the user to monitor and control a given device. The filled template may include resource and component information that represents the state of a represented device 32. This information may be provided by monitoring module 28 for propagation into the user interface. For example, the state of a light switch, volume of a speaker, or that actual video from a video camera may be provided by monitoring module 28 to client access device 22 or remote site 14 and indicated in web page 47. The user interface may include interactive elements, such as sliders, buttons, etc., that allow the user to control a represented device 32. When the user changes the state of a device 32, the state change may be packaged as a command or other communication. The command may be entered into queue 51. In some embodiments, queue 51 may be an advanced queue that operates as specialized memory. A separate dequeue process may manage retrieving commands from the advanced queue in a non-first-in-first-out (non-FIFO) process for different devices, but in a FIFO process for commands for the same device. In some embodiments, multiple queues may be used for different devices, different users, or using any other suitable approach. Web page 47 (or other display) may indicate to the user that a state change has been submitted and in the process of being executed.
[0094] In some embodiments, database server 48 may not be updated immediately to reflect a change in state for a device made by a user. Instead, monitoring module 28 may receive packaged commands from queue 51 and provide the commands to the appropriate device descriptor 49. Device descriptor 49, as instantiated or otherwise activated by monitoring module 28, may issue a command to database server 48 to update the state of the device. If desired, this separate transmission may be the acknowledgment by monitoring module 28 that a state change was made. [0095] FIG. 5 is a flowchart of illustrative steps involved in allowing users to remotely monitor and control devices in accordance with an embodiment of the present invention. In this example, the user controls a light switch and watches content automatically captured and published by a video camera. At step 502, the user contacts web server 46 using Internet browser 26 or remote access device 17. At step 504, the user may be prompted to verify his or her registration with the system by, for example, entering a user name and password. Once logged in to his or her account, the user may access a control panel display to control the light switch (or other devices) (steps 506 and 508) . The control panel display may include listings for the devices 32 associated with the user. A user may indicate a desire to control the light switch (e.g., by selecting a listing for the light switch in the control panel display) . In response, a virtual representation of the light switch 41, generated from the template and components for the light switch 41, may be provided to the user (step 510) . The user may manipulate the virtual representation of the light switch (i.e., the display components) to command the user's desired option (e.g., on or off) and remotely change the state of light switch 41 and connected lamp 42 (step 512) . For example, the system may allow the user to change the state of lamp 42 from being "off" to being "on" by manipulating the virtual on/off switch from web server 46. In some embodiments, a command for the state change may be placed in queue 51 at step 514. [0096] Monitoring module 28 may periodically poll remote site 14 to obtain waiting commands such as the state change command of light switch 41 (step 516) . If there are no commands for monitoring module 28, it will perform no state changes and continue to periodically poll remote site 14 (steps 518 and 520) . Otherwise, monitoring module 28 may retrieve or otherwise receive its commands from queue 51 (step 522) . Monitoring module 28 may communicate the command to the device 32 - in this example changing the state of light switch from off to on and thereby turning on lamp 44 (step 524) . Monitoring module 28 determines whether the command is executed successfully at step 526. If not, monitoring module 28 posts an error message to remote site 14 and remote site 14 may generate a notification in accordance with the user's notification preferences or through any other suitable approach for communicating information to the user (step 528) . [0097] If the command is executed successfully, an acknowledgment may be sent to remote site 14 (step 530) and the state of the device updated in database 48 (step 532) and indicated to the user on the control panel. The successful execution of a command may have other effects. For purposes of illustration, assume that turning on lamp 44 triggers camera 34, which previously recorded nothing in the dark, to record and transmit video (step 534) . The newly captured content (i.e. video) may be uploaded to remote site 14 (step 536) and stored for access by the user associated with the device. The video may be posted to a message board on the user's account (step 538) .
[0098] FIG. 6 is a flowchart of illustrative steps involved in the automatic upload of automatically captured content. As an example, contact sensor 40 may be positioned so as to be linked with the front door and configured to trigger whenever the front door is opened. In addition to sensor 40, camera 34 may be positioned to view the front door location and may be programmed to capture a digital photograph upon contact sensor 40 being triggered. At step 602, contact sensor 40 may be monitoring for any triggering activity at the front door. When contact sensor 40 is triggered, for example by the opening of the front door, camera 34 may be instructed to take a digital photograph of the triggering event in step 604. The image content may then be transmitted, in step 606, over communications network 16, via monitoring module 28, and stored in database server 48, located at remote location 14, awaiting publication instructions. The triggering event may be linked with a notification. Once the uploaded content is deciphered a notification procedure may be activated and the user may be informed, in addition to the publication on his or her account, of the event occurrence (steps 608 and 610) . The registered user may be informed of an event through pager 43, via cellular transmitter 44. In step 612, the user receiving a notification may access his account to acquire additional information concerning the triggering event. If sensor 40 has not been triggered then sensor 40 maintains its current monitoring state (step 614) .
[0099] FIG. 7 is a more generalized flowchart of steps involved in allowing users to access content published to a user account. At step 702, the user accesses a web page using a web browser. The page may be a login page, or a home page after which a login page is displayed (step 704), and the user logs in by entering his or her user name and password (step 706) . If the user name and password are incorrect, the login procedure restarts (step 708) . Otherwise, the user enters his or her account (step 710) and may be presented a message board display if there are waiting messages or other notifications (step 712) . An illustrative message board display is shown in, for example, FIG. 12. The messages may include event information, such as event names, that indicate to the user what events have occurred that caused the publication of new content (step 714) . The user may select a desired event to access the content captured for that event, or additional information associated with the event (step 716) . The user may also delete the event, relocate the event to another area of his or her account, or perform any other suitable action (step 718) .
[0100] FIG. 8 is a generalized flowchart of illustrative steps involved in capturing content and publishing it with a user associated account. At step 800, content is captured locally for an event. The content may be any suitable content such as, for example, video, audio, pictures, data, or any other suitable content. The content may be captured by any suitable capture device, such as a video or still camera, microphone, thermometer, scanner, fax, rain gauge, or any other suitable device or appliance for capturing content. The content may be captured continuously, periodically, or in response to a user indication. Content may be captured automatically in response to the detection of an event at step 805. Events may be detected by any suitable sensor such as, for example, a motion sensor, photo-detector, heat sensor, thermostat, carbon monoxide detector, contact sensor, or any other suitable sensor or detector. [0101] At step 810, content is encapsulated with metadata. The metadata may include information about the content, the device that captured the content, the user associated with the capture device, or any other suitable information. In some embodiments, the metadata may include templates and components for generating a user interface for remote control and monitoring of the device. At step 815, the content and, if provided, the metadata, are automatically transmitted to a remote computer such as web server 46, database server 48, or another suitable remote computer.
[0102] At step 820, the remote computer automatically publishes the content for user access. The content may be published based on metadata (step 825) . For example, the metadata may include information regarding the type of content (i.e., whether the content is a picture, video, text, etc.). The remote computer may publish the content accordingly. Still pictures may be stored, for example, as .tif files and presented as thumbnail or full-size displays. Video may be stored, for example, as .mpg files and presenting the video may cause the user's access device (e.g., client access device 22 or remote user access device 17) to launch a suitable player. Video may also be streamed when provided in real time. Content information may also include display formats, aspect ratios, keywords, or any other suitable information that describes the content. Metadata may include information about the capture device. For example, the metadata may include a user- defined device name for the capture device. When the content is published, the user display (e.g., web page) may indicate the name of the capture device so that the user knows which device captured the content. Metadata may include user information. For example, the user information may indicate the user account to which the content is published. If applicable, the content may be published to one or more user accounts. Metadata may include information about the virtual interface that will represent the capture device. For example, the metadata may include the templates or components for the capture device. Metadata may include event information. For example, the event information may include an event name and time. Event information may be published with the content so that the user knows what type of event occurred and when it happened. As another example, the remote computer may determine what type of notification to provide the user based on the event information. This list is only illustrative, as the metadata may include any other suitable information associated with the content.
[0103] FIG. 9 shows an illustrative account login display 900 that may be provided when the user attempts to access his or her account. The user may access his or her account from a client access device 22 or a remote access device 17. For example, system 10 may allow a user to use browser 26 to access a registered account at remote site 14. Before a user is given access they may be prompted to verify their registration with remote site 14 by entering username 902 and password 904.
[0104] When the user has successfully logged into his or her account, the user may have access to various features and controls. FIG. 10 shows an illustrative control panel display 1000 that may be provided to allow the user to control devices 32 located at an installation 12 and it may also permit the user to establish device settings. For example, the user may access control panel 1000 that displays registered devices 32 at installation 12 to command light switch 41 (e.g., step 506 and 508 in FIG. 5). A virtual representation of light switch 41 may be made available to the user in control panel 1000 through the selection of device listing 1002 (e.g., step 510 in FIG. 5). [0105] As demonstrated in FIG. 4b, a user may assign notifications to particular events. FIG. 11 shows an illustrative control panel display 1100 that may be provided to allow the user to set up notification instructions for specific events. In order for the user to access notification options for a particular event listing 1102, the user may select an "edit action" button 1104 for that event. When an event occurs the user will be notified in accordance with the notification instructions assigned to the event. The user may be notified through paging device 43, electronic mail (e-mail) , or using any other suitable approach. For example, using the example demonstrated in step 612 of FIG. 6, the user may be notified through paging device 43, when his or her front door sensor is triggered (assuming that the user has assigned a notification instruction with that specific event) . The user may then, if he or she wishes, access his or her account from any browser 26 accessible location to acquire additional information about that particular event occurrence (e.g., video feed from a camera, time of the event, etc.). [0106] FIGS. 12-19 are illustrative displays for providing users with access to remote devices and captured content in accordance with one embodiment of the present invention. In practice, any suitable display and combination of passive and active user interface features may be used. In some embodiments, the displays of FIGS. 12-19 may be incorporated into web pages accessible by a browser. In such embodiments, the browser may supplement the displays with browser elements such as, for example, toolbars. FIG. 12 shows an illustrative message board display 1200 that may be provided to allow the user to view the captured content and its relevant data. Message board 1200 may display event information, which may consist of, but is not limited to, a photo thumbnail 1202, date and time of event occurrence 1204, the device source 1206 the event was captured on, and a title 1208 that may have been issued in reference to the event. Event titles may be user configurable. By selecting a particular event information feature the user may acquire additional information. For example, if the user selects photo thumbnail 1202 a video clip may be played back to the user of the event that triggered the upload of content. [0107] Message board 1200 may also incorporate additional features such as delete button 1210 to remove collected messages on message board 1200, move button 1212 to relocate specific captured content to another part of the user' s account, or any other applicable features that may be useful in viewing content collected on message board 1200. [0108] FIG. 13 shows an illustrative display 1300 that may provide the user with various account options. Display 1300 provides access to control panel 1000 (discussed in FIGS. 10 and 11), message board 1200 (discussed in FIG. 12) , and additional features such as, for example, a groups feature 1302 and a "shoeboxes" feature 1304. [0109] Groups feature 1302 may allow the user an ability to share access with other parties of interest. The user, for example, may want to share captured content with another registered user. Through groups feature 1302, the user may transfer data, upload data, send a message, start a chat session, or any other applicable actions. The "shoeboxes" feature 1304 may allow the user to maintain and organize collected photos, events data (i.e., captured content), or any other applicable data that the user may want to incorporate into his or her account.
[0110] FIG. 14 and 15 show illustrative displays 1400 and 1500 for providing a monitoring menu and detection menu, respectively, on client device 22 within installation 12. "Home Control" application software may allow the user to monitor and control devices, run set-up options, and provide a link to the user's account at remote site 14. Furthermore, "home control" software may consist of a plurality of views and menu options . [0111] ' FIG. 14, shows illustrative monitoring menu 1400 which may incorporate options such as, for example, local activity monitor 1402 for monitoring a selected device on video/image display 1404, a device menu 1406 for selecting a plurality of different devices, setup menu 1408, log menu 1410 for viewing a record of events, help menu 1412, and link menu 1414 that may provide access (e.g., through the use of a browser) . to remote site 14. Furthermore, monitoring menu 1400 may also include system status monitor 1416. System status monitor 1416 may inform the user of current uploads to remote site 14. For example, the user may capture an image or collect video feed by selecting a device from device menu 1406 and utilizing the capture buttons 1418 or 1420. Once device 32 has executed the capturing of content, the user may choose to upload that content to remote site 14. System status monitor 1416 may verify a successful upload. [0112] FIG. 15 shows illustrative detection menu 1500. Detection menu 1500 may indicate detected local capture devices 32 and captured content. The content may have been stored locally in a temporary gallery on client access device 22. For example, "get video feed" buttons 1502 may be used to activate any of the detected devices 32. In response to the user selecting a detected device 32 and its associated "get video feed" button 1502, monitoring menu 1400 may be displayed (as discussed above) to provide the user with a video display and allows the user control of that device 32.
[0113] Once the user has activated a specific device from detection menu 1500, monitoring menu 1400 may be displayed and the user may use capture buttons 1418 or 1420 to collect content. The captured content may be stored in an temporary gallery for evaluation at a later time. If the user wishes to access the temporary gallery the user may utilize "get pictures" button 1504. In response, an illustrative display, as shown in FIG. 16, may provide the user with photo gallery menu 1600. Photo gallery menu 1600 may display collected image clips 1602. The user may use this menu to perform selected features such as, for example, save images 1604 locally on client device 22, delete images 1606 from the gallery, transfer images 1608 to the user's registered account on remote site 14, or perform any other applicable actions.
[0114] FIG. 17 shows another illustrative photo gallery display 1600 that demonstrates upload menu 1700 which provides a user the ability to upload collected image clips to his or her account at remote site 14.
In response to the user selecting transfer button 1608, the upload menu 1700 may be provided. In upload menu 1700, the user may select specific image clips 1602 from any picture gallery using, for example, "shoebox" menu 1704 in FIG. 18. Once the user has selected which image gallery and which images he would like to upload to his or her account, the user may use the upload button 1702 to connect to remote site 14. When remote site 14 is contacted, the user's account is opened
(e.g., through browser 26) and "shoeboxes" feature 1304 may be automatically selected from the user's account to display uploaded image clips 1602. [0115] Thus, systems and methods for the automatic upload of content based on captured events are provided. One skilled in the art will appreciate that the present invention can be practiced by other than the described embodiments, which are presented for purposes of illustration and not of limitation, and the present invention is limited only by the claims which follow.

Claims

What is claimed is:
1. A method for providing remote access to captured content, comprising: locally capturing content for an event using a capture device; automatically transmitting the content from the capture device to a remote computer over a communications network'; automatically associating the content with a user account; automatically publishing the content on a remote server; and providing the content to a user access device of a user associated with the user account.
2. The method defined in claim 1 wherein capturing content comprises capturing content .without persistently storing the content.
3. The method defined in claim 1 wherein: publishing the content further comprises automatically publishing the content to a plurality of user accounts on the remote server; and providing the content further comprises providing the content to user access devices of users associated with the plurality of user accounts.
4. The method defined in claim 1 wherein: the method further comprises detecting the event with a sensor; and locally capturing content comprises automatically capturing the content in response to the detection of the event by the sensor.
5. The method defined in claim 4 wherein the sensor is a motion sensor, a contact sensor, a smoke sensor, a humidity sensor, a water emersion sensor, a radon sensor, a temperature sensor, an audio sensor, a carbon monoxide sensor, an infrared sensor, or a radiation sensor.
6. The method defined in claim 1 wherein the capture device is a video camera, a still camera, a microphone, or a temperature gauge.
7. The method defined in claim 1 wherein: the method further comprises encapsulating the content with metadata, wherein the metadata includes information about the capture device; and publishing the content on the web site comprises publishing the information about the capture device with the content according to the metadata.
8. The method defined in claim 1 wherein: the method further comprises encapsulating the content with metadata, wherein the metadata includes information about the content; and publishing the content on the web site comprises publishing the content according to the information about the content in the metadata.
9. The method defined in claim 8 wherein: the information about the content includes the type of the content; and publishing the content according to the information about the content comprises publishing the ' content according to the type of the content as indicated in the metadata.
10. The method defined in claim 8 wherein the type of content includes picture, video, or text.
11. The method defined in claim 1 wherein: the capture device has an associated virtual interface; the method further comprises encapsulating the content with metadata, wherein the metadata includes information about the virtual interface; and publishing the content on the web site comprises providing the user with access to the content using the virtual interface according to the metadata.
12. The method defined in claim 1 wherein: the method further comprises encapsulating the content with metadata, wherein the metadata includes user information; and automatically associating the content with a user account comprises automatically associating the content with a user account based on the user information.
13. The method defined in claim 1 further comprising: encapsulating the content with metadata, wherein the metadata includes information about the event; and providing an electronic notification to the user, wherein the notification includes the information about the event.
14. A system for providing remote access to captured content comprising: a capture device configured to locally capture content; a remote computer configured to automatically associate the content with a user account and automatically publish the content to a web site; a monitoring module configured to automatically provide the content to the remote computer from the capture device over a communications network; the remote computer configured to automatically publish the content to the remote server; and a user access device configured to provide content of a user associated with the user account.
15. The system defined in claim 14 wherein the capture device captures content without persistently storing the content.
16. The system defined in claim 14 wherein: the remote computer is further configured to automatically publish content to a plurality of user accounts on the remote server; and the user access device is further configured to provide content to users associated with the plurality of user accounts.
17. The system defined in claim 14 wherein: the system further comprises a sensor configured to detect an event; and the capture device is further configured to locally capture the content in response to the detection of the event by the sensor.
18. The system defined in claim 17 wherein the sensor is a motion sensor, a contact sensor, a smoke sensor, a humidity sensor, a water emersion sensor, a radon sensor, a temperature sensor, an audio sensor, a carbon monoxide sensor, an infrared sensor, or a radiation sensor.
19. The system defined in claim 14 wherein the capture device is a video camera, a still camera, a microphone, or a temperature gauge.
20. The system defined in claim 14 wherein: the monitoring module is further configured to encapsulate the content with metadata, wherein the metadata includes information about the capture device; and the remote computer is further configured to publish the content according to the information about the capture device.
21. The system defined in claim 14 wherein: the monitoring module is further configured to encapsulate the content with metadata, wherein the metadata includes information about the content; and the remote computer is further configured to publish the content according to the information about the content.
22. The system defined in claim 21 wherein: the information about the content includes the type of content; and the remote computer is further configured to publish the content according to the type of content.
23. The system defined in claim 21 wherein the type of content includes picture, video, or text.
24. The system defined in claim 14 wherein: the capture device has an associated virtual interface; the monitoring module is further configured to encapsulate the content with metadata, wherein the metadata includes information about the virtual interface; and the remote computer is further configured to publish the content on the web site according to the information about the virtual interface.
25. The system defined in claim 14 wherein: the monitoring module is further configured to encapsulate the content with metadata, wherein the metadata includes information about the user information; and the remote computer is further configured to publish the content according to the user information.
26. The system defined in claim 14 wherein: the monitoring module is further configured to encapsulate the content with metadata, wherein the metadata includes information about the event; and the system further comprises a notification device configured to provide an electronic notification to the user, wherein the notification includes the information about the event.
27. A system for providing remote access to captured content comprising: means for locally capturing content for an event; means for automatically transmitting the content to a remote computer over a communications network; means for automatically associating the content with a user account; means for automatically publishing the content to a remote server; and means for associating a user with the user account.
28. The system defined in claim 27 wherein the means for capturing content without persistently storing the content comprises the capture device.
29. The system defined in claim 27 wherein: the means for automatically publishing the content further comprises means for publishing the content to a plurality of user accounts on the remote server; and the means for providing the content further comprises means for providing the content to user access devices of users associated with the plurality of user accounts.
30. The system defined in claim 27 wherein: the system further comprises means for detecting the event; and the means for locally capturing content comprises means for automatically capturing the content in response to the detection of the event by the means for detecting.
31. The system defined in claim 30 wherein the means for detecting comprises a motion sensor, a contact sensor, a smoke sensor, a humidity sensor, a water emersion sensor, a radon sensor, a temperature sensor, an audio sensor, a carbon monoxide sensor, an infrared sensor, or a radiation sensor.
32. The system defined in claim 27 wherein the means for capturing comprises a video camera, a still camera, a microphone, or a temperature gauge.
33. The system defined in claim 27 wherein: the system further comprises means for encapsulating the content with metadata, wherein the metadata includes information about the capture device; and the means for publishing the content on the web site comprises means for publishing the information about the capture device with the content according to the metadata.
34. The system defined in claim 27 wherein: the system further comprises means for encapsulating the content with metadata, wherein the metadata includes information about the content; and the means for publishing the content on the web site comprises means for publishing the content according to the information about the content in the metadata.
35. The system defined in claim 34 wherein: the information about the content includes the type of the content; and the means for publishing the content according to the information about the content comprises means for publishing the content according to the type of the content as indicated in the metadata.
36. The system defined in claim 34 wherein the means for identifying the type of content comprises identifying picture, video, or text.
37. The system defined in claim 27 wherein: the capture device has an associated virtual interface; the system further comprises means for encapsulating the content with metadata, wherein the metadata includes information about the virtual interface; and the means for publishing the content on the web site comprises means for providing the user with access to the content using the virtual interface according to the metadata.
38. The system defined in claim 27 wherein: the system further comprises means for encapsulating the content with metadata, wherein the metadata includes user information; and the means for automatically associating the content with a user account comprises means for automatically associating the content with a user account based on the user information.
39. The system defined in claim 27 further comprising: means for encapsulating the content with metadata, wherein the metadata includes information about the event; and means for providing an electronic notification to the user, wherein the notification includes the information about the event.
PCT/US2001/042073 2000-09-06 2001-09-06 Automated upload of content based on captured event WO2002021472A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
AU2001291301A AU2001291301A1 (en) 2000-09-06 2001-09-06 Automated upload of content based on captured event
EP01971411A EP1327232A4 (en) 2000-09-06 2001-09-06 Automated upload of content based on captured event
CA002421772A CA2421772A1 (en) 2000-09-06 2001-09-06 Automated upload of content based on captured event

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US23030500P 2000-09-06 2000-09-06
US60/230,305 2000-09-06
US24718300P 2000-11-10 2000-11-10
US60/247,183 2000-11-10
US09/775,882 2001-02-02
US09/775,882 US7734724B2 (en) 2000-09-06 2001-02-02 Automated upload of content based on captured event

Publications (1)

Publication Number Publication Date
WO2002021472A1 true WO2002021472A1 (en) 2002-03-14

Family

ID=27398070

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/042073 WO2002021472A1 (en) 2000-09-06 2001-09-06 Automated upload of content based on captured event

Country Status (5)

Country Link
US (3) US7734724B2 (en)
EP (1) EP1327232A4 (en)
AU (1) AU2001291301A1 (en)
CA (1) CA2421772A1 (en)
WO (1) WO2002021472A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004003868A1 (en) * 2002-06-27 2004-01-08 Paul-Edouard Bouquin Device for monitoring goods and people
CN101257515A (en) * 2007-03-01 2008-09-03 捷讯研究有限公司 System and method for transformation of syndicated content for mobile delivery
US8560724B2 (en) 2007-03-01 2013-10-15 Blackberry Limited System and method for transformation of syndicated content for mobile delivery

Families Citing this family (117)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7657835B2 (en) * 1997-01-31 2010-02-02 Making Everlasting Memories, L.L.C. Method and system for creating a commemorative presentation
US6882708B1 (en) 1999-02-26 2005-04-19 Bellsouth Intellectual Property Corporation Region-wide messaging system and methods including validation of transactions
US6707890B1 (en) 2002-09-03 2004-03-16 Bell South Intellectual Property Corporation Voice mail notification using instant messaging
US9892606B2 (en) 2001-11-15 2018-02-13 Avigilon Fortress Corporation Video surveillance system employing video primitives
US8564661B2 (en) 2000-10-24 2013-10-22 Objectvideo, Inc. Video analytic rule detection system and method
US8711217B2 (en) 2000-10-24 2014-04-29 Objectvideo, Inc. Video surveillance system employing video primitives
US7213207B2 (en) * 2000-12-20 2007-05-01 National Instruments Corporation System and method for accessing registers of a hardware device in a graphical program
US7631265B1 (en) * 2000-12-29 2009-12-08 Gateway, Inc. System and method for configuring and loading a user interface
US7424175B2 (en) 2001-03-23 2008-09-09 Objectvideo, Inc. Video segmentation using statistical pixel modeling
US7072931B2 (en) * 2001-05-16 2006-07-04 David Goldhaber Accreditation maintenance through remote site monitoring
US7649987B1 (en) * 2001-06-19 2010-01-19 At&T Intellectual Property I, L.P. System and method for forwarding selective calls
US20030011644A1 (en) * 2001-07-11 2003-01-16 Linda Bilsing Digital imaging systems with user intent-based functionality
US6983448B2 (en) * 2001-07-12 2006-01-03 International Business Machines Corporation Open framework for the definition of metadata
US7913175B2 (en) * 2001-08-01 2011-03-22 Sony Corporation Information processing apparatus and method
US20030084193A1 (en) * 2001-10-31 2003-05-01 Brake Gregory A. Systems and methods for preparing a record of an event based on images from multiple image capture devices
US8504652B2 (en) * 2006-04-10 2013-08-06 Portulim Foundation Llc Method and system for selectively supplying media content to a user and media storage device for use therein
US8909729B2 (en) * 2001-11-20 2014-12-09 Portulim Foundation Llc System and method for sharing digital media content
US7711774B1 (en) * 2001-11-20 2010-05-04 Reagan Inventions Llc Interactive, multi-user media delivery system
US8122466B2 (en) * 2001-11-20 2012-02-21 Portulim Foundation Llc System and method for updating digital media content
US7503059B1 (en) * 2001-12-28 2009-03-10 Rothschild Trust Holdings, Llc Method of enhancing media content and a media enhancement system
US20070022465A1 (en) * 2001-11-20 2007-01-25 Rothschild Trust Holdings, Llc System and method for marking digital media content
US7412486B1 (en) * 2001-12-14 2008-08-12 Edial, Inc. Methods and apparatus providing a web based messaging system
US7046772B1 (en) * 2001-12-17 2006-05-16 Bellsouth Intellectual Property Corporation Method and system for call, facsimile and electronic message forwarding
US7167701B1 (en) 2001-12-18 2007-01-23 Bellsouth Intellectual Property Corporation Voice mailbox with management support
US20050065979A1 (en) * 2002-03-01 2005-03-24 Ivan Vachovsky System and method for creating and maintaining an online photo album
US7317908B1 (en) 2002-03-29 2008-01-08 At&T Delaware Intellectual Property, Inc. Transferring voice mail messages in text format
US7359491B2 (en) * 2002-03-29 2008-04-15 At&T Delaware Intellectual Property, Inc. Saving information from information retrieval systems
US6888930B1 (en) * 2002-03-29 2005-05-03 Bellsouth Intellectual Property Corporation Saving information from information retrieval systems
US7305436B2 (en) * 2002-05-17 2007-12-04 Sap Aktiengesellschaft User collaboration through discussion forums
US7072452B1 (en) * 2002-06-24 2006-07-04 Bellsouth Intellectual Property Corporation Saving and forwarding customized messages
US6996212B1 (en) * 2002-06-26 2006-02-07 Bellsouth Intellectual Property Corporation Voicemail system with subscriber specific storage folders
US7221742B1 (en) * 2002-06-26 2007-05-22 Bellsouth Intellectual Property Corporation Voicemail box with caller-specific storage folders
US7190950B1 (en) * 2002-06-27 2007-03-13 Bellsouth Intellectual Property Corporation Storage of voicemail messages at an alternate storage location
US6930792B2 (en) * 2002-08-02 2005-08-16 Cross Match Technologies, Inc. Web-enabled live scanner and method for control
US20040255018A1 (en) * 2002-10-04 2004-12-16 Brian Taraci Method and apparatus for providing universal web access functionality with port contention resolution
US7177881B2 (en) 2003-06-23 2007-02-13 Sony Corporation Network media channels
US7177872B2 (en) * 2003-06-23 2007-02-13 Sony Corporation Interface for media publishing
US20050001903A1 (en) * 2003-07-02 2005-01-06 Endler Sean Christopher Methods and apparatuses for displaying and rating content
TWI277317B (en) * 2003-07-07 2007-03-21 Hsiang-Tsung Kung Methods and systems for operating a logical sensor network
JP4561084B2 (en) * 2003-11-25 2010-10-13 ソニー株式会社 Service management apparatus, service management method, service providing system, and service providing method
US20050194456A1 (en) 2004-03-02 2005-09-08 Tessier Patrick C. Wireless controller with gateway
US7805523B2 (en) * 2004-03-15 2010-09-28 Mitchell David C Method and apparatus for partial updating of client interfaces
US8332178B2 (en) * 2004-04-13 2012-12-11 Honeywell International Inc. Remote testing of HVAC systems
US7593991B2 (en) * 2004-08-05 2009-09-22 At&T Intellectual Property I, L.P. Systems and methods for processing attachments associated with electronic messages
US7660873B2 (en) * 2004-08-16 2010-02-09 General Electric Company Systems and methods for communicating messages
US7454461B2 (en) * 2004-08-18 2008-11-18 Nokia Corporation Data processing information feeder framework
US11687217B2 (en) 2004-09-08 2023-06-27 Universal Electronics Inc. System and method for flexible configuration of a controlling device
US9632665B2 (en) 2004-09-08 2017-04-25 Universal Electronics Inc. System and method for flexible configuration of a controlling device
US20070055740A1 (en) * 2005-08-23 2007-03-08 Luciani Luis E System and method for interacting with a remote computer
US7414525B2 (en) * 2006-01-11 2008-08-19 Honeywell International Inc. Remote monitoring of remediation systems
KR101392294B1 (en) 2006-04-17 2014-05-27 오브젝트비디오 인코퍼레이티드 Video segmentation using statistical pixel modeling
WO2008001344A2 (en) * 2006-06-27 2008-01-03 Waterfall Solutions Ltd One way secure link
US20080201412A1 (en) * 2006-08-14 2008-08-21 Benjamin Wayne System and method for providing video media on a website
US20090049122A1 (en) * 2006-08-14 2009-02-19 Benjamin Wayne System and method for providing a video media toolbar
US8090081B2 (en) 2006-08-30 2012-01-03 At&T Intellectual Property I, L.P. Maintaining a call log
US8649368B2 (en) * 2006-08-30 2014-02-11 At&T Intellectual Property I, L. P. Notification of image capture
KR100791305B1 (en) * 2006-10-24 2008-01-04 삼성전자주식회사 System and method for sharing contents using messenger
IL180020A (en) * 2006-12-12 2013-03-24 Waterfall Security Solutions Ltd Encryption -and decryption-enabled interfaces
IL180748A (en) * 2007-01-16 2013-03-24 Waterfall Security Solutions Ltd Secure archive
US20080271112A1 (en) * 2007-04-30 2008-10-30 Waker Philip M Automatic file transfer
US10237358B2 (en) * 2007-10-23 2019-03-19 La Crosse Technology Ltd. Location monitoring via a gateway
US8223205B2 (en) * 2007-10-24 2012-07-17 Waterfall Solutions Ltd. Secure implementation of network-based sensors
CA2722513A1 (en) * 2008-04-23 2009-10-29 Proscape Technologies, Inc. System and method of managed content distrubution
US8595160B2 (en) * 2008-05-14 2013-11-26 Disney Enterprises, Inc. System and method for client-side advertisement retrieval
US8156442B2 (en) * 2008-06-30 2012-04-10 Nokia Corporation Life recorder and sharing
JP5332369B2 (en) * 2008-07-18 2013-11-06 ソニー株式会社 Image processing apparatus, image processing method, and computer program
US8274380B2 (en) 2008-12-01 2012-09-25 Research In Motion Limited Anticipatory responses to commands
US20110252371A1 (en) * 2010-04-13 2011-10-13 Sony Corporation System and method for fast boot of computer
KR101691831B1 (en) * 2010-08-17 2017-01-02 엘지전자 주식회사 Mobile terminal and Method for controlling information publication via web site thereof
KR101811714B1 (en) * 2010-09-17 2017-12-26 삼성전자주식회사 Method and apparatus for managing data
US9043387B2 (en) 2010-09-29 2015-05-26 Open Text S.A. System, method and computer program product for smart upload automation
JP5701007B2 (en) * 2010-10-19 2015-04-15 キヤノン株式会社 Surveillance camera device and control method of surveillance camera device
KR20120040958A (en) * 2010-10-20 2012-04-30 삼성전자주식회사 Method for communicating in a portable terminal
US20120197971A1 (en) * 2011-02-01 2012-08-02 Shiarng Llc Enhanced web-browsing system and method
US8982223B2 (en) * 2011-03-30 2015-03-17 Panasonic Intellectual Property Management Co., Ltd. Image sending apparatus, image recording apparatus and image recording method using identification information relating reduced image data with original image data
US9317496B2 (en) 2011-07-12 2016-04-19 Inkling Systems, Inc. Workflow system and method for creating, distributing and publishing content
US8631125B2 (en) * 2011-08-22 2014-01-14 Verizon Patent And Licensing Inc. Network device and mobile device with state capture services
EP2771802A4 (en) * 2011-10-24 2016-05-25 Schneider Electric Ind Sas System and method for managing industrial processes
US9069881B2 (en) * 2012-01-09 2015-06-30 International Business Machines Corporation Adaptation of probing frequency for resource consumption
US9152807B2 (en) * 2012-03-08 2015-10-06 Marvell World Trade Ltd. Method and apparatus for providing audio or video capture functionality according to a security policy
US8886836B2 (en) * 2012-06-12 2014-11-11 Facebook, Inc. Providing a multi-column newsfeed of content on a social networking system
WO2014018155A1 (en) * 2012-07-24 2014-01-30 Penthera Partners, Inc. Video uploading from mobile devices
US9635037B2 (en) 2012-09-06 2017-04-25 Waterfall Security Solutions Ltd. Remote control of secure installations
US9438684B2 (en) 2012-11-29 2016-09-06 Ebay Inc. Automatic population of a network accessible content collection
US10094585B2 (en) 2013-01-25 2018-10-09 Honeywell International Inc. Auto test for delta T diagnostics in an HVAC system
KR102023013B1 (en) * 2013-04-18 2019-09-19 엘지전자 주식회사 Refrigerator and operating method thereof
US9419975B2 (en) 2013-04-22 2016-08-16 Waterfall Security Solutions Ltd. Bi-directional communication over a one-way link
US9528720B2 (en) 2013-04-30 2016-12-27 Honeywell International Inc. Display sub-assembly for an HVAC controller
CN104184753B (en) * 2013-05-20 2018-04-27 腾讯科技(深圳)有限公司 A kind of document transmission method and device
US9401973B2 (en) * 2013-06-18 2016-07-26 Vmware, Inc. Systems and methods for transmitting data
US20150346932A1 (en) * 2014-06-03 2015-12-03 Praveen Nuthulapati Methods and systems for snapshotting events with mobile devices
KR101636722B1 (en) 2014-06-09 2016-07-06 엘지전자 주식회사 Home applicance
KR101587465B1 (en) 2014-06-09 2016-01-21 엘지전자 주식회사 Home applicance
KR101545486B1 (en) * 2014-06-09 2015-08-21 엘지전자 주식회사 Home applicance
US20170200476A1 (en) * 2014-08-29 2017-07-13 Coban Technologies, Inc. Systems, apparatuses and methods for facilitating access to and distribution of audiovisual files by use of modified audiovisual files
US20160085840A1 (en) * 2014-09-22 2016-03-24 Microsoft Corporation Universal Interaction for Capturing Content to Persistent Storage
IL235175A (en) 2014-10-19 2017-08-31 Frenkel Lior Secure remote desktop
US9584378B1 (en) 2015-12-22 2017-02-28 International Business Machines Corporation Computer-implemented command control in information technology service environment
US10165171B2 (en) 2016-01-22 2018-12-25 Coban Technologies, Inc. Systems, apparatuses, and methods for controlling audiovisual apparatuses
IL250010B (en) 2016-02-14 2020-04-30 Waterfall Security Solutions Ltd Secure connection with protected facilities
US10641013B2 (en) 2016-02-16 2020-05-05 Go Lock Technology, Inc. Portable lock with integrity sensors
EP3436926A4 (en) * 2016-03-30 2019-11-13 Tinoq Inc. Systems and methods for user detection and recognition
KR102475927B1 (en) * 2016-04-28 2022-12-08 엘지전자 주식회사 Display device for providing a scrap function and operating method thereof
US10789840B2 (en) 2016-05-09 2020-09-29 Coban Technologies, Inc. Systems, apparatuses and methods for detecting driving behavior and triggering actions based on detected driving behavior
US10152858B2 (en) 2016-05-09 2018-12-11 Coban Technologies, Inc. Systems, apparatuses and methods for triggering actions based on data capture and characterization
US10370102B2 (en) 2016-05-09 2019-08-06 Coban Technologies, Inc. Systems, apparatuses and methods for unmanned aerial vehicle
US10915954B2 (en) * 2017-12-26 2021-02-09 Chicago Mercantile Exchange Inc. Integration application utilizing a communications protocol
US11095810B2 (en) * 2019-01-07 2021-08-17 Hanwha Techwin Co., Ltd. Setting system for a camera and control method thereof
US11636870B2 (en) 2020-08-20 2023-04-25 Denso International America, Inc. Smoking cessation systems and methods
US12017506B2 (en) 2020-08-20 2024-06-25 Denso International America, Inc. Passenger cabin air control systems and methods
US11813926B2 (en) 2020-08-20 2023-11-14 Denso International America, Inc. Binding agent and olfaction sensor
US11828210B2 (en) 2020-08-20 2023-11-28 Denso International America, Inc. Diagnostic systems and methods of vehicles using olfaction
US11760170B2 (en) 2020-08-20 2023-09-19 Denso International America, Inc. Olfaction sensor preservation systems and methods
US11932080B2 (en) 2020-08-20 2024-03-19 Denso International America, Inc. Diagnostic and recirculation control systems and methods
US11760169B2 (en) 2020-08-20 2023-09-19 Denso International America, Inc. Particulate control systems and methods for olfaction sensors
US11881093B2 (en) 2020-08-20 2024-01-23 Denso International America, Inc. Systems and methods for identifying smoking in vehicles
US12008487B2 (en) * 2020-12-15 2024-06-11 International Business Machines Corporation Inference model optimization

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5689442A (en) * 1995-03-22 1997-11-18 Witness Systems, Inc. Event surveillance system
US6005482A (en) * 1998-09-17 1999-12-21 Xerox Corporation Surface mounted information collage

Family Cites Families (109)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3812462A (en) 1972-11-17 1974-05-21 Seismograph Service Corp Remote monitoring and remote control systems
US5291193A (en) 1988-01-21 1994-03-01 Matsushita Electric Works, Ltd. Identification registration for a wireless transmission-reception control system
US4990890A (en) 1988-05-02 1991-02-05 Newby Lionel L Vehicle security system
US6345288B1 (en) * 1989-08-31 2002-02-05 Onename Corporation Computer-based communication system and method using metadata defining a control-structure
US4977612A (en) 1989-10-10 1990-12-11 Motorola, Inc. Channel selection in a multi-frequency radio data communication system
US5706290A (en) * 1994-12-15 1998-01-06 Shaw; Venson Method and apparatus including system architecture for multimedia communication
GB9121203D0 (en) 1991-10-04 1991-11-20 D2B Systems Co Ltd Local communication bus system and apparatus for use in such a system
ATE275959T1 (en) 1992-05-19 2004-10-15 Graham Edmund Kelly USE OF ISOFLAVONE PHYTO-ESTROGEN EXTRACTS OF SOY OR CLOVER
US5568612A (en) * 1992-11-18 1996-10-22 Canon Kabushiki Kaisha Method and apparatus for advertising services of two network servers from a single network node
EP0626635B1 (en) 1993-05-24 2003-03-05 Sun Microsystems, Inc. Improved graphical user interface with method for interfacing to remote devices
US5594858A (en) 1993-07-29 1997-01-14 Fisher-Rosemount Systems, Inc. Uniform control template generating system and method for process control programming
US5689641A (en) * 1993-10-01 1997-11-18 Vicor, Inc. Multimedia collaboration system arrangement for routing compressed AV signal through a participant site without decompressing the AV signal
US7010144B1 (en) * 1994-10-21 2006-03-07 Digimarc Corporation Associating data with images in imaging systems
US5754765A (en) 1993-11-24 1998-05-19 Intel Corporation Automatic transport detection by attempting to establish communication session using list of possible transports and corresponding media dependent modules
GB9401924D0 (en) 1994-02-01 1994-03-30 Jonhig Ltd System for road toll payment
US5829444A (en) 1994-09-15 1998-11-03 Visualization Technology, Inc. Position tracking and imaging system for use in medical applications
WO1996013135A1 (en) 1994-10-20 1996-05-02 Ies Technologies, Inc. Automated appliance control system
US6198408B1 (en) 1994-11-29 2001-03-06 Elihay Cohen Method and apparatus for controlling electrical appliances by remote control transmitters
CA2168641C (en) * 1995-02-03 2000-03-28 Tetsuya Kitamura Image information encoding/decoding system
US5872928A (en) 1995-02-24 1999-02-16 Cabletron Systems, Inc. Method and apparatus for defining and enforcing policies for configuration management in communications networks
US5586121A (en) 1995-04-21 1996-12-17 Hybrid Networks, Inc. Asymmetric hybrid access system and method
US5721878A (en) * 1995-06-07 1998-02-24 International Business Machines Corporation Multimedia control system and method for controlling multimedia program presentation
JPH098944A (en) 1995-06-20 1997-01-10 Fujitsu Ltd Service profile changeover method and terminal equipment
US5907837A (en) * 1995-07-17 1999-05-25 Microsoft Corporation Information retrieval system in an on-line network including separate content and layout of published titles
US5812394A (en) 1995-07-21 1998-09-22 Control Systems International Object-oriented computer program, system, and method for developing control schemes for facilities
JPH0984147A (en) 1995-09-08 1997-03-28 Sony Corp Remote controller, electronic equipment and electronic equipment system
US5802467A (en) 1995-09-28 1998-09-01 Innovative Intelcom Industries Wireless and wired communications, command, control and sensing system for sound and/or data transmission and reception
US5717879A (en) * 1995-11-03 1998-02-10 Xerox Corporation System for the capture and replay of temporal data representing collaborative activities
US6212556B1 (en) 1995-11-13 2001-04-03 Webxchange, Inc. Configurable value-added network (VAN) switching
US5713075A (en) * 1995-11-30 1998-01-27 Amsc Subsidiary Corporation Network engineering/systems engineering system for mobile satellite communication system
US6185409B1 (en) * 1995-11-30 2001-02-06 Amsc Subsidiary Corporation Network engineering/systems engineering system for mobile satellite communication system
US6272341B1 (en) * 1995-11-30 2001-08-07 Motient Services Inc. Network engineering/systems engineering system for mobile satellite communication system
US6112085A (en) * 1995-11-30 2000-08-29 Amsc Subsidiary Corporation Virtual network configuration and management system for satellite communication system
US5793365A (en) * 1996-01-02 1998-08-11 Sun Microsystems, Inc. System and method providing a computer user interface enabling access to distributed workgroup members
WO1997030375A1 (en) 1996-02-13 1997-08-21 Obsidian Imaging, Inc. Method and apparatus for configuring a camera through external means
US5862325A (en) * 1996-02-29 1999-01-19 Intermind Corporation Computer-based communication system and method using metadata defining a control structure
US6101528A (en) * 1996-03-27 2000-08-08 Intel Corporation Method and apparatus for discovering server applications by a client application in a network of computer systems
US6098116A (en) 1996-04-12 2000-08-01 Fisher-Rosemont Systems, Inc. Process control system including a method and apparatus for automatically sensing the connection of devices to a network
US6311197B2 (en) 1996-06-03 2001-10-30 Webtv Networks, Inc. Method for downloading a web page to a client for efficient display on a television screen
US6061738A (en) 1997-06-27 2000-05-09 D&I Systems, Inc. Method and system for accessing information on a network using message aliasing functions having shadow callback functions
US6275490B1 (en) 1996-08-21 2001-08-14 Netspeak Corporation Method and apparatus for establishing communications from browser application
US5999525A (en) * 1996-11-18 1999-12-07 Mci Communications Corporation Method for video telephony over a hybrid network
US5867495A (en) * 1996-11-18 1999-02-02 Mci Communications Corporations System, method and article of manufacture for communications utilizing calling, plans in a hybrid network
US5867494A (en) * 1996-11-18 1999-02-02 Mci Communication Corporation System, method and article of manufacture with integrated video conferencing billing in a communication system architecture
US5817993A (en) 1996-11-27 1998-10-06 Otis Elevator Company Monitoring of elevator door reversal data
DE69634834D1 (en) * 1996-12-23 2005-07-14 Ericsson Telefon Ab L M RADIO PHONE WITH SPECIAL ANTENNA FOR STANDBY MODE
US6163316A (en) 1997-01-03 2000-12-19 Texas Instruments Incorporated Electronic programming system and method
US6370571B1 (en) * 1997-03-05 2002-04-09 At Home Corporation System and method for delivering high-performance online multimedia services
US6166729A (en) * 1997-05-07 2000-12-26 Broadcloud Communications, Inc. Remote digital image viewing system and method
US6236997B1 (en) 1997-06-23 2001-05-22 Oracle Corporation Apparatus and method for accessing foreign databases in a heterogeneous database system
WO1998059478A1 (en) 1997-06-25 1998-12-30 Samsung Electronics Co., Ltd. Programming tool for home networks
US6038601A (en) * 1997-07-21 2000-03-14 Tibco, Inc. Method and apparatus for storing and delivering documents on the internet
US6134606A (en) 1997-07-25 2000-10-17 Flashpoint Technology, Inc. System/method for controlling parameters in hand-held digital camera with selectable parameter scripts, and with command for retrieving camera capabilities and associated permissible parameter values
US6012084A (en) 1997-08-01 2000-01-04 International Business Machines Corporation Virtual network communication services utilizing internode message delivery task mechanisms
US6069655A (en) * 1997-08-01 2000-05-30 Wells Fargo Alarm Services, Inc. Advanced video security system
US6292830B1 (en) 1997-08-08 2001-09-18 Iterations Llc System for optimizing interaction among agents acting on multiple levels
AUPO918697A0 (en) * 1997-09-15 1997-10-09 Canon Information Systems Research Australia Pty Ltd Enhanced information gathering apparatus and method
US6002427A (en) * 1997-09-15 1999-12-14 Kipust; Alan J. Security system with proximity sensing for an electronic device
US6233428B1 (en) * 1997-09-17 2001-05-15 Bruce Fryer System and method for distribution of child care training materials and remote monitoring of child care centers
US5974566A (en) * 1997-10-07 1999-10-26 International Business Machines Corporation Method and apparatus for providing persistent fault-tolerant proxy login to a web-based distributed file service
US7190392B1 (en) * 1997-10-23 2007-03-13 Maguire Jr Francis J Telepresence system and active/passive mode display for use therein
US6035323A (en) 1997-10-24 2000-03-07 Pictra, Inc. Methods and apparatuses for distributing a collection of digital media over a network with automatic generation of presentable media
US6930709B1 (en) * 1997-12-04 2005-08-16 Pentax Of America, Inc. Integrated internet/intranet camera
US5963624A (en) 1997-12-05 1999-10-05 Zilog, Inc. Digital cordless telephone with remote control feature
US6237049B1 (en) 1998-01-06 2001-05-22 Sony Corporation Of Japan Method and system for defining and discovering proxy functionality on a distributed audio video network
US6032202A (en) 1998-01-06 2000-02-29 Sony Corporation Of Japan Home audio/video network with two level device control
US6243000B1 (en) 1998-02-13 2001-06-05 Philip Y. W. Tsui Wireless rolling code security system
US6330597B2 (en) 1998-03-04 2001-12-11 Conexant Systems, Inc. Method and apparatus for monitoring, controlling, and configuring remote communication devices
US6567122B1 (en) * 1998-03-18 2003-05-20 Ipac Acquisition Subsidiary I Method and system for hosting an internet web site on a digital camera
US6009401A (en) 1998-04-06 1999-12-28 Preview Systems, Inc. Relicensing of electronically purchased software
JP3285841B2 (en) * 1998-04-24 2002-05-27 株式会社次世代情報放送システム研究所 Content providing device and content providing method, receiving device and receiving method, and communication system and communication method
US6385772B1 (en) * 1998-04-30 2002-05-07 Texas Instruments Incorporated Monitoring system having wireless remote viewing and control
US6167469A (en) * 1998-05-18 2000-12-26 Agilent Technologies, Inc. Digital camera having display device for displaying graphical representation of user input and method for transporting the selected digital images thereof
US7209955B1 (en) * 1998-05-29 2007-04-24 Research In Motion Limited Notification system and method for a mobile data communication device
US6218953B1 (en) 1998-10-14 2001-04-17 Statsignal Systems, Inc. System and method for monitoring the light level around an ATM
US6005476A (en) 1998-07-24 1999-12-21 Valiulis; Carl Electronic identification, control, and security system for consumer electronics and the like
US6286038B1 (en) 1998-08-03 2001-09-04 Nortel Networks Limited Method and apparatus for remotely configuring a network device
US6710790B1 (en) 1998-08-13 2004-03-23 Symantec Corporation Methods and apparatus for tracking the active window of a host computer in a remote computer display window
US6202210B1 (en) 1998-08-21 2001-03-13 Sony Corporation Of Japan Method and system for collecting data over a 1394 network to support analysis of consumer behavior, marketing and customer support
DE69905936D1 (en) * 1998-11-13 2003-04-17 Lightsurf Technologies Inc METHOD FOR COLOR-WIDE DISPLAY OF IMAGES TRANSFERRED ON A NETWORK
US6510466B1 (en) * 1998-12-14 2003-01-21 International Business Machines Corporation Methods, systems and computer program products for centralized management of application programs on a network
US6147601A (en) 1999-01-09 2000-11-14 Heat - Timer Corp. Electronic message delivery system utilizable in the monitoring of remote equipment and method of same
US6680730B1 (en) 1999-01-25 2004-01-20 Robert Shields Remote control of apparatus using computer networks
US6564380B1 (en) * 1999-01-26 2003-05-13 Pixelworld Networks, Inc. System and method for sending live video on the internet
US6584466B1 (en) * 1999-04-07 2003-06-24 Critical Path, Inc. Internet document management system and methods
US6591279B1 (en) * 1999-04-23 2003-07-08 International Business Machines Corporation System and method for computer-based notifications of real-world events using digital images
US6298332B1 (en) 1999-05-06 2001-10-02 David R. Montague CD-ROM product label apparatus and method
US8121874B1 (en) * 1999-05-27 2012-02-21 Accenture Global Services Limited Phase delivery of components of a system required for implementation technology
US6981016B1 (en) * 1999-06-11 2005-12-27 Visage Development Limited Distributed client/server computer network
US6411724B1 (en) * 1999-07-02 2002-06-25 Koninklijke Philips Electronics N.V. Using meta-descriptors to represent multimedia information
US6388579B1 (en) 1999-08-09 2002-05-14 Intelligent Vehicle Systems, Inc. Apparatus and system for remotely updating and monitoring the status of a vehicle
US6803945B1 (en) * 1999-09-21 2004-10-12 Intel Corporation Motion detecting web camera system
US6954859B1 (en) * 1999-10-08 2005-10-11 Axcess, Inc. Networked digital security system and methods
US6698021B1 (en) * 1999-10-12 2004-02-24 Vigilos, Inc. System and method for remote control of surveillance devices
US6654782B1 (en) * 1999-10-28 2003-11-25 Networks Associates, Inc. Modular framework for dynamically processing network events using action sets in a distributed computing environment
US7356570B1 (en) * 2000-08-29 2008-04-08 Raja Tuli Portable high speed communication device
US6275997B1 (en) 2000-04-20 2001-08-21 Vikki Richardson Gel-cushion socks
US7630721B2 (en) 2000-06-27 2009-12-08 Ortiz & Associates Consulting, Llc Systems, methods and apparatuses for brokering data between wireless devices and data rendering devices
US7117519B1 (en) * 2000-07-26 2006-10-03 Fotomedia Technologies Llc Method and system for selecting actions to be taken by a server when uploading images
US6636259B1 (en) * 2000-07-26 2003-10-21 Ipac Acquisition Subsidiary I, Llc Automatically configuring a web-enabled digital camera to access the internet
US6621827B1 (en) * 2000-09-06 2003-09-16 Xanboo, Inc. Adaptive method for polling
US6686838B1 (en) 2000-09-06 2004-02-03 Xanboo Inc. Systems and methods for the automatic registration of devices
US7555528B2 (en) 2000-09-06 2009-06-30 Xanboo Inc. Systems and methods for virtually representing devices at remote sites
US7287088B1 (en) * 2000-10-06 2007-10-23 Fotomedia Technologies, Llc Transmission bandwidth and memory requirements reduction in a portable image capture device by eliminating duplicate image transmissions
US7069345B2 (en) 2001-05-09 2006-06-27 Koninklijke Philips Electronics N.V. Device identification and control in network environment
US20030234809A1 (en) 2002-06-19 2003-12-25 Parker Kathryn L. Method and system for remotely operating a computer
US6907387B1 (en) * 2002-08-05 2005-06-14 Bellsouth Intellectual Property Corporation Systems and methods for remote monitoring of a facility location
KR100513851B1 (en) 2003-01-24 2005-09-09 삼성전자주식회사 Remote control service processing device using GUI in home network environment
US7254279B2 (en) 2003-10-17 2007-08-07 Hewlett-Packard Development Company, L.P. Method for image stabilization by adaptive filtering

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5689442A (en) * 1995-03-22 1997-11-18 Witness Systems, Inc. Event surveillance system
US6005482A (en) * 1998-09-17 1999-12-21 Xerox Corporation Surface mounted information collage

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1327232A4 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004003868A1 (en) * 2002-06-27 2004-01-08 Paul-Edouard Bouquin Device for monitoring goods and people
CN101257515A (en) * 2007-03-01 2008-09-03 捷讯研究有限公司 System and method for transformation of syndicated content for mobile delivery
EP1967971A1 (en) * 2007-03-01 2008-09-10 Research In Motion Limited System and method for transformation of syndicated content for mobile delivery
US8560724B2 (en) 2007-03-01 2013-10-15 Blackberry Limited System and method for transformation of syndicated content for mobile delivery

Also Published As

Publication number Publication date
EP1327232A4 (en) 2007-02-07
US20100208069A1 (en) 2010-08-19
US20150012825A1 (en) 2015-01-08
CA2421772A1 (en) 2002-03-14
US20030140090A1 (en) 2003-07-24
US7734724B2 (en) 2010-06-08
US8860804B2 (en) 2014-10-14
AU2001291301A1 (en) 2002-03-22
EP1327232A1 (en) 2003-07-16

Similar Documents

Publication Publication Date Title
US7734724B2 (en) Automated upload of content based on captured event
US9407685B2 (en) Remotely viewing image or video captured by node
US7555528B2 (en) Systems and methods for virtually representing devices at remote sites
WO2002021298A1 (en) Systems and methods for virtually representing devices at remote sites
EP1328868A1 (en) Systems and methods for virtually representing devices at remote sites

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PH PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2421772

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 2001971411

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2001971411

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

NENP Non-entry into the national phase

Ref country code: JP