WO2007109557A2

WO2007109557A2 - Automation control system having a configuration tool and two-way communication with a touch-screen display

Info

Publication number: WO2007109557A2
Application number: PCT/US2007/064199
Authority: WO
Inventors: Seale Moorer; Eric Eichensehr
Original assignee: Exceptional Innovation, Llc
Priority date: 2006-03-16
Filing date: 2007-03-16
Publication date: 2007-09-27
Also published as: WO2007109557A3

Abstract

An automation system and process of operating an automation system in a Web Service environment, includes providing at least one client (104) and at least one device (102), the at least one client and the at least one device configured with a web services for devices stack protocol (207), connecting a network (12) includes at least one server (10) with the web services for devices to the at least one client and the at least one device, and transmitting automation-based control and communication between the at least one client and at least one device, wherein the at least one client comprises one of a touch screen display and a handheld controller and the at least one device comprises an audio system, a video system, an intercom system, a lighting system, a security system, a link, and a HVAC system.

Description

AUTOMATION CONTROL SYSTEM HAVINO A GONFlGURATfON TOOL AND TWO- WAY COMMUNICATION WiTH A TOUCH-SCREEN DISPLAY

BACKGROUND OF THE INVENTION

1 Field of the Invention

[00011 The? invention is e^jected to multiple devsce control and convergence, and more particularly to

device addressing, discovery, description, control, eventing and i- convergence ^;n a Weo Service environment, and control through an input device.

2, Related Art

PDCItJ Household. academic and/or business spaces now more commonly have mors man one audto or vϊdeo device such as CO/OVO player, portable MP3 player, tuner. is preamp. power arr>p. speakers. VGR, DVR. computers running media players or connected to some other source ol audio o? video {e.g , internet radio, satβiifte radio and the like), etc. Typlcaϋy. a CD/OVO player from one company comes with its own remote control aod an amplifier oy an entirely different company comes vvsrh its own remote control The same space may have a PC wsm its keyboard and mouse, and yet another

Vj- company s portable MP3 player with sis own control switches., While egch audio device is dosng precisely what it was designed to do, each operates completely independent from the others with the possible exception of the portable UP3 player that may be connected ro a FO for synchronfeai-on As a result a user ends up gosng from one keypad to another or juggling a series of remote consols in order Io control the devices

S^f- !O0>03| Since these andio/vsdeo and similar devices are not designed to communicate vV&th each other or thesf communication is very limited, access to these audso/vsdeo devices ss limited by their physical locations. For example, ii ;s difficult to play an MP3 file saved ;n a PC hard disk dove in one mom or area (a chsld's bedroom} on speakers iocateo in another room or area (an entertainment room) Thus, sn order for a user SQ

^ an-oy >Tmsic of hss or her choice whenever and wherever he or she wanls, each room needs to be equipped with all the necessary audio/videe equipment and dlgria! audio/video cement

[001)41 Also, the a^dio/video devices are not dessened to communicate with otnef devices (e.g , TV, sighting, secuniy system, etc) Thus, R ss diWiCuK. If not impossible, to 3<? coiweroe the devices for common control for certain occasions For exampie in order to vvaich <s movie, the user must turn on s TV. a OVO player and an audio amplifier by using three different remcie controls. Then the user must set the TV to receive a v^eo sionas :>m the OVO player, set the audso amplifier to receive an audio ssgnai from the DVO ayer and use another control ami to adjust the lighting of the room Even when a use? iilzes a universal remote, as ;s known in the art, the result ;s a plurality of devices that e separately operaisd and are operated separately from a single universal remote, *ese devices do r>ot converge as described above because the devices lack any ability easily connect and effectively communicate With each other, and bo controlled by a ngle input devrce fCHH>$] Accordingly, there is a need for a solution for the aforementioned access ibiϋty, connectabϋsty and convergence issues to ailow devices to connect, communicate and be controlled

SUMMARY OF THE INVENTION flKlOll] the invention meets the foregoing needs using an automaton speαfsc iP based automation protocol which results :n a significant increase in discovery ana communications between devices along wsth an IP based Input device and other advantages apparent from the discussion herein

|CMK)?] Accordingly, in one aspect of me invention, a process of operating an automation sysiem in a Web Service environment includes the steps of providing at least one cherst and at least one device, the at least one cl-ent and the at least one device configured with a web services for devices stack protocol connecting g network includes at least one server with the web services for devices to the at least one olsent and the at least one device, and transmitting automation-based control and communication between the at least one client and at least one device, wherein the at least one efent composes one of a touch screen display and a handheld controller and the at least one device comprises an audio system, a video system, an intercom system, a lighting system, a security system, a NnK. and a HVAC system

PCH>!$] One of the touch screen display and the handheld controller may include a! leasi one of a LCD display, processor wireless interface, wired interface, IR snt^face, audio system, inputs, support base, end knob The at least one chent funher may include one of a TV. a personal computer, a personal digital assistant, and a game controller The ws-b services for devices stack protocol may include a services tier that provides comnuinscabon vsa at least one Qi HTTP and K)DP wheresn the communication via HTTP and UDP may include information cc-ntained m SOAP packets, and a iogscai interface ^ith the at least one oUent. and the web services for devices stack protocol may include a web service to? each at ieast one device The web services for devices slack protocol may include a service provider configured as a geneπe host for web services. The web services. tor devices stack protocol further may include one of a component configured to host multiple services, and a controller configured to communicate with the at least one device and wheresn the web sendees for devsces stack protocol further may include a device b>dgβ configured to translate commands for the devices The controller may be configured to send feedback from the at feast one device to the at least one dient. The web services for devices stack protocol may ha configured to communicate with the at least one device so a native format and fhe native format may include at least one of HTTP, TOP UDP, and senal protocols The. web services for devices probeol may be configured to discover tne at ieast one client and the discovery may include one or multicast announcements, multicast query requests and unicast responses. The web services for devices protocol may be configured for description and the description may ⁱnclude at least one of WS-Metadata exchange *veb services description language, and simple object access ptotecol/Xtvil protocol. The web services for devices protocol may be configured for eventing and wherein the eventing may include at least one of web services description language for detailed events, a configuration for client subscription to events, and a configuration for the at least one device to posh events to the at least one cbent

|T>CR)S| Accordingly, so another aspect o? lhe snvention, a machine-readable ?r;£?dsym ^clude^ instructions stored therewith whsch, when executed by a processor cause the processor to establish an automation system in a Wsb Service environment, the machine- resschafcle medium includes Instructions for providing automation-based control s-nd cornniυnk.stion between at least one client arid at least one dev-cs. the at least one client and the at ieasi one device configured with a web services fo? davrces stacK orotocol configuf^'ed to the at least one client and at ieast one devsoe, and instructions for conliøurlng a network includes at least one server to b-e connected to the at least one client and the aξ feast one devscs with the web services for devices, wherein the at least o^e client may Include one of a touch screen display and a handheld controller and the at least one device may Include an audio system, a video system, an intercom system, a sighting system, a security system, a HnK₁ and a HVAC system

[DCIIfJ] One of the touch screen display and the handheld controller may include at least one o? a ICD display, processor, wireless interface, wired interface. IR snteffacc-. audio system inputs, support base, and knob The al least ona chent further may include one of a TV, a personal computer, a personal digital assistant, and a game controller The ^/eb services for devices stack protocol may include a services t*er that provides eornmunieation via at least one ol HTTP and UDP wharβsπ the communication via HTTP and UDP comprises ^formation contained ;n SOAP packets, and a iørjicai interface with the at i&ast one client, and the web services for devices stack p? oiocol comprises a web service, for each at ieasi one device The web services for devices stack protocol further snay include a device ondge configured Io translate commands for the devices, and a sendee provider conferred as a generic host for web services The wβo services for devices stack protocol further may include a component, configured to host rnoifiple services, end a controller configured to communicate with the at least one device. The controller may be configured to send feedback from the at least one devsce to the at least one chent The web cervices far devices stack protocol may be configured to communicate with tne at least one device in a native format and ttie native format may include at least one of HTTP, TCP. UDP, and serial protocols The weθ services for devices protocol may be configured to discover the at least one client and the discovery may include on*? of multicast announcement multicast query requests _: and upcast responses. The web services for devices protocol may D-e configured for description and the description may include at least one of WS--fV1etadata exchange, web sendees descnpcon language, and Simple onject access protocol/XML protocol The web services for devices protocol may be configured for eventing and wherein the evening may include at least or^;e of web services description language for d-etaiied events, a co^fsguratior? for cissrn subscriptbn to events, and a configuration for the at least one device to push events to the at least ona cheni fdui IJ Accordingly in yet another aspect oi^' the invention, an automa^on system operating m a Web Service for Devices environment s^dudes at feast one client and at least one device the at iaast one client ar>d the at least one device configured with a wsb services for devices stack proiocoi configured to provide automation-based controi and communication between the at least one client and at ieast one device, and a network includes^, ai least one server configured to be connected to the at least one client and the at ieast one device with the web services for devices, wherein the at least one client may meiude one of a touch screen display and « haπdhoid coπUofer and the at ieast one device may include an audso system, a video system, an intercom system, a lighting system, a security system, a Nnk, and a HVAC system. fTjδi 2| One of the touch screen display and the handheld controller may include ai feast one oi a ICO display, processor, wireless smen'ace. Wired tedace, IR interface, audio system inputs, support base, and knob. The at least one cise^t further may include one of a TV a personal computer . a personal digital assistant, and a game oontroϋer. The a weo services for devsces stack protocol may include a services tier that provides communication vsa at least one of HTTP and UDP wherein the communication vsa HTTP and UDP may include information contained ϊn SOAP packets. ar?d a logical interface With the at feast one client and the wet services- for devices stack protocol may include a web service for each at feast one device, and a service provider configured as a generic host fof web services. The web services for device stack protocol further may include a device bndge configured to translate commands for the oevsces. and a service provider configured as a generic host for web services The web services for devices stack protocol further may include a component configured to host multiple services, and a controller contoured to communicate with the at teas! one device. [0013] Thfe controller may be configured to send feedback from the at least one device to the at feast one client The web services for devices stack protocol may be configured to communicate with the a! least one device in a native format and the native format may include at least or>e of HTTP. TCP, UOP, and seha! protocols. The web services for devices protocol may be configured to discover the at least one chent and the discovery may Include one of multicast announcements, multicast query requests, and unlcaxt responses The web services for devices protocol may be configured for description and lhe desonpiKm may include at least one of VVS^vtetadata exchange, web services descrlotϊon language, and ssmpie object access protocol/XML protocol The web services fof devices protocol may be configured for evening and vvherβsn the eventing may include at ieast one of web services description language for detailed events, a configuration for ctsent subscription to events, and a configuration for the at least one devsce to push events to the at least one client,

[0014J Additional features of the invention may be set forth or apparent from consideration of the following detailed description drawings, and claims Moreover. ;t is to be understood that both the foregomq summary of the invention and the following detailed description are exemplary and intended to provide further explanation without Smiting the scope of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

[ODIS] The accompanying drawings, which are Included to provide a further uixierstatvόing of the ;hverφ^:en. are incorporated p and constitute a part of this specification, illustrate emooeiϊments of the Invention and together With the detailed description servo to explain lf>^ principles of the invention No attempt rs made to show structural details oi the invention in more detail than may be necessary for a fundamental understanding oi the invention and the vanous ways m which it may be practiced, in the drawings

|CI01€| F ig. 1 shows an schematic overview of a convergence solution constructed accordsriO to the pnoeiples of the invention: [0017] F ig 2 schematically shows the web services for devices stack for use in the convergence solution of F ig 1. constructed according to principles of the invention;

[0018] Fig 3 shows a device life cycle operating according to the principles of the invention

[0019] Figures 4, 5. 6. and 7, show a automation network touch display input device constructed according to the principles of the invention

[0020] Figure 8 shows another automation network display input device constructed according to the principles of the invention,

[0021] Figure 9 shows another automation network touch display constructed according to the principles of the invention; and

[0022] Figure 10 shows a link module constructed according to the principles of the invention.

DETAILED DESCRIPTION OF THE INVENTION

[0023 The embodiments of the invention and the various features and advantageous details thereof are explained more fully with reference to the non-limiting embodiments and examples that are described and/or illustrated in the accompanying drawings and ^•detailed in the following description It should be noted that the features illustrated in the drawings are not necessarily drawn to scale and features of one embodiment may be employed with other embodiments as the skilled artisan would recognize even If not explicitly stated herein Descriptions of well-know components and processing techniques may be omitted so sa to not unnecessarily obscure the embodiments of the invention The examples used herein are intended merely to facilitate an understanding cf ways in whic the invention may be practiced and to further enable those of skill in the art to practice the embodiment so fth einvention .Accordinly, the examples and embodiments herein should not be construed as limiting the scope of the invention, which is defined solely by the appended claims and applicable law Moreover, it is noted that like reference numerals represent similar parts throughout the several views of the drawings

[0024] Fig 1 schematically shows an overview of a convergence solution according to an embodiment of the invention. The convergence solution may be a combination of hardware and software. The hardware may include a server 10 connected to a network 12 (e.g. IP based wired or wireless network such as an Ethernet network) and may possibly be connected to the internet 14 devices. 102 (e.g audio 20\ video 22, intercom- 24 lightin 26 , security system 28. HVAC 38. and the like) and clients 104 (e,g TV 30. personal computer (PC) 32. personal digital assistance (PDA) 34, controller 36 such as a controi panel, game controller 0 e.

the clients 104 may include a remote control 39 or a remote control may be configured to be a client 10< The server 10 may be any type- of computer, such as_* a PC connected to the n^«tworl< 12 The events 104 such as events 3D. 32, 34. 36 may provide a user with control over the devices 102 such as devices 20, 22_t 24, 26. 28. 38. fC?CI2S| Rg 1 fuπhe? schematically shows interaction of the convergence a solution interacting with nomir-temet protocol devices such as non-Internet protocol devices 52, 56- Non-internet protocol device 52 (non-IP) devtce ss considered non- internet protocol sn that It does not include a communications interface that Is. IP based, The noo-iF device S2 may include other types of (serial, COM port, and the HKe) communication protocols Accordingly, the server 10 may be contoured to include various inputs, and outputs to provide communication and control to vanous devsoes such as non-iP device 52, Non-IP device 52 may De implemented es any number of different devices including, for example only, VvWdow shade automation devices, audio devices, video devices and so on. føølø] fig 1 further shows implementation of the convergence solution that may communicate with a non-IP devϊoe such as the ncn-iP device §6 that not arranged proimate to server 10 hi order to accomplish communication hetween the non-!P device o6 and the network 12, a link or conversion module 54 may be arranged in communication With the netwonx 12. As described in further detail below, the conversion module 54 connects. Ϊ& the network v^th an Ethernet type connection that provides, internet protocol communications with the network 12 The conversion module 54 further provides a second type of communication connection as shown by 5$ that may be any type of communreaiion protocoi as- noted above With respect to communication pmtocoi 60 Accordingly the non-IP devrce SS may then communicate via network 12 and operate as a wee- service device accordingly

|002T] The software (i e , application} enaoleδ the hardware such as ths? server 10, devices 102, and clients 104 to communicate with each other despite their different p?oρnetary languages and communication protocols, and may provide the user with control over most or all the hardware from a singte eirent. The application may utilize sϊ least o^e oort^on of the hardware to send commends to the devices 102 and receive feedback from them The application may integrate centralized device control into a PC Paced media environment t« o. , Microsoft Media Center ^:V> environment) that may store_: ofoan^yre and piay digital media content. The user may use the same remote control 3t5 to listen to music, watch and record television enjoy family photographs and home movies, as weil as adjust the lighting, secure trie home, adjust the temperature, dsstrifeute music tnsoughout the house, check eurveiiiance cameras and the like, fOCKIS] The application may be implemented with Web Services Tha WeD Services use sta dard internet protocol (IP; and ar^» based on siandsrd XiML-rβias-ed technologies such as SOAP (Sample Object Access Protocol) for communrearsons and WSDt (Web Sen/sees Device Language) Io descnbe interlaces The devices implemented With WeD. Service for Devsce tWSD) become biacK boxes on the network, providing services to any application, on any platform, written in any language

IHOIiJ Alternatively or additionally, if the server 10 or the FC 32 Is running a enabled operating system such as Microsoft Windows Vista™, the devices, may be configured as a Sκ.teShow^rw device or '^■gadget^" A SscieShow^ device or gacJgei may communicate with any client or device im pigmented with WSD m the network via protocols according to SideShow^!ϊΛ XML communroanon specifications Moreover, the server 10 or the PC 32 u^ng Microsoft Windows Vmta^T!* may be running a SideSho*^"

computer providing a user interface rendering for the device thai communicates v^th automation controi devices via WSD technology.

|0030| Aiternatsveiy or additionaPv, the WSD technology may he implemented using Device Profile for Wen Services (DF⁵WSj. The DPWS may be used to define how vanous devices may be able so use Web Services m conjunction with the convergence solution noted above The DPWS further may allow anet/or e^ure interoperabii% between the var-ous devices 102 and the clients- 104 and the like, Moreover, the OPW S may allow for cup-pon of resource constramed devices within the convergence solution shown ;n Fig, 1. One benefit of DFWS is its ability to enable device and service discovery v^thsn the convergence solution of Fig. 1 The DF⁵WS may allow for and Support noή eventing, an end posnt, and may be bosk on standards- and WS βpecifications, More speoifiearsy. the end point may provide devlcemost metadata Additionally, the PPWS specifications may incJuds HTTP. WSDL. SOAP. WS~Diseovery. WS^Addressing. WSCventsng, WS- metacta^a, transfer, and the like.

|0f!31] Fig. 2 schematically shews the Web Services for Devices ;WSD) Stack for use h the convergence solution of Fsg 1 constructed according to the principles in the invention. The WSD stack as referenced herein refers to the protocol architecture, in particular Fig 2 shows ihe WSD Stack 2OD The WSD stack 200 of the invention ss a particular automation software implementation of a Weό Serwees compiler ner^o?1eog protocol suite The individual protocols are designed with a single purpose in m;nd Because each protocol module may only communicate wsth two others, the modules are commonly imagined as layers in a stack of protocols. The lowest protocol always dea^e With ⁵Io^- ϊevei:' physical interaction of the hardware. Every higher layer adds more features As described sn greater detail below, the WSD Slack 2OD allows and ensbies the discovery of devices in a network, such as the convergence sokmon of Fig 1 and the dev-ees on the network sn a hghi weight, simple fashion. Using the WSQ Stack 200, a device 102 in the network n$ able to send a message to determine- what services are available enabling

& discovery of the device 102

|0δ32J The WSD Stack 200 ss the software that may be used to process protocols The WSD Stack 200 ss required to use a specie set of protocols in particular, the WSD Stack 200 leverage's Web Services for Devices to create a powerful, extensible system that may communicate w;th a wide variety of devices 102 described in greater detail above. As κ> shown in fig. 2, the WSD Stack is shown schematically at a high ievel. The WSO Stack 200 i^ Rg, 2 shows the communication to and from clients 10^ &\ the top of the diagram vsa a logical interface and she various hardware devices 102 arranged at the very bottom

[0O33J The logical interface Initially communicates with and throuoh the WSD StacK 200 !-? vsa a Hyper Texi Transfer Protocol ξ HTT P) or a User Oatagrarη protocol (UDP) as hy reference numeral 201. The HTTP enables dsta transfer and display of weo ρa<jes and the like as is weϋ known In the an:. The UDP enables a direct way to send and receive datagram-?- on an IP rsetwork as is well known m the art. Accordingly, the clients s 04 interface vsa the log-cal interface through one or both of the HTTP and UDP layers ?o 301 to a service provider 203 For example, communication from the cPeπt 104 to the servsce provider 2:02 may be vsa the HTTP or UDP information and the communication may be contained ;n SOAP packets

|δO34] The sery-ee ρ?ovider 20? may be configured as a large, ge^enc host for web services The service provider 202 may hoet one or more components 305 therein, A ^s cornoonent 30S may have the ability to nost multiple services However, the component 206 may limit the relationship between a se^v-oe and a dawce to a one-to-one relationship

|CK33S] A furthe? part of lhe component 2OS ss the web service 203 The web service 203 exssts for each device 204. The web service 203 may be configured as a generic web

3& service based on the device category For example, a thermostat has a corresponding web service based on the HVAC category for example only fOCTM] Each we& service 203 may be configured with a device bodge 304 The device ohdge 204 may be configured to essentially translate commands by the physical devices 102. Accordingly, each devsce bridge 204 may be specific to the specific make of the

^- otwsϊca! device 102. [003?] Th& service provider 203 may iurther include a controller 205 The controller 206 may be a?ϊsmge<! to communicate wsth the devices 102 The controller 206 may be configured to have a ratio of one controller per component 205 The controller 208 may inc^lude the ability to send feedback from the devices 102 to lhs component 204, The component 204 may then route the feedback to the appropriate web service 203 Accordingly tm$ arrangement provider the ability for feedback from the devices 102 to vss oo u 5- events 104

[00381 The service provider 202 oext may communicate to the various physical devices ¹02 via one or rnore of a plurality of different communications protocol 207. in particular, ^fhe Communications^, protocol With the devices 102 may include any type of native or proprietary format Suoh native or proprietary formats may be sent via Hyper Text Transfer protocol (HTTP), transmission control protocol (TCP), user datagram protocol \UOPk or seπai protocols. The TCP enables two hosts to connect. The serial protocol provides one or two way senal communication as is weϋ known- in the aft |0CKI3| Accordingly, the WSD Staok 200 creates a powerful and extensible system based on web services for devices Moreover, the WSD Stack 200 may communicate with a wide- variety of deuces 102 as discussed -n detail with respect ro f sg 1 above. Ussng toe WSO Stack 200 allows network component to become "biack Pox" components This allows the various clients 103 and devices 102 ξ.o communicate in a clearly deftoed way wsthoot needing to know how they are sccompϋshino thesr venous ^tasks Using the WSD Sϋsok 200 allows components to be implemented on any appiscsϋon amniπg on any platterm and written in any language in essence_, when the yVSO Stack 200 ss implemented, the network location and communications are handled by the platform allowing application developers to focus soiely on apαlicafion problems, it should be noted that various modifications to the WSD Stack 200 are contemplated Py the invention

P040] f >^'g 3 shows a devsoe life cycle operating according to the principles of the invemion In particular. Fig. 3 shows the various portions of the life cycle of a device networKinp using the VVSD Slack 200 described above and shown in Fsg 2 m a device ^■502 as shown in f 59 1 above. Initially, as shown in Fig 3, ths first step in a device 102 sn us life cycle on the network is discovery 302 Discovery 302 as used in conjunction with the WSD Srack 200 may use the WS--DiSCθvety specification The WS-Discovery specification may include multicast announcements, multicast query requests such as probe and probe match, and umcast responses In ϋns regard a device 102 may probe a ciien? 104 using the discovery networking life cycle 302 to receive a probe match from ths ckent 104 Ir₅ this regard, discovery of the device IDS by one or more ciients 104 ;s strasoh* κ^;rwarcj and essentially automatic. More specifically. ^ devsce- 102 may announce ^■ts present as it is connected to ihs network 12 This announcement may be through a sending out of a heiio or bye message Dy devsce 102 on to the- network 12 Addmonaiiy. the devsce 102 may respond to a ctsenf 104 request including vanous probe and resolve type requests. A probe request may induόe the ability to identify a device or servsce within the client 104 or device 102 The resoive request πiay include ?h& BbMy to locate a device 102 or service «od point The reβuit is the ability to gat or obtain information via metadata exchange during the discovery 302 process. f 0041 J The next steo in the networking Isle cycle of the WSD Slack 200 process includes the arep of description 304 The step of description 304 may include a metadata exchange This metadata exchange may be a response to a "get request ^Λ The deseoption step 304 may thus include the VVS-lvletadata exchange protocol and may moreover include the VVSDl or SOAP/XMl information exchange The WSDL (Web Services Description Language) may be used sn ccjmbsnBtson with the SOAP and XML schema to provide web services A devsce connecting to thg network 12 may read the WSDl to determine what functions are available on the network 12, clients 104 arκl the iike The SOAP {Ssmpte Object Access Protocol) ss a protoooi that may be used mr exchanging XIvIL bas^d messages over the network 12 |H04^1 The nex^ξ; step sn the networking PIe cycie shown \n f ig. 3 ss ths step of control 306. in the stsp of control 306, control over a device 102 may fee exsrcised by sending messages to the devsce ^02 and/or services hosted by the device 102 The control 300 may be defined oy the WSOL and XML schema This definition of control 306 may ensure e common base line for interoperability 10043! hinaNy, ths^; iast step In the networking life cycle shown in Fsg. 3 is the step of eventing 308, The evemsno step 308 may include the WSD StacK 200 web service^ evem^s!r*g and may again use the SOAp/xr^i. schema, In particular_, the evening 30δ may aik>w tor a noh evenung model, This mode! may allow tor detaϋed events through WSDL, The eventing 308 ma/ allow a client to subsc?; fee w various events Moreover, ^e eventing 308 may aNow tor the device 102 to push events to the clients 104, [t)044| Sho^n in Figures 4, δ. 6, and ? is -a client implemented as a handheld device 400 with a touch screen display 408. in particular, the handheld evice 400 includes remote oaρ®bιlϊty that maybe wsseless Furthermore a knob ^02 may be iocated on the back of the handheld device 400 as shown in figures S ar*d β In particular, the knob ^02 is shaped such that it may be easily held by either iet> or right hand (ambidextrous;. fVio?eover, the knoo- 402 also may be arranged under the handheld device 400 in an arrangement such that it may prop up the handheld device on a tabie Qr another fiat surface such that a user can view the display Moreover, the knob 402 may function to hold the handheld device m a docking cradle 404, The docking cradle 404 may function a-? a oower supply or power transformer for powering lhe handheld device and/or as a eonn^βcbon to the network 10. Additionally, the handheld device 400 may opiate using *^■ wireless fidelity (Wi-Fi) w;th an antenna for communication using the θ02.1 1 protocol for example. fOS4$] As shown in Figure 8. a handheld device §00 is another handheld client In parucuiar lhe bandheld 800 may include a power-over Ethernet (POE; connection or may be batten? operated for wireless connections. Moreover one siclt of the handheld 800

^■Q may include a navigation pad 802 that may snoiude buttons (such as up. down, left, fight and select). There may also he a back button in this aspect, it may not have a touch sensmve εhspiay The handheld 300 may be wall mounted, it may be an IPAQ (available from Hewlett-Packard. Palo A\io. CA) or a PDA based device The handheld 000 may be wired by Ethernet or may be- a WhFi or w-feless connected device using any known

>s protocol such as 802 11. The handheld 800 may also allow for tne dlstnOufson of audio Wi^felessiy (recede mussc and distribute the same through the automation network). Moreover, it ;s contemplated thai the handheld 300 may have a headphone _jack for dlstnhution of music vsa headphone The handheld 800 may also be configured to be placed ^;n the same or a different docking cradle 402 as noted above r.-o |t)04δ| Another eKempiary client Is shown in Rgure 9 implemented as a touch screen 900 that mav include a touch screen housing 922 that may include key holes and k«y$ to >nteract with each oth^r and to hold the touch screen in place so a wall without any oth«-r mechanical fasteners mot shown) Additionally, the touch screen 900 because it is web eased, requires only an Ethernes oon^ection and a po^er connection In particular, the

. 5 Ethernet connection may be a typscai RJ454ype connection. Whereas the power connection may be a 14-18 gauge-type wire pair connecting to s DC power source (12 volhi). and the lϊke The toucn screen 000 may Pe a notebook based type o? processor For example, en inteP^ P^nhom M-type or Core ¹^ Duo processor wrm the touch screen Sn^)Q ϊ^'he touch screen 900 may include a seneor arrangement overlaid on the display s^;.> 902 Additionally, the touch screen may Include an audio line out type of arrangement including speakers 910, 012. Moreover, the touch screen SOO may be arranged with a plurality of USB type connections for communication tne^ewith. Finally, the touch screen SOO may also be eon%^red to have a virtual QWERTY type keyboar that may be virtually arranged on the touch screen SOO for emry of slpha-numenc characters.

^ |Dδ47| The touch screen mooiior 900 includes a display 902 The display 902 may be an LCD type display However, any other type of display technology ϊs contemplated for use as the display 902 The touch screen δOQ further includes a plurality of hoi spots 904, 908. 918, 314, ar*e §20. in particular, the hotpots provide a way m which to receive input from a user by touching a ρa?t of the housing 922 The hotspots OCM, 90S. 918. 014, and 920 are eapacitlve -sensing. Howe^sr, any type of touch sensitive technology is contemplated for use with the invention Each of these hotspots 004, §08, 91B₁ 914, and 920 may be assigned a parucuiar feature. For example, turning on the lights, turning on ^ stereo, turning on the television and the Mke for each hot spot, it should b& nαted thai the any of the above-notad devices may De controlled hy the hotspois. [CKHfJ Additionally, the touch screen display 900 includes slider areas 906, 916 These slider areas 906, 916 may use a eapacitive sensing type sensor to sense a sliding snput Siting me finger up or down the areas 906. 916, provides a decreasing actuation of a particular home automation component such as lights or audio volume. It should be noted that the any of the above- noted devices may be controlled by the seders The display 902 further includes a touch sensitive capaαtive overlay thai may allow a user to touch various virtual buttons that are formed on the front of the display 902 rVloreovβ?', the touch screen 900 may include a microphone 924 for receiving audio Input for intercom functions and the

!OCMS] Each of the display deuces 400, 600, and 900 may include a CPU, CPU hoard, a base- ooard, a hard drive, haat-sinκ_: and a blower fan controlled based on mternal ^mperature An exhaust opening for αVeeung the exhaust air from the blower fan may he arranged on the devices 400, 800, and 000, The touch screen may snciudβ an IR nnfrared} receiver conducted according to the principles of the invention in particular-, me SR receiver device may be for receiving an IR signal to control the devices 400. 800, and 900 It is contemplated thm the touch screen may allow this type of IR input arrangement to allow a remote control to interact with the devices 400, 800, and 900. F inaϋy, it rs contemplated that the touch screen rnrght tee voice activated to receive voice commands/input-s snd ho able to operate in response thereto. Additionally, the devices 400, 800. and 900 may include a photocell may be included to sense ambient Hgh* to control th^« dssplay brightness of the devices 400, 800. and 900 pf>$0jj A Firj, 10 shows an exemplary link or conversion module constructed accordingly to th?j principles of the myenhon, In particular the conversion mαduϊe 54 is constructed to connect vaHh t^e network 12 usmg IP protocol and, in particular WSD. The conversion module 54 connects tc the network 12 either via a wireless connection through antenna B02 irking a?w known Wireless protocol such as a WVF? or a wired connection through a sack 804 The conversion module $4 -ncludcs a memory, a processor, an operating svs>^vem, and so on. The operating system of the conversion module S4 allows for the use of the WSD stack 200 The conversion module 54 also includes a communications connection 806 The communications connection 806 may use any kind of proprietary and/or serial type connections or communication Accordingly, 3 device that may not be able to connect to a network. 12 because it lacks an IP protocol type of interface, may be able to cornet to the conversion module 54 tnrough the communication connection 806 Accordingly that device becomes a black box on the network and be able to accordingly interact with the network using web services for devices [0051] Accordingly, the application and clients as described above, may be implemented with Web Services for Devices and in particular the above noted WSD Stack 200 The Web Services for Devices (WSD) uses standard Internet protocol (IP) and may be based on standard XML-related technology such as SOAP (Simple Object Access Protocol) for communication s and WSDL (Web Services Device Language) to describe interfaces The devices implemented with WSD Stack 200 become black boxes on the network, providing services to any application, on any platform, written in any language. [0052] In accordance with various embodiments of the invention, the methods described herein are intende d for operation with dedicated hardware implementations including, but not limited to, semiconductors, application specific integrated circuits, programmable logic arrays and other hardware devices constructed to implement the methods and modules described herein. Moreover, various embodiments of the invention described herein are intended for operation with as software programs running on a computer processor Furthermore, alternative software implementations including, but not limited to, distributed processing or component/object distributed processing, parallel processing, virtual machine processing, any future enhancements, or any future protocol can also be used to implement the methods described herein,

[0053] It should also be noted that the software implementations of the invention as described herein are optionally stored on a tangible storage medium, such as a magnetic medium such as a disk or tape, a magneto-optical or optical medium such as a disk or a solid state medium such as a memory card or other package that houses one or more read-only (non-volatile) memories, random access memories, or other re-writtable (volatile) memories. A digital i^'iie attachment to em ad or other self-contained information archive or set oi archives is considered a distribution medsum equivalent to a tangible storage medium Accordingly the invention is considered to include a tangible storage modern or distribution medium, as listed herein and including art- recognized equivalents and successor media, in which the software implementations herein are stored, [0054] While the invention has been described in terms of exemplary embodiments, those skilled in the art will recognize that the invention can be practiced with modifications in the spirit and scope of the appended claims. These examples given above are merely illustrative and are not meant to be an exhaustive list of all possible designs, embodiments , applications or modifications of the invention

Claims

WHAT IS CLAIMED IS:

1. A process of operating an automation system in a Web Service environment comprising the steps of' providing at least one client and at least one device, the at least one client and the at least one device configured with a web services for devices stack protocol connecting a network comprising at least one server with the web services for devices to the at least one client and the at least one device, and transmitting automation-based control and communication between the at least one client and at least one device, wherein the at least one client comprises one of a touch screen display and a handhled controller and the at least one device comprises an audio system, a video system, an intercom system, a lighting system a security system a link and a HVAC system

2. The process according to claim 1 wherein one of the touch screen display and the handhled controller comprise at least one of a LCD display. processor, wireless interface, wired interface, IR interface, audio system, inputs, support base, and knob.

3. The process accroding to claim 1 wherein the at least one client further comprises one of a TV a personal computer, a personal digital assistant and a game controller

4 The process according to claim 1 wherein the web services for devices stack protocol comprises. a services tier that provides communication via at least one of HTTP and UDP wherein the communicati on via HTTP and UDP composes information contained in SOAP packets and a logical interface with the at least one client, and the web services for devices stack protocol comprises a web service for each at least one device

5, The process, according to claim i wherein the web serv-ces for devices stack protocol comprises a service provider configured as a generic host for web services.

6 the process accroding to claim 1 wherein the web services for devices stack protocol further comprises one of a component configured to host multiple services, and a controller configured to communicate with tha at least one device and wherein the web services for devices stack protocol further comprises a device bridge configured to translate commands for the devices.

7 The process according to claim 1 wherein the controller is configured to send feedback from the at least one device to the at least one client

8 The process according to claim 1 wherein the web services for devices stack protocol is configured to communicate with the at least one device m a native format and the native format comprises at least one of HTTP. TCP, UOP, and serial protocols

9 The process according to claim 1 wherein the web services for devices protocol is configured to discover the at least one client and the discovery comprises one of multicast announcements , multicast query requests, and unlcast responses.

10 The process according to claim 1 wherein the web services for devices protocol is configured for description and the description comprises at least one of WS- Metadata exchange web services description language, and simple object access protocol/XML protocol.

1 1 The process according to claim 1 wherein the web services for devices protocol is configured for eventing and wherein the evening comprises at least one cf web services description language for detailed events, a configuration for client subscription on events, and a configuration for the at least one device to push events to the at least one client.

12 A machine-readable medium comprising instruction stored therewith which when executed by a processor cause the processor to establish an automation system in a WeP Service environment, the machine- readable medium comprising: instructions for providing automation-based control and communication between at least one client and at least one device the at least one client and the at least one device configured with a web services for devices stack protocol configured to the at least one client and at least one device, and instructions for configuring a network comprising at least one server to be connected to the at least one client and the at least one device with the web services for devices, wherein the at ieast one client comprises one of a touch screen drspiay and a handheld controller &r>d the at .least one device ce-mpπses ^n audio system, a vsdeo system an intercom system, a lighting system, a security system, a link, and a HVAC

13, The machine-readable medium according Io claim 12 wherein one of the touch screen display and lhe handheld controller comprise at least one of a LCD display, processor, w_;reless interface, wired interface. IR interface, audio system inputs, support i>ase. and knob

14 The roachine-feadable medium according to claim 12 wherein the at least one cisent further composes one of a TV. a personal computer, a personal digital assistant, ersd a game controller

15 The maoNne-readahte rnedium according to claim 12 wherem the web se?Vϊθe$> for devices stack protocol comprises' a services tser that provides con-imunicaϋon vsa at least one of HTTP and UDP wherein ?ne eomonu rsicat ion via HTTP and UDP comprises information contained in SOAF pa c ket s ; and a lOQscas ^terface wsth the at least one client, and the web services I^'or devsces stack prαfecoi comprises a web service for each at ieast one device

1§ The machlne-readabie medium according to cialm 12 wherein the web serv'C-es for devices stack protocol former comprises a device bn<i<je configured to transiate com.mands for the devices, and a service provider configured as a genenc host for web services,

1? The machine-readabie medium according to claim 12 wherein me web services fo? devices stack protocol further comprises a component configured to host multiple services, and a controller contoured to communicate with ϊhe at least one device

iδ The machine-readarole medium according to clasni 12 wheresn the controller ss configured to send feedback from the at leasl one device to the at leas*, one client

19 The machine-readable medium according to claim 12 wherein the web services for devices stack protocol is configured to communicate with the at least one device in a native format and the native format comprises at least one of HTTP, TCP UDP, and serial protocols

20. The machine-readable medium according to claim 12 wherein the we b services for devices protocol is configured to discover the at least one client and the discovery composes one of multicast announcement, multicast query request, and αnϊcast responses

2 1 The machine-readable medium according to claim 12 wherein the web services for devices protocol is configured for description and the description comprises at least one of WS-Metadata exchange web services description language and simple object access protocol/XML protocol

22 The machine-readable medium according to claim 12 wherein the web services for devices protocol is configured for eventing and wherein th eeventin comprises at least one of web services description language for det ailed events, a configuration for client subscription to events, and a configuration for the at least one device to push events to the at ieact one client,

23 An automation system operating in a Web Service for Devices environment comprising at least one client and at least one devsee. me at teast one client and the at least one device configured with a web services for devices stack protocol configured to provide automation -based control and communication between the at least one client and at least one device, and a network comprising at least one server configured to be connected to the at least one client and the at least one device with the vveb services for devices. wherein me at least one client comprises one of a touch screen display and 3 handheld controller and the at least one device eoniprises an audio system, a video system, an intercom system, a lighting system, a secuhty system a link, and a HVAC system

24 The automation system according tp claim 33 wherein one of the *o«ch screen dsspiay and the handheld controller compπse at least one of a LCD display. processor wireless interface, wired interface R interface, audio system, Inputs, support base, and Knob

25^. The automation system according to claim 23 wherein the at least one client further comprises one of a TV a personal computer a personal digital assistant and a game controller

28 The automation system according to claim 23 wherein the web services for devices stack protocol comprises: a services tier that provides communication via at least one of HTTP and UDP wherein the communication via HTTP and UDP comprises information contained in SOAP packets; and a logical interface with the at least one client and the web services for device stack protocol comprises a web service for each at least one device, and a service provider configured as a generic host tor web services

27 The automation system according to claim 23 wherein the web service for devices stack protocol further comprises a device bridge configured to translate commands for the devices: and a service provider configured as a generic host for web services.

28. The automation system according to claim 23 wherein the web services for devices stack protocol further comprises a component configured to host multiple services and a controlle configured to communicate with the at least one device

29. The automation system according to claim 23 wherein the controller is configured to send feedback from the at least one device to the at least one client

30. The automation system according to claim 23 wherein the web service for devices stack protocol is configured to communicate with the at least one device in a native format and the native format comprises at least one of HTTP, TCP, UDP, and serial

31 The automation system according to claim 23 wherein the web services for devices protocol is configured to discover the at least one client and the discovery comprises one of multicast announcements, multicast query requests, and unicast

32 The automation system according to claim 23 wherein the web services for devices protocol is configured for description and the description comprises at least one of

WS-Metadata exchange, web services description language, and simple object access protocol/XML protocol.

33 The automation system accordi ng claim 23 wherein the web services for devices protocol is configured for eventing and wherein the eventing comprises at least one of web services description language for detailed events, a configuration for client subscription to events, and a configuration for the at least one device to push events to tha at least one client.