WO2008150062A1

WO2008150062A1 - Biological signal sensor apparatus, wireless sensor network, and user interface system using biological signal sensor apparatus

Info

Publication number: WO2008150062A1
Application number: PCT/KR2008/001382
Authority: WO
Inventors: Young-Guk Ha; Joo Chan Sohn; Kyung-Il Kim; Hyeonsung Cho; Young Cheol Go; Hyun Kyu Cho; Young-Jo Cho
Original assignee: Electronics And Telecommunications Research Institute
Priority date: 2007-06-04
Filing date: 2008-03-12
Publication date: 2008-12-11

Abstract

A biological signal sensor apparatus worn on a user's body includes: a sensor unit for sensing physical states or movements of a user to generate biological signal data; a wireless communications unit for performing wireless data communications with a wireless sensor network to transmit the biological signal data; a sensor network protocol processing unit for processing protocols for end-to-end communications between the wireless communications unit and the wireless sensor network and for performing a mobility support procedure for the biological signal sensor apparatus; a processor for controlling the wireless data communications, the end-to-end communications, and the mobility support procedure to allow the biological signal sensor apparatus to serve as a mobile wireless sensor node; and a connection unit for connecting the sensor unit and the processor. The biological signal sensor apparatus serves as a mobile wireless sensor node in the wireless sensor network.

Description

BIOLOGICAL SIGNAL SENSOR APPARATUS, WIRELESS

SENSOR NETWORK, AND USER INTERFACE SYSTEM USING

BIOLOGICAL SIGNAL SENSOR APPARATUS

Technical Field

[1] The present invention relates to a biological signal sensor apparatus, a wireless sensor network, and a user interface system using the biological signal sensor apparatus; and, more particularly, a biological signal sensor apparatus for sensing biological signals of a user, a wireless sensor network, and a user interface system for providing application services based on location information.

[2] This work was supported by the IT R&D program of MIC/IITA. [2006-S-026-02,

Development of the URC Server Framework for Proactive Robotic Services]

[3]

Background Art

[4] With the recent developed and widespread computer networking technology, ubiquitous computing technology and a wireless sensor network or a ubiquitous sensor network (USN) technology come into the spotlight as next-generation computing technologies.

[5] The ubiquitous computing technology is directed to provision of all user-desired computing services anytime and anywhere and basically based on a wireless sensor network. To be specific, computers and sensors are installed at invisible positions in ambient living spaces and connected with each other over a wireless network, thereby sensing various data, recognizing contexts and situations based on the data, and providing a variety of services.

[6] A ubiquitous healthcare system (u-healthcare system) is a killer application of the ubiquitous computing technology. The ubiquitous healthcare system results from combination of the ubiquitous computing technology and healthcare services which are a matter of primary concern nowadays, and facilitates checking and managing health states of children, aged or feeble people, chronic patients, and the like in real life anytime and anywhere. A currently developed ubiquitous healthcare system is configured with a wireless or wired body/wrist wearable biological signal sensor apparatus, which is connected to a portable user terminal or a computer and inter- operates with a remote hospital or a healthcare server.

[7] Fig. 1 illustrates a configuration of a conventional user interface system using a biological signal sensor apparatus wherein the system is a ubiquitous healthcare system using a wrist-wearable biological signal sensor apparatus. [8] As shown in Fig. 1, the conventional ubiquitous healthcare system includes a wrist- wearable biological signal sensor apparatus 10 for collecting health information of a user 1 while worn on a wrist of the user 1 ; and a portable terminal 30, a home server 40 and a personal computer (PC) 50 which are connected with the wrist- wearable biological signal sensor apparatus 10 via a wireless communications link 20.

[9] The portable terminal 30, e.g., a personal digital assistant (PDA), is connected with a wireless local area network (LAN) access point 70 via a wireless LAN 60 which in turn is connected with a healthcare server 90 at a healthcare authority via the Internet 80. The home server 40 and the PC 50, which can access the Internet 80 by themselves, are directly connected with the healthcare server 90.

[10] In the above ubiquitous healthcare system, the wrist- wearable biological signal sensor apparatus 10 collects the health information of the user 1 on occasion, and, the collected health information is transmitted to the healthcare server 90 via the portable terminal 30, the home server 40 or the PC 50.

[11] Drawbacks of the user interface system using a biological signal sensor apparatus, e.g., the ubiquitous healthcare system of Fig. 1, are as follows. First, it cannot support free mobility of a user due to a limited communicable distance of a wireless or wired communications link. Second, it cannot recognize at which space a user is currently located even though it can perform wireless communications in an actual use- environment having several spaces. These drawbacks are problems to be solved for implementing a real sense of ubiquitous healthcare system through which healthcare can be performed anytime and anywhere. In particular, provision of location information necessary for rescue of a user in an emergency such as a heart attack, a blackout, a trouble in movements and the like is a very important and essential function of the ubiquitous healthcare system.

[12] The GPS (Global Positioning System) based location recognition technique is being applied to various fields as means for detecting location of a user. However, the GPS is inadequate for an ordinary life because it is not available in an indoor area.

[13] Further, configuration and functions of the conventional wrist- wearable biological signal sensor apparatus are focused only on healthcare. Therefore, the conventional wrist- wearable biological signal sensor apparatus does not recognize behavioral and emotional states of a user which can be recognized using various biological signals sensed from the user, and thus, cannot be utilized as an interface with a variety of ubiquitous service devices.

[14]

Disclosure of Invention Technical Problem [15] In view of the above, the present invention provides a biological signal sensor apparatus for sensing biological signals of a user, a wireless sensor network, and a user interface system for providing application services based on location information of the user. [16]

Technical Solution [17] In accordance with a first aspect of the invention, there is provided a biological signal sensor apparatus worn on a user's body, including: [18] a sensor unit for sensing physical states or movements of a user to generate biological signal data; [19] a wireless communications unit for performing wireless data communications with a wireless sensor network to transmit the biological signal data; [20] a sensor network protocol processing unit for processing protocols for end-to-end communications between the wireless communications unit and the wireless sensor network and for performing a mobility support procedure for the biological signal sensor apparatus;

[21] a processor for controlling the wireless data communications, the end-to-end communications, and the mobility support procedure to allow the biological signal sensor apparatus to serve as a mobile wireless sensor node; and [22] a connection unit for connecting the sensor unit and the processor.

[23] In accordance with a second aspect of the invention, there is provided a wireless sensor network, including: [24] a biological signal sensor apparatus, worn on a user's body and serving as a mobile wireless sensor node, for sensing biological signals of a user to generate biological signal data; [25] a plurality of stationary wireless sensor nodes, installed in living spaces of the user, for performing wireless communications with the biological signal sensor apparatus; and [26] a plurality of wireless sink nodes wirelessly connected with the stationary wireless sensor nodes to form the wireless sensor network. [27] In accordance with a third aspect of the invention, there is provided a user interface system, including: [28] a biological signal sensor apparatus, worn on a user's body and serving as a mobile wireless sensor node in a wireless sensor network, for sensing biological signals of a user to generate biological signal data; [29] a plurality of stationary wireless sensor nodes, installed in living spaces of the user, for performing wireless communications with the biological signal sensor apparatus; [30] a plurality of wireless sink nodes wirelessly connected with the stationary wireless sensor nodes to form the wireless sensor network; and

[31] a service unit for processing the biological signal data transmitted via the wireless sink nodes to provide to the user application services based on location information of the user who stays in any one of the living spaces in the wireless sensor network.

[32]

Advantageous Effects

[33] In accordance with the present invention, wide-area user mobility can be supported by using a sensor network having a biological signal sensor apparatus and inexpensive wireless sensor nodes installed at several positions in indoor/outdoor living spaces of a user. Further, a current location and behavioral states of the user can be recognized through interoperation between wireless sensor nodes installed at specific positions and a user- worn wireless sensor node. From this, the user interface system of the present invention can be used as a user interface not only for a ubiquitous healthcare service but also for various services requiring recognition of physical/emotional state changes, behaviors, and commands of a user. Therefore, a variety of ubiquitous application services such as game/education services, childcare services, and remote control services for intelligent service robots, computers or digital appliances can be effectively provided.

[34]

Brief Description of the Drawings

[35] The above features of the present invention will become apparent from the following description of embodiments, given in conjunction with the accompanying drawings, in which:

[36] Fig. 1 illustrates a configuration of a conventional user interface system using a biological signal sensor apparatus wherein the system is a ubiquitous healthcare system;

[37] Fig. 2 illustrates a configuration of a user interface system using a biological signal sensor apparatus in accordance with the present invention;

[38] Fig. 3 illustrates a detailed configuration of a biological signal sensor apparatus, a stationary wireless sensor node, and a wireless sink node, which form the user interface system in accordance with the present invention;

[39] Fig. 4 illustrates a detailed configuration of a service apparatus in accordance with the present invention;

[40] Fig. 5 illustrates a configuration of a sensor network protocol packet format for use in transmission of biological signal data in the user interface system in accordance with the present invention; [41] Fig. 6 illustrates a configuration of a sensor map database for use in the user interface system in accordance with the present invention; [42] Figs. 7 to 10 illustrate an embodiment of mobility support procedure for a wireless sensor node in the user interface system in accordance with the present invention; [43] Figs. 11 to 14 illustrate another embodiment of mobility support procedure for a wireless sensor node in the user interface system in accordance with the present invention; [44] Fig. 15 illustrates a configuration of an embodiment of a nearby node table for use in the mobility support procedure for a wireless sensor node in the user interface system in accordance with the present invention; [45] Fig. 16 illustrates an exemplary view of the user interface system using a biological signal sensor apparatus to provide a childcare service; [46] Fig. 17 illustrates an exemplary view of the user interface system using a biological signal sensor apparatus to provide an eldercare/infantcare service; [47] Fig. 18 illustrates an exemplary view of the user interface system using a biological signal sensor apparatus to provide a game/education service; [48] Fig. 19 illustrates an exemplary view of the user interface system using a biological signal sensor apparatus to provide a ubiquitous healthcare service; and [49] Fig. 20 illustrates an exemplary view of the user interface system using a biological signal sensor apparatus to provide an electrical device remote control service. [50]

Best Mode for Carrying Out the Invention [51] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which form a part hereof. [52] In this specification, the term "biological signals" is used to refer to signals detected from a user's body, and it includes physical states and movements of a user. [53] Fig. 2 illustrates a configuration view of a user interface system using a biological signal sensor apparatus in accordance with the present invention. [54] As shown in Fig. 2, a user interface system in accordance with the present invention includes: a biological signal sensor apparatus 110, which serves as a mobile wireless sensor node, for sensing biological signals of a user 1 while worn on a wrist or the like of the user 1 to generate biological signal data based thereon; a plurality of stationary wireless sensor nodes 120, installed in living spaces of the user 1 such as a garden, a library, an inner room, a bedroom, a rest room, a living room and the like, for performing wireless communications with the biological signal sensor apparatus 110 via wireless communications links 20; a plurality of wireless sink nodes 130 connected with the stationary wireless sensor nodes 120 via the wireless communications links 20 to form a wireless sensor network; service apparatuses 141 to 143, connected with the wireless sink nodes 130, for processing the biological signal data generated by the biological signal sensor apparatus 110 and providing application services based on location information of the user 1 in the wireless sensor network; a service server 150, connected with the service apparatuses 141 to 143 via an external communications network such as the Internet 80, for providing the application services based on the biological signal data via the service apparatuses 141 to 143; and subsidiary sensors (not shown) for obtaining images of the user 1 to assist the biological signal sensor apparatus 110.

[55] The service apparatuses 141 to 143 provide a variety of application services based on the biological signal data generated by the biological signal sensor apparatus 110. Each of the service apparatuses 141 to 143 may be implemented with: a personal computer accessible to the wireless sink nodes 130 and the Internet 80; a home server accessible to the wireless sink nodes 130 and the Internet 80 and forming a home network; an intelligent robot accessible to the wireless sink nodes 130 and the Internet 80 via a wireless LAN 60 and a wireless LAN access point 70; or the like. Since the personal computer, the home server, and the intelligent robot have enough excellent processing powers to provide a variety of application services, each of them can be solely dedicated as the service apparatus 141, 142 or 143. Even if a service apparatus connected with the wireless sink node 130 has an insufficient processing power to provide the application services, the service apparatus can be used in conjunction with an additional host apparatus having an appropriate processing power. These service apparatus and host apparatus are an exemplary embodiment of a service unit to process biological signal data transmitted via the wireless sink node 130 and provide application services based on the location information of the user in a wireless sensor network.

[56] Each of the stationary wireless sensor nodes 120 has an ID (identification) assigned thereto, and communicates with each other in a multi-hop fashion in which a communicable distance in end-to-end wireless communications is not limited. The biological signal sensor apparatus 110, which serves as a mobile wireless sensor node, performs a mobility support procedure (i.e., a handover procedure) while moving, in which the biological signal sensor apparatus 110 automatically creates a connection with the most nearby stationary wireless sensor node 120, so that seamless connection with the sensor network can be guaranteed.

[57] A space (e.g., an inner room, a bedroom, a living room and the like) where the user stays at present is found by using the stationary wireless sensor node 120 currently connected with the biological signal sensor apparatus 110 as a location reference node.

[58] Movements, biological information and location information of the user 1, which are collected by the biological signal sensor node 110 and the sensor network, are employed to provide services to the user 1 via application programs embedded in the service apparatuses 141 to 143. Or, they are transmitted to the service server 150 connected with the Internet 80 to provide more specialized services to the user 1. The service server 150 may be implemented with a CDSS (Clinical Decision Support System) in a medical authority.

[59] Fig. 3 illustrates a detailed configuration of the biological signal sensor apparatus, the stationary wireless sensor node, and the wireless sink node as shown in Fig. 2, all of which form the user interface system in accordance with the present invention.

[60] Referring to Fig. 3, the biological signal sensor apparatus 110 includes: a sensor unit

111 for sensing physical states and movements of the user 1 to generate biological signal data; a wireless communications unit 112 for wirelessly transmitting and receiving the biological signal data to and from the stationary wireless sensor node 120; a sensor network protocol processing unit 113 for performing end-to-end multi- hop communications between the wireless communications unit 112 and the stationary wireless sensor node 120 and processing protocols for the mobility support procedure; a processor 114 for controlling wireless data transmission and reception, the end- to-end multi-hop communications, and the mobility support procedure; and a connection unit 115 for connecting the sensor unit 111 and the processor 114. The sensor unit 111 has a pulse/pulse wave sensor 11 Ia, a blood pressure sensor 11 Ib, an electrocardiogram sensor 11 Ic, a body temperature sensor 11 Id, a blood-sugar sensor 11 Ie, an acceleration sensor 11 If, and an angular speed sensor 11 Ig. The sensor network protocol processing unit 113 may be implemented as independent hardware or firmware. The wireless communications unit 112 may be implemented by using a wireless communications standard using the license-free ISM (industrial, scientific, medical) radio bands, e.g., ZigBee (IEEE 802.15.4), Bluetooth, or the like. The biological signal sensor apparatus 110 may be made of a wrist- wearable type such as a wrist-band or a wrist- watch.

[61] The stationary wireless sensor node 120 includes: a wireless communications unit

121 for wirelessly transmitting and receiving the biological signal data to and from the biological signal sensor apparatus 110 and the wireless sink node 130; a sensor network protocol processing unit 122 for performing end-to-end multi-hop communications between the wireless communications unit 121 and the biological signal sensor apparatus 110 and processing protocols for the mobility support procedure; a processor 123 for controlling wireless data transmission and reception, the end-to-end multi-hop communications, and the mobility support procedure; a sensor unit 124 for sensing a living environment of the user 1; and a connection unit 125 for connecting the sensor unit 124 and the processor 123. The sensor unit 124 has a temperature sensor 124a, a humidity sensor 124b, and an illuminance sensor 124c. The stationary wireless sensor node 120 can be implemented without the sensors 124a to 124c and the connection unit 125 if the living environment of the user 1 needs not to be sensed. The stationary wireless sensor node 120 can be easily attached to the living spaces.

[62] The wireless sink node 130 includes: a wireless communications unit 131 for wirelessly transmitting and receiving the biological signal data to and from the stationary wireless sensor node 120; a sensor network protocol processing unit 132 for performing end-to-end multi-hop communications between the wireless communications unit 131 and the stationary wireless sensor node 120; a processor 133 for controlling wireless data transmission and reception and the end-to-end multi-hop communications; and a connection unit 134 for connecting the processor 133 and the service apparatuses 141 to 143. The connection unit 134 may use serial communications such as RS-232C, USB (Universal Serial Bus), and the like.

[63] Fig. 4 illustrates a detailed configuration view of a service apparatus shown in Fig. 2.

[64] Referring to Fig. 4, each of the service apparatuses 141 to 143 includes: a sink node connection unit 201 for providing a connection with the wireless sink node 130; a sink node application program interface (API) unit 202 for providing basic libraries to support communications with the wireless sink node 130; a sensor signal processing unit 203 for performing pre-processing, such as filtering, conversion, and the like, on the biological signal data received from the wireless sink node 130; and a sensor data analysis unit 204 for analyzing patterns of the pre-processed biological signal data by applying learning/recognizing algorithm such as a Hidden Markov Model (HMM), a neural network, and the like.

[65] Each of the service apparatuses 141 to 143 further includes: a user location management unit 205 for retrieving a current location information of the user 1 from a sensor map database (DB) 400 based on a nearby sensor node ID included in the biological signal data transmitted by the wireless sink node 130; a sensor data synthesis unit 206 for extracting new meaningful context by combining the biological signal data analyzed by the sensor data analysis unit 204 and data obtained by a subsidiary sensor apparatus (not shown) to assist the biological signal sensor apparatus 110; a service API unit 207 for providing libraries for use in development of application service programs; an application service unit 208 for providing application services to the user 1 via the service apparatuses 141 to 143 based on the biological signal data analyzed by the sensor data analysis unit 204 or synthesized by the sensor data synthesis unit 206 and the location information of the user 1 retrieved by the user location management unit 205; and a server interoperation unit 209 for providing interoperability with the service server 150. Here, the nearby sensor node ID and the sensor map DB 400 will be described below with reference to Fig. 5 and Fig. 6, respectively. [66] Fig. 5 illustrates a configuration of a sensor network protocol packet format for use in transmission of biological signal data in the user interface system in accordance with the present invention.

[67] Referring to Fig. 5, the sensor network protocol packet 300 includes a sensor network protocol header 310 and a sensor network protocol payload 320. The sensor network protocol payload 320 has: a sensor node ID field 321 indicating a unique ID of a sensor node that transmits current sensor data; a sensor message type field 322 indicating a current sensor data message type (e.g., a control message or a data message); a nearby sensor node ID field 323 indicating a unique ID of a nearby sensor node with which the sensor node that transmits the current sensor data is connected; a sensor data number field 324 indicating the number of sensor data included in the current sensor data message; and sensor data fields 325 containing actually sensed data, wherein the number of the sensor data fields 325 is identical to that of sensor data. Each of the sensor data fields 325 includes: a sensor type field 301 indicating a type of a sensor (e.g., an acceleration, an angular speed, a pulse, a blood pressure, or a body temperature sensor) that produces the sensor data included in the sensor data fields 325; a sensor value number field 302 indicating the number of sensor values included in the sensor data; and sensor value fields 303 including sensed data values, wherein the number of the sensor value fields 303 corresponds to the value of the sensor value number field 302.

[68] The reason for transmitting several sensor values for one sensor is to avoid a loss of the sensed data values during a transmission interval I_t when the transmission interval I_t is greater than a sensing interval I_s of a sensor (I_t > I_s). In addition to the above- described basic fields, the sensor network protocol payload 320 may include fields having a variety of message information suitable for applications.

[69] Fig. 6 illustrates a configuration of a sensor map database for use in the user interface system in accordance with the present invention. The sensor map database (DB) 400 is configured so that the user location management unit 205 of the service apparatus 141, 142 or 143 can retrieve a name of a space where a corresponding sensor node is installed and coordinate information of location of the corresponding sensor node by using the nearby sensor node ID field 323 as a key.

[70] Referring to Fig. 6, the sensor map DB 400 includes: a sensor node ID field 401 used as a database retrieval key; a sensor space name field 402 for storing a space name (e.g., an inner room, a living room, a garden) suitably defined for a service environment; and a sensor coordinate field 403 for storing a coordinate of the sensor node in a 2-dimensional or 3-dimensional coordinate system. In addition to the above- described basic fields, the sensor map DB 400 may include fields having a variety of message information suitable for applications. [71] From the sensor map DB 400, the user location management unit 205 retrieves the current location information of the user 1 based on the nearby sensor node ID 323 in the biological signal data.

[72] Figs. 7 to 10 illustrate an embodiment of a mobility support procedure for the biological signal sensor apparatus 110, which is a mobile wireless sensor node, or the wireless sink node 130 mounted on the intelligent robot 143 in the user interface system in accordance with the present invention. This embodiment is based on a tree topology in a sensor network, in which a mobile wireless sensor node or a wireless sink node is a leaf node and stationary wireless nodes in a service space serve as router nodes. The mobility support procedure in such a sensor network is a kind of handover protocol to seamlessly keep the connection between the sensor network and a node moving in the service space, i.e., the biological signal sensor apparatus 110 or the wireless sink node 130 mounted on the intelligent robot 143.

[73] (SI l)

[74] It is assumed that a biological signal sensor apparatus 110 currently worn on a wrist of a user holds a connection 601 with a sensor network via a stationary wireless sensor node 120 installed in a rest room (i.e., the user is currently located in the rest room) (see, Fig. 7).

[75] (S 12)

[76] If the user conducts a movement 602 to enter the inner room which is out of a radio coverage of the stationary wireless sensor node 120 installed in the rest room, the connection 601 is made to be interrupted (i.e., the user-worn sensor node is disconnected from the sensor network) (see, Fig. 8).

[77] (S 13)

[78] The biological signal sensor apparatus 110 detecting the disconnection searches for a stationary wireless sensor node 120 of which radio coverage 604 the user is located in (see, Fig. 9).

[79] (S 14)

[80] The biological signal sensor apparatus 110 creates a connection 605 with the searched stationary wireless sensor node 120 in the inner room, which is a nearby wireless sensor node (see, Fig. 10).

[81] The ID of the searched sensor node is a key for use in finding a space where the user is currently located. The ID is transmitted within the nearby sensor node ID field 323 of the above-described sensor network protocol packet 300, and, is used by the user location management unit 205 to retrieve the sensor map DB 400 of Fig. 6.

[82] Figs. 11 to 14 illustrate an embodiment of a mobility support procedure for the biological signal sensor apparatus 110, which is a mobile wireless sensor node, or the wireless sink node 130 mounted on the intelligent robot 143 in the user interface system in accordance with the present invention. This embodiment is based on the same tree topology in a sensor network as of Figs. 7 to 10, in which a mobile wireless sensor node or a wireless sink node is a leaf node and stationary wireless nodes in a service space serve as router nodes.

[83] (S21)

[84] The biological signal sensor apparatus 110 currently worn on a wrist of a user periodically receives Hello messages 701 from all stationary wireless sensor nodes 120 installed in a service environment around the user. The Hello messages 701 serve as RSSIs (received signal strength indicator) to find the most nearby stationary wireless sensor node 120 (see, Fig. 11).

[85] (S22)

[86] The biological signal sensor apparatus 110 creates and manages a nearby node table

800 of Fig. 15 based on the received Hello messages 701, and creates a connection 702 with a stationary wireless sensor node 120 having the highest wireless signal strength (i.e., a stationary wireless sensor node 120 at the nearest location) (see, Fig. 12).

[87] Fig. 15 illustrates a configuration view of an embodiment of the nearby node table

800 for use in the mobility support procedure for a wireless sensor node in the user interface system in accordance with the present invention. Referring to Fig. 15, the nearby node table 800 includes: a sensor node ID field 801 storing IDs of nearby stationary wireless sensor nodes 120; a wireless signal strength field 802 storing received signal strength of the respective stationary wireless sensor nodes 120; and a time stamp field 803 storing a time when a corresponding sensor node entry is created or lastly modified, wherein the time is used in searching for a sensor node entry which has not been updated for a specific period of time and deleting the sensor node entry from the nearby node table 800. In addition to the above-described basic fields, the nearby node table 800 may include fields having a variety of nearby node information suitable for applications.

[88] (S23)

[89] Even if the user conducts a movement 703 to enter an inner room, the biological signal sensor apparatus 110 continues to receive the Hello messages 701 from all stationary wireless sensor nodes 120 around the user (see, Fig. 13).

[90] (S24)

[91] After the user has conducted the movement 703, the biological signal sensor apparatus 110 selects a stationary wireless sensor node 120 having the highest wireless signal strength (i.e., a stationary wireless sensor node 120 at the nearest location) based on the Hello messages 701 and creates a connection 705 with the selected stationary wireless sensor node 120 (see, Fig. 14).

[92] Hereinafter, exemplary embodiments of the user interface system in accordance with the present invention will be described with reference to Figs. 16 to 20. The exemplary embodiments include a childcare service, an eldercare/infantcare service, a game/ education service, a ubiquitous healthcare service, and an electrical device remote control service. These services may be separately provided by independent systems, respectively, or, two or more of these services may be provided as a combined service by a single integrated system.

[93] Fig. 16 illustrates an exemplary view of the user interface system using a biological signal sensor apparatus to provide a childcare service.

[94] Referring to Fig. 16, the childcare service refers to a service in which, a biological signal sensor apparatus 110 senses behaviors of a child and a service apparatus such as an intelligent robot 143 or a home server 142 monitors and analyzes the behaviors via a sensor network to record the result or report the same to a guardian of the child in real time.

[95] First, the child wears the biological signal sensor apparatus 110, and, then, the biological signal sensor apparatus 110 senses data such as an acceleration, an angular speed, a pulse, a blood pressure, a location (a bedroom, a dining room, a computer room, etc.) and the like (steps S901 to 903). These data are required to recognize the behaviors (sleeping, dinning, gaming, and other various behaviors) of the child to be cared. The sensed data is transmitted to the intelligent robot 143 via the sensor network (step S904).

[96] The intelligent robot 143 performs pre-processing on the received sensor data through sensor data signal processing (step S905), and, then, recognizes meaning of the behaviors by performing sensor data analysis on the pre-processed sensor data and finds out a current location of the child wearing the sensor through location finding (step S906). The intelligent robot 143 synthesizes the analyzed sensor data and the location data to finally recognize the meaning of the behaviors (step S907), and provides the childcare service through childcare applications (step S908). To be specific, the intelligent robot 143 reports the behaviors to the guardian in real time (step S909), or stores the same in a database (step S910).

[97] Further, if a subsidiary visual sensor is mounted on the intelligent robot 143 as a subsidiary sensor, the intelligent robot 143 is made to move to a current user location and create subsidiary data such as user pose data through processing image obtained via the subsidiary sensor (step S911). By using the subsidiary data in the data synthesis, the intelligent robot 143 can recognize the behaviors more accurately. In order to provide more intelligent and effective services, the intelligent robot 143 may automatically output, using a voice output device or a speaker mounted thereon, a speech to control or restrict behaviors of the child, or may allow the guardian to have a conversation with the child in real time. [98] Fig. 17 illustrates an exemplary view of the user interface system using a biological signal sensor apparatus to provide an eldercare/infantcare service.

[99] Referring to Fig. 17, the eldercare/infantcare service refers to a service in which, a biological signal sensor apparatus 110 senses states of an elder or an infant who cannot freely move or talk, and a service apparatus such as an intelligent robot 143 or a home server 142 monitors and analyzes the states via a sensor network to record the result, report the same to a guardian thereof in real time, or call emergency rescue.

[100] First, the elder or the infant wears the biological signal sensor apparatus 110, and, then, the biological signal sensor apparatus 110 senses data such as an acceleration, an angular speed, a pulse, a blood pressure, a body temperature, a location and the like (steps SlOOl to 1003). These data are required to recognize the states (movements while sleeping, falling from a bed, a body temperature of an infant, and other various states) to be observed. The sensed data is transmitted to the intelligent robot 143 via the sensor network (step S1004).

[101] The intelligent robot 143 performs pre-processing on the received sensor data through sensor data signal processing (step S 1005), and, then, recognizes meaning of the states by performing sensor data analysis on the pre-processed sensor data and finds out a current location of the elder/infant wearing the sensor through location finding (step S 1006). The intelligent robot 143 synthesizes the analyzed sensor data and the location data to finally recognize the meaning of the states (step S 1007), and provides the eldercare/infantcare service through eldercare/infantcare applications (step S 1008). To be specific, the intelligent robot 143 reports the states to the guardian in real time (step S1009), calls emergency rescue (step SlOlO), or stores the states in a database (step SlOI l).

[102] Further, if a subsidiary visual sensor is mounted on the intelligent robot 143 as a subsidiary sensor, the intelligent robot 143 is made to move to a current user location and create subsidiary data such as user pose data through processing image obtained via the subsidiary sensor (step S1012). By using the subsidiary data in the data synthesis, the intelligent robot 143 can recognize the states more accurately. In order to provide more intelligent and effective services, the intelligent robot 143 may automatically output, using a voice output device or a speaker mounted thereon, a speech to relieve the user, or may allow the user to have a conversation with the guardian or emergency rescuer in real time.

[103] Fig. 18 illustrates an exemplary view of the user interface system using a biological signal sensor apparatus to provide a game/education service.

[104] Referring to Fig. 18, a user interface of the game/education service is not a joystick, other existing game interface, or a general user interface device such as a mouse or a keyboard. Instead, a biological signal sensor apparatus 110 senses movements of hands of a user and changes of physical states of the user. The biological signal sensor apparatus 110 transmits sensor data to a service apparatus such as a computer, an intelligent robot or a home server, and the service apparatus analyzes the sensor data to provide a variety of games, educational application programs and content, and the like.

[105] First, a child, who is a user of the game/education service, wears the biological signal sensor apparatus 110, and, then, the biological signal sensor apparatus 110 senses data such as an acceleration, an angular speed, a pulse, a location and the like (steps SI lOl). These data are required to recognize behaviors and states of the user to provide games, educational application programs and content, and the like. The sensed data is transmitted to an intelligent robot 143, for example, via the sensor network (step Sl 102).

[106] The intelligent robot 143 performs pre-processing on the received sensor data through sensor data signal processing (step S 1103), and, then, recognizes the behaviors and the states of the user by performing sensor data analysis on the pre-processed sensor data and finds out a current location of the user wearing the sensor through location finding (step Sl 104). The intelligent robot 143 synthesizes the analyzed sensor data and the location data to finally recognize the meaning of the behaviors and the states of the user (step S 1105), and provides the game/education service through game/education applications (step S 1106).

[107] In such a game/education service, movements data of the user obtained by, e.g., an acceleration sensor and an angular speed sensor is used as a means for replacing an user input device in the game or education, and physical state data of the user obtained by, e.g., a pulse sensor is used to detect changes of the physical states of the user under the game/education service. For example, in a game service, a pulse of a user playing the game for a certain period of time is monitored via the sensor network to measure a fatigue or excitement level of the user and responses thereto are made in an intelligent manner (step S 1107), thereby providing more excellent game service. Further, the user location data can be used for automatic termination of the game or education when the user moves to other space, or can be used for a location-based game such as a hide- and-seek game with the intelligent robot 143 which is a movable service apparatus.

[108] Further, if a subsidiary visual sensor is mounted on the intelligent robot 143 as a subsidiary sensor, the intelligent robot 143 is made to create subsidiary data such as user pose data or a color or shape data of item used in the game or education through processing image obtained via the subsidiary sensor (step Sl 108). By using the subsidiary data in the data synthesis, the intelligent robot 143 can recognize the user input more accurately, thereby providing more intelligent and effective services.

[109] Fig. 19 illustrates an exemplary view of the user interface system using a biological signal sensor apparatus to provide a ubiquitous healthcare service. [110] Referring to Fig. 19, the ubiquitous healthcare service is a service in which, a biological signal sensor apparatus 110 senses ordinary physical states of a chronic patient, physical states while exercising, physical states in an emergency situation, and the like, and a service apparatus such as an intelligent robot 143 or a home server 142 monitors and analyzes the states via a sensor network to, perform a regular medication, a blood pressure/blood sugar measurement, an exercise amount management, or an emergency rescue call when necessary.

[I l l] First, a user (a chronic patient or a night worker) for whom the healthcare service is needed wears the biological signal sensor apparatus 110, and, then, the biological signal sensor apparatus 110 senses data such as a pulse, a blood pressure, a body temperature, a blood sugar, an acceleration, an angular speed, a blood pressure, a location and the like (steps S1201 to 1203). These data are necessary for chronic disease care, exercise amount care, or emergency care such as a blackout or a heat attack. The sensed data is transmitted to the intelligent robot 143 via the sensor network (step S 1204).

[112] The intelligent robot 143 performs pre-processing on the received sensor data through sensor data signal processing (step S 1205), and, then, recognizes meaning of the states by performing sensor data analysis on the pre-processed sensor data and finds out a current location of the user wearing the sensor through location finding (step S 1206). The intelligent robot 143 synthesizes the analyzed sensor data and the location data to finally recognize the meaning of the states (step S 1207), and provides the healthcare service through healthcare applications (step S 1208). To be specific, the intelligent robot 143 performs a regular medication and a blood pressure/blood sugar measurement (step S1209), manages exercise amount (step S1210), or calls emergency rescue (step S 1211) when necessary.

[113] In particular, records for the regular medication, blood pressure/blood-sugar measurement, and ordinary exercise amount are recorded in a server in a medical authority which provides medical services to the user and utilized as data for medical treatment (step S 1212).

[114] Further, if a subsidiary visual sensor is mounted on the intelligent robot 143 as a subsidiary sensor, the intelligent robot 143 is made to move to a current user location and create subsidiary data such as user pose data through processing image obtained via the subsidiary sensor (step S1213). By using the subsidiary data in the data synthesis, the intelligent robot 143 can recognize the states more accurately. In order to provide more intelligent and effective services, the intelligent robot 143 may regularly notify, using a voice output device or a speaker mounted thereon, a medication time or a blood pressure/blood sugar measurement time, or may inform advice on exercise amount or emergency measures to be taken by the user in an emergency situation. Further, the intelligent robot 143 may allow the user to have a conversation with an emergency rescuer in real time.

[115] Fig. 20 illustrates an exemplary view of the user interface system using a biological signal sensor apparatus to provide an electrical device remote control service.

[116] Referring to Fig. 20, a user interface of the electrical device remote control service is not a remote controller using buttons or a joystick. Instead, a biological signal sensor apparatus 110 senses movements of hands of a user. The biological signal sensor apparatus 110 transmits sensor data to a service apparatus such as a computer 141, a home server 142, or an intelligent robot 143, and the service apparatus remotely controls electrical devices in service spaces.

[117] First, the user wears the biological signal sensor apparatus 110, and, then, the biological signal sensor apparatus 110 senses data such as an acceleration, an angular speed, a location and the like (steps S1301). The data are required to recognize behaviors of the user to remotely control an electrical device, e.g., the intelligent robot 143. The sensed data is transmitted to the intelligent robot 143, which is a control object, via the sensor network (step S 1302).

[118] The intelligent robot 143 performs pre-processing on the received sensor data through sensor data signal processing (step S 1303), and, then, recognizes the behaviors conducted by the user for remote control by performing sensor data analysis on the pre-processed sensor data and finds out a current location of the user wearing the sensor through location finding (step S 1304). The intelligent robot 143 synthesizes the analyzed sensor data and the location data to finally recognize control commands (step S 1305), and is remotely controlled through electrical device control applications (step S1306).

[119] Further, if a subsidiary visual sensor is mounted on the intelligent robot 143 as a subsidiary sensor, the intelligent robot 143 is made to create subsidiary data such as user pose data through processing image obtained via the subsidiary sensor (step S1307). By using the subsidiary data in the data synthesis, the intelligent robot 143 can recognize the control commands from the user more accurately, so that more intelligent and effective remote control services can be provided.

[120] While the invention has been shown and described with respect to the embodiments, it will be understood by those skilled in the art that various changes and modification may be made without departing from the scope of the invention as defined in the following claims.

Claims

[1] A biological signal sensor apparatus worn on a user's body, comprising: a sensor unit for sensing physical states or movements of a user to generate biological signal data; a wireless communications unit for performing wireless data communications with a wireless sensor network to transmit the biological signal data; a sensor network protocol processing unit for processing protocols for end-to-end communications between the wireless communications unit and the wireless sensor network and for performing a mobility support procedure for the biological signal sensor apparatus; a processor for controlling the wireless data communications, the end-to-end communications, and the mobility support procedure to allow the biological signal sensor apparatus to serve as a mobile wireless sensor node; and a connection unit for connecting the sensor unit and the processor.

[2] The biological signal sensor apparatus of claim 1, wherein the sensor unit includes at least one of a pulse/pulse-wave sensor, a blood pressure sensor, an electrocardiogram sensor, a body temperature sensor, and a blood sugar sensor.

[3] The biological signal sensor apparatus of claim 1, wherein the sensor unit includes at least one of an acceleration sensor and an angular speed sensor.

[4] The biological signal sensor apparatus of claim 1 , wherein the sensor network protocol processing unit is implemented as independent hardware or firmware.

[5] A wireless sensor network, comprising: a biological signal sensor apparatus, worn on a user's body and serving as a mobile wireless sensor node, for sensing biological signals of a user to generate biological signal data; a plurality of stationary wireless sensor nodes, installed in living spaces of the user, for performing wireless communications with the biological signal sensor apparatus; and a plurality of wireless sink nodes wirelessly connected with the stationary wireless sensor nodes to form the wireless sensor network.

[6] The wireless sensor network of claim 5, wherein each of the stationary wireless sensor nodes includes: a wireless communications unit for performing wireless data communications with the biological signal sensor apparatus and the wireless sink nodes; a sensor network protocol processing unit for processing protocols for end-to-end communications between the wireless communications unit and the biological signal sensor apparatus and for performing a mobility support procedure for the biological signal sensor apparatus; and a processor for controlling the wireless data communications, the end-to-end communications, and the mobility support procedure.

[7] The wireless sensor network of claim 6, wherein each of the stationary wireless sensor nodes includes: a sensor unit for sensing environmental conditions in the living spaces; and a connection unit for connecting the sensor unit and the processor.

[8] The wireless sensor network of claim 7, wherein the sensor unit includes at least one of a temperature sensor, an illuminance sensor, and a humidity sensor.

[9] The wireless sensor network of claim 5, wherein each of the wireless sink nodes includes: a wireless communications unit for performing wireless data communications with the stationary wireless sensor nodes; a sensor network protocol processing unit for processing protocols for end-to-end multi-hop communications between the wireless communications unit and the stationary wireless sensor nodes; a processor for controlling the wireless data communications and the end-to-end multi-hop communications; and a connection unit for connecting the processor and external service units for providing application services to the user through the connection unit.

[10] A user interface system, comprising: a biological signal sensor apparatus, worn on a user's body and serving as a mobile wireless sensor node in a wireless sensor network, for sensing biological signals of a user to generate biological signal data; a plurality of stationary wireless sensor nodes, installed in living spaces of the user, for performing wireless communications with the biological signal sensor apparatus; a plurality of wireless sink nodes wirelessly connected with the stationary wireless sensor nodes to form the wireless sensor network; and a service unit for processing the biological signal data transmitted via the wireless sink nodes to provide to the user application services based on location information of the user who stays in any one of the living spaces in the wireless sensor network.

[11] The user interface system of claim 10, wherein the service unit includes: a sink node connection unit; a sink node application program interface unit for providing basic libraries to support communications with the wireless sink nodes; a sensor signal processing unit for performing pre-processing on the biological signal data received from the wireless sink nodes; a sensor data analysis unit for analyzing patterns of the pre-processed biological signal data by applying learning/recognizing algorithm thereto; a user location management unit for obtaining the location information of the user based on the biological signal data received from the wireless sink nodes; and an application service unit for providing the application services to the user based on the analyzed biological signal data and the location information of the user.

[12] The user interface system of claim 11, wherein the service unit further includes a service application program interface unit for providing libraries for use in program development for the application services.

[13] The user interface system of claim 11, further comprising: a service server, connected with the service unit via an external communications network, for providing to the user the application services based on the biological signal data via the service unit, wherein the service unit further includes a server interoperation unit for providing interoperability with the service server.

[14] The user interface system of claim 11, further comprising: a subsidiary sensor apparatus for obtaining image data of the user to assist the biological signal sensor apparatus, wherein the service unit further includes a sensor data synthesis unit for combining the analyzed biological signal data and the image data obtained by the subsidiary sensor apparatus to extract meaningful context therefrom and transmitting the meaningful context to the application service unit to provide the application services.

[15] The user interface system of claim 10, wherein the service unit includes a service apparatus, connected with the wireless sink nodes, for providing the application services via application programs of its own.

[16] The user interface system of claim 15, wherein the service apparatus includes at least one of a computer accessible to the wireless sink nodes and external communications networks, a home server accessible to the wireless sink nodes and the external communications networks and forming a home network, and an intelligent robot accessible to the external communications networks via a wireless local area network and the wireless sink nodes.

[17] The user interface system of claim 10, wherein the service unit includes: a service apparatus connected with the wireless sink nodes; and a host apparatus, connected with the service apparatus, for providing the ap- plication services via application programs embedded therein.

[18] The user interface system of claim 11, wherein a sensor network protocol packet for use in transmission of the biological signal data includes a sensor network protocol header and a sensor network protocol payload, and the sensor network protocol payload has: a sensor node ID (identification) field indicating a sensor node ID of a sensor node transmitting current sensor data; a sensor message type field indicating a message type of the current sensor data, the message type including a control message and a data message; a nearby sensor node ID field indicating a sensor node ID of a nearby sensor node with which the sensor node transmitting the current sensor data is connected; a sensor data number field indicating the number of sensor data contained in the sensor network protocol packet; and one or more sensor data fields containing the sensor data, the number of sensor data fields corresponding to the number of sensor data.

[19] The user interface system of claim 18, wherein each of the sensor data fields includes: a sensor type field indicating a type of sensor that senses corresponding sensor data; a sensor value number field indicating the number of sensor values contained in the corresponding sensor data; and one or more sensor value fields indicating sensor values, the number of the sensor value fields corresponding to the value of the sensor values.

[20] The user interface system of claim 18, wherein the service unit further includes a sensor map DB (database) from which a space name of a space where a sensor node is installed and a coordinate of a location of the sensor node are retrieved by using a sensor node ID of the sensor node as a key, and the user location management unit obtains location information of the user by retrieving the sensor map DB using the sensor node ID of the nearby sensor node.

[21] The user interface system of claim 20, wherein the sensor map DB includes: a sensor node ID field to be used as the key; a sensor space name field for storing the space name suitably defined for a service environment; and a sensor coordinate field for storing the coordinate in a 2-dimensional or

3-dimensional coordinate system.

[22] The user interface system of claim 20, wherein if the biological signal sensor apparatus, which has been connected with the wireless sensor network via a stationary wireless sensor node among the stationary wireless sensor nodes, goes out of a radio coverage of the stationary wireless sensor node, the biological signal sensor apparatus searches for another stationary wireless sensor node having a radio coverage within which the user is located and creates a new connection therewith.

[23] The user interface system of claim 22, wherein the biological signal sensor apparatus sets the nearby sensor node ID field of the sensor network protocol payload to be transmitted as the sensor node ID of the stationary wireless sensor node with which the new connection is created.

[24] The user interface system of claim 20, wherein the biological signal sensor node measures signal strength of a message received from each of the stationary wireless sensor nodes and creates a connection with a stationary wireless sensor node which transmits a message having the highest signal strength.

[25] The user interface system of claim 24, wherein the biological signal sensor node creates and manages a nearby node table based on the measured signal strength.

[26] The user interface system of claim 25, wherein the nearby node table includes: a sensor node ID field storing the sensor node ID of each of the stationary wireless sensor nodes located around the user; and a wireless signal strength field for storing the signal strength for each of the stationary wireless sensor nodes.

[27] The user interface system of claim 26, wherein the nearby node table further includes a time stamp field for storing a time when a corresponding sensor node entry is created or lastly modified, wherein the time is used in searching for a sensor node entry which has not been updated for a specific period of time and deleting the sensor node entry from the nearby node table.

[28] The user interface system of claim 10, wherein the biological signal sensor apparatus senses child's behavior information as the biological signal data, and, wherein the service unit provides the application services managing the child's behavior information.

[29] The user interface system of claim 10, wherein the biological signal sensor apparatus senses elder's or infant's state information as the biological signal data, and, wherein the service unit provides the application services managing the elder's or infant's state information.

[30] The user interface system of claim 10, wherein the biological signal sensor apparatus senses movements and changes of physical states of the user as the biological signal data, and, wherein the service unit provides the application services relating games or educations by analyzing the movements and the changes of physical states.

[31] The user interface system of claim 10, wherein the biological signal sensor apparatus senses health information of the user as the biological signal data, and, wherein the service unit provides the application services relating healthcare by analyzing the health information.

[32] The user interface system of claim 10, wherein the biological signal sensor apparatus senses hand-signs of the user as the biological signal data, and, wherein the service unit provides the application services relating remote control on electrical devices by analyzing the hand- signs.