KR20100042801A - Smart sensor system for activity awareness - Google Patents

Abstract

PURPOSE: A smart sensor system for activity awareness is provided to sense the characteristic behavior of a user and detect the position within a user space even through the user does not possess a restrictive-attachable signal generator. CONSTITUTION: An intelligent sensor platform(100) senses the location and behavior of a user, and a behavior inferring engine(200) figures out the location and behavior of a user from raw context data from the intelligent sensor platform., and provides a user with a service proper to the his/her situation. The intelligent sensor platform comprises a sensor node(110) and a sensor coordinator(120). The behavior inferring engine comprises a behavior recognition module(210) and a service module(220).

Description

Intelligent Sensor System for Behavior Detection {SMART SENSOR SYSTEM FOR ACTIVITY AWARENESS}

The present invention relates to a self-contained, non-self-contained sensor system, in particular, to detect the user's location and behavior without the restraining equipment, to determine the user's location, situation and behavior to automatically provide a suitable service to the user For an intelligent sensor system.

With the development of information and communication technology, the base of the wireless communication environment is gradually increasing, such as the wireless Internet is possible, and the interest of academics and the general public is increasing.

Within these concerns, the concept of 'home networking' or 'ubiquitous' is gradually taking place.

Here, home networking means building a network between various information devices in a home.

In more detail, it means creating an environment in which information appliances can communicate with each other through wired and wireless networks and connect with each other through the Internet.

Ubiquitous has a dictionary meaning of 'ubiquitous, ubiquitous at the same time', and means an environment that can access a computer anytime and anywhere.

In order to realize the home networking and ubiquitous environment in real life, development of a sensor system that detects a person's behavior or location must be preceded.

That is, a person can determine the situation where a person is located according to a location or an action and a suitable service can be provided, and the service must be equipped with a wired / wireless network detection system that can be provided immediately at a desired time and place. Home networking and ubiquitous environments can be created.

In general, a bracelet or necklace type signal transmitter is often used to grasp the position of a person in a space, but the signal transmitter has a risk of loss and hassle that a person should install it separately, and has a high humidity. There is a problem that is restricted by many environmental factors such as not available in.

In addition, when capturing a person in an image to grasp a person's behavior or location, there is a possibility that the privacy data is breached by leaking the photographed data to the outside.

The present invention is provided to solve the above-described problem, an object of the present invention is to determine the location in the user's space, even if the user does not have a separate restraining-detachable signal generator, and to detect the specific behavior of the user To provide an intelligent sensor system for behavior detection.

Still another object of the present invention is to automatically create an environment in a space according to information for each user.

Still another object of the present invention is to promptly cope with a crisis when a crisis occurs in the user, and to receive help from the structure of the space in which the user is located until the user exits the crisis.

Still another object of the present invention is to provide an intelligent sensor system for behavior detection, which does not have the possibility of leaking user's personal information.

Intelligent sensor system for behavior detection according to the present invention for achieving the above object, the user's position and behavior through a non-restrained, self-aware device, and information is transmitted to each other through wireless communication between each component A sensor system comprising: an intelligent sensor platform; and an action decision inference engine that grasps a location and an operation state of a user from raw situation data transmitted from the intelligent sensor platform, and provides a service suitable for a situation. The intelligent sensor platform includes a plurality of sensor nodes installed inside a building to perform actual user detection, and collect sensor nodes that control structures in the space according to signals transmitted from the behavior decision inference engine, and wireless data transmitted from the sensor nodes. Suitable for delivery to the behavior decision inference engine It is provided with a sensor coordinator to process the raw situation data of the equation, the behavior determination inference engine, grasping the position and operation of the user from the raw situation data transmitted from the sensor node, the shape and space of the user-specific information and space It is characterized in that it is provided as a behavior recognition module for storing the information of the various structures constituting the, and the service module for analyzing the integrated context data transmitted from the behavior recognition module, select the appropriate service for each situation to the user.

Here, the sensor node is provided in the space in which the user resides and the structures in the space, so as to sense the temperature or the amount of light in the space or the manipulation state of the structure of the user, or through the light, heat, ultrasonic waves, pressure, etc. The sensing member for detecting the behavior of the user, and converts the user, structure, and spatial information detected by the sensing member into a signal suitable for wireless communication, and transmits the structure control signal transmitted from the sensor coordinator to the structure control member to be described later A sensor process member and a signal transmitted from the sensor processor member to the sensor coordinator to transmit a signal on a wireless channel in the air, and receives the radio signal transmitted from the sensor coordinator to transmit to the sensor process member A wireless communication member and the sensor process member According to the control signaling may be provided to the structure control member for controlling the structure of the status or operation in the space.

The sensor coordinator may include: a sensor node interface provided separately for each sensor node and receiving a radio signal transmitted from the sensor node, or transmitting a signal transmitted from a sensor node management member to be described later to a sensor node; A sensor node management member which collects the signals transmitted from all the sensor node interfaces and generates raw situation data by integrating information such as the time at which the sensing is performed, the location where the sensor node is installed, and the positional relationship of the sensor nodes; It may be provided as a network interface for converting the raw situation data transmitted from the node management member into a signal suitable for wired or wireless communication and transmitting it to the behavior recognition module of the behavior decision inference engine.

In addition, the behavior recognition module, the behavior information analysis unit for analyzing the raw situation data transmitted from the sensor coordinator to determine the location in the sensed space and to generate the basic data for analyzing the user's motion, and the behavior A behavior information integration processor for integrating the basic data transmitted from the information analysis unit and the data transmitted from the behavior recognition unit and the behavior information manager described later to analyze the situation in which the user is in real time and generate integrated context data in 5W1H format; A static space modeling unit for setting three-dimensional coordinates according to the size and structure of the space in which the user resides or is active with reference to the height and installation angle at which the sensor node is installed, and the behavior by referring to the three-dimensional coordinates of the static space modeling unit Determine the behavior pattern of the user transmitted through the information integration processing unit, and add Behavior recognition unit that can receive the behavior pattern data of the user, a structure management unit for receiving the position and status information about the structure, such as household appliances provided in the space in which the user lives or activities, and input through the structure management unit A behavior information management unit for receiving user's behavior pattern information associated with the structure in the space, and classifying the user's situation according to the type of the structure and the user's behavior pattern, inputting information for each user, and the structure management unit The structure information and the situational behavior pattern information input through the behavior information management unit may be provided as a data storage unit for storing the user information, the structure information and the situation information, respectively.

In addition, the service module, the service analysis unit for selecting a service suitable for the situation by analyzing the integrated context data of the 5W1H format transmitted from the behavior recognition module, and in connection with the user-specific information stored in the behavior recognition module of each user A user information processing unit that infers and selects a service suitable for a user from a past record, or receives a service suitable for the user, and an available device manager for identifying and managing the operation and abnormality of the structure stored in the behavior recognition module; A service management unit for managing the list of services and the required structure for each service, and a service driver for providing a suitable service to the user according to the signal generated by the service analysis unit, user information processing unit, available device management unit and service management unit It can be prepared as.

Here, the sensing member of the sensor node may be provided as a vibration sensor, a temperature sensor, an infrared sensor, a light amount sensor, a pressure sensor, a voltage power sensor.

In addition, the sensor node is installed at a location having various heights such as structures, ceilings, side walls, and floors in the space where the user is active, thereby detecting one user repeatedly through a plurality of sensor nodes, and thus the user's behavior pattern. The accuracy of the detection can be increased.

The wireless communication member of the sensor node may perform wireless communication through any one of WLAN, Bluetooth, or personal area wireless communication (WPAN).

In addition, the sensor process member of the sensor node may be characterized in that the sensor operating program is implemented through TinyOS.

Meanwhile, the situation information stored in the data storage unit of the behavior recognition module includes individual risk level information according to the location patterns in the space or the behavior pattern for each location within the space, and the risk level information of each structure is included in the structure information of the data storage unit. Can be.

Preferably, when the user stays in a place classified as a dangerous area in the space, or when the user takes an action corresponding to the risk level at a specific location, the detection sensitivity of the sensor node is increased, and the behavior information integrated processor warns. Integrated context data including the preliminary signal may be generated.

The service signal generated by the service driver includes a control signal for controlling a structure in a space where a user is active and is transmitted to the sensor coordinator.

According to the present invention, even if the user does not have a separate restraint-removable signal generator, the user can grasp the position in the space and can sense the specific behavior of the user.

In addition, according to the present invention, the environment in the space can be automatically created according to the information for each user.

In addition, according to the present invention, when a crisis situation occurs to the user, it is possible to quickly cope with the crisis, it is possible to get help from the structure of the space in which the user is located until the user exits the crisis situation.

In addition, according to the present invention, it is possible to provide a sensing system in which there is no possibility that a user's personal information is leaked.

Hereinafter, with reference to the accompanying drawings will be described in detail with respect to the present invention.

Prior to this, terms used in the present specification and claims should not be construed in a dictionary meaning, and the inventors may properly define the concept of terms in order to explain their invention in the best way. It should be construed as meaning and concept consistent with the technical spirit of the present invention.

Therefore, the configurations shown in the embodiments and drawings described herein are only preferred embodiments of the present invention, and do not represent all of the technical idea of the present invention, and various equivalents may be substituted for them at the time of the present application. It is to be understood that water and variations may exist.

1 is a block diagram of an intelligent sensor system for detecting behavior according to the present invention.

Referring to FIG. 1, the intelligent sensor system for detecting behavior according to the present invention detects a user's location and behavior through an unrestrained and insensitive device, and intelligently transmits information through wireless communication between each component. Sensor system including a sensor platform 100 and a behavior decision inference engine 200 that grasps the location and operation state of the user from the raw situation data transmitted from the intelligent sensor platform, and provides a service suitable for the situation to the user. In the intelligent sensor platform 100, a plurality of sensor nodes 110 are installed in the interior of the building to perform a substantial user detection, and control the structure in the space according to the signal transmitted from the behavior decision inference engine, and A type suitable for collecting and transmitting wireless data transmitted from the sensor node to the behavior decision inference engine. It is provided with a sensor coordinator 120 to process the raw situation data of the, the behavior decision inference engine 200, grasp the location and operation of the user from the raw situation data transmitted from the sensor node 110, for each user Behavior recognition module 210 that stores the information and the shape of the space and information of the various structures constituting the space, and analyzes the integrated context data transmitted from the behavior recognition module 210, and selects a service suitable for each situation to the user Characterized in that it is provided with a service module 220 to provide.

Here, the sensor node 110 is provided in the space in which the user resides and the structures in the space, so as to sense the temperature or the amount of light in the space or the operation state of the structure of the user, or to the remote or through the light, heat, ultrasound, pressure, etc. Sensing member 111 for detecting a user's behavior at a short distance, and converts the user, structure, and spatial information detected by the sensing member 111 into a signal suitable for wireless communication, and transmitted from the sensor coordinator 120 The sensor process member 113 for transmitting the structure control signal to the structure control member 112, which will be described later, and the radio channel in the air to transmit the signal transmitted from the sensor processor member 113 to the sensor coordinator 120. Wireless communication to transmit a signal to the sensor coordinator 120, and receives the wireless signal transmitted from the sensor coordinator (120) The member 114 and the structure control member 112 for controlling the state or operation of the structure in the space according to the control signal transmitted from the sensor process member 113 may be provided.

One sensor node 110 is an independent sensing device incorporating all of the sensing member 111, the structure control member 112, the sensor process member 113, and the wireless communication member 114. ) May be provided in a structure in which the structure control member 112 is omitted.

The sensing member 111 is a sensing sensor that substantially detects a user's position and motion in a space. Specifically, the sensing member 111 includes a vibration sensor, a temperature sensor, an infrared sensor, a light intensity sensor, a pressure sensor, a voltage power sensor, and the like. Can be prepared as.

For example, when the sensor node 110 is provided in the lighting device in the space, the sensor node 110 may be provided by measuring the illuminance of the lighting or the magnitude of the current and voltage flowing through the lighting device.

Alternatively, when the sensor node 110 is provided as an infrared sensor on the ceiling inside the space where the user resides, the sensor node 110 can detect the user's body temperature or the user's shape outline.

Alternatively, when the sensor node 110 is provided as a pressure sensor on a sofa provided in the space where the user resides, the sensor node 110 can detect the user's weight or the user's motion.

That is, the sensing member 111 is included in the surrounding environment of the user, so that the user can grasp the state or the position of the user without having a separate signal generator.

The sensor process member 112 is a key control device of the sensor node 110. The sensor process member 112 converts a signal generated from the sensing member 111 into a signal suitable for wireless transmission, and holds an identification ID unique to the sensor node 110. It plays a role.

Since the sensing signal generated from the sensing member 111 is only a simple electrical code, it is necessary to convert a signal for transmitting it wirelessly.

In addition, when a signal is transmitted from the sensing member 111 in real time, time information needs to be added for each sensing signal, and such an operation is performed in the sensor process member 112.

Meanwhile, since a plurality of sensor nodes 110 may be provided in a space where a user resides, an identification ID for each sensor node 110 to distinguish signals transmitted from each sensor node 110 and prevent crosstalk of the signals. The identification ID of the sensor process member 112 may be provided by including a radio frequency identification tag (RFID) in the sensor node 110, but is not limited thereto.

Here, the RFID tag has a semiconductor chip and a small antenna embedded with the detailed information of the object on which the RFID tag is mounted, and can transmit information of the object from several m to several tens of meters through a radio frequency method. Means a frequency system, when the sensor process member 112 is provided with a microprocessor, the radio recognition tag may be integrally implemented.

As such, the plurality of sensor nodes 110 installed in the space operate independently of each other and are distinguished by the identification ID, so that some sensor nodes 110 may be detached from the attached position, newly added, or fail. It has no effect on other sensor nodes 110.

The sensor node 110 may receive power for operation wirelessly from the outside, or may be directly provided from the structure including the sensor node 110. For the efficiency and availability of the entire system, the sensor node 110 is extremely Less energy must be consumed and power must be managed efficiently.

In order to meet such requirements, an operating program for controlling the operation of the sensor process member 112 may be implemented in TinyOS, but is not limited thereto.

Here, TinyOS is a system technology designed for a sensor network, which is excellent in parallel processing of processes, excellent in the ability to operate limited memory, and reduces power consumption of the entire system by transitioning to the idle state when the microprocessor is not in use. Have

In particular, TinyOS has a database and security system for efficiently managing sensor information transmitted through sensors, making it suitable for ubiquitous network environments.

The structure control member 113 is provided to control the operation of the structure according to a service signal generated from a service module to be described later when the sensor node 110 is provided inside a specific structure in a space where the user resides.

As described above, when the sensor node 110 is provided in the lighting device, the brightness or brightness of the lighting device is controlled according to the service signal.

The wireless communication member 114 is provided for wireless communication between the sensor node 110 and the sensor coordinator 120, and exchanges a wireless signal with the sensor node interface 121 of the sensor coordinator 120 to be described later.

Preferably, the wireless communication member 114 may perform wireless communication through any one of a wireless LAN (WLAN), Bluetooth, or personal area wireless communication (WPAN), but is not limited thereto. no.

Here, when the wireless LAN method is used for wireless communication of the wireless communication member 114, the existing networking can be used as it is, and by using the ISM frequency band, it is possible to utilize the advantage that the radio wave fee is not separately charged.

In addition, when the Bluetooth method is used for wireless communication of the wireless communication member 114, wireless communication is possible even when the sensor node 110 is not exposed to the external space, and by using the ISM frequency band as in the wireless LAN method. It is possible to take advantage of the fact that radio wave charges are not charged separately, and it is possible to transmit and receive signals with low power consumption.

On the other hand, when the personal area wireless communication method is used for wireless communication of the wireless communication member 114, low power and low cost radio wave transmission and reception are enabled through ZigBee, a low-speed home automation network standard technology, and 255 sensors in one wireless network. The advantage that the node 110 can be provided may be utilized.

Preferably, the sensor node 110 is installed at a location having various heights such as structures, ceilings, side walls, and floors in a space where a user is active, thereby overlapping one user through a plurality of sensor nodes 110. Can be detected.

That is, when the infrared sensor node 110 provided on the ceiling in the space, the pressure sensor node 110 provided on the sofa and the infrared sensor node 110 provided on the wall performs detection as a group, The user's motion can be detected in consideration of the user's shape when looking down at the user, the user's shape when looking at the user, and the area in which the user is sitting on the couch.

As such, when sensing is performed as one group, the sensor node management member 1220 to be described later includes the three sensor nodes 110 in the detection signal indicating that the three sensor nodes 110 are the same group.

In addition, by analyzing the detection signals detected as a group in the behavior recognition module 210 to be described later, it is possible to increase the accuracy of the user behavior pattern analysis through the mutual comparison of each sensor node 110 data, a plurality of users in one space If present, the accuracy of user discrimination can also be increased.

The sensor coordinator 120 receives a wireless signal transmitted from the sensor node 110 or transmits a signal transmitted from the sensor node management member 122 to be described later to the sensor node 110. And collecting the signals transmitted from all the sensor node interfaces 121 and integrating information such as the time at which the detection is performed, the location where the sensor node 110 is installed, and the positional relationship between the sensor nodes 110, and the like. The sensor node management member 122 and the raw situation data transmitted from the sensor node management member 122 are converted into a signal suitable for wired or wireless communication so as to recognize the behavior of the behavior determination inference engine 200 ( It may be provided as a network interface 123 for transmitting to the 210.

The sensor coordinator 120 may be provided as one person in each space, but is not limited thereto. The sensor coordinator 120 may be installed in a place where signals can be easily received from all sensor nodes 110.

The sensor node interface 121 is provided with a receiver according to a communication method used in the wireless communication member 114 of the sensor node 110, and receives a signal transmitted from the sensor node 110 as well as to be described later. The service signal of the service driver 225 received by the network interface 123 may be transmitted to the sensor node 110.

The sensor node management member 122 is a core component of the sensor coordinator 120, and serves to generate raw situation data by integrating the signals of all sensor nodes 110 connected to the sensor coordinator 120.

When the raw situation data is generated, as described above, sensing signals generated from adjacent sensor nodes 110 in a space may be bound and processed as a group, or the sensor nodes 110 of the same type may be processed. Can be combined into a group and processed.

Further, the sensor node management member 122 does not need a separate operation even if the lower sensor node 110 is added or reduced, and selects only a signal of a sensor node including a unique code signal of the sensor node management member 122. By processing, it may be provided in a manner to prevent the interference caused by the sensor node 110 signal of another user transmitted outside the use space.

The network interface 123 is responsible for transmitting the raw context data generated by the sensor node management member 122 to the behavior information analyzing unit 211 of the behavior recognition module 210 described later, and is used for transmission. Or convert the raw context data into a form suitable for a wireless line.

The network interface 123 also receives a service signal from the service driver 225 to be described later and transmits the service signal to the sensor node management member 122.

The behavior recognition module 210 may analyze a raw situation data transmitted from the sensor coordinator 120 to determine a location in a detected space and generate basic data for analyzing a user's motion ( 211), and the basic data transmitted from the behavior information analysis unit 211 and the data transmitted from the behavior recognition unit 213 and the behavior information management unit 215 which will be described later to analyze the situation in which the user is in real time. 3D coordinates according to the size and structure of the space in which the user lives or operates with reference to the height information and the installation angle of the behavior information integration processing unit 212 generating the integrated situation data of 5W1H format and the sensor node 100 installed. The static space modeling unit 214 and the 3D coordinates of the static space modeling unit 214 are set and transmitted through the behavior information processing unit 212. A behavior recognition unit 212 capable of determining a user's behavior pattern and receiving additional user's behavior pattern data, and receiving position and state information about a structure such as a household appliance provided in a space where the user lives or operates Receiving the user's behavior pattern information associated with the structure in the space input through the structure management unit 216 and the structure management unit 216, the action to classify the situation of the user according to the type of the structure and the user's behavior pattern The information management unit 215, information for each user, structure information input through the structure management unit, and contextual behavior pattern information input through the behavior information management unit are stored as user information, structure information, and situation information, respectively. The data storage unit 217 may be provided.

The behavior information analysis unit 211 extracts a signal indicating a location, an operation state, a state of the space and whether the structure is in operation and the state of the user from the raw situation data transmitted from the sensor coordinator 120 to determine the situation. Generate basic data.

That is, the sensor node 110 first of all grasp the sensor node 110 is detected where the user is installed, and after that, to determine the operating state of the lamp, the refrigeration unit, etc. where the user is located, At the same time, the physical state and operation state of the user transmitted from the infrared sensor node 110 or the thermal sensor node 110 are identified.

In this way, the basic data classified by the type of the detection signal in the behavior information analysis unit 211 is transmitted to the behavior information integration processing unit 212 which is the backbone of the behavior recognition module.

The behavior information processing unit 212 first classifies the basic data transmitted from the behavior information analysis unit 211 and transmits the basic data to the behavior recognition unit 213 and the behavior information management unit 215, respectively.

In addition, the signals processed through the behavior recognition unit 213 and the behavior information management unit 215 are integrated to generate 5W1H integrated context data.

Here, the 5W1H integrated situation data is data representing the user's situation identified in accordance with the rules of land and land, and includes the items of 'who', 'when', 'where', 'what', 'how' and 'why'. Accordingly, each information may be arranged in a form of one information unit, but is not limited thereto.

That is, 'who' is information indicating a unique code of the user, and 'when' is information representing a specific time when the detection is performed, and is expressed in detailed units of 'year: month: day: hour: minute: second'.

In addition, "where" is information indicating a specific place in the space where the sensing is performed, and is represented as a unique code of the space in which the sensor coordinator 120 is installed and a unique location code indicating each position in the space.

In addition, 'what' is information indicating a unique code of a structure manipulated by a user or a structure adjacent to the user, and 'how' is information representing a specific behavior of a user identified through a user's behavior detection as a unique code. .

Here, the unique code of the structure is represented as the identification ID of the sensor node 110 in the case of the structure including the sensor node 110, and is represented as the tag ID of the structure when a radio recognition tag is attached to the structure. .

Finally, the 'why' includes the user's current state information and the user's past state information code related to the user's temperature or history, and additionally infers the relationship between the user's past state information code and the currently adjacent structure. And emergency data may be included.

The integrated situation data generated in this way can be easily viewed and sorted for each item data, thereby extracting data such as situation data for each user, situation data for each location, situation data for each structure, or situation data for each time. The time to be factored can be minimized.

The static space modeling unit 214 holds the structure and position of the space by three-dimensional coordinates, and serves to provide spatial coordinate information when requested by the behavior recognition unit 213.

That is, since the structure of the space captured through the image has a two-dimensional structure, in order to more accurately identify the three-dimensional structure, three-dimensional coordinates for each position of the two-dimensional image transmitted by the sensor node 110 must be set.

In addition, since the distortion degree of the sensed image and the angle of view vary according to the sensing angle of the sensing member 111 of the sensor node 110 and the installation position of the sensor node 110, a spatial calculation considering this is required. .

Typically, the three-dimensional coordinate calculation is performed before the intelligent sensor system according to the present invention is in full swing, and if there is a change in the structure of the space in the future, an input device capable of receiving spatial data to compensate for this is provided. The input device may be provided through a graphical user interface (GUI) such as a computer.

The behavior recognition unit 213 is a component that determines which behavior pattern the user's motion corresponds to, and processes the information without excluding information on structures around the user.

That is, the behavior recognition unit 213 performs image processing of extracting only the outermost line components constituting the user's shape from the image from the image acquired through the sensor node 110 capable of detecting infrared rays.

In addition, by comparing the image processing data with the previously stored behavior patterns, it is inferred that the user's movement specifically corresponds to the behavior, but the configuration and processing method of the behavior recognition unit 213 is not limited thereto. .

Here, the behavior pattern of the person stored in the behavior recognition unit 213 may be additionally input through the GUI, or may be updated with the latest data.

The structure manager 216 includes information such as a structure in which the sensor node 110 is embedded, a structure in which a radio recognition tag is embedded, and furniture for each location, and may receive additional information through a GUI. The structure information may be transmitted to and stored in the data storage unit 217.

In this case, risk level information may be additionally included for each structure.

For example, in the case of a stove in a kitchen, there is a risk of burns, fires and explosions, so a risk level may be assigned which means a high degree of risk.

Behavior information management unit 215 is the behavior pattern data of the user transmitted from the behavior recognition unit 213 via the behavior information integrated processing unit 212, structure data transmitted from the structure manager 216, data storage unit It is a component that determines the situation of the user by integrating the context data transmitted from the context information of 217.

In other words, the behavior information management unit 215 is a situation in which the user is dangerous or difficult to prepare for the current data referred to the data of the structure management unit 216 and the behavior recognition unit 213 in the past, or a situation that is predetermined as a pattern. It can be judged whether or not.

Here, the situation determination of the behavior information management unit 215 is determined by additionally using the location in the space, user information, and structure information near the user.

In other words, when a young child is actively running around a gas stove which is a structure, the behavior information management unit 215 may determine that the child may be in a dangerous situation, but if the user is an adult, in the case of a young child It is considered to be a relatively less dangerous situation.

In addition, the situation determination data of the behavior information management unit 215 is stored as the situation information of the data storage unit 217 to be used as judgment data for a subsequent situation, and the situation determination data is used as the behavior information integration processing unit 212. It is used as a basic data to make integrated situation data of 5W1H format by transmitting to.

The data storage unit 217 is a component for storing situation, user, and structure related information. The data storage unit 217 may be provided outside or inside the behavior recognition module 210.

In particular, the situation information stored in the data storage unit 217 includes individual risk level information according to the behavioral pattern of the location or the space in the space, the structure information stored in the data storage unit 217 for each structure Hazard class information may be included.

As described above, by specifying the risk level information for each situation or structure in advance, it helps to quickly process the situation determination of the behavior information management unit 215.

In addition, the information of the data storage unit 217 is stored as a database of a number of situations, it is used as the basis data to infer the state or behavior of the user for each situation.

As described above, the sensory data acquired from the infrared photographing or other sensor in the behavior recognition module 210 is not stored separately, and the sensory data is converted into data in which unique codes are listed in 5W1H behavior, thereby allowing the user's personal Even if the information is protected and divulged, even without knowing what each unique code means, the user's personal information cannot be easily derived from the leaked 5W1H data.

The service module 220 analyzes the integrated context data of 5W1H format transmitted from the behavior recognition module 210 and selects a service suitable for a situation, and is stored in the behavior recognition module 210. Inferring and selecting a service suitable for a user from the past record of each user in association with the user-specific information, or the operation of the structure stored in the behavior recognition module 210 and the user information processing unit 222 that receives a service suitable for the user and Available device manager 224 for identifying and managing abnormal MUs, a service manager 223 for managing a list of services provided to a user and identifying structures required for each service, and the service analyzer 221 and the user. The service providing the appropriate service to the user according to the signal generated by the information processing unit 222, available device management unit 224 and service management unit 223. It may be provided as a vis driving unit 225.

The service analyzer 221 analyzes the current state of the user and selects a service suitable for the user.

In other words, the integrated situation data of the 5W1H format is data in which the current user's situation is recorded, and the service analyzer 221 selects different services according to the current location of the user.

In other words, when it is determined that the user has been lying in the bedroom for a long time, the user may provide a service to dim the lighting of the bedroom in which the user is located.

On the contrary, the user information processing unit 222 selects a service required by the user based on the user's past record.

In other words, if the user has a history such as pneumonia, a service for maintaining a constant temperature of the indoor space may be preferentially provided so that the user does not catch a cold.

In general, among services selected by the service analysis unit 221 and services selected by the user information processing unit 222, a service is determined in a direction that prioritizes the health and safety of the user, but the data storage unit 217 The service may be determined in a direction more useful to the user with reference to past records formed in the database.

For example, if a user has inadvertently left a window open and the temperature of the space where the user lives is lowered, and if there is a history that the user has often caught a cold in the past, the situation is directed toward lowering the temperature of the space. Rather than moving, the service may be selected in the form of raising the temperature of the space and sending a notification signal to the user that the window is open.

The service manager 223 stores a list of all services that can be provided to the user and sets a structure required for each service.

The types of services that can be provided to a user can be divided into a complex service and an individual service. The complex service is a service that changes a particular situation in which the user is located. The individual service means a service such as one-time or simple alarm. do.

As an example of the complex service, when increasing the temperature of the space to which the user belongs, several individual services, such as operating a heating device and closing open windows, may be simultaneously provided.

The usable device manager 224 is a component that determines whether the structure, such as a home appliance or furniture, listed in the data storage unit 217 operates or is abnormal, or whether the structure can be utilized in providing a service. Structure data that has been processed by 224 is transmitted to the data storage unit 217 and stored again.

The service driver 225 serves to generate a signal for actually providing a service selected by the service analyzer 221 and the user information processor 222 to the user. In order to provide a service, a service signal generated by the service driver 225 may include a control signal for controlling a structure in a space where a user is active and may be transmitted to the sensor coordinator 120.

And finally, the control signal is transmitted to the sensor node 110 to operate the structure on which the sensor node 110 is mounted to provide the service of the service driver 225.

In addition, the wired / wireless control signal for the structure in which the sensor node 110 is not installed is also generated from the service driver 225.

In addition, the service driver 225 may be connected to an external police station, a hospital, or the like, and operate in a manner of quickly delivering information and situations when an emergency occurs to a user.

Meanwhile, the type of service actually provided by the service driver 225 may vary according to the information of the available device manager 224 and the service manager 223.

That is, even though the service analyzing unit 221 and the user information processing unit 222 determine a service for raising the temperature of the space, a service related to heating does not exist in the service management unit 223 in the actual service list, If it is determined in the available device management unit 224 that the structure, such as the associated stove is damaged, the actual heating service will not be provided.

In such a case, the service driver 225 generates a notification signal informing the user of the absence of the heating service, or transmits a repair request signal to the heating service company via wired or wirelessly through a network connected to the outside. do.

Preferably, when the user stays in a place classified as a dangerous area in the space, or when the user takes an action corresponding to a risk level at a specific location, the detection sensitivity of the sensor node 110 is increased, and the behavior information is integrated. In the processor 212, the integrated situation data including the warning preliminary signal may be generated.

In this case, the increase of the sensing sensitivity may be achieved by shortening the sensing period of the sensing member 111 and by using a larger number of sensor nodes 110 to detect a user when the sensor 111 is in a normal state.

In addition, the warning preliminary signal may be provided in a form that is additionally recorded in the 1H item of the integrated status data of the 5W1H format generated by the behavior information integrated processing unit 212, when the integrated warning data is included, The service analysis unit 212 may provide a service that helps the user escape from a dangerous situation in preference to other services, or the service signal for preparing for an emergency that may occur later may be switched to a ready state.

For example, when it is detected by the sensor node 110 that an elderly user enters a bathroom having a very high humidity, the warning preliminary signal generated by the behavior information processing unit 212 prepares for a safety accident of the user. Therefore, the service driver 225 may increase the brightness of the lighting of the bathroom and transmit a notification signal for notifying other users that the aged user has entered the bathroom.

Figure 2 is a schematic diagram showing an application example of the intelligent sensor system for behavior detection according to the present invention, Figure 3 shows a process of processing when an emergency situation occurs through the intelligent sensor system for behavior detection according to the present invention It is.

According to FIG. 2, sensor nodes 110 may be provided in various places in which a user lives, such as a toilet, a living room, a room, and a kitchen, and the sensor node 110 may be provided through a sensor coordinator 120 installed at one wall. The sensing signal may be provided in a manner of receiving wirelessly.

In addition, the sensor coordinator 120 transmits raw context data to the behavior recognition module 210 through a wired or wireless line, and the integrated context data generated by the behavior recognition module 210 is transmitted to the service module 220 to the user. The necessary services will be sent to various places.

The behavior recognition module 210 and the service module 220 may be provided together in a space where a user resides, or may be provided in a separate place that manages the living spaces of all users.

For example, when the intelligent sensor system according to the present invention is installed in a nursing home established for the purpose of treatment of the elderly. The sensor node 110 and the sensor coordinator 120 is installed in a place where the elderly live, and the behavior recognition module 210 and the service module 220 may be provided in a management ward.

At this time, the behavior pattern stored in the behavior recognition unit 213 may be used to analyze the data of the elderly's operation, the service provided by the service driving unit 225 focuses on heating, drying the place such as toilet or washroom Service can be provided to prevent slipping.

Referring to FIG. 3, when the old man falls down on the floor and there is no movement for a predetermined time, the sensor node 110 of the intelligent sensor platform 100 detects body temperature through infrared rays and shape of a person. Through the detection, the signal generated through the detection is processed by the behavior decision inference engine 200.

Here, when the integrated situation data of the behavior information integration processing unit 212 that is in an emergency situation is generated, the service module 220 informs the doctor and the nurse in charge of the old person's personal information and current behavior information and the place where the old man is located. A notification service or the like may be generated to quickly confirm the state of the elderly.

In addition, the sensor node 110 detects the body temperature of the elderly, and maintains or increases the temperature of the place where the elderly are located until the doctor or nurse arrives, and provides services such as increasing the brightness of the elderly. You can easily check the condition of and can prevent abnormal symptoms due to rapid temperature drops.

The intelligent sensor system for behavior detection according to the present invention can be usefully used in everyday life as well as in preparation for the above-mentioned emergency.

For example, in case of paralytic patients, a lot of physical movements should be carried out through steady rehabilitation training, and it is necessary for the doctor in charge to understand the exercise state of the patient in detail.

Here, when the intelligent sensor system is applied to the patient's home, the attending physician can acquire statistical data on the movement of the patient, and if necessary, home appliances such as a TV controlled by a remote controller, etc. for the movement of the patient. A limited service may be provided to the home of the patient that does not accept this remote control signal.

Or, in order to manage the TV watching time of a child with a lot of TV watching time, if it is detected that the child stays in the living room where the TV is installed for a long time while the TV is in operation, for a predetermined time by a service timer set by the parent of the child Only TV can be operated.

Alternatively, since most of the structures in the space are connected through wireless communication, even if the user and the structure are blocked by a wall or are separated from each other, the structures in the space can be controlled by the user's wireless control signal, and the user can It is possible to control structures inside the space through wired or wireless network connection.

As mentioned above, although the present invention has been described by way of limited embodiments and drawings, the technical idea of the present invention is not limited thereto, and a person having ordinary skill in the art to which the present invention pertains, Various modifications and variations may be made without departing from the scope of the appended claims.

1 is a block diagram of an intelligent sensor system for detecting behavior according to the present invention.

Figure 2 is a schematic diagram showing an application example of the intelligent sensor system for detecting the behavior according to the present invention.

3 illustrates a process of processing when an emergency occurs through an intelligent sensor system for detecting a behavior according to the present invention.

Explanation of symbols on the main parts of the drawings

100: intelligent sensor platform 110: sensor node

111: sensing member 112: structure control member

113: sensor process member 114: wireless communication member

120: sensor coordinator 121: sensor node interface

122: sensor node management member 123: network interface

200: Behavior Decision Inference Engine 210: Behavior Cognition Module

211: behavior information analysis unit 212: behavior information integrated processing unit

213: behavior recognition unit 214: static space modeling unit

215: behavior information management unit 216: structure management unit

217: data storage unit 220: service module

221: service analysis unit 222: user information processing unit

223: service management unit 224: available device management unit

225: service driver

Claims (12)

An intelligent sensor platform that detects a location and behavior of a user and transmits information to each other through wireless communication between each component; In the sensor system comprising; a behavior decision inference engine that grasps the location and operation state of the user from the raw situation data transmitted from the intelligent sensor platform, and provides a service suitable for the situation to the user, The intelligent sensor platform, A sensor node installed in a plurality of interiors of the building to sense a user and control a structure in a space according to a signal transmitted from the behavior determination inference engine; And a sensor coordinator for collecting the wireless data transmitted from the sensor node and processing the raw data into a format suitable for delivery to the behavior decision inference engine. The behavior decision inference engine, A behavior recognition module for identifying a location and an operation of the user from the raw situation data transmitted from the sensor node, and storing user-specific information and information about various structures constituting the space and the space; And a service module that analyzes the integrated context data transmitted from the behavior recognition module and selects and provides a service suitable for each situation to a user. The method of claim 1, The sensor node, A sensing member provided in a space in which the user resides and a structure in the space to sense a temperature or an amount of light in the space or a manipulation state of the structure of the user, or detect a user's behavior through light, heat, ultrasonic waves, or pressure; A sensor process member for converting user, structure, and spatial information detected through the sensing member into a signal suitable for wireless communication, and transferring a structure control signal transmitted from the sensor coordinator to a structure control member; A wireless communication member which transmits a signal on a wireless channel in air to transmit a signal transmitted from the sensor processor member to the sensor coordinator, and receives and transmits a radio signal transmitted from the sensor coordinator to the sensor processor member; Structure control member for controlling the state or operation of the structure in the space in accordance with the control signal transmitted from the sensor process member; Intelligent sensor system for action detection. The method of claim 1, The sensor coordinator, A sensor node interface configured to receive a radio signal transmitted from the sensor node or to transmit a signal transmitted from a sensor node management member to a sensor node; A sensor node management member which collects the signals transmitted from all the sensor node interfaces and generates raw situation data by integrating information such as the time at which the sensing is performed, the location where the sensor node is installed, and the positional relationship between the sensor nodes; Intelligent sensor for behavior detection, characterized in that the; network interface for changing the raw situation data transmitted from the sensor node management member to a signal suitable for wired or wireless communication to the behavior recognition module of the behavior decision inference engine system. The method of claim 1, The behavior recognition module, A behavior information analysis unit for analyzing the raw situation data transmitted from the sensor coordinator to identify the location in the sensed space and to generate basic data for analyzing the user's motion; A behavior information integration processor for integrating the basic data transmitted from the behavior information analysis unit with the data transmitted from the behavior recognition unit and the behavior information management unit to analyze the situation in which the user is in real time and generate integrated context data in 5W1H format; A static space modeling unit configured to set three-dimensional coordinates according to the size and structure of the space in which the user lives or operates with reference to the height and the installation angle at which the sensor node is installed; A behavior recognition unit for determining a user's behavior pattern transmitted through the behavior information integration processing unit with reference to the three-dimensional coordinates of the static space modeling unit, and receiving additional user's behavior pattern data; A structure manager for receiving position and state information about a structure such as a household appliance provided in a space where a user lives or operates; A behavior information management unit which receives user's behavior pattern information associated with the structure in the space input through the structure management unit, and classifies the user's situation according to the type of the structure and the user's behavior pattern; And a data storage unit for storing user information, structure information input through the structure manager, and contextual behavior pattern information input through the behavior information manager, as user information, structure information, and situation information, respectively. Intelligent sensor system for behavior detection, characterized in that. The method of claim 1, The service module, A service analysis unit for selecting a service suitable for a situation by analyzing integrated context data of 5W1H format transmitted from the behavior recognition module; A user information processing unit which infers and selects a service suitable for a user from a past record of each user in association with user-specific information stored in the behavior recognition module, or receives a service suitable for a user; An available device manager for identifying and managing the operation and abnormality of the structure stored in the behavior recognition module; A service manager for managing a list of services provided to a user and identifying structures required for each service; And a service driver for providing a service suitable for a user according to signals generated by the service analyzer, the user information processor, the available device manager, and the service manager. The method of claim 2, The sensor member of the sensor node is an intelligent sensor system for the behavior detection, characterized in that the vibration sensor, temperature sensor, infrared sensor, light intensity sensor, pressure sensor, voltage power sensor. The method of claim 6, The sensor node is installed at a location having various heights such as structures, ceilings, side walls, and floors in a space where the user is active, thereby detecting a user repeatedly through a plurality of sensor nodes, thereby detecting user behavior patterns. Intelligent sensor system for behavioral branches, characterized by increased accuracy. The method of claim 7, wherein The wireless communication member of the sensor node is an intelligent sensor for behavior detection, characterized in that performing wireless communication through any one of a wireless LAN (WLAN), Bluetooth (Bluetooth), or personal area wireless communication (WPAN). system. The method of claim 8, The sensor process member of the sensor node is intelligent sensor system for behavior detection, characterized in that the sensor operating program is implemented through TinyOS. The method of claim 4, wherein The situation information stored in the data storage unit of the behavior recognition module includes individual risk level information according to the location patterns in the space or the location-specific behavior patterns, and the risk level information for each structure is included in the structure information stored in the data storage unit. Intelligent sensor system for behavior detection, characterized in that included. The method of claim 10, When the user stays in a place classified as a dangerous area in the space, or when the user takes an action corresponding to the danger level at a specific location, the detection sensitivity of the sensor node is increased, and the warning preliminary signal is included in the behavior information integrated processor. Intelligent sensor system for action detection, characterized in that integrated context data is generated. The method of claim 5, The service signal generated by the service driver includes a control signal for controlling a structure in a space where a user is active and transmitted to the sensor coordinator.

Images