KR101767828B1 - Personalized home automation service providing method based on ontology and service providing system using ontology based on context awareness - Google Patents

Abstract

The present invention provides a method for providing a customized home automation service by using an ontology, which comprises the following steps: a service device collects sensing data representing a surrounding state; the service device generates an instance based on the ontology pre-defined by using the sensing data; the service device generates first state information by applying the instance to a pre-defined semantic web rule language (SWRL) rule; the service device generates service information by applying the first state information to a java expert system shell (JESS) rule; and the service device provides a service by using the service information.

Description

Technical Field [0001] The present invention relates to a method of providing a customized home automation service using an ontology and a situation-aware service providing system using an ontology. [0002]

The technique described below relates to a technique for providing a customized service using context aware ontology.

Smart home technology is a technology that provides convenient service to users by using home networking and Internet information appliance based on wired / wireless communication and digital information device.

On the other hand, context awareness technology is a technology that recognizes and judges the surrounding situation with communication and computing ability and provides useful information to human being. Recently, research on home automation service using context recognition technology is under way.

Korean Patent Publication No. 10-2009-0020994

The technique described below intends to provide customized services to the user by re-inferring the context information reasoned based on the ontology with the JESS engine.

A method of providing a customized home automation service using an ontology includes collecting sensing data representing a circumstance of a service device, generating an ontology-based instance defined in advance using the sensing data, The service device generates the first context information by applying the instance to a predefined Semantic Web Rule Language (SWRL) rule, and the service apparatus applies the first context information to the JESS (Java Expert System Shell) rule Generating service information by using the service information, and providing the service using the service information.

A context-aware service providing system using an ontology is provided with at least one home network device, a plurality of sensor devices located in a home network to sense information about the surrounding environment, and a plurality of sensor devices connected to the home network device and the sensor device, Generates an ontology-based instance defined in advance using the collected sensing data, generates the first context information by applying the instance to a predefined Semantic Web Rule Language (SWRL) rule, And a home network server for applying service information to JESS (Java Expert System Shell) rules to generate service information.

The technique described below infers the situation information indicating the state of the user or home appliance in the home network and provides the user with an appropriate service according to the situation information.

1 is an example of a block diagram showing a configuration of a context aware service providing system using an ontology.
2 is an example of a flowchart of a method of providing a customized home automation service using an ontology.
3 is an example of a service providing process for performing diagnosis on the air conditioner operation.
4 is an example of a service providing process for controlling the air conditioner operation.

The following description is intended to illustrate and describe specific embodiments in the drawings, since various changes may be made and the embodiments may have various embodiments. However, it should be understood that the following description does not limit the specific embodiments, but includes all changes, equivalents, and alternatives falling within the spirit and scope of the following description.

The terms first, second, A, B, etc., may be used to describe various components, but the components are not limited by the terms, but may be used to distinguish one component from another . For example, without departing from the scope of the following description, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

As used herein, the singular " include "should be understood to include a plurality of representations unless the context clearly dictates otherwise, and the terms" comprises & , Parts or combinations thereof, and does not preclude the presence or addition of one or more other features, integers, steps, components, components, or combinations thereof.

Before describing the drawings in detail, it is to be clarified that the division of constituent parts in this specification is merely a division by main functions of each constituent part. That is, two or more constituent parts to be described below may be combined into one constituent part, or one constituent part may be divided into two or more functions according to functions that are more subdivided. In addition, each of the constituent units described below may additionally perform some or all of the functions of other constituent units in addition to the main functions of the constituent units themselves, and that some of the main functions, And may be carried out in a dedicated manner.

Also, in performing a method or an operation method, each of the processes constituting the above method may occur in a different order than that described in the context without explicitly specifying a specific order in the context. That is, each process may occur in the same order as described, may be performed substantially concurrently, or may be performed in the opposite order.

The technology described below collects peripheral information with a sensing device, generates situation information based on a predefined ontology, and generates information for providing a service using a JESS (Java Expert System Shell) engine . The technology described below is not necessarily applied to a home network system, but will be described below with reference to a home network system.

The ontology is a tool that can implement semantic web and semantically connect knowledge concepts, and can be expressed using languages such as RDF, OWL, and SWRL. The constituent elements of an ontology can be classified into classes, instances, relations, and properties. A detailed description of the meaning of each component is omitted.

1 is an example of a block diagram showing the configuration of a context aware service providing system 100 using an ontology. The context aware service provision system 100 using the ontology includes home network devices 110a, 110b and 110c, sensor devices 120a, 120b and 120c, a control device 140 and a home network server 150. [ The context aware service provision system 100 using an ontology corresponds to a service apparatus that provides a user-customized service.

The home network appliances 110a, 110b, and 110c shown in FIG. 1 are household appliances located at home. 1 shows a TV 110a, an air conditioner 110b and a washing machine 110c as home network devices.

The sensor devices 120a, 120b, and 120c may include various types of sensors. For example, the sensor device may be a temperature sensor, a humidity sensor, an illuminance sensor, an image sensor, a timer, an infrared sensor, other optical sensors, an acoustic sensor, an airflow sensor,

In FIG. 1, the sensor device 120a refers to a sensor that detects the position or movement of the user 50. In this case, the sensor device 120a may be an image sensor such as a camera or an infrared sensor capable of detecting other motion. Furthermore, the sensor device 120a may detect the position or movement of the user in such a manner that the user terminal 55 possessed by the user 50 is detected. In this case, the sensor device 120a may be a wireless communication AP capable of communicating with the user terminal 55, a transmitter for short range wireless communication, and the like. For example, the position of the user terminal 55 can be estimated using the signal strength between the AP apparatus and the user terminal 55. [ Furthermore, the position of the user 50 or the user terminal 55 may be determined by using a plurality of sensor devices.

Further, although not shown in FIG. 1, the sensor device may be a device disposed in the home network devices 110a, 110b, and 110c. For example, the sensor device may be various sensor devices (illumination sensor, temperature sensor, motion sensor, etc.) used by the home network device, various devices (timer, voltage meter, current meter, etc.) . In this case, the home network device itself can perform the function of the sensor device.

The control device 140 is a device that controls the operation of the home network devices 110a, 110b, and 110c. In FIG. 2, the control device 140 controls the home network devices 110a, 110b, and 110c based on the service information of the home network server 150. FIG. In some cases, the home network server 150 may directly control the operation of the home network devices 110a, 110b, and 110c.

The home network server 150 recognizes the situation on the basis of the sensing data collected by the sensor devices 120a, 120b, and 120c and / or the home network devices 110a, 110b, and 110c, and performs the determination according to the situation. The home network server 150 generates the situation information based on the sensing data collected by the sensor devices 120a, 120b, and 120c and / or the home network devices 110a, 110b, and 110c. The home network server 150 generates the ontology-based instance defined in advance using the sensing data, and applies the instance to the predefined Semantic Web Rule Language (SWRL) rule to generate the situation information.

The situation information will be briefly described. The context information can be expressed using web ontology (OWL). Status information can be divided into upper level and lower level. The top level context information defines abstract classes and attributes that can be used in common across all domains, and describes the relationships and constraints between each attribute using the semantic information of the ontology. For example, the 'Brightness' property of 'Livingroom' is expressed in the form of <Livingroom, Brightness, LivingroomBrightness>. At this time, 'Brightness' corresponding to the above predicate plays a role of expressing the relation between 'Livingroom' and 'Livingroom Brightness', and a situation information that can be located in the subject and object positions thereof Have to be of type 'Room' and 'Brightness', respectively.

Situation information that may occur to the user in the home network base can be classified into the following three types. The situation information can be classified into (1) situation information by sensor, (2) situation information by reasoning, and (3) predefined situation information type. Hereinafter, an example will be described in order.

(1) For example, the situation information by the sensor such as 'person; locatedAt' is the situation information received from the sensor at the execution time of the context aware application.

(2) Context information by reasoning such as 'person; hasStatus' can be obtained through inference process after context information is input by the sensor. That is, the context information by the reasoning is automatically generated when the user-defined rule is satisfied.

For example, the situation information that the current person's state is 'sleeping' is the current state information that the user predefined [sleep-rule: (? P rdf: type Person) type Device (? p locatedAt Bedroom) (? d locatedIn Bedroom) (? d hasState ON) -> (? p hasStatus sleeping).

These rules include queries such as '<? P person; locatedAt Bedroom>' and '<? D device; hasState ON>' to get the current position of the person and the current state of the bed. Since this kind of query is a query for the context information that receives the value from the sensor at the execution time of the context aware application, the context information that the current status of the person is 'sleeping' can not be obtained before the execution time of the context aware application .

(3) Situation information that is defined by a user in the case of predefined situation information such as '<TV device locatedIn Livingroom>', and is not changed after the definition. Therefore, the query to obtain the predefined context information value always has the same result.

The home network server 150 generates the service information by applying the situation information to the JESS (Java Expert System Shell) rule. Further, the home network server 150 or the control device 140 may provide a certain service to the user based on the service information. Specific examples will be described later.

2 is an example of a flowchart of a method 200 for providing a customized home automation service using an ontology. The sensor device collects sensing data representing a surrounding situation (210). The context awareness service providing system generates an ontology-based instance defined in advance using sensing data (220). The context aware service providing system applies the instance to a predefined Semantic Web Rule Language (SWRL) rule to generate context information (230). The context aware service providing system applies the context information to JESS (Java Expert System Shell) rules to generate service information (240). The context aware service providing system provides the service using the service information (250).

Furthermore, the context aware service providing system may store the created service information in a storage device and utilize the service information stored in the storage device. The context aware service provisioning system may receive user feedback on the service provision and modify the service information stored in the storage by learning feedback (260). Then, the service providing system can generate the service information based on the context information and generate the modified service information according to the learned contents.

Hereinafter, the operation of the context aware service providing system will be described based on several examples. 3 is an example of a service providing process for performing diagnosis on the air conditioner operation. 3 is an example showing a part of the configuration included in the context aware service providing system. 3 shows an air conditioner 310, a temperature sensor 321, a humidity sensor 322, and a home network server 350, which are home network appliances.

First, the home network server 350 generates the context information through the SWRL defined in advance. To this end, the home network server 350 uses the information collected by the sensor device.

(1) For example, the current time is assumed to be "July 2016". The home network server 350 may check the time through a separate device such as a timer, or may check the time through a timer built in the server itself. It is assumed that the room temperature measured through the current temperature sensor 321 is 31 degrees Celsius (1) and the room humidity measured through the humidity sensor 322 is 70% (2). Based on this, the home network server 350 generates the status information "current summer and the weather is hot ". (2) Further, it generates situation information that "the air conditioner needs to be operated" according to preset conditions. (3) The home network server 350 communicates with the air conditioner 310 to collect information that the current air conditioner 310 is not operating (3). (4) The home network server 350 generates the status information "current air conditioner does not operate ". This process is an example of generating context information based on SWRL.

Now, the home network server 350 generates new service information using the JESS engine based on the context information generated based on the SWRL. The JESS engine is a forwarding chaining engine based on JAVA. JESS rules for reasoning should be prepared in advance. The JESS engine can reasonably refine predefined rules while inferring new facts.

The home network server 350 can check the replacement period of the air conditioner filter while communicating with the air conditioner 150 (4). If the air conditioner filter has been used for an exchange period (for example, 6 months), the home network server 350 makes an inference that there is a problem with the air conditioner filter through the JESS engine. Further, the home network server 350 may transmit information to the service center (separate server) that "exchange of the air conditioner filter is necessary ". This process is an example of performing the fault diagnosis based on the situation information deduced from the SWRL by the home network server 350 and the sensing data (filter replacement cycle) transmitted from the air conditioner.

Alternatively, the home network server 350 may communicate with the air conditioner 150 to check whether there is a component that does not operate normally during the configuration of the air conditioner (step 5). For example, the home network server 350 may receive sensing data indicating that power is not being supplied from the air conditioner 150. The home network server 350 performs an inference that "power to the air conditioner is out of order ". This process is an example of performing the repair diagnosis based on the situation information deduced by the home network server 350 as SWRL and the sensing data (failure information) received from the air conditioner.

4 is an example of a service providing process for controlling the air conditioner operation. FIG. 4 shows an example of a part of the configuration included in the context aware service providing system. 4 is a block diagram showing the configuration of the home network device 310, the temperature sensor 321, the humidity sensor 322, the image sensor 323, the control device 340, the home network server 350 and the storage device 360, do.

The home network server 350 generates the situation information through the SWRL defined beforehand. To this end, the home network server 350 uses the information collected by the sensor device.

(1) For example, the current time is assumed to be "July 2016". The home network server 350 may check the time through a separate device such as a timer, or may check the time through a timer built in the server itself. The room temperature measured through the temperature sensor 321 is 31 degrees Celsius (②), and the room temperature measured through the humidity sensor 322 is The indoor humidity is assumed to be 70% (③). Based on this, the home network server 350 generates the status information "current summer and the weather is hot ". (2) Further, it generates situation information that "the air conditioner needs to be operated" according to preset conditions. (3) The home network server 350 communicates with the air conditioner 310 to collect information that the current air conditioner 310 is not operating (4). (4) The home network server 350 generates the status information "current air conditioner does not operate ". This process is an example of generating context information based on SWRL.

Now, the home network server 350 generates new service information using the JESS engine based on the context information generated based on the SWRL. It is assumed that the home network server 350 obtains identification information for the user through the image sensor 323 or the like. The home network server 350 performs a customized service. To this end, the home network server 350 confirms the user-customized information stored in the storage device 360 (5). The home network server 350 determines the optimal air conditioning setting according to time, temperature, humidity, and user (identifier). The home network server 350 delivers the user-customized setting to the controller 340 (6). The controller 340 transmits the control information according to the customized setting to the air conditioner 310 (7).

Meanwhile, the home network server 350 can acquire information that the current air conditioner 310 is operating in a certain setting while communicating with the air conditioner 310 (4). In this case, the home network server 350 may determine a new user-customized setting by referring to the user-customized information stored in the storage 360.

Although not shown in FIG. 4, the user 50 can transmit feedback on a service currently being performed to a home network server 350 using a user terminal connected to the home network, a smart TV, and the like. Or home network server 350 may receive information that user 50 manually manipulates air conditioner 310. [ The home network server 350 may update the user-customized information stored in the storage 360 based on the feedback information of the user.

It should be noted that the present embodiment and the drawings attached hereto are only a part of the technical idea included in the above-described technology, and those skilled in the art will readily understand the technical ideas included in the above- It is to be understood that both variations and specific embodiments which can be deduced are included in the scope of the above-mentioned technical scope.

50: User
55:
100: Situational awareness service system using ontology
110a, 110b, 110c: Home network device
120a, 120b, 120c:
140: Control device
150: Home network server
310: Air conditioner
321: Temperature sensor
322: Humidity sensor
323: Image sensor
340: Control device
350: Home network server
360: Storage device

Claims (13)

Collecting sensing data of a household appliance and a surrounding situation;
Generating a predefined ontology-based instance using the sensing data;
The service device applying the instance to a predefined Semantic Web Rule Language (SWRL) rule to generate context information;
Generating service information on the operation of the home appliance by applying the state information to a Java Expert System Shell (JESS) rule;
Transmitting the service information to the home appliance; And
And updating the service information by using the feedback information on the operation of the home appliance based on the service information,
The situation information may be inferred from environmental information about an environment or object collected by a separate sensor device, information on an operation rule of the home appliance previously set according to the environment information, and information on whether the home appliance is operated And a method of providing a customized home automation service using an ontology including state information of the home appliance. delete The method according to claim 1,
Wherein the sensing data includes at least one of a group including a time, a temperature, a humidity, an operation state of a home appliance, a position of a home appliance, a user's behavior, and a user's location. The method according to claim 1,
Wherein the service information further includes a diagnosis result on the operation of the home appliance. 5. The method of claim 4,
Wherein the service device further uses device information including at least one of an operation of the home appliance, a replacement cycle of the consumables of the home appliance, and an operation of the plurality of devices constituting the home appliance using the sensor device in the home appliance, A method of providing a customized home automation service using an ontology that generates service information. The method according to claim 1,
And the service device repeatedly learns the feedback information to update the service information. At least one home network appliance;
A plurality of sensor devices located in the home network and sensing information on the home network device and the surrounding environment; And
The method comprising: generating a predefined ontology-based instance connected to the home network device and the sensor device using sensed data collected by the sensor device, and transmitting the instance to a predefined SWRL (Semantic Web Rule Language ) Rule to generate context information, applying the context information to JESS (Java Expert System Shell) rules to generate service information, and using feedback information on the operation of the home network device based on the service information And a home network server for updating the service information,
Wherein the status information includes at least one of environmental information about an environment or an object collected by a sensor device, information about an operation rule of a home appliance set in advance according to the environment information, A context aware service provision system using an ontology that includes state information of home appliances. 8. The method of claim 7,
And a control device for controlling the home network appliance using the service information. delete 8. The method of claim 7,
Wherein the sensing data includes at least one of a group including a time, a temperature, a humidity, an illuminance, an operating state of a home network appliance, a home network appliance, and a user's location. 8. The method of claim 7,
The home network server generates the service information by further using the device information including at least one of the operation of the home network device, the replacement period of the consumables of the home network device, and the operation of the plurality of devices constituting the home network device Context - aware service provisioning system using ontology. 8. The method of claim 7,
Wherein the service information is a result of the diagnosis of the operation of the home network device, and the home network server transmits the service information to a server at a user or a remote location. delete

Images