KR20190109612A - Apparatus for providing living space management service using contextual reasoning technique based ontology and method thereof - Google Patents

Abstract

An embodiment of the present invention discloses an apparatus for providing a living space management service. The apparatus comprises: a management unit generating context information by applying information for environment around a user to a preset information conversion rule based on ontology to store the generated context information in the common knowledge base; a reasoning unit reasoning a situation of the user based on the context information stored in the common knowledge base, generating context information corresponding to the reasoned situation, and storing the generated context information in the common knowledge base; and a control unit using the context information corresponding to the reasoned situation to provide a living space management service to the user.

Description

Apparatus and method for providing residential space management service using ontology-based situation reasoning method

An embodiment relates to a device and a method for providing a living space management service.

Smart home is a new residential type that provides various types of automation services based on IoT. Smart homes can be connected and controlled in a variety of fields other than electronic products (TV, air conditioners, refrigerators, etc.), energy consumption devices (water, electricity, heating and cooling), security devices (door locks, surveillance cameras, etc.). . Accordingly, the smart home provides a service that automatically operates according to the user's situation or controls all devices in the house by remote control of the user.

Existing smart home is focused on providing a remote service that can be operated from outside the house even if the user is not located in the house using a user terminal such as a smartphone. That is, the existing smart home service delivers home environment information to a user through a server on which a smart home controller is installed, and controls home appliances from outside the home through the information provided by the user.

However, this service type has a disadvantage in that it is difficult to perform in a situation other than a set function. For example, the user may only perform a command provided by an application installed in the user terminal, but other control may not be performed. In addition, the user must select a command provided according to his / her situation to receive the corresponding service. To solve this problem, many contents using IoT are added, but there are limitations in developing hardware and flexible services.

Therefore, there is a need for an intelligent smart home technology that can infer a user's situation and provide a service according to the inferred situation.

The background technology of the present invention is disclosed in Korean Patent Publication No. 10-2016-0125284 (published on October 31, 2016).

Embodiments provide an apparatus and method for providing a living space management service for improving a user's living convenience by intelligently providing a living space management service tailored to the inferred occupant's situation information.

The problem to be solved in the examples is not limited thereto, and the object or effect that can be grasped from the solution means or the embodiment described below will also be included.

The apparatus for providing a living space management service according to an embodiment of the present invention generates a context information by applying environment information around a user to a preset ontology-based information conversion rule, and stores the generated context information in a common knowledge base. An inference unit for inferring a user's situation based on context information stored in a common knowledge base, generating context information corresponding to the inferred situation, and storing the generated context information in the common knowledge base, and inferring the inferred situation. It includes a control unit for providing a living space management service to the user by using the corresponding context information.

The inference unit, upon receiving context information from the common knowledge base, selects an inference rule according to the received context information, and infers a situation of the user according to the selected inference rule.

When the inference unit receives a user response corresponding to a question from the user according to the inference rule, the inference unit may infer the situation of the user through the user response.

The controller may select a service model corresponding to the context information corresponding to the inferred situation, generate a control command according to the inferred situation through the selected service model, and transmit the generated control command to the target device.

The method may further include updating the living space management service by reflecting the behavior pattern of the user analyzed through the environmental information and the inferred situation.

In accordance with another aspect of the present invention, there is provided a method of providing a living space management service, generating context information by applying environment information around a user to a predetermined ontology-based information conversion rule, and storing the generated context information in a common knowledge base. Inferring a user's situation based on context information stored in a common knowledge base, generating context information corresponding to the inferred situation, and storing the generated context information in the common knowledge base, corresponding to the inferred situation Providing a living space management service to the user by using the context information.

In the inferring the user's situation, upon receiving context information from the common knowledge base, the inference rule according to the received context information may be selected, and the user's situation may be inferred according to the selected inference rule.

Inferring the user's situation, upon receiving a user response corresponding to the question from the user according to the inference rule, can infer the user's situation through the user response.

The providing of the living space management service may include selecting a service model corresponding to the context information corresponding to the inferred situation, generating a control command according to the inferred situation through the selected service model, and transmitting the same to the target device. Can be.

The method may further include updating the living space management service by reflecting the behavior pattern of the user analyzed through the environmental information and the inferred situation.

According to an embodiment of the present invention, it is possible to accurately infer the current situation of the user through the surrounding environment information and behavior patterns, and intelligently provide a service suitable for the situation without the user requesting the service. In addition, since context information used for situation inference is shared through the blackboard, it can be easily linked with additional devices.

1 is a block diagram of an apparatus for providing a living space management service according to an embodiment of the present invention.
2 is a flowchart of a method for providing a living space management service according to an embodiment of the present invention.
3 is an exemplary view of step S240 of FIG.
4 is an exemplary diagram for describing in detail the operation S250 of FIG. 2.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated and described in the drawings. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms including ordinal numbers, such as second and first, may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the second component may be referred to as the first component, and similarly, the first component may also be referred to as the second component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

The term '~ part' used in the present embodiment refers to software or a hardware component such as a field-programmable gate array (FPGA) or an ASIC, and '~ part' performs certain roles. However, '~' is not meant to be limited to software or hardware. '~ Portion' may be configured to be in an addressable storage medium or may be configured to play one or more processors. Thus, as an example, '~' means components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, procedures, and the like. Subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionality provided within the components and the 'parts' may be combined into a smaller number of components and the 'parts' or further separated into additional components and the 'parts'. In addition, the components and '~' may be implemented to play one or more CPUs in the device or secure multimedia card.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings, and the same or corresponding components will be given the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted.

1 is a block diagram of an apparatus for providing a living space management service according to an embodiment of the present invention.

As shown in FIG. 1, the apparatus 100 for providing a living space management service according to an embodiment of the present invention includes a management unit 110, an inference unit 120, a control unit 130, a common knowledge base 140, and an update unit ( Not shown).

The management unit 110 generates context information by applying environment information around the user to a predetermined ontology-based information conversion rule and stores the generated context information in the common knowledge base 140.

The inference unit 120 infers the user's situation based on the context information stored in the common knowledge base 140.

In detail, when the inference unit 120 receives the context information from the common knowledge base 140, the inference unit 120 selects an inference rule according to the received context information. The inference unit 120 infers the user's situation according to the selected inference rule.

In addition, when the inference unit 120 receives a user response corresponding to a question from the user according to the inference rule, the inference unit 120 may infer the user's situation through the user response.

In this case, the situation of the user includes all situations occurring in or around the user. For example, not only the user's current behavior such as eating, going out, exercising, sleeping, but also the environment around the user, such as weather, traffic conditions, and event information of the region where the user is currently located.

The inference unit 120 generates context information corresponding to the inferred situation and stores the generated context information in the common knowledge base 140.

The controller 130 provides a living space management service to the user by using context information corresponding to the inferred situation.

The controller 130 selects a service model corresponding to the context information corresponding to the inferred situation, generates a control command according to the inferred situation through the selected service model, and transmits the generated control command to the target device.

The controller 130 may update the living space management service by reflecting the behavioral pattern of the user analyzed through the environmental information and the inferred situation.

The common knowledge base 140 stores the generated context information and acts as a blackboard for requesting the inference unit 120 or the controller 130 to perform an operation according to the stored context information. For example, when context information regarding time information is input, the common knowledge base 140 may request the reasoning unit 120 to infer a current situation related to time. As another example, when context information regarding a sleep situation is input, the common knowledge base 140 may request the controller 130 for a housing space management service corresponding to the context information about the sleep situation.

The common knowledge base 140 may delete pre-stored context information according to a set condition. For example, when context information regarding TV visibility is stored in a situation where context information regarding sleep is stored, the common knowledge base 140 may delete context information regarding sleep. In addition, a condition for deleting after a predetermined time may be used, and the setting of the condition may be set differently according to the context information.

The update unit (not shown) updates the living space management service by reflecting the user's behavior pattern analyzed through the environmental information and the inferred situation.

For example, suppose a user enters a home and the room is hot. Then, the controller infers a situation in which the user feels heat, and can provide a living space management service for operating the air conditioner in response thereto. At this time, the residential space management service initially provided can operate air conditioners for all rooms.

However, if the behavior pattern in the living room is analyzed for more than two hours after entering the user, the update unit updates the living space management service to operate only the Aiken in the living room to reflect the behavior pattern.

The residence space management service may be updated in the residence space management service providing apparatus according to the embodiment of the present invention or updated in the central server. When updated in the central server, the residence space management service providing apparatus 100 according to an embodiment of the present invention may receive the updated residence space management service and provide it to the user.

2 is a flowchart of a method for providing a living space management service according to an embodiment of the present invention.

As shown in FIG. 2, the management unit generates context information by applying environment information around the user to a predetermined ontology-based information conversion rule (S210).

In this case, the environment information includes at least one of sensing information of a user living space, device operation information, and weather information. Let's take a closer look at environmental information below.

First, the sensing information of the user living space is information detected from the sensing equipment in the user living space. For example, the door opening and closing sensor installed in the front door may detect the opening and closing of the front door and transmit sensing information on opening and closing the front door to the management unit. As another example, the motion sensor installed in the kitchen may detect the user's movement and transmit sensing information about the movement to the management unit.

Next, device operation information of the user living space is operation information on devices in the living space. For example, the boiler may transmit information on the current operation mode (going out mode, temperature operation mode, time operation mode, etc.) to the management unit. As another example, the lighting of the room may transmit information on whether the lighting is on or off, and the television may transmit whether the lighting is on or off or the current channel information to the management unit.

Next, the weather information is weather information outside the living space. For example, the Meteorological Agency server may transmit current or weekly weather, temperature, humidity, fine dust concentration information, etc. to the management unit.

In addition to the information illustrated above, the environmental information may include information that affects a user's life, such as traffic information and accident accident information. For example, the environmental information may include road construction information, event information, road congestion section information, and the like. In addition, the environment information may include information about a user's profile, for example, user gender, age, commute time, and the like.

Since the received environment information is received in the form of raw data, the management unit uses the environment information received in accordance with an ontology-based conversion rule by the apparatus for providing living space management services according to an embodiment of the present invention. Convert to contextual information.

For example, in the case of time information, context information is generated as '2018/04/08/13/25/22 /' in the form of 'year / month / day / hour / minute / second' according to the information conversion rule. Can be. In the case of the front door opening and closing information, the context information may be generated in the form of 'front door / open' or 'front door / close' according to the information conversion rule. In the case of motion detection information, the context information may be generated in a form such as 'motion / detection' or 'motion / undetection' according to the information conversion rule.

Then, the management unit stores the generated context information in the common knowledge base (S220). The common knowledge base may be a blackboard. The common knowledge base may store previously generated context information.

Next, the inference unit infers the situation of the user based on the context information stored in the common knowledge base (S230).

Specifically, upon receiving context information from the common knowledge base, the inference unit selects an inference rule according to the received context information, and infers the user's situation according to the selected inference rule.

For example, upon receiving context information of 'door / open' from the common knowledge base, the reasoning unit selects an inference rule regarding 'going out'. In addition, the inference unit receives 'front door / open' and 'action / detection', context information necessary for situation inference, from the common knowledge base according to the inference rule regarding 'going out'. If both the 'door / open' and the 'action / detection' context are received, the reasoning unit infers the user's situation by going out. On the other hand, if the 'action / detection' context is not received, the reasoning unit may stop the reasoning.

As another example, upon receiving context information of 'going out' from the common knowledge base, the inference unit selects an inference rule regarding 'movement'. In addition, the inference unit receives 'time / weekend' and 'time / morning', contextual information required for situation inference, from the common knowledge base according to the inference rule regarding 'movement'. When all of the 'going out', 'time / weekend', and 'time / morning' contexts are received, the inference unit infers the user's situation as a morning exercise.

As another example, assume that a context regarding time information '2018/07/14/06/10/22' is input. Then, the inference unit generates context information about seasons, times, days of the week, and holidays in accordance with the inference rules regarding time. Specifically, context information such as 'summer' according to the inference rule for the season, 'morning' according to the inference rule for the time, 'saturday' according to the inference rule for the day, and 'holiday' according to the inference rule for the holiday Can be generated.

If the inference unit receives a user response corresponding to the question from the user according to the inference rule, the inference unit may infer the user's situation through the user response. For example, after the user's outing situation is inferred, the inference unit may provide the user with a question about whether the outing situation is a long outing or a short outing. When the user response is received in response to the question, the inference unit may infer whether the user is going out for a long time or a short time out through the user response.

The inference unit may select different inference rules through the same context information. The inference unit may infer a user situation according to each of the plurality of inference rules when a plurality of inference rules are selected. The inference rule can infer the situation of the user using one or more context information.

The inference unit generates context information corresponding to the inferred situation and stores the generated context information in the common knowledge base (S240). For example, if the user infers a situation that the user is going out, the inference unit may generate context information of 'going out' and store it in the common knowledge base.

The control unit provides a living space management service to the user using context information corresponding to the inferred situation (S250).

In more detail, the controller selects a service model corresponding to the context information corresponding to the inferred situation, generates a control command according to the inferred situation through the selected service model, and delivers the control command to the target device. In this case, the service model may provide the user with living information corresponding to the context information.

Here, the service model controls the devices necessary for the user's residence, such as electronic products (TV, air conditioners, refrigerators, etc.), energy consumption devices (water supply, electricity, heating and cooling), security devices (door locks, surveillance cameras, etc.) in the residential space. May be an algorithm.

For example, assume that context information of 'going out / promising / 6 hours' is generated in step S240. Then, the controller may select a service model corresponding to the short-term outing situation, generate a control command for controlling the boiler in the outing mode for five hours, and transmit it to the boiler.

The controller may provide information in response to a user's question or command. Specifically, when the controller receives a user's question or command, the controller receives context information for generating corresponding information from the common knowledge base. The controller may provide information on a question or command using the context information received from the common knowledge base.

For example, if the user asks' How is the air outside today? ', The control unit receives the context information of' fine dust concentration / bad 'from the common knowledge base, and then the' high dust concentration is high today. Please wear a mask and go out. '

Figure 3 is an illustration of the situation inference and living space management service according to an embodiment of the present invention.

3 illustrates a process of inferring a situation regarding whether a user is going out for a short time or a long outing and providing a service corresponding thereto after the situation where the user goes out is inferred.

First, when the outing situation is inferred by the inference unit, the control unit receives the context information of 'outing' and selects a service model corresponding to the 'outing' context. The control unit receives the context information on the weather from the common knowledge base according to the service model, and based on this, the probability of precipitation in the afternoon is 80%. Get your umbrella. '

And, the reasoning unit provides the user with a question, 'Are you going out for a long time?' Upon receiving the user response 'No, I'm going to work', the inference unit infers the short-term outing situation and generates context information of 'going out / short-term'.

Then, the control unit according to the service model corresponding to the 'going out' context information and 'going out / short-term' context information 'smart TV-OFF' 'air cleaner-OFF' 'smart cleaner-OFF' 'boiler / air conditioning-outing mode' 'Smart Plug-OFF' 'Smart Lighting-OFF' generates control commands and sends them to each device.

On the other hand, upon receiving the user response 'Yes, it's a business trip', the inference unit infers the long-term outing situation and creates a 'going out / long-term' context. And the reasoning unit asks the user, 'How many days do you want to come back?' When receiving a user response of 'returning after 5 days', the inference unit infers the situation of a business trip for 5 days and generates context information of 'going out / long term / 5 days'.

Then, the control unit according to the service model corresponding to the 'going out' context information and 'going out / long-term / 5 days' context information' smart TV-OFF '' air purifier-after 4 days operation reservation '' smart cleaner-after 4 days Operation reservation '' Boiler / Air conditioner-OFF '' Smart plug-OFF '' Smart lighting-OFF 'control command is generated and transmitted to each device. .

If the answer to the question, 'Are you going out for a long time?', 'Yes, it's a business trip for 5 days', you may skip the question 'How many days are you coming back?'

Meanwhile, the residential space management service may be updated to reflect the user's behavior pattern analyzed through the environmental information and the inferred situation.

4 is an exemplary diagram for describing context information according to an embodiment of the present invention.

The context information according to an embodiment of the present invention may be formed in a hierarchical structure consisting of lower context information and higher context information.

The lower context information is context information generated through environment information around the user, and corresponds to year, month, day, time, off of the motion sensor, and off node of the door lock sensor of FIG. 4.

The upper context information is context information corresponding to a situation inferred through lower context information or a combination of lower context information and other higher context information. Weekdays / weekends, seasons, outings / travels, and user profile information nodes of FIG. 4 correspond to this. Although not shown in FIG. 4, the upper context information may be context information corresponding to a situation inferred through a combination of other higher context information.

According to an embodiment of the present invention, it is possible to accurately infer the current situation of the user through the surrounding environment information and behavior patterns, and intelligently provide a service suitable for the situation without the user requesting the service. In addition, since context information used for situation inference is shared through the blackboard, it can be easily linked with additional devices.

Although the above description has been made based on the embodiments, these are merely examples and are not intended to limit the present invention. Those skilled in the art to which the present invention pertains may not have been exemplified above without departing from the essential characteristics of the present embodiments. It will be appreciated that many variations and applications are possible. For example, each component specifically shown in the embodiment can be modified. And differences relating to such modifications and applications will have to be construed as being included in the scope of the invention defined in the appended claims.

100: residence space management service providing device
110: management unit 120: inference unit
130: control unit 140: common knowledge base

Claims (10)

A management unit for generating context information by applying environment information around the user to a preset ontology-based information conversion rule and storing the generated context information in a common knowledge base;
An inference unit for inferring a user's situation based on context information stored in the common knowledge base, generating context information corresponding to the inferred situation, and storing the generated context information in the common knowledge base;
And a control unit for providing a living space management service to a user using context information corresponding to the inferred situation. The method of claim 1,
The inference unit,
And receiving inference information from the common knowledge base, selecting an inference rule according to the received context information, and inferring the user's situation according to the selected inference rule. The method of claim 2,
The inference unit,
And receiving a user response corresponding to a question from the user according to the inference rule, and inferring the user's situation through the user response. The method of claim 1,
The control unit,
And a service model corresponding to the context information corresponding to the inferred context, and generating a control command according to the inferred context through the selected service model and transmitting the generated control command to a target device. The method of claim 1,
And updating the living space management service by reflecting the behavior pattern of the user analyzed through the environmental information and the inferred situation. Generating context information by applying environment information around the user to a predetermined ontology-based information conversion rule and storing the generated context information in a common knowledge base;
Inferring a user's situation based on context information stored in the common knowledge base;
Generating context information corresponding to the inferred situation and storing the generated context information in the common knowledge base;
And providing a living space management service to a user using context information corresponding to the inferred situation. The method of claim 6,
Inferring the situation of the user,
Receiving context information from the common knowledge base, selecting the inference rule according to the received context information, and inferring the user's situation according to the selected inference rule providing a living space management service. The method of claim 7, wherein
Inferring the situation of the user,
And receiving a user response corresponding to a question from the user according to the inference rule, and inferring the user's situation through the user response. The method of claim 6,
Providing the living space management service,
And selecting a service model corresponding to the context information corresponding to the inferred situation, generating a control command according to the inferred situation through the selected service model, and transmitting the generated control command to a target device. The method of claim 6,
And updating the living space management service by reflecting the behavioral pattern of the user analyzed through the environment information and the inferred situation.

Images