KR100811091B1 - Home network context-aware service system of an intelligence type and its method - Google Patents

Abstract

An intelligent home network context-aware service system and a method therefor are provided to recognize and infer the behavior and context information of a user belonging to a home network environment, thereby providing intelligently a home network service corresponding to the context of the user without a request of the user. An interface agent(130) secures first context information on a home network and collects crawling information through the Internet as supplementary information for supplementing the first context information. A knowledge repository(120) stores and manages rule and context information for inference. A context managing agent(140) manages the context information on the knowledge repository and secures second context information on the domain ontology of an external repository(110) to supplement the first context information. An inference mining agent(150) infers a current context based on the first context information and the crawling information, or the first context information and the second context information and registers a service to be provided to a user(190) on the home network in a service managing agent(160). The service managing agent transfers the service to a client device(170) through the interface agent.

Description

Intelligent home network context-aware service system and its method {Home network context-aware service system of an intelligence type and its method}

1 is a block diagram showing an embodiment of an intelligent home network context aware service system according to the present invention;

2 is a flowchart showing an embodiment of the mutual operation between the processing means according to the present invention.

              <Explanation of symbols for the main parts of the drawings>

110: external information storage means 120: information storage means

130: interface means 140: situation management means

150: reasoning and minor means 160: service management means

170: client device 180: context management interface

190: user

The present invention relates to an intelligent home network context aware service system and method thereof, and more particularly, to an intelligent home network context aware service system based on OWL, a web ontology language for satisfying knowledge service requirements in a ubiquitous home network environment. It's about how.

The ubiquitous environment refers to an environment in which a user can freely access a network and receive various services regardless of a place without a computer or a network being recognized. In other words, ubiquitous refers to an environment in which information can be exchanged economically and conveniently at any time, anywhere, any device, and any device.

The home network, which is opening the ubiquitous era, is based on wired and wireless communication networks such as mobile communication and high-speed internet, and A / V, data communication, and information appliances in the home are connected to each other through a network. It is possible to provide, and it is possible to manage the whole house through the central home server, so that it can provide safe and smart automation service. In addition, its purpose is to maximize the user's convenience by providing services through complex and knowledgeable interoperability with various user requests and environments.

As research on technology for the development of home network is accelerating, in order to build a future-oriented home network, the physical space connected with devices in the simple form of the existing is transformed into an intelligent ubiquitous environment, which is a more intelligent and adaptive computing environment. You have to.

In order to implement such an intelligent environment, autonomous and diverse entities need to recognize and exchange common contexts, and context-aware technology to provide optimal services for a given situation.

In other words, it is not a passive environment that operates only by a user's direct service request, but an environment that can be provided with an 'Invisible Service' that provides a service without the user being aware of it.

Accordingly, an object of the present invention is to provide an intelligent home network situation awareness service system and method for recognizing and inferring various kinds of situations including a user's behavior pattern.

In addition, another object of the present invention is to provide an intelligent home network context awareness service for sharing contextual information between agents or systems in a public, dynamic, and distributed environment through providing semantics about the situation. A system and method are provided.

In addition, another object of the present invention is to determine whether the selected actuator (actuator) on the home network is appropriate to the current user's situation and intelligent home network situation to enable the service corresponding to the current user's situation through the combination of the executor The present invention provides a cognitive service system and a method thereof.

In addition, another object of the present invention is to utilize a minimum amount of user information required to provide a service as a situation, and whether the intelligent home network situation to realize a privacy protection function to prevent the user information from leaking to the outside? The present invention provides a service system and a method thereof.

The object of the present invention is to secure the first situation information on the home network, the interface means for collecting crawling information via the Internet as additional information for supplementing the first situation information; Information storage means for storing and managing rules and situation information for inference; Situation management means for managing situation information on the information storage means and securing second situation information on a domain ontology of an external storage means to supplement the first situation information; A service for inferring a current situation based on the first situation information and the crawling information, or the first situation information and the second situation information, and providing a service to a user located on the home network according to the inferred situation Inference minor means for registering with the management means; And service management means for delivering a service registered from the inference minor means to a client device through the interface means.

Another object of the present invention is a first step of securing the first status information on the home network; A second step of securing crawling information via the Internet or second situation information on a domain ontology of an external storage means as additional information for supplementing the first situation information; A third step of inferring a current situation using the first situation information and the crawling information, or the first situation information and the second situation information; And a fourth step of providing a service according to the inferred situation.

Prior to this, terms or words used in the specification and claims should not be construed as having a conventional or dictionary meaning, and the inventors should properly explain the concept of terms in order to best explain their own invention. Based on the principle that can be defined, it should be interpreted as meaning and concept corresponding to the technical idea of the present invention.

Therefore, the embodiments described in the specification and the drawings shown in the drawings are only one of the most preferred embodiments of the present invention and do not represent all of the technical idea of the present invention, various modifications that can be replaced at the time of the present application It should be understood that there may be equivalents and variations.

First, context refers collectively to information about a situation, condition, or object around a user associated with the relationship between the user and the ubiquitous computing environment. Applications in ubiquitous computing environments are context aware, allowing them to be applied to various situations and to respond appropriately to user needs.

In addition, a context aware service is an intelligent service provided by combining information input by the user and surrounding contextual information recognized in various ways to be adjusted to a desired level according to the user's situation. .

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating an embodiment of an intelligent home network context awareness service system according to the present invention. Referring to FIG. 1, context aware service middleware of an intelligent home network context aware service system is classified into a knowledge repository 120, an interface agent 130, a context managing agent 140, and a context management agent 140. Inference minor means (inference & mining agent, 150), and service management agent (service managing agent, 160).

The information storage means 120 is an information store such as rules and contexts for inference, and provides necessary information about a user's behavior pattern and situation, etc. for the situation recognition service.

The interface unit 130 interprets and gives meaning to the situation information on the home network or the user's query or command with the help of a reasoning unit, and gives the result according to the client devices, To a command that 170 can understand. In addition, it performs a crawling function when there is a request for information through the external Internet from other components.

The situation management means 140 secures the situation stored in the information storage means 120 and transmits it to other components. In addition, the situation recognition service middleware internal and external context information is stored in the information storage means 120 or converted into information that can be recognized by the device.

The inference minor means 150 generates a new situation or derives a situation relationship based on the situation model and rules of the information storage means 120, and generates result information on the user's query or command. . In addition, new users' behavior patterns are learned, necessary information is summarized, extracted and classified.

The service management means 160 performs overall service management including resolution of a service conflict problem through the inference unit. It also provides user privacy protection.

The client device 170 outside the context awareness service middleware receives a user's query by applying the Multimodal Interaction Framework proposed by the W3C, and provides a multi-modal interface (MMI) and a visible service for informing the user of the result of the service. Contains an application for.

Meanwhile, a context management interface 180 is provided for the user 190 to set the environment and access the context of the context awareness service middleware. The context management interface 180 may be included in the client device 170 or may be provided separately from the client device 170.

The information storage means 120 is additionally inputted when the request is periodically received from the sensor of the client device 170 or other components through the situation management means 140, the interface means 130 via the Internet The crawled crawling information and the query or command from the user 190 are stored and managed. In addition, the context management means 140 stores and manages the knowledge of the situation information.

For example, when the first user is located in the bedroom, the movement of the first user is limited to 5 minutes or less within a radius of 1 meter, the lamp of the bedroom is turned off, and the TV of the bedroom is turned off. The client device 170 obtains the lower context information from the client device 170. Thereafter, the reasoning minor means 150 extracts the upper level knowledge, which is knowledgeable that the first user is going to bed, through the inference process from the lower situation information.

The information storing means 120 stores these sub situations in a rule set used by the inference minor means 150, and stores the upper situations in homenet ontologies, which are one of the situation models. The upper contexts are stored as instances of web ontology language (OWL).

The interface unit 130 is an agent for converting a situation by providing an interface of the context awareness service middleware, and is an interfacing engine, a translator, a result formatter, and a context acquisition unit. It includes.

The interface unit generates the query information required by the inference unit based on the user's query or command input from the outside through a query engine and transfers the generated query information to the inference unit.

The converter performs a semantic representation of a user's query or command input from the MMI of the client device 170 or a situation (state or sensing information of the executor) input from a sensor of the client device 170. It converts and stores the facts (facts, collection of information inside the inference part for inference) and situation information that is an instance of the situation model. The information converted into the fact of the inference unit is transmitted to the inference minor means 150 through the interface unit.

The result formatter receives the device control command from the subtask management unit of the service management unit 160 and converts the device control command into information of a state that can be recognized by the device, and sends it to the executor for controlling the device through the situation output unit of the client device 170. To pass. In addition, when output of information or transmission of voice is required, rather than control of the device, a resource description framework (RDF) / XML corresponding to the information is generated and transmitted to the MMI of the client device 170 to be output.

The situation collecting unit finally collects more necessary situations for the situation recognition service before the reasoning unit registers the service in the service management means 160 and provides the service to the user. In addition, through web crawler (web crawler) to collect the web information through the Internet, such as weather, stocks, news to the minor portion of the reasoning minor means 150 to summarize.

The context management means 140 expresses, stores, and manages various types of situations, such as an ontology management engine, a metadata management engine, a knowledge search engine, and the like. Includes a storage management engine.

The ontology manager parses and validates OWL (RDF) documents and, if necessary, loads OWL classes and instances into the system by synthesizing the ontology of various domains. In addition, the OWL type situation can be modified and deleted.

The metadata management unit manages metadata about a situation such as reference information of an Internet website.

The information retrieval unit provides a function of retrieving various types of situations from the information storage means 120.

The storage management unit manages images, videos, and file systems that may be part of a user's request in a home network environment. That is, the storage management unit manages the file system, the directory, and the stored contents.

On the other hand, the situation management means 140, as well as the situation information such as query / command from the client device 170 or the user 190, crawling information or external information storage means 110 additionally collected by the interface means 130 By re-collecting instances (situation information) on domain ontologies and synthesizing these information, we can make clear situational awareness for service.

The reasoning minor means 150 includes an inference part and a minor part.

The inference unit infers the current situation with the relationship between the class and the instance of the situation model and the various context information sensed through the situation management means 140, and finds a service suitable for the current situation through the rule-based module. Register at

The reasoning methods include ontology inference that infers relations based on a situational model stored in OWL, and inference based on rules defined by a user or a developer. Here, the context-aware service middleware of the present invention enables inference through a rule-based module and OWL relational inference through an inference module to perform various types of mixed inference.

The minor part recognizes the user's dynamic behavior pattern and continuously knowledges it. In addition, the query / command or inference from the user performs the function of extracting, summarizing, and classifying the character information directly shown to the user before registering the service in the service management means (160).

Here, the miner is composed of a text miner module and a data miner module.

The text minor module includes a language analyzer, a feature extractor, a document classification / cluster / summarizer, and uses these to find out the information desired by the inference part of the reasoning unit, and to provide the service to the user for service decision. Performs the function of extracting / summarizing / classifying the information needed in the step. Therefore, the user can obtain customized context information briefly summarized through the text minor module.

The data miner module formulates the atypical behavior of the user stored through various sensed situations, user queries / commands, and device state changes, and probably extracts music, expected behavior, and interests that the user mainly listens to. It allows you to intelligently automate repetitive sets of services. To this end, a database of the user's behavior such as whether the user controls the device and whether the user moves is required to be databased and continuously updated.

The service management unit 160 recognizes a collision for each service unit and classifies and manages the service for each service unit to minimize service conflicts through inference and homenet ontology. In addition, the service management means 160 is based on the profile based on the user access level and information disclosure level of the home net ontology before the command is delivered to the executor for controlling the device through the result formatter of the interface means 130. Perform user privacy protection.

The service management means 160 includes a session module, a task module, a subtask module, a subtask planer, a privacy module, and a tracking module. It includes.

The session management unit creates a session allocated for each user when the user is in a state where the user can receive the service of the context-aware service middleware system (when the user is located at home or virtually located at home through a network). Perform session management such as modification and deletion. Also, it recognizes the collision of the session and transmits the information about the collision to the inference unit to query the alternative for collision prevention.

The task manager generates an automated default task, a scheduled task preset by a user or a system, or a temporary task temporarily generated by an arbitrary user command according to a user's situation. It manages tasks such as modifying and deleting, and also classifies tasks by session. Once a task is created, it has a purpose and is deleted when the goal is achieved. It is also excluded from the classification by session.

The subtask management unit performs server task management such as creating, modifying, and deleting a subtask that is a component of a task performed for one purpose. In addition, the subtask management unit recognizes the subtask collision and responds to the collision avoidance method from the inference unit through the query to rearrange the order of related subtasks through the subtask planning unit, or postpone or delete the subtask.

The privacy management unit protects user privacy and determines whether to perform a task according to the privacy level of each user or the access level of each device by referring to the privacy class of the policy ontology of the homenet ontology.

The tracking management unit maintains user sessions and checks the overall service status of each user so that services are not missed.

2 is a flowchart showing an embodiment of the mutual operation between the processing means according to the present invention. Referring to Figure 2, the interaction between the processing means of the situation recognition service middleware can be largely divided into the step of obtaining the latest situation information through the update of the situation information and the step of finding and providing an appropriate service based on the situation information. .

First, referring to the update of the situation information, the situation information recognized and collected through the query / command of the sensor or the user 190 in the client device 170 is analyzed through the interface means 130. The contextual information analyzed through the interface means 130 is converted into an RDF / XML format and input into the context management means 140 and the reasoning means 151, or changes the existing context.

At this time, in order to supplement the context information for providing a clear service, the interface means 130 collects crawling information that crawls the Internet, and secures additional sensing information. In addition, the context management means 140 re-collects necessary instances (situation information) on the domain ontology of the external information storage means 110 for this purpose. Therefore, the context management means 140 secures accurate context information for service provision by using the crawling information, sensing information, and instances on the domain ontology of the external information storage means 110.

The situation awareness service middleware maintains the latest situation by periodically performing the above series of operations. At this time, in order to reduce the overload of the system due to excessively repeated update of the situation information, such as changing the location information of the user, the interface means 130 temporarily stores the same type of situation information input before the update of the situation information and creates a new situation. Compare with the information to determine whether to update.

The reason for performing the filtering of the situation information in the interface means 130 as described above is that the situation information in the RDF / XML format and the situation management means 140 compared to the time when the interface means 130 compares the situation of the lower level. And the reason for updating by the reasoning means 151 is long, and it is likely to cause an overload of the system.

In addition to keeping the status information up to date, the inference unit infers the current situation based on the entered or changed situation information and rules, and decides whether to provide a service suitable for the inferred situation. That is, matching the rule pattern of the situation information inferred by the reasoning unit and the situation information stored in the information storage means 120, and finds a service to be provided if there is a matching rule and delivers it to the service management means 160.

The service management unit 160 checks whether there is a session corresponding to the user by using the user information included in the service providing command of the inference unit, and if there is a session already open, activates the session and does not have a session. In this case, a new session is created for the user.

When the session is activated or created, the service management unit 160 queries the inference unit for detailed services (tasks and subtasks), and then binds the task to the session. To do this, the interface means 130 transmits a device control command to the result formatter.

When the above-described series of operations are performed, the service management unit 160 checks whether there is a conflict between the current service and the new service to be performed by each service unit, and if a conflict occurs, the inference unit and the homenet ontology, which is a situation model. Query the conflict recovery plan based on the policy ontology of the service, and reorder, delay or delete the service order according to the result.

On the other hand, after transmitting the device control command to the device to determine the success of the service provided through the ACK or NACK message returned from the device, update the status of the device, and history the various situations of inferred user by learning the pattern of the minor part Apply to.

For example, if the current user's time range and father's location information match the rule, the user's session is created or activated, the task is bound, and the service to be inferred with ontology relation is inferred at the same time. Retrieves subtasks that are the minimum number of operation commands required to execute. In addition, in order to provide additional information such as stock information of interest or channel information, the service management means 160 requests the interface means 130 to collect additional information. The web crawler of the interface means 130 determines where to obtain the corresponding additional information through its own internal ontology, collects the additional information and summarizes the additional information, and then transfers the additional information to the service management means 160. The service management means 160 controls the actual device through the result format step of the interface means 130 when all information for providing a service to the user is prepared.

Although the present invention has been shown and described with reference to the preferred embodiments as described above, it is not limited to the above embodiments and those skilled in the art without departing from the spirit of the present invention. Various modifications and variations are possible without departing from the spirit of the present invention and equivalents of the claims to be described below.

Therefore, the intelligent home network context awareness service system and method thereof of the present invention artificially create a home network service corresponding to a situation in which the user is in a situation without the user's request through the recognition and inference of the user's behavior and context information belonging to the home network environment. There is an effect that can be provided intelligently.

In addition, the present invention can prevent the collision of services in consideration of priority and privacy, and can compensate for the problem of providing a service to multiple users, to provide a service according to space or location recognition that requires services of various static patterns In part, there is an effect that can be used as the underlying technology.

In addition, the present invention has the effect of increasing the efficiency and accuracy of service provision in the ubiquitous network environment and home network environment based thereon.

In addition, the present invention has an effect that can prevent the leakage of the user's information through the privacy protection function.

In addition, the present invention can recognize the situation in various environments, there is an effect that can be easily linked with other systems through the module configuration.

Claims (6)

Interface means for securing first status information on a home network and collecting crawling information via the Internet as additional information for supplementing the first status information; Information storage means for storing and managing rules and situation information for inference; Situation management means for managing situation information on the information storage means and securing second situation information on a domain ontology of an external storage means to supplement the first situation information; A service for inferring a current situation based on the first situation information and the crawling information, or the first situation information and the second situation information, and providing a service to a user located on the home network according to the inferred situation Inference minor means for registering with the management means; And Service management means for delivering a service registered from the inference minor means to a client device through the interface means; Intelligent home network context awareness service system comprising a. The method of claim 1, The first situation information is the intelligent home network context awareness service system, which is context information recognized and collected through a query or command of a sensor or a user in the client device. The method of claim 1, And the reasoning minor means secures a service for registering with the service management means by matching the inferred situation information with the rule pattern of the situation information stored in the information storing means. A first step of securing first status information on a home network; A second step of securing crawling information via the Internet or second situation information on a domain ontology of an external storage means as additional information for supplementing the first situation information; A third step of inferring a current situation using the first situation information and the crawling information, or the first situation information and the second situation information; And Fourth step of providing a service according to the inferred situation Intelligent home network context awareness service method comprising a. The method of claim 4, wherein The first situation information is an intelligent home network context awareness service method that is recognized and collected through a query or command of a sensor or a user in a client device. The method of claim 4, wherein And the service of the fourth step is secured by matching the rule pattern of the situation information stored in the information storage means with the situation inferred through the third step.

Images