KR102573591B1 - Method and system for providing user-centric context aware service in internet of things environment - Google Patents

Abstract

The present invention relates to a user-centered context-aware service providing method in an IoT environment. A user-centered context-aware service providing method in an IoT environment includes the steps of receiving raw data including information related to a plurality of IoT devices and user information from a plurality of IoT devices; Generating associated high-level contextual information, determining whether or not the generated high-level contextual information satisfies service conditions required for service provision, and when it is determined that the service conditions are satisfied, the user and and executing a service that satisfies the service condition in one or more associated IoT devices.

Description

Method and system for providing user-oriented context-aware service in IoT environment

The present invention relates to a method and system for providing a user-centered context-aware service in an IoT environment, and more particularly, to a method and system for providing a user-centered context-aware service using IoT devices near a user's location.

Recently, an Internet of Things (IoT) environment in which devices and people are connected across ubiquitous terminals such as computers and smart phones has been implemented. In such an IoT environment, communication between people and/or devices may be supported, and thus, various services may be provided through interactions between people and/or devices.

For example, many existing IoT platforms provide mesh services in various areas such as hot water management, weather information service, smart home, smart building, and sleep management. However, such services may only be provided without considering the user's current state or location. Therefore, in order to implement a true IoT environment, it is necessary to analyze a user's situation in real time and provide a user-centered, seamless situation-aware service based on the analyzed information.

The present invention provides a method for providing a user-oriented context-aware service in an IoT environment, a computer program stored in a computer-readable medium, and a system (device) to solve the above problems.

The present invention can be implemented in a variety of ways, including methods, systems (devices), computer programs stored on computer readable media or computer readable media on which computer programs are stored.

According to an embodiment of the present invention, a method for providing a user-oriented context aware service in an IoT environment, performed by at least one processor, includes a row including information and user information associated with a plurality of IoT devices from a plurality of IoT devices. Receiving data, generating high-level contextual information related to the user's situation based on the received raw data, whether the generated high-level contextual information satisfies service conditions required for service provision and when it is determined that the service condition is satisfied, executing a service that satisfies the service condition in one or more IoT devices associated with the user.

According to an embodiment of the present invention, the step of executing a service may include searching a list of services used by a user, determining whether the user uses a service that satisfies service conditions, and if it is determined that the user uses the service, Determining service execution information for executing a service, and executing a service satisfying a service condition in one or more IoT devices associated with a user based on the determined service execution information.

According to an embodiment of the present invention, generating high-level contextual information associated with a user's context based on received raw data includes converting a data format of the raw data to generate low-level contextual information. and generating high-level contextual information associated with the user's context, including objects, times, places, and purposes associated with the user, based on the low-level contextual information.

According to an embodiment of the present invention, generating a dynamic mesh network including location information of a plurality of IoT devices and determining one or more IoT devices included within a predetermined distance from a user's location using the dynamic mesh network Include more steps.

According to an embodiment of the present invention, generating a dynamic mesh network may include, when a new first IoT device is discovered, determining a first shortest moving distance for each of the first IoT device and a plurality of IoT devices; and and generating a dynamic mesh network by reconfiguring connections to the first IoT device and the plurality of IoT devices according to the determined first shortest moving distance.

According to an embodiment of the present invention, generating a dynamic mesh network may include, when the second IoT device included in the plurality of IoT devices is removed, removing a connection to the second IoT device, the second IoT device Determining a second shortest moving distance for each of the plurality of IoT devices from which the second IoT device is removed, and reconstructing a connection to each of the plurality of IoT devices from which the second IoT device is removed according to the determined second shortest moving distance to perform a dynamic mesh It involves creating a network.

A computer program stored in a computer readable recording medium is provided to execute the above-described method according to an embodiment of the present invention on a computer.

A user-centered situational awareness system according to an embodiment of the present invention includes a communication unit that receives raw data including user information and information related to a plurality of IoT devices from a plurality of IoT devices, and stores the received raw data in a raw data DB. A device management unit for storing and a context management unit for generating high-level contextual information associated with a user's situation based on the raw data stored in the raw data DB and storing the generated high-level contextual information in the context DB.

According to an embodiment of the present invention, the context management unit converts the data format of the raw data to generate low-level contextual information, and based on the low-level contextual information, the object, time, place, and purpose related to the user Generates high-level contextual information associated with the user's context, including

According to an embodiment of the present invention, the context management unit determines whether the generated high-level contextual information satisfies service conditions required for service provision, and if it is determined that the service conditions are satisfied, the user Sends a list of services used.

According to an embodiment of the present invention, a service management unit that searches a service list, determines whether a user uses a service that satisfies a service condition, and transmits service execution information for executing the service is further included.

According to an embodiment of the present invention, when service execution information is received, a service for determining one or more IoT devices included within a predetermined distance from a user's location using a dynamic mesh network and executing a service with a device management unit. It further includes a topology controller that transmits execution information.

According to an embodiment of the present invention, the device manager executes a service that satisfies a service condition in one or more IoT devices associated with a user.

According to an embodiment of the present invention, the topology control unit creates a dynamic mesh network including location information of a plurality of IoT devices.

According to an embodiment of the present invention, when a new first IoT device is discovered, the topology control unit determines a first shortest moving distance for each of the first IoT device and a plurality of IoT devices, and the determined first shortest moving distance. According to the method, a dynamic mesh network is created by reconfiguring connections to the first IoT device and the plurality of IoT devices.

According to an embodiment of the present invention, the topology controller, when the second IoT device included in the plurality of IoT devices is removed, removes the connection to the second IoT device, and removes the plurality of IoT devices from which the second IoT device is removed. A second shortest moving distance for each device is determined, and a dynamic mesh network is created by reconstructing a connection to each of the plurality of IoT devices from which the second IoT device has been removed according to the determined second shortest moving distance.

In various embodiments of the present invention, even if there is no service request from the user, the context-aware system recognizes the current context of the user using various information obtained by IoT devices and provides a service optimized for the current context of the user. can provide

In various embodiments of the present disclosure, a context aware system may provide a service optimized for a user's current situation through one or more IoT devices determined based on location.

In various embodiments of the present invention, an optimal service may be provided to the user in real time by effectively determining a service currently required by the user based on high-level contextual information.

In various embodiments of the present invention, even when at least some of the plurality of IoT devices are changed, the dynamic mesh network is reconfigured so that a service based on the shortest path of the IoT devices can be effectively provided to users.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned are clear to those skilled in the art (referred to as "ordinary technicians") from the description of the claims. will be understandable.

BRIEF DESCRIPTION OF THE DRAWINGS Embodiments of the present invention will be described with reference to the accompanying drawings described below, wherein like reference numbers indicate like elements, but are not limited thereto.
1 is a functional block diagram showing the internal configuration of a situational awareness system according to an embodiment of the present invention.
2 is a functional block diagram showing the internal configuration of a service management unit according to an embodiment of the present invention.
3 is a functional block diagram showing the internal configuration of a context management unit according to an embodiment of the present invention.
4 is a functional block diagram showing the internal configuration of a topology controller according to an embodiment of the present invention.
5 is a functional block diagram showing the internal configuration of a device management unit according to an embodiment of the present invention.
6 is a diagram illustrating an example of low-level contextual information according to an embodiment of the present invention.
7 is a diagram illustrating an example of high-level contextual information according to an embodiment of the present invention.
8 is a diagram illustrating an example of a dynamic mesh network according to an embodiment of the present invention.
9 is a diagram illustrating an example of reconfiguring a dynamic mesh network according to an embodiment of the present invention.
10 is a flowchart illustrating an example of a method for providing a user-centered context aware service in an IoT environment according to an embodiment of the present invention.
11 is a flowchart illustrating an example of a method for generating high-level contextual information according to an embodiment of the present invention.
12 is a flowchart illustrating an example of a method for creating a dynamic mesh network according to an embodiment of the present invention.
13 is a flowchart illustrating an example of a dynamic mesh network reconfiguration method according to an embodiment of the present invention.
14 is a block diagram showing the internal configuration of a situational awareness system according to an embodiment of the present invention.

Hereinafter, specific details for the implementation of the present invention will be described in detail with reference to the accompanying drawings. However, in the following description, if there is a risk of unnecessarily obscuring the gist of the present invention, detailed descriptions of well-known functions or configurations will be omitted.

In the accompanying drawings, identical or corresponding elements are given the same reference numerals. In addition, in the description of the following embodiments, overlapping descriptions of the same or corresponding components may be omitted. However, omission of a description of a component does not intend that such a component is not included in an embodiment.

Advantages and features of the disclosed embodiments, and methods of achieving them, will become apparent with reference to the following embodiments in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and can be implemented in various different forms, only these embodiments make the present invention complete and the scope of the invention to those skilled in the art. It is provided only for complete information.

Terms used in this specification will be briefly described, and the disclosed embodiments will be described in detail. The terms used in this specification have been selected from general terms that are currently widely used as much as possible while considering the functions in the present invention, but these may vary depending on the intention or precedent of a person skilled in the related field, the emergence of new technologies, and the like. In addition, in a specific case, there is also a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the invention. Therefore, the term used in the present invention should be defined based on the meaning of the term and the overall content of the present invention, not simply the name of the term.

Expressions in the singular number in this specification include plural expressions unless the context clearly dictates that they are singular. Also, plural expressions include singular expressions unless the context clearly specifies that they are plural. When it is said that a certain part includes a certain component in the entire specification, this means that it may further include other components without excluding other components unless otherwise stated.

In the present invention, the terms "comprise", "comprising" and the like may indicate that features, steps, operations, elements and/or components are present, but may be used when such terms include one or more other functions, It is not excluded that steps, actions, elements, components, and/or combinations thereof may be added.

In the present invention, when a specific element is referred to as being “coupled”, “combined”, “connected”, or “reactive” to any other element, the specific element is directly bonded to, combined with, and/or other elements. or may be linked or reacted, but is not limited thereto. For example, one or more intermediate components may exist between certain components and other components. Also, in the present invention, “and/or” may include each of one or more items listed or a combination of at least a part of one or more items.

In the present invention, terms such as "first" and "second" are used to distinguish a specific component from other components, and the aforementioned components are not limited by these terms. For example, the “first” element may have the same or similar shape as the “second” element.

1 is a functional block diagram showing the internal configuration of a situational awareness system 100 according to an embodiment of the present invention. As shown, the context awareness system 100 may include a service management unit 110, a situation management unit 120, a topology control unit 130, a device management unit 140, a communication unit 150, and the like, Not limited to this. The context awareness system 100 communicates with the IoT device 170 (or a plurality of IoT devices) through the network layer 160, and can exchange data and/or information necessary to provide a user-centered context awareness service.

The context awareness system 100 recognizes a context for a user around the IoT device 170 using data and/or information collected from the IoT device 170 and provides a service suitable for the recognized situation. It may be a system for In addition, IoT may refer to an intelligent technology and/or service that mutually communicates information by connecting all objects based on the Internet, and the IoT device 170 refers to objects and devices connected to other IoT devices based on the Internet. etc. can be referred to. For example, the IoT device 170 may include a user terminal associated with a user and public infrastructure devices such as a switch, a door lock, and an alarm device.

According to an embodiment, the context awareness system 100 may receive raw data including information related to the IoT device 170 and user information from the IoT device 170 . For example, the communication unit 150 may receive raw data from the IoT device 170 through the network layer 160 . That is, the IoT device 170 may collect sensing information received from the surrounding sensors 180 (or a plurality of sensors) and transmit the collected sensing information to the contextual awareness system 100 . Here, the user information may be information sensed from various sensors included in the user terminal, and the information related to the IoT device 170 is centered on the current location of the user (or user terminal) and is located within a predetermined distance from the IoT device. It may be sensing information collected or obtained by For example, the context awareness system 100 may periodically receive raw data at predetermined time intervals, but is not limited thereto, and may receive raw data when there is a service request from a user.

When receiving raw data, the situational awareness system 100 and/or the device management unit 140 may store the received raw data in a raw data DB (not shown). Also, the context management unit 120 may generate high-level contextual information associated with the user's context based on the raw data stored in the raw data DB. For example, the context management unit 120 converts the data format of the raw data to generate low-level contextual information, and based on the low-level contextual information, an object associated with the user ( It can generate high-level contextual information associated with the user's context, including who, when, where, and what. That is, the context management unit 120 may process or convert the raw data received from the IoT device 170 to generate context recognition information for determining the user's context.

Then, the context management unit 120 may determine whether the generated high-level context awareness information satisfies service conditions required for service provision. That is, each service provided by the context awareness system 100 may be associated with a specific condition for providing the service. For example, a parking service that provides an optimal parking location may be a condition for providing the service whether or not a user subscribing to the parking service enters a building related to the parking service. Not limited.

When it is determined that the service condition is satisfied, the context awareness system 100 and/or the service management unit 110 may execute a service satisfying the service condition in one or more IoT devices associated with the user. For example, the service management unit 110 may receive a list of services used by the user from the situation management unit 120. In this case, the service management unit 110 searches the service list to provide services for which the user satisfies service conditions. It is determined whether to use , and service execution information for executing the service may be transmitted to the topology control unit 130 . Then, when the service execution information is received, the topology control unit 130 determines one or more IoT devices included within a predetermined distance from the user's location using a dynamic mesh network, and the device management unit 140 ) to transmit service execution information for service execution. When service execution information is received, the device management unit 140 may provide a user-centered context-aware service by executing a service that satisfies a service condition in one or more IoT devices associated with a user.

In FIG. 1 , the context awareness system 100 is illustrated as receiving sensing information from one IoT device 170, but is not limited thereto, and the context awareness system 100 receives sensing information from a plurality of IoT devices. can do. In addition, in FIG. 1, each functional component included in the context awareness system 100 has been separately described, but this is only to aid understanding of the present invention, and one computing device may perform two or more functions. With this configuration, even if there is no service request from the user, the context awareness system 100 recognizes the current situation of the user using various information obtained by the IoT devices, and optimizes the current situation of the user. service can be provided.

2 is a functional block diagram showing the internal configuration of the service management unit 110 according to an embodiment of the present invention. As shown, the service management unit 110 includes an open service API 210, a service registration module 220, a service modification module 230, a service removal module 240, a service request module 250, a service monitoring module ( 260), a user service management module 270, and the like, but are not limited thereto. As described above, the service manager 110 interacts with the context manager 120, the topology controller 130, the device manager 140, and the communication unit 150 to provide a user-centered context aware service.

According to an embodiment, the service management unit 110 may support or perform user service search, subscription, withdrawal, service provider registration, and service execution in an IoT device including a user terminal. Here, the service provided to the user may include, but is not limited to, an application program visualized through a user interface of a user terminal, a control service of an IoT device such as an elevator or an air conditioner through an application program.

The service registration module 220 supports registration of services developed by service providers, the service modification module 230 supports modification of services registered by service providers, and the service removal module 240 removes registered services. can support That is, the service management unit 110 may manage context-oriented services that can be provided to users by registering, modifying, or removing them. In other words, through interactions of the service registration module 220 , service modification module 230 , and service removal module 240 , services that can be provided to the user may be continuously changed. In this case, the open service API 210 may support an open structure that facilitates service development by providing an API for a service provider.

According to an embodiment, the service request module 250 may support communication between an actual service and a context-aware system, and provide service execution information for executing a service based on context-aware information. In addition, the service monitoring module 260 may include an interface that provides conditions necessary for service execution to the context management unit 120 and, when the conditions are met, provides related content to the context aware system. Also, the user service management module 270 may support subscription or withdrawal of a user's service. That is, the service request module 250, the service monitoring module 260, and the user service management module 270 interact with each other and may support provision of a service suitable for a user's situation.

3 is a functional block diagram showing the internal configuration of the context management unit 120 according to an embodiment of the present invention. As shown, the context management unit 120 may include a service monitor module 330, a context recognition module 320, and a raw data acquisition module 310, but is not limited thereto. As described above, the context manager 120 interacts with the service manager 110, the topology controller 130, the device manager 140, and the communication unit 150 to provide a user-centered context aware service.

According to an embodiment, the raw data acquisition module 310 may receive raw data including information related to a plurality of IoT devices and user information from a plurality of IoT devices. For example, each sensor may transmit its own sensing information to a nearby IoT device. In this case, each IoT device collects sensing information received from a plurality of sensors to obtain raw data module 310 can be sent to

The context awareness module 320 may receive raw data from the raw data acquisition module 310 and use the raw data to generate high level context awareness information associated with the user's context. For example, the contextual awareness module 320 converts the data format of the raw data to generate low-level contextual information, and based on the low-level contextual information, a person associated with the user, It can generate high-level contextual information associated with the user's context, including when, where, and what. That is, the contextual awareness module 320 may recognize or identify the user's current context using the generated contextual information and predict the user's next action.

According to an embodiment, when the service manager 110 registers a new service or modifies a service, the service monitor module 330 may register service conditions such as an IoT device associated with the corresponding service. For example, if the registered service condition is satisfied, the corresponding service can be performed, and the service monitor module 330 determines the service in which the high level context awareness information generated by the context awareness module 320 is registered. When it is determined that the condition is satisfied, the service management unit 110 may be requested to perform a service related to the satisfied service condition.

4 is a functional block diagram showing the internal configuration of the topology control unit 130 according to an embodiment of the present invention. As shown, the topology control unit 130 includes a map data management module 410, a shortest path search module 420, a topology reconstruction module 430, a location estimation module 440, a node removal module 450, and a node insertion module 460 and the like, but is not limited thereto. As described above, the topology control unit 130 interacts with the service management unit 110, the context management unit 120, the device management unit 140, and the communication unit 150 to provide a user-centered context aware service.

According to an embodiment, the topology control unit 130 may interoperate a plurality of IoT devices included in a specific area to provide a user-centered context aware service. For example, the topology control unit 130 may create a dynamic mesh network including location information of a plurality of IoT devices and interoperate the plurality of IoT devices.

In order to create a dynamic mesh network, the map data management module 410 may store or manage data by mapping a location of an actual map and each location of a plurality of IoT devices. For example, the map data management module 410 determines the location of each IoT device based on any sensor included in the plurality of IoT devices and/or any signal (eg, RSSI, etc.) transmitted from the plurality of IoT devices. It is possible to create and manage a map associated with a plurality of IoT devices by determining the location of each IoT device and combining the determined location of each IoT device with a previously stored or extracted actual map.

The shortest path search module 420 may determine the shortest path between each IoT device based on the location of each IoT device determined by the map data management module 410 and/or the generated map. For example, the shortest path search module 420 may use any algorithm capable of determining the shortest path connecting a plurality of points (eg, Algorithm, etc.) can be used to determine the shortest path between each IoT device. That is, an initial dynamic mesh network may be created by the map data management module 410 and the shortest path search module 420 .

According to an embodiment, the location estimation module 440 may continuously estimate or determine the location of a dynamic IoT device (eg, a user terminal, etc.) moving with a user. For example, the location estimating module 440 may estimate or determine the location of the IoT device associated with the user using an arbitrary sensor (eg, a GPS sensor) included in the IoT device. In this way, a user-centered context aware service may be provided based on the user's location estimated by the location estimation module 440 and the generated dynamic mesh network.

According to one embodiment, the topology reconstruction module 430 may reconstruct the dynamic mesh network by modifying or updating it. In this case, the topology reconstruction module 430 may reconstruct the dynamic mesh network together with the node removal module 450 and the node insertion module 460 . For example, when a new IoT device is included in an area where a dynamic mesh network is configured, the topology reconstruction module 430 and the node insertion module 460 determine the location of the IoT device and determine the shortest path between the plurality of IoT devices. By recrystallization, the dynamic mesh network can be reconstructed. In another example, when an IoT device is removed from an area where a dynamic mesh network is configured, the topology reconfiguration module 430 and the node removal module 450 re-determine the shortest path between the remaining IoT devices except for the corresponding IoT device, thereby re-determining the dynamic mesh network. can be reconstructed.

5 is a functional block diagram showing the internal configuration of the device management unit 140 according to an embodiment of the present invention. As shown, the device management unit 140 may include a fixed device management module 510 and a mobile device management module 520, but is not limited thereto. As described above, the device manager 140 interacts with the service manager 110, the context manager 120, the topology controller 130, and the communication unit 150 to provide a user-centered context aware service.

According to an embodiment, a fixed device is an IoT device installed at a specific location in a specific area and having a fixed location, and may indicate a device included in a predetermined area based on a user's location, and a mobile device is associated with a user and has a dynamic It can represent an IoT device that moves to . The device management unit 140 may perform registration of IoT devices and location management, state management, performance management, etc. for services provided to IoT devices through the fixed device management module 510 and the mobile device management module 520. .

According to an embodiment, the fixed device management module 510 may include a device registration module 512, a device location management module 514, a device status management module 516, a device service management module 518, and the like. . In addition, the mobile device management module 520 may include a user terminal registration module 522, a user terminal location management module 524, a user terminal status management module 526, a user terminal service management module 528, and the like. .

The device registration module 512 and/or the user terminal registration module 522 may register and manage information associated with the new IoT device when the new IoT device is included in the area where the dynamic mesh network is configured. In addition, the device location management module 514 and/or the user terminal location management module 524 may continuously determine the fixed location or moving location of the registered IoT device and utilize it to provide a user location-based service. Here, the device state management module 516 and/or the user terminal state management module 526 may manage states such as processing capacity and battery of the current IoT device. In addition, the device service management module 518 and the user terminal service management module 528 may manage or process the type of service currently provided or to be provided by the IoT device, service provision time, and the like.

Additionally, the communication unit 150 may be in charge of communication between the IoT device and the context awareness system. For example, the communication unit 150 collects or receives data and/or information from the IoT device using request/response HTTP (Hypertext Transfer Protocol), and transfers the collected or received data and/or information to the device management unit 140. can be forwarded to That is, the communication unit 150 may function as a gateway between the IoT device and the context awareness system.

According to one embodiment, the data structure of data transmitted by the communication unit 150 may be composed of three columns: a tag, a MAC address, and a data list. Here, the tag may indicate a data category associated with the IoT device, and for example, in the case of data associated with user subscription, the tag may be determined as “user registration”. In addition, the MAC address represents a unique identifier of the IoT device, and the data list may include a JSON-type array.

6 is a diagram illustrating an example of low-level contextual awareness information 600 according to an embodiment of the present invention. As described above, the context awareness system receives raw data including user information and information related to the plurality of IoT devices from a plurality of IoT devices, and converts the data format of the raw data to perform low-level context awareness. Information 600 may be generated.

As shown, the low-level contextual information 600 may include information 610 associated with a plurality of IoT devices as an infrastructure context and user information 620 as a user context. can For example, information 610 associated with a plurality of IoT devices is collected from IoT devices and sensors (eg, sensor 1, sensor 2, sensor N, etc.) around the user's current location identified on the basis of the user information 620. The sensor data 612 may be included. In addition, the user information 620 is data collected from the user's IoT device and may include event data 622 and sensor data 624.

According to an embodiment, the event data 622 is data about a user's profile, schedule, call list, time log, user application, and the like, and may include data capable of storing the user's current state. In addition, the sensor data 622 may include GPS data, accelerator data, Wi-Fi, web-log data, and Bluetooth sensor data generated from various sensors included in the user's IoT device.

7 is a diagram illustrating an example of high-level contextual awareness information 700 according to an embodiment of the present invention. As described above, the context-awareness system may generate high-level contextual information 700 related to the user's context based on the received raw data. For example, the context-aware system converts the data format of raw data to generate low-level context-aware information, and determines who (712) and when (when) associated with the user based on the low-level context-aware information. 714 , where 716 , what 718 , and high-level contextual information 700 associated with the user's context can be generated. That is, the high-level situational awareness information 700 is 4W information 710 including who 712, when 714, where 716, and what 718. ), service data 720 and public cloud data 730.

According to an embodiment, the service data 720 may include information about a service that a user subscribes to or subscribes to, and mesh data. Also, the public cloud data 730 may include public data generated from a service that a user is interested in or subscribes to. For example, the public data may include weather data related to the user's location, parking lot status information, bus stop information, and the like. Here, the service data 720 and/or the public cloud data 730 may be generated or transmitted through an application of an IoT device associated with a user. The context-aware system searches the high-level context-aware information 700 of a specific user, and when a condition is met, it can deliver service contents to the user. With this configuration, a service currently needed by a user can be effectively determined based on high-level situational awareness information, and an optimal service can be provided to the user in real time.

8 is a diagram illustrating an example of a dynamic mesh network 800 according to one embodiment of the present invention. As described above, the context awareness system generates a dynamic mesh network 800 including location information of a plurality of IoT devices, and uses the dynamic mesh network to locate one or more IoT devices included within a predetermined distance from the user's location. can decide

According to one embodiment, dynamic mesh network 800 may be a virtual overlay network. For example, in the dynamic mesh network 800, nodes corresponding to A to I may represent a plurality of IoT devices, and an edge may represent a connection between each IoT device. That is, the dynamic mesh network 800 may be configured by connecting a plurality of IoT devices corresponding to A to I through the shortest path.

According to one embodiment, connections between IoT devices may be used to estimate a user's subsequent location. For example, if a user is currently receiving a service from an IoT device corresponding to D, the service can be prepared and provided under the assumption that the user can move to one of B, C, E, and I connected to D. In this way, through one or more IoT devices determined based on the location, the context-aware system may provide a service optimized for the user's current situation.

9 is a diagram illustrating an example of reconfiguring a dynamic mesh network 910 according to an embodiment of the present invention. According to one embodiment, dynamic mesh network 910 may be continuously reconfigured. For example, when a new IoT device is included or an existing IoT device is removed, the dynamic mesh network 910 may be reconfigured.

In the illustrated example, the dynamic mesh network 910 may be configured by connecting six IoT devices of A, B, C, D, E, and Z. Here, when the IoT device corresponding to Z is removed or unregistered, a reconfigured dynamic mesh network 920 may be created. According to an embodiment, when a specific IoT device included in a plurality of IoT devices is removed, the context awareness system removes a connection to the specific IoT device, and each of the plurality of IoT devices from which the specific IoT device is removed. The shortest moving distance for can be determined. Then, the context awareness system may generate a reconfigured dynamic mesh network 920 by reconstructing a connection to each of a plurality of IoT devices from which a specific IoT device has been removed according to the determined shortest moving distance. For example, to determine the shortest travel distance, a situational awareness system can extract a triangle containing three nodes. Then, the situational awareness system may determine the shortest distance except for a case where a triangle is not formed because lines are not completely connected among the extracted triangles.

Additionally or alternatively, when a new IoT device is discovered, the context aware system may determine a shortest moving distance for each of the new IoT device and the plurality of existing IoT devices. In addition, the context aware system may create a dynamic mesh network by reconfiguring the IoT device and connections to a plurality of IoT devices according to the determined shortest moving distance. With this configuration, even when at least some of the plurality of IoT devices are changed, the dynamic mesh network 910 is reconfigured, so that a service based on the shortest path of the IoT devices can be effectively provided to users.

10 is a flowchart illustrating an example of a method 1000 of providing a user-centered context aware service in an IoT environment according to an embodiment of the present invention. The method 1000 of providing a user-oriented context awareness service may be performed by a processor (eg, at least one processor of a context awareness system). As shown, the method 1000 for providing a user-centered context-aware service may be initiated by a processor receiving raw data including information related to a plurality of IoT devices and user information from a plurality of IoT devices (S1010).

The processor may generate high-level contextual information associated with the user's context based on the received raw data (S1020). In addition, the processor may determine whether the generated high-level context awareness information satisfies a service condition required for service provision (S1030). When it is determined that the service condition is satisfied, the processor may execute a service satisfying the service condition in one or more IoT devices associated with the user (S1040).

According to an embodiment, the processor searches a service list used by the user, determines whether the user uses a service that satisfies the service condition, and if it is determined that the user uses the service, provides service execution information for executing the service. can decide Thereafter, the processor may execute a service satisfying a service condition in one or more IoT devices associated with the user based on the determined service execution information.

11 is a flow diagram illustrating an example of a method 1100 of generating high-level contextual information according to an embodiment of the present invention. The method 1100 for generating high-level context awareness information may be performed by a processor (eg, at least one processor of a context awareness system). As described above, the processor may generate high-level contextual information associated with the user's context based on the raw data.

In this case, the high-level context-aware information generation method 1100 may be initiated by a processor converting a data format of raw data to generate low-level context-aware information (S1110). The processor may generate high-level contextual information related to the user's context, including who, when, where, and what, based on the low-level contextual information. It can (S1120).

According to an embodiment, the low-level contextual information may include information associated with a plurality of IoT devices as public infrastructure context and user information as user context. In addition, the high-level contextual information may include 4W information including who, when, where, and what, service data, and public cloud data.

12 is a flow diagram illustrating an example of a method 1200 of creating a dynamic mesh network according to an embodiment of the present invention. The dynamic mesh network creation method 1200 may be performed by a processor (eg, at least one processor of a context aware system). According to an embodiment, the processor may generate a dynamic mesh network including location information of a plurality of IoT devices, and determine one or more IoT devices included within a predetermined distance from a location of a user by using the dynamic mesh network. Then, the processor may execute a service that satisfies the service condition in one or more IoT devices.

When a new first IoT device is discovered on the dynamic mesh network, the processor may determine a first shortest movement distance between the first IoT device and each of the plurality of IoT devices (S1210). For example, the processor may determine the first shortest distance traveled using any algorithm for determining the shortest distance and/or shortest path. Then, the processor may generate a dynamic mesh network by reconfiguring connections to the first IoT device and the plurality of IoT devices according to the determined first shortest moving distance (S1220).

13 is a flow diagram illustrating an example of a dynamic mesh network reconfiguration method 1300 according to an embodiment of the present invention. Dynamic mesh network reconstruction method 1300 may be performed by a processor (eg, at least one processor of a context aware system). According to an embodiment, the processor may generate a dynamic mesh network including location information of a plurality of IoT devices, and determine one or more IoT devices included within a predetermined distance from a location of a user by using the dynamic mesh network. Then, the processor may execute a service that satisfies the service condition in one or more IoT devices.

When the second IoT device included in the plurality of IoT devices on the dynamic mesh network is removed, the processor may remove the connection to the second IoT device (S1310). Then, the processor may determine a second shortest moving distance for each of the plurality of IoT devices from which the second IoT device is removed (S1320). For example, the processor may determine the second shortest travel distance using any algorithm for determining the shortest distance and/or shortest path. In this case, the processor may generate a dynamic mesh network by reconstructing a connection to each of the plurality of IoT devices from which the second IoT device is removed according to the determined second shortest moving distance (S1320).

14 is a block diagram showing the internal configuration of a situational awareness system 1400 according to an embodiment of the present invention. In the illustrated example, the context awareness system 1400 may include a memory 1410 , a processor 1420 , a communication module 1430 and an input/output interface 1440 . As shown in FIG. 14 , context awareness system 1400 may be configured to communicate information and/or data over a network using communication module 1430 .

Memory 1410 may include any non-transitory computer readable recording medium. According to one embodiment, the memory 1410 is a non-perishable mass storage device (permanent mass storage device) such as random access memory (RAM), read only memory (ROM), disk drive, solid state drive (SSD), flash memory, and the like. mass storage device). As another example, a non-perishable mass storage device such as a ROM, SSD, flash memory, or disk drive may be included in the context aware system 1400 as a separate permanent storage device separate from memory. Also, an operating system and at least one program code may be stored in the memory 1410 .

These software components may be loaded from a computer-readable recording medium separate from the memory 1410 . Recording media readable by such a separate computer may include a recording medium directly connectable to the situation awareness system 1400, for example, a floppy drive, disk, tape, DVD/CD-ROM drive, memory card, etc. It may include a computer-readable recording medium. As another example, software components may be loaded into the memory 1410 through the communication module 1430 rather than a computer-readable recording medium. For example, at least one program may be loaded into the memory 1410 based on a computer program installed by files provided by developers or a file distribution system that distributes application installation files through the communication module 1430. can

The processor 1420 may be configured to process commands of a computer program by performing basic arithmetic, logic, and input/output operations. Commands may be provided to a user terminal (not shown) or other external system by the memory 1410 or the communication module 1430 .

The communication module 1430 may provide a configuration or function for a user terminal (not shown) and the context awareness system 1400 to communicate with each other through a network, and the context awareness system 1400 may provide an external system (for example, a separate configuration or function to communicate with a cloud system, etc.). For example, control signals, commands, data, etc. provided under the control of the processor 1420 of the contextual awareness system 1400 are transmitted through the communication module 1430 and the network to the user terminal and/or the communication module of the external system. It may be transmitted to a terminal and/or an external system.

In addition, the input/output interface 1440 of the context awareness system 1400 is connected to the context awareness system 1400 or means for interface with a device (not shown) for input or output that the context awareness system 1400 may include. can be In FIG. 14 , the input/output interface 1440 is illustrated as an element separately configured from the processor 1420 , but is not limited thereto, and the input/output interface 1440 may be included in the processor 1420 . The contextual awareness system 1400 may include many more components than those of FIG. 14 . However, there is no need to clearly show most of the prior art components.

The processor 1420 of the context awareness system 1400 may be configured to manage, process, and/or store information and/or data received from a plurality of user terminals and/or a plurality of external systems.

The above-described methods and/or various embodiments may be realized with digital electronic circuits, computer hardware, firmware, software, and/or combinations thereof. Various embodiments of the present invention may be performed by a data processing device, eg, one or more programmable processors and/or one or more computing devices, or as a computer readable recording medium and/or a computer program stored on a computer readable recording medium. can be implemented The above-described computer programs may be written in any form of programming language, including compiled or interpreted languages, and may be distributed in any form, such as a stand-alone program, module, or subroutine. A computer program may be distributed over one computing device, multiple computing devices connected through the same network, and/or distributed over multiple computing devices connected through multiple different networks.

The methods and/or various embodiments described above may be performed by one or more processors configured to execute one or more computer programs that process, store, and/or manage any function, function, or the like, by operating on input data or generating output data. can be performed by For example, the method and/or various embodiments of the present invention may be performed by a special purpose logic circuit such as a Field Programmable Gate Array (FPGA) or an Application Specific Integrated Circuit (ASIC), and the method and/or various embodiments of the present invention may be performed. Apparatus and/or systems for performing the embodiments may be implemented as special purpose logic circuits such as FPGAs or ASICs.

The one or more processors executing the computer program may include a general purpose or special purpose microprocessor and/or one or more processors of any kind of digital computing device. The processor may receive instructions and/or data from each of the read-only memory and the random access memory, or receive instructions and/or data from the read-only memory and the random access memory. In the present invention, components of a computing device performing methods and/or embodiments may include one or more processors for executing instructions, and one or more memory devices for storing instructions and/or data.

According to one embodiment, a computing device may exchange data with one or more mass storage devices for storing data. For example, a computing device may receive/receive data from and transfer data to a magnetic or optical disc. A computer-readable storage medium suitable for storing instructions and/or data associated with a computer program includes semiconductor memory devices such as Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable PROM (EEPROM), and flash memory devices. Any type of non-volatile memory may be included, but is not limited thereto. For example, computer readable storage media may include magnetic disks such as internal hard disks or removable disks, magneto-optical disks, CD-ROM and DVD-ROM disks.

To provide interaction with a user, a computing device includes a display device (eg, a cathode ray tube (CRT), a liquid crystal display (LCD), etc.) It may include a pointing device (eg, a keyboard, mouse, trackball, etc.) capable of providing input and/or commands to, but is not limited thereto. That is, the computing device may further include any other type of device for providing interaction with a user. For example, a computing device may provide any form of sensory feedback to a user for interaction with the user, including visual feedback, auditory feedback, and/or tactile feedback. In this regard, the user may provide input to the computing device through various gestures such as visual, voice, and motion.

In the present invention, various embodiments may be implemented in a computing system including a back-end component (eg, a data server), a middleware component (eg, an application server), and/or a front-end component. In this case, the components may be interconnected by any form or medium of digital data communication, such as a communication network. For example, the communication network may include a local area network (LAN), a wide area network (WAN), and the like.

A computing device based on the example embodiments described herein may be implemented using hardware and/or software configured to interact with a user, including a user device, user interface (UI) device, user terminal, or client device. can For example, the computing device may include a portable computing device such as a laptop computer. Additionally or alternatively, the computing device may include personal digital assistants (PDAs), tablet PCs, game consoles, wearable devices, internet of things (IoT) devices, virtual reality (VR) devices, AR (augmented reality) device, etc. may be included, but is not limited thereto. A computing device may further include other types of devices configured to interact with a user. Further, the computing device may include a portable communication device (eg, a mobile phone, smart phone, wireless cellular phone, etc.) suitable for wireless communication over a network, such as a mobile communication network. A computing device communicates wirelessly with a network server using wireless communication technologies and/or protocols such as radio frequency (RF), microwave frequency (MWF) and/or infrared ray frequency (IRF). It can be configured to communicate with.

The various embodiments herein, including specific structural and functional details, are exemplary. Accordingly, embodiments of the present invention are not limited to those described above and may be implemented in various other forms. In addition, terms used in the present invention are for describing some embodiments and are not construed as limiting the embodiments. For example, the singular and the above may be construed to include the plural as well, unless the context clearly dictates otherwise.

In the present invention, unless defined otherwise, all terms used in this specification, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which such concept belongs. . In addition, terms commonly used, such as terms defined in a dictionary, should be interpreted as having a meaning consistent with the meaning in the context of the related art.

Although the present invention has been described in relation to some embodiments in this specification, various modifications and changes can be made without departing from the scope of the present invention that can be understood by those skilled in the art. Moreover, such modifications and variations are intended to fall within the scope of the claims appended hereto.

100: situational awareness system
110: service management unit
120: situation management department
130: topology control unit
140: device management unit
150: communication department
160: network layer
170: IoT device
180: sensor

Claims (16)

A method for providing a user-oriented context-aware service in an IoT environment performed by at least one processor,
Receiving raw data including information and user information associated with the plurality of IoT devices from a plurality of IoT devices;
generating high-level contextual information associated with a user's context based on the received raw data;
determining whether the generated high-level contextual information satisfies a service condition required for service provision;
Executing a service satisfying the service condition in one or more IoT devices associated with the user when it is determined that the service condition is satisfied;
generating a dynamic mesh network including location information of the plurality of IoT devices; and
determining the one or more IoT devices included within a predetermined distance from the location of the user using the dynamic mesh network;
including,
The step of executing the service is,
searching a service list used by the user and determining whether the user uses a service that satisfies the service condition;
determining service execution information for executing the service when it is determined that the service is used; and
Executing a service satisfying the service condition in one or more IoT devices associated with the user based on the determined service execution information;
including,
Generating high-level contextual information associated with the user's context based on the received raw data includes:
generating low-level contextual information by converting a data format of the raw data; and
Generating high-level contextual information associated with a user's context, including who, when, where, and what, associated with the user based on the low-level contextual information step;
Including, a method for providing a user-centric context-aware service in an IoT environment.
delete delete delete According to claim 1,
Creating the dynamic mesh network,
determining a first shortest movement distance between the first IoT device and each of the plurality of IoT devices when a new first IoT device is found; and
generating the dynamic mesh network by reconfiguring connections to the first IoT device and the plurality of IoT devices according to the determined first shortest moving distance;
Including, a method for providing a user-centric context-aware service in an IoT environment.
According to claim 1,
Creating the dynamic mesh network,
removing a connection to the second IoT device when the second IoT device included in the plurality of IoT devices is removed;
determining a second shortest moving distance for each of the plurality of IoT devices from which the second IoT device is removed; and
generating the dynamic mesh network by reconfiguring a connection to each of a plurality of IoT devices from which the second IoT device is removed according to the determined second shortest moving distance;
Including, a method for providing a user-centric context-aware service in an IoT environment.
A computer program stored in a computer readable recording medium to execute the method according to any one of claims 1, 5 and 6 on a computer.
As a user-oriented situation awareness system,
A communication unit for receiving raw data including information and user information associated with the plurality of IoT devices from a plurality of IoT devices;
a device management unit to store the received raw data in a raw data DB;
a context management unit that generates high-level contextual information associated with a user's context based on the raw data stored in the raw data DB and stores the generated high-level contextual information in a context DB;
a service management unit that searches a service list, determines whether the user uses a service that satisfies a service condition, and transmits service execution information for executing the service; and
When receiving the service execution information, determining one or more IoT devices included within a predetermined distance from the location of the user using a dynamic mesh network, and transmitting service execution information for executing the service to the device manager a topology controller;
including,
The context management unit converts the data format of the raw data to generate low-level context-aware information, and based on the low-level context-aware information, a person associated with the user generate high-level contextual information associated with the user's context, including when, where, and what;
The context management unit determines whether the generated high-level context awareness information satisfies a service condition required for service provision, and transmits a list of services used by the user when it is determined that the service condition is satisfied. , a user-centered situational awareness system.
delete delete delete delete According to claim 8,
Wherein the device management unit executes a service satisfying the service condition in one or more IoT devices associated with the user.
According to claim 8,
Wherein the topology controller generates a dynamic mesh network including location information of the plurality of IoT devices.
According to claim 14,
The topology control unit,
When a new first IoT device is discovered, a first shortest movement distance is determined for the first IoT device and each of the plurality of IoT devices, and the first shortest movement distance is determined according to the determined first shortest movement distance. A user-centric situational awareness system for creating the dynamic mesh network by reconfiguring IoT devices and connections to the plurality of IoT devices.
According to claim 14,
The topology control unit,
When the second IoT device included in the plurality of IoT devices is removed, a connection to the second IoT device is removed, and a second shortest path for each of the plurality of IoT devices from which the second IoT device is removed is removed. A user-centered situational awareness system for determining a moving distance and reconstructing a connection to each of a plurality of IoT devices from which the second IoT device is removed according to the determined second shortest moving distance to create the dynamic mesh network.

Images