KR102094041B1 - System having the Semantic Engine based on RDF Graph for Autonomous Interaction between IoT Devices in Real-Time - Google Patents

Abstract

Disclosed are a resource description framework (RDF) graph based semantic engine for autonomous interaction in real time between Internet of things (IoT) terminals and a method thereof. According to the present invention, a system having an RDF graph based semantic engine comprises: an IoT terminal having various sensors, light bulbs/LED lights, and a device; an aggregator having a web server and used as an IoT service platform based on oneM2M standards; a semantic IoT gateway in communication with the aggregator and used as a gateway between the IoT terminal and the server operating based on a semantic engine; and a user terminal connected to the semantic IoT gateway and having a web client.

Description

System having the Semantic Engine based on RDF Graph for Autonomous Interaction between IoT Devices in Real-Time}

The present invention relates to a system having a Semantic engine based on RDF (Resource Description Framework) graph for autonomous interaction between IoT terminals in real time, and more specifically, an IoT platform system using a unique Resource URI in oneM2M standard. It is registered on the web and can be accessed through IoT standard communication protocols such as HTTP, MQTT, CoAP, Resource URI means the URI of oneM2M standard-based resource, and Device in the RDF (Resource Description Framework) graph model means IoT terminal. Service provides service functions supported by the IoT terminal, and when the device is a sensor or light bulb / LED light, the service provides functions for on / off, color change, and brightness change of the light bulb / LED light of the sensor, To express this as a Semantic resource, the RDF graph model for IoT common service elements defined in the IoT standard oneM2M is used, and it is defined in the IoT standard. The modeled common service function is modeled as an RDF graph, giving semantics to be applied to IoT terminals and machines by using Semantic vocabulary for services possessed by IoT terminals and terminals, and rules defined in the IoT platform ( rule) to provide the service.

The Internet of Things (IoT) uses IoT devices to connect various sensors / sensor networks, MCUs, actuators and motors, RFID tags, and ICT communication technologies through Things to connect objects, processes, and data to wired and wireless communication networks. Through IoT gateway, wireless communication (Bluetooth, Wi-Fi, ZigBee, PLC, LTE / 5G, 6LoWPAN) and TCP / IP over Ethernet protocols are used.

The IoT protocol stack mounted on the IoT device and the IoT gateway is a physical layer such as IEEE 802151 Bluetooth (BLE), IEEE 80211 Wi-Fi, IEEE 802154 ZigBee, IEEE 19012 PLC, LTE / 5G, 6LoWPAN, IEEE 8023 Ethernet for L2 Connectivity. (Physical Layer); A network layer that provides access control such as IPv6, TCP, UDP, ICMP, RTP, SCTP, QUIC, AAA, EAP, and SSL / TLS IoT network protocols; It includes a service platform for IoT services of the usage layer of HTTP / HTTPS, CoAP, MQTT, XMPP, DDS, SIP, DNS, SSDP.

IoT application services are applied to various fields such as IoT home appliances, smart homes, smart buildings, smart factories, smart farms, smart healthcare, intelligent vehicles, fire / disaster prevention, and disaster management using smart devices.

IoT devices (BLE node, Wi-Fi node, ZigBee node, etc.) are communicated by IoT Gateway (agent)-router-Application server-client structure.

IoT dedicated network LoRa network structure is LoRa device (IoT device using LoRa RF)-LoRa base station (uplink / downlink resource allocation and data transmission / reception)-LoRa network server (subscriber / session management)-ThingPlug (IoT platform)-Application server-communicated in a client structure.

When using a NB-IoT (NarrowBand Internet of Things) terminal, the NB-IoT terminal-a LTE base station-an LTE exchange-an IoT platform-an application server-a client structure is communicated.

For IoT network security, standards for IoT device control and Internet of Things security management are being reviewed in Internet Protocol Smart Objects (IPSO), OneM2M, etc., and provide basic authentication encryption functions in the unit of IoT connectivity platform, App.

OneM2M is a private standard organization in the global IoT field that provides requirements for IoT, IoT technology, architecture, API specifications, security solutions, and interoperability, and smart cities, smart cars, home automation, and smart meters for smart grids. It is promoting the standardization of M2M by connecting things to the Internet.

oneM2M is a global standardization cooperation group in the field of intelligent communications (M2M), the American Telecommunications Information Standards Association (ATIS), the Telecommunications Industry Association (TIA), the European Telecommunications Association (ETSI), the Korea Telecommunications Technology Association (TTA), and Japan Radio Industry associations (ARIB) and China Communication Standards Association (CCSA) participate, and many companies, research institutes, and universities participate. Partners use cases and requirements for development of common M2M service platform standards, end-to-end M2M architecture and service layer and platform standards, common use examples and interfaces in terms of M2M terminals and modules , API (Application Programming Interface).

oneM2M currently has more than 200 participating partners and members, AT & T, Alcatel-Lucent, Deutsche Telecom, IBM, Cisco Systems, BT Group, Adobe, Ericsson, Sierra Wireless, Interdigital, Intel, Samsung Group, LG U +, Telephonica is participating.

As related prior art 1, Patent Publication No. 10-2017-0093680 discloses a resource unit configuration method for uplink signal transmission of an LTE NB-IoT (NarrowBand Internet of Things) terminal in a 3GPP LTE / LTE-Advanced system. , A technique for setting a transmission resource for transmitting HARQ ACK / NACK of an NB IoT terminal that transmits and receives data using a narrow band is known. Particularly, an embodiment is a method for a NarrowBand IoT terminal to transmit an uplink signal, receiving downlink data from a base station, generating HARQ ACK / NACK feedback information for downlink data, and HARQ ACK / NACK feedback. And transmitting information to a base station through a Narrowband Physical Uplink Shared Channel (NPUSCH), and the NPUSCH provides a method and apparatus mapped to a resource unit composed of M subcarriers and K slots.

As related prior art 2, in Patent Publication No. 10-2017-0107878, "NB-IoT terminal uplink data transmission method and apparatus thereof" is disclosed, and NB IoT (NarrowBand Internet of Internet) in 3GPP LTE / LTE-Advanced system Things) It relates to an uplink data transmission and reception technology of the terminal. Specifically, it relates to a method and apparatus for allocating resources of an uplink data channel of an NB IoT terminal that transmits and receives data using a narrow band. One embodiment is a method for a NarrowBand Internet of things (NB IoT) terminal to transmit uplink data, receiving and receiving downlink control information (DCI) including a subcarrier indication field from a base station. Setting a radio resource of the uplink data channel based on at least one of the carrier indication field and the subcarrier spacing information set in the NB IoT terminal, and transmitting the uplink data using the radio resource of the uplink data channel. It provides a method and apparatus comprising.

However, the existing IoT service platform is expressed as a Semantic resource that is given meaning for IoT terminals and machines to understand through the Semantic query language SPARQL (SPARQL Protocol and RDF Query Language) defined by W3C. The RDF graph model for IoT common service elements defined in the standard oneM2M was not used to provide autonomous interaction of the IoT service platform.

Patent Publication No. 10-2017-0093680 (published on August 16, 2017), "Method and apparatus for configuring resource unit for uplink signal transmission of NB-IoT terminal", Katie Co., Ltd. Patent Publication No. 10-2017-0107878 (published on September 26, 2017), "Method and Device for Uplink Data Transmission of NB-IoT Terminal", Katie Co., Ltd.

The object of the present invention for solving the above problem is to register on the IoT platform system using a unique Resource URI in the oneM2M standard and access it through IoT standard communication protocols such as HTTP, MQTT, and CoAP, and the Resource URI is oneM2M standard The URI of the resource based on the resource, the device of the RDF (Resource Description Framework) graph model means the IoT terminal, and the service provides the service function supported by the IoT terminal, and the service when the device is a sensor or a light bulb / LED light Provides functions for on / off, color change, and brightness change of the bulb / LED light of the sensor, and uses the RDF graph model for IoT common service elements defined in the IoT standard oneM2M to express this as a Semantic resource. , Model common service function defined in IoT standard as RDF graph, and use Semantic vocabulary for IoT terminal and service possessed by I Semantic based on RDF (Resource Description Framework) graph for autonomous interaction between IoT terminals that provide services by granting semantics applied to oT terminals and machines and executing rules defined in the IoT platform Provided is a system and method having an engine.

A Semantic resource that is given meaning to be used for IoT terminals and machines through RDF Triple, which uses all the data generated in the IoT system, using RDF defined in W3C, and the Semantic query language SPARQL (SPARQL Protocol and RDF Query Language) defined in W3C. Expressed as to provide the autonomous interaction of the IoT service platform, and provides a service with faster execution time than the IoT platform where the existing Semantic was introduced, the RDF graph-based Semantic engine for autonomous interaction between IoT terminals and Provides a method.

To achieve the object of the present invention, a system equipped with an RDF graph-based Semantic engine for autonomous interaction in real time between IoT terminals includes: an IoT terminal having various sensors, lights, and devices; Aggregator having a web server and used as an IoT service platform based on oneM2M standard; A semantic IoT gateway communicated with the aggregator and used as a gateway between the IoT terminal and a server operating based on a semantic engine; And a user terminal connected to the semantic IoT gateway and having a web client,

The Aggregator is a oneM2M standard based IoT service platform, a web server connecting a wired or wireless Internet; oneM2M DataBase module for storing oneM2M standard resources; A resource monitoring module that monitors the creation, deletion, and change of resources in the aggregator and informs the user terminal; And an interworking interface module that manages integrated APIs of different IoT platforms, analyzes the request message from the aggregator, and then calls the API of the corresponding platform to directly transmit control commands for IoT devices,
The web client of the user terminal provides a user with information about IoT terminals and services registered in the IoT service platform through the web, and visually shows an RDF graph provided by Semantic Exposing and shows it; A rule customizing module that dynamically configures rules for autonomous interaction by requesting to the Semantic IoT Gateway for creation and deletion of rules that meet user needs; And a device control module that transmits a device control command to the IoT terminal through the Semantic IoT Gateway and the aggregator and outputs a response.

The semantic IoT gateway includes: a Semantic Monitoring & Modeling module that configures oneM2M resources registered in the Aggregator into RDF triples based on a graph model; Semantic Database (Semantic Database) for storing the generated RDF graph; A Semantic Exposing module providing the RDF graph to a user; To express as a Semantic resource, create a command for the rule of the RDF graph model for the IoT service element defined in the IoT standard oneM2M, and perform a condition check on the Input DataPoint of the generated rule to take responsibility for rule execution decision Making & Matching module; And a oneM2M Translation module that converts the RDF graph into a oneM2M standard so that an aggregator in charge of device control can perform operations.

delete

The process of registering / deleting and updating information on the device and service of the IoT terminal as Semantic data through each module in the semantic IoT gateway, and the process of creating / deleting user-based rules and performing rules This is done.

The semantic IoT gateway is configured as RDF Triple by requesting information on the IoT terminal registered on the platform based on oneM2M standard to the aggregator,

Thereafter, for the newly registered IoT terminal, the aggregator is delivered to the semantin IoT gateway through Resource Monitoring to configure RDF Triple in the Semantic Monitoring & Modeling module in real time, and the RDF Triple is stored in the Semantic Database, and the It is delivered to the web client of the user terminal from the Semantic Exposing module, and receives information about the service of the IoT terminal and the terminal through RDF Triple received by the web client of the user terminal,

Through the rule customizing module of the web client, a rule between IoT terminals to be performed in the semantic IoT gateway is generated, and when the semantic IoT gateway receives a request to create a rule, the rule making module generates a rule to provide a rule list ,

When the service status value of the IoT terminal changes, find the rule through the Semantic Query (Code 1) in the Rule Matching module for the information reported through the aggregator, check the condition for the changed status value, and perform the rule At the same time, it updates RDF Triple and delivers it to the web client.

Registered on the IoT platform system using a unique Resource URI in the oneM2M standard and accessible through the IoT standard communication protocol of HTTP, MQTT, and CoAP, and the Resource URI means the URI of a resource based on the oneM2M standard, and RDF (Resource Description Framework) The device of the graph model means an IoT terminal, and the service provides a service function supported by the IoT terminal, and when the device is a sensor or a light bulb / LED light, the service is a sensor light bulb / LED light It provides functions for on / off, color change, and brightness change, and uses RDF graph model for IoT common service elements defined in IoT standard oneM2M to express them as Semantic resources, and common services defined in IoT standard By modeling the function as an RDF graph, it is intended to be applied to IoT terminals and machines by using Semantic vocabulary for services provided by IoT terminals and terminals. Granted, and by running the rule (rule) defined in the IoT platform to provide services.

The process of creating / deleting and updating the RDF graph

When the resource retrieving is transmitted from the semantic IoT gateway to the aggregator, a provide resource is transmitted from the aggregator to the semantic IoT gateway, and the semantic IoT gateway generates an RDF graph, an RDF graph generation process;

After generating the RDF graph, Device (Sensor) connected / disconnected is transmitted from the IoT terminal equipped with a specific device and sensor to the Aggregator, and Event reporting for Device (Sensor) connected / disconnected from the Aggregator to the Semantic IoT Gateway. Transmitting, the semantic IoT gateway executes RDF graph creation / deletion, and transmits RDF graph esposing from the semantic IoT gateway to the web client of the user terminal to delete the RDF graph; And

When a state (value) update is transmitted from the IoT terminal to the aggregator, event reporting for state (value) update is transmitted from the aggregator to the semantic IoT gateway, and the semantic IoT gateway updates the RDF garph, and the semantic IoT And an RDF graph update process of transmitting RDF graph exposing from the gateway to the web client of the user terminal.

In the process of creating / deleting user-based rules:

Upon receiving a Request Rule creation / deletion from the web client of the user terminal to the semantic IoT gateway, the semantic IoT gateway performs rule creation / deletion and transmits RDF graph exposing from the semantic IoT gateway to the web client of the user terminal. And

In the process of performing a rule: When a state (value) update is received from the IoT terminal equipped with a sensor and a device as an aggregator, event reporting is transmitted from the aggregator to the semantic IoT gateway, and the semantic IoT gateway is RDF graph updating & Rule Matching is performed, and a request message is transmitted from the semantic IoT gateway to the aggregator, and the aggregator transmits an actuator control to the IoT terminal.

The system equipped with a Semantic engine based on RDF graph for autonomous interaction in real time between IoT terminals of the present invention is used by using the Semantic engine in IoT terminals and industrial systems and IoT smart home systems using numerous sensors and devices. Save time and money on building and maintaining environments for heterogeneous platforms using different data formats.

In addition, by giving meaning to data through explicit Semantic vocabulary to be used for IoT terminals and machines, users can set up interaction rules between multiple terminals to set up autonomous systems, and the Semantic IoT Gateway and the Aggregator Through this, it is possible to transmit a device control command to the IoT terminal and output the response.

The existing Semantic IoT system performs mapping on all resources using ontology in which the relationship between resources is explicitly defined, but the overhead is large.

The Semantic engine of the present invention reduces overhead by selectively performing resource mapping through Semantic Query of code without explicitly defining the relationship between Device and Service.

1 is a diagram showing an RDF graph model for IoT common service elements defined in oneM2M, an IoT standard, to represent Semantic resources.
2 is a view showing an IoT service framework using a Semantic engine-based gateway.
3 is a view showing the RDF graph creation / deletion and update.
4 is a diagram illustrating user-based rule creation / deletion and rule execution.
5 is a graph showing the results of Semantic function execution time experiments with the existing ontology method.

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention will be described in detail the configuration and operation of the invention.

The Semantic engine and method based on RDF graph for autonomous interaction in real time between IoT terminals of the present invention are registered on the IoT platform system using a unique Resource URI in oneM2M standard, HTTP, Message Queuing Telemetry Transport (MQTT), It can be accessed through IoT standard communication protocols such as CoAP (Constrained Application Protocol), Resource URI means the URI of oneM2M standard-based resource, and Device in the RDF (Resource Description Framework) graph model means IoT terminal, Service Provides the service function supported by the IoT terminal, and if the device is a sensor or a light bulb / LED light, the Service provides the function for on / off, color change, and brightness change of the light bulb / LED light of the sensor, which is a Semantic resource. RDF graph model for IoT common service elements defined in IoT standard oneM2M is used to express as, and common defined in IoT standard By modeling the service function as an RDF graph, the semantics is applied to the IoT terminal and the service of the terminal using semantic vocabulary to give the semantics to be applied to the IoT terminal and the machine, and the rules defined in the IoT platform It provides a Semantic engine and method based on Resource Description Framework (RDF) graph for autonomous interaction between IoT terminals that provide services by executing.

A Semantic resource that is given meaning to be used for IoT terminals and machines through RDF Triple, which uses all the data generated in the IoT system, using RDF defined in W3C, and the Semantic query language SPARQL (SPARQL Protocol and RDF Query Language) defined in W3C. Expressed as, it provides autonomous interaction of the IoT service platform, and provides a service with faster execution time than the IoT platform in which the existing Semantic was introduced.

For reference, the Internet of Things application protocol uses HTTP over IPv4 & IPv6 over TCP / IP networks to provide HTTP / Request requests from web servers and web clients on the Internet; It is used as an application protocol on 6LoWPAN using IPv6 for communication of IoT devices with limited computing power, such as IoT devices on the Internet for the Internet of Things.Constrained Application Protocol (CoAP) standardized in the IETF Constrained RESTful Environment (CoRE) working group. ; In the Facebook messenger, MQTT (Message Queuing Telemetry Transport), which is frequently used for PUSH messaging service, is used.

The present invention provides a semantic engine and method based on RDF (Resource Description Framework) graph for autonomous interaction between IoT terminals. Configures RDF Triple using RDF defined by W3C (World Wide Web Consortium) for all data generated from IoT systems, and enables IoT terminals and machines to be used through the Semantic query language SPARQL (SPARQL Protocol and RDF Query Language) defined by W3C. It is expressed as a Semantic resource with meaning, and provides an autonomous interaction of the IoT service platform using the RDF graph model for IoT common service elements defined in the IoT standard oneM2M to express as a Semantic resource. It provides a service with faster execution time than the introduced IoT platform.

The Semantic engine expresses information about the IoT terminal and the service provided by the terminal as RDF Triple based on the RDF graph model of FIG. 1. RDF Triple means a resource structure composed of three types: Subject, Predicate, and Object. RDF Triple is used to represent the relationship between two resources in a machine-readable language model.

1 is a diagram showing an RDF graph model for IoT common service elements defined in oneM2M, an IoT standard, to represent Semantic resources.

Device of RDF graph model means IoT terminal, and Service means service function provided by IoT terminal. When the device is a sensor or a light bulb / LED light (eg, Philips Hue light bulb), the service can have functions for on / off of the sensor, on / off of the light bulb / LED light, color change, and brightness change. For example, the sensor may use a temperature sensor, a humidity sensor, an illuminance sensor, a health care sensor, a bio sensor, and the like.

In the oneM2M standard, resources are registered on the IoT platform system in a unique URI form and can be accessed through IoT standard communication protocols such as HTTP, MQTT, and CoAP. Resource URI means the resource URI based on oneM2M standard.

Command means a user-defined rule. Input DataPoint means the service for the condition that the rule is executed, and Output DataPoint means the service to be executed when the condition is satisfied.

Command Value means the command value for each command service. For example, if there is a command of 'Turn on the switch of SmartThings when the power of the bulb / LED lamp is on,' the power of the bulb / LED lamp becomes the Input DataPoint, and the SmartThings switch becomes the Output DataPoint. Light bulb and switch on are Command Value for each DataPoint.

Device is a subject that manages information about the IoT terminal, and a Service List for services provided by the IoT terminal through predicates; Type for the type of IoT terminal; It has an object for Resource URI, which means the location of the terminal in the system.

Service is the subject that manages the services supported by the IoT terminal and has the value that means the current status value, the type for the type of service, and the object language of the resource URI for accessing the service in the IoT platform system.

Although the existing Semantic IoT system uses mapping ontology where the relationship between resources is explicitly defined, mapping is performed for all resources, but overhead is large.

In particular, the Semantic engine of the present invention reduces overhead by selectively performing resource mapping through Semantic Query of Code 1 without explicitly defining the relationship between Device and Service.

Device_Namespace is the subject of the RDF graph where the IoT terminal is registered. It also has the command subject to perform autonomous interactions. It has the object of Input DataPoint, which means the condition that the rule is executed, and Output DataPoint, which means the service to be executed when the condition is satisfied. The two object words have the object value of Command Value, which means the condition value of the service to perform or control the rule. After connecting the device and the serviuce, the Input / Ouput Datapoint is mapped to the Resource URI registered in the service system through Semantic Qeury in the code 1 above.

2 is a view showing an IoT service framework using a Semantic engine-based gateway.

A system equipped with an RDF graph-based Semantic engine for autonomous interaction in real time between IoT terminals of the present invention includes: an IoT terminal having various sensors, light bulbs / LED lights, and devices; Aggregator having a web server and used as an IoT service platform based on oneM2M standard; A semantic IoT gateway communicated with the aggregator and used as a gateway between the IoT terminal and a server operating based on a semantic engine; And a user terminal connected to the semantic IoT gateway and having a web client.

The Aggregator is a oneM2M standard based IoT service platform, a web server connecting a wired or wireless Internet; oneM2M DataBase module for storing oneM2M standard resources; A resource monitoring module that monitors the creation, deletion, and change of resources in the aggregator and informs the user terminal; And an interworking interface module that manages integrated APIs of different IoT platforms, analyzes the request message from the aggregator, and then calls the API of the corresponding platform to directly transmit a control command for the device of the IoT terminal.
The web client of the user terminal provides a user with information about IoT terminals and services registered in the IoT service platform through the web, and visually shows an RDF graph provided by Semantic Exposing and shows it; A rule customizing module that dynamically configures rules for autonomous interaction by requesting to the Semantic IoT Gateway for creation and deletion of rules that meet user needs; And a device control module that transmits a device control command to the IoT terminal through the Semantic IoT Gateway and the aggregator and outputs a response.

Aggregator means an IoT service platform based on oneM2M standard, and has a web server that connects the device of the IoT terminal (located on the left) to the Internet through wired or wireless communication.

The oneM2M DataBase is a module that stores oneM2M standard resources, and the Resource Monitoring module is a module that monitors resource creation, deletion, and change in the aggregator and informs the user.

The Interworking Interface module manages the integrated API of different IoT platforms, and analyzes the request message from the aggregator and then calls the API of the platform to transmit control commands for the IoT device directly.

Semantic IoT Gateway means a gateway between a user and a server operating based on the Semantic Engine.

The Semantic IoT Gateway comprises: a Semantic Monitoring & Modeling module that configures oneM2M resources registered in the Aggregator into RDF triples based on a graph model; Semantic Database (Semantic Database) for storing the generated RDF graph; A Semantic Exposing module providing the RDF graph to a user; To express as a Semantic resource, a command is generated for the rule of the RDF graph model (FIG. 1) for the IoT service element defined in the IoT standard oneM2M, and the rule is determined by performing condition check on the Input DataPoint of the generated rule Rule Making & Matching module in charge; And a oneM2M Translation module that converts the RDF graph into a oneM2M standard so that an aggregator in charge of device control can perform operations.

For example, for the command, a light bulb / LED light ON / OFF may be used.

The Semantic Monitoring & Modeling module configures the oneM2M resource registered in the Aggregator into an RDF triple based on the graph model in FIG. 1.

The Semantic Database is a module that stores generated RDF graphs, and the Semantic Exposing module is a module that provides RDF graphs to users.

The Rule Making & Matching module is a module that creates a command for the rule in FIG. 1 and performs a condition check on the Input DataPoint of the generated rule to determine rule execution. OneM2M Translation converts RDF graphs to oneM2M standard so that it can perform operations in the aggregator that is actually in charge of device control.

The web client of the user terminal provides information about the IoT terminal and service registered to the IoT service platform to the user through the web.

Resource Viewer to visualize and display RDF graph provided by Semantic Exposing module; A rule customizing module that dynamically configures rules for autonomous interaction by requesting to the Semantic IoT Gateway for creation and deletion of rules that meet user needs; And a device control module that transmits a device control command to the IoT terminal through the Semantic IoT Gateway and the aggregator and outputs a response.

FIG. 3 is a diagram showing RDF graph creation / deletion and update, and FIG. 4 is a diagram showing user-based rule creation / deletion and rule execution.

It shows the process of registering / deleting and updating information on the device and service of the IoT terminal through Semantic IoT gateway through each module as Semantic data, and creating / deleting user-based rules and executing rules.

Semantic IoT gateway is configured as RDF Triple by requesting information on the IoT terminal registered on the platform based on oneM2M standard to the aggregator.

Thereafter, for the newly registered IoT terminal, the Aggregator configures RDF Triple in the Semantic Monitoring & Modeling module in real time by passing it to the Semantin IoT gateway through Resource Monitoring. The RDF Triple is stored in the Semantic Database and delivered from the Semantic Exposing module to the web client. RDF Triple received by the web client of the user terminal receives information about the service of the IoT terminal and the terminal, and generates rules between the IoT terminals to be executed in the semantic IoT gateway through the rule customizing module of the web client. When the Semantic IoT gateway receives a request to create a rule, the rule making module creates a rule and provides a rule list.

When the service status value of the IoT terminal changes, the rule matching module finds the rule through the Semantic Query of Code 1 for the information reported through the aggregator, checks the condition for the changed status value, and determines whether to execute the rule . At the same time, RDF Triple is updated and delivered to the web client.

Registered on the IoT platform system using a unique Resource URI in the oneM2M standard and accessible through the IoT standard communication protocol of HTTP, MQTT, and CoAP, and the Resource URI means the URI of a resource based on the oneM2M standard, and RDF (Resource Description Framework) The device of the graph model means an IoT terminal, and the service provides a service function supported by the IoT terminal, and when the device is a sensor or a light bulb / LED light, the service is a sensor light bulb / LED light It provides functions for on / off, color change, and brightness change, and uses RDF graph model for IoT common service elements defined in IoT standard oneM2M to express them as Semantic resources, and common services defined in IoT standard By modeling the function as an RDF graph, it is intended to be applied to IoT terminals and machines by using Semantic vocabulary for services provided by IoT terminals and terminals. Granted, and by running the rule (rule) defined in the IoT platform to provide services.

The process of creating / deleting and updating the RDF graph

When the resource retrieving is transmitted from the semantic IoT gateway to the aggregator, a provide resource is transmitted from the aggregator to the semantic IoT gateway, and the semantic IoT gateway generates an RDF graph, an RDF graph generation process;

After generating the RDF graph, Device (Sensor) connected / disconnected is transmitted from the IoT terminal equipped with a specific device and sensor to the Aggregator, and Event reporting for Device (Sensor) connected / disconnected from the Aggregator to the Semantic IoT Gateway. Transmitting, the semantic IoT gateway executes RDF graph creation / deletion, and transmits RDF graph esposing from the semantic IoT gateway to the web client of the user terminal to delete the RDF graph; And

When a state (value) update is transmitted from the IoT terminal to the aggregator, event reporting for state (value) update is transmitted from the aggregator to the semantic IoT gateway, and the semantic IoT gateway updates the RDF garph, and the semantic IoT And transmitting an RDF graph exposing from the gateway to the web client of the user terminal.

4 is a time measurement result of updating the RDF Triple and the ontology of Semantic data 200 times in an environment in which there are existing ontologies and 50 to 1000 virtual terminals in order to evaluate the performance of the RDF graph method of the Semantic engine. Shows.

User-based rule creation / deletion process: When a request rule creation / deletion is received from the web client of the user terminal to the semantic IoT gateway, the semantic IoT gateway performs rule creation / deletion, and the user from the semantic IoT gateway Send RDF graph exposing to the terminal's web client.

Rule execution process: When a state (value) update is received from the IoT terminal equipped with the sensor and the device as an aggregator, event reporting is transmitted from the aggregator to the semantic IoT gateway, and the semantic IoT gateway performs RDF graph updating & rule matching, A request message is transmitted from the semantic IoT gateway to the aggregator, and the aggregator transmits an actuator control to the IoT terminal.

Since this Semantic IoT gateway does not perform resource mapping, performance as much as the overhead incurred in the resource mapping process is improved. In the IoT environment, time to process a message is important because the data generation cycle is short and the data size is small. This comparative experiment shows that the performance of the Semantic engine is excellent.

5 is a graph showing the results of Semantic function execution time experiments with the existing ontology method.

Compared to the existing ontology method, the execution time of the Semantic engine proposed in the present invention is further reduced.

Accordingly, the RDF graph-based Semantic engine and method for autonomous interaction in real time between IoT devices of the present invention uses Semantic engine in industrial systems and IoT smart home systems using numerous sensors and devices. By doing so, it is possible to save time and money in the environment construction and maintenance of heterogeneous platforms using different data formats.

In addition, by giving meaning to data through explicit vocabulary that can be understood by IoT devices and machines, users can set autonomous systems by setting interaction rules between terminals.

As described above, the method of the present invention is implemented as a program and recorded in a form that can be read using software of a computer (CD-ROM, RAM, ROM, memory card, hard disk, magneto-optical disk, storage device, etc.) ).

The present invention has been described with reference to preferred embodiments, but various modifications or variations of the present invention can be made without departing from the spirit and scope of the present invention as described in the following claims by those of ordinary skill in the art. It will be understood that it can be carried out.

Claims (9)

IoT terminal having various sensors, lights, and devices;
Aggregator having a web server and used as an IoT service platform based on oneM2M standard;
A semantic IoT gateway communicated with the aggregator and used as a gateway between the IoT terminal and a server operating based on a semantic engine; And
It is connected to the semantic IoT gateway, and includes a user terminal having a web client,
The aggregator is an IoT service platform based on oneM2M standard, a web server connecting a wired or wireless Internet; oneM2M DataBase module for storing oneM2M standard resources; A resource monitoring module that monitors the creation, deletion, and change of resources in the aggregator and informs the user terminal; And an interworking interface module that manages integrated APIs of different IoT platforms, analyzes the request message from the aggregator, and then calls the API of the corresponding platform to directly transmit control commands for IoT devices,
The web client of the user terminal provides a user with information on IoT terminals and services registered in the IoT service platform through the web, and visually shows an RDF graph provided by Semantic Exposing and shows it; A rule customizing module that dynamically configures rules for autonomous interaction by requesting to the Semantic IoT Gateway for creation and deletion of rules that meet user needs; And a Device Control module that transmits a device control command to the IoT terminal through the Semantic IoT Gateway and the Aggregator and outputs the response, an RDF graph-based Semantic engine for autonomous interaction between IoT terminals in real time. Equipped system. delete According to claim 1,
The semantic IoT gateway
Semantic Monitoring & Modeling module that configures the oneM2M resource registered in the aggregator into an RDF triple based on a graph model;
Semantic Database (Semantic Database) for storing the generated RDF graph;
A Semantic Exposing module providing the RDF graph to a user;
To express as a Semantic resource, create a command for the rule of the RDF graph model for the IoT service element defined in the IoT standard oneM2M, and perform a condition check on the Input DataPoint of the generated rule to take responsibility for rule execution decision Making & Matching module; And
A oneM2M Translation module that converts the RDF graph into a oneM2M standard so that an aggregator in charge of device control can perform operations;
A system equipped with an RDF graph-based Semantic engine for autonomous interaction in real time between IoT terminals including a. delete According to claim 3,
The process of registering / deleting and updating information on the device and service of the IoT terminal as Semantic data through each module in the semantic IoT gateway, and the process of creating / deleting user-based rules and performing rules This is made, a system equipped with an RDF graph-based Semantic engine for autonomous interaction in real time between IoT terminals. According to claim 3,
The semantic IoT gateway is configured as RDF Triple by requesting information on the IoT terminal registered on the platform based on oneM2M standard to the aggregator,
Thereafter, for the newly registered IoT terminal, the aggregator is delivered to the semantin IoT gateway through Resource Monitoring to configure RDF Triple in the Semantic Monitoring & Modeling module in real time, and the RDF Triple is stored in the Semantic Database, and the It is delivered to the web client of the user terminal from the Semantic Exposing module, and receives information about the service of the IoT terminal and the terminal through RDF Triple received by the web client of the user terminal,
Through the rule customizing module of the web client, a rule between IoT terminals to be performed in the semantic IoT gateway is generated, and when the semantic IoT gateway receives a request to create a rule, the rule making module generates a rule to provide a rule list ,
When the service status value of the IoT terminal changes, find the rule through the Semantic Query (Code 1) in the Rule Matching module for the information reported through the aggregator, check the condition for the changed status value, and perform the rule A system equipped with an RDF graph-based Semantic engine for autonomous interaction in real time between IoT terminals, which determines and simultaneously updates the RDF Triple and delivers it to the web client. According to claim 1,
Registered on the IoT platform system using a unique Resource URI in the oneM2M standard and accessible through the IoT standard communication protocol of HTTP, MQTT, and CoAP, and the Resource URI means the URI of a resource based on the oneM2M standard, and RDF (Resource Description Framework) The device of the graph model means an IoT terminal, and the service provides a service function supported by the IoT terminal, and when the device is a sensor or a light bulb / LED light, the service is a sensor light bulb / LED light It provides functions for on / off, color change, and brightness change, and uses RDF graph model for IoT common service elements defined in IoT standard oneM2M to express them as Semantic resources, and common services defined in IoT standard By modeling the function as an RDF graph, it is intended to be applied to IoT terminals and machines by using Semantic vocabulary for services provided by IoT terminals and terminals. The grant and, IoT execute the rule (rule) defined in the platform, providing services, end-to-end real-time autonomous IoT cross a system comprising a RDF graph-based Semantic Engine for action. According to claim 1,
The process of creating / deleting and updating the RDF graph
When the resource retrieving is transmitted from the semantic IoT gateway to the aggregator, a provide resource is transmitted from the aggregator to the semantic IoT gateway, and the semantic IoT gateway generates an RDF graph, an RDF graph generation process;
After generating the RDF graph, Device (Sensor) connected / disconnected is transmitted from the IoT terminal equipped with a specific device and sensor to the Aggregator, and Event reporting for Device (Sensor) connected / disconnected from the Aggregator to the Semantic IoT Gateway. Transmitting, the semantic IoT gateway executes RDF graph creation / deletion, and transmits RDF graph esposing from the semantic IoT gateway to the web client of the user terminal to delete the RDF graph; And
When a state (value) update is transmitted from the IoT terminal to the aggregator, event reporting for state (value) update is transmitted from the aggregator to the semantic IoT gateway, and the semantic IoT gateway updates the RDF garph, and the semantic IoT An RDF graph update process of transmitting RDF graph exposing from a gateway to a web client of the user terminal;
A system equipped with an RDF graph-based Semantic engine for autonomous interaction in real time between IoT terminals including a. According to claim 1,
In the process of creating / deleting user-based rules:
Upon receiving a Request Rule creation / deletion from the web client of the user terminal to the semantic IoT gateway, the semantic IoT gateway performs rule creation / deletion and transmits RDF graph exposing from the semantic IoT gateway to the web client of the user terminal. And
In the process of performing a rule: When a state (value) update is received from the IoT terminal equipped with a sensor and a device as an aggregator, event reporting is transmitted from the aggregator to the semantic IoT gateway, and the semantic IoT gateway is RDF graph updating & Rule Matching is performed, and a request message is transmitted from the semantic IoT gateway to the aggregator, and the aggregator transmits an actuator control to the IoT terminal, which uses an RDF graph-based Semantic engine for autonomous interaction between IoT terminals in real time. Equipped system.

Images