KR101847271B1 - Smart IT Convergence Framework System Applying a Lego-typed Sensor Module - Google Patents

Abstract

The present invention relates to a legato sensor module for implementing a communication between a server, an Arduino sensor, and a mobile device to set a prototype of a framework, thereby applying the Lego sensor module to various contents production in an IoT environment Smart IT Convergence Framework System.
The smart IT convergence framework system utilizing the Lego sensor module according to the present invention is a smart IT convergence framework system that implements real-time communication between devices in the IoT environment, and has a wireless communication function, and an Android-based app is installed A driven mobile device 100; An ADC 310 having a microcontroller connected to the sensor module 320 through a sensor interface to control the operation of the sensor module 320; And transmits and receives data by establishing wireless communication with the mobile device 100 and the adonaboard 310. The mobile device 100 transmits and receives data to and from the mobile device 100, And a local server 200 for controlling the operation of the module 320, so that it can be efficiently applied to various contents production in the IoT environment.

Description

{Smart IT Convergence Framework System Applying a Lego-typed Sensor Module}

The present invention relates to a smart IT convergence framework system, and more particularly to a smart IT convergence framework system, in which communication between a server, an Arduino sensor, and a mobile device is implemented to set a prototype of a framework, And a smart IT convergence framework system using a Lego sensor module that can be applied to various contents production.

As the use of the Internet increases, IoT, which is actively interacting with devices triggered, is spreading throughout the industry. This Internet of Things (IoT) was created by Kevin Ashton of MIT Auto-ID Sensor in 1999, and vision of connecting things to the Internet through RFID technology is presented. IoT technology is similar but defined differently depending on the organization dealing with the technology and its purpose. The common point is that all objects have global scale connectivity and provide intelligent services based on them.

Although there are various categories of domestic and overseas IOT industry, some of them are accepted as an extension of ubiquitous or machine to machine (M2M). Key domestic industry examples include SKT's smart farm service, KT's smart home service, and LG U +'s IoT @ Home. SKT's smart farm is a service that manages farming through smart phones by installing various sensor and W-CDMA-based terminals in a farmhouse's greenhouse. In the case of KT and LG U + business models, it is a service that allows home terminals such as outlets, electric lamps, and gas valves to be controlled from the outside by a smart phone to enable a more comfortable life. However, in the case of the IoT industry, which is being serviced in the domestic market, I feel that it is an extension of the USN or M2M that was in the past and is far from the IoT for global service.

Major industries outside Korea include EVRYTHING's WoT, Paraimpu, and IBM's Smarter Planet. EVRYTHING is a leader in the WoT (Web of Things) technology. Based on ADI (Active Digital Identities ™), it enables identification and access to various objects including RFID, NFC and existing web resources. Services. In addition, Paraimpu has created a new paradigm called Social Web of Things that enables SNS and IoT to be linked and shared. IBM's Smarter Planet is a typical example of global IoT, and is being developed with the goal of applying IoT technology to infrastructure such as urban planning, traffic management, and railway systems. Unlike in Korea, research on the systemization of social infrastructures more freely and controllable is going on overseas.

In this way, as the Internet of Things (IOT) spreads throughout the industry, it is necessary to transmit data to the web server and application in real time through the network in order to interact with the user and the IoT devices. As a work.

Korean Registered Patent No. 10-1613372 (Registered on April 11, 2016)

The present invention has been proposed in order to provide an IT convergence framework according to the spread of the IoT industry. It is an object of the present invention to provide a prototype that can be used for content production using a user's mobile device and various Arduino sensors based on the IoT environment To provide a smart IT convergence framework system.

In order to achieve the above object, the smart IT convergence framework system according to the present invention is a smart IT convergence framework system that implements real-time communication between devices in an IoT environment, and has a wireless communication function. A mobile device; And a microcontroller connected to the sensor module through a sensor interface to control the operation of the sensor module; And a local server for establishing wireless communication with the mobile device and the adunone board to transmit and receive data and to control the operation of a sensor module connected to the adonaboard according to a control signal of an app installed in the mobile device, .

A WiFi module for performing WiFi communication is provided in the mobile device and the Arduino board. A router is provided in the local server, and a plurality of mobile devices and an Arduino board are connected to one local server to perform communication.

The local server receives the initialization code from the mobile device and the sensor module connected to the ADC, and transmits the initialization completion code as a packet to the sensor module connected to the mobile device and the ADC, It receives data from the sensor module connected to the device and the daughter board, processes the data, and relays the communication between the mobile device and the daughter board.

On the other hand, when the local server transmits / receives data to / from the sensor module connected to the add-on board, when a delay of more than a predetermined time threshold value occurs, it is determined that a problem has occurred in the corresponding adapter module.

In addition, the local server identifies and assigns sensor numbers according to the types of sensor modules connected to the add-on board 310, and when a new sensor module is added to the add-on board, a new sensor The sensor number is extended by giving a number.

The local server combines an LED, a pressure sensor, and a lock sensor among the sensor modules connected to the add-on board to give one sensor number, gives a different sensor number to the lock sensor, and combines a plurality of RFID sensors Another sensor number is assigned, and another sensor number is assigned by combining the pressure sensor and the RFID sensor.

In order to control the operation of the sensor module connected to the add-on board, the local server transmits a control command including a device name, an instruction word, and a parameter value to be controlled to the ADC.

Meanwhile, the local server is connected to a web server through a communication network, and transmits data generated according to communication with the mobile device and the adouno board. The web server stores data transmitted from a local server, It is preferable to display it through the display unit and provide it to the user.

According to the present invention, by implementing a prototype of a framework capable of performing communication between a server, an Arduino sensor, and a mobile device in an IoT environment, it is possible to efficiently apply various contents in an IoT environment through the prototype . Especially, by using prototype of implemented framework, it is possible to confirm the possibility of smart IT convergence framework by implementing smart toy game through combination of Lego type sensor module. Through this, various sensor modules It can be effectively applied to the production of utilized contents.

1 is a general conceptual diagram of a smart IT convergence framework system according to the present invention,
2 is a data flow diagram of a smart IT convergence framework system according to the present invention,
3 is a network diagram of a smart IT convergence framework system according to the present invention,
4 is a flowchart illustrating a communication setup procedure of a local server, a mobile device, and an Arduino according to the present invention.
5 to 8 illustrate an example of the design of the Arduino sensor module according to the present invention,
9 is an example of a smart toy implemented through a smart IT convergence framework system according to the present invention,
10 is a circuit diagram of a smart toy implemented according to the present invention;
FIG. 11 shows a control application screen of a smart toy driven by a mobile device according to the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a general conceptual diagram of a smart IT convergence framework system according to an embodiment of the present invention.

As shown in FIG. 1, the smart IT convergence framework system according to the present invention includes a mobile device 100 and an Aduno 300, a local server 200, and a web server 400.

The mobile device 100 is a smart device such as a smart phone equipped with an Android operating system and communicates with the local server 200 via WiFi communication to control the operation of the Arduino 300 connected to the local server 200 And monitors the operation status of the arduino 300.

The Arduino 300 is an open source H / W platform compatible with the mobile device 100 based on the Android operating system and is a device control board incorporating a micro controller for an open source. The Arduino 300 can connect sensor modules such as various sensors and components to the Arduino board. The Arduino 300 connects with the computer and loads software to operate. Therefore, And the like.

The local server 200 is a PC based on a Windows operating system and the local server 200 communicates with the mobile device 100 and the Adouino 300 to receive a message from the mobile device 100, And controls the operation of the Arduino 300 by receiving the control signal and processing it. In addition, the local server 200 transmits the result of the adunion control to the web server 400. The web server 400 stores the adonyne control process and the result transmitted from the local server 200, So that the user can confirm it. In the embodiment of the present invention, the local server 200 interacts with the web server 400 through Mysql based on the C ++ language, which aims to provide the user with a display through a web page. All the sensors of the mobile device 100 and the Adouino 300 communicate with each other through the local server 200. The local server 200 controls the setting of the mobile device 100 and the Arduino 300 Completion confirmation, data exchange, data processing, and data and processing result backup.

2 is a data flow diagram of a smart IT convergence framework system according to an embodiment of the present invention.

2, the mobile device (Andrioid Mobile) 100, the Arduino sensor 300, and the local server 200 may perform initialization, data exchange, and error handling .

- Initialization step : At the initial initialization stage, when the mobile device 100 and the Adouino 300 start to operate, they accept the IP address of the corresponding device (mobile device and arduino sensor) The local server 200 transmits a set-up message to the local server 200, and the local server 200 receives the code and sets the state of each device to the initialization step. If it is determined that all the devices are set to the initialization step, the local server 200 transmits the initialization completion code as a packet to all the connected devices.

- Data exchange step: The device (mobile device and adunion sensor) receiving the initialization completion code transmits the input value to the local server 200, assuming that the data is ready to be exchanged. This includes various parameter values, including On / Off values. The local server 200 stores the received data value in the web server 400. [ In addition, the received data may be analyzed to provide appropriate data processing to the mobile device 100 or the Adouino 300. The user can communicate with the mobile device 100 via the local server 200 and all the data generated therebetween is automatically stored in the web server 400, 400), it is possible to more easily grasp and manage the flow of data.

- Error Handling Step: Since each sensor of the Arduino 300 is very vulnerable to changes in the external environment, it is necessary to handle errors according to the circumstances in which an interrupt occurs. In the present invention, the local server 200 updates the threshold value of the Socket object to an arbitrary initial value when exchanging data with the Adono 300. The value will decrease over time until the next data exchange occurs. Therefore, in the present invention, the threshold value is set, and when a time delay exceeding the set threshold value occurs, the local server 200 determines that a problem has occurred in the corresponding adunino 300 and informs the user of the information of the adunino 300 Reboot is recommended. The user can set whether or not to process data for all sensors operating in conjunction with the device. The local server 200 sends the initialization completion code to the corresponding adapter 300, and all the devices are normally operated.

The local server 200 exchanges data with the mobile device 100 and the Adouino 300 through the above process. In the embodiment of the present invention, the data linkage between the mobile device 100 and the Adouino 300 The data structure of the local server 200 is designed as shown in Table 1 below.

As shown in Table 1, the data packet is basically designed to have a length of 9 bytes. The data packet is divided into 3 bytes each consisting of a command type, a value 1 for a command type, and a value 2 for a command type.

In addition, the Lego type sensor module applied to the present invention is identified by assigning sensor numbers to four types as shown in Table 2 below.

That is, in the present invention, the identifier of the mobile device 100 is based on the socket generated at the time of Accept, while the sensor module composed of the Arduino 300 is numbered by the rule as shown in Table 2 Respectively. After assigning a number to each sensor according to the above method, it is used for communication with the local server 200 by the packet design method as shown in Table 3 below.

Each sensor of the Arduino 300 exchanges data with the local server 200. In the present invention, the sensor module designed for the platform is designed with the following criteria.

First, each sensor module integrates each sensor group locally based on the Arduino Due chipset (board) because the communication unit of each sensor is designed based on Wifi wireless communication and is managed by Arduino chipset . Second, the control items for each sensor module are managed in the form of commands, and each sensor module can not arbitrarily control each sensor before sending a completion message. This is because all modules must be controlled by the central server and run in sync with each other.

All of the Arduino sensor modules configured on the platform according to these criteria are controlled by the local server 200. Therefore, in order to efficiently control each sensor module, all control commands are composed of three parts of device name, command, and parameter value. In addition, by defining a specific specification, it is convenient and easy to add even if other devices are added later.

Hereinafter, a concrete embodiment of the smart IT convergence framework system having the above structure will be described.

3 is a network diagram of a smart IT convergence framework system according to an embodiment of the present invention.

 3, the local server 200 communicates with the mobile device 100, the aduno 300, and the web server 400. The local server 200 includes a router 210, A plurality of N mobile devices 100 and an Arduino 300 are connected and a plurality of N local servers 200 may be connected to one web server 400. [

The mobile device 100 includes an ordinary camera 110 and a WiFi module 120 as an Android-based smart device. The mobile device 100 is connected to the local server 200 through WiFi communication, Data is transmitted and received through a packet.

The local server 200 manages the data flow of the mobile device 100 and the Adouino 300 and analyzes and processes the data of the mobile device 100 and the Adouino 300 to provide feedback .

The Arduino 300 is connected to a plurality of sensor modules 320 through a sensor interface to an Arduino board 310 on which a micro controller and a WiFi module 311 are mounted. The ADC 310 reads the data of the various digital or analog sensor modules 320 connected to the local server 200 and transmits the data to the local server 200 via the WiFi module 311, And controls the sensor module 320 accordingly. A variety of sensors, such as a pressure sensor 321, a lock sensor 322, an RFID sensor 323, an LED 324, a relay 325, and a solenoid 326 are connected to the sensor module 320 connected to the aruba- Sensors may be included.

The web server 400 is connected to the local server 200 through a network such as the Internet network and receives and stores data transmitted from the local server 200 and the mobile device 100 and the Aduno 300, And displays it so that the user can check it on the web.

4 is a flowchart illustrating a communication setup process of a local server, a mobile device, and an Arduino according to an exemplary embodiment of the present invention.

4, the arpeggio sensor module 320, the mobile device 100, and the local server 200 are driven to perform an initialization process. In the initialization process, the arpeggio sensor module 320 and the mobile device 100, and the local server 200, and starts the actual operation (S100, S200, S300).

The local server 200 sends an operation permission signal to the mobile device 100 to initialize the entire sensor module 320 connected to the mobile device 100, And the ink-in sensor module 320 (S210).

The Adouino 300 and the mobile device 100 receive data through user input in steps S120 and S220 and transmit and receive data to and from the local server 200 through the predefined packets in steps S130, ). The mobile device 100 and the local server 200 communicate with each other in real time through asynchronous processing when transmitting and receiving data.

5 shows an example of the design of the Arduino sensor module according to the present invention.

The Arduino sensor module 320 shown in FIG. 5 has FSR (Pressure Sensor), ESP8266 (WiFi Module), Relay module, LED and Solenoid, DC 12V connected to the Arduino board 310, Pressure sensor (FSR), WiFi module (ESP8266), LED, Solenoid. This module is used to supply power to the LED and solenoid using the relay module when the pressure value is received. This sensor module is designed to drop objects by pressure and focus attention. Communication uses WiFi communication using ESP 8266 chipset model. The command uses the protocol included in Table 3.

6 shows another example of the design of the Arduino sensor module according to the present invention.

The Arduino sensor module 320 shown in FIG. 6 is connected to the Arduino board 310 with two ESP8266 (WiFi modules), a Relay module and a solenoid and DC 12V. The Arduino Due chipset, the WiFi module, When the server 200 transmits a command through the WiFi module, it controls the solenoid through the relay module. To supply power to Arduino Due chipset and each sensor, two 12V DC power sources are used for DC power supply, and communication uses WiFi communication using ESP 8266 chipset model.

7 shows another example of the design of the Arduino sensor module according to the present invention.

The Arduino sensor module 320 shown in FIG. 7 includes an Arduino Due chipset, a WiFi module, and an RFID-RC522 module, which are connected to the Arduino board 320 with four ESP8266 (WiFi Module) It works with four. When RFID tags are connected to each RFID reader and a signal is received from all readers, it transmits a specific value to the server. The Arduino sensor module determines the order of specific objects. The communication uses WiFi communication using the ESP 8266 chipset model. The command uses the protocol included in Table 3. One DC 12 V power source is used for DC power.

8 shows another example of the design of the Arduino sensor module according to the present invention.

The Arduino sensor module 320 shown in FIG. 8 includes an Arduino Due chipset, a WiFi module, and a Bluetooth module connected to the Arduino board 310 with two ESP8266 (WiFi Module), RFID-RC5222, FSR (pressure sensor) The RFID-RC522 module and the pressure sensor are connected to each other, and the RFID tag is connected to each RFID reader. At the same time, when the pressure value is inputted, the specific value is sent to the server. This module is a module to check what objects come into a certain object position in the prototype. The communication uses WiFi communication using ESP 8266 chipset model, and the command uses the protocol included in Table 3. One DC 12 V power source is used for DC power.

Upon connection of the power source, the Arundinosensor Module 320 transmits to the local server 200 that the setup of the corresponding sensor module is completed. When all devices necessary for the IOT environment are set up, He starts to control it. A user or an administrator using the device controls each device in the form of a GUI in an app or a web environment installed in the mobile device 100, and can directly send a command to the device from the server itself.

The mobile device 100 has the following functions in an IT convergence framework to control the adonino sensor module 320 in the IoT environment.

First, the mobile device 100 must have a network connection function. In the present invention, a Wi-Fi network is used to connect the mobile device 100 to the IoT environment. Basically, it does not need to be connected to an external Internet network, so it constructs a closed Wi-Fi network and tries to connect to the server using TCP / IP protocol. In this case, port forwarding is not implemented because it is a closed network, and asynchronous input / output function is used so that a message to be missed is not generated.

In addition, the mobile device 100 generates an event through a predetermined packet. The packet received and communicated by using the server and the asynchronous I / O function is interpreted as shown in Table 4 below to display a UI on the Android device When the user changes or operates the Android device, the corresponding command is packetized and transmitted to the server.

In addition, in the present invention, a Web Cam function, which is a built-in Unity 3D function, and a handwritten notepad function using a pen or a finger, are implemented in the mobile device 100 in the present invention. When the Web Cam function is used in a mobile environment, the camera 110 in the device can be used. This function is used to take a picture and compares the pixel color data of the picture with the reference color, and when the match degree reaches 90% or more, the event generation function is generated and the logic is processed. In the embodiment of the present invention, the LineRender function, which is a Unity3D built-in function, is basically used and is designed to store a memo that the user has memorized.

FIG. 9 is an example of a smart toy implemented through a smart IT fusion framework system according to an embodiment of the present invention, and FIG. 10 is a circuit configuration diagram of a smart toy. The smart toy shown in Fig. 9 and Fig. 10 uses Adouinoo as a processor and uses a motor driver to drive the motor. Use the Bluetooth HC-06 module to communicate with your smartphone.

FIG. 11 shows a control application screen of a smart toy operating in a mobile device according to an embodiment of the present invention. As shown in FIG. 11, in the smart toy control application screen, an attempt is made to connect with the smart toy through the local server 200 through the Bluetooth connection button in the central part, and the user pushes the A button to move forward, the R button to move backward, The stop command is transmitted to the left, the right turn, and the stop button.

As described above, the smart IT convergence framework system according to the present invention makes it possible to efficiently apply various contents production in the IoT environment by utilizing the Lego type sensor module. In particular, the proposed framework proposes items to be provided by the framework through the implementation of communication between the web server 400 and the local server 200 in the IoT environment, the Arduino 300, and the mobile device 100, By implementing the prototype of the work, it is possible to efficiently apply it to contents production utilizing various sensor modules in IOT environment such as smart toy game.

It is to be understood that the present invention is not limited to the above-described embodiment, and that various modifications and changes may be made by those skilled in the art without departing from the spirit and scope of the appended claims. Of course, can be achieved.

100: mobile device 110: camera
120: WiFi module 200: Local server
210: Router 300: Arduino
310: Arduino board 311: WiFi module
320: sensor module 321: pressure sensor
322: lock sensor 323: RFID sensor
324: LED 325: Relay
326: Solenoid 400: Web server

Claims (8)

A mobile device 100 having a wireless communication function and an Android-based app installed and operated; An ADC 310 having a microcontroller connected to the sensor module 320 through a sensor interface to control the operation of the sensor module 320; And transmits and receives data by establishing wireless communication with the mobile device 100 and the adonaboard 310. The mobile device 100 transmits and receives data to and from the mobile device 100, A smart IT convergence framework system comprising a local server (200) for controlling the operation of a module (320)
The local server 200 receives the initialization code from the mobile device 100 and the sensor module 320 connected to the adonyno board 310 and transmits the initialization code to the mobile device 100 and the sensor The mobile device 100 receives data from the sensor module 320 connected to the mobile device 100 and the mobile device 100 and transmits the initialization completion code as a packet to the mobile device 100 ) And the communication board 310,
The local server 200 identifies and identifies the sensor number according to the type of the sensor module 320 connected to the adonyno board 310. When a new sensor module 320 is added to the adonyno board 310 A sensor number is extended by adding a new sensor number according to the type of the added sensor module 320 so that the LED 324, the pressure sensor 321, the padlock 321 of the sensor module 320 connected to the adonaboard 310, The sensors 322 are combined to give one sensor number xx1 and the lock sensor 322 is given a different sensor number xx2 and the plurality of RFID sensors 323 are combined to generate another sensor number xx2 and the sensor number (xx4) is given by combining the pressure sensor (321) and the RFID sensor (323).
The method according to claim 1,
WiFi modules 120 and 311 for performing WiFi communication are provided in the mobile device 100 and the adonyno board 310. A router 200 is provided in the local server 200,
A smart IT convergence framework system, wherein a plurality of mobile devices (100) and an ascending board (310) are connected to one local server (200) to perform communication.
delete The method according to claim 1,
The local server (200)
When data is transmitted / received to / from the sensor module 320 connected to the electrode board 310, if a time longer than a predetermined time threshold value occurs, it is determined that a problem has occurred in the corresponding electrode module 320 and a warning is given Smart IT convergence framework system that features.
delete delete The method according to claim 1,
The local server 200 transmits a control command including an apparatus name, an instruction word, and a parameter value to be controlled, to the adonyno board 310, in order to control the operation of the sensor module 320 connected to the adonyno board 310. [ To the smart IT convergence framework system.
The method according to claim 1,
The local server 200 is connected to the web server 400 through a communication network and transmits data generated according to communication with the mobile device 100 and the adouno board 310,
The web server 400 stores data transmitted from the local server 200, displays the web page, and provides the web page to the user.

Images