KR102217608B1 - HMI monitoring system using QR code - Google Patents

Abstract

The present invention relates to an HMI monitoring system using a QR code, which is configured to perform data communication by being connected in communication between a user terminal and the HMI through a QR code scan displayed on the HMI. Therefore, a user can automatically connect to the HMI without any separate operation and input, thereby increasing the convenience and efficiency of use, as well as checking the status of the HMI and reading information remotely, and also the user terminal can be conveniently interlocked with the HMI even if a separate input means is not provided in the HMI.

Description

HMI monitoring system using QR code}

The present invention relates to an HMI monitoring system using a QR code, and in detail, an external terminal is automatically connected to a corresponding HMI through scanning of a QR code provided by each HMI (Human machine interface) to check the status and information of the corresponding HMI. It relates to an HMI monitoring system that can be viewed remotely.

In industrial sites, most of the work processes are made of automated equipment to reduce manufacturing cost and manufacturing time.

In addition, as the field of application of the automation equipment increases, a control management system for controlling the automation equipment is also being developed, and this control management system can be easily controlled by a user through an HMI device.

HMI (Human Machine Interface) device is a device that intuitively displays the data of the control management system to the user and controls the control management system according to the control command input from the user. It receives the indicated data and converts it into numerical values, figures, or graphs and provides them to the workers. In addition, the operator can control each equipment based on the data provided through the HMI device.

These HMIs can easily monitor and control industrial devices in various industrial fields by requesting an operation command for a specific device input from the user and receiving response data corresponding to the requested data value from the device and displaying it. It has the advantage of being able to do it.

However, conventionally, in order to view or manipulate a specific HMI, the operator must directly move to the location where the HMI is located to view the operation status and information of each of the machine tools assigned to the HMI, so unnecessary manpower and time are consumed, as well as work. Convenience, efficiency and accessibility are poor.

Accordingly, various researches on HMI remote monitoring systems to remotely view and monitor the operation status and information of each of the HMIs installed in industrial sites are being conducted.

1 is a block diagram showing an HMI system disclosed in Korean Patent Registration No. 10-1909836 (name of invention: HMI system for industrial process automation control, and process automation monitoring method based on this).

The HMI system of FIG. 1 (hereinafter referred to as prior art (100) refers to an HMI terminal 110, a plurality of PLC panels (120g, (120-1), ..., (12-n))), each PLC panel A plurality of articulated robots (130g, (130-1), ..., (130-m)) connected to (120g), photographing devices (160a-g), ..., (160a-n), It consists of a network 140 and an administrator mobile device 150.

The HMI terminal 110 not only integrates and efficiently manages the process of controlling and managing the process based on the existing HMI device platform for process control, but also quickly identifies and recovers abnormal conditions during the process by linking with PLC panels (120g). To be able to do it.

The photographing apparatuses 160a-g, ..., 160a-n have a structure connected to one PLC panel.

The manager mobile device 150 provides a function of interworking with a smartphone web or an app so that a process control situation that is integratedly managed by the HMI terminal 110 can be identified and taken from a remote location.

In the prior art 100 configured as described above, the HMI terminal 110 and the administrator mobile device 150 are connected to the network 140 so that the operator can view it remotely through the administrator mobile device 150, so that work efficiency and It has the advantage of increasing accessibility.

However, in the prior art 100, in order to connect the HMI terminal 110 and the manager mobile device 150, connection information, which is information necessary for the manager mobile device 150 to connect to the corresponding HMI terminal 110, is previously It must be registered and set, and accordingly, when the operator uses a mobile device other than the mobile device 150 of the corresponding manager, the pre-work is complicated and time lag, and accessibility This falling has structural limitations.

In addition, the prior art 100 has a disadvantage in that the accuracy and reliability of normal or abnormal determination are inferior because the state of each of the articulated robots 130-1, ..., and (130-m) is made only in the HMI (3). Have.

The present invention is to solve this problem, the problem of the present invention is configured to perform data communication by connecting a user terminal and an HMI through a QR code scan displayed on the HMI, so that the user can perform separate manipulation and input. It is possible to automatically connect to the HMI without needing to do so, so it is possible to increase the convenience and efficiency of use, as well as to check the status of the corresponding HMI and to view information remotely. It relates to an HMI monitoring system that can be conveniently linked with.

The solution means of the present invention for solving the above problem comprises: a human machine interface (HMI) that generates a QR code in which set identification information is stored, and displays the generated QR code to the outside according to a user's request; A user terminal including a QR code acquisition means for obtaining a QR code image by photographing a QR code, a monitoring application being installed; Including a monitoring management server, the monitoring application is obtained by reading the obtained QR code image after obtaining a QR code image by photographing the QR code expressed in the HMI through the QR code acquisition means of the user terminal. After extracting the HMI identification information stored in the QR code, the connection request data including the extracted HMI identification information is generated and transmitted to the monitoring management server, and when the monitoring management server receives the connection request data from the monitoring application, the transmission After matching the HMI corresponding to the HMI identification information of the received connection request data and the monitoring application to the connection target, data communication between the matching HMI and the monitoring application as the connection target is mediated, and the monitoring application is executed according to the user's request. A QR code acquisition means control module for controlling the QR code acquisition means of the user terminal to capture a QR code displayed on the HMI to obtain a QR code image; A QR code reading module for reading the QR code image acquired by the QR code obtaining means control module and extracting HMI identification information stored in the QR code image; A connection request data generation module for generating connection request data including HMI identification information extracted by the QR code reading module; And a control module for transmitting the connection request data generated by the connection request data generation module to the monitoring management server, wherein the monitoring management server comprises an HMI corresponding to the HMI identification information of the connection request data transmitted from the monitoring application. A connection target matching unit matching the monitoring application to a connection target; A data intermediary unit for mediating data between the monitoring application and the HMI matched by the connection target matching unit, the HMI manages and controls the machine tools allocated to itself, and at the same time, the rows of each of the machine tools are periodically A control request data generation module that collects data, and generates control request data representing a data request or operation control request of an HMI that is a connection target according to a user's request; A display module, wherein the control module transmits the control request data generated by the control request data generation module to the monitoring management server, and the data intermediary unit of the monitoring management server transmits the control request data received from the monitoring application. When the response data corresponding to the control request data is transmitted from the HMI matched as the connection target and transmitted to the HMI matched as the connection target, the received response data is transmitted to the monitoring application matched as the connection target, and the monitoring application The display module of is to display the response data received from the monitoring management server on the monitor of the user terminal.

delete

delete

In addition, in the present invention, the controller of the HMI includes a memory; A QR code generator for generating a QR code in which preset identification information is stored and storing it in the memory; A QR code display unit that displays a QR code stored in the memory to the outside according to a user's request; A data collection unit collecting log data of each of the machine tools at a predetermined period and storing the log data in the memory; A monitoring management unit that is executed when a connection request is received from the monitoring management server, wherein the monitoring management unit includes a data input unit for receiving control request data transmitted from the monitoring management server; A response data generator configured to generate response data according to the calculation process after performing an operation process corresponding to the control request data input through the data input unit; It is preferable to further include a response data transmission unit for transmitting the response data generated by the response data generation unit to the monitoring management server.

In addition, in the present invention, the HMI monitoring system further includes IoT sensors installed in each of the machine tools, and the data collection unit of the controller collects measured values of each of the IoT sensors every cycle and stores them in the memory, The monitoring application includes a measurement value request data generation module that generates measurement value request data for requesting measurement values of a connected HMI according to a user's request, and the data intermediary unit of the monitoring management server is transmitted from the monitoring application. When the received measurement value request data is transmitted to the matching HMI as a connection target, and the monitoring management unit of the controller receives the measurement value request data from the monitoring management server, the measurement values measured by the IoT sensors are monitored and managed. A measurement value selection/transmission unit transmitted to the server, and the data intermediary unit of the monitoring management server transmits the measurement values transmitted from the HMI to a monitoring application matched as a connection target, and the display module of the monitoring application includes the It is preferable to display the measured values transmitted from the monitoring management server on the monitor of the user terminal.

Further, in the present invention, the measurement value selection/transmission unit of the monitoring management unit includes a measurement value extraction module for extracting measurement values collected by the data collection unit; Using the preset set value (TH, Threshold) and threshold range for each IoT sensor, it is compared whether the measured values extracted by the measured value extraction module are within the threshold range of the corresponding set value (TH). If the extracted measured value is not within the threshold range of the set value (TH), the measured value is determined as an invalid measured value, which is invalid data, and if the extracted measured value is included in the threshold range of the set value (TH) If so, a set value comparison and determination module for determining that the measured value is a valid measurement value that is valid data; A filtering module for filtering invalid measurement values determined by the set value comparison and determination module among measurement values extracted by the measurement value extraction module to select valid measurement values; And an effective measurement value transmission module for transmitting the effective measurement values selected by the filtering module to the monitoring management server, the monitoring management server further comprising an effective measurement value processing unit, and the data intermediary unit received from the HMI. The effective measured values are input to the effective measured value processing unit to execute the effective measured value processing unit, and when the processed measured value is detected by the effective measured value processing unit, the detected processed measured value is matched to the connection target. A missing target determination module that transmits to an application, and determines whether there is a missing target, which is an IoT sensor that has not transmitted the effective measured value among IoT sensors of the corresponding HMI by analyzing the input valid measured values; It is executed when it is determined that the missing target exists by the missing target determination module, extracts the initial value TH corresponding to the detected missing target, and then replaces the extracted initial value with the effective measured value of the corresponding IoT sensor. It is preferable to include a processing module for detecting processed measured values corresponding to the transmitted effective measured values.

According to the present invention having the above problems and solutions, it is configured to perform data communication by being connected in communication between a user terminal and an HMI through a QR code scan displayed on the HMI, so that the user can automatically communicate with the HMI without additional manipulation and input. Not only can the accessibility increase the convenience and efficiency of use, but also the status check and information reading of the relevant HMI can be done remotely, and even if the HMI is not equipped with a separate input means, the user terminal can be conveniently linked with the HMI. There will be.

1 is a block diagram showing an HMI system disclosed in Korean Patent Registration No. 10-1909836 (name of invention: HMI system for industrial process automation control, and process automation monitoring method based on this).
1 is a block diagram showing an HMI system disclosed in Korean Patent Registration No. 10-1909836 (name of invention: HMI system for industrial process automation control, and process automation monitoring method based on this).
2 is a block diagram showing an HMI monitoring system according to an embodiment of the present invention.
3 is a block diagram illustrating the HMI of FIG. 2.
4 is a block diagram illustrating the controller of FIG. 3.
5 is a block diagram illustrating a monitoring management unit of FIG. 4.
6 is a block diagram illustrating a measurement value selection/transmission unit of FIG. 5.
7 is a block diagram illustrating the user terminal of FIG. 2.
8 is a block diagram illustrating a monitoring application of FIG. 2.
9 is a block diagram showing the monitoring management server of FIG. 2.
10 is a block diagram illustrating an effective measurement value processing unit of FIG. 9.

Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

2 is a block diagram showing an HMI monitoring system according to an embodiment of the present invention.

The HMI monitoring system 1 according to an embodiment of the present invention, as shown in FIG. 2, includes the HMI (3-1), ..., (3-N), the user terminal (4), the monitoring application (5). ), monitoring management server (7), machine tool (8-1), ..., (8-N), IoT sensor (9-1), ..., (9-N), communication network (10 ).

At this time, in FIG. 2, for convenience of explanation, it has been described as an example that the HMI 3 is connected to the machine tools (8-1), ..., (8-N) to transmit and receive data, but each machine tool ( 8) is connected to a commonly used PLC, and the HMI 3 may be configured to transmit and receive data through the PLC of each machine tool.

The communication network 10 provides a data movement path between the HMI (3-1), ..., (3-N), the user terminal (4) and the monitoring management server (7), and in detail, a wide area network It can be composed of (WAN), mobile communication network, wired communication network, LTE, 3G, 4G, 5G, etc.

IoT sensors (9-1), ..., (9-N) are various known physical/chemical sensors for detecting a state related to the operation of the machine tool (8). ) May be composed of a gyro sensor, an acceleration sensor, a temperature sensor, an acoustic sensor, and a gas sensor.

Machine tools (8-1), ..., (8-N) are installed according to the process line of the industrial site, and collect raw data while performing the process according to the pre-designed process process.

In addition, a plurality of IoT sensors (9-1), ..., (9-N) are installed in each of the machine tools (8-1), ..., (8-N), and the IoT sensor (9-1 ), ..., (9-N) measured values are collected.

In addition, the machine tools (8-1), ..., (8-N) periodically transmit the stored raw data and measured values to the corresponding HMI (3) at the request of the upper component, the HMI (3).

In addition, when the machine tools (8-1), ..., (8-N) receive request data from the upper component, the HMI (3), they perform operation processing and operation according to the received request data, Transmit response data to the relevant HMI (3).

HMI(3-1), ..., (3-N) manage and control the sub-elements assigned to them, such as machine tools (8-1), ..., (8-N), and periodically Receives raw data and measured values to the pre-allocated machine tools (8) and stores them, requests an operation command to a specific machine tool (8) according to the user's request, and sends the request data from the machine tool (8). The corresponding response data is received and displayed.

3 is a block diagram illustrating the HMI of FIG. 2.

As shown in FIG. 3, the HMI 3 includes a display means 303 for displaying response data or a QR code according to a user's request, an input means 305 for receiving a QR code request from the user, and an HMI ( 3) It is composed of a controller 301 that manages and controls the overall operation and transmits monitoring information in connection with the connected user terminal 4.

At this time, when the input means 305 is touched, pressed, or manipulated by the user, it requests the display of the QR code to the controller 301, and in detail, it may be implemented as a button type, a keyboard, a mouse, or the like.

The controller 301 is a controller that manages and controls the overall operation of the HMI 3, and after requesting data to the machine tool 8 at the request of a user, and receiving response data corresponding thereto, it is received. The received response data is processed and the processed data is displayed through the display means (303).

In addition, in the controller 301, connection information, which is information necessary for an external terminal (user terminal) to connect to the corresponding HMI 3 through the communication network 10, is preset and stored.

In addition, the controller 301 generates and stores a QR code in which preset identification information is stored, and when a user requests to view the QR code through the input means 305, the generated QR code is displayed on the display means 303. Display. At this time, the monitoring application 5 controls the user terminal 4 to scan and read the displayed QR code through the display means 303, and then request a connection including the HMI identification information read to the monitoring management server 7 By transmitting the data, the status of the HMI 3 can be monitored.

4 is a block diagram illustrating the controller of FIG. 3.

As shown in FIG. 4, the controller 301 includes a control unit 30, a memory 31, a communication interface unit 32, a data input/output unit 33, a QR code generation unit 34, and a QR code display unit. (35), data collection unit 36, failure determination unit 37, supplementary service unit 38, and consists of a monitoring management unit (39).

The control unit 30 is an OS (Operating System) of the controller 301, and the control targets (31), (32), (33), (34), (35), (36), (37), (38) , (39) to manage and control.

In addition, the control unit 30 executes the QR code generation unit 34 when first executed, and stores the QR code generated by the QR code generation unit 34 in the memory 31.

In addition, when the control unit 30 receives a request to view the QR code from the user through the input means 305, it executes the QR code display unit 35.

In addition, when the control unit 30 receives a request for connection from the monitoring management server 7 through the communication interface unit 32, it executes the monitoring management unit 39.

In addition, the control unit 30 executes the data collection unit 36 at preset periods.

In the memory 31, identification information of a preset HMI is stored. At this time, the identification information means information necessary to identify the HMI (3), and in detail, the model name, version information, Ethernet information, Product ID, and other port numbers and IDs required for connection (FTP, VNC, etc.) And the like.

In addition, the QR code generated by the QR code generation unit 34 is stored in the memory 31.

In addition, the memory 31 stores log data and measurement values collected by the data collection unit 36 and error information detected by the failure determination unit 37.

The communication interface unit 32 transmits and receives data to and from the user terminal 4 connected to the communication network 10.

The data input/output unit 33 inputs and outputs data to and from the connected machine tools (8-1), ..., (8-N).

The QR code generation unit 34 generates a QR code in which identification information stored in the memory 31 is stored, and the generated QR code information is stored in the memory 31 under the control of the controller 30. At this time, since the technology and method of generating the QR code is commonly used in the QR code system, a detailed description will be omitted.

The QR code generation unit 34 may be executed when the HMI 3 is driven for the first time, or may be executed at a preset cycle.

The QR code display unit 35 is executed when a user requests to view the QR code through the input unit 305, and displays the QR code generated by the QR code generation unit 34 and stored in the memory 31 by a display unit ( 303).

At this time, the QR code displayed by the display means 303 is photographed by the camera of the user terminal 4.

The data collection unit 36 requests log data and measured values from the machine tools (8-1), ..., (8-N) allocated to the machine tools (8-1), ..., (8-N) assigned to the machine tools (8-1),. .., log data and measured values transmitted from the (8-N) are stored in the memory 31.

The failure determination unit 37 analyzes and processes the log data collected by the log data collection unit 36 to determine whether the operation of each machine tool 9 is normal or not. At this time, since the technology and method for determining whether the operation of the corresponding driver is normal or not by analyzing and utilizing the log data are known, a detailed description will be omitted.

The additional service unit 38 performs arithmetic processing for performing functions such as alarms, logging, errors, and recipes that are normally provided by the HMI 3.

In addition, the additional service unit 38 requests data from the machine tool 8 according to the user's request, and displays the response data received from the machine tool 8 on the display means 303.

The monitoring management unit 39 is executed when a connection request is received from the monitoring management server 7 through the communication network 10.

5 is a block diagram illustrating a monitoring management unit of FIG. 4.

As shown in FIG. 5, the monitoring management unit 39 includes a data input unit 391, a response data generation unit 392, a response data transmission unit 393, and a measurement value selection/transmission unit 394.

The data input unit 391 receives control request data or measurement value request data transmitted from the monitoring management server 7 through the communication interface unit 32.

At this time, the control request data is data related to control and information reading using a general HMI, such as requesting log data of a specific machine tool, controlling operation of each machine tool, requesting error log data of a specific machine tool, requesting operation status of a specific machine tool, etc. It means, and the measurement value request data means a request for measurement values of the IoT sensors 9.

In addition, the data input unit 391 executes the response data generation unit 392 when the control request data is input, and executes the measurement value selection/transmission unit 394 when the measurement value request data is input.

The response data generation unit 392 performs an operation process corresponding to the control request data input through the data input unit 392 and then generates response data according to the operation process.

The response data transmission unit 393 controls the communication interface unit 32 to transmit the response data generated by the response data generation unit 392 to the monitoring management server 7.

6 is a block diagram illustrating a measurement value selection/transmission unit of FIG. 5.

The measurement value selection/transmission unit 394 is executed when the measurement value request data is transmitted from the monitoring management server 7 through the data input unit 391, and repeatedly performs an operation until the measurement value request is terminated.

In addition, the measurement value selection/transmission unit 394, as shown in FIG. 6, includes a measurement value extraction module 3937, a set value comparison and determination module 3938, a filtering module 3939, and an effective measurement value transmission module ( 3944), and a set value optimization module 3945.

The measurement value extraction module 3931 extracts measurement values collected by the data collection unit 36. At this time, the measured values are sorted and extracted by IoT sensor.

The set value comparison and determination module 3934 utilizes a preset set value (TH, Threshold) and a threshold range, and the measured value extracted by the measured value extraction module 3937 is included within the threshold range of the set value TH. Compare whether it works. At this time, the set value TH and the threshold range are preset for each IoT sensor.

In addition, when the extracted measured value is not included in the threshold range of the set value TH, the set value comparison and determination module 3934 determines that the measured value is invalid data, which is an invalid measurement value.

In addition, when the extracted measurement value is included in the threshold range of the setting value TH, the set value comparison and determination module 3939 determines that the measured value is a valid measurement value that is valid data.

For example, when the IoT sensor'A' is a humidity sensor, the set value (TH) is set to 3.0%, and the threshold range is set to'±0.3%', the set value comparison and determination module 3939 is When the measured value of'A' is '3.21%', the measured value is determined as an invalid measured value, but when the measured value of'A' is '5.1%', the measured value is determined as a valid measured value. I can.

The filtering module 3939 filters invalid measured values by the set value comparison and determination module 3934 among the measured values extracted by the measured value extraction module 3939 to select only valid measured values.

The effective measurement value transmission module 3944 controls the communication interface unit 32 so that the effective measurement values selected by the filtering module 3939 are transmitted to the monitoring management server 7.

The set value reset module 3945 determines whether all of the measured values extracted by the measured value extraction module 3931 during a preset period T are included in the threshold range of the set value TH, and if the extracted When all the measured values are not included in the threshold range of the set value TH, it is determined that the set value TH needs to be reset, and if at least one of the extracted measured values is included in the threshold range of the set value TH At this time, it is determined that the set value TH is not reset.

In addition, when the set value reset module 3945 determines that all of the extracted measured values are not included in the threshold range of the set value TH, and thus it is determined that the set value TH needs to be reset, the average value of the measured values extracted during the period Is reset to the set value TH, and the reset set value TH is stored in the memory 31.

7 is a block diagram illustrating the user terminal of FIG. 2.

As shown in FIG. 7, the user terminal 4 includes a memory 41 in which data is stored, and a monitor 42 in which graphic user interfaces (GUIs) provided by the monitoring application 5 are displayed. , QR code acquisition means 43 for obtaining a QR code image for photographing a QR code displayed through the display means 303 of the HMI 3, and data with the monitoring management server 7 by connecting to the communication network 10 It consists of a communication interface module 44 for transmitting/receiving, an application interworking module 45 interworking with the monitoring application 5, and a control module 46 in charge of an operating system (OS) of the user terminal 4.

A monitoring application is installed in the user terminal 4.

The monitoring application 5 is an application, software, or application program installed in the user terminal 4 to provide a monitoring service of the HMI 3 to a user in connection with the monitoring management server 7.

8 is a block diagram illustrating a monitoring application of FIG. 2.

As shown in Fig. 8, the monitoring application 5 includes a control module 50, a data storage module 51, a data input/output module 52, a GUI processing module 53, a QR code acquisition means control module 54. ), QR code reading module 55, connection request data generation module 56, control request data generation module 57, measurement value request data generation module 58, and display module 59.

The control module 50 manages and controls the operation of the monitoring application 5, and in detail, configuration means (51), (52), (53), (54), (55), (56), ( 57), (58), (59) are managed and controlled.

The data storage module 51 stores data in the memory 41 of the user terminal 4 or extracts data stored in the memory 41.

The data input/output module 52 inputs and outputs data to and from the user terminal 4.

The GUI processing module 53 displays previously manufactured graphic user interfaces (GUI, Graphic User Interfaces) on the monitor 42 of the user terminal 4 and receives data from the user and processes operations corresponding to the input data. Is done.

In this case, the graphic user interface may be produced with various known functions and graphics, such as including an input box for receiving data from a user or including an exhibition box in which data transmitted from the monitoring management server 7 is displayed. .

The QR code acquisition means control module 54 is executed when a user requests a QR code scan, and activates the QR code acquisition means 43 of the user terminal 4 through the display means 303 of the HMI 3 Take a picture of the displayed QR code to obtain a QR code image.

The QR code reading module 55 reads the QR code image acquired by the QR code acquisition means control module 54 and extracts the identification information of the corresponding HMI stored in the QR code.

The connection request data generation module 56 generates connection request data including HMI identification information extracted by the QR code reading module 55. At this time, the generated connection request data is transmitted to the monitoring management server 7 through the user terminal 4 under the control of the control module 50, and the monitoring management server 7 sends a connection request received from the user terminal 4 It connects to the relevant HMI 3 through the HMI identification information of the data and mediates data communication between them.

The control request data generation module 57 generates control request data for the corresponding HMI 3 according to the user's request. At this time, the control request data is data related to control and information reading using a general HMI, such as requesting log data of a specific machine tool, controlling operation of each machine tool, requesting error log data of a specific machine tool, requesting operation status of a specific machine tool, etc. It means, and the measurement value request data means a request for measurement values of the IoT sensors 9.

At this time, the control request data generated by the control request data generation module 57 is transmitted to the monitoring management server 7, and the monitoring management server 7 transmits the control request data to the corresponding HMI 3 when it receives the control request data. Thereafter, the response data received from the HMI 3 is transmitted to the user terminal 4, and the monitoring application 5 transmits the response data received from the monitoring management server 7 through the user terminal 4 to the display module ( 59) is displayed on the monitor 42 of the user terminal 4.

The measurement value request data generation module 58 generates measurement value request data for the corresponding HMI 3 according to the user's request. At this time, the measured value request data refers to data that requests the measured values measured by the IoT sensors 9, which are sub-transport elements of the corresponding HMI 3.

In addition, the measurement value request data generated by the measurement value request data generation module 580 is transmitted to the monitoring management server 7 through the user terminal 4, and the monitoring management server 7 is transmitted from the user terminal 4. The measured value request data is transmitted to the corresponding HMI 3, the measured value is received from the HMI 3, and the transmitted measured values are processed again and transmitted to the user terminal 4. At this time, the HMI 3 is a monitoring management server ( When transmitting the measured values to the monitoring management server 7 according to the measured value request data received from 7), as described above in FIG. 6, the invalid measured values are filtered and only valid measured values are transmitted, resulting in a large amount of data transmission. It is possible to effectively prevent the network load phenomenon caused by.

The display module 59 displays a previously manufactured GUI, response data transmitted from the monitoring management server 7 or processed measured values transmitted from the monitoring management server 7 on the monitor 42 of the user terminal 4. .

9 is a block diagram showing the monitoring management server of FIG. 2.

As shown in Fig. 9, the monitoring management server 7 includes a control unit 70, a database unit 71, a data transmission/reception unit 72, an application management unit 73, a connection target matching unit 74, and data intermediary. It consists of a unit 75, an effective measurement value processing unit 76, and an uploading unit 77.

The control unit 70 is an O.S (Operating System) of the monitoring management server 7, and manages and controls the control targets 71, 72, 73, 75, and 77.

In addition, when the control unit 70 receives the connection request data from the user terminal 4 through the data transmission/reception unit 72, the control unit 70 inputs the received connection request data to the connection target matching unit 74.

Further, the control unit 70 controls the data transmission/reception unit 72 to transmit and receive data between the HMI 3 and the user terminal 4 under the control of the data intermediary unit 75.

In addition, when the control unit 70 receives valid measurement values from the HMI 3 through the data transmission/reception unit 72, the received effective measurement values are input to the effective measurement value processing unit 76, and the effective measurement value processing unit ( The data transmission/reception unit 72 is controlled so that the processed measured values detected by 76) are transmitted to the user terminal 4.

The database unit 71 stores log files of data transmitted and received between connection targets by the uploading unit 77.

In addition, the database unit 71 stores effective measured values transmitted from the HMI 3 and processed measured values detected by the effective measured value processing unit 76.

In addition, the database unit 71 periodically interlocks with the HMI 3 to store the set value TH and the threshold range currently set in the HMI 3.

In addition, member information of the monitoring application 5 is stored in the database unit 71.

The data transmission/reception unit 72 transmits and receives data to and from the user terminal 4 and the HMIs 3-1, ..., (3-N).

The application manager 73 manages and controls the operation of the monitoring application 5.

The connection target matching unit 74 inputs the connection request data transmitted from the user terminal 4, and connects the HMI 3 and the user terminal 4 corresponding to the HMI identification information of the input connection request data to the connection targets. Match with

The data intermediary unit 75 mediates the data between the user terminal 4 and the HMI 3 matched by the connection target matching unit 74, and in detail, transmits the control request data from the user terminal 4 Upon receipt, it is transmitted to the matching HMI 3 as a connection target, and when response data corresponding to the control request data is received from the HMI 3, it is transmitted to the user terminal 4 matched as the connection target, and the HMI ( 3) When the measured value request data is received, it is transmitted to the matching HMI 3 as a connection target, and when effective measured values corresponding to the measured value request data are received from the HMI 3, this is shown in FIG. 9 to be described later. Simultaneously with input to the effective measured value processing unit 76, the processed measured values detected by the effective measured value processing unit 76 are transmitted to the user terminal 4 matched as a connection target.

10 is a block diagram illustrating an effective measurement value processing unit of FIG. 9.

The effective measurement value processing unit 76 is executed when receiving the effective measurement values from the HMI 3.

In addition, the effective measurement value processing unit 76 analyzes the effective measurement values received from the HMI 3 and does not transmit the effective measurement value among the IoT sensors 9 of the HMI 3, as shown in FIG. 10. An initial value corresponding to the detected missing target, executed when it is determined that the missing target exists by the missing target determination module 761 and the missing target determination module 761, which is an IoT sensor that is not TH) and a processing module 762 that detects processed measured values corresponding to the transmitted effective measured values by replacing the extracted initial values with effective measured values of the IoT sensor 9 after extracting the threshold range and TH). Consists of

As described above, the HMI monitoring system 1, which is an embodiment of the present invention, is configured to perform data communication by connecting the user terminal and the HMI through a QR code scan displayed on the HMI, so that the user does not have to perform separate manipulations and input It is possible to automatically connect to the HMI to increase the convenience and efficiency of use, as well as to check the status of the HMI and to view information remotely. Even if the HMI is not equipped with a separate input means, the user terminal is convenient with the HMI. Can be interlocked.

1: HMI monitoring system 3-1, ..., 3-N: HMIs 4: User terminal
5: Monitoring application 7: Monitoring management server
8-1, ..., 8-N: machine tools 9-1, ..., 9-N: IoT sensors
10: communication network 30: control unit
31: memory 32: communication interface unit
33: data input/output unit 34: QR code generation unit 35: QR code display unit
36: Data collection unit 37: Failure determination unit 38: Additional services unit
40: monitoring management unit 50: control module 51: data storage module
52: data input/output module 53: GUI processing module
54: QR code acquisition means control module 55: QR code reading module
56: connection request data generation module 57: control request data generation module
58: measurement value request data generation module 59: display module
70: control unit 71: database unit 72: data transmission/reception unit
73: application management unit 74: connection target matching unit
75: data intermediary unit 76: effective measurement value processing unit
77: Uploading section

Claims (6)

HMI (Human machine interface) for generating a QR code in which preset identification information is stored, and for displaying the generated QR code to the outside according to a user's request;
A user terminal including a QR code acquisition means for obtaining a QR code image by photographing a QR code, a monitoring application being installed;
Including a monitoring management server,
The monitoring application
After obtaining a QR code image by photographing the QR code expressed from the HMI through the QR code obtaining means of the user terminal, reading the obtained QR code image and extracting HMI identification information stored in the obtained QR code, Generates connection request data including the extracted HMI identification information and transmits it to the monitoring management server,
The monitoring management server
When the connection request data is received from the monitoring application, the HMI corresponding to the HMI identification information of the transmitted connection request data and the monitoring application are matched to the connection target, and then data communication between the HMI matched as the connection target and the monitoring application is performed. Intermediary,
The monitoring application
A QR code acquisition means control module for acquiring a QR code image by controlling the QR code acquisition means of the user terminal according to a user's request to take a QR code displayed on the HMI;
A QR code reading module for reading the QR code image acquired by the QR code obtaining means control module and extracting HMI identification information stored in the QR code image;
A connection request data generation module for generating connection request data including HMI identification information extracted by the QR code reading module;
And a control module for transmitting the connection request data generated by the connection request data generation module to the monitoring management server,
The monitoring management server
A connection target matching unit for matching the HMI corresponding to the HMI identification information of the connection request data transmitted from the monitoring application with the monitoring application as a connection target;
A data intermediary unit for intermediating data between the monitoring application and HMI matched by the connection target matching unit,
The HMI manages and controls the machine tools allocated to itself, and at the same time periodically collects raw data of each of the machine tools,
The monitoring application
A control request data generation module for generating control request data indicating a data request or an operation control request of an HMI to be connected according to a user's request;
Including a display module,
The control module transmits the control request data generated by the control request data generation module to the monitoring management server,
The data intermediary unit of the monitoring management server transmits the control request data received from the monitoring application to the HMI matched as a connection target, and at the same time, when receiving response data corresponding to the control request data from the HMI matched as a connection target, Transmit the received response data to the monitoring application matched to the connection target,
The display module of the monitoring application
HMI monitoring system, characterized in that the response data received from the monitoring management server is displayed on the monitor of the user terminal. delete delete The method of claim 1, wherein the controller of the HMI
Memory;
A QR code generator for generating a QR code in which preset identification information is stored and storing it in the memory;
A QR code display unit that displays a QR code stored in the memory to the outside according to a user's request;
A data collection unit collecting log data of each of the machine tools at a predetermined period and storing the log data in the memory;
Includes a monitoring management unit that is executed when a connection is requested from the monitoring management server,
The monitoring management unit
A data input unit receiving control request data transmitted from the monitoring management server;
A response data generator configured to generate response data according to the calculation process after performing an operation process corresponding to the control request data input through the data input unit;
HMI monitoring system, characterized in that it further comprises a response data transmission unit for transmitting the response data generated by the response data generation unit to the monitoring management server. The method of claim 4, wherein the HMI monitoring system further comprises IoT sensors installed in each of the machine tools,
The data collection unit of the controller collects measurement values of each of the IoT sensors every cycle and stores them in the memory,
The monitoring application
It includes a measurement value request data generation module that generates measurement value request data for requesting measurement values of the HMI to be connected according to the user's request,
The data intermediary unit of the monitoring management server transmits the measured value request data received from the monitoring application to the matching HMI as a connection target,
The monitoring management unit of the controller
When receiving the measurement value request data from the monitoring management server, including a measurement value selection / transmission unit for transmitting the measurement values measured by the IoT sensors to the monitoring management server,
The data intermediary unit of the monitoring management server
Transmit the measured values received from the HMI to the monitoring application matched to the connection target,
The display module of the monitoring application is an HMI monitoring system, characterized in that for displaying the measured values transmitted from the monitoring management server on the monitor of the user terminal. The method of claim 5, wherein the measurement value selection/transmission unit of the monitoring management unit
A measurement value extraction module for extracting measurement values collected by the data collection unit;
Using the preset set value (TH, Threshold) and threshold range for each IoT sensor, it is compared whether the measured values extracted by the measured value extraction module are within the threshold range of the corresponding set value (TH). If the extracted measured value is not within the threshold range of the set value (TH), the measured value is determined as an invalid measured value, which is invalid data, and if the extracted measured value is included in the threshold range of the set value (TH) If so, a set value comparison and determination module for determining that the measured value is a valid measurement value that is valid data;
A filtering module for filtering invalid measurement values determined by the set value comparison and determination module among measurement values extracted by the measurement value extraction module to select valid measurement values;
Including an effective measurement value transmission module for transmitting the effective measurement values selected by the filtering module to the monitoring management server,
The monitoring management server further includes an effective measurement value processing unit,
The data intermediary unit inputs the effective measurement values transmitted from the HMI to the effective measurement value processing unit to execute the effective measurement value processing unit, and when the processed measurement value is detected by the effective measurement value processing unit, the detected processed The measured value is transmitted to the matching monitoring application as the connection target,
The effective measurement value processing unit
A missing object determination module that analyzes the input valid measurement values and determines whether there is a missing object, which is an IoT sensor that has not transmitted an effective measurement value among IoT sensors of the corresponding HMI;
It is executed when it is determined that the missing target exists by the missing target determination module, extracts the initial value TH corresponding to the detected missing target, and then replaces the extracted initial value with the effective measured value of the corresponding IoT sensor. HMI monitoring system comprising a processing module for detecting processed measured values corresponding to the transmitted effective measured values.

Images