JP2023046548A - Data management system and data management method - Google Patents

Abstract

To improve security when collecting data from collection equipment.SOLUTION: A management part and collection equipment are connected to an arrangement part by the MQTT system so as to be capable of detecting messages classified by a specific topic each. The collection equipment transmits data to an integration part when detecting distribution of a message for instructing transmission of data to the collection equipment as a specific topic from the management part to the distribution part during connection to the distribution part by the MQTT system. The integration part distributes a completion message for showing integration of the data as a specific topic to the distribution part when the data are integrated. The management part detects the completion message and determines that the collection equipment is in a responsible state when the completion message is distributed to the distribution part during connection to the distribution part by the MQTT system.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to data management systems and data management methods.

Patent Literature 1 discloses a data collection system having a slave data collection device that collects information from facility equipment and a main data collection device that collects data from the slave data collection device. The master collection device sends a data write frame to the first slave data collection device, and the slave data collection device passes the frame with its own collected data written to the next slave data collection device. Subsequent slave data collection devices pass frames in which their own collected data are written to the next slave data collection device. The last nth slave data collection device writes its collected data into the frame and sends the written frame to the master data collection device.

JP 2015-211382 A

It is desirable that slave data collection devices operate independently so as not to affect other slave data collection devices. Also, from the viewpoint of security, there is a demand to acquire data of the slave data collection device or to monitor the life and death of the slave data collection device without the master data collection device directly accessing the slave data collection device.

The present disclosure can be implemented as the following forms.

(1) According to one aspect of the present disclosure, a data management system is provided. This data management system includes a collecting device that outputs collected data, a management unit that manages the collecting device, an aggregating unit that collects the data output by the collecting device, the management unit, the collecting device, and the An MQTT method in which other devices themselves acquire messages delivered by any one of the management unit, the collecting device, and the aggregating unit, using sorting using topics for the aggregating unit. and a distribution unit that mediates between the management unit, the collection device, and the aggregating unit by using sorting using topics, and distributing the management unit, the collection device, and the aggregating unit. Any one device of the aggregating units is connected by an MQTT method in which other devices acquire messages to be distributed to the distributing unit by themselves, and the collecting device uses the topic specified by the collecting device to When it is detected that the message distributed from the unit to the distribution unit is a data transmission instruction addressed to the collection device, the collected data is transmitted to the aggregation unit, and the aggregation unit completes aggregation of the data. Then, the management unit distributes a completion message specified using the specified topic to the distribution unit, and when the management unit detects that the completion message has been distributed from the aggregating unit to the distribution unit, Determine that the collection device is ready to respond. According to the data management system of this form, the collecting device can access the distribution unit, but the distribution unit cannot directly access the collecting device. You can manage your equipment.
(2) In the data management system of the above aspect, the aggregating unit has a storage unit, a collection system that stores the data in the storage unit, and a transmission server that transmits the data from the collection device to the collection system. and, the collection system may distribute the completion message to the distribution unit when the data is stored in the storage unit.
(3) In the data management system of the above aspect, the collection device may be connected to the distribution section using a specific input port of the distribution section. According to the data management system of this form, the collecting device is connected using a specific input port of the distribution section, so the security of the collecting device can be further enhanced.
(4) In the data management system of the above aspect, the delivery unit may acquire device information of the collection device when connected from the collection device, and perform life-and-death monitoring of the collection device. According to this aspect, the distribution unit can acquire the device information of the collection device and perform life-and-death monitoring without accessing the collection device.
(5) According to one aspect of the present disclosure, a data management method is provided. In this data management method, the management unit and the collection device are connected to the distribution unit by the MQTT method so as to be able to detect messages classified using a specific topic, and the collection device is connected to the distribution unit by the MQTT method. , when it is detected that a message of a data transmission instruction addressed to the collection device, which is a specific topic, has been delivered from the management unit to the delivery unit, data is sent to the aggregating unit, and the aggregating unit After aggregating the data, the unit delivers a completion message indicating that the data of a specific topic has been aggregated to the delivery unit, When a message is delivered to the delivery unit, it detects the message and determines that the collection device is ready to respond. According to this form of data management method, the collection device can access the distribution unit, but the distribution unit cannot directly access the collection device. You can manage your equipment.

The present disclosure can also be implemented in various forms other than a data management system. For example, it can be implemented in the form of a data management method or the like.

It is an explanatory view showing a data management system. FIG. 10 is an explanatory diagram showing data storage processing; FIG. 10 is a sequence diagram showing data storage processing; FIG. 4 is an explanatory diagram showing the flow of instructions and data in the data management system;

FIG. 1 is an explanatory diagram showing the data management system 10. As shown in FIG. The data management system 10 includes a management unit 100, an MQTT Broker (Message Queueing Telemetry Transport) device 110 (hereinafter referred to as "MQTT Broker 110"), transmission servers 120 and 125, a collection device group 130, a collection system 150, 155; Collection device group 130 includes collection devices 131 to 142 . The collection devices 131 to 136 are connected to the transmission server 120 and the collection devices 131 to 136 are connected to the transmission server 125 via a network such as LAN. Transmission server 120 is connected to collection system 150 having storage unit 160 , and transmission server 125 is connected to collection system 155 having storage unit 165 via a network such as a LAN. The transmission servers 120 and 125, the collection systems 150 and 155, and the storage units 160 and 165 are collectively referred to as aggregating units 170 and 175, respectively. The MQTT Broker 110 is connected to the management section 100, the collection devices 131 to 142, and the collection systems 150 and 155 by the MQTT method. In the MQTT method, sorting using topics is used, and messages distributed by any one of the management unit 100, the collection devices 131 to 142, and the collection systems 150 and 155 are acquired by the other devices themselves.

The management unit 100 is a device that publishes and distributes a message including a data transmission instruction addressed to the collection device group 130 or the collection devices 131 to 142 . The management unit 100 also sends a data storage completion message from the collection systems 150 and 155 to the storage units 160 and 165 to the MQTT broker 110 in order to detect that the data storage completion message has been published to the MQTT broker 110. Always subscribe connected. When the management unit 100 detects that the data storage completion message has been published to the MQTT Broker 110, it stores it as management information together with the device information of the collection devices 131 to 142 that are transmission sources.

Here, Publish distribution means that a sender of a message distributes a message including a specific topic to specific subscribers. In the present embodiment, the topic is, for example, "a data transmission instruction addressed to the collection device group 130 or to the collection devices 131 to 142", and "data storage completed in the storage units 160 and 165". ”. A subscriber can subscribe to a message containing a specific topic specified by the subscriber by making a Subscribe connection to the sender of the message. Here, a Subscribe connection is a connection that allows a subscriber to subscribe to messages containing a specific topic. In a subscribe connection, by using a specific input port of the connection destination, access from the connection source (subscriber) to the connection destination is possible, but reverse access from the connection destination to the connection source is disabled. . A connection source device can detect and acquire a message containing a specific topic that has been published when the connection source device is subscribed to a connection destination. However, it is not possible to detect/acquire a message including a specific topic that has been published before the connection source device subscribes to the connection destination. It should be noted that it may be possible to detect and acquire a message containing a specific topic, which was published before the subscriber made a subscribe connection to the connection destination. Further, when the connection destination device is subscribed from the connection source, the device information of the connection source device can be obtained.

MQTT Broker 110 is a distribution unit that distributes messages to subscribers. When the MQTT Broker 110 receives a message containing a specific topic published from the management unit 100, it distributes the message to the collector devices 131 to 142, which are subscribers. Also, when the MQTT Broker 110 receives a message containing a specific topic published from the collection systems 150 and 155, it distributes it to the management section 100, which is a subscriber. The MQTT Broker 110 thus mediates the delivery of messages.

The collection devices 131 to 142 of the collection device group 130 are, for example, devices such as loggers arranged in the factory 200 that record the operations of sensors. The collection devices 131 to 142 are isolated by firewalls, for example, so that they cannot be accessed by other devices such as the management unit 100, the MQTT broker 110, the transmission servers 120 and 125, and the collection systems 150 and 155. The collection devices 131 to 142 of the collection device group 130 are always subscribed to the MQTT Broker 110 using specific input ports. The network is preferably a wired LAN from the viewpoint of security, but may be a wireless LAN if security measures such as encryption are taken. Of course, even if it is a wired LAN, security measures such as encryption may be taken.

Collecting devices 131 to 142 detect and obtain messages containing specific topics during Subscribe connection to MQTT Broker 110 . A message including a specific topic is a message that instructs data transmission to the collection device group 130 or to its own collection device. When the collection devices 131 to 142 detect/acquire that the MQTT Broker 110 publishes a data transmission instruction to the collection device group 130 or to their own collection device, they collect the data and correspond to each of them. Send to the sending servers 120 and 125 . In this embodiment, collection devices 131 - 136 send data to transmission server 120 and collection devices 137 - 142 send data to transmission server 125 . In addition, when data has already been collected, the collection devices 131 to 142 may transmit the collected data without acquiring new data.

The transmission server 120 is a transmission server that transmits data transmitted from the collection devices 131 to 146 to the collection system 150 , and the transmission server 125 transmits data transmitted from the collection devices 137 to 142 to the collection system 155 . is the server. The transmission servers 120 and 125 are configured by, for example, an HTTP (HyperText Transfer Protocol) server, an FTP (File Transfer Protocol) server, and an MQTT server.

The collection system 150 stores the data transmitted from the transmission server 120 in the storage unit 160 . When the collection system 150 stores the data transmitted from the transmission server 120 in the storage unit 160, the collection system 150 sends a data storage completion message indicating that the data has been stored in the storage unit 160, which is a message including a specific topic. Publish delivery to the MQTT Broker 110 together with the device information of the collection devices 131 to 136 .

FIG. 2 is an explanatory diagram showing data storage processing. FIG. 3 is a sequence diagram showing data storage processing. In step S100, the collection system 150 always subscribes to the MQTT Broker 110. FIG. In step S<b>110 , the management unit 100 always subscribes to the MQTT Broker 110 . Either of steps S100 and S110 may be performed first.

In step S<b>120 , the management unit 100 publishes a data transmission instruction message addressed to the collection device group 130 or the collection device 131 to the MQTT Broker 110 . In step S130, the collection device 131 acquires from the MQTT Broker 110 the self-addressed data transmission instruction message published to the MQTT Broker 110 while it is subscribed to the MQTT Broker 110. FIG.

In step S140, the collection device 131 collects data. In step S<b>150 , the collection device 131 transmits the data and its own device information to the transmission server 120 . Note that the collecting device 131 omits step S140, and transmits the collected data and its own device information at the time of acquiring the self-addressed data transmission instruction message published to the MQTT Broker 110 from the MQTT Broker 110. It may be sent to server 120 . In step S<b>160 , the transmission server 120 transmits the data and the device information of the collection device 131 to the collection system 150 .

In step S170, the collection system 150 associates the data with the device information of the collection device 131 and stores the data in the storage unit 160. FIG. In step S<b>180 , the collection system 150 publishes a data storage completion message to the MQTT Broker 110 together with the device information of the collection device 131 to indicate that the data has been stored in the storage unit 160 .

In step S190, when the management unit 100 detects/acquires that the data storage completion message has been published to the MQTT Broker 110 while being subscribed to the MQTT Broker 110, the process proceeds to step S200. In step S200, the management unit 100 stores the data storage completion message as management information.

FIG. 4 is an explanatory diagram showing the flow of instructions and data in the data management system 10. As shown in FIG. A data transmission instruction flows as a message from the management unit 100 to the MQTT Broker 110 and the collection device 131, data flows from the collection device 131 to the collection system 150 via the transmission server 120, and a data storage completion message is sent from the collection system 150. As it flows through the MQTT Broker 110, messages and data flow in one direction in a loop, not in the other direction.

As described above, according to the present embodiment, the collection devices 131 to 142 of the collection device group 130 subscribe to and access the MQTT Broker 110, and detect and acquire data transmission instructions published to the MQTT Broker 110 as messages. Since the MQTT Broker 110 does not directly access the collection devices 131-142, the security of the collection device group 130 and the collection devices 131-142 when collecting data from the collection device group 130 and the collection devices 131-142 can be improved.

According to this embodiment, the MQTT Broker 110 acquires the device information of the collection devices 131 to 142 when subscribed from the collection devices 131 to 142 of the collection device group 130 . As a result, the MQTT Broker 110 can perform life and death monitoring of the collection devices 131-142. In addition, the management unit 100 can acquire the results of life-and-death monitoring of the collection devices 131 to 142 from the MQTT Broker 110, or determine the data collection status.

In this embodiment, the data management system 10 comprises two collection systems 150,155. Each of the collection systems 150 and 155 stores data in storage units 160 and 165, respectively. It may be a configuration provided. In addition, the collection systems 150 and 155 may obtain relationships between the data instead of the data itself and store them in the storage units 160 and 165 . The collection systems 150 and 155 may also detect anomalies from data and publish them to the MQTT Broker 110 . Also, the two collection systems 150, 155 may be configured differently. Also, in this embodiment, a plurality of collection devices 131 to 142 are provided, but the configuration may be such that only one collection device is provided.

In this embodiment, the aggregating units 170 and 175 are composed of transmission servers 120 and 125, collection systems 150 and 155, and storage units 160 and 165, respectively. It may be composed of individual computer devices. For example, the aggregating units 170 and 175 may be configured as a diagnosis system that judges abnormality/normality and outputs/stores the result.

In the present embodiment, the management unit 100 is always subscribed to the MQTT Broker 110, and the collection devices 131 to 142 are always subscribed to the MQTT Broker 110, but they do not have to be always subscribed. The collecting devices 131 to 142 may subscribe to the MQTT Broker 110 at predetermined intervals, or receive instructions from other higher-level devices in the factory 200 to subscribe. Note that messages published to the MQTT Broker 110 during a period when the management unit 100 and the collection devices 131 to 142 are not subscribed to the MQTT Broker 110 are not subscribed to by the management unit 100 and the collection devices 131 to 142 after that. but can't get it. Therefore, it is preferable that the management unit 100 and the collection devices 131 to 142 establish a subscribe connection during a period when there is a possibility that the message will be published.

The present disclosure is not limited to the embodiments described above, and can be implemented in various configurations without departing from the scope of the present disclosure. For example, the technical features of the embodiments corresponding to the technical features in each form described in the Summary of the Invention column are used to solve some or all of the above problems, or to achieve some of the above effects. Or in order to achieve all, it is possible to perform substitution and combination suitably. Also, if the technical features are not described as essential in this specification, they can be deleted as appropriate.

DESCRIPTION OF SYMBOLS 10... Data management system, 100... Management part, 110... MQTT Broker, 120, 125... Transmission server, 130... Collection equipment group, 131-142... Collection equipment, 150, 155... Collection system, 160, 165... Storage part, 170, 175... Aggregation part

Claims (5)

A data management system,
a collection device that outputs the collected data;
a management unit that manages the collecting device;
an aggregating unit for aggregating the data output by the collecting device;
Messages distributed by any one of the management unit, the collecting device, and the aggregating unit are sent to the managing unit, the collecting device, and the aggregating unit, using sorting using topics. A distribution unit that mediates by the MQTT method that other devices acquire by themselves;
with
The distributing unit uses topic-based sorting for the managing unit, the collecting device, and the aggregating unit so that any one of the managing unit, the collecting device, and the aggregating unit is connected by the MQTT method in which other devices themselves acquire messages to be delivered to the delivery unit,
When the collection device detects that the message distributed from the management unit to the distribution unit is a data transmission instruction addressed to the collection device using the topic specified by the collection device, the collection unit collects the message. send said data obtained from
When the aggregation of the data is completed, the aggregating unit delivers a completion message specified using the topic specified by the management unit to the delivery unit;
When the management unit detects that the completion message has been delivered from the aggregation unit to the delivery unit, the management unit determines that the collection device is ready to respond.
Data management system. A data management system according to claim 1, wherein
The aggregating unit is
a collection system having a storage unit and storing the data in the storage unit;
a transmission server that transmits the data from the collection device to the collection system;
with
The data management system, wherein the collection system distributes the completion message to the distribution unit when the data is stored in the storage unit. A data management system according to claim 1 or claim 2,
The data management system, wherein the collection device connects to the distributor using a specific input port of the distributor. The data management system according to any one of claims 1 to 3,
A data management system according to claim 1, wherein said delivery unit acquires device information of said collection device when connected from said collection device, and performs life-and-death monitoring of said collection device. A data management method comprising:
The management unit and the collection device are each connected to the distribution unit by the MQTT method so that messages sorted using specific topics can be detected,
When the collecting device detects that a data transmission instruction message addressed to the collecting device, which is a specific topic, has been distributed from the management unit to the distribution unit while being connected to the distribution unit by the MQTT method, send the data to the aggregator,
After aggregating the data, the aggregating unit delivers a completion message indicating that the data of a specific topic has been aggregated to the delivery unit;
When the completion message is delivered to the delivery unit while being connected to the delivery unit by the MQTT method, the management unit detects the message and determines that the collection device is ready to respond.
Data management method.

Images