JP4237599B2 - Data collection device, data collection method, and data collection program - Google Patents

Description

  The present invention is a data collection device that collects data acquired by a device connected via a network, a data collection method that is executed by the data collection device, and a data collection device that is used to realize the data collection device. Related data collection programs.

  When remote monitoring is performed by collecting data acquired by a device from a device connected via a network, the monitoring device is in the device as if it were accessing the memory in its own computer. It is conceivable to use a method of accessing the memory and reading data.

  Although this method is an extremely simple method, there is a problem that a loss of data to be collected cannot be avoided when the reliability of the network is low.

  In other words, for example, when data is collected according to a specified collection cycle, if a network failure occurs in the middle of a certain collection cycle, data in that collection cycle cannot be collected, so avoid missing data to be collected. It is not possible.

  Therefore, in the prior art, without using such a method, a device functioning as a monitored device is provided with a computer function such as a personal computer, and data to be monitored on the device side. Data stored using a high-performance file transfer protocol (FTP) that has a resending function, etc., for the device that is to be monitored by the device to be monitored using its computer function. Is used.

For example, even in the remote management system disclosed by the present applicant, a configuration is adopted in which a personal computer that acquires status information from a device to be monitored is prepared, and the personal computer is connected to a remote management server connected via a network. On the other hand, the acquired state information is transmitted (for example, refer to Patent Document 1).
JP2002-223383A

  However, according to such a conventional technique, since it is necessary to provide a computer function such as a personal computer on the side of the device to be monitored, the device to be monitored may have a simple configuration. In addition, there is a problem that it is necessary to have a computer function such as a personal computer, and it must be expensive.

  Furthermore, since the data to be monitored are transmitted together, there is a problem that the data collection cycle becomes long and the real-time property is lacking.

  The present invention has been made in view of such circumstances, and when performing processing for collecting data acquired by a device connected via a network, while following a simple configuration, the data The purpose is to provide a new data collection technology that enables data to be collected without incurring any omissions.

The data collection device of the present invention performs processing for collecting data acquired by a device connected from a device via a network. The data collection device follows a simple configuration and does not cause data loss. (B) holding means for holding the acquisition date / time information of the most recently acquired data included in the data collected so far, and (b) the device that is the data collection destination in contrast, to request the transmission of the resulting data already collected by the specified number shall be the starting point latest acquired data acquired by the device, is added to the data sent in response to the request According to the acquisition date and time information and the acquisition date and time information held by the holding means, it is determined whether or not the data collected so far has been transmitted, and when determining that it has not been transmitted, By repeating to request transmission of data specified number following the requested data, the collection means for collecting data acquired later than acquisition date and time held in the hold means, the collection of (c) collection means Updating means for identifying the acquisition date and time of the most recently acquired data from among the data according to the acquisition date and time information attached to the data, and updating the acquisition date and time information held by the holding means accordingly ( D) If duplicate data is included in the data collected by the collecting means, remove it, and if the collected data is already contained in the data collected by the collecting means, remove it. And removing means for removing.

When adopting this configuration, the collecting means follows the acquisition date / time information added to the data transmitted from the device as the data collection destination up to the data to which the acquisition date / time information held by the holding means is added. number to predict, and when the number was the predicted is less than the specified number of the may require the transmission of the next data according to the predicted number of its.

  The data collection method of the present invention realized by the operation of each of the above processing means can be realized by a computer program, and this computer program is provided by being recorded on an appropriate recording medium such as a semiconductor memory. Alternatively, the present invention is realized by being provided via a network, installed when the present invention is carried out, and operating on a control means such as a CPU.

  When realizing the present invention, when a device that is a data collection destination acquires data according to, for example, a specified acquisition cycle, it adds acquisition date / time information to the data and stores it in the memory in its own device according to the acquisition order. Process as you go.

In response to this, the data collection device of the present invention constructed as described above, collecting means, for example, reaches the collection period prescribed, for example, to apparatus as a data acquisition destination, is acquired by the device acquired and the latest acquisition data requests transmission of data already acquired the specified number as a starting point, and the acquisition date and time information added to the data sent in response to the request, for holding the retaining means If it is determined whether or not the data collected so far has been transmitted according to the date and time information, and if it is determined that the data has not been transmitted, transmission of a specified number of data following the previously requested data Repeat requesting.

  In this way, the collection unit collects data acquired after the acquisition date and time held by the holding unit, thereby realizing data collection without causing data loss.

  Then, in response to the data collection by the collecting means, the updating means specifies the acquisition date and time of the most recently acquired data from the data according to the acquisition date and time information added to the data collected by the collecting means. Accordingly, the acquisition date information held by the holding means is updated accordingly.

  With this data collection processing, the data collection device of the present invention collects data acquired by a device connected via a network as if it accesses the memory in its own computer. As described above, even if data is collected by accessing the memory in the device, the data collection can be realized without causing data loss.

  According to the present invention, when data acquired by a device is collected from a device connected via a network, the memory in the device is as if the memory in the computer is accessed. Even if the data is collected by accessing the data, the data can be collected without incurring the loss of data. Data can be collected.

  Hereinafter, the present invention will be described in detail according to embodiments.

  FIG. 1 illustrates an example of a system configuration of a remote monitoring system to which the present invention is applied.

  As shown in this figure, a remote monitoring system to which the present invention is applied is connected to one or a plurality of processing devices 1 for executing a prescribed process such as combustion control and the processing device 1 via the Internet 3. The remote monitoring device 2 that performs processing for monitoring the processing device 1 by collecting data acquired by the processing device 1 is configured.

  FIG. 2 illustrates an example of the device configuration of the processing device 1, and FIG. 3 illustrates an example of the device configuration of the remote monitoring device 2.

  As shown in FIG. 2, the processing device 1 acquires a buffer 10 for temporarily storing data to be transmitted to the remote monitoring device 2, a clock unit 11 for marking the date and time, and data to be transmitted to the remote monitoring device 2. A data acquisition unit 12 stored in the buffer 10 and a data transmission unit 13 that reads data from the buffer 10 and transmits the data to the remote monitoring device 2 in response to a data request from the remote monitoring device 2.

  On the other hand, as shown in FIG. 3, the remote monitoring device 2 includes the data collection unit 20 that collects data from the processing device 1 and the data acquired most recently by the processing device 1 included in the data collected so far. The collected latest date and time holding unit 21 that holds the acquired date and time information, the clock unit 22 that records the date and time, the data storage unit 23 that stores the data collected by the data collection unit 20, and the data storage unit 23 And a monitoring execution unit 24 that executes a prescribed monitoring process according to the data.

  FIG. 4 illustrates an example of a processing flow executed by the data acquisition unit 12 included in the processing device 1, and FIG. 5 illustrates an example of a processing flow executed by the data collection unit 20 included in the remote monitoring device 2.

  Next, according to these processing flows, the present invention will be described in detail. Initially, the process which the data acquisition part 12 with which the processing apparatus 1 is provided is demonstrated.

  When the data acquisition unit 12 included in the processing device 1 is activated by, for example, reaching a specified acquisition period set every minute, as shown in the processing flow of FIG. The data to be transmitted to the remote monitoring device 2 is acquired.

  Subsequently, in step 11, the current acquisition date and time is obtained from the clock unit 11. Subsequently, in step 12, the data stored in the buffer 10 is shifted one by one to make a free space in the top memory area. Subsequently, in step 13, the acquired data is written into the top memory area of the buffer 10 together with the acquired acquisition date / time information.

  In this way, when the data acquisition unit 12 included in the processing device 1 is activated upon reaching the specified acquisition cycle, the data stored in the buffer 10 is shifted one by one as shown in FIG. As a result, a space is created in the top memory area, and the data acquired this time is written together with information on the acquisition date and time.

  According to the processing of the data acquisition unit 12, the buffer 10 included in the processing device 1 acquires the data to be transmitted to the remote monitoring device 2 from the top in accordance with the new acquisition order, as shown in FIG. It will be stored with the date and time information.

  Next, processing executed by the data collection unit 20 included in the remote monitoring device 2 will be described.

  When the data collection unit 20 included in the remote monitoring device 2 is activated, for example, by reaching a specified collection cycle set every 5 minutes, as shown in the process flow of FIG. Thus, the collected latest date and time information (acquired date and time information of the data acquired most recently by the processing device 1 included in the data collected so far) is read from the collected latest date and time holding unit 21.

  Subsequently, in step 21, “0” is set to a variable offset indicating the number of data from the head of the buffer 10. That is, “0” is set to the variable offset defined in the form as shown in FIG.

  Subsequently, in step 22, an attempt is made to read N data from the buffer 10, with a position that is offset from the head address of the buffer 10 as a reading start position.

  That is, for example, using HTTP, the processing device 1 specifies the start address of the buffer 10, the offset value indicating the number of data from the start of the buffer 10, and the number of requested data. Issuing a transmission request, and receiving data returned from the data transmission unit 13 of the processing apparatus 1 in response to the issuance, N pieces of data with a position that is offset from the head address of the buffer 10 as a reading start position It tries to read.

  In this way, the data collection unit 20 performs processing to access the buffer 10 of the processing device 1 and collect data as if it were accessing the memory in its own computer.

  Here, for example, the number of data to be acquired by the processing device 1 during the collection period is set as the N pieces. For example, when the data collection unit 20 collects data according to the collection cycle every 5 minutes and the data acquisition unit 12 obtains data according to the acquisition cycle every minute, 5 is set as N. It will be.

  At step 22, when it is attempted to read N pieces of data with a position offset from the head address of the buffer 10 as a reading start position, subsequently, at step 23, it is determined whether or not this reading is successful, When it is determined that this reading has failed, it is determined that a failure has occurred in the Internet 3 or the like, and the processing in this collection cycle is terminated.

  On the other hand, when it is determined in step 23 that the reading has succeeded, the process proceeds to step 24 where the oldest acquisition date / time information is specified from the acquisition date / time information of the read data.

  Subsequently, in step 25, whether or not data having the latest collected date / time has been read from the information on the oldest acquisition date / time specified and information on the latest collected date / time read from the collected latest date / time holding unit 21. When it is determined that the data having the collected latest date and time has not been read, the process proceeds to step 26, the variable offset value is incremented by N, and the process returns to step 22.

  That is, a failure has occurred in the Internet 3 or the like in the previous collection cycle (which may include a previous collection cycle), and as a result, reading of data from the processing device 1 has failed. If the data having the latest collected date / time cannot be read only by reading N data in the collection cycle, the variable offset value is incremented by N and then the process returns to step 22 to return the data having the latest collected date / time. Processing is performed so as to read the data up to.

  On the other hand, when it is determined in step 25 that the data having the latest collected date and time has been read, the process proceeds to step 27 to remove duplicate data from the data read in the current collection cycle, and the current collection cycle. After the data read in the previous collection cycle is removed from the data read in step (b), the read data is written in the data storage unit in the order of the acquisition date and time.

  That is, when new data to be stored in the buffer 10 is generated on the processing apparatus 1 side during data collection in the current collection cycle, the data is stored in the buffer 10 as described in FIG. As a result, data that is read in the current collection cycle is duplicated. Therefore, such duplicate data is removed. Then, since data older than the data having the latest collected date and time is read in the current collection cycle, such already read data is removed.

  Subsequently, in step 28, the latest acquisition date / time information is specified from the acquisition date / time information of the data read in the current collection cycle, and is written in the collected latest date / time holding unit 21 for processing. Exit.

  In this way, when the data collection unit 20 included in the remote monitoring device 2 is activated by reaching the specified collection cycle, the latest acquisition data is sent to the processing device 1 as shown in FIG. Requests transmission of N pieces of acquired data as starting points (N = 5 in the example of FIG. 7), holds acquisition date / time information of data transmitted in response to the request, and holds the latest collected date / time If it is determined whether or not the data collected so far has been read according to the collected latest date and time information held by the unit 21, and if it is determined that the data has not been read, N following the previously requested data By repeatedly requesting transmission of individual data, processing is performed so as to collect data acquired after the collected latest date and time held by the collected latest date and time holding unit 21.

  According to this data collection processing, according to the remote monitoring device 2 of the present invention, when remote monitoring is performed by collecting data acquired by the processing device 1 from the processing device 1 connected via the network 3. Thus, even if data is collected by accessing the buffer 10 of the processing device 1 as if the memory in the computer is accessed, the data collection can be realized without causing data loss. As a result, the data collection method can be used, so that data can be collected according to a simple configuration.

  FIG. 8 and FIG. 9 show another example of the processing flow executed by the data collection unit 20 provided in the remote monitoring device 2.

  The processing flow of FIGS. 8 and 9 is different from the processing flow of FIG. 5 in that processing of step 26a to step 26g is performed between step 26 to step 27 of the processing flow of FIG.

  When the data collection unit 20 included in the remote monitoring device 2 follows the processing flow of FIG. 5, as shown in FIG. 7, N pieces of data are read from the buffer 10 of the processing device 1. When the processing flow of FIGS. 8 and 9 is followed, the number of data up to the data having the collected latest date and time is predicted, and when the predicted number of data is smaller than N, the predicted number I read the data.

  When the processing device 1 acquires data according to a specified acquisition cycle, it can be predicted how many pieces of data will be read until the data having the latest collected date and time is read. It is processed to read the data.

  That is, when the data collection unit 20 included in the remote monitoring device 2 follows the processing flow of FIG. 8 and FIG. 9, the data collection unit 20 performs the same processing as Step 20 to Step 23 of the processing flow of FIG. When the information on the oldest acquisition date and time of the read data is specified, it is determined whether or not the data having the latest collected date and time has been read in the following step 25, and the data having the latest collected date and time is read. When it is determined that there is not, the routine proceeds to step 26 where the value of the variable offset is incremented by N.

  Next, in step 26a, the number of data from the specified oldest acquisition date and time interval between the acquisition date and time of the read data to the data having the collected latest date and time is predicted, and in step 26b, the prediction is made. When it is determined whether the number of data exceeds N, and when it is determined that the number exceeds N, the process returns to step 22 as it is.

  On the other hand, when it is determined in step 26b that the predicted number of data does not exceed N, the process proceeds to step 26c, and the position that is offset from the head address of the buffer 10 is set as the reading start position, and the predicted number of data from the buffer 10 is determined. Attempts to read data.

  Subsequently, in step 26d, it is determined whether or not the reading has been successful. When determining that the reading has failed, it is determined that a failure has occurred in the Internet 3 or the like, and processing in this collection cycle is performed. Exit.

  On the other hand, when it is determined in step 26d that the reading is successful, the process proceeds to step 26e, and the oldest acquisition date / time information is specified from the acquisition date / time information of the read data.

  Subsequently, in step 26f, whether or not the data having the latest collected date / time has been read from the information of the identified oldest acquisition date / time and the collected latest date / time information read from the collected latest date / time holding unit 21. When it is determined that the data having the collected latest date and time has not been read, the process proceeds to step 26g, the variable offset value is incremented by N, and then the process returns to step 22.

  On the other hand, when it is determined in step 26f that the data having the latest collected date and time has been read, the process proceeds to step 27, where duplicate data is removed from the data read in the current collection cycle, and the current collection cycle. After the data read in the previous collection cycle is removed from the data read in step (b), the read data is written in the data storage unit in the order of the acquisition date and time.

  Subsequently, in step 28, the latest acquisition date / time information is specified from the acquisition date / time information of the data read in the current collection cycle, and is written in the collected latest date / time holding unit 21 for processing. Exit.

  When it is determined in step 25 that the data having the latest collected date and time has been read, the process similarly proceeds to step 27 to remove duplicate data from the data read in the current collection cycle. After the data read in the previous collection cycle is removed from the data read in the collection cycle, the read data is written in the data storage unit 23 in the order of the acquisition date and time.

  Then, in the following step 28, the latest acquisition date information is specified from the acquisition date information of the data read in the current collection cycle, and it is written in the collected latest date storage unit 21 for processing. Exit.

  In this way, the data collection unit 20 included in the remote monitoring device 2 predicts the number of data up to the data having the collected latest date and time when following the processing flow of FIG. 8 and FIG. When the number is smaller than N, the predicted number of data is read.

  Needless to say, even when the predicted number of data is larger than N, the predicted number of data may be read. Even if the predicted number of data is deviated, no problem occurs because the subsequent data is read.

  When the data acquisition unit 12 included in the processing device 1 follows the processing flow of FIG. 4, the data stored in the buffer 10 is shifted one by one as shown in FIG. A space is created, and the data acquired this time is processed to be written together with the information of the acquisition date and time, but a writing method other than the writing method to the buffer 10 can be used. .

  For example, as shown in FIG. 10, it is also possible to use a writing method to the buffer 10 in which data is written in a memory area indicated by a write pointer (WP shown in the figure). In this case, the data acquisition unit 12 of the processing device 1 writes the acquired data in the memory area pointed to by the write pointer, and shifts the write pointer one by one in accordance with the writing, instead of the processing flow of FIG. 11 is executed.

  When the ring buffer type writing method as shown in FIG. 10 is used, the data collection unit 20 included in the remote monitoring device 2 transmits data based on the write pointer instead of the head address of the buffer 10. However, it is not necessary to know the specific position of the write pointer, and it is only necessary to request transmission of data based on the write pointer.

  Further, the data collection unit 20 included in the remote monitoring device 2 performs processing so as to read data from the buffer 10 included in the processing device 1 in the form shown in FIG. However, without introducing the concept of offset, processing may be performed so that data is read from the buffer 10 included in the processing device 1 in the form shown in FIG. .

  The present invention can be applied to various remote monitoring apparatuses that manage monitoring of devices connected via a network.

It is a system configuration diagram of a remote monitoring system to which the present invention is applied. It is an apparatus block diagram of a processing apparatus. It is an apparatus block diagram of a remote monitoring apparatus. It is a processing flow which the data acquisition part with which a processing apparatus is provided performs. It is a processing flow which the data collection part with which a remote monitoring apparatus is provided performs. It is explanatory drawing of the process which the data acquisition part with which a processing apparatus is provided performs. It is explanatory drawing of the process which the data collection part with which a remote monitoring apparatus is provided is performed. It is a processing flow which the data collection part with which a remote monitoring apparatus is provided performs. It is a processing flow which the data collection part with which a remote monitoring apparatus is provided performs. It is explanatory drawing of the data writing method to a buffer. It is a processing flow which the data acquisition part with which a processing apparatus is provided performs. It is explanatory drawing of the process which the data collection part with which a remote monitoring apparatus is provided is performed.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Processing apparatus 2 Remote monitoring apparatus 3 Internet 10 Buffer 11 Clock part 12 Data acquisition part 13 Data transmission part 20 Data collection part 21 Collected latest date and time holding part 22 Clock part 23 Data storage part 24 Monitoring execution part

Claims (7)

In a data collection apparatus that collects data acquired by a device from a device connected via a network,
Holding means for holding the acquisition date information of the most recently acquired data included in the data collected so far;
And to the device, adding to the transmission of the resulting data already collected by the specified number shall be the starting point latest acquired data acquired by the device to request, sent in response to the request data When determining whether or not the data collected so far has been transmitted according to the acquired acquisition date and time information and the acquisition date and time information held by the holding means, and determining that it has not been transmitted by repeating the request the transmission of data specified number following the data requested earlier, collecting means for collecting data acquired later than acquisition date and time for holding the upper Symbol holding means,
According to the acquisition date / time information added to the data collected by the collection means, the acquisition date / time of the most recently acquired data is specified from those data, and the acquisition date / time information held by the holding means is updated accordingly. Providing an updating means to
Characteristic data collection device. The data collection device according to claim 1 ,
The collection means predicts the number of data to which the acquisition date / time information held by the holding means is added according to the acquisition date / time information added to the data transmitted from the device , and the predicted number the but if less than the specified number is, to request transmission of the next data according to the predicted number of its,
Characteristic data collection device. In the data collection device according to claim 1 or 2 ,
If duplicate data is included in the data collected by the collecting means, remove it, and if the collected data is already contained in the data collected by the collecting means, remove it. Having a removal means to remove,
Characteristic data collection device. A data collection method executed by a data collection apparatus that collects data acquired by a device from a device connected via a network,
Reading the acquisition date / time information from the holding means for holding the acquisition date / time information of the most recently acquired data included in the data collected so far;
And to the device, adding to the transmission of the resulting data already collected by the specified number shall be the starting point latest acquired data acquired by the device to request, sent in response to the request data When determining whether or not the data collected so far has been transmitted according to the acquired acquisition date and time information and the acquisition date and time information held by the holding means, and determining that it has not been transmitted by repeating the request the transmission of data specified number following the data requested earlier, the process of collecting the acquired later than acquisition date and time read on SL data,
According to the acquisition date and time information added to the collected data, identifying the acquisition date and time of the most recently acquired data from those data, and updating the acquisition date and time information held by the holding means accordingly Having
Characteristic data collection method. The data collection method according to claim 4 ,
In the collecting process, according to the acquisition date / time information added to the data transmitted from the device, the number of data to which the acquisition date / time information held by the holding means is added is predicted, and the prediction when the number was less than the specified number is, the request child transmission of the next data according to the number obtained by the prediction,
Characteristic data collection method. A data collection program used for realizing a data collection device that collects data acquired by a device connected from a device via a network,
A process of reading the acquisition date / time information from the holding means for holding the acquisition date / time information of the most recently acquired data included in the data collected so far;
And to the device, adding to the transmission of the resulting data already collected by the specified number shall be the starting point latest acquired data acquired by the device to request, sent in response to the request data When determining whether or not the data collected so far has been transmitted according to the acquired acquisition date and time information and the acquisition date and time information held by the holding means, and determining that it has not been transmitted by repeating the request the transmission of data specified number following the data requested earlier, the process of collecting data acquired later than acquisition date and time read on reporting,
According to the acquisition date information added to the collected data, a process for identifying the acquisition date and time of the most recently acquired data from those data and updating the acquisition date and time information held by the holding means accordingly A data collection program that causes a computer to execute. The data collection program according to claim 6 ,
In the collecting process, according to the acquisition date / time information added to the data transmitted from the device, the number up to the data to which the acquisition date / time information held by the holding unit is added is predicted, and the prediction when the number was less than the specified number is, the request child transmission of the next data according to the number obtained by the prediction,
A featured data collection program.

Images