JP5383061B2 - Data processing apparatus, communication system, data processing method, and program - Google Patents

Description

  The present invention relates to a communication system, and more particularly to a system that periodically collects and processes data from a plurality of devices in one computer apparatus.

  As a system for aggregating data from a plurality of devices, for example, there is a system described in JP-A-7-85165.

In the above publication, each device (referred to as master device M, slave device S1, slave device S2, and slave device S3) has a plurality of data A, B, C, and D, respectively. An efficient way to collect all data A, B, C, D from the device is disclosed.
Specifically, for data A, slave device S1 serves as a collection control station, and collects data from other devices (M, S2, S3).
At the same time, for data B, slave device S2 collects from other devices M, S1, S3, and for data C, slave device S3 collects from other devices M, S1, S2, and so on. Different devices act as collection control stations and collect data.
Then, by transmitting the data collected by each device (slave device) to the master device M, collection of all data in the master device M is completed.
With this method, rather than one master device M collecting each data from each device, each slave device collects data in parallel, thereby collecting data in a short time.
Japanese Patent Laid-Open No. 7-85165

In the prior art, it can be equated that small data is not processed many times, but is processed into a large chunk of data once in a slave device and processed a small number of times.
As a result, the network load increases due to the flow of large data, and resources of the master device for receiving and processing large data (for example, a memory for processing and storing data and a CPU (Central Processing Unit for large-scale data processing) ) Etc.) will need to be increased.
Therefore, this method has a problem that data cannot be collected from a large number of devices due to an increase in network load and a shortage of resources of the master device.

Therefore, even when data is regularly collected from a large number of devices, a method is required that is unlikely to cause an increase in network load or a shortage of resources in the master device.
The main object of the present invention is to solve the above-mentioned problems, and periodically collects data from a large number of devices without causing an increase in network load or a shortage of resources of the master device. The main object is to realize a communication system that can handle such a situation.

The data processing apparatus according to the present invention
A data processing device connected to a data collection device that collects data for each of a plurality of types of data collection items, and a management device that manages the collected data collected by the data collection device,
A first communication unit that receives a collection data output request in which the transmission timing of the collection data is designated as the designated transmission timing for each data collection item from the management device;
A collection data transmission request generation unit that generates a collection data transmission request for requesting the data collection device to transmit collected data collected for each data collection item;
A second communication unit that transmits the collection data transmission request to the data collection device and receives collected data for each data collection item from the data collection device as a response to the collection data transmission request;
The transmission timing of the collected data received from the data collection device is determined according to the designated transmission timing indicated in the collection data output request for each data collection item, and the collected data is determined And a transmission timing determination unit for transmitting to the management device via the first communication unit.

According to the present invention, transmission timing is determined for each data collection item, data that needs immediate transmission can be transmitted immediately, and data that can be batch-transmitted can be integrated and transmitted after accumulation, so batch transmission The amount of data at the time can be suppressed, and collected data from a large number of devices can be transmitted without causing the problem of an increase in network load and a shortage of resources.
.

Embodiment 1 FIG.
The system configuration diagram (FIG. 1), device information table (FIG. 2), batch data collection command format (FIG. 3), batch data collection result (immediate) format (FIG. 4), batch data collection result (FIG. 1) Batch) format (FIG. 5), individual data collection command format (FIG. 6), individual data collection result format (FIG. 7), batch data collection command format (FIG. 8), sequence diagram (FIG. 9), master device functions A description will be given with reference to the configuration diagram (FIG. 10), the flowchart diagram (FIG. 11), and the functional configuration diagram of the computer apparatus (FIG. 12).

  As shown in the system configuration diagram of FIG. 1, a computer device (1) for data collection (hereinafter also simply referred to as a computer) and devices (2a, 2b... 2z) for data collection are connected to a network such as the Internet ( 3) through network cables (4a, 4b).

  In the present embodiment, the computer (1) is intended for a data collection system that periodically collects operation data and the like from a plurality of devices (2a, 2b...).

Each device (2) collects data for each of a plurality of types of data collection items.
Each device (2) is an example of a data collection device.
Further, a specific device among the plurality of devices (2) is set as a master device. In the example of FIG. 1, the device (2a) is a master device.
The master device is an example of a data processing device. For this reason, the device 2a which is a master device functions as a data collection device and a data processing device.
Devices (2b to 2z) other than the master device 2a are referred to as slave devices.

The master device (2a) receives a command (collected data output request) from the computer (1) and requests each device (2) to transmit collected data collected for each data collection item. Command (collected data transmission request) is transmitted, and collected data for each data collection item is received from each device (2) as a response. Then, the master device (2a) classifies the received collection data for each data collection item, and determines the transmission timing of the received collection data to the computer (1) for each data collection item from the command from the computer (1). Are determined according to the transmission timing (designated transmission timing) shown in (1), and each collected data is transmitted to the computer (1) at the determined transmission timing.
Specifically, in the command from the computer (1), the collected data for the data collection item designated to be transmitted immediately after reception from each device (2) is transmitted to the computer (1), and the computer (1 The collected data for the data collection item designated to be transmitted after the accumulation in the command from) is accumulated. Then, when a command for requesting transmission of the accumulated collected data (accumulated collection data output request) is received, the accumulated collected data is transmitted to the computer (1).

The computer (1) manages the collected data collected by each device (2).
The computer (1) is an example of a management device.
For each data collection item, the computer (1) designates the collection data transmission timing as the designated transmission timing, transmits a command (collection data output request) requesting the master device (2a) to transmit the collection data, Collected data is received from the device (2a).
In addition, as the designated transmission timing, it is specified that any data collection item is transmitted immediately after the collected data is received from each device (2), and each device ( Specifies that the collected data received after collecting the collected data from 2) is transmitted after being accumulated.
For the collected data accumulated in the master device (2a), a command (accumulated collection data output request) requesting transmission of the accumulated collected data is transmitted and accumulated from the master device (2a). Receive collected data.

As shown in the device information table of FIG. 2, the computer (1) has a device information table (100) that holds information on the device (2) that collects data.
The device information table becomes a master when collecting a device ID (101) for identifying a device, an address (102) such as a DNS (Domain Name System) or IP (Internet Protocol) address for accessing the device, and data. It consists of a master device ID (103) indicating the device. A device whose master device ID (103) matches the device ID (101) operates as a master device.

The outline of data collection is as follows.
The computer (1) issues a batch data collection command (200) (FIG. 3) to the master device (2a).
The master device (2a) that has received it issues an individual data collection command (300) (FIG. 6) to each slave device (2a, 2b, 2c (the device 2a operates as both a master and a slave)). To do.
Each slave device (2) receiving it measures, creates and collects data according to the command (300), and returns the individual data collection result (310) (FIG. 7) to the master device.
Collecting these data, the master returns the batch data collection result (immediate) (210) (FIG. 4) or the batch data collection result (batch) (220) (FIG. 5) to the computer (1).
The computer (1) can periodically collect data by periodically issuing the batch data collection command (200). For example, by carrying out every 5 minutes, it is possible to obtain a transition of the operating state of the device and a trend of temperature data every 5 minutes.

Next, the data format will be described.
As shown in the collective data collection command format of FIG. 3, the collective data collection command (200) includes a master device ID (201) for which data collection is requested, a slave device ID list (202) connected to the master, and data to be collected. It consists of a list of pairs of name (203) and its data collection type (204).
The data name (203) designates the name of the data to be collected (data collection item), and the data collection type (204) designates whether the data is collected immediately or collected in batches later. Has information (designated transmission timing).

As shown in the collective data collection result (immediate) format of FIG. 4, the collective data collection result (immediate) (210) is a pair of the collected device ID (211) and a specific result data value (212). It consists of a list of
There are as many result data columns as the number of data to be collected, and there are as many pairs of these data as there are devices.
At this time, not only the value of the result data but also the data name may be included.
Note that the data name shown here includes only the result of data indicated as “immediate” in the data type (204) in the batch data collection command (200).

As shown in the collective data collection result (batch) format of FIG. 5, the collective data collection result (batch) (220) is a pair of a collected device ID (221) and a specific result data value (222). Consists of an array of lists.
There are as many result data columns as the number of data to be collected, and there are as many pairs of these data as there are devices.
In addition, these data pairs exist as an array for the number of times of measurement.
At this time, not only the value of the result data but also the data name may be included.
The data name shown here includes only the result of the data indicated as “batch” in the data type (204) in the batch data collection command (200). Each data may include collected date and time information.

  As shown in the individual data collection command format of FIG. 6, the individual data collection command (300) is composed of a device ID (301) of the device (2) to be collected and a list of data names (302) to be collected. The The data may include collected date / time information.

As shown in the individual data collection result format of FIG. 7, the individual data collection result (310) is composed of a list of the device ID (311) of the device (2) to be collected and the value (312) of the collected data. The
At this time, not only the value of the result data but also the data name may be included. The data may include collected date / time information.

As shown in the batch batch data collection command format of FIG. 8, the batch batch data collection command (230) includes a device ID (231) of the device (2) to be collected and a command (232) meaning batch data collection. Consists of.
At this time, as with the collective data collection command (200), the slave device ID list, data name, and data type information may also be included.

  Next, a functional configuration example of the master device (2a) according to the present embodiment will be described with reference to FIG.

The batch data collection command receiving unit (401) receives a command from the computer (1).
The collective data collection command receiving unit (401) is an example of a first communication unit.
The command analysis unit (406) determines whether the command received by the batch data collection command reception unit (401) is the batch data collection command (200) (collection data output request) or the batch data collection command (230) (accumulated collection data). If it is a batch data collection command (200), an individual data collection command (300) (collected data transmission request) is generated.
In the case of the batch data collection command (200), the batch data collection command (200) is stored in the data collection command recording area (401-1).
The command analysis unit (406) is an example of a collected data transmission request generation unit.

The individual data collection command transmission unit (402) transmits an individual data collection command (300) to each device (2).
The result receiving unit (403) receives collected data as a response to the individual data collection command (300) from each device (2).
The individual data collection command transmission unit (402) and the result reception unit (403) are examples of the second communication unit.

The result analysis / integration unit (404) determines the transmission timing of the collected data received by the result receiving unit (403) from each device (2) to the computer (1) for each data collection item. It is determined according to the contents of the collective data collection command (200) in 401-1).
Collected data for immediate transmission is transmitted from the batch data transmission unit (405) to the computer (1), and collected data for batch transmission is stored in a batch processing data temporary recording area (404-1) (collected data storage unit). When the batch batch data collection command (230) is received from the computer (1), the collected data stored in the batch processing data temporary recording area (404-1) is transferred from the batch data transmission unit (405) to the computer ( To 1).
The result analysis / integration unit (404) is an example of a transmission timing determination unit.
The collective data transmission unit (405) transmits the collected data to the computer (1).
The batch data transmission unit (405) is an example of the first communication unit.

The data collection unit (407) collects data for each of the plurality of data collection items in the same manner as the slave device.
Note that the data collection unit (407) may be omitted if the master device (2a) does not play a role of data collection and only collects collected data from slave devices.

Next, a functional configuration example of the computer (1) will be described with reference to FIG.
The data collection command transmission and collection result receiving unit (501) transmits a batch data collection command (200) or a batch batch data collection command (230) to the master device (2a), and collects batch data from the master device (2a). The collection result (immediate) (210) or the collective data collection result (immediate) (220) is received.
The device information table (100) is the information shown in FIG.
The network resource and computer resource load measurement unit (502) will be described in the third embodiment.
In the computer (1) according to the present embodiment, it is assumed that the network resource and the computer resource load measurement unit (502) do not exist.

  Next, a detailed data collection mechanism will be described with reference to the sequence diagram of FIG. 9, the configuration diagram of the master device of FIG. 10, and the flowchart of data collection of the master device of FIG.

  First, the computer (1) looks at the device information table (100), and with respect to the device (2) whose master device ID (103) is the master, a collective data collection command (200) for data collection. Is issued using the data collection command transmission and collection result receiving unit (501).

In S1, the master device (2a) receives the command by the data collection command receiving unit (401) (first communication step).
Next, in S2, the received command is analyzed by the command analysis unit (406) to determine whether it is a batch data collection command (200) or a batch batch data collection command (230). In the case of the batch data collection command (200), the process proceeds to S3, and in the case of the batch batch data collection command (230), the process proceeds to S8-2.

In S3, the command analysis unit (406) records the batch data collection command (200) in the data collection command recording area (401-1).
In S4, the command analysis unit (406) creates an individual data collection command (300) corresponding to each slave device from the batch data collection command (200) (collected data transmission request generation step).
Next, in S5, the individual data collection command transmission unit (402) converts the individual data collection command (300) created by the command analysis unit (406) into the slave device ID list (200) described in the batch data collection command (200). 202) to each device (2b, 2c, etc.) (second communication step). At this time, it is also transmitted to itself (master device).

  Each slave device (2b, 2c) and master device (2a) receive the individual data collection command, collect the corresponding data, and transmit the collected individual data collection result (310) to the master device (2a).

Next, in S6, the result receiving unit (403) of the master device (2a) receives the individual data collection result (310) from each slave device (second communication step).
Next, in S7, the result analysis / integration unit (404) has the data collection type (204) information in the data collection command recording area (401-1) for the individual data collection result (310) from each slave device. The collected data is divided into immediate data and batch data, and the data collection type (immediate) (210) data is created from the data collection type immediately (transmission timing determination step).
If the data collection type is batch, it is recorded in the batch processing data temporary recording area (404-2).
In S8-1, the batch data transmission unit (405) transmits the batch data collection result (immediate) (210) to the computer (1).

  On the other hand, if it is determined in S2 that the command is a batch batch data collection command (230), in S8-2, the result analysis / integration unit (404) determines the batch processing data temporary recording area (404-2). Are integrated to create a batch data collection result (batch) (220), which is transmitted from the batch data transmission unit (405) to the computer (1).

  The computer (1) collects data by using the data collection command transmission and collection result receiving unit (501).

  As described above, according to the present embodiment, data that needs immediate transmission is classified into data that can be transmitted in batch, data that needs immediate transmission is transmitted immediately, and data that can be transmitted in batch is accumulated. Since it is decided to send the data after integration, the amount of data during batch transmission can be reduced, so that data can be regularly received from a large number of devices without causing problems such as an increase in network load and insufficient resources on the master device. It is possible to collect.

  As described above, in the present embodiment, in a system that collects device data regularly or irregularly from a computer, data is collected using a command including the name of the data to be collected and the data collection timing. A data collection system that performs

  In the present embodiment, as the collection timing, “immediately” that collects data simultaneously with command reception and transmits the collection result, and collects data simultaneously with command reception. A data collection system with two types of “batch” that transmits data for several times at once has been described.

  Further, in the present embodiment, the data collection system using the command for collecting the data stored several times on the device side has been described.

In this embodiment, in a system that collects data of a plurality of devices regularly or irregularly from a computer,
A master device having a communication function for receiving a collection command from a computer and sending the collected result to the computer;
A data collection system including a slave device having a communication function for receiving a collection command from a master device and sending the collected result to the master device has been described.

In this embodiment, in a system that collects data of a plurality of devices regularly or irregularly from a computer,
The data collection system having information on the master and slave devices that should collect data has been described based on the information table indicating the relationship between the master device held by the computer and a plurality of slave devices.

Embodiment 2. FIG.
The second embodiment will be described focusing on the difference from the first embodiment.
The difference from the first embodiment is that FIG. 3 “collective data collection command format”, FIG. 9 “sequence diagram”, and FIG. 11 “master device data collection flowchart” respectively show FIG. 13 “collective data collection command format 2”. FIG. 14 “sequence diagram 2” and FIG. 15 “master device data collection flowchart 2”.

Each difference is shown below.
As shown in FIG. 13, the batch data collection command format (200-1) according to the present embodiment is different from the batch data collection command format (200) of the first embodiment in the data collection condition (205) (transmission). Condition). This condition includes the number of times of reception of the batch data collection command format (200), the time, the data size of the data stored in the batch processing data temporary recording area (404-1), and the network with the computer (1). One or more conditions such as traffic conditions are specified.

  Accordingly, as shown in FIG. 14 “sequence diagram”, the batch data collection result (batch) (220) is not transmitted after receiving the batch batch data collection command (230), but is sent to the master device (2a). The result analysis / integration unit (404) constantly checks whether these conditions are satisfied (S9), and when these conditions are satisfied, the accumulated collection data is transmitted (S8-2).

For example, if “10 times” is described as the number of receptions of the batch data collection command format (200) as the data collection condition (205), the batch is collected after receiving the batch data collection command format (200) 10 times. The accumulated collection data accumulated in the processing data temporary recording area (404-1) is transmitted to the computer (1).
For example, when the data size of the data stored in the batch processing data temporary recording area (404-1) is described as the data collection condition (205), the batch processing data temporary recording area (404-1) When the data size of the data stored in () exceeds the threshold, the data stored in the batch processing data temporary recording area (404-1) is transmitted to the computer (1).

  Thus, according to the present embodiment, since the batch batch data collection command (230) is not transmitted from the computer (1), the network traffic can be reduced accordingly.

  As described above, in the present embodiment, as the collection timing, data is collected at the same time as the command is received, but after collecting the collected results, one or more of the designated number of measurements, the designated time, the designated size, etc. are stored. A data collection system that collects and transmits data when conditions are met has been described.

Embodiment 3 FIG.
The third embodiment will be described focusing on the differences from the first and second embodiments.
The difference between the first embodiment and the second embodiment is whether or not to use the network resource and computer resource load measurement unit (502) in FIG. 12 “Example of Functional Configuration of Computer Device”. Embodiment 1 and Embodiment 2 do not use this function.

The network resource and computer resource load measurement unit (502) constantly measures the load on the network connected to the computer (1) and the computer (1), and when the load is low (when the load is below a certain level). In addition, a batch batch data collection command (230) is issued to control an increase in the load on the computer.
Alternatively, the data collection condition of the collective data collection command format (200-1) shown in FIG. 13 is changed to control an increase in the load on the computer.

  As described above, in this embodiment, since the batch transmission of the collected data is performed when the load on the computer (1) or the network is low, the burden on the computer (1) and the network can be reduced.

  As described above, in the present embodiment, the timing for issuing a command for collecting data accumulated several times on the device side from the network load, the computer resource load, etc., the number of measurements for transmitting the accumulated data, and the specified time A data collection system having a function of determining one or more conditions of a specified size in a computer has been described.

Finally, a hardware configuration example of the computer (1) and each device (2) shown in the first to third embodiments will be described.
FIG. 16 is a diagram illustrating an example of hardware resources of the computer (1) and each device (2) illustrated in the first to third embodiments.
Note that the configuration of FIG. 16 is merely an example of the hardware configuration of the computer (1) and each device (2), and the hardware configuration of the computer (1) and each device (2) is described in FIG. It is not limited to this configuration, and other configurations may be used.

In FIG. 16, the computer (1) and each device (2) include a CPU 911 (also referred to as a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, and a processor) that executes a program.
The CPU 911 is connected to, for example, a ROM (Read Only Memory) 913, a RAM (Random Access Memory) 914, a communication board 915, a display device 901, a keyboard 902, a mouse 903, and a magnetic disk device 920 via a bus 912. Control hardware devices.
Further, the CPU 911 may be connected to an FDD 904 (Flexible Disk Drive), a compact disk device 905 (CDD), a printer device 906, and a scanner device 907. Further, instead of the magnetic disk device 920, a storage device such as an optical disk device or a memory card (registered trademark) read / write device may be used.
The RAM 914 is an example of a volatile memory. The storage media of the ROM 913, the FDD 904, the CDD 905, and the magnetic disk device 920 are an example of a nonvolatile memory. These are examples of the storage device.
A communication board 915, a keyboard 902, a mouse 903, a scanner device 907, an FDD 904, and the like are examples of input devices.
The communication board 915, the display device 901, the printer device 906, and the like are examples of output devices.

  As shown in FIG. 1, the communication board 915 is connected to a network. For example, the communication board 915 may be connected to a LAN (local area network), the Internet, a WAN (wide area network), or the like.

The magnetic disk device 920 stores an operating system 921 (OS), a window system 922, a program group 923, and a file group 924.
The programs in the program group 923 are executed by the CPU 911 using the operating system 921 and the window system 922.

The RAM 914 temporarily stores at least part of the operating system 921 program and application programs to be executed by the CPU 911.
The RAM 914 stores various data necessary for processing by the CPU 911.

The ROM 913 stores a BIOS (Basic Input Output System) program, and the magnetic disk device 920 stores a boot program.
When the computer (1) and each device (2) are activated, the BIOS program in the ROM 913 and the boot program for the magnetic disk device 920 are executed, and the operating system 921 is activated by the BIOS program and the boot program.

  The program group 923 stores a program for executing the function described as “˜unit” in the description of the first to third embodiments. The program is read and executed by the CPU 911.

In the file group 924, in the description of the first to third embodiments, “determination of”, “collection of”, “analysis of”, “calculation of”, “comparison of”, “evaluation of”. ”,“ Create ”,“ Set up ”,“ Register ”,“ Select ”, etc. It is stored as each item of "~ file" and "~ database".
The “˜file” and “˜database” are stored in a recording medium such as a disk or a memory. Information, data, signal values, variable values, and parameters stored in a storage medium such as a disk or memory are read out to the main memory or cache memory by the CPU 911 via a read / write circuit, and extracted, searched, referenced, compared, and calculated. Used for CPU operations such as calculation, processing, editing, output, printing, and display.
Information, data, signal values, variable values, and parameters are stored in the main memory, registers, cache memory, and buffers during the CPU operations of extraction, search, reference, comparison, calculation, processing, editing, output, printing, and display. It is temporarily stored in a memory or the like.
In addition, arrows in the flowcharts described in the first to third embodiments mainly indicate input / output of data and signals, and the data and signal values are the memory of the RAM 914, the flexible disk of the FDD904, the compact disk of the CDD905, and the magnetic field. Recording is performed on a recording medium such as a magnetic disk of the disk device 920, other optical disks, mini disks, DVDs, and the like. Data and signals are transmitted online via a bus 912, signal lines, cables, or other transmission media.

  In addition, what is described as “˜unit” in the description of the first to third embodiments may be “˜circuit”, “˜device”, “˜device”, and “˜step”, It may be “˜procedure” or “˜processing”. That is, what is described as “˜unit” may be realized by firmware stored in the ROM 913. Alternatively, it may be implemented only by software, or only by hardware such as elements, devices, substrates, and wirings, by a combination of software and hardware, or by a combination of firmware. Firmware and software are stored as programs in a recording medium such as a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, and a DVD. The program is read by the CPU 911 and executed by the CPU 911. That is, the program causes the computer to function as “to part” in the first to third embodiments. Alternatively, the computer executes the procedure and method of “to part” in the first to third embodiments.

  As described above, the computer (1) and each device (2) shown in the first to third embodiments output a CPU as a processing device, a memory as a storage device, a magnetic disk, a keyboard as an input device, a mouse, a communication board, etc. The computer includes a display device, a communication board, and the like, and implements the functions indicated as “to unit” using the processing device, the storage device, the input device, and the output device as described above.

FIG. 3 is a diagram illustrating a system configuration example according to the first to third embodiments. FIG. 4 is a diagram showing an example of a device information table according to the first embodiment. FIG. 5 shows a batch data collection command format according to the first embodiment. The figure which shows the batch data collection result (immediate) format which concerns on Embodiment 1. FIG. The figure which shows the batch data collection result (batch) format which concerns on Embodiment 1. FIG. FIG. 4 is a diagram showing an individual data collection command format according to the first embodiment. The figure which shows the separate data collection result format which concerns on Embodiment 1. FIG. The figure which shows the batch batch data collection command format which concerns on Embodiment 1. FIG. FIG. 3 is a sequence diagram according to the first embodiment. FIG. 3 is a diagram illustrating a functional configuration example of a master device according to the first embodiment. 4 is a data collection flowchart of the master device according to the first embodiment. FIG. 3 is a diagram illustrating a mechanism configuration example of a computer apparatus according to Embodiments 1 to 3; The figure which shows the batch data collection command format which concerns on Embodiment 2. FIG. FIG. 9 is a sequence diagram according to the second embodiment. 10 is a data collection flowchart of a master device according to the second embodiment. The figure which shows the hardware structural example of the computer apparatus which concerns on Embodiment 1-3, and each apparatus.

Explanation of symbols

  1 computer device, 2a master device, 2b slave device, 2c slave device, 2y slave device, 2z slave device, 3 network, 4a network cable, 4b network cable, 100 device information table, 401 batch data collection command receiving unit, 401- 1 Data collection command recording area, 402 Individual data collection command transmission section, 403 Result reception section, 404 Result analysis / integration section, 404-1 Batch processing data temporary recording area, 405 Batch data transmission section, 406 Command analysis section, 407 data Collection unit, 501 Data collection command transmission and collection result reception unit, 502 Network resource and computer resource load measurement unit.

Claims (11)

A data processing device connected to a data collection device that collects data for each of a plurality of types of data collection items, and a management device that manages the collected data collected by the data collection device,
A first communication unit that receives a collection data output request in which the transmission timing of the collection data is designated as the designated transmission timing for each data collection item from the management device;
A collection data transmission request generation unit that generates a collection data transmission request for requesting the data collection device to transmit collected data collected for each data collection item;
A second communication unit that transmits the collection data transmission request to the data collection device and receives collected data for each data collection item from the data collection device as a response to the collection data transmission request;
The transmission timing of the collected data received from the data collection device is determined according to the designated transmission timing indicated in the collection data output request for each data collection item, and the collected data is determined A transmission timing determination unit for transmitting to the management device via the first communication unit;
A collected data storage unit for storing collected data received from the data collection device;
The first communication unit is
As the designated transmission timing, it is specified that any one of the data collection items is transmitted to the management device immediately after receiving the collected data from the data collection device, and the data is transmitted to any other data collection item. Receiving the collected data output request specifying that the collected data received after collecting the collected data from the collecting device is stored and then transmitted to the management device;
The transmission timing determination unit
Among the collected data received from the data collection device, the collected data for the data collection item designated to be transmitted immediately after reception from the data collection device in the collected data output request is transmitted to the management device, In the collected data output request, the collected data for the data collection item designated to be transmitted after accumulation is accumulated in the collected data accumulation unit,
The first communication unit is
From the management device, a stored collection data output request for requesting transmission of accumulated collection data is received,
The transmission timing determination unit
A data processing apparatus, wherein when the storage / collection data output request is received from the management apparatus, the storage / collection data stored in the collection data storage unit is transmitted to the management apparatus. The data processing device is connected to a plurality of data collection devices,
The second communication unit is
When the collection data output request is received from the management apparatus, the collection data transmission request is transmitted to each data collection apparatus, and collection is performed for each data collection item from each data collection apparatus as a response to the collection data transmission request. Receive data,
The transmission timing determination unit
The collected data received from each data collection device is classified for each data collection item, and the collected data received from each data collection device is transmitted to the management device at the determined transmission timing for each data collection item. The data processing apparatus according to claim 1. The data processing device further includes:
It has a data collection unit that collects data for each of multiple types of data collection items,
The transmission timing determination unit
The collection data received from the data collection device and the collection data collected by the data collection unit are transmitted to the management device at a determined transmission timing for each data collection item. 2. A data processing apparatus according to 2. The transmission timing determination unit
A transmission condition for transmitting the accumulated collection data accumulated in the collected data accumulation unit is set, and when the transmission condition is satisfied, the accumulated collection data is transmitted to the management device. The data processing apparatus according to claim 1. The transmission timing determination unit
As the transmission condition, a condition regarding at least one of the number of times of reception of the collected data output request, time, the data size of the accumulated collected data, and the traffic status in the network with the management device is set. The data processing apparatus according to claim 4. A communication system having a data processing device connected to a data collection device that collects data for each of a plurality of types of data collection items, and a management device that manages the collected data collected by the data collection device. ,
The management device
For each data collection item, specify the transmission timing of the collected data as the designated transmission timing, send a collection data output request for requesting the data processing device to transmit the collected data,
The data processing device includes:
The collection data output request is received from the management device, and a collection data transmission request for requesting transmission of collected data collected for each data collection item is transmitted to the data collection device, and the collection Collected data for each data collection item is received from the data collection device as a response to the data transmission request, and the transmission timing of the collected data received from the data collection device to the management device is determined for each data collection item. Determine according to the designated transmission timing indicated in the output request, and transmit each collected data to the management device at the determined transmission timing,
The management device
As the designated transmission timing, it is specified that any one of the data collection items is transmitted to the management device immediately after receiving the collected data from the data collection device, and the data is transmitted to any other data collection item. After collecting data is received from the collecting device, a collected data output request is sent to the data processing device to specify that the collected data received is transmitted after being accumulated,
The data processing device includes:
Among the collected data received from the data collection device, the collected data for the data collection item designated to be transmitted immediately after reception from the data collection device in the collected data output request is transmitted to the management device, Accumulating collected data for a data collection item designated to be transmitted after accumulation in the collected data output request,
The management device
Sending a collected collection data output request for requesting transmission of accumulated collection data to the data processing device,
The data processing device includes:
A communication system, wherein when the storage collection data output request is received from the management apparatus, the stored collection data is transmitted to the management apparatus. The data processing device is connected to a plurality of data collection devices,
When the collection data output request is received from the management apparatus, the collection data transmission request is transmitted to each data collection apparatus, and collection is performed for each data collection item from each data collection apparatus as a response to the collection data transmission request. Data is received, the collected data received from each data collection device is classified for each data collection item, and the collected data received from each data collection device is sent to the management device at the determined transmission timing for each data collection item. The communication system according to claim 6, wherein the communication system transmits the data to the communication system. The management device
When monitoring at least one of the traffic status in the network with the data processing device and the processing load status in the management device, if at least one of the traffic status and the processing load status is below a certain level, The communication system according to claim 6, wherein the storage collection data output request is transmitted to the data processing device. The management device
Monitoring at least one of a traffic status in the network with the data processing device and a processing load status in the management device, and based on at least one of the traffic status and the processing load status in the collected data storage unit Set transmission conditions for transmitting the accumulated collection data that has been accumulated, and send a collection data output request indicating the transmission conditions to the data processing device,
The data processing device includes:
The communication system according to claim 6, wherein accumulated collection data is transmitted to the management device when the transmission condition is satisfied. A data processing method performed by a computer connected to a data collection device that collects data for each of a plurality of types of data collection items and a management device that manages collected data collected by the data collection device,
A first communication step of receiving, from the management device, a collection data output request in which collection data transmission timing is designated as designated transmission timing for each data collection item;
A collection data transmission request generating step for generating a collection data transmission request for requesting the data collection device to transmit collected data collected for each data collection item;
A second communication step of transmitting the collection data transmission request to the data collection device and receiving collection data for each data collection item from the data collection device as a response to the collection data transmission request;
The transmission timing of the collected data received from the data collection device is determined according to the designated transmission timing indicated in the collection data output request for each data collection item, and the collected data is determined a transmission timing determination step of transmitting to said management apparatus at,
A storage collection data output request receiving step for receiving a storage collection data output request for requesting transmission of stored collection data from the management device;
When the accumulated collection data output request from the management apparatus is received by the accumulated collection data output request receiving step, the accumulated collection data that is transmitted to the management apparatus is stored collection data accumulated in a predetermined accumulation area. A transmission step ,
In the first communication step,
As the designated transmission timing, it is specified that any one of the data collection items is transmitted to the management device immediately after receiving the collected data from the data collection device, and the data is transmitted to any other data collection item. The computer receives a collection data output request that specifies collection data received after collection data is received from the collection device and then transmitted to the management device, and
In the transmission timing determination step,
Of the collected data received from the data collection device, the computer collects collected data for a data collection item designated to be transmitted immediately after reception from the data collection device in the collected data output request to the management device. and it transmits the data processing method comprising a storage child collected data to the data collection items that are designated to transmit after storage in the collected data output request to the storage area. A computer connected to a data collection device that collects data for each of a plurality of types of data collection items and a management device that manages the collected data collected by the data collection device,
A first communication process for receiving, from the management device, a collection data output request in which collection data transmission timing is designated as designated transmission timing for each data collection item;
A collection data transmission request generation process for generating a collection data transmission request for requesting the data collection device to transmit collected data collected for each data collection item;
A second communication process for transmitting the collected data transmission request to the data collection device and receiving collected data for each data collection item from the data collection device as a response to the collected data transmission request;
The transmission timing of the collected data received from the data collection device is determined according to the designated transmission timing indicated in the collection data output request for each data collection item, and the collected data is determined a transmission timing determination processing to be transmitted to the management apparatus at,
A storage collection data output request reception process for receiving a storage collection data output request for requesting transmission of stored collection data from the management device;
When the accumulated collection data output request from the management apparatus is received by the accumulated collection data output request reception process, accumulated collection data that is stored in a predetermined accumulation area is transmitted to the management apparatus. A program for executing transmission processing ,
In the first communication process,
As the designated transmission timing, it is specified that any one of the data collection items is transmitted to the management device immediately after receiving the collected data from the data collection device, and the data is transmitted to any other data collection item. Collected data output request that specifies that the collected data received after collecting data is received from the collecting device and then transmitted to the management device is received by the computer,
In the transmission timing determination process,
Of the collected data received from the data collection device to the computer, collected data for the data collection item designated to be transmitted immediately after reception from the data collection device in the collected data output request to the management device causes the transmitted program characterized and storage of Serco collected data to the data collection items that are designated to transmit after storage in the collected data output request to the storage area.

Images