JP2019159785A - Backup server, backup method, program, and storage system - Google Patents

Abstract

To solve a problem that the transfer rate of backup target data may be reduced due to an increase in time associated with de-duplication, when performing de-duplication at a backup server.SOLUTION: A backup server for transmitting data received from an external device to a storage device having a de-duplication function, includes a de-duplication unit configured to perform de-duplication processing on block data obtained by dividing the data received from the external device, a network load information acquisition unit configured to acquire network load information indicating a load state of a network with the storage device, and a determination unit configured to determine whether the de-duplication unit performs de-duplication processing based on the network load information acquired by the network load information acquisition unit. The de-duplication unit performs de-duplication when the determination unit determines to execute de-duplication.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a backup server, a backup method, a program, and a storage system.

  A storage system having a backup server that receives data to be stored from an external device and a storage device that stores data to be stored received from the backup server is known.

  As a technology related to the above storage system, for example, there is Patent Literature 1. Patent Document 1 discloses a backup server having a first backup processing unit that performs deduplication using first deduplication information, and a second backup processing unit that performs deduplication using second deduplication information. And a storage system having a storage device. According to Patent Document 1, when it is determined that the first backup processing unit is not duplicated, while the second backup processing unit is determined to be duplicated, the second backup processing unit is Send the deduplication information to the backup device. According to Patent Document 1, it is possible to perform efficient deduplication with the above configuration.

Patent No. 5774794

  In the case of a system in which the backup server performs deduplication as described in Patent Document 1, after deduplication is performed in the backup server, the data after deduplication is transmitted to the storage apparatus. Due to such a configuration, when the CPU performance of the backup server is insufficient, the time required for deduplication increases, and transfer of backup target data to the storage apparatus may be delayed. As a result, there has been a problem that the transfer speed of the backup target data is reduced.

  As described above, when deduplication is performed at the backup server, there is a problem that the transfer speed of the backup target data may be reduced due to an increase in time associated with deduplication.

  Therefore, an object of the present invention is to provide a backup server, a backup method, and a method for solving the problem that, when performing deduplication at a backup server, there is a risk that the transfer rate of data to be backed up may decrease due to an increase in time associated with deduplication, It is to provide a program and a storage system.

In order to achieve such an object, a backup server which is an embodiment of the present invention provides:
A backup server that transmits data received from an external device to a storage device having a deduplication function,
A deduplication unit that performs deduplication processing of block data obtained by dividing the data received from the external device;
A network load information acquisition unit that acquires network load information indicating a load state of a network with the storage device;
A determination unit that determines whether or not the deduplication unit performs deduplication processing based on the network load information acquired by the network load information acquisition unit;
Have
The deduplication unit is configured to perform deduplication when the determination unit determines to perform deduplication.

In addition, the backup method according to another aspect of the present invention includes:
A backup server that transmits data received from an external device to a storage device having a deduplication function,
Obtaining network load information indicating the load status of the network with the storage device;
Based on the network load information, it is determined whether to perform deduplication processing of block data obtained by dividing the data,
A configuration is adopted in which deduplication is performed based on the determination result.

Moreover, the program which is the other form of this invention is:
To a backup server that sends data received from an external device to a storage device that has a deduplication function,
A deduplication unit that performs deduplication processing of block data obtained by dividing the data received from the external device;
A network load information acquisition unit that acquires network load information indicating a load state of a network with the storage device;
A determination unit that determines whether or not the deduplication unit performs deduplication processing based on the network load information acquired by the network load information acquisition unit;
Realized,
The deduplication unit is a program that performs deduplication when the determination unit determines to perform deduplication.

A storage system according to another embodiment of the present invention
A backup server that transmits data received from an external device to a storage device having a deduplication function, and the storage device,
The backup server
A deduplication unit that performs deduplication processing of block data obtained by dividing the data received from the external device;
A network load information acquisition unit that acquires network load information indicating a load state of a network with the storage device;
A determination unit that determines whether or not the deduplication unit performs deduplication processing based on the network load information acquired by the network load information acquisition unit;
Have
The deduplication unit performs deduplication when the determination unit determines to perform deduplication,
The storage device
The backup server is configured to deduplicate the block data that has not been deduplicated.

  By configuring as described above, the present invention solves the problem that when deduplication is performed at a backup server, the transfer speed of data to be backed up may decrease due to an increase in time associated with deduplication. A backup server, backup method, program, and storage system can be provided.

1 is a block diagram showing an example of the overall configuration of a storage system according to a first embodiment of the present invention. It is a block diagram which shows an example of a structure of the backup server shown in FIG. It is a figure which shows an example of the process of the backup server in 1st Embodiment. FIG. 2 is a block diagram illustrating an example of a configuration of a storage device illustrated in FIG. 1. It is a flowchart which shows an example of operation | movement of the backup server in the 1st Embodiment of this invention. It is a block diagram which shows an example of a structure of the backup server in the 2nd Embodiment of this invention. It is a figure which shows an example of the process of the backup server in 2nd Embodiment. It is a flowchart which shows an example of operation | movement of the backup server in the 2nd Embodiment of this invention. It is a block diagram which shows an example of a structure of the backup server in the 3rd Embodiment of this invention. It is a figure which shows an example of the process of the backup server in 3rd Embodiment. It is a flowchart which shows an example of operation | movement of the backup server in the 3rd Embodiment of this invention. It is a block diagram which shows an example of a structure of the backup server in the 4th Embodiment of this invention.

[First Embodiment]
A first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram showing an example of the overall configuration of the storage system 1. FIG. 2 is a block diagram illustrating an example of the configuration of the backup server 2. FIG. 3 is a diagram illustrating an example of processing of the backup server 2. FIG. 4 is a block diagram illustrating an example of the configuration of the storage apparatus 3. FIG. 5 is a flowchart showing an example of the operation of the backup server 2.

  In the first embodiment, a backup server 2 that receives storage target data (for example, a file) from a backup target device 4 that is an external device, and transmits block data obtained by dividing the received data to the storage device 3. Will be described. As will be described later, the backup server 2 in the present embodiment acquires network load information indicating the network load status between the backup server 2 and the storage device 3. Then, the backup server 2 determines whether or not to perform deduplication according to the acquired network load information. When deduplication is performed, the backup server 2 transmits block data after deduplication to the storage apparatus 3. On the other hand, when deduplication is not performed, the backup server 2 transmits the block data before deduplication to the storage apparatus 3 as it is.

  FIG. 1 shows an example of the overall configuration of the storage system 1. Referring to FIG. 1, the storage system 1 includes a backup target device 4, a backup server 2, and a storage device 3. As shown in FIG. 1, the backup target device 4 and the backup server 2 are connected so as to communicate with each other. The backup server 2 and the storage device 3 are connected so that they can communicate with each other.

  The configuration of the storage system 1 is not limited to the case illustrated in FIG. For example, the storage system 1 may have a plurality of backup target devices 4 or a plurality of backup servers 2. The storage system 1 may have a plurality of storage devices 3. Further, one backup server 2 may be connected to a plurality of backup target devices 4 or may be connected to a plurality of storage devices 3.

  When the backup server 2 receives the storage target data from the backup target device 4, the backup server 2 divides the received data into fixed-length or variable-length block data. Further, the backup server 2 acquires network load information indicating the load status of the network with the storage apparatus 3 that is the block data transmission destination. Then, the backup server 2 performs deduplication by itself according to the acquired network load information, and then transmits the deduplicated block data to the storage device 3, or the block data as it is without performing deduplication. Whether to transmit to the storage apparatus 3 is determined.

  FIG. 2 shows an example of the configuration of the backup server 2. Referring to FIG. 2, the backup server 2 includes, for example, a data reception unit 21, a network load information acquisition unit 22, a process determination unit 23 (determination unit), and a deduplication unit 24.

  For example, the backup server 2 has an arithmetic device such as a CPU (Central Processing Unit) (not shown) and a storage device. For example, the backup server 2 implements the above-described processing units by causing the arithmetic device to execute a program stored in a storage device (not shown).

  The data receiving unit 21 receives data to be stored (for example, a file) from the backup target device 4. Then, the data receiving unit 21 divides the received data into fixed-length or variable-length block data.

  The network load information acquisition unit 22 acquires network load information indicating a network load state between the storage apparatus 3 that is a transmission destination of block data and the backup server 2. For example, the network load information acquisition unit 22 acquires information indicating the network bandwidth usage status (for example, the network bandwidth usage rate) as the network load information. In the present embodiment, the method by which the network load information acquisition unit 22 acquires network load information is not particularly limited. The network load information acquisition unit 22 may be configured to acquire network load information using a known method.

  The process determination unit 23 determines whether or not to perform deduplication in the backup server 2 based on the network load information acquired by the network load information acquisition unit 22. FIG. 3 shows an example of processing of the backup server 2 according to the network load information. Specifically, FIG. 3A shows processing when there is a margin in the network bandwidth between the backup server 2 and the storage device 3. FIG. 3B shows processing when there is no room in the network bandwidth between the backup server 2 and the storage device 3.

  For example, the process determination unit 23 compares the utilization rate of the network band indicated by the network load information with a predetermined threshold A (second threshold). Then, the process determination unit 23 determines whether or not the backup server 2 performs deduplication based on the result of comparing the utilization ratio of the network bandwidth indicated by the network load information with the threshold value A.

  For example, when the utilization rate of the network band indicated by the network load information is equal to or less than the threshold value A, the process determining unit 23 determines that there is an empty network band and determines not to perform deduplication. As a result, the deduplication unit 24 does not perform deduplication processing. In such a case, as shown in FIG. 3A, the backup server 2 transmits the block data before deduplication to the storage apparatus 3 as it is.

  On the other hand, when the utilization rate of the network band indicated by the network load information is larger than the threshold A, the process determination unit 23 determines that there is no free network band and determines to perform deduplication. As a result, the deduplication unit 24 performs deduplication processing. In such a case, as shown in FIG. 3B, the backup server 2 transmits the deduplicated block data to the storage apparatus 3.

  Note that the value of the threshold A, which is the second threshold, may be set arbitrarily. The value of the threshold A may be 80 or 90, for example, or may be a value other than that exemplified.

  The deduplication unit 24 performs deduplication to check whether or not the block data is already stored in the storage apparatus 3 when the process determination unit 23 determines that deduplication is to be performed. The deduplication unit 24 performs deduplication to confirm whether or not duplicate block data is included in the block data to be transmitted when the process determination unit 23 determines that deduplication is to be performed. You may comprise. On the other hand, as described above, when the process determination unit 23 determines not to perform deduplication, the deduplication unit 24 does not perform deduplication.

  For example, the deduplication unit 24 calculates a hash value representing the data content based on the data content of the block data to be transmitted. Specifically, for example, the deduplication unit 24 calculates a hash value from the data content of the block data using a preset hash function (for example, a cryptographic hash function such as SHA-2).

  Subsequently, the deduplication unit 24 checks whether the block data has already been stored in the storage device 3 using the calculated hash value. Further, the deduplication unit 24 can check whether or not the same block data is included in the block data scheduled to be transmitted to the storage apparatus 3 using the calculated hash value.

  For example, the deduplication unit 24 is a deduplication information that is information in which a hash value calculated based on block data already stored in the storage device 3 and information indicating the storage position of the block data are associated with each other. have. The deduplication unit 24 refers to the deduplication information to determine whether or not block data having the same content is already stored in the storage device 3. For example, when the deduplication unit 24 includes a value calculated based on the block data in the deduplication information, the block data having the same content is already stored in the storage device 3 (that is, is duplicated). to decide. Then, the deduplication unit 24 excludes block data whose same contents are already stored in the storage apparatus 3 from transmission targets. That is, as shown in FIG. 3B, block data already stored in the storage apparatus 3 is not transmitted to the storage apparatus 3 as a result of the deduplication process by the deduplication unit 24. For example, in the case of FIG. 3B, the block data G is already stored in the storage device 3. Therefore, the backup server 2 does not transmit the block data G to the storage device 3. In this case, for example, the backup server 2 can transmit information indicating the storage location of the block data to the storage device 3 instead of the block data.

  Further, when the block data to be transmitted includes block data having the same hash value, the deduplication unit 24 can determine that the overlapping block data is included in the block data to be transmitted. . Then, the deduplication unit 24 excludes other block data whose same contents are included in the block data scheduled to be transmitted from the transmission target. That is, the deduplication unit 24 performs deduplication so that block data having the same content is not transmitted to the storage apparatus 3. As a result, only one of the overlapping block data is transmitted to the storage apparatus 3 as shown in FIG. For example, in the case of FIG. 3B, the block data B and the block data D have the same content (the hash values calculated based on the block data are the same), and the block data E and the block data H have the same content (the block data Hash values calculated based on the same are the same). Therefore, for example, the backup server 2 transmits block data B and block data E to the storage apparatus 3, but does not transmit block data D and block data H to the storage apparatus 3. When performing the above-described deduplication, the backup server 2 transmits, for example, block data (for example, block data B) having the same hash value instead of block data (for example, block data D) that is not transmitted. ) (For example, a hash value) can be transmitted.

  The deduplication information included in the deduplication unit 24 can be updated by receiving it from the storage apparatus 3, for example. By receiving the deduplication information from the storage device 3, for example, it becomes possible to perform deduplication based on block data transmitted to the storage device 3 via different backup servers 2.

  The above is an example of the configuration of the backup server 2. As described above, the backup server 2 determines whether or not to perform deduplication based on the network load information. The backup server 2 can transmit the block data to the storage device 3 so that it can be determined whether or not the block data has been deduplicated. For example, the backup server 2 can transmit block data with an identifier or the like indicating whether or not deduplication processing has been completed.

  The storage device 3 has a deduplication function. The storage device 3 performs deduplication on the block data and stores the block data after deduplication. The storage apparatus 3 may be configured to perform deduplication processing regardless of the presence or absence of deduplication processing in the backup server 2, and performs deduplication processing on block data that has not been deduplicated in the backup server 2. You may comprise so that it may perform.

  FIG. 4 shows an example of the configuration of the storage apparatus 3. Referring to FIG. 4, the storage apparatus 3 includes a block data receiving unit 31, a deduplication unit 32, a data storage unit 33, and a storage device 34.

  For example, the storage device 3 includes an arithmetic device such as a CPU (not shown) and a storage device. For example, the storage device 3 realizes the processing units by causing the arithmetic device to execute a program stored in a storage device (not shown).

  The block data receiving unit 31 receives block data from the backup server 2. As described above, the block data received by the block data receiving unit 31 may be deduplicated by the backup server 2 or may not be deduplicated by the backup server 2.

  The deduplication unit 32 performs deduplication to check whether the block data received by the block data receiving unit 31 is already stored in the storage device 34 of the storage device 3. For example, the deduplication unit 32 performs a duplication process similar to the deduplication process performed by the deduplication unit 24.

  For example, the deduplication unit 32 calculates a hash value from the data content of the block data using a preset hash function. Subsequently, the deduplication unit 32 checks whether the block data is already stored in the storage device 34 of the storage device 3 using the calculated hash value. For example, like the deduplication unit 24, the deduplication unit 32 has deduplication information. The deduplication unit 32 refers to the deduplication information to determine whether block data with the same content is already stored in the storage device 34.

  For example, if the deduplication unit 32 includes a value calculated based on block data in the deduplication information, block data having the same content is already stored in the storage device 34 (that is, is duplicated). to decide. In such a case, duplicate block data is not stored in the storage device 34. The storage apparatus 3 manages the block data that is to be stored in the block data storage location that is associated with the hash value of the block data in the deduplication information.

  On the other hand, when the value calculated based on the block data is not included in the deduplication information, the deduplication unit 32 determines that block data having the same content is not stored in the storage device 34. In such a case, the deduplication unit 32 outputs block data to the data storage unit 33.

  Note that, as described above, the deduplication unit 32 may be configured to perform deduplication processing regardless of the presence or absence of deduplication processing in the backup server 2, or a block in which deduplication is not performed in the backup server 2. You may comprise so that deduplication processing may be performed with respect to data. When the deduplication unit 32 is configured to perform deduplication processing on block data that has not been deduplicated in the backup server 2, the deduplication unit 32 determines that deduplication processing has not been completed based on an identifier or the like. Deduplication processing is executed for block data.

  The data storage unit 33 acquires block data after deduplication processing by the deduplication unit 32 or block data that the deduplication unit 32 does not perform deduplication. The data storage unit 33 stores block data in the storage device 34. Thereafter, the storage apparatus 3 manages the block data stored in the data storage unit 33 as being stored in the storage location stored in the data storage unit 33.

  The storage device 34 is a storage device such as a disk device. Block data is stored in the storage device 34 by the data storage unit 33.

  The above is an example of the configuration of the storage apparatus 3. The storage device 3 may be configured to compress the block data to be stored and further divide it into a plurality of fragment data. Further, the storage apparatus 3 may be configured to add redundant data to the divided fragment data. In this way, the storage apparatus 3 may be configured to perform processing for adding redundancy as necessary.

  The backup target device 4 is an information processing device that transmits data to be stored to the backup server 2. The backup target device 4 may be a client device or a business server. In the present embodiment, the backup target device 4 is not particularly limited. The backup target device 4 may be a device other than those exemplified above.

  The above is an example of the configuration of the storage system 1. Next, an example of the operation of the backup server 2 will be described with reference to FIG.

  FIG. 5 is a flowchart showing an example of the operation of the backup server 2. Referring to FIG. 5, the data receiving unit 21 divides the data received from the backup target device 4 into fixed-length or variable-length block data (step S101).

  The process determination unit 23 determines whether or not to perform deduplication in the backup server 2 based on the network load information acquired by the network load information acquisition unit 22. If the utilization rate of the network band indicated by the network load information is equal to or less than the threshold value A (Yes in step S102), the process determining unit 23 determines that the network band is free and determines not to perform deduplication. As a result, the deduplication unit 24 does not perform deduplication processing described later. In such a case, the backup server 2 transmits the block data before deduplication as it is to the storage apparatus 3 (step S103).

  On the other hand, when the utilization rate of the network band indicated by the network load information is larger than the threshold A (No in step S102), the process determining unit 23 determines that there is no free network band and determines to perform deduplication. . In this case, the deduplication unit 24 performs deduplication (step S104). Then, the backup server 2 transmits the block data after deduplication to the storage device 3 (step S105).

  The above is an example of the operation of the backup server 2.

  As described above, the backup server 2 in the present embodiment includes the network load information acquisition unit 22, the process determination unit 23, and the deduplication unit 24. With this configuration, the process determination unit 23 can determine whether or not the deduplication unit 24 performs deduplication according to the network load information acquired by the network load information acquisition unit 22. As a result, for example, the processing determination unit 23 does not perform deduplication by the deduplication unit 24 even when the backup server 2 has the deduplication unit 24 when the network bandwidth is sufficient. It becomes possible to judge. As a result, it is possible to reduce the amount of deduplication processing by the deduplication unit 24, and when performing deduplication in the backup server 2, there is a risk that the transfer speed of the backup target data may be reduced due to an increase in time associated with deduplication. It is possible to suppress the occurrence of the problem that there is. That is, according to the present embodiment, it is possible to provide the backup server 2 that has been improved to solve the problem that the data transfer rate may be reduced.

[Second Embodiment]
Next, a second embodiment of the present invention will be described with reference to FIGS. FIG. 6 is a block diagram illustrating an example of the configuration of the backup server 5. FIG. 7 is a diagram illustrating an example of processing of the backup server 5. FIG. 8 is a flowchart showing an example of the operation of the backup server 5.

  In the second embodiment, a backup server 5 that is a modification of the backup server 2 described in the first embodiment will be described. Similar to the backup server 2, the backup server 5 described in the present embodiment receives data to be stored from the backup target device 4 and transmits block data obtained by dividing the received data to the storage device 3.

  The backup server 5 acquires network load information indicating the load status of the network with the storage apparatus 3 that is the block data transmission destination, and acquires CPU load information indicating the load status of the CPU. Then, the backup server 5 performs deduplication by itself according to the acquired network load information and CPU load information, and then transmits the deduplicated block data to the storage apparatus 3 or does not perform deduplication. It is determined whether the block data is transmitted to the storage device 3 as it is.

  FIG. 6 shows an example of the configuration of the backup server 5. Referring to FIG. 6, the backup server 5 includes, for example, a data reception unit 21, a network load information acquisition unit 22, a CPU load information acquisition unit 51, a process determination unit 52, and a deduplication unit 24. ing. The configuration of the data receiving unit 21, the network load information acquiring unit 22, and the deduplication unit 24 is the same as the configuration of the backup server 2 described in the first embodiment. Therefore, detailed description is omitted. Hereinafter, a characteristic configuration in the present embodiment will be described.

  The CPU load information acquisition unit 51 acquires CPU load information indicating the load status of the CPU of the backup server 5 itself. For example, the CPU load information acquisition unit 51 acquires information indicating the CPU usage status (for example, the CPU usage rate) as the CPU load information. In the present embodiment, the method by which the CPU load information acquisition unit 51 acquires CPU load information is not particularly limited. The CPU load information acquisition unit 51 may be configured to acquire CPU load information using a known method.

  The process determination unit 52 determines whether or not the backup server 5 performs deduplication based on the network load information acquired by the network load information acquisition unit 22 and the CPU load information acquired by the CPU load information acquisition unit 51. FIG. 7 shows an example of processing of the backup server 5 according to network load information and CPU load information. Specifically, FIG. 7A shows processing when the CPU usage rate is equal to or higher than the threshold B (first threshold) and there is a margin in the network bandwidth. FIG. 7B shows processing when the usage rate of the CPU is smaller than the threshold B or there is no room in the network bandwidth.

  For example, the process determination unit 52 compares the usage rate of the CPU indicated by the CPU load information with a predetermined threshold value B. Then, when the usage rate of the CPU is smaller than the threshold value B, the process determining unit 52 determines to perform deduplication processing as shown in FIG.

  On the other hand, when the CPU usage rate is equal to or higher than the threshold value B, the process determination unit 52 compares the network bandwidth usage rate indicated by the network load information with a predetermined threshold value A. Then, when the utilization rate of the network band indicated by the network load information is equal to or less than the threshold value A, the process determining unit 52 determines that there is an empty network band and determines not to perform deduplication. As a result, the deduplication unit 24 does not perform deduplication processing described later. In such a case, as shown in FIG. 7A, the backup server 5 transmits the block data before deduplication to the storage apparatus 3 as it is.

  On the other hand, when the utilization rate of the network band indicated by the network load information is greater than the threshold A, the process determination unit 52 determines that there is no free network band and determines to perform deduplication. As a result, the deduplication unit 24 performs deduplication processing. In such a case, as shown in FIG. 7B, the backup server 2 transmits the deduplicated block data to the storage apparatus 3.

  Note that the value of the threshold value B, which is the first threshold value, may be arbitrarily set similarly to the threshold value A. The value of the threshold B may be 80 or 90, for example, or may be a value other than that exemplified.

  The above is an example of a characteristic configuration of the backup server 5. Next, an example of the operation of the backup server 5 will be described with reference to FIG.

  FIG. 8 is a flowchart showing an example of the operation of the backup server 5. Referring to FIG. 8, the data receiving unit 21 divides the data received from the backup target device 4 into fixed-length or variable-length block data (step S101).

  The process determination unit 52 compares the CPU usage rate indicated by the CPU load information with a predetermined threshold value B (step S201).

  When the usage rate of the CPU is smaller than the threshold value B (No in step S201), the process determining unit 52 determines to perform deduplication processing. In this case, the deduplication unit 24 performs deduplication (step S104). Then, the backup server 5 transmits the deduplicated block data to the storage apparatus 3 (step S105).

  On the other hand, when the usage rate of the CPU is equal to or higher than the threshold B (step S201, Yes), the process determination unit 52 compares the usage rate of the network band indicated by the network load information with a predetermined threshold A. When the utilization rate of the network band indicated by the network load information is equal to or less than the threshold A (Yes in step S102), the process determining unit 52 determines that there is a free network band and determines not to perform deduplication. As a result, the deduplication unit 24 does not perform deduplication processing described later. In such a case, the backup server 5 transmits the block data before deduplication as it is to the storage apparatus 3 (step S103).

  On the other hand, when the utilization rate of the network band indicated by the network load information is larger than the threshold A (No in step S102), the process determining unit 52 determines that there is no free network band and determines to perform deduplication. . In this case, the deduplication unit 24 performs deduplication (step S104). Then, the backup server 5 transmits the deduplicated block data to the storage apparatus 3 (step S105).

  The above is an example of the operation of the backup server 5.

  As described above, the backup server 5 in the present embodiment includes the CPU load information acquisition unit 51 and the process determination unit 52. With this configuration, the process determination unit 52 can determine whether or not the deduplication unit 24 performs deduplication after adding the CPU load information acquired by the CPU load information acquisition unit 51. As a result, for example, when it is determined that the CPU load is high, the process determination unit 52 can determine that deduplication is not performed according to the network bandwidth. As a result, it is possible to reduce the amount of deduplication processing by the deduplication unit 24, and when performing deduplication in the backup server 5, there is a risk that the transfer speed of the backup target data may decrease due to an increase in the time associated with deduplication. It is possible to suppress the occurrence of the problem that there is. That is, according to the present embodiment, it is possible to provide the backup server 5 improved in order to solve the problem that the data transfer rate may be reduced.

[Third Embodiment]
Next, a third embodiment of the present invention will be described with reference to FIGS. FIG. 9 is a block diagram illustrating an example of the configuration of the backup server 6. FIG. 10 is a diagram illustrating an example of processing of the backup server 6. FIG. 11 is a flowchart showing an example of the operation of the backup server 6.

  In the third embodiment, a backup server 6 that is a modification of the backup server 2 described in the first embodiment will be described. Similar to the backup server 2, the backup server 6 described in the present embodiment receives data to be stored from the backup target device 4 and transmits block data obtained by dividing the received data to the storage device 3.

  The backup server 6 is configured to be able to perform processing on a plurality of data (files) in parallel. That is, as shown in FIG. 10, the backup server 6 transmits a plurality of files (block data obtained by dividing each file) to the storage device 3 in the same time zone. Therefore, at a certain timing, the backup server 6 may simultaneously transmit a plurality of block data corresponding to each of the plurality of files (the file transmission start time may be different for each file). Further, the backup server 6 is configured to determine whether or not to perform deduplication for each file. That is, while it is determined that a certain file is to be deduplicated, all of the block data obtained by dividing the file is subject to deduplication processing. On the other hand, while it is determined that a certain file is not deduplicated, not all the block data obtained by dividing the file is subject to deduplication processing. As will be described later, according to the acquired network load information, the backup server 6 according to the present embodiment has a ratio of a file that performs deduplication and a file that does not perform deduplication among a plurality of files processed in parallel. Control a certain deduplication ratio.

  FIG. 9 shows an example of the configuration of the backup server 6. Referring to FIG. 9, the backup server 6 includes, for example, a data reception unit 21, a network load information acquisition unit 22, a deduplication ratio control unit 61 that is a modification of the determination unit, and a deduplication unit 24. is doing. The configuration of the data receiving unit 21, the network load information acquiring unit 22, and the deduplication unit 24 is the same as the configuration of the backup server 2 described in the first embodiment. Therefore, detailed description is omitted. Hereinafter, a characteristic configuration in the present embodiment will be described.

  The deduplication ratio control unit 61 controls the ratio of files to be deduplicated based on the network load information acquired by the network load information acquisition unit 22. That is, the deduplication ratio control unit 61 controls the deduplication ratio, which is the ratio of the files that are subjected to deduplication and the files that are not subjected to deduplication, in a plurality of files processed in parallel. For example, the deduplication ratio control unit 61 controls the deduplication ratio by increasing or decreasing the number of files determined to be deduplicated.

  The deduplication ratio control unit 61 has information indicating a deduplication ratio as a reference, for example. First, the deduplication ratio control unit 61 adjusts the number of files determined to be deduplicated among the files processed in parallel so that the deduplication ratio indicated by the information indicating the deduplication ratio as a reference is obtained. The reference deduplication ratio is, for example, a file that performs deduplication: a file that does not perform deduplication = 1: 1. The reference deduplication ratio may be other than the exemplified values.

  The deduplication ratio control unit 61 controls the deduplication ratio by increasing or decreasing the number of files determined to be deduplicated based on the network load information. For example, the deduplication ratio control unit 61 sets the deduplication ratio when the utilization ratio of the network bandwidth indicated by the network load information is equal to or higher than a predetermined threshold C (third threshold; any value is acceptable). increase. As a result, the deduplication unit 24 increases the number of files to be deduplicated among files processed in parallel. On the other hand, the deduplication ratio control unit 61 sets the deduplication ratio when the utilization ratio of the network bandwidth indicated by the network load information is equal to or less than a predetermined threshold D (fourth threshold, which may be any value). Lower. As a result, the number of files that the deduplication unit 24 deduplicates reduces.

  In this way, the deduplication ratio control unit 61 controls the ratio of files that are to be deduplicated and files that are not to be deduplicated by increasing or decreasing the number of files that are determined to be deduplicated. Further, the deduplication ratio control unit 61 increases the deduplication ratio when the load on the network increases, and decreases the deduplication ratio when the load on the network decreases.

  The deduplication ratio control unit 61 may be configured to control the deduplication ratio in stages. For example, the deduplication ratio control unit 61 can be configured to increase the deduplication ratio as the load on the network increases. Further, the deduplication ratio control unit 61 can be configured to decrease the deduplication ratio as the load on the network decreases.

  The above is an example of a configuration characteristic of the backup server 6. Next, an example of the operation of the deduplication ratio control unit 61 will be described with reference to FIG.

  FIG. 11 is a flowchart illustrating an example of the operation of the deduplication ratio control unit 61. Referring to FIG. 11, the deduplication ratio control unit 61 first deduplicates a file to be deduplicated so that the ratio of a file to be deduplicated and a file to which deduplication is not performed becomes a predetermined ratio. Control the number of missing files. That is, the deduplication ratio control unit 61 sets a predetermined deduplication ratio (step S301).

  The deduplication ratio control unit 61 increases the deduplication ratio when the utilization ratio of the network bandwidth indicated by the network load information is equal to or greater than a predetermined threshold C (Yes in step S302). As a result, the deduplication unit 24 performs deduplication on more files among files transmitted at the same timing. On the other hand, the deduplication ratio control unit 61 reduces the deduplication ratio when the utilization ratio of the network band indicated by the network load information is equal to or less than a predetermined threshold D (Yes in step S303). As a result, the number of files that the deduplication unit 24 deduplicates reduces.

  The above is an example of the operation of the deduplication ratio control unit 61.

  As described above, the backup server 6 in this embodiment has the deduplication ratio control unit 61. With such a configuration, the deduplication ratio control unit 61 performs file deduplication among files transmitted to the storage apparatus 3 at the same timing according to the network load information acquired by the network load information acquisition unit 22. You can control the percentage of files that are not deduplicated. As a result, for example, the deduplication ratio control unit 61 can reduce the deduplication ratio when there is a margin in the network bandwidth. This makes it possible to reduce the amount of deduplication processing by the deduplication unit 24, and when performing deduplication in the backup server 6, there is a risk that the transfer speed of the backup target data will decrease due to an increase in time associated with deduplication. It is possible to suppress the occurrence of the problem that there is. That is, according to the present embodiment, it is possible to provide the backup server 6 that has been improved to solve the problem that the data transfer rate may be reduced.

  In the present embodiment, the backup server 6 which is a modification of the backup server 2 has been described. However, the backup server 6 may have the CPU load information acquisition 51 described in the second embodiment. That is, the deduplication ratio control unit 61 may be configured to control the deduplication ratio based on the network load information and the CPU load information.

[Fourth Embodiment]
Next, a fourth embodiment of the present invention will be described with reference to FIG. FIG. 12 is a block diagram illustrating an example of the configuration of the backup server 7.

  In the fourth embodiment, a backup server 7 that transmits data received from an external device to a storage device having a deduplication function will be described.

  FIG. 12 shows an example of the configuration of the backup server 7. Referring to FIG. 12, the backup server 7 includes a deduplication unit 71, a network load information acquisition unit 72, and a determination unit 73.

  For example, the backup server 7 includes an arithmetic device such as a CPU (not shown) and a storage device. For example, the backup server 7 implements the above-described processing units by causing the arithmetic device to execute a program stored in a storage device (not shown).

  The deduplication unit 71 performs deduplication processing on block data obtained by dividing data received from an external device. The deduplication unit 71 performs deduplication when the determination unit 73 determines to perform deduplication.

  The network load information acquisition unit 72 acquires network load information indicating the load status of the network with the storage device.

  The determination unit 73 determines whether or not the deduplication unit 71 performs deduplication processing based on the network load information acquired by the network load information acquisition unit 72. As described above, the deduplication unit 71 performs deduplication when the determination unit 73 determines to perform deduplication.

  As described above, the backup server 7 in this embodiment includes the deduplication unit 71, the network load information acquisition unit 72, and the determination unit 73. With such a configuration, the determination unit 73 can determine whether or not the deduplication unit 71 performs deduplication according to the network load information acquired by the network load information acquisition unit 72. As a result, for example, the determination unit 73 determines that the deduplication by the deduplication unit 71 is not performed even though the backup server 7 has the deduplication unit 71 when the network bandwidth is sufficient. It becomes possible to do. As a result, it is possible to reduce the amount of deduplication processing by the deduplication unit 71, and when performing deduplication in the backup server 7, there is a risk that the transfer speed of the backup target data may be reduced due to an increase in time associated with deduplication. It is possible to suppress the occurrence of the problem that there is. That is, according to the present embodiment, it is possible to provide the backup server 7 improved to solve the problem that the data transfer rate may be reduced.

  Further, the backup server 7 described above can be realized by incorporating a predetermined program into the backup server 7. Specifically, the program according to another aspect of the present invention divides the data received from the external device into the backup server 7 that transmits the data received from the external device to the storage device having the deduplication function. Obtained by the deduplication unit 71 that executes deduplication processing of block data, the network load information acquisition unit 72 that acquires network load information indicating the load status of the network between the storage devices, and the network load information acquisition unit 72 A determination unit 73 that determines whether or not the deduplication unit 71 performs deduplication processing based on the network load information, and the deduplication unit 71 determines that the determination unit 73 performs deduplication This program performs deduplication.

  Further, the backup method executed by the backup server 7 described above is that the backup server 7 that transmits the data received from the external device to the storage device having the deduplication function is the network load status with the storage device. A method of determining whether or not to perform deduplication processing of block data obtained by dividing data based on the acquired network load information, and performing deduplication based on the determination result It is.

  Even the invention of the program or the backup method having the above-described configuration can achieve the above-described object of the present invention because it has the same operation as the backup server 7. Further, the storage system having the backup server 7 and the storage device can also achieve the object of the present invention as described above.

<Appendix>
Part or all of the above-described embodiment can be described as in the following supplementary notes. The outline of the backup server and the like in the present invention will be described below. However, the present invention is not limited to the following configuration.

(Appendix 1)
A backup server that transmits data received from an external device to a storage device having a deduplication function,
A deduplication unit that performs deduplication processing of block data obtained by dividing the data received from the external device;
A network load information acquisition unit that acquires network load information indicating a load state of a network with the storage device;
A determination unit that determines whether or not the deduplication unit performs deduplication processing based on the network load information acquired by the network load information acquisition unit;
Have
The deduplication unit is a backup server that performs deduplication when the determination unit determines to perform deduplication.
(Appendix 2)
The backup server according to appendix 1,
A CPU load information acquisition unit for acquiring CPU load information indicating a load state of the CPU;
The determination unit determines whether the deduplication unit performs deduplication processing based on the network load information acquired by the network load information acquisition unit and the CPU load information acquired by the CPU load information. Backup server.
(Appendix 3)
The backup server according to appendix 2,
The determination unit, based on the network load information acquired by the network load information acquisition unit, when the value indicated by the CPU load information acquired by the CPU load information is equal to or greater than a predetermined first threshold value, A backup server that determines whether or not the deduplication unit performs deduplication processing.
(Appendix 4)
The backup server according to any one of appendix 1 to appendix 3,
The determination unit is a backup server that determines that the deduplication unit does not perform deduplication processing when the network load information acquired by the network load information acquisition unit is equal to or less than a predetermined second threshold value.
(Appendix 5)
The backup server according to any one of appendix 1 to appendix 4,
The determination unit is a backup server that determines that the deduplication unit performs deduplication processing when the network load information acquired by the network load information acquisition unit is greater than a predetermined second threshold.
(Appendix 6)
The backup server according to any one of appendix 1 to appendix 5,
A plurality of the data received from the external device are configured to be transmitted in parallel to the storage device,
Whether the determination unit performs deduplication processing on the plurality of block data obtained by dividing the data by the deduplication unit based on the network load information acquired by the network load information acquisition unit. A backup server that controls a deduplication ratio that is a ratio of the data that is deduplicated and the data that is not deduplicated.
(Appendix 7)
The backup server described in appendix 6,
The determination unit is a backup server that increases a deduplication ratio when a value indicated by the network load information acquired by the network load information acquisition unit is equal to or greater than a predetermined third threshold value.
(Appendix 8)
The backup server according to appendix 6 or appendix 7,
The determination unit is a backup server that reduces a deduplication ratio when a value indicated by the network load information acquired by the network load information acquisition unit is equal to or less than a predetermined fourth threshold value.
(Appendix 9)
The backup server according to any one of appendix 6 to appendix 8,
The determination unit is a backup server that controls the deduplication ratio stepwise based on the network load information acquired by the network load information acquisition unit.
(Appendix 10)
A backup server that transmits data received from an external device to a storage device having a deduplication function,
Obtaining network load information indicating the load status of the network with the storage device;
Based on the acquired network load information, it is determined whether to perform deduplication processing of block data obtained by dividing the data,
A backup method that performs deduplication based on the judgment results.
(Appendix 11)
To a backup server that sends data received from an external device to a storage device that has a deduplication function,
A deduplication unit that performs deduplication processing of block data obtained by dividing the data received from the external device;
A network load information acquisition unit that acquires network load information indicating a load state of a network with the storage device;
A determination unit that determines whether or not the deduplication unit performs deduplication processing based on the network load information acquired by the network load information acquisition unit;
Realized,
The deduplication unit is a program for performing deduplication when the determination unit determines to perform deduplication.
(Appendix 12)
A backup server that transmits data received from an external device to a storage device having a deduplication function, and the storage device,
The backup server
A deduplication unit that performs deduplication processing of block data obtained by dividing the data received from the external device;
A network load information acquisition unit that acquires network load information indicating a load state of a network with the storage device;
A determination unit that determines whether or not the deduplication unit performs deduplication processing based on the network load information acquired by the network load information acquisition unit;
Have
The deduplication unit performs deduplication when the determination unit determines to perform deduplication,
The storage device
A storage system that deduplicates the block data that was not deduplicated by the backup server.

  The programs described in the above embodiments and supplementary notes are stored in a storage device or recorded on a computer-readable recording medium. For example, the recording medium is a portable medium such as a flexible disk, an optical disk, a magneto-optical disk, and a semiconductor memory.

  Although the present invention has been described with reference to the above embodiments, the present invention is not limited to the above-described embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

DESCRIPTION OF SYMBOLS 1 Storage system 2 Backup server 21 Data receiving part 22 Network load information acquisition part 23 Processing determination part 24 Deduplication part 3 Storage apparatus 31 Block data receiving part 32 Deduplication part 33 Data storage part 34 Storage apparatus 4 Backup object apparatus 5 Backup server 51 CPU load information acquisition unit 52 processing determination unit 6 backup server 61 deduplication ratio control unit 7 backup server 71 deduplication unit 72 network load information acquisition unit 73 determination unit

Claims (12)

A backup server that transmits data received from an external device to a storage device having a deduplication function,
A deduplication unit that performs deduplication processing of block data obtained by dividing the data received from the external device;
A network load information acquisition unit that acquires network load information indicating a load state of a network with the storage device;
A determination unit that determines whether or not the deduplication unit performs deduplication processing based on the network load information acquired by the network load information acquisition unit;
Have
The deduplication unit is a backup server that performs deduplication when the determination unit determines to perform deduplication. The backup server according to claim 1,
A CPU load information acquisition unit for acquiring CPU load information indicating a load state of the CPU;
The determination unit determines whether the deduplication unit performs deduplication processing based on the network load information acquired by the network load information acquisition unit and the CPU load information acquired by the CPU load information. Backup server. The backup server according to claim 2,
The determination unit, based on the network load information acquired by the network load information acquisition unit, when the value indicated by the CPU load information acquired by the CPU load information is equal to or greater than a predetermined first threshold value, A backup server that determines whether or not the deduplication unit performs deduplication processing. The backup server according to any one of claims 1 to 3, wherein
The determination unit is a backup server that determines that the deduplication unit does not perform deduplication processing when the network load information acquired by the network load information acquisition unit is equal to or less than a predetermined second threshold value. The backup server according to any one of claims 1 to 4, wherein
The determination unit is a backup server that determines that the deduplication unit performs deduplication processing when the network load information acquired by the network load information acquisition unit is greater than a predetermined second threshold. The backup server according to any one of claims 1 to 5, wherein
A plurality of the data received from the external device are configured to be transmitted in parallel to the storage device,
Whether the determination unit performs deduplication processing on the plurality of block data obtained by dividing the data by the deduplication unit based on the network load information acquired by the network load information acquisition unit. A backup server that controls a deduplication ratio that is a ratio of the data that is deduplicated and the data that is not deduplicated. The backup server according to claim 6,
The determination unit is a backup server that increases a deduplication ratio when a value indicated by the network load information acquired by the network load information acquisition unit is equal to or greater than a predetermined third threshold value. The backup server according to claim 6 or 7, wherein
The determination unit is a backup server that reduces a deduplication ratio when a value indicated by the network load information acquired by the network load information acquisition unit is equal to or less than a predetermined fourth threshold value. The backup server according to any one of claims 6 to 8,
The determination unit is a backup server that controls the deduplication ratio stepwise based on the network load information acquired by the network load information acquisition unit. A backup server that transmits data received from an external device to a storage device having a deduplication function,
Obtaining network load information indicating the load status of the network with the storage device;
Based on the acquired network load information, it is determined whether to perform deduplication processing of block data obtained by dividing the data,
A backup method that performs deduplication based on the judgment results. To a backup server that sends data received from an external device to a storage device that has a deduplication function,
A deduplication unit that performs deduplication processing of block data obtained by dividing the data received from the external device;
A network load information acquisition unit that acquires network load information indicating a load state of a network with the storage device;
A determination unit that determines whether or not the deduplication unit performs deduplication processing based on the network load information acquired by the network load information acquisition unit;
Realized,
The deduplication unit is a program for performing deduplication when the determination unit determines to perform deduplication. A backup server that transmits data received from an external device to a storage device having a deduplication function, and the storage device,
The backup server
A deduplication unit that performs deduplication processing of block data obtained by dividing the data received from the external device;
A network load information acquisition unit that acquires network load information indicating a load state of a network with the storage device;
A determination unit that determines whether or not the deduplication unit performs deduplication processing based on the network load information acquired by the network load information acquisition unit;
Have
The deduplication unit performs deduplication when the determination unit determines to perform deduplication,
The storage device
A storage system that deduplicates the block data that was not deduplicated by the backup server.

Images