JP2019087287A - Managing device, storage system, storage management method, and program - Google Patents

Abstract

To dynamically improve reliability of storage data while effectively utilizing a surplus capacity of a storage.SOLUTION: A managing device of a storage system for dispersedly storing objects, based on a set replica number includes: a detection part for detecting a free space of a storage system; a change information storage part for storing change information of a replica number that is change information of a replica number including a free space of the storage system and a fractional value set in accordance with importance for each container for storing objects, and is set such that the replica number decreases from a state in which the free space of the storage system is large as the importance is smaller; and a change part for reading change information corresponding to the free space of the storage system and importance for each container for storing objects from the change information storage part, and for changing the setting of the replica number including the fractional value as an average value for each container such that the value does not fall below the lower-limit value of the replica number according to the change information of the replica number.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a management apparatus, a storage system, a storage management method, and a program.

  In recent years, distributed storage systems such as an object storage system (hereinafter referred to as object storage) are known (see, for example, Patent Document 1). In such a storage system, the reliability of the data is secured by storing the data to be stored, for example, in a distributed manner to a predetermined number of replicas (replications). Here, the number of replicas is the number of replicas (replications) including the original data. In the storage system, as the number of replicas increases, the reliability improves, but the storage capacity unit price tends to increase.

Patent No. 5396848 gazette

  However, in the storage system as described above, the reliability ensured by the set number of replicas is the minimum guaranteed level, and the reliability is improved as much as possible to reduce the risk of data loss. It is desirable to Further, in the storage system as described above, even if there is a surplus storage capacity, it is not reflected in the number of replicas, and there is a possibility that the surplus storage capacity can not be effectively used.

  The present invention has been made to solve the above problems, and an object thereof is a management apparatus, storage system, and the like, which can dynamically improve the reliability of stored data while effectively utilizing the surplus capacity of storage. A storage management method and program are provided.

  In order to solve the above problem, one aspect of the present invention is a replica number indicating the number of objects to be copied and stored that are a group of data, and the objects are distributed based on the set number of replicas. Storage management apparatus for storing data stored in the storage system, the detection unit detecting the free space of the storage system, the free space of the storage system, and the importance of each container storing the object as a lower layer below Change information of the number of replicas including a decimal value set correspondingly, wherein the number of replicas is set to decrease from a state where the storage system has a large amount of free space as the importance is lower. A change information storage unit that stores change information of the number of replicas, and the free space of the storage system detected by the detection unit The change information of the replica number corresponding to the degree of importance of each container storing the object is read from the change information storage unit, and the lower limit of the replica number determined in advance according to the read change information of the replica number read And a changing unit configured to change the setting of the number of replicas including the decimal value as an average value of the containers so as not to fall below the value.

  Further, according to one aspect of the present invention, in the management apparatus, the replica number storage unit stores the upper limit value and the lower limit value of the replica number, and the change unit stores the container and the importance in association with each other. The degree of importance of each container is acquired from the degree of importance storage unit, and the upper limit value and the lower limit value stored in the replica number storage unit are stored based on the acquired degree of importance of each container and the free space. The setting of the number of replicas may be changed between the containers.

Further, according to one aspect of the present invention, in the management apparatus, the replica number storage unit stores an upper limit value and a lower limit value of the replica number for each degree of importance, and among the upper limit value and the lower limit value of the replica number At least one of which is set based on the importance of the container.
Further, according to one aspect of the present invention, in the management apparatus, the detection unit periodically detects the free space of the storage system, and the change unit detects the free space of the storage system 1 detected by the detection unit. Setting the number of replicas periodically.

  Further, according to one aspect of the present invention, there is provided the management device as described above, and the object stored under the container such that the average number of replicas in the container is the number of replicas set by the management device. And a server device that adjusts the number of replicas.

  Further, according to one aspect of the present invention, in the storage system described above, the storage system includes a plurality of storage devices in which copies of the stored object are deleted or added based on the number of replicas changed by the management device. The server apparatus is characterized in that, in the storage apparatus, when deleting or adding a duplicate of the object, the object having a large size is prioritized among the objects stored under the container.

  Further, according to one aspect of the present invention, there is provided a storage number, which is the number of replicas indicating the number of objects to be copied and stored that are a collection of data, and distributed based on the set number of replicas. Change information of the number of replicas including a free space and a decimal value set corresponding to the importance of each container that stores the object under the lower hierarchy, the lower the importance, the lower the importance A storage management method of a storage system comprising: a change information storage unit storing change information of the number of replicas set so that the number of replicas decreases from a state where there is a large amount of free space in the storage system; A detection step of detecting the free space of the storage system; and the stress detected by the change unit at the detection step. The change information of the number of replicas corresponding to the free space of the storage system and the degree of importance of each container storing the object is read from the change information storage unit and determined in advance according to the change information of the read number of replicas And changing the setting of the number of replicas including the decimal value as an average value for each container so as not to fall below the lower limit value of the number of replicas.

  Further, according to one aspect of the present invention, there is provided a storage number, which is the number of replicas indicating the number of objects to be copied and stored that are a collection of data, and distributed based on the set number of replicas. Change information of the number of replicas including a free space and a decimal value set corresponding to the importance of each container that stores the object under the lower hierarchy, the lower the importance, the lower the importance The free space of the storage system is detected in a computer of a storage system including a change information storage unit that stores change information of the number of replicas set so that the number of replicas decreases from a state where the free capacity of the storage system is large Detecting step, the free capacity of the storage system detected in the detecting step, and The change information of the number of replicas corresponding to the degree of importance of each container storing objects is read from the change information storage unit, and the lower limit value of the number of replicas determined in advance according to the change information of the read number of replicas And a change step of changing the setting of the number of replicas including the fractional value as an average value for each container so as not to be less than.

  According to the present invention, the reliability of stored data can be dynamically improved while effectively utilizing the surplus capacity of the storage.

FIG. 1 is a block diagram showing an example of a storage system according to a first embodiment. It is a figure which shows an example of the ring file memory | storage part in this embodiment. It is a figure which shows the example of data of the ring information of the ring file in this embodiment. It is a figure which shows the example of data of the device list information of the ring file in this embodiment. It is a figure which shows the example of data of the account information in this embodiment. It is a figure showing an example of data of container list information in this embodiment. It is a figure showing an example of data of container information in this embodiment. It is a figure showing an example of data of object list information in this embodiment. It is a figure which shows the example of data of the replica number memory | storage part in this embodiment. It is a figure which shows an example of the change information of the number of replicas in this embodiment. It is a figure which shows an example of the logical hierarchical structure of the storage in this embodiment. It is a figure which shows an example of the change process of the number of replicas in this embodiment. It is a flowchart which shows an example of the addition process of the object in this embodiment. It is a flowchart which shows an example of the change process of the number of replicas in this embodiment. It is a flowchart which shows an example of adjustment processing of the number of replicas in this embodiment. It is a block diagram showing an example of a storage system by a 2nd embodiment. It is a figure which shows the example of data of the replica number memory | storage part in 2nd Embodiment.

  Hereinafter, a storage system and a management apparatus according to an embodiment of the present invention will be described with reference to the drawings.

First Embodiment
FIG. 1 is a block diagram showing an example of a storage system 1 according to the first embodiment.
As shown in this figure, the storage system 1 includes a proxy node 20, a plurality of storage nodes (31, 32, 33,...), And a management apparatus 10. The proxy node 20, the storage nodes (31, 32, 33,...), And the management device 10 are connected to one another via the network NT. The storage system 1 is also connectable to the client terminal 2 via the network NT.

The storage system 1 is, for example, an object storage system, and distributes and stores data based on the set number of replicas. Here, the number of replicas indicates the number of data to be replicated and stored, and is the number of replicas (replications) including the original data.
Further, in the present embodiment, a group of data is referred to as an "object". The storage system 1 distributes and stores one object in a plurality of storage nodes (31, 32, 33,...) Based on the set number of replicas.

  Each of the storage node 31, the storage node 32, the storage node 33,... Has ring file storage units (311, 321, 331) described later, and is the same in configuration for storing objects. The storage node 31, the storage node 32, the storage node 33,... Will be described as the storage node 30 when indicating any storage node provided in the storage system 1 or when not making a distinction in particular.

  The client terminal 2 is a computer device that transmits a write request or read request of an object to a storage provided in the storage system 1, and, for example, the end user performs a service such as provision of resources via a terminal device or a network NT. Server device provided to The client terminal 2 requests the proxy node 20 to write, read, or delete an object.

The proxy node 20 is, for example, a server device, and distributes processing to each storage node 30 in response to a request from the client terminal 2. For example, upon receiving an object write request from the client terminal 2, the proxy node 20 selects a plurality of storage nodes 30 specified by ring files, which will be described later, from all the storage nodes 30 and selects the plurality of storage nodes 30 selected. Send a write request for the same object to. In the example illustrated in FIG. 1, the storage system 1 is described as including one proxy node 20. However, the storage system 1 may include a plurality of proxy nodes 20.
The proxy node 20 also includes a storage unit 210.

The storage unit 210 stores information used for various processes of the proxy node 20. The storage unit 210 includes, for example, a ring file storage unit 211.
The ring file storage unit 211 stores a ring file. Here, the ring file is, for example, table information that associates data (for example, an object) with a physical position (server apparatus, disk) in which the data is stored. Details of the ring file will be described later. For example, as shown in FIG. 2, the ring file storage unit 211 stores a plurality of ring files corresponding to the degree of importance of data.

FIG. 2 is a diagram showing an example of the ring file storage unit 211 in the present embodiment.
In the example shown in this figure, the ring file storage unit 211 includes a plurality of ring files (“Ring file A”, “Ring file B”,...). Each ring file stored in the ring file storage unit 211 corresponds to the degree of importance of data, and in the present embodiment, the ring file storage unit 211 stores a ring file for each degree of importance.

  The ring file includes, for example, ring information which is a table for specifying a storage destination (device) of an object, and device list information. The ring information includes the head portion (prefix) of the hash value calculated from the object name, the storage location (including the device ID and storage location candidate) of the object corresponding to the head portion, the number of replicas and the importance It is the associated information. Here, it is assumed that the hash value is calculated so that the storage destination is equally allocated.

FIG. 3 is a diagram showing an example of data of ring information of a ring file in the present embodiment.
As shown in FIG. 3, the ring information is, for example, information in which “prefix”, a device ID corresponding to the “prefix”, “importance level”, and “number of replicas” are associated. Further, the ring information includes “first device ID”, “second device ID”, “third device ID”,... Corresponding to “prefix”. Here, the "prefix" is the head portion of the hash value calculated from the above-described object name. Also, “first device ID”, “second device ID”, “third device ID”,... Indicate identification information for identifying a device in which an object is stored.

  In the example shown in FIG. 3, for example, an object whose “prefix” is “00” has “1st device ID” “3” and “second device ID” “0” as storage destinations. The “third device ID” is stored in the order of “2”,... Devices. Further, in the ring information, it is indicated that the "importance" is "50" and the set "number of replicas" is "3.0". In the ring information, more devices than the set “number of replicas” are designated for each “prefix” in consideration of the fact that the devices are not operating.

FIG. 4 is a diagram showing an example of data of device list information of a ring file in the present embodiment.
As shown in FIG. 4, the device list information includes a plurality of pieces of information in which “device ID”, “IP address”, “port”, and “device name” are associated. Here, "device ID" indicates identification information for identifying a device (server apparatus, disk). Also, “IP address” and “port” indicate the IP address and port number of the device. Also, "device name" indicates the name of the device.

In the example shown in FIG. 4, the “IP address” of the device corresponding to “0” of “device ID” is “x.x.x.x”, “port” is “8000”, and “device name” is “ZZ”. It shows that it is ".
As described above, the ring file sets the “number of replicas” and specifies the “IP address”, “port” and “device name” of the storage destination device from the object name.

Returning to the description of FIG. 1, the storage node 30 (an example of a storage device) is, for example, a server device including a storage (storage device), and performs processing in response to a request received from the proxy node 20, for example. For example, when a write request or read request for an object is received from the proxy node 20, the storage node 30 writes or reads the object and transmits it to the proxy node 20.
The storage node 30 includes a storage node 31 (account server) that manages an account, a storage node 32 (container server) that manages a container, and the like, in addition to a normal storage node 33 that stores objects. Here, the container indicates, for example, a container for storing an object, and corresponds to a directory or folder in the file system. Moreover, an account shows the container which stores a container, for example. Thus, the hierarchical structure above objects is a container, the hierarchy above containers is an account, and objects, containers, and accounts indicate the hierarchical structure of data.

The storage node 31 (account server), for example, stores an object and manages an account. The storage node 31 includes, for example, a storage unit 310.
The storage unit 310 stores information used for various processes of the storage node 31. The storage unit 310 includes, for example, a ring file storage unit 311 and an account information storage unit 312.

The ring file storage unit 311 is the same as the ring file storage unit 211 described above, and thus the description thereof is omitted here.
The account information storage unit 312 stores account management information for managing an account. The account information storage unit 312 stores, for example, account information and container list information as account management information.

FIG. 5 is a view showing an example of data of account information in the present embodiment.
As shown in FIG. 5, the account information storage unit 312 stores, for example, “account name”, “number of containers”, “hash value of name”, and “account ID” in association with each other as account information. Here, "account name" indicates the name of the account, and "hash value of name" indicates a hash value of "account name". Also, "the number of containers" indicates the number of containers existing under the account, and "account ID" indicates identification information for identifying the account.
In the example shown in FIG. 5, the account whose "Account Name" is "ABC" has "3" containers under the "Account Name" has "XXXXXXXXXXXX" and "Account ID" is "YYYYYYYY". It shows that it is ".

Moreover, FIG. 6 is a figure which shows the example of data of container list information in this embodiment.
As shown in FIG. 6, the account information storage unit 312 may, for example, “NO.”, “Container name”, “creation time”, “deletion time”, “name hash value”, “container The container list information having a plurality of pieces of information associated with the ID is stored. Here, “NO.” Indicates the line number of the container list information, and “container name” indicates the name of the container. Further, “creation time” and “deletion time” indicate creation time and deletion time of the container, and “hash value of name” indicates a hash value of the “container name”. Moreover, "container ID" has shown the identification information which identifies a container.

  In the example shown in FIG. 6, in the container where "NO." Is "1", "container name" is "testcont1" and "creation time" is "2014-10-01 10:00:00" Is shown. Also, "name hash value" is "YYYYYYYYYYYY". It indicates that the "container ID" is "ZZZZZ".

Returning to the description of FIG. 1 again, the storage node 32 (container server) manages, for example, the object while storing the object. The storage node 32 includes, for example, a storage unit 320.
The storage unit 320 stores information used for various processes of the storage node 32. The storage unit 320 includes, for example, a ring file storage unit 321 and a container information storage unit 322.

The ring file storage unit 321 is the same as the ring file storage unit 211 described above, and thus the description thereof is omitted here.
The container information storage unit 322 (an example of the importance degree storage unit) stores container management information that manages a container. The container information storage unit 322 stores, for example, container information and object list information as container management information.

FIG. 7 is a diagram showing an example of data of container information in the present embodiment.
As shown in FIG. 7, the container information storage unit 322, for example, “account name”, “container name”, “creation time”, “deletion time”, “number of objects”, “number of bytes” , “Name hash value”, “container ID”, and “importance” are stored as container information in association with each other. Here, the “account name” indicates the name of the higher-level account, and the “container name” indicates the name of the container. In addition, “creation time”, “deletion time”, “hash value of name”, and “container ID” are the same as the above-described container list information. Also, “number of objects” and “number of bytes” indicate the number of objects subordinate to the container and the number of bytes of data, and “importance” indicates the importance of the container.
As described above, the container information storage unit 322 associates and stores the container (hierarchical structure) for storing data and the importance.

  In the example shown in FIG. 7, the container information whose "container name" under "account name" is "ABC" is "testcont1" is shown, and "the number of objects" and "the number of bytes" are "14" and " It indicates that it is 8096 "bytes. It also indicates that the "importance" of the container is "50".

FIG. 8 is a view showing an example of data of object list information in the present embodiment.
As shown in FIG. 8, for example, the container information storage unit 322 includes “NO.”, “Object name”, “creation time”, “number of bytes”, “content type”, and “hash value”. And object list information having a plurality of pieces of information in which the “deleted flag” is associated with each other. Here, “NO.” Indicates the line number of the object list information, and “object name” indicates the name of the object. Also, “creation time” indicates the creation time of the object, and “number of bytes” and “content type” indicate the number of bytes of the object and the type of object (eg, image, moving image, text, etc.). Also, “hash value” indicates a hash value of the “object name”, and “deletion flag” indicates whether the object is deleted.

In the example shown in FIG. 8, for an object whose “NO.” Is “1”, the “object name” is “obj1” and the “creation time” is “2014-10-02 10:00:00”. Is shown. Also, it indicates that the “number of bytes” is “3072” bytes and the “content type” is “image / jpeg” (jpeg image). Also, the “hash value” is “AAAAAAAAAAAA”. It indicates that the "deleted flag" is "NO".
In the above-mentioned example, although one account and one container were explained for explanation, storage system 1 may contain a plurality of accounts and containers.

Referring back to FIG. 1 again, the storage node 33 (30) stores, for example, an object, and includes, for example, a storage unit 330.
The storage unit 330 stores information used for various processes of the storage node 33. The storage unit 330 includes, for example, a ring file storage unit 331.
The ring file storage unit 331 is the same as the ring file storage unit 211 described above, and thus the description thereof is omitted here.

The management device 10 is a computer device that manages the number of replicas of the storage system 1. The management device 10 includes, for example, a management storage unit 110 and a management control unit 120.
The management storage unit 110 stores information used for various processes of the management apparatus 10. The management storage unit 110 includes, for example, a replica number storage unit 111 and a change information storage unit 112.

The replica number storage unit 111 stores, for example, the upper limit value and the lower limit value of the number of replicas, as shown in FIG. In the present embodiment, the upper limit value and the lower limit value of the number of replicas in the entire storage system 1 are predetermined, and the replica number storage unit 111 is the upper limit value and the lower limit value of the number of replicas in the entire storage system 1. Remember.
FIG. 9 is a view showing an example of data of the replica number storage unit 111 in the present embodiment.
As shown in this figure, the replica number storage unit 111 stores the “upper limit value” and the “lower limit value” in association with each other. Here, “upper limit value” indicates the upper limit value of the number of replicas in the entire storage system 1, and “lower limit value” indicates the lower limit value of the number of replicas in the entire storage system 1.
The example shown in FIG. 9 indicates that the “upper limit value” is “5” and the “lower limit value” is “2”.

  Referring back to FIG. 1 again, the change information storage unit 112 stores change information of the number of replicas for changing the setting of the number of replicas according to the free space of the storage system 1. The change information storage unit 112 is, for example, table information specifying the number of replicas corresponding to the free capacity of the storage system 1 in the range between the “upper limit value” and the “lower limit value” stored in the replica number storage unit 111. is there. In addition, the change information storage unit 112 may store, for example, different change information according to the degree of importance of each container. For example, as shown in FIG. 10, the change information storage unit 112 stores table information that is changed according to the free space of the storage system 1.

FIG. 10 is a diagram showing an example of change information of the number of replicas in the present embodiment.
The graph shown in FIG. 10 shows the setting of the number of replicas with respect to the free space, the vertical axis shows the number of replicas, and the horizontal axis shows the free space (%).
As shown in this figure, the change information of the number of replicas is larger as the free space is larger between “2” of “lower limit value” and “5” of “upper limit value” stored in replica number storage unit 111, The number of replicas is set to be large. In this figure, the waveform W1 shows an example of change information when the degree of importance is the highest, and the waveform W2 shows an example of change information when the degree of importance is the second highest. Further, the waveform W3 shows an example of change information in the case where the degree of importance is the lowest.
As described above, in the embodiment, the change information of the number of replicas is set according to the degree of importance, and as the degree of importance is lower, the number of replicas is set to decrease from the state where the free space is large.

  The number of replicas is not limited to a natural number, and may be a real number including a natural number and a decimal. When the number of replicas is a real number including decimals, for example, as shown in FIG. 11, the storage system 1 replicates and stores each object so that the number of replicas can be realized as an average value for each container.

FIG. 11 is a diagram showing an example of the logical hierarchical structure of the storage in this embodiment.
The example illustrated in FIG. 11 illustrates an example in the case where the container C1 is present under the account A1, for example. The container C1 stores "object 1" (OB1), "object 2" (OB2), and "object 3" (OB3). Here, the number of replicas of “object 1” (OB1) and “object 2” (OB2) is “3”, respectively, and is stored in three places. The "object 3" (OB3) has a replica number of "2" and is stored in two places. In this case, the number of replicas of the container C1 as a whole is "2.666" according to the following equation (1).

  Number of replicas = (3 + 3 + 2) /3=2.666 (1)

  As described above, in the storage system 1 according to the present embodiment, it is possible to set the number of replicas using real values including decimals for each container.

  Referring back to FIG. 1 again, the management control unit 120 is, for example, a processor including a CPU (Central Processing Unit) and the like, and centrally controls the management apparatus 10. The management control unit 120 includes, for example, a free space detection unit 121 and a ring change unit 122.

  The free space detection unit 121 (an example of a detection unit) detects the free space of the storage system 1. The free capacity detection unit 121 detects the free capacity of the storage system 1 periodically at predetermined time intervals. The free space detection unit 121 acquires, for example, account management information stored by the account server corresponding to each account and container management information stored by the container server corresponding to each container, and the acquired account management information and container management The free space of the storage system 1 is detected based on the information.

  The ring changing unit 122 (an example of the changing unit) sets the number of replicas so as not to fall below the predetermined lower limit of the number of replicas according to the free space of the storage system 1 detected by the free space detection unit 121. change. The ring changing unit 122 acquires, for example, the importance of each container from the container information storage unit 322 which stores the container storing data and the importance in association with each other. The ring changing unit 122 changes, for each container, the setting of the number of replicas between the upper limit value and the lower limit value stored in the replica number storage unit 111 based on the acquired degree of importance for each container and the free space. That is, the ring changing unit 122 determines the number of replicas for each container based on the degree of importance and the free space, and changes the number of replicas in the ring file to the determined number of replicas. 20 and the storage node 30). That is, the ring changing unit 122 updates (replaces) the ring file stored by each node.

  For example, the ring changing unit 122 acquires the upper limit value and the lower limit value stored in the replica number storage unit 111. When the upper limit value is “5” and the lower limit value is “2”, the ring changing unit 122 refers to the change information stored in the change information storage unit 112, and the replica corresponding to the acquired importance level for each container Determine the number (the number of replicas between the upper limit "5" and the lower limit "2"). For example, as shown in FIG. 10, the ring changing unit 122 determines the number of replicas including the natural number and the decimal according to the free space of the storage system 1. Also, the ring changing unit 122 generates a ring file reflecting the determined number of replicas. Then, the ring changing unit 122 distributes the generated ring file to each node (proxy node 20 and storage node 30).

  The proxy node 20 described above periodically checks the number of replicas in the ring file stored in the ring file storage unit 211 and the container management information stored in the container information storage unit 322, and Change the number of replicas of each object according to the change. That is, the proxy node 20 periodically adjusts the number of replicas of each object so that the average number of replicas of each container matches the number of replicas in the ring file. That is, the proxy node 20 adjusts the number of replicas of data stored under the container so that the average number of replicas in the container becomes the number of replicas set by the management device 10.

Next, the operation of the storage system 1 according to the present embodiment will be described with reference to the drawings.
FIG. 12 is a diagram showing an example of the process of changing the number of replicas in the present embodiment.
In FIG. 12, an example in which the storage system 1 has five containers of "container A" to "container E" is shown. In this example, the importance of “container A” and “container B” is “100”, the importance of “container C” and “container D” is “50”, and the importance of “container C” is It shall be "10". In addition, importance is assumed to be higher as the value is larger. Further, in this example, it is assumed that the “upper limit value” stored in the replica number storage unit 111 is “3” and the “lower limit value” is “2”.

  FIG. 12A shows a state (for example, 80%) in which the free capacity of the storage system 1 is large. In this case, the management apparatus 10 sets the number of replicas of the ring file whose importance is "100" to "3", and the number of replicas of the ring file whose importance is "50" to "3", the importance The number of ring file replicas corresponding to “10” is set to “3”. In this case, the proxy node 20 adjusts the deletion or addition of each object so that the average number of replicas of each container matches the number of replicas in the ring file.

  Next, FIG. 12 (b) shows a state (for example, 50%) in which the free capacity of the storage system 1 is reduced as compared with FIG. 12 (a). In this case, the management apparatus 10 sets the number of replicas of the ring file whose importance is "100" to "3", and the number of replicas of the ring file whose importance is "50" to "3", the importance Set the number of ring file replicas corresponding to "10" to "2.5" respectively. In this case, the proxy node 20 deletes and adjusts the duplicate of the object of “container E” so that the number of replicas of “container E” matches “2.5”.

  Next, FIG. 12C shows a state (for example, 10%) in which the free capacity of the storage system 1 is further reduced from FIG. 12B. In this case, the management apparatus 10 sets the number of ring file replicas corresponding to the importance level “100” to “3”, and the number of ring file replicas corresponding to the importance level “50” to “2.6”, The number of ring file replicas corresponding to the importance level "10" is set to "2" respectively. In this case, the proxy node 20 deletes the duplicates of the objects of “container C” and “container D” so that the numbers of replicas of “container C” and “container D” match “2.6”. adjust. Further, the proxy node 20 deletes and adjusts the duplicate of the object of “container E” so that the number of replicas of “container E” matches “2”.

  Thus, the management apparatus 10 (ring changing unit 122) sets the number of replicas between the upper limit value and the lower limit value stored in the replica number storage unit 111 based on the free space of the storage system 1 for each container. change.

Next, with reference to FIG. 13, the operation of the object addition processing of the storage system 1 in the present embodiment will be described.
FIG. 13 is a flowchart showing an example of the process of adding an object in the present embodiment.

  In this figure, first, the proxy node 20 determines whether there is a request for adding an object (step S101). That is, for example, the proxy node 20 determines whether there is a request for adding an object from the client terminal 2 via the network NT. The proxy node 20 advances the process to step S102 when there is an object addition request (step S101: YES). In addition, when there is no request for adding an object (step S101: NO), the proxy node 20 returns the process to step S101.

  In step S102, the proxy node 20 acquires container management information. That is, the proxy node 20 acquires container management information (see FIGS. 7 and 8) stored in the container information storage unit 322 of the storage node 33 (container server). Here, the proxy node 20 acquires, for example, the importance of the container.

  Next, the proxy node 20 refers to the ring file corresponding to the container (step S103). That is, the proxy node 20 refers to the ring file corresponding to the degree of importance of the container from the ring file storage unit 211.

  Next, the proxy node 20 determines the arrangement of the object to be added based on the referenced ring file (step S104). The proxy node 20 determines a plurality of devices specified by the ring information (see FIG. 3) in the ring file based on the setting of the number of replicas in the ring file. Here, the proxy node 20 specifies the device corresponding to the “device ID” of the ring information by the device list information shown in FIG. The proxy node 20 instructs the device of each storage node 30 to arrange the determined object.

  Next, the storage node 30 arranges the objects based on the arrangement instruction of the objects (step S105). That is, the storage node 30 adds an object based on the placement instruction of the object.

  Next, the proxy node 20 updates container management information (step S106). That is, for example, the proxy node 20 adds an object to the container management information stored in the container information storage unit 322 of the storage node 33 (container server) to which the object is added. The proxy node 20 changes, for example, the “number of objects” and the “number of bytes” of the container information stored in the container information storage unit 322, and adds a line corresponding to the object added to the object list information. After the process of step S106, the proxy node 20 returns the process to step S101.

  In the example shown in FIG. 13 described above, an example of adding an object has been described, but deleting an object is basically the same as the process shown in FIG. However, when deleting an object, the proxy node 20 changes the “deleted flag” of the row corresponding to the object to be deleted in the object list information stored in the container information storage unit 322 to “YES”.

Next, with reference to FIG. 14, the operation of the process of changing the number of replicas of the storage system 1 in the present embodiment will be described.
FIG. 14 is a flowchart showing an example of the process of changing the number of replicas in the present embodiment. In addition, the process shown in FIG. 14 shall be regularly performed by a predetermined time interval (for example, a several-minute unit or several-hour unit).

  In this figure, first, the management device 10 detects the free space of the storage system 1 (step S201). That is, the free space detection unit 121 of the management device 10 acquires, for example, account management information stored by the account server corresponding to each account and container management information stored by the container server corresponding to each container. The free space detection unit 121 detects the free space of the storage system 1 based on the acquired account management information and container management information.

  Next, the management device 10 determines the number of replicas according to the free space (step S202). That is, the ring changing unit 122 of the management device 10 determines the number of replicas based on the free space detected by the free space detection unit 121. Specifically, based on the change information stored in the change information storage unit 112 and the free space, the ring change unit 122 fits within the range of the upper limit value and the lower limit value of the number of replicas stored in the replica number storage unit 111. In addition, determine the number of replicas for each degree of importance. The number of replicas determined here is a real value including a natural number and a decimal.

  Next, the ring changing unit 122 generates a ring file (step S203). That is, the ring changing unit 122 generates a ring file for each degree of importance based on the determined number of replicas for each degree of importance. Specifically, the ring changing unit 122 generates, for example, a ring file in which the number of replicas in the current ring file has been changed. In the present embodiment, the “importance” is stored in the container information stored in the container information storage unit 322, and the importance is determined for each container. Therefore, the ring changing unit 122 changes the number of replicas in units of containers by changing the number of replicas of the ring file.

  Next, the ring changing unit 122 distributes the generated ring file (step S204). That is, the ring changing unit 122 transmits the generated ring file for each degree of importance to the proxy node 20 and the storage node 30. Thereby, the proxy node 20 and the storage node 30 store the received ring file in the ring file storage unit (211, 311, 321, 331), and update the ring file. As a result, the number of replicas set in the ring file held by each node (proxy node 20 and storage node 30) is updated. After the process of step S204, the ring changing unit 122 ends the process.

Next, adjustment processing of the number of replicas in which the number of replicas for each container of the storage node 30 is changed based on the updated ring file in the storage system 1 will be described with reference to FIG.
FIG. 15 is a flowchart showing an example of the adjustment processing of the number of replicas in the present embodiment. In addition, the process shown in FIG. 15 shall be regularly performed by a predetermined time interval (for example, a few minutes etc.).

  In this figure, first, the storage system 1 confirms a ring file (step S301). For example, the proxy node 20 checks each ring file stored in the ring file storage unit 211. The proxy node 20 confirms, for example, the importance of the ring file and the number of replicas.

  Next, the proxy node 20 confirms the object of the container corresponding to the ring file (step S302). The proxy node 20 acquires, for example, the container management information stored in the container information storage unit 322, and confirms the objects in the container by the ring file in which the importance of the container management information matches. The proxy node 20 calculates, for example, the average number of replicas in the current container.

  Next, the proxy node 20 determines whether it is necessary to change the placement of the object (step S303). That is, the proxy node 20 determines, for each container, whether the number of replicas set in the ring file matches the average number of replicas in the current container. If the proxy node 20 needs to change the arrangement of objects (step S303: YES), the process proceeds to step S304. The proxy node 20 ends the process when it is not necessary to change the arrangement of the objects (step S303: NO).

  In step S304, the proxy node 20 determines an object to increase or decrease a replica (replica). That is, the proxy node 20 determines an object to be deleted or added so that the number of replicas set in the ring file matches the average number of replicas in the container, in the container that needs to be changed. In addition, when deleting or adding a duplicate of an object, the proxy node 20 gives priority to an object having a large size among objects in the container. That is, when deleting or adding a duplicate of an object in the storage node 30, the proxy node 20 gives priority to an object having a large size among objects stored under the container.

  Next, the proxy node 20 deletes or adds the determined object (step S305). The proxy node 20 instructs the storage node 30 to delete or add the determined object to delete or add the determined object. The storage node 30 executes deletion or addition of an object based on an instruction from the proxy node 20. Note that deletion or addition of an object is performed on a device set by the corresponding ring file.

  Next, the proxy node 20 updates container management information (step S306). That is, among the container management information stored in the container information storage unit 322, the proxy node 20 updates the container management information corresponding to the container on which the deletion or addition of the object has been performed. After the process of step S306, the proxy node 20 ends the process.

  As described above, in the storage system 1, the proxy node 20 periodically checks the ring file and the container management information to obtain the number of replicas corresponding to the change in the setting of the number of replicas of the ring file. Adjust each time.

As described above, the management apparatus 10 according to the present embodiment is a management apparatus of the storage system 1 that distributes and stores data (for example, objects) based on the set number of replicas, and the free space detection unit 121 (detection unit) and a ring change unit 122 (change unit). Here, the number of replicas indicates, for example, the number of data replicated and stored. The free space detection unit 121 detects the free space of the storage system 1. The ring changing unit 122 changes the setting of the number of replicas so as not to fall below the predetermined lower limit of the number of replicas according to the free space of the storage system 1 detected by the free space detection unit 121.
Thus, the management apparatus 10 according to the present embodiment increases the number of replicas, for example, when the free space is large, and reduces the number of replicas, for example, when the free space is small. Can be enhanced. Therefore, the management apparatus 10 according to the present embodiment can dynamically improve the reliability of stored data while effectively utilizing the surplus capacity of the storage.

Further, in the present embodiment, the management apparatus 10 includes the replica number storage unit 111 that stores the upper limit value and the lower limit value of the number of replicas. The ring changing unit 122 acquires the importance of each container from the container information storage unit 322 (importance storage unit) that stores the container (hierarchical structure) storing data and the importance in association with each other. The ring changing unit 122 changes, for each container, the setting of the number of replicas between the upper limit value and the lower limit value stored in the replica number storage unit 111 based on the acquired degree of importance for each container and the free space.
Thereby, the management apparatus 10 according to the present embodiment appropriately changes the number of replicas between the upper limit value and the lower limit value stored in the replica number storage unit 111 based on the degree of importance for each container and the free space. can do.

Further, in the present embodiment, the ring changing unit 122 generates a ring file in which the number of replicas has been changed, and transmits the generated ring file to the proxy node 20 (proxy device) and the storage node 30 (storage device).
Thereby, the management device 10 according to the present embodiment uses the conventional object storage by providing the proxy node 20 and the storage node 30 with the ring file in which the number of replicas is changed according to the free space and the degree of importance. The number of replicas can be dynamically changed by a simpler method.

In addition, the storage system 1 according to the present embodiment is stored under the container so that the average number of replicas in the above-described management apparatus 10 and containers (hierarchical structure) becomes the number of replicas set by the management apparatus 10 And a proxy node 20 for adjusting the number of replicas of data.
Thus, in the storage system 1 according to the present embodiment, for example, a decimal value can be set as the number of replicas, and the degree of freedom in setting the number of replicas can be increased.

Further, the storage system 1 according to the present embodiment is provided with a plurality of storage nodes 30 (storage devices) in which a copy of stored data is deleted or added based on the number of replicas changed by the management device 10 . When deleting or adding data duplication in the storage node 30, the proxy node 20 gives preference to data having a large size among data stored under the container (hierarchical structure).
As a result, when the number of replicas is changed, for example, the number of replicas is changed from an object having a large size, so that the storage system 1 according to the present embodiment can promptly cope with the change of the free space. Therefore, the storage system 1 according to the present embodiment can dynamically improve the reliability of stored data while effectively utilizing the surplus capacity of the storage.

Further, the storage management method according to the present embodiment is a storage management method of the storage system 1 in which data is distributed and stored based on the set number of replicas, which is the number of replicas indicating the number of data to be replicated and stored. And includes a detection step and a change step. In the detection step, the management device 10 detects the free space of the storage system 1. In the change step, the management device 10 changes the setting of the number of replicas so as not to fall below the predetermined lower limit value of the number of replicas, according to the free space of the storage system 1 detected in the detection step.
Thereby, the storage management method according to the present embodiment can improve the reliability of stored data dynamically while effectively utilizing the surplus capacity of the storage, similarly to the management device 10 and the storage system 1 described above. .

Second Embodiment
Next, a storage system and a management apparatus according to a second embodiment will be described with reference to the drawings.
The present embodiment differs from the above-described first embodiment in that the upper limit value and the lower limit value of the number of replicas are changed according to the degree of importance.

FIG. 16 is a block diagram showing an example of a storage system 1a according to the second embodiment.
As shown in this figure, the storage system 1a includes a proxy node 20, a plurality of storage nodes (31, 32, 33,...), And a management device 10a. The proxy node 20, the storage nodes (31, 32, 33,...), And the management device 10a are connected to one another via the network NT. The storage system 1a is also connectable to the client terminal 2 via the network NT.
In this figure, the same components as those shown in FIG. 1 are denoted by the same reference numerals and the description thereof will be omitted.

The management device 10a is a computer device that manages the number of replicas of the storage system 1a. The management device 10a includes, for example, a management storage unit 110a and a management control unit 120a.
The management storage unit 110a stores information used for various processes of the management device 10a. The management storage unit 110 a includes, for example, a replica number storage unit 111 a and a change information storage unit 112.

The replica number storage unit 111a stores, for example, the upper limit value and the lower limit value of the number of replicas, as shown in FIG. In the present embodiment, the upper limit value and the lower limit value of the number of replicas are determined in advance for each degree of importance, and the replica number storage unit 111a associates the importance level with the upper limit value and the lower limit value of the number of replicas. To memorize.
FIG. 17 is a diagram showing an example of data of the replica number storage unit 111a in the present embodiment.
As shown in this figure, the replica number storage unit 111 a associates and stores “importance level”, “upper limit value”, and “lower limit value”. Here, the “importance” is, for example, the importance set for each container.
In the example shown in FIG. 17, when the “importance level” is “100”, it is indicated that the “upper limit value” is “5” and the “lower limit value” is “3”. Further, when the “importance level” is “10”, it indicates that the “upper limit value” is “3” and the “lower limit value” is “2”.
Thus, the replica number storage unit 111a stores the upper limit value and the lower limit value of the replica number for each degree of importance. In the example shown in FIG. 17 described above, an example has been described in which the upper limit value and the lower limit value of the number of replicas are changed for each degree of importance, but at least one of the upper limit value and the lower limit value of the number of replicas is for each degree of importance It may be changed.

  Returning to the description of FIG. 16, the change information storage unit 112 of this embodiment is the same as that of the first embodiment, except that the upper limit value and the lower limit value of the number of replicas for each importance are set.

  The management control unit 120a is, for example, a processor including a CPU, and centrally controls the management device 10a. The management control unit 120a includes, for example, a free space detection unit 121, a ring change unit 122a, and an importance change unit 123.

  The ring changing unit 122a is basically the same as the ring changing unit 122 in the first embodiment, except that the upper limit value and the lower limit value for each degree of importance stored in the replica number storage unit 111a are used. The ring changing unit 122a acquires the importance of each container from the container information storage unit 322, and acquires the upper limit value and the lower limit of the number of replicas corresponding to the acquired importance of each container from the replica number storage unit 111a. The ring changing unit 122a changes the setting of the number of replicas for each container between the upper limit value and the lower limit value of the acquired number of replicas.

  The importance change unit 123 (an example of a change unit) changes the importance of each container in response to a change request from the client terminal 2, for example. The importance changing unit 123 changes the value of “importance” stored in the container information storage unit 322 based on the acquired change request. In addition to the change request from the client terminal 2, the importance change unit 123 may change the importance according to the access frequency to each container. That is, the importance changing unit 123 detects the access frequency to each container, and executes, for example, processing to increase the importance of the container with high access frequency. In the storage system 1a of the present embodiment, the upper limit value and the lower limit value of the number of replicas corresponding to the container are changed by raising the importance of the container with high access frequency, and the reliability of stored data is improved.

As described above, in the management device 10a according to the present embodiment, the replica number storage unit 111a stores the upper limit value and the lower limit value of the number of replicas for each degree of importance. Here, at least one of the upper limit value and the lower limit value of the number of replicas is set based on the importance of the container (hierarchical structure).
As a result, the management apparatus 10a according to the present embodiment can flexibly change the number of replicas for each container according to the degree of importance.

Further, the management device 10a according to the present embodiment includes the importance changing unit 123 that changes the importance according to the access frequency to each container.
Thereby, the management apparatus 10a according to the present embodiment can dynamically improve the reliability of stored data while effectively utilizing the surplus capacity of the storage according to the access frequency to the container.

In addition, this invention is not limited to said each embodiment, It can change in the range which does not deviate from the meaning of this invention.
For example, in each of the above embodiments, an example of setting the importance level for each container has been described as an example of the hierarchical structure, but the present invention is not limited to this. The importance level is set for each object or account. You may do it.

In each of the above-described embodiments, the ring file is provided for each degree of importance. However, the present invention is not limited to this. For example, a ring file may be provided for each container.
In each of the above embodiments, the proxy node 20 executes the adjustment processing of the number of replicas. However, another apparatus such as a container server (storage node 32) may execute the adjustment processing of the number of replicas.
In addition, although an example in which the proxy node 20 periodically executes the adjustment processing of the number of replicas has been described, the present invention is not limited to this, and the client terminal 2 receives a request for adding or deleting (erasing) an object In this case, adjustment processing of the number of replicas may be performed.

In each of the above embodiments, the management device 10 (10 a) has been described as an example realized by one device, but may be realized by a plurality of server devices. Further, a part or all of the management storage unit 110 (110a) may be provided outside the management apparatus 10 (10a).
Further, although the management apparatus 10 (10a) has been described as an example including the change information storage unit 112, instead of including the change information storage unit 112, another means such as calculation may be used to set between the upper limit value and the lower limit value. The number of replicas may be generated.

  In each of the above-described embodiments, when deletion or addition of duplication of data (for example, an object) is described, an example in which large data (for example, an object) is prioritized has been described, but the present invention is not limited thereto. For example, data to be deleted or added (for example, an object) may be randomly determined or determined according to other rules.

Each component of the storage system 1 (1a) described above has a computer system inside. Then, a program for realizing the function of each configuration included in the storage system 1 (1a) described above is recorded in a computer readable recording medium, and the program recorded in the recording medium is read into the computer system and executed. By doing this, processing in each configuration provided in the above-described storage system 1 (1a) may be performed. Here, "to read and execute the program recorded on the recording medium into the computer system" includes installing the program on the computer system. The “computer system” mentioned here includes an OS and hardware such as peripheral devices.
Also, the “computer system” may include a plurality of computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. The term "computer-readable recording medium" refers to a storage medium such as a flexible disk, a magneto-optical disk, a ROM, a portable medium such as a ROM or a CD-ROM, or a hard disk built in a computer system. As described above, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM.

  The recording medium also includes a recording medium provided internally or externally accessible from the distribution server for distributing the program. The program may be divided into a plurality of parts, and after downloading at different timings, the configuration combined in each configuration of the storage system 1 (1a) may be different, or the distribution server for distributing each of the divided programs may be different. . Furthermore, "computer-readable recording medium" holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system serving as a server or a client when the program is transmitted via a network. We shall include things. Further, the program may be for realizing a part of the functions described above. Furthermore, it may be a so-called difference file (difference program) that can realize the above-described functions in combination with a program already recorded in the computer system.

  In addition, part or all of the above-described functions may be realized as an integrated circuit such as LSI (Large Scale Integration). Each function mentioned above may be processor-ized separately, and part or all may be integrated and processor-ized. Further, the method of circuit integration is not limited to LSI's, and implementation using dedicated circuitry or general purpose processors is also possible. In the case where an integrated circuit technology comes out to replace LSI's as a result of the advancement of semiconductor technology, integrated circuits based on such technology may also be used.

1, 1a storage system 2 client terminal 10, 10a management device 20 proxy node 30, 33 storage node 31 storage node (account server)
32 Storage node (container server)
110, 110a Management storage unit 111, 111a Replica number storage unit 112 Change information storage unit 120, 120a Management control unit 121 Free space detection unit 122, 122a Ring change unit 123 Importance change unit 210, 310, 320, 330 Storage unit 211 , 311, 321, 331 Ring file storage unit 312 Account information storage unit 322 Container information storage unit NT Network

Claims (8)

A management system of a storage system, which is a number of replicas indicating the number of objects to be copied and stored, which is a group of data, and which distributes and stores the objects based on the set number of replicas.
A detection unit that detects the free space of the storage system;
Change information of the number of replicas including the free capacity of the storage system and the decimal value set corresponding to the importance of each container that stores the object thereunder as a lower hierarchy, and the importance is low A change information storage unit for storing change information of the number of replicas set so that the number of replicas decreases from a state where the free capacity of the storage system is large;
The change information of the number of replicas corresponding to the free space of the storage system detected by the detection unit and the degree of importance of each container storing the object is read from the change information storage unit, and the number of replicas read is changed And a change unit configured to change the setting of the number of replicas including the decimal value as an average value of the containers so as not to fall below a predetermined lower limit value of the number of replicas according to information. Management device. A replica number storage unit for storing the upper limit value and the lower limit value of the replica number;
The change unit is
The importance of each container is acquired from the importance storage unit that associates and stores the container and the importance, and the replica number storage unit is based on the acquired importance of each container and the free space. The management apparatus according to claim 1, wherein the setting of the number of replicas is changed for each of the containers between the upper limit value and the lower limit value to be stored. The replica number storage unit stores an upper limit value and a lower limit value of the replica number for each degree of importance,
The management device according to claim 2, wherein at least one of the upper limit value and the lower limit value of the number of replicas is set based on the degree of importance of the container. The detection unit periodically detects the free space of the storage system,
The said change part changes the setting of the said number of replicas regularly according to the free capacity of the storage system 1 which the said detection part detected. The claim any one of the Claims 1-3 characterized by the above-mentioned. Management device described in. The management apparatus according to any one of claims 1 to 4.
And a server device for adjusting the number of replicas of the object stored under the container such that the average number of replicas in the container is equal to the number of replicas set by the management device. system. The storage apparatus includes a plurality of storage devices to which duplicates of the stored objects are deleted or added based on the number of replicas changed by the management device.
When deleting or adding a duplicate of the object in the storage device, the server device gives priority to an object having a large size among the objects stored under the container. The storage system according to 5. It is the number of replicas that indicates the number of objects to be replicated and stored as a set of data, and the objects are distributed and stored based on the set number of replicas, and the free space of the storage system and lower hierarchy Change information of the number of replicas including a decimal value set corresponding to the degree of importance of each container under which the object is stored, wherein the lower the degree of importance, the larger the free space of the storage system A storage management method of a storage system, comprising: a change information storage unit that stores change information of the number of replicas set so that the number of replicas decreases.
A detection step of detecting a free space of the storage system by a detection unit;
The changing unit reads, from the change information storage unit, the change information of the number of replicas corresponding to the free space of the storage system detected in the detection step and the importance of each container storing the object. Changing the setting of the number of replicas including the decimal value as an average value of the containers so as not to fall below a predetermined lower limit value of the number of replicas according to change information of the number of replicas; Storage management method characterized by including. It is the number of replicas that indicates the number of objects to be replicated and stored as a set of data, and the objects are distributed and stored based on the set number of replicas, and the free space of the storage system and lower hierarchy Change information of the number of replicas including a decimal value set corresponding to the degree of importance of each container under which the object is stored, wherein the lower the degree of importance, the larger the free space of the storage system A computer of a storage system comprising: a change information storage unit storing change information of the number of replicas set so that the number of replicas decreases.
A detection step of detecting the free capacity of the storage system;
The change information of the number of replicas corresponding to the free space of the storage system detected in the detection step and the importance of each container storing the object is read from the change information storage unit, and the read number of the replicas is read Changing the setting of the number of replicas including the decimal value as an average value of the containers so as not to fall below a predetermined lower limit value of the number of replicas according to the change information program.

Images