JP4778538B2 - Storage data management system and storage data management program - Google Patents

Description

  The present invention relates to a storage data management system and data management program in which user access time in a data storage service is considered as a cost, and more particularly to a storage data management system and data management program in consideration of an access speed allowable by a user.

  The amount of data handled in recent computer systems tends to increase rapidly, and for this reason, data storage services that provide online data storage services are increasing. However, data must be managed at various stages from generation to disposal based on the value generated by the data so that it can be used most efficiently. It is proposed to set the data storage cost according to the data life cycle.

  The following patent document 1 is cited as a document describing a technique for setting a data storage cost according to the life cycle of this data. In this patent document 1, the data manager determines the degree of importance and In order to set attribute information such as access frequency and determine the location and management method of data, for example, “High importance, frequently accessed data is stored in a highly reliable high-end storage unit, and the importance is high. However, data with a low access frequency is stored in a storage unit with a medium access speed and good cost performance, and data with a low importance level is stored in a low-cost storage unit. Accordingly, it is described that the storage cost required for data storage is reduced.

Further, as a document describing the technology related to the data storage cost, the following Patent Document 2 can be cited. This Patent Document 2 monitors the data transfer speed when the user accesses the data, and the predetermined data contracted with the user. A technique is described in which when the transfer rate cannot be achieved, it is stored as the number of peterties and the user billing fee is discounted by the number of peterties.
JP 2006-85208 A JP 2006-113824 A

  The technique described in Patent Document 1 described above can reduce the management cost for the user by storing data in a highly reliable high-end storage or a storage considering the cost according to the importance and access frequency of the data. Although it is possible, the data access speed requested by the user is not taken into consideration, and there is a problem that the speed requested by the user may not be satisfied.

  Furthermore, although the technique described in Patent Document 2 describes a charging method considering the access speed, there is a problem in that it does not guarantee the data access speed for the user.

  An object of the present invention is to predict a change in data access speed when changing a storage unit according to the importance of data, and a storage data management system that moves data only within the range of the data access speed allowed by the user And providing a storage data management program.

In order to achieve the above object, the present invention provides a storage unit with a high data transfer rate, a plurality of storage units with a low data transfer rate compared to the high-speed storage unit, and a unit per unit time of each storage unit for each user. A data value standard definition file storage unit for storing the range value of the reference access frequency in advance, a data access usage frequency storage unit for storing the actual access frequency value per unit time of each data, and a guaranteed access speed preset for each user A data access speed reference definition file storage section for storing limit values, a control section for controlling data movement among a plurality of storage sections with reference to the reference access count range, actual access count values, and guaranteed access speed limit values; With
The control unit
A first step of reading an actual access number value of each data from the data access use frequency storage unit;
A second step of reading a reference access frequency range value of each data from the data value reference definition file storage unit;
A third step of determining whether or not the actual access number value read in the first step is equal to or less than a reference access number range value read in the second step;
When it is determined in the third step that the actual access count value is less than or equal to the reference access count range value, the data determined to be less than or equal to the reference access count range value is stored in the one storage unit having a high data transfer rate from the one storage unit. A fourth step of calculating a data transfer rate when moving to another storage unit having a lower data transfer rate than the unit;
A fifth step of determining whether the data transfer rate calculated in the fourth step is equal to or less than a guaranteed access rate limit value for each user stored in the data access rate reference definition file storage unit;
Only when it is determined in the fifth step that the calculated data transfer rate is not less than or equal to the guaranteed access rate limit value, the data for which the transfer rate after movement in the fourth step is calculated is transferred from the storage unit 1 to the other The first feature is that the sixth step of moving to the storage unit is executed.

  According to the present invention, in the storage data management system having the above characteristics, a total value of values obtained by multiplying the data capacity determined in the fourth step by the data transfer rate value of the storage unit storing the data is calculated by the control unit. A second feature is to calculate the data transfer rate based on a value obtained by calculating and dividing the calculated total value by the number of storage units.

  According to the present invention, in the storage data management system of any one of the above characteristics, the control unit divides the transfer rate of the storage unit storing the data determined in the fourth step by the capacity of the data. A third feature is that the data transfer time of each storage unit is calculated and the data transfer rate is calculated based on an average value obtained by dividing the total value of the data transfer times by the number of storage units.

  According to the present invention, in the storage data management system according to the first or second feature, the control unit determines that the data transfer rate calculated in the fifth step is equal to or less than a guaranteed access rate limit value, and the data transfer A fourth feature is that when data is moved from one storage unit having a relatively high speed to another storage unit having a relatively low data transfer speed, the data is moved from the one storage unit to the other storage unit. .

  According to the present invention, in the storage data management system according to any one of the above characteristics, the guaranteed access speed limit value stored in the data access speed reference definition file storage unit by the control unit is rewritten, and the rewritten guaranteed access speed is When the limit value is rewritten to a value faster than the guaranteed access speed limit value before rewriting, the data is moved from the storage unit with a low data transfer rate to the storage unit with a high data transfer rate, and the rewritten guaranteed access The fifth feature is that when the speed limit value is rewritten to a value slower than the guaranteed access speed limit value before rewriting, the data is moved from the storage unit having a high data transfer rate to the storage unit having a low data transfer rate. To do.

Furthermore, the present invention provides a storage unit having a high data transfer rate, a plurality of storage units having a low data transfer rate compared to the high-speed storage unit, and a range value of the reference access count per unit time of each storage unit for each user. A data value standard definition file storage unit for storing data in advance, a data access usage frequency storage unit for storing the actual access count value per unit time of each data, and data for storing a guaranteed access speed limit value preset for each user A storage data management system comprising: an access speed reference definition file storage unit; and a control unit that controls data movement among a plurality of storage units with reference to the reference access frequency range, actual access frequency value, and guaranteed access speed limit value Data management program,
In the control unit,
A first step of reading an actual access number value of each data from the data access use frequency storage unit;
A second step of reading a reference access frequency range value of each data from the data value reference definition file storage unit;
A third step of determining whether or not the actual access number value read in the first step is equal to or less than a reference access number range value read in the second step;
When it is determined in the third step that the actual access count value is less than or equal to the reference access count range value, data determined to be less than or equal to the reference access count range value is transferred from one storage section with a high data transfer rate to the one storage section A fourth step of calculating a data transfer rate when moving to another storage unit having a lower data transfer rate than
A fifth step of determining whether the data transfer rate calculated in the fourth step is equal to or less than a guaranteed access rate limit value for each user stored in the data access rate reference definition file storage unit;
Only when it is determined in the fifth step that the calculated data transfer rate is not less than or equal to the guaranteed access rate limit value, the data for which the transfer rate after movement in the fourth step is calculated is transferred from the storage unit 1 to the other The sixth feature is that the sixth step of moving to the storage unit is executed.

  According to the present invention, in the storage data management program having the characteristics described above, a total value of values obtained by multiplying the control unit by the data capacity determined in the fourth step and the data transfer rate value of the storage unit storing the data is obtained. A seventh feature is that a step of calculating the data transfer rate based on a value obtained by dividing the calculated total value by the number of storage units is executed.

  In the storage data management program according to any one of the above features, the control unit may divide the transfer rate of the storage unit storing the data determined in the fourth step by the capacity of the unit time. And calculating a data transfer speed based on an average value obtained by dividing the total data transfer time by the number of storage units. To do.

  According to the present invention, in the storage data management program according to the fifth or sixth feature, the control unit determines that the data transfer rate calculated in the fifth step is equal to or less than a guaranteed access rate limit value, When data is moved from one storage unit having a relatively high speed to another storage unit having a relatively low data transfer speed, the step of moving from the one storage unit to the other storage unit is executed. It is characterized by.

  According to the present invention, in the storage data management program according to any one of the above features, the guaranteed access speed limit value stored in the data access speed reference definition file storage unit is rewritten in the control unit, and the rewritten guaranteed access speed is When the limit value is rewritten to a value faster than the guaranteed access speed limit value before rewriting, the data is moved from the storage unit with a low data transfer rate to the storage unit with a high data transfer rate, and the rewritten guaranteed access When the speed limit value is rewritten to a value slower than the guaranteed access speed limit value before rewriting, the step of moving the data from the storage unit having a high data transfer rate to the storage unit having a low data transfer rate is executed. Ten features.

  The storage data management system and the storage data management program according to the present invention store the guaranteed access speed limit value in advance in the data access speed reference definition file storage section, and the data transfer speed can be increased from one storage section having a high data transfer speed. When moving data to another low-speed storage unit, determine whether the transferred data transfer rate satisfies the guaranteed access speed limit value stored in the data access rate reference definition file storage unit, and only if it is satisfied By performing data movement, it is possible to efficiently save data in consideration of cost while satisfying the transfer (access) speed requested by the user.

  Hereinafter, an embodiment of a storage data management system to which a data management method and a data management program according to the present invention are applied will be described in detail with reference to the drawings.

  FIG. 1 is an overall configuration diagram of a storage data management system according to this embodiment, FIG. 2 is a diagram for explaining storage according to this embodiment, and FIG. 3 is a diagram showing an example of a data value standard definition file according to this embodiment. 4 is a diagram showing an example of a data access speed reference definition file according to the present embodiment, FIG. 5 is a diagram for explaining an example of calculating the data state and data access speed at the time of data movement determination according to the present embodiment, and FIG. It is a figure which shows the flowchart which determines the data movement availability by this embodiment.

[Constitution]
The storage data management system according to the present embodiment includes a storage service system 10 connected from a user 18 through a public communication line 17, and the storage service system 10 includes a plurality of HDDs (hard disk: storage units) 11a to 11c. Storage 11 configured, data value standard definition file storage unit 13 in which determination data for determining data value for each user is defined in advance, and data access speed standard definition in which a transfer rate allowed for each user is defined in advance Information life cycle management that is a control unit that controls the movement of data between the HDDs 11a to 11c with reference to the file storage unit 14, the data value standard definition file storage unit 13, and the storage data access speed standard definition file storage unit 14 Part 12 and per user One comprised the access frequency of each data from the data access use frequency storing unit 20 for storing detected.

  The storage 11 includes HDDs 11a to 11c for each of three performance levels. The HDD 11a is a high-performance high-performance hard disk device with a data transfer rate of 500 MB / s, as shown in FIG. The HDD 11c is a low-cost, low-performance hard disk device with a data transfer rate of 200 MB / s. These HDDs 11a to 11c have a relatively higher and lower relationship.

  As shown in FIG. 3, the data value standard definition file storage unit 13 is worth storing data accessed in the HDD 11a at a usage frequency of 5 or more times per hour, and the usage frequency is 3 or more and 4 times per hour. The following data is worth storing in the HDD 11b, and the value data (the range of the number of times of access) that the data whose usage frequency is less than twice per hour is worth storing in the HDD 11c is stored. The same is true, and more value data for each user is stored.

  As shown in FIG. 4, the data access speed reference definition file storage unit 14 guarantees a minimum access speed of 300 MB / s for the user X by a contract or the like, and for the user Y at least 350 MB / s by a contract or the like. It is stored as judgment data (guaranteed access speed limit value) that the access speed of s is guaranteed. The information stored in the data access speed reference definition file storage unit 14 may be data transfer time per unit time.

  The data access usage frequency storage unit 20 stores the usage (access) frequency for each data accessed by the user in the past, for example, the number of accesses per hour as usage frequency data.

  In the storage data management system according to the present embodiment, the access speed requested by the user varies depending on the HDD performance (data transfer speed) for storing data, and a calculation method thereof will be described with reference to FIG. In this calculation method, for example, when three pieces of data having a capacity of 100 MB are stored in each of the HDDs 11a to 11c, before the data movement, the capacity of the HDD 11a × the transfer speed MB value (100 MB × 5) and the capacity of the HDD 11b × the transfer speed. The total value 1000 MB of the MB value (100 MB × 3) and the capacity of the HDD 11 c × the transfer speed MB value (100 MB × 2) is calculated as a value (333.3 MB) divided by the number of HDDs 3 (333.3 MB), and the 100 MB data of the HDD 11 a is stored in the HDD 11 b. After the movement, a value obtained by dividing the total value 800 MB of the capacity of the HDD 11b × the transfer speed MB value (200 MB × 3) and the capacity of the HDD 11c × the transfer speed MB value (100 MB × 2) by the number of HDDs (266.6 MB). It is possible to calculate that the average data transfer speed before movement is faster than that of movement.

  This transfer rate calculation method is not limited to the above example. For example, the transfer time from the HDD 11a is 100 MB ÷ 500 MB / s, the transfer time from the HDD 11b is 100 MB ÷ 300 MB / s, and the transfer time from the HDD 11c is 100 MB ÷ It may be calculated as 200 MB / s, and the transfer rate per unit time may be calculated from the average value of these transfer times. Similarly, even after movement, the transfer time from the HDD 11 b is 200 MB ÷ 300 MB / s, and the transfer time from the HDD 11 c is calculated. The transfer time may be calculated as 100 MB / 200 MB / s, the average value of the transfer times of the two HDDs may be calculated, and the maximum value of the calculated transfer time may be used.

[Operation]
Now, in the storage data management system configured as described above, the information life cycle management unit 12 of the storage service system 10 has a data value standard definition file storage unit 13 as shown in FIG. Step 601 for reading the value data for each of the HDDs 11a to 11c of the user who has accessed the data, step S602 for reading the access frequency (number of times / time) of the data to be accessed from the data access usage frequency storage unit 20, It is determined whether or not the actual usage frequency (number of times / time) of the user read in step 602 exceeds the value data (number range / time) serving as a reference for each HDD read in step 601, and does not exceed (data is valued) Stored in the HDD that meets the standards) Performing step 603 to terminate the process when.

  Next, when the system determines in step 603 that the value data (frequency range / time) serving as a reference for each HDD exceeds (data is not stored in an HDD that meets the value standard), the data access speed reference definition Step 604 for reading a predetermined access speed reference value for each user stored in the file storage unit 14 and when data not stored in the HDD meeting the value criterion determined in step 604 is moved to a lower HDD Step 605 for calculating the average data access speed of the data by the above-described calculation method, and determining whether or not the average data access speed after the data movement calculated in step 605 is lower than the reference access speed read in step 604. , Determined to be less than the reference speed when moving data Step 606 for ending the processing at this time, and determining that the average data access speed after the data movement calculated in Step 606 does not fall below the reference access speed (the reference speed is satisfied even if the data is moved) Step 607 is executed to move data (for example, HDD 11a → HDD 11b, HDD 11b → HDD 11c) from the upper HDD having a relatively high data transfer speed to the lower HDD having the next lowest transfer speed. In step 607, an example in which data is moved to the HDD having the next transfer speed has been described. However, the transfer speed requested by the user stored in the data access speed reference specification file unit 14 is, for example, 200 MB / s or less. In some cases, all data may be transferred to the HDD 11c.

  Through this series of processes, the storage data management system according to the present embodiment can provide an access speed that satisfies a user request registered in advance even if the data access frequency from the user is low. Note that the comparison of the data transfer rates in step 606 may be performed by comparing the transfer times before and after the movement, or by comparing the maximum values of the transfer times before and after the movement.

  In the above-described embodiment, the example in which data is distributed and stored in each HDD with the transfer rate requested by the user stored in the data access speed reference specification file unit 14 as a limit has been described. When the transfer request speed of the user stored in the data access speed reference specification file section 14 is redefined so as to change at high speed, the information life cycle management section 12 stores the data stored in the lower HDD according to the new definition. If the transfer request speed is redefined to change to a low speed, data can be moved from a high-speed HDD to a low-speed HDD. These processing procedures can be performed by step 607 shown in FIG.

1 is an overall configuration diagram of a storage data management system according to an embodiment of the present invention. The figure for demonstrating the storage by this embodiment. The figure which shows an example of the data value reference | standard definition file by this embodiment. The figure which shows an example of the data access speed reference | standard definition file by this embodiment. The figure which shows the data transfer rate at the time of the data movement determination by this embodiment. The figure which shows the flowchart which determines the data movement availability by this embodiment.

Explanation of symbols

  10: Storage service system, 11: Storage, 12: Information life cycle management unit, 13: Data value standard definition file storage unit, 14: Data access speed standard definition file storage unit, 17: Public communication line, 18: User, 20 : Data access use frequency storage unit, HDDs 11a to 11c: HDD.

Claims (10)

Data storing in advance a storage unit having a high data transfer rate, a plurality of storage units having a lower data transfer rate than the high-speed storage unit, and a range value of the reference access count per unit time of each storage unit for each user Value standard definition file storage unit, data access usage frequency storage unit that stores the actual access count value per unit time of each data, and data access speed standard definition file that stores a guaranteed access speed limit value preset for each user A storage unit, and a control unit that controls data movement among a plurality of storage units with reference to the reference access frequency range, the actual access frequency value, and the guaranteed access speed limit value,
The control unit
A first step of reading an actual access number value of each data from the data access use frequency storage unit;
A second step of reading a reference access frequency range value of each data from the data value reference definition file storage unit;
A third step of determining whether or not the actual access number value read in the first step is equal to or less than a reference access number range value read in the second step;
When it is determined in the third step that the actual access count value is less than or equal to the reference access count range value, the data determined to be less than or equal to the reference access count range value is stored in the one storage unit having a high data transfer rate from the one storage unit. A fourth step of calculating a data transfer rate when moving to another storage unit having a lower data transfer rate than the unit;
A fifth step of determining whether the data transfer rate calculated in the fourth step is equal to or less than a guaranteed access rate limit value for each user stored in the data access rate reference definition file storage unit;
Only when it is determined in the fifth step that the calculated data transfer rate is not less than or equal to the guaranteed access rate limit value, the data for which the transfer rate after movement in the fourth step is calculated is transferred from the storage unit 1 to the other The storage data management system which performs the 6th process which moves to a memory | storage part.   The control unit calculates a total value of values obtained by multiplying the capacity of the data determined in the fourth step and the data transfer rate value of the storage unit storing the data, and calculates the calculated total value by the number of storage units. The storage data management system according to claim 1, wherein the data transfer rate is calculated based on the divided value.   The control unit calculates the data transfer time of each storage unit per unit time by dividing the transfer rate of the storage unit storing the data determined in the fourth step by the capacity of the data, and the data transfer time The storage data management system according to claim 1, wherein the data transfer rate is calculated based on an average value obtained by dividing the total value by the number of storage units.   The control unit determines that the data transfer rate calculated in the fifth step is equal to or less than the guaranteed access rate limit value, and the other storage unit having a relatively low data transfer rate from one storage unit having a relatively high data transfer rate. The storage data management system according to any one of claims 1 to 3, wherein when data is moved to a storage unit, the storage unit moves from the first storage unit to the other storage unit.   The control unit rewrites the guaranteed access speed limit value stored in the data access speed reference definition file storage unit, and rewrites the rewritten guaranteed access speed limit value to a value faster than the guaranteed access speed limit value before rewriting. Data is moved from a storage unit with a low data transfer rate to a storage unit with a high data transfer rate, and the rewritten guaranteed access speed limit value is rewritten to a value slower than the guaranteed access speed limit value before rewriting. 5. The storage data management system according to claim 1, wherein when the data is transferred, the data is moved from a storage unit having a high data transfer rate to a storage unit having a low data transfer rate. Data storing in advance a storage unit having a high data transfer rate, a plurality of storage units having a lower data transfer rate than the high-speed storage unit, and a range value of the reference access count per unit time of each storage unit for each user Value standard definition file storage unit, data access usage frequency storage unit that stores the actual access count value per unit time of each data, and data access speed standard definition file that stores a guaranteed access speed limit value preset for each user A data management program for a storage data management system comprising: a storage unit; and a control unit that controls data movement between a plurality of storage units with reference to the reference access frequency range, the actual access frequency value, and the guaranteed access speed limit value. There,
In the control unit,
A first step of reading an actual access number value of each data from the data access use frequency storage unit;
A second step of reading a reference access frequency range value of each data from the data value reference definition file storage unit;
A third step of determining whether or not the actual access number value read in the first step is equal to or less than a reference access number range value read in the second step;
When it is determined in the third step that the actual access count value is less than or equal to the reference access count range value, data determined to be less than or equal to the reference access count range value is transferred from one storage section with a high data transfer rate to the one storage section A fourth step of calculating a data transfer rate when moving to another storage unit having a lower data transfer rate than
A fifth step of determining whether the data transfer rate calculated in the fourth step is equal to or less than a guaranteed access rate limit value for each user stored in the data access rate reference definition file storage unit;
Only when it is determined in the fifth step that the calculated data transfer rate is not less than or equal to the guaranteed access rate limit value, the data for which the transfer rate after movement in the fourth step is calculated is transferred from the storage unit 1 to the other A storage data management program for executing a sixth step of moving to a storage unit.   The control unit calculates a total value of values obtained by multiplying the data capacity determined in the fourth step by the data transfer rate value of the storage unit storing the data, and calculates the calculated total value as the number of storage units. 7. The storage data management program according to claim 6, wherein a step of calculating the data transfer rate based on the divided value is executed.   The control unit calculates the data transfer time of each storage unit per unit time by dividing the transfer rate of the storage unit storing the data determined in the fourth step by the capacity of the data, and the data transfer time The storage data management program according to claim 6, wherein a step of calculating a data transfer rate is executed based on an average value obtained by dividing the total value by the number of storage units.   The control unit determines that the data transfer rate calculated in the fifth step is equal to or less than the guaranteed access rate limit value, and stores another data with a relatively low data transfer rate from one storage unit with a relatively high data transfer rate. The storage data management program according to any one of claims 6 to 8, wherein when the data is moved to a storage unit, a step of moving from the one storage unit to the other storage unit is executed.   The guaranteed access speed limit value stored in the data access speed reference definition file storage unit is rewritten in the control unit, and the rewritten guaranteed access speed limit value is rewritten to a value faster than the guaranteed access speed limit value before rewriting. Data is moved from a storage unit with a low data transfer rate to a storage unit with a high data transfer rate, and the rewritten guaranteed access speed limit value is rewritten to a value slower than the guaranteed access speed limit value before rewriting. 10. The storage data management program according to claim 6, wherein the storage data management program executes a step of moving data from a storage unit having a high data transfer rate to a storage unit having a low data transfer rate.

Images