CN101776946B - Method for controlling power consumption on basis of object-based storage system - Google Patents

Abstract

The invention discloses a power consumption control method based on an object storage system, and aims to solve the problem that the current power consumption control method cannot perform effective power consumption control according to application characteristics or lacks processing of complicated service request situations. The technical solution is to count server utilization at fixed time intervals, and adjust its power consumption level according to the actual utilization of each object storage server; to view the service queue length of each object storage server at fixed time intervals, and to check the service queue length of each object storage server according to the queue length and current power consumption level Adjust the power consumption level of the corresponding server; the metadata server judges whether there is a specific service request to implement power consumption control. By adopting the present invention, the power consumption level of each object storage server can be adjusted according to the actual utilization rate of the object storage server and the condition of the service queue, so as to meet the requirements of the object storage server for power consumption control, and use the metadata server to process the service request, and Specific service requests to improve power consumption control efficiency.

Description

A Power Consumption Control Method Based on Object Storage System

technical field

The invention relates to a method for controlling power consumption of a computer system, in particular to a method for controlling power consumption based on an object storage system.

Background technique

Parallel storage system is an important part of massively parallel computer systems, and object storage system is a parallel storage structure. As shown in Figure 1, an object storage system consists of a metadata server, multiple object storage servers, and multiple computing nodes interconnected through a network. The metadata server and multiple object storage servers provide file access services such as data reading and writing and data storage for computing nodes. The metadata server provides metadata services for computing nodes and is unique to object storage systems. Metadata describes information such as the owner of each file, creation time, modification time, file size, and file distribution on the object storage system. The object storage server is responsible for saving the specific data of the file, and provides file access services to the computing nodes under the management of the metadata server. The file access request of the computing node is first submitted to the metadata server to obtain the file distribution information, and then submits the access request to the relevant object storage server according to the distribution information to complete the data reading and writing process. The object storage system makes full use of the high-bandwidth network and the concurrency of storage access to provide high data access bandwidth for parallel applications, and has been widely used in the top ten computer systems of the world's supercomputers. Power consumption is an important issue in the design of massively parallel computer systems, and the power consumption of storage systems accounts for a considerable proportion. With the wide application of object storage systems, power consumption control based on object storage systems can help reduce the power consumption of the entire parallel computer system.

At present, the power consumption control methods for storage systems include: (1) putting temporarily unused storage devices (such as disks) into a sleep state to reduce the power consumption of storage devices; (2) adjusting the speed of disk devices to reduce the power consumption of storage devices. Power consumption; (3) Optimize data access, improve data access hit rate, reduce disk seek and rotation times; (4) For data centers such as backup servers, set the power consumption level of backup servers to 0 when there is no data backup task minimum; etc. The power consumption control methods for devices (such as the previous two methods) and the data optimization method for reducing the number of disk seeks cannot obtain changes in service requests in the storage system, and cannot perform effective power consumption control according to application characteristics. The power consumption control method for the backup server in the data center (such as the fourth method) considers the busy state of the server and implements simple power consumption optimization, but this method cannot perform the functions of complex service requests in the object storage system. consumption control. At present, there is no public technical information on the power consumption control method for the object storage system.

Contents of the invention

The technical problem to be solved by the present invention is to propose a power consumption control method based on an object storage system to solve the problem that the current storage system power consumption control method cannot perform effective power consumption control according to application characteristics or lacks the processing of complex service requests .

The technical solution is: define multiple power consumption levels for the object storage server, and adjust the power consumption level of the object storage server according to different conditions, specifically including: (1) Statistical server utilization at fixed time intervals, according to the actual Utilization adjusts its power consumption level; (2) Check the service queue length of each object storage server at fixed time intervals, and adjust the power consumption level of the corresponding server according to the queue length and current power consumption level; (3) Judgment by the metadata server Whether a specific service request occurs to implement power consumption control. A specific service request refers to a class of service requests that require the object storage server to respond at the highest power consumption level, such as large-scale job loads, checkpoint operations, and so on. Adjust the power consumption level of the involved object storage server to the highest level according to the specific service request category. Power consumption level adjustment is achieved by adjusting the voltage or frequency of the processor.

The specific technical solutions are:

For an object storage system that includes 1 metadata server and N object storage servers, N is a positive integer, and each object storage server supports m-level power consumption levels 1, 2, ..., m, and the power consumption of each level is respectively P ₁ , P ₂ ,..., P _m , satisfying P ₁ <P ₂ <...<P _m , the server benchmark utilization rate corresponding to each level of power consumption is U ₁ , U ₂ ,..., U _m satisfies U ₁ <U ₂ <...<U _m . Server benchmark utilization refers to the server utilization value corresponding to the multi-level power consumption P ₁ , P ₂ , ..., P _m , the higher the power consumption level is, the higher the server benchmark utilization rate is, and the power consumption control method is based on The power consumption level is pre-set.

The first step is to initialize the parameters related to power consumption control of the object storage system, including the following steps:

1.1 Initialize the power consumption control interval t _interval , the value range is 5 to 10 minutes;

1.2 Initialize the number of power consumption levels m, the value range is 3 to 5;

1.3 Initialize m-level server benchmark utilization ratios U ₁ , U ₂ , . . . , U _m . The method for setting the benchmark utilization rate is as follows: set the value of U ₁ with a range of 10% to 20%, and set the value of U _m with a range of 70% to 80%. Set _Uk value,

1.4 Initialize the service request queue length threshold L _th , with a value range of 10 to 20;

1.5 Initialize power consumption control time t, t=0.

The second step is to start power consumption control, including the following steps:

2.1 Start the metadata server and N object storage servers, and set the power consumption level of all object storage servers to the highest level m;

2.2 Start the power consumption real-time monitor to monitor the actual power consumption values of N object storage servers;

2.3 Starting time t starts counting;

2.4 Start power consumption control while waiting for the service request from the computing node.

In the third step, the twelfth step is executed when the request for disabling the power consumption control is received; otherwise, the fourth step is executed.

In the fourth step, the power consumption control is started every interval t _interval . Judging whether t=t _interval is established, if established, then execute the fifth step; if not established, execute the tenth step;

The _fifth step is to count the actual utilization rates u ₁ , u ₂ , _. If the i-th (1≤i≤N) object storage server is responding to a specific service request, then u _i =U _m ;

The sixth step is to adjust the power consumption level according to the actual utilization rate and the baseline utilization rate of the object storage server. If the i-th object storage server satisfies u _i < U ₁ , 1≤i≤N, set the power consumption level of the i-th object storage server to 1; if u _i ≥ U _m , set the i-th object storage The power consumption level of the server is set to m; for the utilization rate u _i satisfying U _k ≤ _{u i} < U _k+1 (k=1, 2, ..., m-1), the i-th object is stored in the server The power consumption level of is set to k.

Step 7: Check the service request queues of the N object storage servers, and record the queue lengths l ₁ , l ₂ , . . . , l _N .

Step 8, if l _i >L _th and the power consumption level of the i-th object storage server is lower than m, execute step 9; otherwise, execute step 10;

The ninth step is to increase the power consumption level of the object storage server by one level, so as to meet the fast response of a large number of service request operations in the future.

In the tenth step, the metadata server monitors the service request sent by the computing node, and judges whether it is a specific service request, and if so, executes the eleventh step; otherwise, executes the third step.

In the eleventh step, send a message to the object storage server, set the power consumption level of the corresponding object storage server to the highest m, and mark that the object storage server is responding to a specific service request, and execute the third step.

Step 12, closing the power consumption control service of the object storage system.

Compared with the prior art, adopting the present invention can achieve the following technical effects:

1. The power consumption level of each object storage server can be adjusted according to the actual utilization rate and service queue of the object storage server to meet the requirements of the object storage server for power consumption control;

2. Use the metadata server to process service requests. For specific service requests, such as large-scale job loading and checkpoint operations, send messages to the object storage server in advance to adjust the power consumption level, reduce the lag of power consumption level adjustment, and improve performance. consumption control efficiency.

Description of drawings

Figure 1 is a structural diagram of an object storage system.

Figure 2 is a general flow chart of the present invention.

specific implementation plan

Figure 2 is a general flow chart of the present invention.

Step 1), initialize the power consumption control related parameters of the object storage system;

Step 2), start power consumption control;

Step 3), when receiving the request to close the power consumption control, then perform step 12), otherwise perform step 4);

Step 4), judge whether t=t _interval is set up, if yes, then perform step 5); otherwise perform step 10);

Step 5), counting the actual utilization rates u ₁ , u ₂ , ..., u _N of the N object storage servers in the past t _interval time;

Step 6), adjusting the power consumption level according to the actual utilization rate and the baseline utilization rate of the object storage server;

Step 7), check the service request queues of N object storage servers, and record the queue lengths l ₁ , l ₂ , ..., l _N ;

Step 8), if l _i >L _th and the power consumption level of the i-th object storage server is lower than m, execute step 9); otherwise execute step 10);

Step 9), increasing the power consumption level of the object storage server by one level;

Step 10), the metadata server monitors the service request sent by the computing node, and judges whether it is a specific service request, if yes, execute step 11); otherwise execute step 3);

Step 11), send a message to the object storage server, set the power consumption level of the corresponding object storage server to the highest m, and mark that the object storage server is responding to a specific service request, and perform step 3);

Step 12), closing the power consumption control service of the object storage system.

Claims (3)

1. power consumption control method based on object storage system is characterized in that may further comprise the steps:

The power consumption control correlation parameter of the first step, initialization object storage system may further comprise the steps:

1.1 initialization power consumption control t interval time _Interval, span is 5～10 minutes;

1.2 the initialization power consumption level is counted m, span is 3～5; Each object storage server is supported m level power consumption level 1,2 ..., m, every grade power consumption is respectively P ₁, P ₂..., P _m, satisfy P ₁＜P ₂＜...＜P _m

1.3 initialization m level server benchmark utilization factor U ₁, U ₂..., U _m, the method to set up of benchmark utilization factor is: U is set ₁Value, span is 10%～20%, and U is set _mValue, span is 70%～80%, and U is set _kValue,

1.4 initialization services request queue length threshold L _Th, span is 10～20;

1.5 initialization power consumption control time t, t=0;

Second step, startup power consumption control may further comprise the steps:

2.1 start meta data server and N object storage server, and the power consumption level of all object storage servers is arranged to highest level m, N is a positive integer;

2.2 start the real-time watch-dog of power consumption, the actual power loss value of N object storage server of monitoring;

2.3 start-up time, t began counting;

2.4 the services request of nodes to be calculated such as one side, Yi Bian begin power consumption control;

The 3rd step, when receiving when closing the power consumption control request, carried out for the 12 step, otherwise carried out for the 4th step;

The 4th the step, every time t _IntervalStart one time power consumption control, judge t=t _IntervalWhether set up,, then carried out for the 5th step if set up; If be false, carried out for the tenth step;

The 5th goes on foot, adds up t in the past _IntervalThe practical efficiency u of N object storage server in time ₁, u ₂..., u _N, the practical efficiency of object storage server obtains by distributing operation system interface; If i object storage server responding particular service request, then u _i=U _m, 1≤i≤N;

The 6th the step, regulate power consumption level according to the practical efficiency and the benchmark utilization factor of object storage server: if i object storage server satisfies u _i＜U ₁, 1≤i≤N, then the power consumption level of i object storage server is set to 1; If u _i〉=U _m, then the power consumption level of i object storage server is set to m, and the span of m is 3～5; For satisfying U _k≤ u _i＜U _K+1Utilization factor u _i, then the power consumption level of i object storage server is set to k, k=1, and 2 ..., m-1;

The 7th goes on foot, checks the services request formation of N object storage server, writes down its queue length l ₁, l ₂..., l _N

If the 8th step l _i＞L _ThAnd the power consumption level of i object storage server is lower than m, carries out for the 9th step; Otherwise carried out for the tenth step;

The 9th the step, the power consumption level of this object storage server is heightened one-level;

The tenth step, meta data server are monitored the services request that the calculating node sends, and judge whether to be particular service request, in this way, carry out for the 11 step; Otherwise carried out for the 3rd step;

The 11 step, send message, the power consumption level of corresponding objects storage server is set to the highest m, responding particular service request, carried out for the 3rd step with this object storage server of tense marker to the object storage server;

The 12 goes on foot, closes the power consumption control service of object storage system.

2. the power consumption control method based on object storage system as claimed in claim 1 is characterized in that the services request that described particular service request is meant needs the object storage server to respond with the highest power consumption level.

3. the power consumption control method based on object storage system as claimed in claim 1 is characterized in that described power consumption level adjustment realizes by the voltage or the frequency of regulating processor.

Images