CN114327813A - Disk array reconstruction task scheduling method, device, equipment and storage medium - Google Patents
Disk array reconstruction task scheduling method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN114327813A CN114327813A CN202111450041.7A CN202111450041A CN114327813A CN 114327813 A CN114327813 A CN 114327813A CN 202111450041 A CN202111450041 A CN 202111450041A CN 114327813 A CN114327813 A CN 114327813A
- Authority
- CN
- China
- Prior art keywords
- performance index
- disk array
- task
- real
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 230000008569 process Effects 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 17
- 230000015556 catabolic process Effects 0.000 claims description 16
- 238000006731 degradation reaction Methods 0.000 claims description 16
- 230000009467 reduction Effects 0.000 claims description 9
- 230000003993 interaction Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 230000009471 action Effects 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Landscapes
- Debugging And Monitoring (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
The application discloses a method, a device, equipment and a storage medium for scheduling a disk array reconfiguration task, wherein the method comprises the following steps: counting the real-time performance index of the current disk array; the real-time performance index is a performance index represented by the number of the currently executed first user read-write tasks; judging whether the reconstruction task speed of the disk array needs to be adjusted currently or not based on the real-time performance index and the preset performance index so as to obtain a corresponding judgment result; the preset performance index is a performance index represented by the number of second user read-write tasks which can be expected to be executed; and correspondingly adjusting the current reconstruction task speed of the disk array based on the judgment result and a preset reconstruction task scheduling rule. According to the method and the device, the self-adaptive speed adjustment of the reconstruction task is carried out based on the real-time performance index and the preset performance index of the disk array, so that the performance requirements of a user reading and writing task are adapted, the configuration flow is simplified, and the operation efficiency of a storage server system is further improved.
Description
Technical Field
The invention relates to the technical field of computer storage, in particular to a disk array reconstruction task scheduling method, device, equipment and storage medium.
Background
Currently, in order to maintain high availability of an existing storage system, and thus not to stop a service when hardware fails, a hardware redundancy mode is mostly adopted, that is, the same RAID (Redundant Arrays of Independent Disks) is placed on two nodes to operate. When the controllers on the two nodes operate normally, the two nodes respectively process different services to keep the performance; if a controller on one of the nodes fails, a controller on the other node takes over traffic of the failed controller.
In addition, when the existing storage system is configured with RAID5 or RAID6 to operate, the storage system supports recovery of unexpectedly lost data through redundant data, and performs part of tasks to be reconstructed by coordinating disk array reconstruction task scheduling to complete reconstruction work. When the reconstruction work is running, the user service and the background reconstruction task are subjected to interactive operation, so that the running of the background reconstruction task inevitably affects the performance of the user service, and the performance reduction in the reconstruction process is taken as an important performance measurement standard in the existing storage system.
In order to solve the problem that the performance of user services is affected by the operation of a background reconfiguration task, the conventional storage system generally provides a speed control command of the background task to meet the user requirements of different scenes, that is, the service performance of the user is ensured by limiting the scheduling speed of the background task. The scheduling speed of the background task is generally inversely related to the performance of the user service, and the faster the scheduling speed of the background task is, the lower the performance of the user service is. A target value is therefore inevitably required to limit the scheduling speed of the background task. The background will stop the scheduling of tasks when the number of reconstructed units per time unit is higher than the target value.
However, even if the background stops scheduling of the background reconfiguration task due to the existence of the user service, the reconfiguration is not really terminated, and the main reason is that the user service also causes part of the reconfiguration task, so that part of the stripes must be reconfigured, so it can be known that the setting of the target value is also related to the performance of the user service, the fixed target value is not in real-time coordination with the change of the user service scene, and the existing setting of the target value generally sets the reference value according to the performance of the back-end hard disk, intervenes through the input value of the user, and the setting of the reference value may be related to the configuration of the hard disk type, the hard disk performance, the hard disk state, the number of array hard disks, the array state, and the like, and the related calculation mode is very complicated and needs to be continuously updated, and cannot be commonly used in various platforms.
In summary, how to avoid the scheduling limitation of the background reconstruction task based on the target value is a problem to be solved in the art.
Disclosure of Invention
In view of this, the present invention provides a method, an apparatus, a device, and a storage medium for scheduling a disk array reconfiguration task, which can adapt to performance requirements of a user read-write task, and schedule a background reconfiguration task based on a real-time performance index, so as to simplify a configuration process, further improve operation efficiency of a storage server system, and solve a problem that a target value is difficult to set in a scenario where performance is not uniform when the reconfiguration task is executed. The specific scheme is as follows:
in a first aspect, the present application discloses a method for scheduling a disk array reconfiguration task, including:
counting the real-time performance index of the current disk array; the real-time performance index is a performance index represented by the number of the currently executed first user read-write tasks;
judging whether the reconstruction task speed of the disk array needs to be adjusted currently or not based on the real-time performance index and a preset performance index so as to obtain a corresponding judgment result; the preset performance index is a performance index represented by the number of second user read-write tasks which can be expected to be executed;
and correspondingly adjusting the current reconstruction task speed of the disk array based on the judgment result and a preset reconstruction task scheduling rule.
Optionally, the counting the real-time performance index of the current disk array includes:
counting the number of executed user read-write tasks in the last historical time period, and carrying out average processing on the counted number of the user read-write tasks to obtain the number of first user read-write tasks;
and determining the current real-time performance index of the disk array based on the number of the first user read-write tasks.
Optionally, the counting the number of the user read-write tasks that have been executed in the previous historical time period, and performing average processing on the counted number of the user read-write tasks to obtain the number of the first user read-write tasks includes:
and counting the number of the executed user read-write tasks in the last reconstruction operation period, and performing average processing on the counted number of the user read-write tasks to obtain the number of the first user read-write tasks.
Optionally, before the determining whether the reconstruction task speed of the disk array needs to be adjusted currently, the method further includes:
acquiring a normal operation performance index of the disk array; the normal operation performance index is a performance index represented by the number of third user read-write tasks which can be executed in a normal operation state;
obtaining a scaling factor for adjusting the normal operation performance index determined based on performance degradation expectations; the performance reduction expectation is the expectation of performance reduction amplitude caused by the execution process of the read-write task of the user;
and determining the preset performance index based on the normal operation performance index and the proportionality coefficient.
Optionally, the obtaining a scaling factor for adjusting the normal operation performance index, which is determined based on the performance degradation expectation, includes:
establishing a parameter configuration interface on a human-computer interaction interface;
and acquiring a proportionality coefficient for adjusting the normal operation performance index based on the performance degradation expected configuration by the user terminal through the parameter configuration interface.
Optionally, the correspondingly adjusting the current task reconstruction speed of the disk array based on the determination result and a preset reconstruction task scheduling rule includes:
and when the judgment result is that the real-time performance index is not less than the preset performance index, improving the current reconstruction task speed of the disk array.
Optionally, the correspondingly adjusting the current task reconstruction speed of the disk array based on the determination result and a preset reconstruction task scheduling rule includes:
and when the judgment result is that the real-time performance index is smaller than the preset performance index, keeping the current reconstruction task speed of the disk array unchanged.
In a second aspect, the present application discloses a disk array reconfiguration task scheduling apparatus, including:
the performance index counting module is used for counting the real-time performance index of the current disk array; the real-time performance index is a performance index represented by the number of the currently executed first user read-write tasks;
the adjustment judging module is used for judging whether the reconstruction task speed of the disk array needs to be adjusted currently or not based on the real-time performance index and a preset performance index so as to obtain a corresponding judging result; the preset performance index is a performance index represented by the number of second user read-write tasks which can be expected to be executed;
and the task adjusting module is used for correspondingly adjusting the current reconstruction task speed of the disk array based on the judgment result and a preset reconstruction task scheduling rule.
In a third aspect, the present application discloses an electronic device, comprising:
a memory for storing a computer program;
and the processor is used for executing the computer program to realize the steps of the disk array reconfiguration task scheduling method disclosed in the foregoing.
In a fourth aspect, the present application discloses a computer readable storage medium for storing a computer program; wherein, the computer program realizes the steps of the disk array reconfiguration task scheduling method disclosed in the foregoing when being executed by a processor.
The method comprises the steps of counting the real-time performance index of the current disk array; the real-time performance index is a performance index represented by the number of the currently executed first user read-write tasks; judging whether the reconstruction task speed of the disk array needs to be adjusted currently or not based on the real-time performance index and a preset performance index so as to obtain a corresponding judgment result; the preset performance index is a performance index represented by the number of second user read-write tasks which can be expected to be executed; and correspondingly adjusting the current reconstruction task speed of the disk array based on the judgment result and a preset reconstruction task scheduling rule. Therefore, the problem that target values are difficult to set under the scene of uneven performance during the execution of the reconstruction task can be solved by scheduling and limiting the reconstruction task based on the real-time performance index and the preset performance index of the disk array, the current reconstruction task speed of the disk array is correspondingly adjusted based on the preset reconstruction task adjustment rule, the reconstruction task can be subjected to self-adaptive speed adjustment, the performance index requirements corresponding to the read-write task of a user are adapted, the configuration process is simplified, and the operation efficiency of the storage server system is further improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a disk array reconfiguration task scheduling method disclosed in the present application;
FIG. 2 is a schematic diagram of a dispatch pool as disclosed herein;
FIG. 3 is a flowchart of a specific disk array reconfiguration task scheduling method disclosed in the present application;
FIG. 4 is a flowchart of a specific disk array reconfiguration task scheduling method disclosed in the present application;
FIG. 5 is a schematic diagram of a disk array reconfiguration task cycle schedule according to the present disclosure;
fig. 6 is a schematic structural diagram of a disk array reconfiguration task scheduling apparatus disclosed in the present application;
fig. 7 is a block diagram of an electronic device disclosed in the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Currently, when the reconfiguration work is running, the user service and the background task are interactively operated, so that the running of the background task affects the performance of the user service, the scheduling speed of the background task is generally in negative correlation with the performance of the user service, the faster the scheduling speed of the background task is, the lower the performance of the user service is, and therefore a target value is set to limit the scheduling speed of the background task. However, since the setting of the target value is related to the performance of the user service, the fixed target value is not matched with the change of the user service scene in real time, so that the calculation mode related to the setting of the target value is very complicated and needs to be updated continuously, and the target value cannot be commonly used on various platforms. Therefore, the method for scheduling the disk array reconfiguration task is correspondingly provided, the problem that the target value is difficult to set in the scene with uneven performance in reconfiguration can be solved, adaptive scheduling speed control is achieved, the scheduling process is simplified, and therefore the operating efficiency of the storage system is improved.
The embodiment of the invention discloses a disk array reconstruction task scheduling method, which is shown in figure 1 and comprises the following steps:
step S11: counting the real-time performance index of the current disk array; the real-time performance index is a performance index represented by the number of the currently executed first user read-write tasks.
It should be noted that, as shown in fig. 2, when a user read-write operation is transmitted to the array layer of the disk array, the array module of the array layer encapsulates the user read-write operation into a user read-write task, and places the user read-write task into a scheduling pool, so that the scheduling pool has multiple tasks, such as the user read-write task, a background reconstruction task generated by the scheduling pool itself, and a foreground reconstruction task caused by the user read-write task, where the foreground reconstruction task and the background reconstruction task cooperate to complete a reconstruction task. And the scheduling pool can select a proper processing mode to process the tasks according to different task types. The scheduling pool is used as a scheduler for processing array layer tasks, the user read-write tasks are delivered to the scheduling pool from the outside through an interface provided by the scheduling pool, and the interface provided by the scheduling pool comprises a plurality of linked lists which are respectively used for storing the tasks of a plurality of threads so as to ensure the multithreading performance.
In this embodiment, it is required to record the number of the executed user read-write tasks in real time to determine the operation performance corresponding to the user read-write tasks, and indirectly reflect the real-time performance index of the current disk array, where it can be understood that the real-time performance index is a performance index represented by the number of the currently executed first user read-write tasks. For example, the frequency of executing the user read-write task counted in real time may indirectly reflect the real-time performance index of the current disk array.
Step S12: judging whether the reconstruction task speed of the disk array needs to be adjusted currently or not based on the real-time performance index and a preset performance index so as to obtain a corresponding judgment result; the preset performance index is a performance index represented by the number of second user read-write tasks expected to be executed.
In this embodiment, after the real-time performance index of the current disk array is determined, whether the reconstruction task speed of the disk array needs to be adjusted currently is determined based on the real-time performance index and a preset performance index, so as to obtain a corresponding determination result. It can be understood that the real-time performance index and the preset performance index are compared to determine whether the reconstruction task speed of the disk array needs to be adjusted currently. It should be noted that the preset performance index is a performance index represented by the number of the second user read-write tasks expected to be executed, that is, the preset performance index is determined by the number of the second user read-write tasks expected to be executed, so that when a plurality of tasks such as a reconfiguration task and the user read-write tasks are executed in parallel, if the performance of the user read-write tasks is reduced to exceed the performance of the expected index, the reconfiguration task is guaranteed to be adjusted in time.
Step S13: and correspondingly adjusting the current reconstruction task speed of the disk array based on the judgment result and a preset reconstruction task scheduling rule.
In this embodiment, whether the reconstruction task speed of the disk array needs to be adjusted currently is determined based on the real-time performance index and the preset performance index, so as to obtain a corresponding determination result, and then, the current reconstruction task speed of the disk array is adjusted correspondingly based on the determination result and a preset reconstruction task scheduling rule. Namely, after the comparison result of the real-time performance index and the preset performance index is determined, the reconstruction task speed of the disk array is adjusted based on the comparison result. It can be understood that the preset reconstruction task scheduling rule is mainly used for specifying a rule for performing linear adjustment or nonlinear adjustment on the reconstruction task speed.
In a specific embodiment, the correspondingly adjusting the current task reconstruction speed of the disk array based on the determination result and a preset reconstruction task scheduling rule may include: and when the judgment result is that the real-time performance index is not less than the preset performance index, improving the current reconstruction task speed of the disk array. It can be understood that, after the speed of the current reconfiguration task of the disk array is increased, the reconfiguration task can be completed as soon as possible, and since a certain area of the disk array corresponding to the user read-write task must be an area in which the reconfiguration task has already been completed, the reconfiguration task in the area must be completed before the user read-write task reads and writes the certain area of the disk array, so that the speed of the reconfiguration task needs to be increased to complete the reconfiguration task in the area as soon as possible, so as to release the resources of the disk array and improve the performance of the disk array in processing the user read-write task.
In another specific embodiment, the correspondingly adjusting the current reconstruction task speed of the disk array based on the determination result and a preset reconstruction task scheduling rule may include: and when the judgment result is that the real-time performance index is smaller than the preset performance index, keeping the current reconstruction task speed of the disk array unchanged. It can be understood that, when the real-time performance index is smaller than the preset performance index, the current reconstruction task speed of the disk array can be reduced according to actual application requirements, so as to increase the number of the user read-write tasks in unit time, thereby improving the real-time performance index of the disk array.
As shown in fig. 3, when there are a reconfiguration task and a user read-write task in the disk array, it is necessary to determine whether the speed of the reconfiguration task of the disk array needs to be adjusted currently based on the real-time performance index and the preset performance index. For example, when the real-time performance index is higher than the preset performance index, the reconstruction task is preferentially executed, after the reconstruction task is executed, whether the current real-time performance index is higher than the preset performance index needs to be judged again, if the real-time performance index is not higher than the preset performance index, the user read-write task is preferentially executed and counted in real time, so as to count the number of the executed user read-write tasks, and after the user read-write task is completed, the step of judging whether the speed of the reconstruction task of the disk array needs to be adjusted currently based on the real-time performance index and the preset performance index is returned, so that the process is circulated until all tasks in the disk array are executed.
Therefore, in the embodiment of the application, the problem that the target value is difficult to set under the scene of uneven performance during the execution of the reconfiguration task can be solved by performing the scheduling limitation of the reconfiguration task based on the real-time performance index and the preset performance index of the disk array, and the current reconfiguration task speed of the disk array is correspondingly adjusted based on the preset reconfiguration task adjustment rule, so that the reconfiguration task can perform self-adaptive speed adjustment, thereby adapting to the performance index requirements corresponding to the read-write task of a user, simplifying the configuration process, and further improving the operation efficiency of the storage server system.
Referring to fig. 4, an embodiment of the present invention discloses a specific disk array reconfiguration task scheduling method, and compared with the previous embodiment, this embodiment further describes and optimizes the technical solution.
Step S21: counting the number of the user read-write tasks which have been executed in the last historical time period, and carrying out average processing on the counted number of the user read-write tasks to obtain the number of the first user read-write tasks.
In this embodiment, in order to obtain the number of the first user read-write tasks, the number of the user read-write tasks that have been executed in the last historical time period needs to be counted, and the counted number of the user read-write tasks is averaged, where the averaged number of the user read-write tasks is the number of the first user read-write tasks. It can be understood that, counting the number of the user read-write tasks refers to the user read-write tasks in the previous history period. For example, the number of the user read-write tasks executed in the last reconstruction running period is counted, and the counted number of the user read-write tasks is averaged to obtain the number of the first user read-write tasks. The reconstruction running period is from the starting time of the reconstruction task to the ending time of the reconstruction task.
Step S22: and determining the current real-time performance index of the disk array based on the number of the first user read-write tasks.
In this embodiment, after the number of the first user read-write tasks is obtained, the current real-time performance index of the disk array is determined based on the number of the first user read-write tasks. It can be understood that, when the number of the read-write tasks of the first user is larger, the real-time performance index of the current disk array is better. That is, the number of the read-write tasks of the first user may reflect the current real-time performance index of the disk array.
Step S23: judging whether the reconstruction task speed of the disk array needs to be adjusted currently or not based on the real-time performance index and a preset performance index so as to obtain a corresponding judgment result; the preset performance index is a performance index represented by the number of second user read-write tasks expected to be executed.
Step S24: and correspondingly adjusting the current reconstruction task speed of the disk array based on the judgment result and a preset reconstruction task scheduling rule.
For the details of the above steps S23 to S24, reference may be made to the corresponding contents disclosed in the foregoing embodiments, and details are not repeated here.
In the embodiment of the application, the current real-time performance index of the disk array is determined based on the counted number of the first user read-write tasks which have been executed in the last historical time period, then the scheduling limitation of the reconstruction task is performed based on the real-time performance index and the preset performance index, the problem that the target value is difficult to set under the scene of uneven performance during the execution of the reconstruction task can be solved, the current reconstruction task speed of the disk array is correspondingly adjusted based on the preset reconstruction task adjustment rule, the reconstruction task can be adaptively adjusted, the performance index requirements corresponding to the user read-write tasks are met, the configuration process is simplified, and the operation efficiency of the storage server system is further improved.
Referring to fig. 5, an embodiment of the present invention discloses a specific disk array reconfiguration task scheduling method, and compared with the previous embodiment, this embodiment further describes and optimizes the technical solution.
Step S31: counting the real-time performance index of the current disk array; the real-time performance index is a performance index represented by the number of the currently executed first user read-write tasks.
Step S32: acquiring a normal operation performance index of the disk array; and the normal operation performance index is a performance index represented by the number of the third user read-write tasks which can be executed in a normal operation state.
In this embodiment, when the disk array has no reconfiguration task, the normal operation performance index of the disk array is obtained. It can be understood that the normal operation performance index is a performance index represented by the number of third user read-write tasks that can be executed in the normal operation state, that is, the number of user read-write tasks in a preset time period is counted in the normal operation state corresponding to the normal operation state without causing an abnormal condition, and the number of user read-write tasks is averaged to obtain the number of third user read-write tasks, so that the number of third user read-write tasks is used to represent the normal operation performance index.
Step S33: obtaining a scaling factor for adjusting the normal operation performance index determined based on performance degradation expectations; the performance reduction expectation is the expectation of the performance reduction amplitude caused by the execution process of the read-write task of the user.
In this embodiment, in order to determine the preset performance index, a scaling factor for adjusting the normal operation performance index, which is determined based on performance degradation expectation, needs to be obtained. It can be understood that the performance degradation is expected to be the performance degradation caused by the execution process of the user read-write task, and specifically, a parameter configuration interface is created on the human-computer interaction interface; and acquiring a proportionality coefficient for adjusting the normal operation performance index based on the performance degradation expected configuration by the user terminal through the parameter configuration interface. In this embodiment, the expected performance degradation value may range from 0 to 100. For example, the expected value a of the performance degradation may be 60, and the scaling factor corresponding to the expected value a/100, that is, the scaling factor is 60%.
Step S34: and determining the preset performance index based on the normal operation performance index and the proportionality coefficient.
In this embodiment, after the normal operation performance index and the scaling factor are determined, the preset performance index is determined based on the normal operation performance index and the scaling factor. It can be understood that the normal operation performance index B is multiplied by the scaling factor a/100 to obtain the preset performance index a × B/100, and thus, in an actual application, if a higher preset performance index is needed, when the scaling factor for adjusting the normal operation performance index determined based on performance degradation expectation is obtained, a higher scaling factor corresponding to the actual application requirement in a value range is obtained through the parameter configuration interface.
Step S35: judging whether the reconstruction task speed of the disk array needs to be adjusted currently or not based on the real-time performance index and a preset performance index so as to obtain a corresponding judgment result; the preset performance index is a performance index represented by the number of second user read-write tasks which can be expected to be executed;
step S36: and correspondingly adjusting the current reconstruction task speed of the disk array based on the judgment result and a preset reconstruction task scheduling rule.
For the details of the above steps S35 to S36, reference may be made to the corresponding contents disclosed in the foregoing embodiments, and details are not repeated here.
It can be seen that, in the embodiment of the present application, the preset performance index is determined based on the normal operation performance index and the proportionality coefficient, then the problem of difficulty in setting the target value in the scene of uneven performance during the execution of the reconfiguration task can be solved by performing scheduling limitation on the reconfiguration task based on the real-time performance index of the disk array and the preset performance index, and the current reconfiguration task speed of the disk array is correspondingly adjusted based on the preset reconfiguration task adjustment rule, so that the reconfiguration task can perform adaptive speed adjustment, thereby adapting to the performance index requirements corresponding to the read-write task of the user, simplifying the configuration flow, and further improving the operation efficiency of the storage server system.
Correspondingly, an embodiment of the present application further discloses a disk array reconfiguration task scheduling apparatus, as shown in fig. 6, the apparatus includes:
the performance index counting module 11 is used for counting the real-time performance index of the current disk array; the real-time performance index is a performance index represented by the number of the currently executed first user read-write tasks;
an adjustment judging module 12, configured to judge whether a reconstruction task speed of the disk array needs to be adjusted currently based on the real-time performance index and a preset performance index, so as to obtain a corresponding judgment result; the preset performance index is a performance index represented by the number of second user read-write tasks which can be expected to be executed;
and the task adjusting module 13 is configured to correspondingly adjust the current reconstruction task speed of the disk array based on the determination result and a preset reconstruction task scheduling rule.
The method comprises the steps of counting the real-time performance index of the current disk array; the real-time performance index is a performance index represented by the number of the currently executed first user read-write tasks; judging whether the reconstruction task speed of the disk array needs to be adjusted currently or not based on the real-time performance index and a preset performance index so as to obtain a corresponding judgment result; the preset performance index is a performance index represented by the number of second user read-write tasks which can be expected to be executed; and correspondingly adjusting the current reconstruction task speed of the disk array based on the judgment result and a preset reconstruction task scheduling rule. Therefore, the problem that target values are difficult to set under the scene of uneven performance during the execution of the reconstruction task can be solved by scheduling and limiting the reconstruction task based on the real-time performance index and the preset performance index of the disk array, the current reconstruction task speed of the disk array is correspondingly adjusted based on the preset reconstruction task adjustment rule, the reconstruction task can be subjected to self-adaptive speed adjustment, the performance index requirements corresponding to the read-write task of a user are adapted, the configuration process is simplified, and the operation efficiency of the storage server system is further improved.
In some specific embodiments, the performance index statistics module 11 may specifically include:
the first task quantity counting unit is used for counting the quantity of the user read-write tasks which are executed in the last historical time period;
the first average processing unit is used for carrying out average processing on the counted number of the user read-write tasks to obtain the number of the first user read-write tasks;
and the first performance index determining unit is used for determining the current real-time performance index of the disk array based on the number of the first user read-write tasks.
In some specific embodiments, the performance index statistics module 11 may specifically include:
the second task quantity counting unit is used for counting the quantity of the user read-write tasks executed in the last reconstruction operation period;
and the second average processing unit is used for carrying out average processing on the counted number of the user read-write tasks to obtain the number of the first user read-write tasks.
In some specific embodiments, the task scheduler for reconstructing a disk array further includes:
the performance index acquisition module is used for acquiring the normal operation performance index of the disk array; the normal operation performance index is a performance index represented by the number of third user read-write tasks which can be executed in a normal operation state;
a scaling factor obtaining module for obtaining a scaling factor for adjusting the normal operation performance index determined based on performance degradation expectation; the performance reduction expectation is the expectation of performance reduction amplitude caused by the execution process of the read-write task of the user;
and the second performance index determining module is used for determining the preset performance index based on the normal operation performance index and the proportionality coefficient.
In some specific embodiments, the scaling factor obtaining module may specifically include:
the interface configuration unit is used for creating a parameter configuration interface on the human-computer interaction interface;
and the proportionality coefficient acquisition unit is used for acquiring a proportionality coefficient which is used for adjusting the normal operation performance index and is configured by the user terminal based on the performance degradation expectation through the parameter configuration interface.
In some specific embodiments, the task adjusting module 13 may specifically include:
and the speed increasing unit is used for increasing the current reconstruction task speed of the disk array when the judgment result shows that the real-time performance index is not less than the preset performance index.
In some specific embodiments, the task adjusting module 13 may specifically include:
and the speed maintaining unit is used for maintaining the current reconstruction task speed of the disk array unchanged when the judgment result shows that the real-time performance index is smaller than the preset performance index.
Further, the embodiment of the application also provides electronic equipment. FIG. 7 is a block diagram illustrating an electronic device 20 according to an exemplary embodiment, and the contents of the diagram should not be construed as limiting the scope of use of the present application in any way.
Fig. 7 is a schematic structural diagram of an electronic device 20 according to an embodiment of the present disclosure. The electronic device 20 may specifically include: at least one processor 21, at least one memory 22, a power supply 23, a communication interface 24, an input output interface 25, and a communication bus 26. The memory 22 is configured to store a computer program, and the computer program is loaded and executed by the processor 21 to implement relevant steps in the disk array reconfiguration task scheduling method disclosed in any of the foregoing embodiments. In addition, the electronic device 20 in the present embodiment may be specifically an electronic computer.
In this embodiment, the power supply 23 is configured to provide a working voltage for each hardware device on the electronic device 20; the communication interface 24 can create a data transmission channel between the electronic device 20 and an external device, and a communication protocol followed by the communication interface is any communication protocol applicable to the technical solution of the present application, and is not specifically limited herein; the input/output interface 25 is configured to obtain external input data or output data to the outside, and a specific interface type thereof may be selected according to specific application requirements, which is not specifically limited herein.
In addition, the storage 22 is used as a carrier for resource storage, and may be a read-only memory, a random access memory, a magnetic disk or an optical disk, etc., and the resources stored thereon may include an operating system 221, a computer program 222, etc., and the storage manner may be a transient storage or a permanent storage.
The operating system 221 is used for managing and controlling each hardware device on the electronic device 20 and the computer program 222, and may be Windows Server, Netware, Unix, Linux, or the like. The computer program 222 may further include a computer program that can be used to perform other specific tasks in addition to the computer program that can be used to perform the disk array reconfiguration task scheduling method executed by the electronic device 20 disclosed in any of the foregoing embodiments.
Further, an embodiment of the present application further discloses a storage medium, where a computer program is stored in the storage medium, and when the computer program is loaded and executed by a processor, the steps of the disk array reconfiguration task scheduling method disclosed in any of the foregoing embodiments are implemented.
The embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same or similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The disk array reconfiguration task scheduling method, device, equipment and storage medium provided by the invention are introduced in detail, and a specific example is applied in the text to explain the principle and the implementation of the invention, and the description of the above embodiment is only used to help understanding the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A disk array reconfiguration task scheduling method is characterized by comprising the following steps:
counting the real-time performance index of the current disk array; the real-time performance index is a performance index represented by the number of the currently executed first user read-write tasks;
judging whether the reconstruction task speed of the disk array needs to be adjusted currently or not based on the real-time performance index and a preset performance index so as to obtain a corresponding judgment result; the preset performance index is a performance index represented by the number of second user read-write tasks which can be expected to be executed;
and correspondingly adjusting the current reconstruction task speed of the disk array based on the judgment result and a preset reconstruction task scheduling rule.
2. The method according to claim 1, wherein the counting the real-time performance index of the current disk array includes:
counting the number of executed user read-write tasks in the last historical time period, and carrying out average processing on the counted number of the user read-write tasks to obtain the number of first user read-write tasks;
and determining the current real-time performance index of the disk array based on the number of the first user read-write tasks.
3. The disk array reconfiguration task scheduling method according to claim 2, wherein the counting the number of user read/write tasks that have been executed in a previous historical time period, and performing an average process on the counted number of user read/write tasks to obtain a first number of user read/write tasks includes:
and counting the number of the executed user read-write tasks in the last reconstruction operation period, and performing average processing on the counted number of the user read-write tasks to obtain the number of the first user read-write tasks.
4. The method for scheduling the disk array reconfiguration task according to claim 1, wherein before the determining whether the speed of the reconfiguration task of the disk array needs to be adjusted currently, the method further comprises:
acquiring a normal operation performance index of the disk array; the normal operation performance index is a performance index represented by the number of third user read-write tasks which can be executed in a normal operation state;
obtaining a scaling factor for adjusting the normal operation performance index determined based on performance degradation expectations; the performance reduction expectation is the expectation of performance reduction amplitude caused by the execution process of the read-write task of the user;
and determining the preset performance index based on the normal operation performance index and the proportionality coefficient.
5. The disk array reconfiguration task scheduling method according to claim 4, wherein said obtaining a scaling factor for adjusting the normal operation performance indicator determined based on performance degradation expectation comprises:
establishing a parameter configuration interface on a human-computer interaction interface;
and acquiring a proportionality coefficient for adjusting the normal operation performance index based on the performance degradation expected configuration by the user terminal through the parameter configuration interface.
6. The disk array reconfiguration task scheduling method according to any one of claims 1 to 5, wherein the correspondingly adjusting a current reconfiguration task speed of the disk array based on the determination result and a preset reconfiguration task scheduling rule includes:
and when the judgment result is that the real-time performance index is not less than the preset performance index, improving the current reconstruction task speed of the disk array.
7. The disk array reconfiguration task scheduling method according to any one of claims 1 to 5, wherein the correspondingly adjusting a current reconfiguration task speed of the disk array based on the determination result and a preset reconfiguration task scheduling rule includes:
and when the judgment result is that the real-time performance index is smaller than the preset performance index, keeping the current reconstruction task speed of the disk array unchanged.
8. A disk array reconfiguration task scheduling apparatus, comprising:
the performance index counting module is used for counting the real-time performance index of the current disk array; the real-time performance index is a performance index represented by the number of the currently executed first user read-write tasks;
the adjustment judging module is used for judging whether the reconstruction task speed of the disk array needs to be adjusted currently or not based on the real-time performance index and a preset performance index so as to obtain a corresponding judging result; the preset performance index is a performance index represented by the number of second user read-write tasks which can be expected to be executed;
and the task adjusting module is used for correspondingly adjusting the current reconstruction task speed of the disk array based on the judgment result and a preset reconstruction task scheduling rule.
9. An electronic device, comprising:
a memory for storing a computer program;
a processor for executing the computer program to implement the steps of the disk array reconfiguration task scheduling method according to any one of claims 1 to 7.
10. A computer-readable storage medium for storing a computer program; wherein the computer program when executed by a processor implements the steps of the disk array reconfiguration task scheduling method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111450041.7A CN114327813A (en) | 2021-11-30 | 2021-11-30 | Disk array reconstruction task scheduling method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111450041.7A CN114327813A (en) | 2021-11-30 | 2021-11-30 | Disk array reconstruction task scheduling method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114327813A true CN114327813A (en) | 2022-04-12 |
Family
ID=81048391
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111450041.7A Withdrawn CN114327813A (en) | 2021-11-30 | 2021-11-30 | Disk array reconstruction task scheduling method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114327813A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117311995A (en) * | 2023-11-28 | 2023-12-29 | 苏州元脑智能科技有限公司 | Background task execution method and system of storage system and controller |
-
2021
- 2021-11-30 CN CN202111450041.7A patent/CN114327813A/en not_active Withdrawn
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117311995A (en) * | 2023-11-28 | 2023-12-29 | 苏州元脑智能科技有限公司 | Background task execution method and system of storage system and controller |
| CN117311995B (en) * | 2023-11-28 | 2024-02-23 | 苏州元脑智能科技有限公司 | Background task execution method and system of storage system and controller |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9152463B2 (en) | Electronic data store | |
| US8887166B2 (en) | Resource allocation and modification using access patterns | |
| US9298563B2 (en) | Changing a number of disk agents to backup objects to a storage device | |
| EP2689329B1 (en) | Data backup prioritization | |
| US8191070B2 (en) | Dynamic resource allocation | |
| US8019728B2 (en) | Dynamically quantifying and improving the reliability of distributed data storage systems | |
| US8364710B2 (en) | Model-based resource allocation | |
| US20160202933A1 (en) | Impact-based migration scheduling | |
| US20090100108A1 (en) | Replica Placement and Repair Strategies in Multinode Storage Systems | |
| US20140040573A1 (en) | Determining a number of storage devices to backup objects in view of quality of service considerations | |
| EP2311250A1 (en) | Model-based resource allocation | |
| WO2017039800A1 (en) | Systems and methods for repair rate control for large erasure coded data storage | |
| CN112433881A (en) | Data recovery method and device for distributed storage system | |
| CN114327813A (en) | Disk array reconstruction task scheduling method, device, equipment and storage medium | |
| US9727252B2 (en) | Methods and systems for optimal snapshot distribution within a protection schedule | |
| US8725868B2 (en) | Interactive service management | |
| CN108306780B (en) | Cloud environment-based virtual machine communication quality self-optimization system and method | |
| CN109002263A (en) | The method of adjustment and device of memory capacity | |
| CN116248699B (en) | Data reading method, device, equipment and storage medium in multi-copy scene | |
| CN114327259B (en) | Flash memory channel controller operation method, device, equipment and storage medium | |
| CN106484310B (en) | Storage array operation method and device | |
| CN110059062B (en) | Stripe setting method and system of file system and related components | |
| CN115878047B (en) | Data consistency verification method, device, equipment and storage medium | |
| CN111399779B (en) | Flow control method and device | |
| CN117591301B (en) | Monitoring cloud resource allocation optimization method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20220412 |