WO2023184907A1

WO2023184907A1 - Multi-control storage system io processing method and system, and related component

Info

Publication number: WO2023184907A1
Application number: PCT/CN2022/121922
Authority: WO
Inventors: 刘丹
Original assignee: 苏州浪潮智能科技有限公司
Priority date: 2022-03-30
Filing date: 2022-09-27
Publication date: 2023-10-05
Also published as: CN114415981B; CN114415981A

Abstract

A multi-control storage system IO processing method and system, and a related component, applied to the field of storage system control. The multi-control storage system IO processing method comprises: determining the correspondences between a plurality of strips and a plurality of controllers (S1), so that write processing tasks of all the strips are respectively in the charge of the plurality of controllers, and two strips in the charge of any two controllers do not coincide; receiving an IO task, and determining, from among all the strips, a target strip corresponding to the IO task (S2); determining whether the IO task is a write processing task (S3); if the IO task is a write processing task, determining that a target controller is a controller corresponding to the target strip (S4); if the IO task is not a write processing task, determining that the target controller is any controller (S5); and controlling the target controller to execute the IO task (S6). The multi-control storage system IO processing method and system, and the related component are used for processing the IO task of a multi-control storage system, specific controllers are allocated to write operations of all the strips, and the target controller is intentionally allocated when the IO task is received, so that the write processing task can only be achieved by the unique corresponding controller, and thus, lock-free mutual exclusion between IO tasks is ensured.

Description

An IO processing method, system and related components for a multi-control storage system

Cross-references to related applications

This application requires the priority of the Chinese patent application submitted to the China Patent Office on March 30, 2022, with the application number 202210321234.0, and the application name is "An IO processing method, system and related components for a multi-control storage system", all of which The contents are incorporated into this application by reference.

Technical field

This application relates to the field of storage system control, and in particular to an IO processing method, system and related components of a multi-control storage system.

Background technique

Currently, as storage systems have increasingly higher requirements for reliability and performance, the high fault tolerance, high reliability and high performance design of RAID (Redundant Arrays of Independent Disks) has become a necessity. RAID not only needs to perform upper-layer business IO (Input/Output, input/output), but also needs to perform various background tasks, such as inspection, initialization, reconstruction, etc. There are interaction scenarios between these business IO and background tasks. In order to ensure the execution of business For data consistency during IO and background tasks, dual-control storage systems usually add stripe locks between controllers. The stripe lock can ensure mutual exclusion of IO between two controllers at the same time.

Stripe locks usually involve multiple communications between multiple controls. At the same time, stripe locks themselves are a resource. When the business IO concurrency is large, steps such as resource application waiting, dual-control communication, and lock waiting will affect performance. Influence.

Furthermore, as the system's requirements for reliability and redundant protection capabilities increase, multi-control storage systems that exceed dual-control are also developing. In multi-control storage systems, the strip lock scheme is used to achieve IO mutual exclusion, which will inevitably further Increase the communication frequency of the controller, causing more IO waits, further affecting performance.

Contents of the invention

In view of this, the purpose of this application is to provide an IO processing method, system and related components for a multi-control storage system. The specific plan is as follows:

An IO processing method for a multi-control storage system, including:

Determine the corresponding relationship between multiple stripes and multiple controllers, so that the write processing tasks of all strips are respectively responsible for multiple controllers, and the two stripes responsible for any two controllers do not overlap;

Receive IO tasks and determine the target strip corresponding to the IO task in all strips;

Determine whether the IO task is a write processing task;

If the IO task is a write processing task, determine the target controller as the controller corresponding to the target stripe;

If the IO task is not a write processing task, determine the target controller to be any controller;

Control the target controller to perform IO tasks.

Optional, control the process of the target controller executing IO tasks, including:

Control the target controller to execute IO tasks through task queuing and striped IO counting.

If the IO task is a write processing task, the target controller is controlled to execute the IO task through ROW writing.

Optionally, write processing tasks include background tasks and write operation tasks.

Optional, background tasks include:

One or more of reconstruction, inspection, slow disk detection, and initialization.

Optional, the process of determining the correspondence between multiple strips and multiple controllers includes:

All stripes are distributed to multiple controllers via round robin or hash algorithm.

Optional, IO processing methods also include:

When the controller status changes, the corresponding relationships between all strips and all controllers are re-determined.

Correspondingly, this application also discloses an IO processing system for a multi-control storage system, including:

The relationship module is used to determine the corresponding relationship between multiple strips and multiple controllers, so that the write processing tasks of all strips are respectively responsible for multiple controllers, and the two strips responsible for any two controllers do not overlap. ;

The strip determination module is used to receive IO tasks and determine the target strip corresponding to the IO task in all strips;

The controller determination module is used to determine whether the IO task is a write processing task; if the IO task is a write processing task, determine the target controller as the controller corresponding to the target strip; if the IO task is not a write processing task, determine the target controller for any controller;

Action module, used to control the target controller to perform IO tasks.

Correspondingly, this application also discloses an IO processing device for a multi-control storage system, including:

Memory, used to store computer programs;

The processor is used to implement the steps of any of the above IO processing methods of the multi-control storage system when executing the computer program.

Correspondingly, this application also discloses a non-volatile readable storage medium. A computer program is stored on the non-volatile readable storage medium. When the computer program is executed by the processor, any of the above multi-control storage systems are implemented. The steps of the IO processing method.

This application discloses an IO processing method for a multi-control storage system, which includes: determining the corresponding relationship between multiple strips and multiple controllers, so that the write processing tasks of all strips are respectively responsible for multiple controllers, and any two The two strips responsible for each controller do not overlap; receive the IO task and determine the target strip corresponding to the IO task in all strips; determine whether the IO task is a write processing task; if the IO task is a write processing task, determine The target controller is the controller corresponding to the target stripe; if the IO task is not a write processing task, determine the target controller to be any controller; control the target controller to perform the IO task. This application allocates specific controllers for the write operations of all stripes, and intentionally allocates target controllers when receiving IO tasks, so that the write processing tasks can only be implemented by the only corresponding controller, thereby ensuring that the IO tasks Technical effect of lock-free mutual exclusion.

Description of drawings

In order to explain the embodiments of the present application or the technical solutions in the prior art more clearly, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are only This is an embodiment of the present application. For those of ordinary skill in the art, other drawings can be obtained based on the provided drawings without exerting creative efforts.

Figure 1 is a step flow chart of an IO processing method for a multi-control storage system in an embodiment of the present application;

Figure 2 is a structural distribution diagram of an IO processing system of a multi-control storage system in an embodiment of the present application;

Figure 3 is a structural distribution diagram of an IO processing device of a multi-control storage system in an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

In order to ensure data consistency when executing business IO and background tasks, dual-control storage systems usually add stripe locks between controllers. The stripe lock can ensure that the IO of two controllers at the same time is mutually exclusive. However, stripe locks usually involve multiple inter-frame communications between multiple controllers. At the same time, stripe locks themselves are a resource. When business IO concurrency is large, steps such as resource application waiting, dual-control communication, and lock waiting will all be interrupted. impact on performance.

This application allocates specific controllers for the write operations of all stripes, and intentionally allocates target controllers when receiving IO tasks, so that the write processing tasks can only be implemented by the only corresponding controller, thereby ensuring that the IO tasks Technical effect of lock-free mutual exclusion.

The embodiment of the present application discloses an IO processing method for a multi-control storage system, as shown in Figure 1, which includes:

S1: Determine the corresponding relationship between multiple stripes and multiple controllers, so that the write processing tasks of all strips are respectively responsible for multiple controllers, and the two stripes responsible for any two controllers do not overlap;

Specifically, the correspondence here realizes the isolation of the address space, so that mutually exclusive task execution can be realized between controllers without additional locking. When determining the corresponding relationship, all stripes are generally allocated to multiple controllers through polling or hashing algorithms, and usually all stripes are evenly allocated to multiple controllers. The number of controllers is no less than two, which mainly plays the role of redundancy protection. In some customer systems with higher reliability requirements, the more controllers there are. Furthermore, the corresponding relationship between strips and controllers is not completely fixed. When the status of the controller changes, the corresponding relationships between all strips and all controllers are re-determined to ensure that all strips are responsible for the normal controller. , where the controller status changes, including controller addition or recovery, controller reduction or failure.

S2: Receive the IO task and determine the target strip corresponding to the IO task in all strips;

Specifically, after receiving the IO task, the IO task can be decomposed according to the stripe granularity, and then one or more target stripes corresponding to the IO task can be determined.

S3: Determine whether the IO task is a write processing task;

S4: If the IO task is a write processing task, determine the target controller as the controller corresponding to the target strip;

S5: If the IO task is not a write processing task, determine the target controller to be any controller;

It can be understood that IO tasks include write processing tasks and read request tasks. Write processing tasks specifically include background tasks and write operations. Furthermore, background tasks are unique to RIAD, including reconstruction, inspection, slow disk detection, and initialization. one or more of. It can be understood that write processing tasks specifically involve modification of strip data and must be executed by the controller corresponding to the target strip in the corresponding relationship, rather than other IO tasks that are not write processing tasks, usually read request tasks. Can be executed by other controllers.

S6: Control the target controller to perform IO tasks.

In some specific embodiments, the implementation of step S6 specifically includes: controlling the target controller to execute the IO task through task queuing and stripe IO counting. It can be understood that the target controller uses task queuing and strip IO technology to achieve IO mutual exclusion and high concurrency. When there are multiple write processing tasks for the same target strip, the target controller controls the target controller to achieve this one by one through task queuing. Multiple write processing tasks; when there are both read request tasks and write processing tasks on the same target strip, the active IO count on the strip is generally used to determine whether the strip is occupied to complete mutual exclusion; if there are only Multiple read request tasks are allowed to execute concurrently. That is to say, the target controller that executes the read request task does not necessarily have a corresponding relationship with the target stripe. Among all the task executions of all target stripes, only the write processing task must be implemented by the only corresponding controller. The rest can be IO mutual exclusion is accomplished through task queuing and striped IO counting.

In some specific embodiments, if the IO task is a write processing task, the target controller is controlled to write and execute the IO task through ROW (Redirect-On-Write). It can be understood that when ROW is written, there is a mapping relationship between the metadata controller logical address (L, volume address) and the physical address (P1, RAID address) in the upper layer. When there is no write operation, L points to P1, and the read request directly accesses it. P1 address, during the write operation, L points to P2, but only when the write operation is completed and the metadata is updated (L->P2) can the new read request task be allowed to access the P2 address, that is to say, the read request task during the write operation Either do not execute, or read the old data at the P1 address. There is no situation of reading half of the old data and half of the new data. ROW writing ensures mutual exclusion between write processing tasks and read request tasks.

Embodiments of the present application disclose an IO processing method for a multi-control storage system, which includes: determining the correspondence between multiple strips and multiple controllers, so that the write processing tasks of all strips are respectively responsible for multiple controllers, and The two strips responsible for any two controllers do not overlap; receive the IO task and determine the target strip corresponding to the IO task in all strips; determine whether the IO task is a write processing task; if the IO task is a write processing task , determine the target controller as the controller corresponding to the target strip; if the IO task is not a write processing task, determine the target controller as any controller; control the target controller to perform the IO task. This application allocates specific controllers for the write operations of all stripes, and intentionally allocates target controllers when receiving IO tasks, so that the write processing tasks can only be implemented by the only corresponding controller, thereby ensuring that the IO tasks Technical effect of lock-free mutual exclusion.

Correspondingly, embodiments of the present application also disclose an IO processing system for a multi-control storage system, as shown in Figure 2, which includes:

Relationship module 1 is used to determine the corresponding relationship between multiple strips and multiple controllers, so that the write operations of all strips are respectively responsible for multiple controllers, and the two strips responsible for any two controllers do not overlap. ;

Strip determination module 2 is used to receive IO tasks and determine the target strip corresponding to the IO task in all strips;

Controller determination module 3 is used to determine whether the IO task is a write processing task; if the IO task is a write processing task, determine the target controller as the controller corresponding to the target strip; if the IO task is not a write processing task, determine the target control The device is any controller;

Action module 4 is used to control the target controller to perform IO tasks.

The embodiment of this application allocates specific controllers to the write operations of all stripes, and intentionally allocates target controllers when receiving IO tasks, so that the write processing tasks can only be implemented by the only corresponding controller, thereby ensuring that the IO tasks The technical effect of lock-free mutual exclusion between them.

In some specific embodiments, the action module 4 is specifically used to:

In some specific embodiments, write processing tasks include background tasks and write operation tasks.

In some specific embodiments, the background tasks include: one or more of reconstruction, inspection, slow disk detection, and initialization.

In some specific embodiments, relationship module 1 is specifically used to:

In some specific embodiments, relationship module 1 is also used to:

Correspondingly, the embodiment of the present application also discloses an IO processing device for a multi-control storage system, as shown in Figure 3, which includes:

Memory 11, used to store computer programs;

The processor 12 is configured to implement the steps of the IO processing method of any of the above multi-control storage systems when executing a computer program.

Correspondingly, embodiments of the present application also disclose a non-volatile readable storage medium. A computer program is stored on the non-volatile readable storage medium. When the computer program is executed by the processor, any of the above multi-control functions are implemented. The steps of the storage system's IO processing method.

For details about the IO processing method of the multi-control storage system, please refer to the relevant descriptions in the above embodiments and will not be described again here.

Among them, the IO processing device and non-volatile readable storage medium of the multi-control storage system in this embodiment have the same technical effects as the IO processing method of the multi-control storage system in the above embodiment, and will not be described again here. .

Finally, it should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that these entities or any such actual relationship or sequence between operations. Furthermore, the terms "comprises," "comprises," or any other variations thereof are intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus that includes a list of elements includes not only those elements, but also those not expressly listed other elements, or elements inherent to the process, method, article or equipment. Without further limitation, an element defined by the statement "comprises a..." does not exclude the presence of additional identical elements in a process, method, article, or apparatus that includes the stated element.

The above has introduced in detail the IO processing method, system and related components of a multi-control storage system provided by this application. This article uses specific examples to illustrate the principles and implementation methods of this application. The description of the above embodiments is only It is used to help understand the methods and core ideas of this application; at the same time, for those of ordinary skill in the field, there will be changes in the specific implementation methods and application scope based on the ideas of this application. In summary, this application The content of the description should not be construed as limiting this application.

Claims

An IO processing method for a multi-control storage system, which is characterized by including:

Determine the corresponding relationship between multiple stripes and multiple controllers, so that the write processing tasks of all the strips are respectively responsible for multiple controllers, and any two controllers are responsible for two sections of the strips. None of them overlap;

Receive the IO task and determine the target strip corresponding to the IO task in all the strips;

Determine whether the IO task is the write processing task;

If the IO task is the write processing task, determine the target controller to be the controller corresponding to the target stripe;

If the IO task is not the write processing task, determine that the target controller is any of the controllers;

Control the target controller to execute the IO task.
The IO processing method according to claim 1, characterized in that the process of controlling the target controller to perform the IO task includes:

The target controller is controlled to execute the IO task through task queuing and stripe IO count.
The IO processing method according to claim 1, characterized in that the process of controlling the target controller to perform the IO task includes:

If the IO task is the write processing task, the target controller is controlled to execute the IO task through ROW writing.
The IO processing method according to claim 3, further comprising:

During the execution of the write processing task, other controllers are prohibited from executing read request tasks on data newly written during the execution of the write processing task.
The IO processing method according to claim 1, characterized in that the write processing tasks include background tasks and write operation tasks.
The IO processing method according to claim 5, characterized in that the background tasks include:

One or more of reconstruction, inspection, slow disk detection, and initialization.
The IO processing method according to any one of claims 1 to 6, characterized in that the process of determining the correspondence between multiple strips and multiple controllers includes:

All said strips are distributed to multiple said controllers via a round robin or hashing algorithm.
The IO processing method according to any one of claims 1 to 6, characterized in that the process of determining the correspondence between multiple strips and multiple controllers includes:

All said strips are evenly distributed to multiple said controllers.
The IO processing method according to claim 7, further comprising:

When the status of the controller changes, the corresponding relationships between all the strips and all the controllers are re-determined.
The IO processing method according to claim 9, characterized in that when the status of the controller changes, the process of re-determining the corresponding relationships between all the strips and all the controllers includes:

When the number of the controllers increases or decreases and/or the controller fails and/or the controller repairs the failure, the corresponding relationships between all the strips and all the controllers are re-determined.
The IO processing method according to claim 1, characterized in that the process of receiving an IO task and determining the target strip corresponding to the IO task in all the strips includes:

After receiving the IO task, decompose the IO task according to strip granularity;

The target strip corresponding to the decomposed IO task is determined among all the strips.
The IO processing method according to claim 1, characterized in that if the IO task is not the write processing task, the process of determining the target controller to be any of the controllers includes:

If the IO task is a read request task, the target controller is determined to be any of the controllers.
The IO processing method according to claim 2, wherein the process of controlling the target controller to execute the IO task through task queuing and stripe IO counting includes:

When there are multiple write processing tasks for the same target stripe, the target controller is controlled to execute multiple write processing tasks one by one through task queuing.
The IO processing method according to claim 2, wherein the process of controlling the target controller to execute the IO task through task queuing and stripe IO counting includes:

When the write processing task and the read request task exist for the same target stripe, the target controller is controlled to determine whether the target stripe is occupied through IO counting, so as to complete the processing of the same target stripe based on the judgment result. Mutually exclusive execution of the write processing task and the read request task that exist in the target strip at the same time.
The IO processing method according to claim 2, wherein the process of controlling the target controller to execute the IO task through task queuing and stripe IO counting includes:

When there are multiple read request tasks for the same target stripe, the target controller is controlled to allow multiple read request tasks to be executed concurrently.
The IO processing method according to claim 4, characterized in that, during the execution of the write processing task, other controllers are prohibited from executing read request tasks on newly written data during the execution of the write processing task. The process includes:

During the execution of the write operation task, the logical address of the metadata controller controlling the target controller is converted from the first physical address originally pointed to to the second physical address to prohibit other controllers from accessing the write operation. During the execution of the operation task, the newly written data executes the read request task.
The IO processing method according to claim 16, further comprising:

After the execution of the write operation task is completed, the new read request task is allowed to access the second physical address.
An IO processing system for a multi-control storage system, which is characterized by including:

The relationship module is used to determine the corresponding relationship between multiple strips and multiple controllers, so that the write processing tasks of all the strips are respectively responsible for multiple controllers, and any two controllers are responsible for the two controllers. None of the strips mentioned in the paragraphs overlap;

A strip determination module, configured to receive an IO task and determine the target strip corresponding to the IO task in all the strips;

A controller determination module, used to determine whether the IO task is the write processing task; if the IO task is the write processing task, determine the target controller to be the controller corresponding to the target strip; if The IO task is not the write processing task, and the target controller is determined to be any of the controllers;

An action module is used to control the target controller to execute the IO task.
An IO processing device for a multi-control storage system, which is characterized by including:

Memory, used to store computer programs;

A processor, configured to implement the steps of the IO processing method of the multi-control storage system according to any one of claims 1 to 17 when executing the computer program.
A non-volatile readable storage medium, characterized in that a computer program is stored on the non-volatile readable storage medium, and when the computer program is executed by a processor, it implements any one of claims 1 to 17 The steps of the IO processing method of the multi-control storage system.