WO2021135284A1

WO2021135284A1 - Thick-provisioned volume creating method and apparatus, electronic device, and storage medium

Info

Publication number: WO2021135284A1
Application number: PCT/CN2020/110982
Authority: WO
Inventors: 吴伟; 张端
Original assignee: 浪潮电子信息产业股份有限公司
Priority date: 2019-12-29
Filing date: 2020-08-25
Publication date: 2021-07-08
Also published as: CN111061435A

Abstract

A thick-provisioned volume creating method and apparatus, an electronic device, and a computer readable storage medium. Said method comprises: when a creation command is received, determining the number of threads on the basis of the creation rate in the creation command, the number of the threads being positively correlated with the creation rate; activating target threads, the number of which is equal to the number of the threads, and creating thin-provisioned volumes by using the target threads; and filling the head and tail of each thin-provisioned volume with data of a preset length, so as to obtain a thick-provisioned volume. In the thick-provisioned volume creating method provided in the present application, first, a thin-provisioned volume is created, and when a volume filling operation is performed, the volume is partially filled with a small amount of data, and only a preset length of the head and tail is filled, being able to rapidly complete creation and traversal of all objects, thereby increasing the efficiency of volume filling operation, and further increasing the efficiency of thick-provisioned volume creation. In addition, a plurality of thick-provisioned volumes are created by using a plurality of target threads in parallel, thereby further increasing the efficiency of thick-provisioned volume creation.

Description

Method and device for creating thick provisioned volume, electronic equipment and storage medium

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on December 29, 2019, the application number is 201911386464.X, and the invention title is "a method, device, electronic equipment and storage medium for creating thick stock volumes". The entire content is incorporated into this application by reference.

Technical field

This application relates to the field of storage technology, and more specifically, to a method and device for creating a thick-provisioned volume, an electronic device, and a computer-readable storage medium.

Background technique

In the current distributed storage system, the application of blocks is greatly popularized. As the basic unit of block applications, volumes are responsible for the main function realization and business output. Under the current development situation, volumes are mainly divided into thin volumes and thick provisioned volumes. , The former can realize the rapid creation of volumes and maximize the use of device storage space, while the latter slightly wins in terms of read and write performance. Compared with the creation process of thin volumes, the creation of thick-provisioned volumes requires an operation similar to volume filling of the quota space. Therefore, the creation efficiency is greatly reduced, and the thick-provisioned volume matching application is abandoned in most current scenarios.

Therefore, how to improve the efficiency of creating thick provisioned volumes is a technical problem that needs to be solved by those skilled in the art.

Summary of the invention

The purpose of this application is to provide a method and device for creating a thick-provisioned volume, an electronic device, and a computer-readable storage medium, so as to improve the efficiency of creating a thick-provisioned volume.

In order to achieve the above objective, this application provides a method for creating a thick provisioned volume, including:

When a creation command is received, the number of threads is determined based on the creation rate in the creation command; wherein, the number of threads is positively correlated with the creation rate;

Activate the target thread of the number of threads, and use the target thread to create a reduced volume;

Filling the head and tail of each thin volume with data of a preset length to obtain a thick provision volume.

Among them, it also includes:

Create a thread pool; wherein each thread in the thread pool is locked for protection;

Correspondingly, the activation of the target thread of the number of threads includes:

Activate the target thread of the thread number in the thread pool.

Wherein, the determining the number of threads based on the creation rate in the creation command includes:

The level corresponding to the creation rate in the creation command is determined, and the number of threads is determined based on the level; wherein the level is positively correlated with the creation rate, and the number of threads is positively correlated with the level.

Wherein, after filling the head and tail of each thin volume with data of a preset length to obtain a thick provisioned volume, the method further includes:

Update the object mapping table information of each thick-provisioned volume.

Release all the target threads.

Wherein, filling the head and tail of each thin volume with data of a preset length to obtain a thick provision volume includes:

Fill one byte of data at the head and tail of each thin volume to obtain the thick provisioned volume.

To achieve the above objective, this application provides a thick-provisioned volume creation device, including:

The determining module is configured to determine the number of threads based on the creation rate in the creation command when a creation command is received; wherein the number of threads is positively correlated with the creation rate;

The first creation module is used for activating the target thread of the number of threads, and using the target thread to create a reduced volume;

The filling module is used to fill the head and tail of each thin volume with data of a preset length to obtain a thick provision volume.

Wherein, the filling module is specifically a module that fills one byte of data at the head and tail of each thin volume to obtain the thick provisioned volume.

In order to achieve the above objective, this application provides an electronic device, including:

Memory, used to store computer programs;

The processor is used to implement the steps of the thick-provisioned volume creation method described above when the computer program is executed.

To achieve the foregoing objective, the present application provides a computer-readable storage medium having a computer program stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the thick-provisioned volume creation method described above are realized.

It can be seen from the above solution that the method for creating a thick-provisioned volume provided by the present application includes: when a creation command is received, determining the number of threads based on the creation rate in the creation command; wherein the number of threads is equal to the creation rate There is a positive correlation; the target thread of the number of threads is activated, and the target thread is used to create a thin volume; the head and tail of each thin volume are filled with data of a preset length to obtain a thick provision volume.

The thick-provisioned volume creation method provided in this application first creates a thin volume, and uses a small amount of data to partially fill in the volume filling operation, and only fills the preset lengths of the head and tail, compared to the full filling solution in the related technology , Can quickly complete the creation and traversal of all objects, improve the efficiency of volume filling operations, and further improve the efficiency of creating thick-provisioned volumes. At the same time, multiple target threads are used to create multiple thick-provisioned volumes in parallel, which further improves the efficiency of thick-provisioned volume creation. The application also discloses a thick provisioned volume creation device, an electronic device and a computer-readable storage medium, which can also achieve the above technical effects.

It should be understood that the above general description and the following detailed description are only exemplary and cannot limit the application.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work. The accompanying drawings are used to provide a further understanding of the present disclosure and constitute a part of the specification. Together with the following specific embodiments, they are used to explain the present disclosure, but do not constitute a limitation to the present disclosure. In the attached picture:

Fig. 1 is a flow chart showing a method for creating a thick provisioned volume according to an exemplary embodiment;

Fig. 2 is a flowchart showing another method for creating a thick provisioned volume according to an exemplary embodiment;

Fig. 3 is a structural diagram showing a device for creating thick provisioned volumes according to an exemplary embodiment;

Fig. 4 is a structural diagram of an electronic device according to an exemplary embodiment.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.

The embodiment of the present application discloses a method for creating a thick-provisioned volume, which improves the efficiency of creating a thick-provisioned volume.

Referring to Fig. 1, a flow chart of a method for creating a thick provisioned volume according to an exemplary embodiment, as shown in Fig. 1, includes:

S101: When a creation command is received, the number of threads is determined based on the creation rate in the creation command; wherein, the number of threads is positively correlated with the creation rate;

This embodiment can be developed in C++ language, and the execution body can be the RBD (Chinese full name: Distributed Object Storage Block Device, English full name: Reliable Autonom ic Distributed Object Storage Block Device) layer of the distributed storage system, the purpose is to create a thick provisioned volume , The specific principle is to create a thin volume and perform a volume filling operation on it to obtain a thick provisioned volume.

In this step, when a thick-provisioned volume creation command is received, the number of threads used to create the thick-provisioned volume is determined. The user can set the creation rate in the creation command. To ensure the efficiency of thick-provisioned volume creation, the higher the creation rate, the more threads used to create the thick-provisioned volume.

As a preferred embodiment, this step may include: when a creation command is received, determining the level corresponding to the creation rate in the creation command, and determining the number of threads based on the level; The creation rate is positively correlated, and the number of threads is positively correlated to the level.

In a specific implementation, the creation rate can be divided into different levels, the higher the level, the higher the creation rate. When the user sets the creation rate, you can directly set the level, such as high, medium, low, etc., of course, you can also set the specific value of the creation rate. The RBD layer determines the level corresponding to the creation rate based on the correspondence between each level and the rate interval. . Each level corresponds to a different number of threads, the higher the level, the greater the number of threads. For example, a high level corresponds to 32 threads, a medium level corresponds to 16 threads, and a low level corresponds to 4 threads.

It can be seen that, in this embodiment, the configuration option of the creation rate is added, allowing the creation rate to be configured manually, matching the business process, achieving the purpose of increasing the creation rate of thick-provisioned volumes and artificially controlling the creation rate, thereby expanding the application scenarios of thick-provisioned volumes.

S102: Activate a target thread of the number of threads, and use the target thread to create a reduced volume;

In this step, according to the configuration requirements of the user's creation rate, activate a corresponding number of threads, that is, the target thread in this step, and use the target thread to create a reduced volume. In a specific implementation, a thread pool may be created in advance, that is, this embodiment further includes: creating a thread pool. The thread pool includes a fixed number of threads, and the threads are locked for protection, and conflicts occur when different threads are placed to operate the same piece of data.

S103: Fill the head and tail of each thin volume with data of a preset length to obtain a thick provisioned volume.

In the volume filling operation, the small data volume is partially filled with small data, and the target thread is used to fill only the data of the preset length of the head and tail of the thin volume, and the middle part except the head and tail is not filled with data. The efficiency of the volume filling operation can be improved. It should be noted that the preset length is not specifically limited here, and those skilled in the art can set it flexibly according to the actual situation. For example, one byte of data can be filled in the head and tail of each compact volume and updated The object mapping table information corresponding to the thick-provisioned volume, that is, preferably, after this step, it further includes: updating the object mapping table information of each thick-provisioned volume. After getting the thick provisioned volume, release all target threads.

In the method for creating a thick provisioned volume provided by the embodiment of the present application, a thin volume is first created, and when the volume filling operation is performed, a small amount of data is used for partial filling, and only the preset lengths of the head and tail are filled, which is compared with all filling in related technologies. The solution can quickly complete the creation and traversal of all objects, improve the efficiency of volume filling operations, and further improve the efficiency of creating thick-provisioned volumes. At the same time, multiple target threads are used to create multiple thick-provisioned volumes in parallel, which further improves the efficiency of thick-provisioned volume creation.

The embodiment of the present application discloses a method for creating a thick provisioned volume. Compared with the previous embodiment, this embodiment further explains and optimizes the technical solution. specific:

Referring to FIG. 2, a flowchart of another method for creating a thick provisioned volume according to an exemplary embodiment, as shown in FIG. 2, includes:

S201: When a creation command is received, determine the level corresponding to the creation rate in the creation command, and determine the number of threads based on the level; wherein the level is positively correlated with the creation rate, and the number of threads It is positively correlated with the said grade;

S202: Create a thread pool, and activate a target thread of the number of threads in the thread pool; wherein each thread in the thread pool is locked for protection;

S203: Fill one byte of data at the head and tail of each thin volume to obtain the thick provisioned volume;

S204: Update the object mapping table information of each thick-provisioned volume;

S205: Release all the target threads.

It can be seen that this embodiment adopts a method of constructing a thread pool and filling with a small amount of data to improve concurrent operations during filling of a thick-provisioned volume, so as to achieve the purpose of improving the rapid creation of a thick-provisioned volume. At the same time, in order to match more application scenarios without affecting the current business, the operation of artificially configuring the volume creation rate has been added, allowing users to independently determine the volume creation process, which can greatly expand the application scenarios of thick-provisioned volumes and cater to them. The current concept of fast storage and efficient storage.

The following describes an application embodiment of the present application, which may specifically include the following steps:

Step 1: The user issues an instruction to create a thick provisioned volume, and at the same time, configures reasonable creation rate parameters according to the current business scenario requirements. This solution provides users with three levels of creation rate options: high, medium, and low, corresponding to different levels. The number of write threads;

Step 2: The RBD layer receives the creation instruction, first creates the thin volume, and then writes and fills the thin volume. This operation includes the following processes:

a) The RBD layer creates a write thread pool, which contains 32 threads, and locks between threads to prevent conflicts when different threads operate on the same piece of data;

b) According to the user’s creation rate configuration requirements, activate the corresponding number of threads, where the high level corresponds to 32 threads, the medium level corresponds to 16 threads, and the low level corresponds to 4 threads;

c) Complete the creation of volume data objects in the thread, and fill in 1 byte of data at the beginning and end of each object, and update the objectmap information of the corresponding object accordingly;

d) After filling is completed, the activated thread is released to complete the filling process of the thick-provisioned volume.

Step 3: Complete the creation process of the thick provisioned volume and return.

The following describes a thick-provisioned volume creation device provided by an embodiment of the present application. The thick-provisioned volume creation device described below and the above-described thick-provision volume creation method can be cross-referenced.

Referring to FIG. 3, a structure diagram of a thick provisioned volume creation device according to an exemplary embodiment, as shown in FIG. 3, includes:

The determining module 301 is configured to determine the number of threads based on the creation rate in the creation command when a creation command is received; wherein the number of threads is positively correlated with the creation rate;

The first creation module 302 is configured to activate a target thread of the number of threads, and use the target thread to create a reduced volume;

The filling module 303 is used to fill the head and tail of each thin volume with data of a preset length to obtain a thick provision volume.

The thick-provisioned volume creation device provided by the embodiment of the present application first creates a thin volume, and uses a small amount of data to partially fill in the volume filling operation, and only fills the preset length of the head and tail, which is compared with the full filling in the related technology The solution can quickly complete the creation and traversal of all objects, improve the efficiency of volume filling operations, and further improve the efficiency of creating thick-provisioned volumes. At the same time, multiple target threads are used to create multiple thick-provisioned volumes in parallel, which further improves the efficiency of thick-provisioned volume creation.

On the basis of the foregoing embodiment, as a preferred implementation manner, it further includes:

The second creation module is used to create a thread pool; wherein each thread in the thread pool is locked and protected;

Correspondingly, the first creation module 302 is specifically a module that activates the target thread of the number of threads in the thread pool, and uses the target thread to create a reduced volume.

On the basis of the foregoing embodiment, as a preferred implementation manner, the determining module 301 specifically determines the level corresponding to the creation rate in the creation command when a creation command is received, and determines the level based on the level Module of the number of threads; wherein the level is positively correlated with the creation rate, and the number of threads is positively correlated with the level.

The update module is used to update the object mapping table information of each thick-provisioned volume.

The release module is used to release all the target threads.

Based on the foregoing embodiment, as a preferred implementation, the filling module 303 is specifically a module that fills one byte of data at the head and tail of each thin volume to obtain the thick provisioned volume.

Regarding the device in the foregoing embodiment, the specific manner in which each module performs operation has been described in detail in the embodiment of the method, and detailed description will not be given here.

The present application also provides an electronic device. Referring to FIG. 4, a structural diagram of an electronic device 400 provided by an embodiment of the present application, as shown in FIG. 4, may include a processor 11 and a memory 12. The electronic device 400 may further include one or more of a multimedia component 13, an input/output (I/O) interface 14, and a communication component 15.

The processor 11 is used to control the overall operation of the electronic device 400 to complete all or part of the steps in the above-mentioned thick provisioned volume creation method. The memory 12 is used to store various types of data to support operations on the electronic device 400. These data may include, for example, instructions for any application or method to operate on the electronic device 400, as well as application-related data. For example, contact data, messages sent and received, pictures, audio, video, etc. The memory 12 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, SRAM for short), electrically erasable programmable read-only memory ( Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-only Memory (Read-Only Memory, ROM for short), magnetic memory, flash memory, magnetic disk or optical disk. The multimedia component 13 may include a screen and an audio component. The screen may be a touch screen, for example, and the audio component is used to output and/or input audio signals. For example, the audio component may include a microphone, which is used to receive external audio signals. The received audio signal may be further stored in the memory 12 or sent through the communication component 15. The audio component also includes at least one speaker for outputting audio signals. The I/O interface 14 provides an interface between the processor 11 and other interface modules. The above-mentioned other interface modules may be a keyboard, a mouse, a button, and the like. These buttons can be virtual buttons or physical buttons. The communication component 15 is used for wired or wireless communication between the electronic device 400 and other devices. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G, or 4G, or a combination of one or more of them, so the corresponding communication component 15 may include: Wi-Fi module, Bluetooth module, NFC module.

In an exemplary embodiment, the electronic device 400 may be used by one or more application specific integrated circuits (Application Specific Integrated Circuit, ASIC for short), digital signal processor (Digital Signal Processor, DSP for short), and digital signal processing equipment (Digital Signal Processor). Signal Processing Device, DSPD for short), Programmable Logic Device (PLD for short), Field Programmable Gate Array (FPGA for short), controller, microcontroller, microprocessor or other electronic components Implementation, used to implement the above-mentioned thick provisioned volume creation method.

In another exemplary embodiment, there is also provided a computer-readable storage medium including program instructions that, when executed by a processor, implement the steps of the thick-provisioned volume creation method described above. For example, the computer-readable storage medium may be the aforementioned memory 12 including program instructions, which can be executed by the processor 11 of the electronic device 400 to complete the aforementioned thick-provisioned volume creation method.

The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method part. It should be pointed out that for those of ordinary skill in the art, without departing from the principles of this application, several improvements and modifications can be made to this application, and these improvements and modifications also fall within the protection scope of the claims of this application.

It should also be noted that in this specification, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities or operations. There is any such actual relationship or sequence between operations. Moreover, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes those that are not explicitly listed Other elements of, or also include elements inherent to this process, method, article or equipment. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or equipment that includes the element.

Claims

A method for creating a thick provisioned volume, which is characterized in that it includes:

When a creation command is received, the number of threads is determined based on the creation rate in the creation command; wherein, the number of threads is positively correlated with the creation rate;

Activate the target thread of the number of threads, and use the target thread to create a reduced volume;

Filling the head and tail of each thin volume with data of a preset length to obtain a thick provision volume.
The method for creating a thick provisioned volume according to claim 1, further comprising:

Create a thread pool; wherein each thread in the thread pool is locked for protection;

Correspondingly, the activation of the target thread of the number of threads includes:

Activate the target thread of the thread number in the thread pool.
The method for creating a thick provisioned volume according to claim 1, wherein the determining the number of threads based on the creation rate in the creation command comprises:

The level corresponding to the creation rate in the creation command is determined, and the number of threads is determined based on the level; wherein the level is positively correlated with the creation rate, and the number of threads is positively correlated with the level.
The method for creating a thick provisioned volume according to claim 1, wherein after filling the head and tail of each thin volume with data of a preset length to obtain the thick provisioned volume, the method further comprises:

Update the object mapping table information of each thick-provisioned volume.
The method for creating a thick provisioned volume according to claim 1, wherein after filling the head and tail of each thin volume with data of a preset length to obtain the thick provisioned volume, the method further comprises:

Release all the target threads.
The method for creating a thick-provisioned volume according to any one of claims 1 to 5, wherein said filling the head and tail of each said thin volume with data of a preset length to obtain the thick-provisioned volume comprises:

Fill one byte of data at the head and tail of each thin volume to obtain the thick provisioned volume.
A thick-provisioned volume creation device is characterized in that it comprises:

The determining module is configured to determine the number of threads based on the creation rate in the creation command when a creation command is received; wherein the number of threads is positively correlated with the creation rate;

The first creation module is used for activating the target thread of the number of threads, and using the target thread to create a reduced volume;

The filling module is used to fill the head and tail of each thin volume with data of a preset length to obtain a thick provision volume.
8. The thick-provisioned volume creation device according to claim 7, wherein the filling module is specifically a module that fills one byte of data at the head and tail of each thin volume to obtain the thick-provisioned volume.
An electronic device, characterized in that it comprises:

Memory, used to store computer programs;

The processor is configured to implement the steps of the thick-provisioned volume creation method according to any one of claims 1 to 6 when the computer program is executed.
A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the creation of the thick provisioned volume according to any one of claims 1 to 6 is realized Method steps.