CN115525225A - Disk control method, information processing method, disk access determination method and electronic equipment - Google Patents

Disk control method, information processing method, disk access determination method and electronic equipment Download PDF

Info

Publication number
CN115525225A
CN115525225A CN202211176524.7A CN202211176524A CN115525225A CN 115525225 A CN115525225 A CN 115525225A CN 202211176524 A CN202211176524 A CN 202211176524A CN 115525225 A CN115525225 A CN 115525225A
Authority
CN
China
Prior art keywords
disk group
disk
power
information
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211176524.7A
Other languages
Chinese (zh)
Inventor
董元元
吴锦波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN202211176524.7A priority Critical patent/CN115525225A/en
Publication of CN115525225A publication Critical patent/CN115525225A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0673Single storage device
    • G06F3/0674Disk device
    • G06F3/0676Magnetic disk device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The application provides a method for determining disk control, information processing and disk access, electronic equipment and a storage medium, and relates to the technical field of data storage. The disk control method is applied to disk management equipment and comprises the following steps: determining a target disk group which needs to execute a power-on operation based on disk group information to be accessed, which is sent by a metadata management server; the disk group information to be accessed is used for representing a disk group which needs to be accessed by a storage client, and the disk group which needs to be accessed by the storage client comprises disks in a plurality of data storage servers for storing data; and sending a disk power-on control command to the data storage server corresponding to the target disk group to instruct the data storage server to perform power-on operation on the disks in the target disk group. According to the scheme, the resource consumed by the multiplexing distributed storage system for storing the cold data can be reduced, and therefore the storage cost of the multiplexing distributed storage system for storing the cold data can be reduced.

Description

Disk control method, information processing method, disk access determination method and electronic equipment
Technical Field
The present application relates to the field of data storage technologies, and in particular, to a disk control method, an electronic device, and a storage medium, an information processing method, an electronic device, and a storage medium, a disk access determination method, an electronic device, and a storage medium, and a data storage system.
Background
In practical applications, data may be divided into hot data, warm data, and cold data according to the frequency of access. Wherein cold data is accessed least frequently, even for portions of cold data that are not accessed during their lifetime. Since cold data is accessed less frequently. Therefore, cold data needs to be stored at extremely low cost.
To reduce the storage cost of cold data, those skilled in the art have developed various cold archival storage systems for storing cold data. However, an existing cold archive storage system is often a storage system developed independently from a storage system used for standard storage, for example, a cold archive storage system shown in fig. 1, and has a system architecture that is greatly different from that of the storage system used for standard storage.
And a storage system adopted by the standard storage is independent of another cold filing storage system for storing cold data, so that not only is higher development cost achieved, but also the maintenance cost of the developed cold filing storage system is invisibly increased, and the storage cost of the cold data is greatly improved.
Disclosure of Invention
The embodiment of the application provides a disk control method, electronic equipment and a storage medium, an information processing method, electronic equipment and a storage medium, a disk access determination method, electronic equipment and a storage medium, and a data storage system, so as to reduce the storage cost of cold data.
In a first aspect, a disk control method is applied to a disk management device, and the method includes:
determining a target disk group which needs to execute power-on operation based on disk group information to be accessed, which is sent by a metadata management server; the disk group information to be accessed is used for representing a disk group which needs to be accessed by a storage client, and the disk group which needs to be accessed by the storage client comprises disks in a plurality of data storage servers for storing data;
and sending a disk power-on control command to the data storage server corresponding to the target disk group to instruct the data storage server to execute power-on operation on the disks in the target disk group.
In a second aspect, an embodiment of the present application provides an information processing method, which is applied to a metadata management server, and the method includes:
determining a disk group to be accessed by a storage client based on disk group position determination request information sent by the storage client; the disk group which the storage client needs to access comprises disks in a plurality of data storage servers for storing data;
generating disk group information to be accessed based on the disk group to be accessed by the storage client;
sending the disk group information to be accessed to disk management equipment so that the disk management equipment can determine a target disk group which needs to execute a power-on operation;
and receiving disk group power-up information fed back by the disk management device for the disk group information to be accessed, wherein the disk group power-up information is used for indicating that the target disk group has been successfully powered up.
In a third aspect, an embodiment of the present application provides a method for determining disk access, which is applied to a metadata management server, and the method includes:
sending disk group position determination request information to a metadata management server so that the metadata management server can determine a disk group to be accessed by the storage client; the disk group which the storage client needs to access comprises disks in a plurality of data storage servers for storing data;
determining whether to access the disk group or not based on the received disk group power-on information; the disk group power-on information is used to indicate that a target disk group which needs to execute power-on operation has been successfully powered on, the target disk group is obtained by the disk management device by using the disk group information to be accessed which is sent by the metadata management server, and the disk group information to be accessed is used to indicate the disk group which the storage client needs to access.
In a fourth aspect, an embodiment of the present application provides a data storage system, including: the system comprises a storage client, a metadata management server, a plurality of data storage servers for storing data and a magnetic disk management device;
the metadata management server is used for determining a disk group which needs to be accessed by the storage client, and the disk group which needs to be accessed by the storage client comprises a plurality of disks in the data storage server; generating disk group information to be accessed based on the disk group to be accessed by the storage client; sending the information of the disk group to be accessed to the disk management equipment;
the disk management device is used for determining a target disk group which needs to execute a power-on operation based on the disk group information to be accessed; sending a disk electrifying control command to the data storage server corresponding to the target disk group;
and the data storage server is used for executing power-on operation on the disks in the target disk group based on the disk power-on control command.
In a fifth aspect, an embodiment of the present application provides an electronic device, which includes a memory, a processor, and a computer program stored on the memory, where the processor implements the method provided in any embodiment of the present application when executing the computer program.
In a sixth aspect, the present application provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements the method provided in any embodiment of the present application.
Compared with the prior art, the method has the following advantages:
the application provides a disk control method, which is applied to disk management equipment and can determine a target disk group needing to be subjected to power-on operation based on a disk group needing to be accessed by a storage client, and after the target disk group needing to be subjected to the power-on operation is determined, a disk power-on control command can be sent to a data storage server corresponding to the target disk group so as to instruct the data storage server to carry out the power-on operation on disks in the target disk group.
According to the disk control method, the target disk group which needs to be powered on is determined through the disk management device, the data storage server is instructed to power on the disks in the target disk group, and the disks in the disk group can be selectively powered on and controlled when the data are stored in the multiplexing distributed storage system. By selectively powering on the disks in the disk group, resources consumed when the data are stored by the multiplexing distributed storage system can be reduced, so that the cold data can be stored by the multiplexing distributed storage system, and the storage cost of the cold data is reduced.
And the cold data is stored by multiplexing the distributed storage system, and the development of another set of cold filing storage system for storing the cold data independently of the storage system adopted by the standard storage can be avoided, so that the development cost of the cold filing storage system can be reduced. Because the development of another set of cold filing storage system for storing cold data is not needed to be independent of a storage system adopted by standard storage, the maintenance cost required in the cold data storage process can be greatly reduced. The reduction of development cost and the reduction of maintenance cost can further ensure that cold data can be stored with lower storage cost.
In addition, the application also provides an information processing method, which is applied to a metadata management server and can generate disk group information to be accessed based on the disk groups to be accessed by the storage client, and send the disk group information to be accessed to the disk management equipment so that the disk management equipment can determine the target disk group to be powered on.
According to the information processing method provided by the application, the disk group information to be accessed, which is generated based on the disk group to be accessed by the storage client, is sent to the disk management device, so that the disk management device can determine the target disk group to be powered on. The target disk group which needs to execute the power-on operation is determined by the disk management device, and the power-on control can be selectively carried out on the disks in the disk group when the distributed storage system is multiplexed to store data. By selectively powering on the disks in the disk group, resources consumed when the data are stored by the multiplexing distributed storage system can be reduced, so that the cold data can be stored by the multiplexing distributed storage system, and the storage cost of the cold data is reduced.
And the cold data is stored by multiplexing the distributed storage system, and the development of another set of cold filing storage system for storing the cold data independent of the storage system adopted by the standard storage can be avoided, so that the development cost of the cold filing storage system can be reduced. Because the development of another set of cold filing storage system for storing cold data is not needed to be independent of a storage system adopted by standard storage, the maintenance cost required in the cold data storage process can be greatly reduced. The reduction of development cost and the reduction of maintenance cost can further ensure that cold data can be stored with lower storage cost.
In addition, the application also provides a disk access determining method, which is applied to a storage client and can determine whether to perform disk group access or not based on the received disk group power-on information indicating that the target disk group has been successfully powered on.
According to the disk access determining method provided by the application, since the disk group power-on information is used for indicating that the target disk group has been successfully powered on, the target disk group is obtained by the disk management device by using the disk group to be accessed by the storage client. The target disk group which needs to execute the power-on operation is determined by the disk management device, and the power-on control can be selectively carried out on the disks in the disk group when the distributed storage system is multiplexed to store data. By selectively powering on the disks in the disk group, resources consumed when the distributed storage system is multiplexed to store data can be reduced, so that the distributed storage system can be multiplexed to store cold data, and the storage cost is reduced.
And the cold data is stored by multiplexing the distributed storage system, and the development of another set of cold filing storage system for storing the cold data independently of the storage system adopted by the standard storage can be avoided, so that the development cost of the cold filing storage system can be reduced. Because the development of another set of cold filing storage system for storing cold data is not needed to be independent of a storage system adopted by standard storage, the maintenance cost required in the cold data storage process can be greatly reduced. The reduction of development cost and the reduction of maintenance cost can further ensure that cold data can be stored with lower storage cost.
In addition, the present application also provides a data storage system, including: the system comprises a storage client, a metadata management server, a plurality of data storage servers for storing cold data and a disk management device. The data storage system can multiplex the distributed storage system and can selectively perform power-on control on the magnetic disks in the magnetic disk group when storing data. By selectively powering on the disks in the disk group, resources consumed during data storage can be reduced, and therefore, a distributed storage system can be reused to store cold data, and storage cost is reduced.
The development cost of the data storage system can be reduced by the multiplexing distributed storage system, so that another set of cold filing storage system for storing cold data does not need to be developed independently of the storage system adopted by standard storage, and the development cost of the cold filing storage system can be reduced. And compared with a storage system independent of a standard storage adopted to develop another set of cold filing storage system for storing cold data, the maintenance cost required by the data storage system can be reduced by reusing the distributed storage system to store the cold data. The reduction of development cost and the reduction of maintenance cost can further ensure that the data storage system can store cold data with lower storage cost.
The foregoing summary is provided for the purpose of description only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features of the present application will be readily apparent by reference to the drawings and following detailed description.
Drawings
In the drawings, like reference characters designate like or similar parts or elements throughout the several views unless otherwise specified. The figures are not necessarily to scale. It is appreciated that these drawings depict only some embodiments in accordance with the disclosure and are therefore not to be considered limiting of its scope.
FIG. 1 is a schematic diagram of a conventional system architecture of a cold archive storage system;
FIG. 2 is a schematic view of a scenario of a disk control method according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating a disk control method according to an embodiment of the present application;
FIG. 4 is a flowchart of a processing method of information processing according to another embodiment of the present application;
FIG. 5 is a flowchart of a method for determining disk access according to another embodiment of the present application;
FIG. 6 is a block diagram of a disk control apparatus according to another embodiment of the present application;
fig. 7 is a block diagram of an information processing apparatus according to another embodiment of the present application;
fig. 8 is a block diagram of a disk access determination apparatus according to another embodiment of the present application;
FIG. 9 is a block diagram of an electronic device used to implement embodiments of the present application.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many other forms than those described herein, and it will be appreciated by those skilled in the art that a similar generalization may be made without departing from the spirit or scope of the application and, accordingly, the application is not limited to the specific implementations disclosed below.
In order to more clearly show the disk control method provided in the embodiment of the present application, an application scenario of the disk control method provided in the embodiment of the present application is first introduced. The disk control method provided in the embodiment of the present application can be applied to a data storage system for storing cold data, for example: the data storage system is applied to a data storage system for performing data storage on enterprise backup data, and at this time, the data targeted by the data storage system is the enterprise backup data. An application scenario of the disk control method provided in the embodiment of the present application is described below with reference to fig. 2, and fig. 2 is a scenario schematic diagram of the disk control method in the embodiment of the present application.
As shown in fig. 2, a data storage system for data storage of enterprise backup data includes: a storage client 201, a metadata management server 202, a plurality of data storage servers 203 for storing enterprise backup data, and a disk management device 204. In the process of writing the enterprise backup data into the data storage server 203 or in the process of reading the enterprise backup data written into the data storage server 203, the storage client 201 needs to send the disk group position determination request information for determining the disk group position to the metadata management server 202. For example: in the process of writing the enterprise backup data into the data storage server 203, the storage client 201 sends storage location determination request information for requesting to determine storage locations for the specified data block and the at least one data block copy, to the metadata management server 202, for a specified data block and the at least one data block copy corresponding to the specified data block, where the enterprise backup data currently needs to be written into the data storage server 203. And the following steps: in the process of reading the target enterprise backup data written into the data storage server 203, the storage client 201 sends location obtaining request information for requesting to determine a storage location of a data block corresponding to the target enterprise backup data to the metadata management server 202.
It should be noted that the disk group position determination request information in the embodiment of the present application includes, but is not limited to: the storage location determination request information is used for requesting to determine the storage location of the specified data block and at least one data block copy, and the location acquisition request information is used for requesting to determine the storage location of the data block corresponding to the target enterprise backup data.
After receiving the disk group position determination request information sent by the storage client 201, the metadata management server 202 determines a disk group to be accessed by the storage client based on the disk group position determination request information. When the disk group that the storage client needs to access is in the unpowered state, the metadata management server 202 generates information of the disk group to be accessed based on the disk group that the storage client needs to access, and sends the information of the disk group to be accessed to the disk management device 204.
It should be noted that the disk group in the embodiment of the present application is composed of a plurality of disks in the data storage server 203. That is, the disk group includes disks in a plurality of data storage servers 203 for storing enterprise backup data. Generally, disk groups are pre-partitioned based on a specified disk group partitioning strategy. The disk group division rule includes, but is not limited to, dividing disks in the same position in each data storage server 203 into one disk group for a plurality of data storage servers 203.
The disk group in fig. 2 is obtained by a disk group division strategy division of "for a plurality of data storage servers 203, dividing the disks in the same position in each data storage server 203 into a disk group". In fig. 2, the number of the plurality of data storage servers 203 is m, each data storage server 203 has n disks, and by using a disk group division strategy of "for the plurality of data storage servers 203, dividing the disks at the same position in each data storage server 203 into one disk group", the disk group at the first position in the 1-m data storage servers 203 is divided into a disk group 1, the disk at the second position in the 1-m data storage servers 203 is divided into a disk group 2, and the disk at the nth position in the 1-m data storage servers 203 is divided into a disk group n. Wherein m and n are positive integers, and both m and n are at least greater than or equal to 2.
In the embodiment of the present application, a disk group division policy other than the disk group division policy "for a plurality of data storage servers 203, the disks in the same position in each data storage server 203 are divided into one disk group" may also be adopted to divide the disk group, but it is required to ensure that the disk group includes the disks in the plurality of data storage servers 203 for storing enterprise backup data.
After receiving the information of the disk group to be accessed, the disk management device 204 will sequentially perform the following operations:
first, a target disk group to be powered on is determined based on the disk group information to be accessed sent by the metadata management server 202.
Specifically, the data storage system tends to serve a plurality of storage clients 201, and even for a single storage client 201, the single storage client 201 may send a plurality of disk group location determination request information to the metadata management server 202. The metadata management server 202 may allocate the same disk group to different disk group position determination request information, or may allocate different disk groups to different disk group position determination request information.
Therefore, the metadata management server 202 determines, based on the disk group information to be accessed sent by the metadata management server 202, often more than one disk group that the storage client needs to access. At this time, the disk management device 204 determines at least one disk group to be accessed by the storage client 201 based on the disk group information to be accessed sent by the metadata management server 202 in a specified time period, and then selects a target disk group from the at least one disk group according to the disk group access amount obtained by counting the disk group information to be accessed.
Then, a disk power-on control command is sent to the data storage server 203 corresponding to the target disk group to instruct the data storage server 203 to perform a power-on operation on the disks in the target disk group.
Specifically, after the disk management device 204 determines a target disk group that needs to perform a power-on operation, a disk power-on control command for instructing the data storage server 203 to perform the power-on operation on the disks in the target disk group is generated for the target disk group, and is respectively sent to the multiple data storage servers 203 corresponding to the target disk group.
After receiving the disk powering-on control command sent by the disk management device 204, the data storage server 203 performs a powering-on operation on the disks in the target disk group, and feeds back, to the disk management device 204, disk powering-on state information used for indicating whether the disks in the target disk group are successfully powered on. If the successful power-up ratio of the disks in the target disk group reaches the preset ratio, the disk management device 204 determines that the power-up of the target disk group is successful. The disk management device 204 sends disk group power-on information to the metadata management server 202 and the storage client 201 to notify the metadata management server 202 and the storage client 201 that the target disk group has been successfully powered on. Thereby enabling the metadata management server 202 to allocate storage disks for the specified data blocks based on the target disk group that has been successfully powered on, and enabling the storage client 201 to determine whether to perform disk group access based on the target disk group.
When the target disk group is in the power-on state, the disk management device 204 determines whether the power-on duration of the target disk group reaches the specified power-on duration, and sends a disk power-off control command to the data storage server 203 corresponding to the target disk group to instruct the data storage server 203 to perform power-off operation on the disks in the target disk group when the power-on duration of the target disk group reaches the specified power-on duration.
The data storage server 203, upon receiving the disk power-down control command sent by the disk management device 204, will perform power-down operation on the disks in the target disk group, and will feed back, to the disk management device 204, disk power-down state information used for indicating whether the disks in the target disk group are successfully powered down. And if the successful powering-down proportion of the disks in the target disk group reaches the preset proportion. The disk management device 204 determines that the power down of the target disk group is successful. The disk management device 204 sends disk group power-down information to the metadata management server 202 and the storage client 201 to notify the metadata management server 202 and the storage client 201 that the target disk group has been successfully powered down.
According to the disk control method, the target disk group which needs to be powered on is determined through the disk management device, the data storage server is instructed to power on the disks in the target disk group, and the disks in the disk group can be selectively powered on and controlled when the enterprise backup data is stored by the multiplexing distributed storage system. By selectively electrifying and controlling the disks in the disk group, the resources consumed when the multiplexing distributed storage system stores the enterprise backup data can be reduced, and the storage cost of the multiplexing distributed storage system for storing the enterprise backup data can be reduced.
And the enterprise backup data is stored by multiplexing the distributed storage system, and the development of another set of cold filing storage system for storing the enterprise backup data independently of the storage system adopted by the standard storage can be avoided, so that the development cost of the cold filing storage system can be reduced. Because another set of cold filing storage system used for storing enterprise backup data is not required to be developed independently of a storage system adopted by standard storage, the maintenance cost required in the enterprise backup data storage process can be greatly reduced. The reduction of development cost and the reduction of maintenance cost can further ensure that enterprise backup data can be stored at lower storage cost.
It should be noted that the above application scenario of the disk control method provided in the embodiment of the present application is for facilitating understanding of the disk control method provided in the embodiment of the present application, and is not used to limit the disk control method provided in the embodiment of the present application. The disk control method provided in the embodiment of the present application may be applied to a data storage system for storing other data, for example: the method is applied to a data storage system for storing the archival data, and the cold data in the data storage system is the archival data. Specifically, an application scenario of the disk control method provided in the embodiment of the present application is not specifically limited.
The embodiment of the application provides a disk control method, which is applied to disk management equipment, wherein the disk management equipment is one computing equipment in a data storage system of a multiplexing distributed storage system. The data storage system of the multiplexing distributed storage system further comprises: the system comprises a storage client, a metadata management server and a plurality of data storage servers for storing data. Fig. 3 is a flowchart of a disk control method according to an embodiment of the present application. As shown in fig. 3, the method includes:
step S301, determining a target disk group which needs to execute a power-on operation based on disk group information to be accessed, which is sent by a metadata management server; the disk group information to be accessed is used for representing the disk group which the storage client needs to access, and the disk group which the storage client needs to access comprises disks in a plurality of data storage servers for storing data.
In the embodiment of the present application, the storage objects of the disks in the multiple data storage servers include, but are not limited to, cold data, but generally store the cold data. The cold data includes, but is not limited to, enterprise backup data, archive data, medical image data, scientific data, and video material data. The so-called disk group position determination request information includes, but is not limited to: the storage location determination request information is used for requesting to determine the storage location for the specified data block and at least one data block copy, and the location acquisition request information is used for requesting to determine the storage location of the data block corresponding to the target data. A data block copy is a data copy of a given data block.
By the disk group including disks of a plurality of data storage servers for storing data, it is meant that the disk group is made up of disks of the plurality of data storage servers. Specifically, the disk groups are pre-partitioned based on a specified disk group partitioning strategy. The disk group division rule includes, but is not limited to, dividing, for a plurality of data storage servers, disks in the same location in each data storage server into a disk group.
In the embodiment of the present application, a disk group division policy other than the disk group division policy that "for multiple data storage servers, disks at the same position in each data storage server are divided into one disk group" may also be used to divide a disk group, but it is necessary to ensure that a disk group includes disks in multiple data storage servers for storing data.
In a possible implementation manner, the specific implementation manner of determining the target disk group that needs to execute the power-on operation based on the disk group information to be accessed sent by the metadata management server may be:
firstly, determining at least one disk group which needs to be accessed by a storage client based on disk group information to be accessed and sent by a metadata management server in a specified time period. And then, in at least one disk group, selecting a target disk group according to the disk group access amount obtained by the statistics of the disk group information to be accessed.
Specifically, the number of storage clients tends to be plural, and even for a single storage client, a single storage client may send a plurality of disk group position determination request information to the metadata management server within a specified period of time. In the metadata management server, the same disk group may be allocated to different disk group position determination request information or different disk groups may be allocated to different disk group position determination request information within a specified time period.
Therefore, in a specified time period, the metadata management server sends information about the disk groups to be accessed, which is often more than one, and the storage client needs to access the disk groups, which is often more than one. In order to save storage cost, the disk management device determines at least one disk group to be accessed by the storage client based on the disk group information to be accessed sent by the metadata management server within a specified time period, and then selects a target disk group in the at least one disk group according to the disk group access amount obtained by statistics of the disk group information to be accessed.
In practical application, the implementation manner of selecting a target disk group from at least one disk group according to the disk group access amount obtained by statistics of the disk group information to be accessed may be: and determining the disk group of which the disk group access amount reaches the preset access amount threshold value in at least one disk group as a target disk group.
Step S302, sending a disk power-on control command to the data storage server corresponding to the target disk group to instruct the data storage server to perform a power-on operation on the disks in the target disk group.
The disk power-on control command is a control command generated for the target disk group to instruct the data storage server to perform a power-on operation on the disks in the target disk group.
Specifically, after the disk management device determines a target disk group that needs to perform a power-on operation, a disk power-on control command is generated for the target disk group and is sent to the data storage servers corresponding to the target disk group respectively.
According to the disk control method provided by the embodiment of the application, the target disk group which needs to execute the power-on operation is determined through the disk management device, the data storage server is instructed to execute the power-on operation on the disks in the target disk group, and the power-on control can be selectively performed on the disks in the disk group when the distributed storage system is multiplexed to store data. By selectively powering on the disks in the disk group, resources consumed when the data are stored by the multiplexing distributed storage system can be reduced, so that the cold data can be stored by the multiplexing distributed storage system, and the storage cost of the cold data is reduced.
And the cold data is stored by multiplexing the distributed storage system, and the development of another set of cold filing storage system for storing the cold data independent of the storage system adopted by the standard storage can be avoided, so that the development cost of the cold filing storage system can be reduced. Because the development of another set of cold filing storage system for storing cold data is not needed to be independent of a storage system adopted by standard storage, the maintenance cost required in the cold data storage process can be greatly reduced. The reduction of development cost and the reduction of maintenance cost can further ensure that cold data can be stored with lower storage cost.
In a possible implementation manner, after sending a disk power-on control command to a data storage server corresponding to a target disk group, the disk control method provided in the embodiment of the present application may further determine that the target disk group is successfully powered on, and the specific implementation manner is as follows:
firstly, receiving disk power-on state information fed back by a data storage server according to a disk power-on control command, wherein the disk power-on state information is used for indicating whether the power-on of the disks in the target disk group is successful. And then, determining whether the power-up of the disks in the target disk group is successful based on the disk power-up state information. And finally, determining that the target disk group is successfully electrified according to whether the disks in the target disk group are successfully electrified.
Specifically, according to whether the power-up of the disks in the target disk group is successful, the specific implementation manner for determining that the power-up of the target disk group is successful may be: and determining whether the successful electrifying proportion of the disks in the target disk group reaches a preset proportion, and if so, determining that the target disk group is successfully electrified.
In addition, under the condition that the target disk group is successfully powered on, the disk management device also sends disk group power-on information to the metadata management server and the storage client so as to inform the metadata management server and the storage client that the target disk group is successfully powered on. This can facilitate the metadata management server being able to allocate storage disks for specified data blocks based on the target disk group that has been successfully powered up, and enable the storage client to determine whether to perform a disk group access based on the target disk group.
In a possible implementation manner, after sending a disk power-on control command to a data storage server corresponding to a target disk group, the disk control method provided in the embodiment of the present application needs to further perform the following steps:
firstly, under the condition that the target disk group is in a power-on state, whether the power-on time length of the target disk group reaches a specified power-on time length is determined. And secondly, sending a disk power-off control command to a data storage server corresponding to the target disk group to instruct the data storage server to execute power-off operation on the disks in the target disk group when the power-on time of the target disk group reaches the specified power-on time. And thirdly, receiving the disk power-off state information fed back by the data storage server according to the disk power-off control command, wherein the disk power-off state information is used for indicating whether the power-off of the disks in the target disk group is successful. Finally, determining whether the power down of the disks in the target disk group is successful based on the power down state information of the disks; and determining that the power-down of the target disk group is successful according to whether the power-down of the disks in the target disk group is successful.
Specifically, the manner of determining whether the power-on duration of the target disk group reaches the specified power-on duration may be: and determining whether the electrifying time of the target disk group exceeds a preset electrifying period of the target disk group, and if so, determining that the electrifying time of the target disk group reaches the specified electrifying time. The specified power-on time is generally obtained by using the disk group access amount, and in general, the larger the disk group access amount is, the longer the specified power-on time is.
According to whether the power down of the disks in the target disk group is successful, the successful power down of the target disk group is determined by the following implementation manner: and determining whether the successful power-down proportion of the disks in the target disk group reaches a preset proportion, and if so, determining that the power-down of the target disk group is successful.
In addition, in the case that the power down of the target disk group is successful, the disk management device sends disk group power down information to the metadata management server and the storage client to notify the metadata management server and the storage client that the power down of the target disk group is successful. This can be convenient for metadata management server and storage client to know the outage condition of disk group in real time.
Corresponding to the application scenario and the disk control method provided by the embodiment of the application, the embodiment of the application further provides an information processing method. The application scenario and the disk control method provided by the embodiment of the present application are different in that: except that the information processing method provided by the embodiment of the present application is applied to a metadata management server, the information processing method provided by the embodiment of the present application is basically similar to the application scenario and the disk control method provided by the embodiment of the present application. Therefore, the description of the embodiment of the information processing method provided by the embodiment of the present application is simpler, and the details of the similarity between the information processing method provided by the embodiment of the present application and the application scenario and the disk control method provided by the embodiment of the present application are not described in detail.
Fig. 4 shows an implementation process of another communication information processing method provided in an embodiment of the present application, where fig. 4 is a flowchart of an information processing method according to another embodiment of the present application. As shown in fig. 4, the method includes:
step S401, determining a disk group to be accessed by a storage client based on disk group position determination request information sent by the storage client; the set of disks that the storage client needs to access includes disks in a plurality of data storage servers for storing data.
In the embodiment of the present application, the storage objects of the disks in the plurality of data storage servers include, but are not limited to, cold data, but generally store the cold data. The cold data includes, but is not limited to, enterprise backup data, archive data, medical image data, scientific data, and video material data. The so-called disk group position determination request information includes, but is not limited to: the data storage device comprises storage location determination request information used for requesting to determine storage locations for the specified data blocks and at least one data block copy, and location acquisition request information used for requesting to determine the storage locations of the data blocks corresponding to the target cold data. A data block copy is a data copy of a given data block.
By a disk pack comprising disks of a plurality of data storage servers for storing cold data, it is meant that the disk pack is made up of disks of the plurality of data storage servers.
Step S402, generating disk group information to be accessed based on the disk group to be accessed by the storage client.
The disk group information to be accessed is used for representing the disk group that the storage client needs to access.
In particular, the number of storage clients tends to be plural, and even for a single storage client, the single storage client may send a plurality of disk group position determination request information to the metadata management server. In the case of the metadata management server, it may allocate the same disk group for different disk group position determination request information, or may allocate different disk groups for different disk group position determination request information.
Step S403, sending the disk group information to be accessed to the disk management device, so that the disk management device determines a target disk group that needs to execute a power-on operation.
In a possible implementation manner, a specific implementation manner of sending the information of the disk group to be accessed to the disk management device is as follows: and selecting the disk group information to be accessed in the specified time period and sending the disk group information to the disk management equipment.
Step S404, receiving disk group powering-up information fed back by the disk management device for the disk group information to be accessed, where the disk group powering-up information is used to indicate that the target disk group has been successfully powered up.
The disk group power-up information may be used to indicate that the power-up of the target disk group is successful, and may also be used to indicate that the power-up of the target disk group is successful and that the power-up of the target disk group is failed.
According to the information processing method provided by the embodiment of the application, the disk group information to be accessed generated based on the disk group to be accessed by the storage client is sent to the disk management device, so that the disk management device can determine the target disk group to be powered on. The target disk group which needs to execute the power-on operation is determined by the disk management device, and the power-on control can be selectively carried out on the disks in the disk group when the distributed storage system is multiplexed to store data. By selectively powering on the disks in the disk group, resources consumed when the data are stored by the multiplexing distributed storage system can be reduced, so that the cold data can be stored by the multiplexing distributed storage system, and the storage cost of the cold data is reduced.
And the cold data is stored by multiplexing the distributed storage system, and the development of another set of cold filing storage system for storing the cold data independent of the storage system adopted by the standard storage can be avoided, so that the development cost of the cold filing storage system can be reduced. Because the development of another set of cold filing storage system for storing cold data is not needed to be independent of a storage system adopted by standard storage, the maintenance cost required in the cold data storage process can be greatly reduced. The reduction of development cost and the reduction of maintenance cost can further ensure that cold data can be stored with lower storage cost.
In a possible implementation manner, after receiving disk group power-on information fed back by the disk management device for the disk group information to be accessed, the information processing method provided in the embodiment of the present application needs to further send the disk group power-on information to the storage client, so that the storage client determines whether to perform disk group access based on the target disk group.
In a possible implementation manner, in the information processing method provided in the embodiment of the present application, after receiving disk group power-on information fed back by the disk management device for the disk group information to be accessed, a disk needs to be allocated for a specified data block and at least one data block copy. In the information processing method provided by the embodiment of the application, the disk group is taken as a power-on and power-off unit, and in order to ensure that the storage client can simultaneously read the specified data block and the at least one data block copy, the specified data block and the at least one data block copy need to be stored in the same disk group, and in order to ensure the data security, the specified data block and the at least one data block copy need to be stored in different disks in the same disk group.
Therefore, in practical applications, the following approaches are often taken to allocate disks for the specified data blocks and at least one copy of the data blocks: first, in the disk group position determination request information, storage position determination request information for requesting determination of a storage position for a specified data block and at least one data block copy corresponding to the specified data block is acquired. Then, in the target disk group, the storage location determination request information is referred to, and a specified disk group for storing the specified data block and at least one data block copy is acquired. Finally, in the designated disk group, different disks are allocated for the designated data block and the at least one copy of the data block.
In a possible implementation manner, in the information processing method provided in this embodiment of the present application, after receiving disk group powering-up information that is fed back by a disk management device for disk group information to be accessed, disk group powering-down information that is fed back by the disk management device for a target disk group needs to be further received, where the disk group powering-down information is used to indicate that the target disk group has been successfully powered down. And after receiving the disk group powering-down information, further sending the disk group powering-down information to a storage client, so that the storage client can determine whether to access the disk group based on the target disk group.
It should be noted that, after receiving the disk group power-on information, it is necessary to indicate the target disk group as the target disk group being powered on in a disk group power-on and power-off state list configured in advance for managing the power-on and power-off states of the disk groups. Similarly, after receiving the disk group powering-down information, it is necessary to indicate the target disk group as powered-down in the disk group powering-down state list.
Corresponding to the application scenario, the disk control method and the information processing method provided by the embodiment of the application, the embodiment of the application further provides a disk access determination method. The difference from the application scenario, the disk control method, and the information processing method provided in the embodiment of the present application lies in that: the method for determining disk access provided by the embodiment of the present application is applied to a storage client, and is basically similar to the application scenario, the disk control method, and the information processing method provided by the embodiment of the present application. Therefore, the description of the embodiment of the method for determining disk access provided by the embodiment of the present application is simpler, and the details of the information processing method provided by the embodiment of the present application and the similarities between the application scenario, the disk control method, and the information processing method provided by the embodiment of the present application are not described in detail one by one.
Fig. 5 shows an implementation process of a method for determining disk access according to an embodiment of the present application, where fig. 5 is a flowchart of a method for determining disk access according to another embodiment of the present application. As shown in fig. 5, the method includes:
step S501, sending disk group position determination request information to a metadata management server so that the metadata management server can determine a disk group which needs to be accessed by a storage client; the set of disks that the storage client needs to access includes disks in a plurality of data storage servers for storing data.
In the embodiment of the present application, the storage objects of the disks in the plurality of data storage servers include, but are not limited to, cold data, but generally store the cold data. The cold data includes, but is not limited to, enterprise backup data, archive data, medical image data, scientific data, and video material data.
The so-called disk group position determination request information includes, but is not limited to: the storage location determination request information is used for requesting to determine the storage location for the specified data block and at least one data block copy, and the location acquisition request information is used for requesting to determine the storage location of the data block corresponding to the target data. A data block copy is a copy of a given data block.
By a disk group comprising disks of a plurality of data storage servers for storing data, it is meant that the disk group is made up of disks of the plurality of data storage servers.
Step S502, determining whether to access the disk group or not based on the received power-on information of the disk group; the disk group power-on information is used for indicating that a target disk group which needs to execute power-on operation is successfully powered on, the target disk group is obtained by utilizing disk group information to be accessed, which is sent by a metadata management server, of the disk management device, and the disk group information to be accessed is used for indicating a disk group which needs to be accessed by a storage client.
Determining whether to perform a disk group access based on the received disk group power-up information comprises: and when the target disk group comprises a disk group which needs to be accessed by the storage client, determining to perform disk group access on the disk group which needs to be accessed by the storage client.
In this embodiment of the application, the storage client may further display the target disk group or the disk group to be powered on in response to a query operation of a user on the powered-on disk group.
According to the disk access determining method provided by the application, since the disk group power-on information is used for indicating that the target disk group has been successfully powered on, the target disk group is obtained by the disk management device by using the disk group to be accessed by the storage client. The target disk group required to execute the power-on operation is determined by the disk management device, and the power-on control can be selectively performed on the disks in the disk group when the distributed storage system is multiplexed to store data. By selectively powering on the disks in the disk group, the resource consumed by the multiplexing distributed storage system for storing data can be reduced, so that the distributed storage system can be multiplexed for storing cold data, and the storage cost is reduced.
And the cold data is stored by multiplexing the distributed storage system, and the development of another set of cold filing storage system for storing the cold data independently of the storage system adopted by the standard storage can be avoided, so that the development cost of the cold filing storage system can be reduced. Because a storage system adopted by standard storage does not need to be independent to develop another set of cold filing storage system for storing cold data, the maintenance cost required in the cold data storage process can be greatly reduced. The reduction of development cost and the reduction of maintenance cost can further ensure that cold data can be stored with lower storage cost.
Corresponding to the application scenario and the disk control method provided by the embodiment of the present application, the embodiment of the present application further provides a disk control device, and the device is applied to a disk management device. Fig. 6 is a block diagram of a disk control apparatus according to another embodiment of the present application, where the disk control apparatus may include:
a target disk group determining module 601, configured to determine a target disk group that needs to perform a power-on operation based on disk group information to be accessed, which is sent by the metadata management server; the disk group information to be accessed is used for representing a disk group which needs to be accessed by the storage client, and the disk group which needs to be accessed by the storage client comprises disks in a plurality of data storage servers for storing data;
a disk power-on control command sending module 602, configured to send a disk power-on control command to a data storage server corresponding to the target disk group, so as to instruct the data storage server to perform a power-on operation on the disks in the target disk group.
In a possible implementation manner, the target disk group determining module 601 includes:
the disk group determining submodule is used for determining at least one disk group to be accessed by the storage client based on the disk group information to be accessed, which is sent by the metadata management server in the appointed time period;
and the target disk group determining submodule is used for selecting the target disk group according to the disk group access amount obtained by the statistics of the disk group information to be accessed in at least one disk group.
In a possible implementation manner, the apparatus further includes:
the disk electrifying state information receiving module is used for receiving disk electrifying state information fed back by the data storage server aiming at the disk electrifying control command after sending the disk electrifying control command to the data storage server corresponding to the target disk group, wherein the disk electrifying state information is used for indicating whether the disks in the target disk group are electrified successfully or not;
the disk power-on success judging module is used for determining whether the power-on of the disks in the target disk group is successful based on the disk power-on state information;
the disk group electrifying success judging module is used for determining that the target disk group is electrified successfully according to whether the disks in the target disk group are electrified successfully;
and the disk group power-on information sending module is used for sending the disk group power-on information to the metadata management server and the storage client under the condition that the target disk group is successfully powered on so as to inform the metadata management server and the storage client that the target disk group is successfully powered on.
In a possible implementation manner, the apparatus further includes:
the power-on duration determining module is used for determining whether the power-on duration of the target disk group reaches the specified power-on duration or not under the condition that the target disk group is in a power-on state after a disk power-on control command is sent to a data storage server corresponding to the target disk group;
and the disk powering-off control command sending module is used for sending a disk powering-off control command to the data storage server corresponding to the target disk group to instruct the data storage server to execute powering-off operation on the disks in the target disk group when the powering-on time length of the target disk group reaches the specified powering-on time length.
In a possible implementation manner, the apparatus further includes:
the disk power-off state information receiving module is used for receiving the disk power-off state information fed back by the data storage server according to the disk power-off control command after sending the disk power-off control command to the data storage server corresponding to the target disk group, wherein the disk power-off state information is used for indicating whether the power-off of the disks in the target disk group is successful;
the disk power-off success judging module is used for determining whether the power-off of the disks in the target disk group is successful based on the disk power-off state information;
the disk group power-off success judging module is used for determining the power-off success of the target disk group according to whether the power-off success of the disks in the target disk group is achieved;
and the disk group powering-down information sending module is used for sending the disk group powering-down information to the metadata management server and the storage client under the condition that the target disk group is successfully powered down so as to inform the metadata management server and the storage client that the target disk group is successfully powered down.
Corresponding to the application scenario and the information processing method provided by the embodiment of the application, the embodiment of the application also provides an information processing device, and the device is applied to a metadata management server. As shown in fig. 7, a block diagram of an information processing apparatus according to another embodiment of the present application may include:
a disk group determining module 701, configured to determine, based on disk group position determination request information sent by a storage client, a disk group that the storage client needs to access; the disk group which the storage client needs to access comprises disks in a plurality of data storage servers for storing data;
a to-be-accessed disk group information generating module 702, configured to generate to-be-accessed disk group information based on a disk group to be accessed by a storage client;
a to-be-accessed disk group information sending module 703, configured to send the to-be-accessed disk group information to the disk management device, so that the disk management device determines a target disk group that needs to perform a power-on operation;
the disk group power-up information receiving module 704 receives the disk group power-up information fed back by the disk management device for the disk group information to be accessed, where the disk group power-up information is used to indicate that the target disk group has been successfully powered up.
In a possible implementation manner, the apparatus further includes:
and the disk group power-on information sending module is used for sending the disk group power-on information to the storage client after receiving the disk group power-on information fed back by the disk management device for the disk group information to be accessed so that the storage client can determine whether to access the disk group based on the target disk group.
In a possible implementation manner, the disk group determining module 701 is specifically configured to select disk group information to be accessed in a specified time period and send the disk group information to the disk management device.
In a possible implementation manner, the apparatus further includes:
a storage location determination request information determining module, configured to, after receiving disk group power-on information fed back by a disk management device for disk group information to be accessed, obtain, in the disk group location determination request information, storage location determination request information for requesting to determine a storage location for a specified data block and at least one data block copy corresponding to the specified data block;
a designated disk group determining module 701, configured to, in a target disk group, determine request information for storage location, and acquire a designated disk group for storing a designated data block and at least one data block copy;
and the magnetic disk allocation module is used for allocating different magnetic disks to the specified data block and the at least one data block copy in the specified magnetic disk group.
In a possible implementation manner, the apparatus further includes:
the disk group powering-down information receiving module is used for receiving disk group powering-down information fed back by the disk management equipment aiming at the target disk group, and the disk group powering-down information is used for indicating that the target disk group is successfully powered down;
and the disk group powering-down information sending module is used for sending the disk group powering-down information to the storage client so that the storage client can determine whether to access the disk group based on the target disk group.
Corresponding to the application scenario and the disk access determining method provided by the embodiment of the application, the embodiment of the application further provides a disk access determining device, and the device is applied to a storage client. Fig. 8 is a block diagram illustrating a structure of a device for determining disk access according to another embodiment of the present application, where the device for determining disk access may include:
a request information sending module 801, configured to send disk group position determination request information to a metadata management server, so that the metadata management server determines a disk group that a storage client needs to access; the disk group which the storage client needs to access comprises disks in a plurality of data storage servers for storing data;
a disk group access judging module 802, configured to determine whether to perform disk group access based on the received disk group power-on information; the disk group powering-up information is used for indicating that a target disk group which needs to execute powering-up operation has been successfully powered up, the target disk group is obtained by the disk management device by using the disk group information to be accessed sent by the metadata management server, and the disk group information to be accessed is used for indicating the disk group which the storage client needs to access.
Corresponding to the application scenario provided by the embodiment of the present application and the above device embodiment of the present application, the embodiment of the present application provides a data storage system. Referring to fig. 2 again, the data storage system includes: a storage client 201, a metadata management server 202, a plurality of data storage servers 203 for storing enterprise backup data, and a disk management device 204.
The metadata management server 202 is configured to determine a disk group that the storage client needs to access, where the disk group that the storage client needs to access includes disks in the multiple data storage servers 203; generating disk group information to be accessed based on a disk group to be accessed by a storage client; sending the disk group information to be accessed to the disk management device 204;
the disk management device 204 is configured to determine, based on the disk group information to be accessed, a target disk group that needs to perform a power-on operation; sending a disk electrifying control command to a data storage server 203 corresponding to the target disk group;
and the data storage server 203 is used for executing a power-on operation on the disks in the target disk group based on the disk power-on control command.
In a possible implementation manner, the disk management device 204 is further configured to determine whether the power-on duration of the target disk group reaches a specified power-on duration when the target disk group is in the power-on state; sending a disk power-off control command to the data storage server 203 corresponding to the target disk group when the power-on duration of the target disk group reaches the specified power-on duration;
and the data storage server 203 is further configured to perform a power-down operation on the disks in the target disk group based on the disk power-down control command.
The data storage system provided by the embodiment of the application can multiplex the distributed storage system, and can selectively power on and control the disks in the disk group when storing data. By selectively powering on the disks in the disk group, resources consumed during data storage can be reduced, and therefore, a distributed storage system can be reused to store cold data, and storage cost is reduced.
The development cost of the data storage system can be reduced by multiplexing the distributed storage system, so that another set of cold filing storage system for storing cold data does not need to be developed independently of the storage system adopted by standard storage, and the development cost of the cold filing storage system can be reduced. And compared with a storage system adopted independently of standard storage to develop another set of cold filing storage system for storing cold data, the method can reduce the maintenance cost required by the data storage system by reusing the distributed storage system to store the cold data. The reduction of development cost and the reduction of maintenance cost can further ensure that the data storage system can store cold data with lower storage cost.
It should be noted that the data storage server 203 is further configured to generate a check point for accelerating the recovery speed of data or read-write service after receiving the disk power-off control command; after powering down the disks in the target disk group, clearing metadata related to disk management, and suspending the disks in the target disk group from providing read-write service to the outside to release Central Processing Unit (CPU) and memory resources.
FIG. 9 is a block diagram of an electronic device used to implement embodiments of the present application. As shown in fig. 9, the electronic apparatus includes: a memory 910 and a processor 920, the memory 910 having stored therein computer programs operable on the processor 920. The processor 920, when executing the computer program, implements the methods in the embodiments described above. The number of the memory 910 and the processor 920 may be one or more.
The electronic device further includes:
the communication interface 930 is used for communicating with an external device to perform data interactive transmission.
If the memory 910, the processor 920 and the communication interface 930 are implemented independently, the memory 910, the processor 920 and the communication interface 930 may be connected to each other through a bus and perform communication with each other. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 9, but this does not indicate only one bus or one type of bus.
Optionally, in an implementation, if the memory 910, the processor 920 and the communication interface 930 are integrated on a chip, the memory 910, the processor 920 and the communication interface 930 may complete communication with each other through an internal interface.
Embodiments of the present application provide a computer-readable storage medium, which stores a computer program, and when the program is executed by a processor, the computer program implements the method provided in the embodiments of the present application.
The embodiment of the present application further provides a chip, where the chip includes a processor, and is configured to call and execute the instruction stored in the memory from the memory, so that the communication device in which the chip is installed executes the method provided in the embodiment of the present application.
An embodiment of the present application further provides a chip, including: the system comprises an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected through an internal connection path, the processor is used for executing codes in the memory, and when the codes are executed, the processor is used for executing the method provided by the embodiment of the application.
It should be understood that the Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, etc. A general purpose processor may be a microprocessor or any conventional processor or the like. It is noted that the processor may be a processor supporting Advanced reduced instruction set machine (ARM) architecture.
Further, optionally, the memory may include a read-only memory and a random access memory, and may further include a nonvolatile random access memory. The memory may be volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The non-volatile Memory may include a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. Volatile Memory can include Random Access Memory (RAM), which acts as external cache Memory. By way of example, and not limitation, many forms of RAM are available. For example, static Random Access Memory (Static RAM, SRAM), dynamic Random Access Memory (DRAM), synchronous Dynamic Random Access Memory (SDRAM), double Data Rate Synchronous Dynamic Random Access Memory (DDR SDRAM), enhanced SDRAM (ESDRAM), SLDRAM (Synchronous DRAM), and Direct bus RAM (DR RAM).
In the above embodiments, all or part of the implementation may be realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The procedures or functions according to the present application are generated in whole or in part when the computer program instructions are loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or to implicitly indicate the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "a plurality" means two or more unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process. And the scope of the preferred embodiments of the present application includes other implementations in which functions may be performed out of the order shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. All or part of the steps of the method of the above embodiments may be implemented by hardware that is configured to be instructed to perform the relevant steps by a program, which may be stored in a computer-readable storage medium, and which, when executed, includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module may also be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. The storage medium may be a read-only memory, a magnetic or optical disk, or the like.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive various changes or substitutions within the technical scope of the present application, and these should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (15)

1. A disk control method is applied to disk management equipment, and the method comprises the following steps:
determining a target disk group which needs to execute power-on operation based on disk group information to be accessed, which is sent by a metadata management server; the disk group information to be accessed is used for representing a disk group which needs to be accessed by a storage client, and the disk group which needs to be accessed by the storage client comprises disks in a plurality of data storage servers for storing data;
and sending a disk power-on control command to the data storage server corresponding to the target disk group to instruct the data storage server to execute power-on operation on the disks in the target disk group.
2. The method according to claim 1, wherein the determining a target disk group that needs to perform a power-on operation based on the disk group information to be accessed sent by the metadata management server comprises:
determining at least one disk group which needs to be accessed by the storage client based on the disk group information to be accessed, which is sent by the metadata management server within a specified time period;
and selecting the target disk group from the at least one disk group according to the disk group access amount obtained by counting the disk group information to be accessed.
3. The method of claim 1, wherein after sending a disk power-on control command to the data storage server corresponding to the target disk group, the method further comprises:
receiving disk power-on state information fed back by the data storage server according to the disk power-on control command, wherein the disk power-on state information is used for indicating whether the power-on of the disks in the target disk group is successful;
determining whether the power-on of the disks in the target disk group is successful based on the power-on state information of the disks;
determining whether the target disk group is successfully electrified according to whether the disks in the target disk group are successfully electrified;
and under the condition that the target disk group is successfully electrified, sending disk group electrifying information to the metadata management server and the storage client so as to inform the metadata management server and the storage client that the target disk group is successfully electrified.
4. The method of any of claims 1-3, wherein after sending a disk power-on control command to the data storage server corresponding to the target disk group, the method further comprises:
determining whether the power-on time of the target disk group reaches a specified power-on time under the condition that the target disk group is in a power-on state;
and sending a disk power-off control command to the data storage server corresponding to the target disk group to instruct the data storage server to execute power-off operation on the disks in the target disk group when the power-on time of the target disk group reaches the specified power-on time.
5. The method of claim 4, wherein after sending a disk power-down control command to the data storage server corresponding to the target disk group, the method further comprises:
receiving disk power-off state information fed back by the data storage server according to the disk power-off control command, wherein the disk power-off state information is used for indicating whether the power-off of the disks in the target disk group is successful;
determining whether the power down of the disks in the target disk group is successful based on the power down state information of the disks;
determining that the power down of the target disk group is successful according to whether the power down of the disks in the target disk group is successful;
and sending disk group power-off information to the metadata management server and the storage client to inform the metadata management server and the storage client that the target disk group is successfully powered off when the target disk group is successfully powered off.
6. An information processing method applied to a metadata management server, the method comprising:
determining a disk group to be accessed by a storage client based on disk group position determination request information sent by the storage client; the disk group which the storage client needs to access comprises disks in a plurality of data storage servers for storing data;
generating disk group information to be accessed based on the disk group to be accessed by the storage client;
sending the disk group information to be accessed to disk management equipment so that the disk management equipment can determine a target disk group which needs to execute a power-on operation;
and receiving disk group power-on information fed back by the disk management device for the disk group information to be accessed, wherein the disk group power-on information is used for indicating that the target disk group is successfully powered on.
7. The method according to claim 6, wherein after receiving disk group power-up information fed back by the disk management device for the disk group information to be accessed, the method further comprises:
and sending the disk group electrifying information to the storage client so that the storage client can determine whether to access the disk group based on the target disk group.
8. The method according to claim 6, wherein the sending the disk group information to be accessed to a disk management device includes: and selecting the disk group information to be accessed in a specified time period and sending the disk group information to the disk management equipment.
9. The method according to claim 6, wherein after receiving disk group power-on information fed back by the disk management device for the disk group information to be accessed, the method further comprises:
in the disk group position determination request information, obtaining storage position determination request information for requesting to determine storage positions for a specified data block and at least one data block copy corresponding to the specified data block;
in the target disk group, determining request information aiming at the storage position, and acquiring a specified disk group used for storing the specified data block and the at least one data block copy;
in the designated disk group, different disks are allocated for the designated data block and the at least one data block copy.
10. The method according to any one of claims 6-9, further comprising:
receiving disk group powering-down information fed back by the disk management device for the target disk group, wherein the disk group powering-down information is used for indicating that the target disk group has been successfully powered down;
and sending the disk group power-off information to the storage client side so that the storage client side can determine whether to access the disk group based on the target disk group.
11. A disk access determining method is applied to a storage client, and comprises the following steps:
sending disk group position determination request information to a metadata management server, so that the metadata management server determines a disk group which needs to be accessed by the storage client; the disk group which the storage client needs to access comprises disks in a plurality of data storage servers for storing data;
determining whether to access the disk group or not based on the received disk group power-on information; the disk group power-on information is used to indicate that a target disk group which needs to execute power-on operation has been successfully powered on, the target disk group is obtained by the disk management device by using the disk group information to be accessed which is sent by the metadata management server, and the disk group information to be accessed is used to indicate the disk group which the storage client needs to access.
12. A data storage system, comprising: the system comprises a storage client, a metadata management server, a plurality of data storage servers for storing data and a magnetic disk management device;
the metadata management server is configured to determine a disk group that the storage client needs to access, where the disk group that the storage client needs to access includes disks in the data storage servers; generating disk group information to be accessed based on the disk group to be accessed by the storage client; sending the disk group information to be accessed to the disk management equipment;
the disk management device is used for determining a target disk group which needs to execute a power-on operation based on the disk group information to be accessed; sending a disk power-on control command to the data storage server corresponding to the target disk group;
and the data storage server is used for executing power-on operation on the disks in the target disk group based on the disk power-on control command.
13. The system according to claim 12, wherein the disk management device is further configured to determine whether the power-up duration of the target disk group reaches a specified power-up duration when the target disk group is in the power-up state; when the power-on time of a target disk group reaches the specified power-on time, sending a disk power-off control command to the data storage server corresponding to the target disk group;
the data storage server is further configured to perform a power-down operation on the disks in the target disk group based on the disk power-down control command.
14. An electronic device comprising a memory, a processor and a computer program stored on the memory, the processor implementing the method of any one of claims 1-11 when executing the computer program.
15. A computer-readable storage medium, having stored therein a computer program which, when executed by a processor, implements the method of any of claims 1-11.
CN202211176524.7A 2022-09-26 2022-09-26 Disk control method, information processing method, disk access determination method and electronic equipment Pending CN115525225A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211176524.7A CN115525225A (en) 2022-09-26 2022-09-26 Disk control method, information processing method, disk access determination method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211176524.7A CN115525225A (en) 2022-09-26 2022-09-26 Disk control method, information processing method, disk access determination method and electronic equipment

Publications (1)

Publication Number Publication Date
CN115525225A true CN115525225A (en) 2022-12-27

Family

ID=84700233

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211176524.7A Pending CN115525225A (en) 2022-09-26 2022-09-26 Disk control method, information processing method, disk access determination method and electronic equipment

Country Status (1)

Country Link
CN (1) CN115525225A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116501904A (en) * 2023-06-28 2023-07-28 中国人民解放军总医院 Distributed storage method, device, equipment and medium
CN117008844A (en) * 2023-09-27 2023-11-07 苏州元脑智能科技有限公司 Device control method and device of storage device, storage medium and electronic device

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116501904A (en) * 2023-06-28 2023-07-28 中国人民解放军总医院 Distributed storage method, device, equipment and medium
CN116501904B (en) * 2023-06-28 2023-09-22 中国人民解放军总医院 Distributed storage method, device, equipment and medium
CN117008844A (en) * 2023-09-27 2023-11-07 苏州元脑智能科技有限公司 Device control method and device of storage device, storage medium and electronic device
CN117008844B (en) * 2023-09-27 2024-01-26 苏州元脑智能科技有限公司 Device control method and device of storage device, storage medium and electronic device

Similar Documents

Publication Publication Date Title
CN115525225A (en) Disk control method, information processing method, disk access determination method and electronic equipment
JP6479608B2 (en) Memory device and memory control method
CN110515539B (en) Cloud disk mounting method, device, equipment and storage medium based on cloud storage
EP1630673B1 (en) Memory dump generation with quick reboot
US9058212B2 (en) Combining memory pages having identical content
US8566555B2 (en) Data insertion system, data control device, storage device, data insertion method, data control method, data storing method
US20110213954A1 (en) Method and apparatus for generating minimum boot image
US8065466B2 (en) Library apparatus, library system and method for copying logical volume to disk volume in cache disk with smallest access load
US9940020B2 (en) Memory management method, apparatus, and system
US20070277017A1 (en) Method and a computer for storage area management
US7421538B2 (en) Storage control apparatus and control method thereof
KR20130048594A (en) Distributed storage system, apparatus and method for managing a distributed storage in consideration of delay elements
CN109669822B (en) Electronic device, method for creating backup storage pool, and computer-readable storage medium
CN110704161B (en) Virtual machine creation method and device and computer equipment
US8078798B2 (en) Managing first level storage in a multi-host environment
US20220129346A1 (en) Data processing method and apparatus in storage system, and storage system
CN108132759B (en) Method and device for managing data in file system
CN113849311B (en) Memory space management method, device, computer equipment and storage medium
US20200371694A1 (en) System and Method for Persistent Memory Rotation Based on Remaining Write Endurance
CN116578410A (en) Resource management method, device, computer equipment and storage medium
US11397678B2 (en) Pooling distributed storage nodes that have backup power supplies and write-back caching capabilities
CN115794232A (en) VPD (virtual private display) acquisition method, device, equipment and computer-readable storage medium
US11500741B2 (en) Data write method and storage system
CN111491040B (en) IP distribution method and IP distribution device
WO2018188959A1 (en) Method and apparatus for managing events in a network that adopts event-driven programming framework

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination