CN111026333A - Access request processing method, processing device, electronic equipment and storage medium - Google Patents
Access request processing method, processing device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111026333A CN111026333A CN201911257905.6A CN201911257905A CN111026333A CN 111026333 A CN111026333 A CN 111026333A CN 201911257905 A CN201911257905 A CN 201911257905A CN 111026333 A CN111026333 A CN 111026333A
- Authority
- CN
- China
- Prior art keywords
- access request
- processed
- data
- type
- vtl
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 87
- 238000003672 processing method Methods 0.000 title claims abstract description 25
- 238000000034 method Methods 0.000 claims abstract description 54
- 238000004590 computer program Methods 0.000 claims description 12
- 230000003993 interaction Effects 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 6
- 230000009471 action Effects 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 101150053844 APP1 gene Proteins 0.000 description 1
- 101100189105 Homo sapiens PABPC4 gene Proteins 0.000 description 1
- 102100039424 Polyadenylate-binding protein 4 Human genes 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0664—Virtualisation aspects at device level, e.g. emulation of a storage device or system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0665—Virtualisation aspects at area level, e.g. provisioning of virtual or logical volumes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
- G06F3/0676—Magnetic disk device
Abstract
The embodiment of the invention provides an access request processing method, a processing device, electronic equipment and a storage medium, wherein the method comprises the following steps: receiving an access request to be processed; matching the priority and the workload type of the access request to be processed according to the preset corresponding relation between the metadata and the priority and the workload type by using the metadata corresponding to the access request to be processed; and processing the access request to be processed according to the matched priority and the workload type of the access request to be processed. The embodiment of the invention can further improve the processing logic perfection degree when processing the data access request.
Description
Technical Field
The present invention relates to the field of data storage technologies, and in particular, to an access request processing method, a processing apparatus, an electronic device, and a storage medium.
Background
VTL (Virtual Tape Library) is a storage device that uses a disk as a storage medium, can virtualize a disk space as a Tape space, and can implement the same function as a physical Tape Library. The VTL may be integrated with a physical tape library to form a virtual tape system, utilize the VLT to provide caching, and then store data cached in the VLT in the physical tape library. The physical tape library is a device that stores data using a magnetic tape as a storage medium.
The data access process of the existing virtual tape system is described by taking a data reading process as an example: after receiving a data access request of user equipment, the VTL checks whether the VTL caches data to be accessed, if so, reads the data from the cache and returns the data to the user equipment, and if not, reads corresponding data from a physical tape library and returns the corresponding data to the user equipment. In reading data from a physical tape library, it is necessary to mount a physical tape volume in a physical tape drive by a manipulator and then read the data in the physical tape volume by the physical tape drive.
The inventor researches and discovers that the data access request processing logic in the existing virtual tape system is still not perfect, and as long as the VTL does not cache the requested data by itself, the VTL immediately reads the data from the physical tape volume, so that the physical resources (physical tape volume) in the virtual tape environment cannot be effectively utilized, and the performance of the virtual tape access request is also reduced.
Disclosure of Invention
Embodiments of the present invention provide an access request processing method, processing apparatus, electronic device, and storage medium, so as to further improve the logic perfection degree when processing a data access request. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present invention provides an access request processing method, which is applied to a virtual tape library VTL of a virtual tape system, where the virtual tape system further includes a physical tape library, and a data interaction capability is provided between the VTL and the physical tape library, and the method includes:
receiving a pending access request, wherein the access request is used for accessing data in the virtual tape system;
matching the priority and the workload type of the access request to be processed according to the preset corresponding relation between the metadata and the priority and the workload type by using the metadata corresponding to the access request to be processed, wherein the priority represents the priority of accessing the virtual tape system, the workload type represents the processing type when the access request to be processed is processed and an operation object for the processing type, and the operation object is the VTL or the physical tape library;
and processing the access request to be processed according to the matched priority and the workload type of the access request to be processed.
Optionally, the step of matching the priority and the workload type of the to-be-processed access request according to a preset correspondence between the metadata and the priority and the workload type by using the metadata corresponding to the to-be-processed access request includes:
matching the rules of the access requests to be processed according to the corresponding relation between the metadata recorded in a preset rule list and the priority and the workload type by using the metadata corresponding to the access requests to be processed, wherein the rules comprise: the pending access request priority and the workload type.
Optionally, the workload types include:
an immediate access type indicating immediate access to the physical tape library, a deferred access type indicating deferred access to the physical tape library, a normal read type indicating reading data only from the VTL, and a normal write type indicating writing data only to the VTL.
Optionally, the step of processing the to-be-processed access request according to the matched priority and workload type of the to-be-processed access request includes:
when the priority of the access request to be processed is the highest among all the access requests to be processed and the workload type is the common reading type, judging whether target data is cached in the VTL or not, wherein the target data is the data requested by the access request to be processed, the workload type of which is the common reading type;
if the target data are cached, reading the target data from the VTL;
if the target data is not cached, creating a blank logical volume in the VTL;
caching target data in a physical tape volume of the physical tape library to the blank logical volume;
when the priority of the access request to be processed is the highest in all the access requests to be processed and the workload type of the task to be processed is the common write-in type, caching data to be written into the VTL, wherein the data to be written is the data requested by the access request to be processed, the workload type of which is the common write-in type;
and when a preset condition is met, storing the data to be written cached by the VTL to the physical tape library.
Optionally, when the workload type of the pending access request is the common write type, the method further includes:
detecting whether data which is repeated with the data to be written exists in the VTL;
if so, stopping executing the normal write type of pending access request.
Optionally, when the current pending access request matches a plurality of rules of the same priority, the method further includes:
determining an access time period recorded in each rule, wherein the access time period represents a time period for accessing data in the virtual tape system;
and determining the rule corresponding to the longest access time period as the rule of the current request to be processed.
Optionally, before the matching the priority and the workload type of the to-be-processed access request according to the preset corresponding relationship between the metadata and the priority and the workload type by using the metadata corresponding to the to-be-processed access request, the method further includes:
acquiring log information of each access request to be processed;
extracting metadata related to each access request to be processed from the log information, wherein the metadata comprises: the address of the device sending the access request, the name of the application sending the access request, the processing time period of the task to be processed, the tape medium type identifier and the tape serial number identifier.
Optionally, at least one hot backup disk is disposed in the VTL, and the method further includes:
and performing hot backup on the data of each disk in the VTL by using the hot backup disk to obtain backup data, wherein the backup data is the data stored in each disk in the VTL within a preset time period.
Optionally, when a disk in the VTL fails, the method further includes:
and importing the backup data which is stored in the hot backup disk and corresponds to the fault disk into a replaced disk.
In a second aspect, an embodiment of the present invention provides an access request processing apparatus, which is applied to a virtual tape library VTL of a virtual tape system, where the virtual tape system further includes a physical tape library, and the VTL and the physical tape library have data interaction capability, and the apparatus includes:
a receiving module, configured to receive an access request to be processed, where the access request is used to access data in the virtual tape system;
the matching module is used for matching the priority and the workload type of the access request to be processed according to the preset corresponding relation between the metadata and the priority and the workload type by using the metadata corresponding to the access request to be processed, wherein the priority represents the priority of accessing the virtual tape system, the workload type represents the processing type when the access request to be processed is processed and an operation object for the processing type, and the operation object is the VTL or the physical tape library;
and the processing module is used for processing the access request to be processed according to the matched priority and the workload type of the access request to be processed.
Optionally, the matching module is specifically configured to:
matching the rules of the access requests to be processed according to the corresponding relation between the metadata recorded in a preset rule list and the priority and the workload type by using the metadata corresponding to the access requests to be processed, wherein the rules comprise: the pending access request priority and the workload type.
Optionally, the workload types include:
an immediate access type indicating immediate access to the physical tape library, a deferred access type indicating deferred access to the physical tape library, a normal read type indicating reading data only from the VTL, and a normal write type indicating writing data only to the VTL.
Optionally, the processing module includes:
the judging submodule is used for judging whether target data is cached in the VTL or not when the priority of the access request to be processed is the highest in all the access requests to be processed and the workload type is the common reading type, wherein the target data is the data requested by the access request to be processed, the workload type of which is the common reading type;
the reading sub-module is used for reading the target data from the VTL if the target data is cached;
a creating submodule, configured to create a blank logical volume in the VTL if the target data is not cached;
a first cache submodule, configured to cache target data in a physical tape volume of the physical tape library to the blank logical volume;
the second cache submodule is used for caching data to be written into the VTL when the priority of the access request to be processed is the highest in all the access requests to be processed and the workload type of the task to be processed is the common write-in type, wherein the data to be written is the data requested by the access request to be processed, the workload type of which is the common write-in type;
and the storage submodule is used for storing the data to be written cached by the VTL to the physical tape library when a preset condition is met.
Optionally, the apparatus further comprises:
a detection module, configured to detect whether data that is duplicated with data to be written exists in the VTL when the workload type of the access request to be processed is the common write type;
a stop module for stopping execution of the pending access request of the generic write type if present.
Optionally, the apparatus further comprises:
the first determining module is used for determining the access time periods recorded in the rules when the current access requests to be processed are matched with the rules with the same priority, wherein the access time periods represent the time periods for accessing the data in the virtual tape system;
and the second determining module is used for determining the rule corresponding to the longest access time period as the rule of the current request to be processed.
Optionally, the apparatus further comprises:
the acquisition module is used for acquiring the log information of each access request to be processed;
an extracting module, configured to extract metadata related to each pending access request from the log information, where the metadata includes: the address of the device sending the access request, the name of the application sending the access request, the processing time period of the task to be processed, the tape medium type identifier and the tape serial number identifier.
Optionally, at least one hot backup disk is disposed in the VTL, and the apparatus further includes:
and the hot backup module is used for carrying out hot backup on the data of each disk in the VTL by utilizing the hot backup disk to obtain backup data, and the backup data is the data stored in each disk in the VTL within a preset time period.
Optionally, the apparatus further comprises:
and the replacing module is used for importing backup data which are stored in the hot backup disk and correspond to the fault disk into a replaced disk when the disk in the VTL fails.
In a third aspect, an embodiment of the present invention provides an electronic device, which includes a processor and a machine-readable storage medium, where the machine-readable storage medium stores machine-executable instructions capable of being executed by the processor, and the processor executes the machine-executable instructions to implement the method steps of the access request processing method provided in the first aspect.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method steps of the access request processing method provided in the first aspect are implemented.
In a fifth aspect, an embodiment of the present invention further provides a computer program product containing instructions, which when run on a computer, causes the computer to execute the method steps of the access request processing method provided in the first aspect.
In a sixth aspect, an embodiment of the present invention further provides a computer program, which, when running on a computer, causes the computer to execute the method steps of the access request processing method provided in the first aspect.
According to the access request processing method, the processing device, the electronic device and the storage medium provided by the embodiments of the present invention, after receiving a pending access request, the VTL can match the priority and the workload type of the pending access request according to the preset correspondence between the metadata and the priority and the workload type, by using the metadata corresponding to the pending access request, so as to process the pending access request according to the matched priority and workload type of the pending access request, instead of immediately reading data from a physical tape volume as long as the VTL does not cache the requested data, thereby further improving the processing logic perfection degree when processing the data access request. Of course, it is not necessary for any product or method of practicing the invention to achieve all of the above-described advantages at the same time.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic diagram of an architecture of a virtual tape system according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of an access request processing method according to an embodiment of the present invention;
fig. 3 is a schematic flowchart of step S103 in the access request processing method according to the embodiment of the present invention;
fig. 4 is another schematic flow chart of an access request processing method according to an embodiment of the present invention;
fig. 5 is a schematic flowchart of a method for processing an access request according to another embodiment of the present invention;
fig. 6 is a fourth flowchart illustrating an access request processing method according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of another embodiment of a virtual tape system;
fig. 8 is a schematic structural diagram of an access request processing apparatus according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a processing module in the access request processing apparatus according to the embodiment of the present invention;
fig. 10 is a schematic structural diagram of an access request processing apparatus according to an embodiment of the present invention;
fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the existing virtual tape system, the VTL uses a disk to store data, so that it can be considered that a virtual manipulator and a tape drive are used to replace a bare and vulnerable mechanical device in a physical tape library, and a disk array protected by RAID (redundant arrays of Independent Drives) has a degraded working capability. The VTL can integrate a virtual tape system with a physical tape library, thereby improving the overall security and performance of data protection and reducing the cost of data protection. However, in the virtual tape system, the VTL usually provides a cache, and once a certain disk in the VTL fails, a new disk must be replaced to reconstruct data, which takes a long time in the reconstruction process, and is likely to cause interruption of the data backup service, and thus continuity of the backup service cannot be ensured.
In view of the above, the embodiment of the present invention first provides an access request processing method, which is applied to a virtual tape library VTL of a virtual tape system, and the following first introduces the virtual tape system: as shown in fig. 1, the virtual tape system may include a VTL and a physical tape library, where the VTL is provided with a disk array, and disks are used as storage media to store data, the VTL may perform data interaction with different user computers, and the VTL is provided with a controller, and is capable of executing the access request processing method in the embodiment of the present invention; the VTL may also receive an access request sent by an external device and process the access request, for example, data interaction with a user application in the a-user computer and a user application in the B-user computer shown in fig. 1, respectively.
As shown in fig. 2, the access request processing method according to an embodiment of the present invention may include the following steps:
s101, receiving an access request to be processed.
The VTL may receive access requests sent by different user devices, which may be used to access data in the virtual tape system, e.g., to read data from or write data to the virtual tape system. It will be appreciated that these access requests require processing by a controller in the VTL and may therefore be referred to as pending access requests.
And S102, matching the priority and the workload type of the access request to be processed according to the preset corresponding relation between the metadata and the priority and the workload type by using the metadata corresponding to the access request to be processed.
The metadata mentioned in the embodiment of the present invention may refer to data used for describing data requested in an access request, and the metadata corresponding to the pending access request may be obtained from log information generated when the VTL receives each pending access request, and may obtain a set of metadata of each pending access request, for example, an address of a device that issues the access request of the pending access request, a name of an application that issues the access request, a processing time period of a pending task, a tape media type identifier, a tape serial number identifier, and the like. The embodiment of the present invention may preset the corresponding relationship between the metadata and the priority and the workload type, that is, the embodiment of the present invention may preset the corresponding relationship between a set of metadata corresponding to the access request and the priority and the workload type of the access request, so that after receiving the access request to be processed, the priority and the workload type of the access request to be processed are obtained by matching.
The priority may represent a priority of accessing the virtual tape system, that is, for each received pending access request, the priority corresponding to the received pending access request may be obtained, so that the pending access request with the higher priority is processed first, and then the pending access request with the lower priority is processed.
The workload type may represent a processing type when the pending access request is processed and an operation object for the processing type, and the operation object may be a VTL or a physical tape library, that is, for each received pending access request, the workload type of each pending access request may be specified in a preset correspondence, for example, some access requests may only access the VTL, some access requests may only access the physical tape library, and some access requests may both access the VTL and the physical tape library.
And S103, processing the access request to be processed according to the matched priority and the workload type of the access request to be processed.
In the embodiment of the invention, after the priority and the workload type of the access request to be processed are obtained by matching, the access request to be processed can be processed according to the priority and the workload type of the access request to be processed.
As an optional implementation manner of the embodiment of the present invention, as shown in table 1, a rule list may be preset, and a rule including a correspondence relationship between each group of metadata and a priority and a workload type may be recorded in the rule list, so that after receiving a pending access request, a rule of the pending access request may be obtained by matching in the rule list by using metadata corresponding to the pending access request.
TABLE 1 rule List
A plurality of sets of metadata are recorded in the rule list shown in table 1, where a set of metadata corresponds to a rule, and each set of metadata may include: the name of the application (i.e. APP in table 1) sending the access request, the address of the device sending the access request, the access time period, the media type identifier indicating the storage media type of the tape, e.g. physical tape media and virtual tape media, the volume sequence number identifier indicating the volume sequence number of the tape, the corresponding tape can be found in the virtual tape system by the volume sequence number identifier, the ID indicating the unique identifier of the rule, and the × indicating the default value.
As an optional implementation manner of the embodiment of the present invention, the workload types may specifically be: an immediate access type, a deferred access type, a normal read type, and a normal write type, where the immediate access type indicates that the content requested by the access request does not pass through the VTL, but directly accesses the physical tape library, for example, the content requested by the access request is directly written into a physical tape volume of the physical tape library without passing through a VTL cache; the deferred access type indicates that after receiving an access request, the access request is not processed immediately, but the access request is deferred for a preset time and then processed, for example, data is directly written into a physical tape volume of a physical tape library after 5 seconds; the normal read type indicates that only data is read from the VTL for the access request, and data is not read from the physical tape library; the normal write type indicates that data is only written to the VTL for the access request, and not to the physical tape library. And, the processing priority of the load type is as follows: an immediate access type, a deferred access type, a normal read type, a normal write type, such that each pending access request may be processed according to the workload type.
Therefore, by setting the workload types, each access request to be processed can be processed according to the corresponding workload type, instead of reading data in a physical tape volume immediately as long as the VTL does not cache the requested data, so that the logic perfection degree of processing the data access request is further improved.
As an optional implementation manner of the embodiment of the present invention, as shown in fig. 3, the step S103 may include:
when the priority of the pending access requests is highest among all pending access requests and the workload type is a normal read type,
s1031, judging whether target data are cached in the VTL;
s1032, if the target data is cached, the target data is read from the VTL.
S1033, if the target data is not cached, a blank logical volume is created in the VTL.
S1034, caching the target data in the physical tape volume of the physical tape library to a blank logical volume.
In the embodiment of the present invention, when the VTL caches target data, the target data may be directly read from the VTL, and when the VTL does not cache the target data, a blank logical volume is created in the virtual tape volume, and then a physical volume storing the target data may be found in the physical tape library according to the volume sequence number, and then the target data in the physical volume is cached to the blank logical volume, where the target data may be data requested by a pending access request with a workload type being a normal read type. Through the reading process, the data cached in the VTL can be read preferentially, and when the data is not cached, the data is read from the physical tape library, so that the frequency of accessing the physical tape volumes in the physical tape library is further reduced.
When the priority of the pending access request is highest among all the pending access requests and the workload type of the pending task is a normal write type,
and S1031', caching the data to be written into the VTL.
S1032', when a preset condition is satisfied, storing the data to be written cached by the VTL to the physical tape library.
In the embodiment of the present invention, data to be written may be cached in the VTL, and when a preset condition is satisfied, for example, when the cache in the VTL is full, the data to be written cached in the VTL is then stored in the physical volume of the physical tape library, so as to further reduce the frequency of accessing the physical volume in the physical tape library. The data to be written may refer to data requested by a pending access request with a workload type being a common write type.
As an optional implementation manner of the embodiment of the present invention, when the workload type of the to-be-processed access request is a normal write type, as shown in fig. 4, the access request processing method according to the embodiment of the present invention may further include:
s201, detecting whether data which is overlapped with the data to be written exists in the VTL.
S202, if the access request exists, the execution of the access request to be processed of the common writing type is stopped.
Step S201 may be located before step S1031' of the embodiment shown in fig. 3, and when the workload type of the pending access request is the normal write type, the data to be written may be cached in the VTL at this time, that is, the data is written into the VTL, but before the data is written, the embodiment of the present invention may detect whether there is data overlapping with the data to be written already in the VTL, and if there is, it is not necessary to write the overlapping data into the VTL, that is, the execution of the pending access request of the normal write type is stopped, on one hand, the storage space in the VTL is saved, and on the other hand, the data access efficiency of the virtual tape system is further improved because the number of executing the pending access requests is reduced.
Of course, if there is no data in the VTL that overlaps with the data to be written, step S1031' of the embodiment shown in fig. 3 may be performed.
As an optional implementation manner in the embodiment of the present invention, as shown in fig. 5, when the current to-be-processed access request matches with a plurality of rules with the same priority, the access request processing method in the embodiment of the present invention may further include:
s301, determining the access time period recorded in each rule.
S302, determining the rule corresponding to the longest access time period as the rule of the current request to be processed.
It can be understood that, after performing priority matching on the current pending access request, the embodiment of the present invention may obtain one or more rules, and when multiple local rules are obtained, for example, rule a and rule B, the priorities of which may be 1, at this time, the rule to be used by the current pending access request may be determined by using the access time period in the rule list. The access time period may refer to a time period for accessing data in the virtual tape system, for example, when a certain pending access request is used for data backup, the time period for accessing data in the virtual tape system may be 10 to 14 points.
After the access time periods of the rules are obtained, the lengths of the access time periods can be compared, so that the rule corresponding to the longest access time period is determined as the rule which needs to be used by the current request to be processed.
Illustratively, the access time period of the rule a is 10 to 14 points, and the access time period of the rule B is 11 to 14 points, then the rule a may be determined as a rule that needs to be used by the current pending request, so as to ensure that the access request requiring a long time for access is processed in time, so as to further improve the processing efficiency of the access request of the entire virtual tape system.
As an optional implementation manner of the embodiment of the present invention, if the access time periods of two pending access requests are also the same, one of the pending access requests may be randomly selected for processing each time until the processing of the pending access requests in all the time periods that are also the same is completed, so as to further improve the processing efficiency of the access request of the virtual tape system.
As another optional implementation manner of the embodiment of the present invention, a custom field may be preset in each group of metadata in the rule list, where the custom field may be used to indicate an importance degree of an application name corresponding to each pending access request, for example, appvoip, where VIP is also a custom field and indicates an important application, APP1, where the number 1 may be a custom field and indicates a common application and APPTest, where Test is also a custom field and indicates a Test application, and then the importance degrees indicated by the above custom fields may be preset as follows: VIP > number > Test, whereby each pending access request is processed in turn according to the processing priority indicated by the respective definition field. Of course, the processing priority level indicated by the respective definition fields may be preset, and the embodiment of the present invention is not particularly limited.
An embodiment of the present invention further provides an access request processing method, and on the basis of the flow of the method in fig. 2, as shown in fig. 6, the method may further include:
s401, obtaining log information of each access request to be processed.
S402, extracting metadata related to each access request to be processed from the log information.
According to the foregoing embodiment, it can be known that the metadata can be obtained from log information, and therefore, in the embodiment of the present invention, log information of each pending access request can be obtained first, and then metadata related to each pending access request is extracted from the log information, where the extracted metadata may include: the address of the device sending the access request, the name of the application sending the access request, the processing time period of the task to be processed, the tape medium type identifier, the tape serial number identifier and the like.
As an optional implementation manner of the embodiment of the present invention, as shown in fig. 7, the VTL according to the embodiment of the present invention may further include one or more hot backup disks for global hot backup, so that the hot backup disks are used to perform hot backup on data of each disk in the VTL to obtain global backup data. It is understood that the hot backup disk may not need to backup all data of each disk in the VTL, but backup only important data or data with high heat, such as backup only data stored in each disk in the VTL within a preset time period, or backup only data specified by an administrator, or backup the important data and the data with high heat at the same time, and when backing up the data with high heat, for example, data within 1 hour before the current time as the starting time may be backed up.
As an optional implementation manner of the embodiment of the present invention, when a disk in the VTL fails, backup data stored in the hot backup disk and corresponding to the failed disk may be imported to a replaced disk, so that when the disk in the VTL fails, important data and/or data with high heat in the failed disk can be recovered by using data backed up by the hot backup disk, and data security is further ensured.
In the access request processing method provided by the embodiment of the invention, after receiving the to-be-processed access request, the VTL can match the priority and the workload type of the to-be-processed access request by using the metadata corresponding to the to-be-processed access request according to the preset correspondence between the metadata and the priority and the workload type, so that the to-be-processed access request is processed according to the matched priority and workload type of the to-be-processed access request, instead of immediately reading data from a physical tape volume as long as the VTL does not cache the requested data, and thus the processing logic perfection degree of the data access request can be further improved.
Corresponding to the above method embodiment, the embodiment of the present invention also provides a corresponding device embodiment.
As shown in fig. 8, an embodiment of the present invention provides an access request processing apparatus, which is applied to a virtual tape library VTL of a virtual tape system, where the virtual tape system further includes a physical tape library, and data interaction capability is provided between the VTL and the physical tape library, the apparatus includes:
a receiving module 501, configured to receive a pending access request, where the access request is used to access data in a virtual tape system.
The matching module 502 is configured to match the priority and the workload type of the to-be-processed access request according to a preset correspondence between the metadata and the priority and the workload type, where the priority indicates a priority for accessing the virtual tape system, the workload type indicates a processing type when the to-be-processed access request is processed and an operation object for the processing type, and the operation object is a VTL or a physical tape library.
And the processing module 503 is configured to process the to-be-processed access request according to the matched priority and workload type of the to-be-processed access request.
The matching module 502 is specifically configured to:
matching the rules of the access requests to be processed according to the corresponding relation between the metadata recorded in a preset rule list and the priority and the workload types by using the metadata corresponding to the access requests to be processed, wherein the rules comprise: pending access request priority and workload type.
Wherein the workload types include:
an immediate access type, a deferred access type, a normal read type, and a normal write type, the immediate access type indicating immediate access to the physical tape library, the deferred access type indicating deferred access to the physical tape library, the normal read type indicating reading data only from the VTL, and the normal write type indicating writing data only to the VTL.
As shown in fig. 9, the processing module 503 includes:
the determining sub-module 5031 is configured to determine whether target data is cached in the VTL when the priority of the pending access request is highest among all the pending access requests and the workload type is a normal read type, where the target data is data requested by the pending access request with the workload type being the normal read type.
A reading sub-module 5032, configured to read the target data from the VTL if the target data is cached.
A creating sub-module 5033 for creating a blank logical volume in the VTL if the target data is not cached.
The first caching submodule 5034 is configured to cache the target data in the physical volume of the physical tape library to a blank logical volume.
The second cache submodule 5035 is configured to, when the priority of the pending access request is highest among all the pending access requests and the workload type of the pending task is the normal write type, cache the data to be written into the VTL, where the data to be written is the data requested by the pending access request whose workload type is the normal write type.
The storage sub-module 5036 is configured to store the data to be written, cached by the VTL, in the physical tape library when a preset condition is met.
Wherein, above-mentioned device can also include:
the detection module is used for detecting whether data which are repeated with the data to be written exist in the VTL or not when the workload type of the access request to be processed is a common writing type;
a stop module to stop execution of the normal write type pending access request if present.
Wherein, above-mentioned device can also include:
the first determining module is used for determining the access time periods recorded in the rules when the current access request to be processed is matched with the rules with the same priority, wherein the access time periods represent the time periods for accessing the data in the virtual tape system;
and the second determining module is used for determining the rule corresponding to the longest access time period as the rule of the current request to be processed.
On the basis of the structure of the apparatus shown in fig. 8, as shown in fig. 10, the apparatus may further include:
the obtaining module 601 is configured to obtain log information of each to-be-processed access request.
An extracting module 602, configured to extract metadata related to each pending access request from the log information, where the metadata includes: the address of the device sending the access request, the name of the application sending the access request, the processing time period of the task to be processed, the tape medium type identifier and the tape serial number identifier.
Wherein, the VTL is provided with at least one hot backup disk, and the apparatus may further include:
and the hot backup module is used for carrying out hot backup on the data of each disk in the VTL by utilizing the hot backup disk to obtain backup data, and the backup data is the data stored in each disk in the VTL within a preset time period.
Wherein, above-mentioned device can also include:
and the replacement module is used for importing backup data which are stored in the hot backup disk and correspond to the fault disk into a replaced disk when the disk in the VTL fails.
In the access request processing apparatus provided in the embodiment of the present invention, after receiving the to-be-processed access request, the VTL may match the priority and the workload type of the to-be-processed access request according to the preset correspondence between the metadata and the priority and the workload type, so as to process the to-be-processed access request according to the matched priority and workload type of the to-be-processed access request, instead of immediately reading data from the physical tape volume as long as the VTL does not cache the requested data, thereby further improving the processing logic perfection degree when processing the data access request.
An embodiment of the present invention further provides an electronic device, which may be specifically a server, as shown in fig. 11, where the device 700 includes a processor 701 and a machine-readable storage medium 702, where the machine-readable storage medium stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the following steps:
receiving an access request to be processed, wherein the access request is used for accessing data in a virtual tape system;
matching the priority and the workload type of the access request to be processed according to the preset corresponding relation between the metadata and the priority and the workload type by using the metadata corresponding to the access request to be processed, wherein the priority represents the priority of accessing the virtual tape system, the workload type represents the processing type when the access request to be processed is processed and an operation object for the processing type, and the operation object is a VTL or a physical tape library;
and processing the access request to be processed according to the matched priority and the workload type of the access request to be processed.
The machine-readable storage medium may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.
In the electronic device provided by the embodiment of the present invention, after receiving the pending access request, the VTL can match the priority and the workload type of the pending access request by using the metadata corresponding to the pending access request according to the preset correspondence between the metadata and the priority and the workload type, so as to process the pending access request according to the matched priority and workload type of the pending access request, instead of immediately reading data from the physical tape volume as long as the VTL does not cache the requested data, thereby further improving the processing logic perfection degree when processing the data access request.
An embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the computer program is configured to perform the following steps:
receiving an access request to be processed, wherein the access request is used for accessing data in a virtual tape system;
matching the priority and the workload type of the access request to be processed according to the preset corresponding relation between the metadata and the priority and the workload type by using the metadata corresponding to the access request to be processed, wherein the priority represents the priority of accessing the virtual tape system, the workload type represents the processing type when the access request to be processed is processed and an operation object for the processing type, and the operation object is a VTL or a physical tape library;
and processing the access request to be processed according to the matched priority and the workload type of the access request to be processed.
In the computer-readable storage medium provided in the embodiment of the present invention, after receiving the pending access request, the VTL may match the priority and the workload type of the pending access request by using the metadata corresponding to the pending access request according to the preset correspondence between the metadata and the priority and the workload type, so as to process the pending access request according to the matched priority and workload type of the pending access request, instead of immediately reading data from the physical tape volume as long as the VTL does not cache the requested data, thereby further improving the processing logic perfection degree when processing the data access request.
Embodiments of the present invention also provide a computer program product comprising instructions which, when run on a computer, cause the computer to perform the steps of:
receiving an access request to be processed, wherein the access request is used for accessing data in a virtual tape system;
matching the priority and the workload type of the access request to be processed according to the preset corresponding relation between the metadata and the priority and the workload type by using the metadata corresponding to the access request to be processed, wherein the priority represents the priority of accessing the virtual tape system, the workload type represents the processing type when the access request to be processed is processed and an operation object for the processing type, and the operation object is a VTL or a physical tape library;
and processing the access request to be processed according to the matched priority and the workload type of the access request to be processed.
In the computer program product including instructions provided in the embodiments of the present invention, after receiving a pending access request, a VTL may match the priority and the workload type of the pending access request according to the preset correspondence between the metadata and the priority and the workload type, using the metadata corresponding to the pending access request, so as to process the pending access request according to the matched priority and workload type of the pending access request, instead of immediately reading data from a physical tape volume as long as the VTL does not cache the requested data, thereby further improving the processing logic perfection degree when processing the data access request.
Embodiments of the present invention further provide a computer program, which when running on a computer, causes the computer to execute the following steps:
receiving an access request to be processed, wherein the access request is used for accessing data in a virtual tape system;
matching the priority and the workload type of the access request to be processed according to the preset corresponding relation between the metadata and the priority and the workload type by using the metadata corresponding to the access request to be processed, wherein the priority represents the priority of accessing the virtual tape system, the workload type represents the processing type when the access request to be processed is processed and an operation object for the processing type, and the operation object is a VTL or a physical tape library;
and processing the access request to be processed according to the matched priority and the workload type of the access request to be processed.
In the computer program including instructions provided in the embodiments of the present invention, after receiving a pending access request, a VTL may match the priority and the workload type of the pending access request according to the preset correspondence between the metadata and the priority and the workload type, using the metadata corresponding to the pending access request, so as to process the pending access request according to the matched priority and workload type of the pending access request, instead of immediately reading data from a physical tape volume as long as the VTL does not cache the requested data, thereby further improving the processing logic perfection degree when processing the data access request.
For the apparatus/electronic device/storage medium embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to part of the description of the method embodiment.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (20)
1. An access request processing method applied to a Virtual Tape Library (VTL) of a virtual tape system, the virtual tape system further comprising a physical tape library, the VTL and the physical tape library having data interaction capability therebetween, the method comprising:
receiving a pending access request, wherein the access request is used for accessing data in the virtual tape system;
matching the priority and the workload type of the access request to be processed according to the preset corresponding relation between the metadata and the priority and the workload type by using the metadata corresponding to the access request to be processed, wherein the priority represents the priority of accessing the virtual tape system, the workload type represents the processing type when the access request to be processed is processed and an operation object for the processing type, and the operation object is the VTL or the physical tape library;
and processing the access request to be processed according to the matched priority and the workload type of the access request to be processed.
2. The method according to claim 1, wherein the step of matching the priority and the workload type of the pending access request according to the preset corresponding relationship between the metadata and the priority and the workload type by using the metadata corresponding to the pending access request comprises:
matching the rules of the access requests to be processed according to the corresponding relation between the metadata recorded in a preset rule list and the priority and the workload type by using the metadata corresponding to the access requests to be processed, wherein the rules comprise: the pending access request priority and the workload type.
3. The method of claim 1, wherein the workload types comprise:
an immediate access type indicating immediate access to the physical tape library, a deferred access type indicating deferred access to the physical tape library, a normal read type indicating reading data only from the VTL, and a normal write type indicating writing data only to the VTL.
4. The method of claim 3, wherein the step of processing the pending access request according to the matched priority and workload type of the pending access request comprises:
when the priority of the access request to be processed is the highest among all the access requests to be processed and the workload type is the common reading type, judging whether target data is cached in the VTL or not, wherein the target data is the data requested by the access request to be processed, the workload type of which is the common reading type;
if the target data are cached, reading the target data from the VTL;
if the target data is not cached, creating a blank logical volume in the VTL;
caching target data in a physical tape volume of the physical tape library to the blank logical volume;
when the priority of the access request to be processed is the highest in all the access requests to be processed and the workload type of the task to be processed is the common write-in type, caching data to be written into the VTL, wherein the data to be written is the data requested by the access request to be processed, the workload type of which is the common write-in type;
and when a preset condition is met, storing the data to be written cached by the VTL to the physical tape library.
5. The method of claim 3, wherein when the workload type of the pending access request is the normal write type, the method further comprises:
detecting whether data which is repeated with the data to be written exists in the VTL;
if so, stopping executing the normal write type of pending access request.
6. The method of claim 1, wherein when the currently pending access request matches a plurality of rules of the same priority, the method further comprises:
determining an access time period recorded in each rule, wherein the access time period represents a time period for accessing data in the virtual tape system;
and determining the rule corresponding to the longest access time period as the rule of the current request to be processed.
7. The method according to claim 1, wherein before the matching the priority and the workload type of the pending access request according to the preset corresponding relationship between the metadata and the priority and the workload type by using the metadata corresponding to the pending access request, the method further comprises:
acquiring log information of each access request to be processed;
extracting metadata related to each access request to be processed from the log information, wherein the metadata comprises: the address of the device sending the access request, the name of the application sending the access request, the processing time period of the task to be processed, the tape medium type identifier and the tape serial number identifier.
8. The method of claim 1, wherein at least one hot-spare disk is disposed in the VTL, the method further comprising:
and performing hot backup on the data of each disk in the VTL by using the hot backup disk to obtain backup data, wherein the backup data is the data stored in each disk in the VTL within a preset time period.
9. The method of claim 8, wherein when a disk in the VTL fails, the method further comprises:
and importing the backup data which is stored in the hot backup disk and corresponds to the fault disk into a replaced disk.
10. An access request processing apparatus applied to a virtual tape library VTL of a virtual tape system, the virtual tape system further comprising a physical tape library, the VTL and the physical tape library having data interaction capability therebetween, the apparatus comprising:
a receiving module, configured to receive an access request to be processed, where the access request is used to access data in the virtual tape system;
the matching module is used for matching the priority and the workload type of the access request to be processed according to the preset corresponding relation between the metadata and the priority and the workload type by using the metadata corresponding to the access request to be processed, wherein the priority represents the priority of accessing the virtual tape system, the workload type represents the processing type when the access request to be processed is processed and an operation object for the processing type, and the operation object is the VTL or the physical tape library;
and the processing module is used for processing the access request to be processed according to the matched priority and the workload type of the access request to be processed.
11. The apparatus of claim 10, wherein the matching module is specifically configured to:
matching the rules of the access requests to be processed according to the corresponding relation between the metadata recorded in a preset rule list and the priority and the workload type by using the metadata corresponding to the access requests to be processed, wherein the rules comprise: the pending access request priority and the workload type.
12. The apparatus of claim 10, wherein the workload types comprise:
an immediate access type indicating immediate access to the physical tape library, a deferred access type indicating deferred access to the physical tape library, a normal read type indicating reading data only from the VTL, and a normal write type indicating writing data only to the VTL.
13. The apparatus of claim 12, wherein the processing module comprises:
the judging submodule is used for judging whether target data is cached in the VTL or not when the priority of the access request to be processed is the highest in all the access requests to be processed and the workload type is the common reading type, wherein the target data is the data requested by the access request to be processed, the workload type of which is the common reading type;
the reading sub-module is used for reading the target data from the VTL if the target data is cached;
a creating submodule, configured to create a blank logical volume in the VTL if the target data is not cached;
a first cache submodule, configured to cache target data in a physical tape volume of the physical tape library to the blank logical volume;
the second cache submodule is used for caching data to be written into the VTL when the priority of the access request to be processed is the highest in all the access requests to be processed and the workload type of the task to be processed is the common write-in type, wherein the data to be written is the data requested by the access request to be processed, the workload type of which is the common write-in type;
and the storage submodule is used for storing the data to be written cached by the VTL to the physical tape library when a preset condition is met.
14. The apparatus of claim 12, further comprising:
a detection module, configured to detect whether data that is duplicated with data to be written exists in the VTL when the workload type of the access request to be processed is the common write type;
a stop module for stopping execution of the pending access request of the generic write type if present.
15. The apparatus of claim 10, further comprising:
the first determining module is used for determining the access time periods recorded in the rules when the current access requests to be processed are matched with the rules with the same priority, wherein the access time periods represent the time periods for accessing the data in the virtual tape system;
and the second determining module is used for determining the rule corresponding to the longest access time period as the rule of the current request to be processed.
16. The apparatus of claim 10, further comprising:
the acquisition module is used for acquiring the log information of each access request to be processed;
an extracting module, configured to extract metadata related to each pending access request from the log information, where the metadata includes: the address of the device sending the access request, the name of the application sending the access request, the processing time period of the task to be processed, the tape medium type identifier and the tape serial number identifier.
17. The apparatus of claim 10, wherein the VTL has at least one hot spare disk disposed therein, the apparatus further comprising:
and the hot backup module is used for carrying out hot backup on the data of each disk in the VTL by utilizing the hot backup disk to obtain backup data, and the backup data is the data stored in each disk in the VTL within a preset time period.
18. The apparatus of claim 17, further comprising:
and the replacing module is used for importing backup data which are stored in the hot backup disk and correspond to the fault disk into a replaced disk when the disk in the VTL fails.
19. An electronic device comprising a processor and a machine-readable storage medium storing machine-executable instructions executable by the processor to perform method steps of the access request processing method of any one of claims 1 to 9.
20. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of the access request processing method according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911257905.6A CN111026333A (en) | 2019-12-10 | 2019-12-10 | Access request processing method, processing device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911257905.6A CN111026333A (en) | 2019-12-10 | 2019-12-10 | Access request processing method, processing device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111026333A true CN111026333A (en) | 2020-04-17 |
Family
ID=70205282
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911257905.6A Pending CN111026333A (en) | 2019-12-10 | 2019-12-10 | Access request processing method, processing device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111026333A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111913665A (en) * | 2020-07-30 | 2020-11-10 | 星辰天合（北京）数据科技有限公司 | Mounting method and device of storage volume and electronic equipment |
| CN113342758A (en) * | 2021-08-06 | 2021-09-03 | 联想凌拓科技有限公司 | Metadata management method, device, equipment and medium of file system |
| CN114442934A (en) * | 2021-12-27 | 2022-05-06 | 天翼云科技有限公司 | Data processing method and device and storage engine |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101122843A (en) * | 2006-08-09 | 2008-02-13 | 国际商业机器公司 | Method and system for writing and reading application data |
| CN102467408A (en) * | 2010-11-12 | 2012-05-23 | 阿里巴巴集团控股有限公司 | Method and device for accessing data of virtual machine |
| CN103049224A (en) * | 2012-12-28 | 2013-04-17 | 华为技术有限公司 | Method, device and system for importing data into physical tape |
| CN106843773A (en) * | 2017-02-16 | 2017-06-13 | 天津书生云科技有限公司 | Storage method and distributed storage system |
| CN107832097A (en) * | 2017-09-29 | 2018-03-23 | 华为技术有限公司 | Data load method and device |
| CN108701048A (en) * | 2017-09-29 | 2018-10-23 | 华为技术有限公司 | Data load method and device |
| CN109032507A (en) * | 2018-06-28 | 2018-12-18 | 郑州云海信息技术有限公司 | A kind of method, system and associated component generating source book storage snapshot |
| CN109725832A (en) * | 2017-10-30 | 2019-05-07 | 南京唯实科技有限公司 | A kind of data filtering storage device |
| CN109725839A (en) * | 2017-10-30 | 2019-05-07 | 南京唯实科技有限公司 | A kind of date storage method of data filtering storage device |
| CN110008142A (en) * | 2019-04-16 | 2019-07-12 | 苏州浪潮智能科技有限公司 | Storing data management method, device, equipment and computer readable storage medium |
| CN110275841A (en) * | 2019-06-20 | 2019-09-24 | 上海燧原智能科技有限公司 | Access request processing method, device, computer equipment and storage medium |
-
2019
- 2019-12-10 CN CN201911257905.6A patent/CN111026333A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101122843A (en) * | 2006-08-09 | 2008-02-13 | 国际商业机器公司 | Method and system for writing and reading application data |
| CN102467408A (en) * | 2010-11-12 | 2012-05-23 | 阿里巴巴集团控股有限公司 | Method and device for accessing data of virtual machine |
| CN103049224A (en) * | 2012-12-28 | 2013-04-17 | 华为技术有限公司 | Method, device and system for importing data into physical tape |
| CN106843773A (en) * | 2017-02-16 | 2017-06-13 | 天津书生云科技有限公司 | Storage method and distributed storage system |
| CN107832097A (en) * | 2017-09-29 | 2018-03-23 | 华为技术有限公司 | Data load method and device |
| CN108701048A (en) * | 2017-09-29 | 2018-10-23 | 华为技术有限公司 | Data load method and device |
| CN109725832A (en) * | 2017-10-30 | 2019-05-07 | 南京唯实科技有限公司 | A kind of data filtering storage device |
| CN109725839A (en) * | 2017-10-30 | 2019-05-07 | 南京唯实科技有限公司 | A kind of date storage method of data filtering storage device |
| CN109032507A (en) * | 2018-06-28 | 2018-12-18 | 郑州云海信息技术有限公司 | A kind of method, system and associated component generating source book storage snapshot |
| CN110008142A (en) * | 2019-04-16 | 2019-07-12 | 苏州浪潮智能科技有限公司 | Storing data management method, device, equipment and computer readable storage medium |
| CN110275841A (en) * | 2019-06-20 | 2019-09-24 | 上海燧原智能科技有限公司 | Access request processing method, device, computer equipment and storage medium |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111913665A (en) * | 2020-07-30 | 2020-11-10 | 星辰天合（北京）数据科技有限公司 | Mounting method and device of storage volume and electronic equipment |
| CN111913665B (en) * | 2020-07-30 | 2023-11-24 | 北京星辰天合科技股份有限公司 | Storage volume mounting method and device and electronic equipment |
| CN113342758A (en) * | 2021-08-06 | 2021-09-03 | 联想凌拓科技有限公司 | Metadata management method, device, equipment and medium of file system |
| CN113342758B (en) * | 2021-08-06 | 2021-11-19 | 联想凌拓科技有限公司 | Metadata management method, device, equipment and medium of file system |
| CN114442934A (en) * | 2021-12-27 | 2022-05-06 | 天翼云科技有限公司 | Data processing method and device and storage engine |
| CN114442934B (en) * | 2021-12-27 | 2024-01-02 | 天翼云科技有限公司 | Data processing method, device and storage engine |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9009428B2 (en) | Data store page recovery | |
| US8959301B2 (en) | Accessing data in a storage system | |
| CN111026333A (en) | Access request processing method, processing device, electronic equipment and storage medium | |
| US9767015B1 (en) | Enhanced operating system integrity using non-volatile system memory | |
| US9021087B1 (en) | Method to improve caching accuracy by using snapshot technology | |
| JP6805816B2 (en) | Information processing equipment, information processing system, information processing method and program | |
| US9519545B2 (en) | Storage drive remediation in a raid system | |
| US10581668B2 (en) | Identifying performance-degrading hardware components in computer storage systems | |
| US11030060B2 (en) | Data validation during data recovery in a log-structured array storage system | |
| US10783021B2 (en) | Transaction management for multi-node clusters | |
| US9460014B2 (en) | Sharing local cache from a failover node | |
| US10445193B2 (en) | Database failure recovery in an information handling system | |
| US10089220B1 (en) | Saving state information resulting from non-idempotent operations in non-volatile system memory | |
| US9009430B2 (en) | Restoration of data from a backup storage volume | |
| US8255642B2 (en) | Automatic detection of stress condition | |
| CN108197041B (en) | Method, device and storage medium for determining parent process of child process | |
| EP3264254B1 (en) | System and method for a simulation of a block storage system on an object storage system | |
| US7921324B2 (en) | Providing file system availability during local path failure of a non-server node | |
| US20220374310A1 (en) | Write request completion notification in response to partial hardening of write data | |
| US7949632B2 (en) | Database-rearranging program, database-rearranging method, and database-rearranging apparatus | |
| US11340964B2 (en) | Systems and methods for efficient management of advanced functions in software defined storage systems | |
| KR102403063B1 (en) | Mobile device and management method of mobile device | |
| CN115016740B (en) | Data recovery method and device, electronic equipment and storage medium | |
| US11720551B1 (en) | Method and system for streaming data from portable storage devices | |
| US20230185822A1 (en) | Distributed storage system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |