CN111090500B

CN111090500B - Storage process management method and device

Info

Publication number: CN111090500B
Application number: CN202010205110.7A
Authority: CN
Inventors: 杨贻宏
Original assignee: Shanghai Feiqi Network Technology Co Ltd
Current assignee: Shanghai Feiqi Network Technology Co Ltd
Priority date: 2020-03-23
Filing date: 2020-03-23
Publication date: 2020-06-12
Anticipated expiration: 2040-03-23
Also published as: CN111090500A

Abstract

The embodiment of the application provides a storage process management method and device, wherein after memory fragment features and cache mapping features are extracted from storage process data, a target storage process running node of a current distributed storage node is determined, a virtual process domain of a virtual memory page of a storage process type corresponding to the target storage process running node and a corresponding virtual process interface are determined, and storage process state information is updated in the virtual process domain after virtual process access is performed on a storage process address corresponding to current storage process state information in the virtual process domain according to the virtual process interface. Therefore, the state management of the storage process is carried out by combining the memory fragment characteristic and the cache mapping characteristic, so that the subsequent targeted optimization of the storage performance can be facilitated, the probability of the abnormal occurrence of the storage process is reduced, and the normal operation of the storage service is further ensured.

Description

Storage process management method and device

Technical Field

The present application relates to the field of operating system storage technologies, and in particular, to a storage process management method and apparatus.

Background

With the continuous upgrade of the distributed storage device, the performance and capacity of the distributed storage device are continuously improved, and in order to reduce the waste of storage resources, it is often necessary to manage the storage process state information of the distributed storage device in the process of executing the storage task. In the process of managing the state information of the storage process, the conventional scheme usually updates only the state information of the storage process when the storage of the actual data file is completed, but actually, in the running process of the whole storage process, a lot of memory fragments and cache information may be generated, and this part of information is usually not distributed in the distributed storage nodes in the form of a specific actual data file.

Disclosure of Invention

In view of this, an object of the present application is to provide a method and an apparatus for managing a storage process, which can perform state management on the storage process by combining a memory fragmentation feature and a cache mapping feature, so as to facilitate subsequent targeted optimization of storage performance, reduce the probability of occurrence of an exception in the storage process, and further ensure normal operation of a storage service.

According to a first aspect of the present application, there is provided a storage process management method applied to a server communicatively connected to a distributed storage device, the method including:

acquiring a current distributed storage node associated with a currently executed target storage process in the distributed storage equipment, and acquiring storage process data of the current distributed storage node;

when the current distributed storage node performs storage control by adopting a storage control script corresponding to a target storage process, extracting target storage process characteristics from the storage process data, wherein the target storage process characteristics comprise first storage process characteristics and second storage process characteristics, the first storage process characteristics are memory fragment characteristics which are included in the storage control script and identified by a storage controller corresponding to the target storage process, the second storage process characteristics are cache mapping characteristics identified by the storage controller, and different storage controllers are used for identifying different preset storage process services;

determining a target storage process running node of the current distributed storage node according to the target storage process characteristics, and determining a virtual process domain of a virtual memory page of a storage process type corresponding to the target storage process running node and a corresponding virtual process interface;

and according to the virtual process interface, after virtual process access is carried out on a storage process address corresponding to the current storage process state information in the virtual process domain, the storage process state information is updated in the virtual process domain.

In a possible implementation manner of the first aspect, the step of extracting the target storage process feature from the storage process data includes:

respectively acquiring process interaction data and stored process characteristic information between process nodes of corresponding stored process services from the stored process data through the storage controller;

respectively determining calling intervals among all process nodes of the stored process service according to the acquired process interaction data among all process nodes of the stored process service;

dividing each process node of the storage process service into a memory fragment sequence and a cache mapping sequence according to the storage process characteristic information;

determining respective storage process characteristic information of the memory fragment sequence and the cache mapping sequence according to the storage process characteristic information and a calling interval between each process node of the storage process service;

and determining the characteristics of the target storage process according to the respective storage process characteristic information of the memory fragment sequence and the cache mapping sequence.

In a possible implementation manner of the first aspect, the step of respectively determining, according to the acquired process interaction data between the process nodes storing the process service, a call interval between the process nodes storing the process service includes:

for any two process nodes, determining the memory interaction size between the two process nodes according to the process interaction data between the two process nodes;

respectively determining the ratio of the memory interaction size between the two process nodes to the memory interaction size between the process nodes and other process nodes storing the process services according to the memory interaction size between the two process nodes;

and determining a calling interval between the two process nodes according to the ratio of the memory interaction size between the two process nodes to the memory interaction size between the two process nodes and the process nodes storing the process services.

In a possible implementation manner of the first aspect, the storage process characteristic information includes addressing tag information of at least two addressing types;

determining the respective storage process characteristic information of the memory fragment sequence and the cache mapping sequence according to the storage process characteristic information and the call interval between the process nodes of the storage process service, wherein the step comprises the following steps:

establishing an addressing interval set between process nodes for storing the process service according to the calling intervals between the process nodes for storing the process service;

determining the addressing frequency of each memory fragment sequence and the cache mapping sequence corresponding to the addressing label information of each addressing type according to the storage process characteristic information and the addressing label information of at least two addressing types included in the storage process characteristic information;

establishing a first addressing script of a process node for storing process services corresponding to the addressing label information of each addressing type according to the addressing frequency of the addressing label information of each addressing type corresponding to each memory fragment sequence and the addressing frequency of the addressing label information of each addressing type corresponding to each cache mapping sequence;

utilizing the addressing interval set to circulate the addressing interval set and the addressing calculation result of the first addressing script to obtain a second addressing script for storing addressing label information of each addressing type corresponding to each process node of the process service until the circulation times reach preset times or the change value of each addressing frequency in the second addressing script is lower than a set change value; before each cycle starts, restoring the addressing frequency corresponding to the memory fragment sequence contained in the addressing calculation result obtained by the previous cycle to the addressing frequency corresponding to the memory fragment sequence contained in the first addressing script, and selecting the addressing label information of the addressing type with the largest addressing frequency as the addressing label information corresponding to the memory fragment sequence;

for each cache mapping sequence, according to the addressing frequency of the cache mapping sequence corresponding to the addressing label information of each addressing type in the second addressing script, selecting the addressing label information of the addressing type with the largest addressing frequency as the addressing label information corresponding to the cache mapping sequence;

and obtaining corresponding storage process characteristic information according to the respective corresponding addressing label information of the memory fragment sequence and the cache mapping sequence.

In a possible implementation manner of the first aspect, the step of determining, according to the target storage process characteristic, a target storage process running node of the current distributed storage node includes:

determining a first initial storage process running node and a second initial storage process running node which respectively correspond to the current distributed storage node according to the first storage process characteristic and the second storage process characteristic;

determining a coincident operation node between the first initial storage process operation node and the second initial storage process operation node, acquiring a storage process characteristic of the coincident operation node, and dividing the storage process characteristic into process characteristic segments;

respectively converting the process feature fragments into a memory fragment feature sequence and a cache mapping feature sequence, respectively extracting a first feature from each memory fragment feature of the memory fragment feature sequence, and extracting a second feature from each cache mapping feature of the cache mapping feature sequence;

and fusing the first characteristic and the second characteristic to obtain a fusion characteristic, and determining a target storage process running node of the current distributed storage node according to the fusion characteristic.

In a possible implementation manner of the first aspect, the step of determining a virtual process domain and a corresponding virtual process interface of a virtual memory page of a storage process category corresponding to the target storage process running node includes:

determining a virtual access address of a virtual memory page of a storage process type corresponding to the target storage process operation node, so as to determine a corresponding virtual process domain according to the virtual access address;

obtaining feature information of storage process features of the storage process type, and obtaining memory lock mechanism information of a plurality of virtual memory pages in the storage process type, where the memory lock mechanism information includes one or a combination of multiple kinds of read-write lock mechanism information, thread lock mechanism information, and RCU lock mechanism information;

performing matching degree calculation on the memory lock mechanism information and the feature information of each virtual process interface configured in advance to obtain a plurality of first matching degree calculation results for each virtual process interface, where the feature information of each virtual process interface is: determining the feature information of the preset memory fragment feature and the cache mapping feature corresponding to the virtual process interface in the configuration process;

determining a virtual process interface corresponding to the target storage process operation node according to the plurality of first matching degree calculation results;

wherein, each virtual process interface is configured and obtained by adopting the following mode:

acquiring each process access function of preset virtual process characteristics corresponding to each virtual process instruction in a preset configuration set to form a process access function set;

selecting one process access function in the process access function set one by one to be respectively used as a current process access function, creating a virtual process interface according to the process access function, calculating a calling interval between the current process access function and the interface function of the virtual process interface, and obtaining a plurality of second calling interval values to be used as second matching degree results;

judging whether each second calling interval value is smaller than a preset threshold value, if so, determining that a second matching degree result meets a preset matching degree condition, and if not, determining that the second matching degree result does not meet the preset matching degree condition;

taking a corresponding virtual process interface in a second matching degree calculation result when a preset matching degree condition is met as a virtual process interface to which the current process access function belongs, and adding the current process access function into the virtual process interface to which the current process access function belongs;

and if no second matching degree calculation result meets the preset matching degree condition, creating a virtual process interface, recording the interface function of the virtual process interface as the current process access function, recalculating the interface function of the virtual process interface, and taking the interface function of each virtual process interface as the characteristic information of the preset virtual process characteristic corresponding to each virtual process interface after merging the process access functions in the process access function set.

In a possible implementation manner of the first aspect, after performing virtual process access on a storage process address corresponding to current storage process state information in the virtual process domain according to the virtual process interface, the step of updating the storage process state information in the virtual process domain includes:

acquiring a plurality of virtual process sub-interfaces according to the virtual process interface, and acquiring access matching information of each virtual process sub-interface in the plurality of virtual process sub-interfaces;

acquiring protection sequence control information of each virtual process sub-interface according to the access matching information of each virtual process sub-interface and access parameters pre-configured for each virtual process sub-interface, wherein the protection sequence control information comprises access parameters and corresponding interface parameters of each virtual process sub-interface;

and according to the protection processing label of each virtual process subinterface and the access parameter of each virtual process subinterface, performing virtual process access processing on the access domain of the storage process address corresponding to the current storage process state information in the virtual process domain, and then updating the storage process state information in the virtual process domain.

According to a second aspect of the present application, there is provided a storage process management apparatus applied to a server communicatively connected to a distributed storage device, the apparatus including:

the acquisition module is used for acquiring a current distributed storage node associated with a currently executed target storage process in the distributed storage equipment and acquiring storage process data of the current distributed storage node;

an extraction module, configured to extract, when it is determined that the current distributed storage node performs storage control using a storage control script corresponding to a target storage process, target storage process features from the storage process data, where the target storage process features include a first storage process feature and a second storage process feature, the first storage process feature is a memory fragment feature included in the storage control script and identified by a storage controller corresponding to the target storage process, the second storage process feature is a cache mapping feature identified by the storage controller, and different storage controllers are used to identify different preset storage process services;

a determining module, configured to determine, according to the target storage process characteristic, a target storage process operation node of the current distributed storage node, and determine a virtual process domain and a corresponding virtual process interface of a virtual memory page of a storage process category corresponding to the target storage process operation node;

and the state updating module is used for updating the state information of the storage process in the virtual process domain after virtual process access is carried out on the storage process address corresponding to the state information of the current storage process in the virtual process domain according to the virtual process interface.

Based on any aspect, after the memory fragment features and the cache mapping features are extracted from the storage process data, the target storage process running node of the current distributed storage node is determined, the virtual process domain of the virtual memory page of the storage process category corresponding to the target storage process running node and the corresponding virtual process interface are determined, and the storage process state information is updated in the virtual process domain after the virtual process access is performed on the storage process address corresponding to the current storage process state information in the virtual process domain according to the virtual process interface. Therefore, the state management of the storage process is carried out by combining the memory fragment characteristic and the cache mapping characteristic, so that the subsequent targeted optimization of the storage performance can be facilitated, the probability of the abnormal occurrence of the storage process is reduced, and the normal operation of the storage service is further ensured.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.

Fig. 1 is a schematic diagram illustrating an application scenario of a distributed storage system provided in an embodiment of the present application;

FIG. 2 is a flowchart illustrating a storage process management method according to an embodiment of the present application;

FIG. 3 shows a flow diagram of the substeps of step S120 shown in FIG. 2;

FIG. 4 shows one of the sub-step flow diagrams of step S130 shown in FIG. 2;

FIG. 5 shows a second schematic flow chart of the sub-steps of step S130 shown in FIG. 2;

FIG. 6 shows a flow diagram of the sub-steps of step S140 shown in FIG. 2;

FIG. 7 is a functional block diagram of a storage process management apparatus according to an embodiment of the present application;

fig. 8 is a schematic component structural diagram of a server for executing the storage process management method according to an embodiment of the present application.

Detailed Description

In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it should be understood that the drawings in the present application are for illustrative and descriptive purposes only and are not used to limit the scope of protection of the present application. Additionally, it should be understood that the schematic drawings are not necessarily drawn to scale. The flowcharts used in this application illustrate operations implemented according to some of the embodiments of the present application. It should be understood that the operations of the flow diagrams may be performed out of order, and steps without logical context may be performed in reverse order or simultaneously. One skilled in the art, under the guidance of this application, may add one or more other operations to, or remove one or more operations from, the flowchart.

In addition, the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.

Fig. 1 is a schematic diagram illustrating an application scenario of a storage process management system 10 according to an embodiment of the present application. In this embodiment, the storage process management system 10 may include a server 100 and a distributed storage device 200 communicatively coupled to the server 100. A plurality of distributed storage nodes may be included in the distributed storage appliance 200, each for distributed storage of a corresponding file fragment.

In other possible embodiments, the storage process management system 10 may include only some of the components shown in FIG. 1 or may include other components.

In some embodiments, the server 100 may be a single server or a group of servers. The set of servers may be centralized or distributed (e.g., server 100 may be a distributed system). In some embodiments, the server 100 may be local or remote to the distributed storage appliance 200. For example, the server 100 may access information stored in the distributed storage appliance 200 and a database, or any combination thereof, via a network. As another example, the server 100 may be directly connected to at least one of the distributed storage appliance 200 and a database to access information and/or data stored therein. In some embodiments, the server 100 may be implemented on a cloud platform; by way of example only, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud (community cloud), a distributed cloud, an inter-cloud, a multi-cloud, and the like, or any combination thereof.

In some embodiments, the server 100 may include a processor. The processor may process information and/or data related to the service request to perform one or more of the functions described herein. A processor may include one or more processing cores (e.g., a single-core processor (S) or a multi-core processor (S)).

The aforementioned database may store data and/or instructions. In some embodiments, a database may store data assigned to the distributed storage appliance 200. In some embodiments, the database may store data and/or instructions for the exemplary methods described herein. In some embodiments, the database may include mass storage, removable storage, volatile read-write memory, read-only memory, or the like, or any combination thereof.

In some embodiments, the database may be connected to a network to communicate with one or more components in the storage process management system 10 (e.g., server 100, distributed storage appliance 200, etc.). One or more components in the storage process management system 10 may access data or instructions stored in a database via a network. In some embodiments, the database may be directly connected to one or more components of the storage process management system 10 (e.g., the server 100, the distributed storage appliance 200, etc.; or, in some embodiments, the database may be part of the server 100.

Fig. 2 is a flowchart illustrating a storage process management method according to an embodiment of the present application, where the storage process management method may be executed by the server 100 shown in fig. 1. It should be understood that, in other embodiments, the order of some steps in the storage process management method of this embodiment may be interchanged according to actual needs, or some steps may be omitted or deleted. The detailed steps of the storage process management method are described as follows.

Step S110 is to obtain a current distributed storage node associated with a currently executed target storage process in the distributed storage apparatus 200, and obtain storage process data of the current distributed storage node.

And step S120, when the current distributed storage node adopts the storage control script corresponding to the target storage process to perform storage control, extracting the target storage process characteristics from the storage process data.

Step S130, determining a target storage process running node of the current distributed storage node according to the target storage process characteristics, and determining a virtual process domain of a virtual memory page of a storage process category corresponding to the target storage process running node and a corresponding virtual process interface.

Step S140, according to the virtual process interface, after the virtual process access is performed to the storage process address corresponding to the current storage process state information in the virtual process domain, the storage process state information is updated in the virtual process domain.

In this embodiment, the target storage process characteristic may include a first storage process characteristic and a second storage process characteristic, the first storage process characteristic is a memory fragment characteristic that is included in the storage control script and identified by a storage controller corresponding to the target storage process, the second storage process characteristic is a cache mapping characteristic that is identified by the storage controller, and different storage controllers may be used to identify different preset storage process services.

For example, memory fragmentation is a small partition of main memory that is not available for user work that is generated during the memory allocation process using a partitioned memory management system. In some possible examples, memory fragments may be divided into inner fragments and outer fragments. An internal shard may be a memory space that has been allocated (to specify which target storage process it belongs to) but cannot be utilized, an internal shard being a block of storage that is within a region or within a page. The process that owns these regions or pages does not use this memory block. And the system cannot utilize this block of memory when the process occupies it. The system may not make use of this memory block until the process releases it, or the process ends. An external fragment may be a free area of memory that has not been allocated (not belonging to any storage process), but cannot be allocated to a new process that applies for memory space because the fragment is too small. An external shard is a free block of memory that is outside of any allocated region or page. The sum of these memory blocks may satisfy the length requirements of the current application, but the system may not satisfy the current memory allocation application due to its address discontinuity or other reasons. In addition, the cache map may be a map from a cache information to a block of memory, and a region of an address space may be reserved by the memory map file.

Based on the above steps, in this embodiment, after the memory fragment feature and the cache mapping feature are extracted from the storage process data, the target storage process running node of the current distributed storage node is determined, the virtual process domain of the virtual memory page of the storage process category corresponding to the target storage process running node and the corresponding virtual process interface are determined, and the storage process state information is updated in the virtual process domain after the virtual process access is performed on the storage process address corresponding to the current storage process state information in the virtual process domain according to the virtual process interface. Therefore, the state management of the storage process is carried out by combining the memory fragment characteristic and the cache mapping characteristic, so that the subsequent targeted optimization of the storage performance can be facilitated, the probability of the abnormal occurrence of the storage process is reduced, and the normal operation of the storage service is further ensured.

In one possible implementation, please refer to fig. 3, regarding step S120, it can be further realized through the following sub-steps S121-S125, which are described in detail below.

And a substep S121, respectively acquiring process interaction data and stored process characteristic information between process nodes of the corresponding stored process service from the stored process data through the storage controller.

In this embodiment, the process interaction data may refer to an interaction record generated by each process node in a data interaction process, for example, a call record, a data sending record, a data generation record, and the like of a stored process. The storage process characteristic information may refer to characteristic information of a calling behavior of the storage process in a called process.

And a substep S122, respectively determining calling intervals among the process nodes storing the process service according to the acquired process interaction data among the process nodes storing the process service.

For example, for any two process nodes, the memory interaction size between the two process nodes is determined according to the process interaction data between the two process nodes, then the ratio of the memory interaction size between the two process nodes to the memory interaction size between the process nodes and the process nodes storing other process services is respectively determined according to the memory interaction size between the two process nodes, and the calling interval between the two process nodes is determined according to the ratio of the memory interaction size between the two process nodes to the memory interaction size between the process nodes storing other process services.

For example, assuming that the ratio of the memory interaction size between the two process nodes to the memory interaction size between each process node and other process nodes storing the process traffic is 0.5, the call interval between the two process nodes may be: 1/0.5=2, i.e. [0, 2 ].

And a substep S123 of dividing each process node storing the process service into a memory fragment sequence and a cache mapping sequence according to the stored process characteristic information.

And a substep S124, determining the storage process characteristic information of the memory fragment sequence and the cache mapping sequence according to the storage process characteristic information and the call interval between the process nodes storing the process service.

For example, the storage process characteristic information may include addressing tag information of at least two addressing types. Therefore, an addressing interval set between the process nodes for storing the process service can be established according to the calling intervals between the process nodes for storing the process service, and the addressing frequency of each memory fragment sequence and the cache mapping sequence corresponding to the addressing label information of each addressing type is determined according to the storage process characteristic information and the addressing label information of at least two addressing types included in the storage process characteristic information.

On this basis, the embodiment may establish the first addressing script, in which the process node storing the process service corresponds to the addressing tag information of each addressing type, according to the addressing frequency of each memory fragment sequence corresponding to the addressing tag information of each addressing type and the addressing frequency of each cache mapping sequence corresponding to the addressing tag information of each addressing type. And then, by using the addressing interval set, circulating the addressing interval set and the addressing calculation result of the first addressing script to obtain a second addressing script of each process node for storing the process service, wherein the second addressing script corresponds to the addressing label information of each addressing type until the circulation times reach the preset times or the change value of each addressing frequency in the second addressing script is lower than the set change value. Before each cycle starts, for each memory fragment sequence, restoring the addressing frequency corresponding to the memory fragment sequence contained in the addressing calculation result obtained by the last cycle to be the addressing frequency corresponding to the memory fragment sequence contained in the first addressing script, and selecting the addressing label information of the addressing type with the largest addressing frequency as the addressing label information corresponding to the memory fragment sequence.

Then, for each cache mapping sequence, according to the addressing frequency of the cache mapping sequence corresponding to the addressing tag information of each addressing type in the second addressing script, the addressing tag information of the addressing type with the largest addressing frequency is selected as the addressing tag information corresponding to the cache mapping sequence, and corresponding storage process characteristic information is obtained according to the respective corresponding addressing tag information of the memory fragment sequence and the cache mapping sequence.

And a substep S125, determining the target storage process characteristic according to the respective storage process characteristic information of the memory fragment sequence and the cache mapping sequence.

Based on the above design, in the process of determining the target storage process characteristic, the memory fragment characteristic and the cache mapping characteristic are effectively combined, so that the subsequent targeted storage performance optimization can be facilitated, the probability of the storage process being abnormal is reduced, and the normal operation of the storage service is further ensured.

In one possible implementation, referring to step S130 in combination with fig. 4, the following sub-steps S131-S134 can be implemented, which are described in detail below.

And a substep S131, determining a first initial storage process running node and a second initial storage process running node respectively corresponding to the current distributed storage node according to the first storage process characteristic and the second storage process characteristic.

And a substep S132 of determining a coincident operation node between the first initial storage process operation node and the second initial storage process operation node, acquiring a storage process characteristic of the coincident operation node, and dividing the storage process characteristic into process characteristic segments.

In the substep S133, the process feature segments are respectively converted into a memory fragment feature sequence and a cache mapping feature sequence, and a first feature is respectively extracted from each memory fragment feature of the memory fragment feature sequence, and a second feature is extracted from each cache mapping feature of the cache mapping feature sequence.

And a substep S134, fusing the first characteristic and the second characteristic to obtain a fusion characteristic, and determining a target storage process running node of the current distributed storage node according to the fusion characteristic.

Based on the design, the target storage process running nodes of the current distributed storage nodes are determined by combining the fusion characteristics of the memory fragment characteristic sequences and the cache mapping characteristic sequences for balancing, and all the target storage process running nodes can be accurately and completely determined.

In one possible implementation, still referring to step S130, please refer to fig. 5, which can be implemented by the following sub-steps S135-S138, which are described in detail below.

In the sub-step S135, the virtual access address of the virtual memory page of the storage process category corresponding to the target storage process operation node is determined, so as to determine the corresponding virtual process domain according to the virtual access address.

In the substep S136, the feature information of the storage process features of the storage process category is obtained, and the memory lock mechanism information of the plurality of virtual memory pages in the storage process category is obtained.

As a possible example, the memory lock mechanism information includes one or more of read-write lock mechanism information, thread lock mechanism information, and RCU lock mechanism information.

Substep S137, performing matching degree calculation on the memory lock mechanism information and the feature information of each virtual process interface configured in advance, to obtain a plurality of first matching degree calculation results for each virtual process interface, where the feature information of each virtual process interface is: and determining the characteristic information of the preset memory fragment characteristic and the cache mapping characteristic corresponding to the virtual process interface in the configuration process.

And a substep S138, determining a virtual process interface corresponding to the target storage process operation node according to the plurality of first matching degree calculation results.

As a possible example, each virtual process interface may be configured as follows, which is described in detail below.

Firstly, acquiring each process access function of preset virtual process characteristics corresponding to each virtual process instruction in a preset configuration set to form a process access function set, then selecting one process access function in the process access function set one by one to be used as a current process access function respectively, creating a virtual process interface according to the process access function, calculating a calling interval between the current process access function and the interface function of the virtual process interface, and acquiring a plurality of second calling interval values to be used as a second matching degree result.

And then, judging whether each second calling interval value is smaller than a preset threshold value, if so, determining that the second matching degree result meets a preset matching degree condition, and if not, determining that the second matching degree result does not meet the preset matching degree condition, so that the corresponding virtual process interface in the second matching degree calculation result when the preset matching degree condition is met can be used as the virtual process interface to which the current process access function belongs, and the current process access function is added into the virtual process interface to which the current process access function belongs.

For another example, if no second matching degree calculation result satisfies the preset matching degree condition, a virtual process interface may be created, the interface function of the virtual process interface is recorded as the current process access function, after the interface functions of the virtual process interface are recalculated, and after the process access functions in the process access function set are merged, the interface function of each virtual process interface is used as the feature information of the preset virtual process feature corresponding to each virtual process interface.

In one possible implementation, referring to step S140 in combination with fig. 6, the following sub-steps S141-S143 can be implemented, which are described in detail below.

And a substep S141, obtaining a plurality of virtual process subinterfaces according to the virtual process interfaces, and obtaining access matching information of each virtual process subinterface in the plurality of virtual process subinterfaces.

And a substep S142, obtaining the protection sequence control information of each virtual process subinterface according to the access matching information of each virtual process subinterface and the access parameter pre-configured for each virtual process subinterface.

In this embodiment, the protection sequence control information may include an access parameter and an interface parameter of each corresponding virtual process sub-interface.

And a substep S143, performing virtual process access processing on the access domain of the storage process address corresponding to the current storage process state information in the virtual process domain according to the protection processing tag of each virtual process subinterface and the access parameter of each virtual process subinterface, and then updating the storage process state information in the virtual process domain.

Based on the design, the state management of the storage process is carried out by combining the memory fragment characteristic and the cache mapping characteristic, so that the subsequent targeted optimization of the storage performance can be facilitated, the probability of the abnormal occurrence of the storage process can be reduced, and the normal operation of the storage service can be further ensured.

Based on the same inventive concept, please refer to fig. 7, which shows a functional module diagram of the storage process management device 110 according to the embodiment of the present application, and the embodiment may divide the functional module of the storage process management device 110 according to the above method embodiment. For example, the functional blocks may be divided for the respective functions, or two or more functions may be integrated into one processing block. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation. For example, in the case of dividing each functional module by corresponding functions, the storage process management apparatus 110 shown in fig. 7 is only an apparatus diagram. The storage process management apparatus 110 may include an obtaining module 111, an extracting module 112, a determining module 113, and a status updating module 114, and the functions of the functional modules of the storage process management apparatus 110 are described in detail below.

The obtaining module 111 is configured to obtain a current distributed storage node associated with a currently executed target storage process in the distributed storage apparatus 200, and obtain storage process data of the current distributed storage node. It is understood that the obtaining module 111 can be used to execute the step S110, and for the detailed implementation of the obtaining module 111, reference can be made to the content related to the step S110.

The extracting module 112 is configured to, when it is determined that the current distributed storage node performs storage control by using a storage control script corresponding to a target storage process, extract target storage process features from the storage process data, where the target storage process features include a first storage process feature and a second storage process feature, the first storage process feature is a memory fragment feature that is included in the storage control script and identified by a storage controller corresponding to the target storage process, the second storage process feature is a cache mapping feature that is identified by the storage controller, and different storage controllers are used to identify different preset storage process services. It is understood that the extracting module 112 can be used to execute the step S120, and for the detailed implementation of the extracting module 112, reference can be made to the above-mentioned contents related to the step S120.

The determining module 113 is configured to determine, according to the target storage process characteristic, a target storage process running node of the current distributed storage node, and determine a virtual process domain of a virtual memory page of a storage process category corresponding to the target storage process running node and a corresponding virtual process interface. It is understood that the determining module 113 may be configured to perform the step S130, and for the detailed implementation of the determining module 113, reference may be made to the content related to the step S130.

And a state updating module 114, configured to perform virtual process access on a storage process address corresponding to the current storage process state information in the virtual process domain according to the virtual process interface, and update the storage process state information in the virtual process domain. It is understood that the status updating module 114 can be used to execute the step S140, and for the detailed implementation of the status updating module 114, reference can be made to the content related to the step S140.

In one possible implementation, the extraction module 112 may extract the target storage process features from the storage process data by:

respectively acquiring process interaction data and storage process characteristic information between process nodes of corresponding storage process services from the storage process data through a storage controller;

dividing each process node of the stored process service into a memory fragment sequence and a cache mapping sequence according to the stored process characteristic information;

determining respective storage process characteristic information of a memory fragment sequence and a cache mapping sequence according to the storage process characteristic information and the calling interval between each process node of the storage process service;

In one possible implementation, the extraction module 112 may determine the call intervals between the process nodes storing the process service respectively by:

In a possible implementation manner, the storage process characteristic information includes addressing tag information of at least two addressing types, and the extracting module 112 may determine the storage process characteristic information of each of the memory fragment sequence and the cache mapping sequence by:

utilizing the addressing interval set to circulate the addressing interval set and the addressing calculation result of the first addressing script to obtain a second addressing script of each process node for storing the process service, wherein the second addressing script corresponds to the addressing label information of each addressing type until the circulation times reach the preset times or the change value of each addressing frequency in the second addressing script is lower than the set change value; before each cycle starts, restoring the addressing frequency corresponding to the memory fragment sequence contained in the addressing calculation result obtained by the previous cycle to the addressing frequency corresponding to the memory fragment sequence contained in the first addressing script, and selecting the addressing label information of the addressing type with the largest addressing frequency as the addressing label information corresponding to the memory fragment sequence;

and obtaining corresponding storage process characteristic information according to the corresponding addressing label information of the memory fragment sequence and the cache mapping sequence.

In one possible implementation, the determining module 113 may determine the target storage process execution node of the current distributed storage node by:

determining a coincident operation node between a first initial storage process operation node and a second initial storage process operation node, acquiring a storage process characteristic of the coincident operation node, and dividing the storage process characteristic into process characteristic segments;

In a possible implementation manner, the determining module 113 may determine the virtual process domain of the virtual memory page of the storage process category corresponding to the target storage process running node and the corresponding virtual process interface by:

determining a virtual access address of a virtual memory page of a storage process type corresponding to a target storage process operation node, so as to determine a corresponding virtual process domain according to the virtual access address;

the method comprises the steps of obtaining characteristic information of storage process characteristics of a storage process type, and obtaining memory lock mechanism information of a plurality of virtual memory pages under the storage process type, wherein the memory lock mechanism information comprises one or a combination of a read-write lock mechanism information, a thread lock mechanism information and an RCU lock mechanism information;

matching degree calculation is carried out on the memory lock mechanism information and the feature information of each virtual process interface which is configured in advance, a plurality of first matching degree calculation results for each virtual process interface are obtained, and the feature information of each virtual process interface is as follows: determining the feature information of the preset memory fragment feature and the cache mapping feature corresponding to the virtual process interface in the configuration process;

each virtual process interface can be configured and obtained by adopting the following method:

judging whether each second calling interval value is smaller than a preset threshold value, if so, determining that the second matching degree result meets a preset matching degree condition, and if not, determining that the second matching degree result does not meet the preset matching degree condition;

taking a corresponding virtual process interface in the second matching degree calculation result when the preset matching degree condition is met as a virtual process interface to which the current process access function belongs, and adding the current process access function into the virtual process interface to which the current process access function belongs;

In one possible implementation, the state update module 114 may update the stored process state information in the virtual process domain by:

acquiring protection sequence control information of each virtual process subinterface according to the access matching information of each virtual process subinterface and access parameters pre-configured by each virtual process subinterface, wherein the protection sequence control information comprises the access parameters and the corresponding interface parameters of each virtual process subinterface;

Based on the same inventive concept, please refer to fig. 8, which shows a schematic block diagram of a server 100 for executing the above storage process management method according to an embodiment of the present application, where the server 100 may include a storage process management apparatus 110, a machine-readable storage medium 120, and a processor 130.

In this embodiment, the machine-readable storage medium 120 and the processor 130 are both located in the server 100 and are separately located. However, it should be understood that the machine-readable storage medium 120 may be separate from the server 100 and may be accessed by the processor 130 through a bus interface. Alternatively, the machine-readable storage medium 120 may be integrated into the processor 130, e.g., may be a cache and/or general purpose registers.

The processor 130 is a control center of the server 100, connects various parts of the entire server 100 using various interfaces and lines, performs various functions of the server 100 and processes data by running or executing software programs and/or modules stored in the machine-readable storage medium 120 and calling data stored in the machine-readable storage medium 120, thereby performing overall monitoring of the server 100. Alternatively, processor 130 may include one or more processing cores; for example, the processor 130 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor.

The processor 130 may be a general-purpose Central Processing Unit (CPU), a microprocessor, an Application-Specific Integrated Circuit (ASIC), or one or more Integrated circuits for controlling the execution of the program storing the process management method provided in the above method embodiments.

The machine-readable storage medium 120 may be, but is not limited to, a ROM or other type of static storage device that can store static information and instructions, a RAM or other type of dynamic storage device that can store information and instructions, an Electrically Erasable programmable Read-Only MEMory (EEPROM), a compact disc Read-Only MEMory (CD-ROM) or other optical disk storage, optical disk storage (including compact disc, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The machine-readable storage medium 120 may be self-contained and coupled to the processor 130 via a communication bus. The machine-readable storage medium 120 may also be integrated with the processor. The machine-readable storage medium 120 is used for storing machine-executable instructions for performing aspects of the present application. The processor 130 is configured to execute machine executable instructions stored in the machine readable storage medium 120 to implement the storage process management method provided by the foregoing method embodiment.

The storage process management apparatus 110 may include software functional modules (for example, the obtaining module 111, the extracting module 112, the determining module 113, and the status updating module 114 included in the storage process management apparatus 110 shown in fig. 7) stored in the machine-readable storage medium 120, so as to implement the storage process management method provided by the foregoing method embodiment when the processor 130 executes the software functional modules in the storage process management apparatus 110.

Since the server 100 provided in the embodiment of the present application is another implementation form of the method embodiment executed by the server 100, and the server 100 may be configured to execute the storage process management method provided in the method embodiment, the technical effect obtained by the server may refer to the method embodiment, and is not described herein again.

Further, the present application also provides a readable storage medium containing computer executable instructions, and when executed, the computer executable instructions may be used to implement the storage process management method provided by the foregoing method embodiments.

Of course, the storage medium provided in the embodiments of the present application contains computer-executable instructions, and the computer-executable instructions are not limited to the above method operations, and may also perform related operations in the storage process management method provided in any embodiments of the present application.

Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While the present application has been described in connection with various embodiments, other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed application, from a review of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the word "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

The above description is only for various embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the present application, and all such changes or substitutions are included in the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A storage process management method is applied to a server which is in communication connection with distributed storage equipment, and comprises the following steps:

2. The storage process management method according to claim 1, wherein the step of extracting the target storage process characteristics from the storage process data comprises:

3. The method for managing the storage process according to claim 2, wherein the step of respectively determining the calling intervals between the process nodes storing the process service according to the acquired process interaction data between the process nodes storing the process service comprises:

4. The storage process management method according to claim 2, wherein the storage process characteristic information includes addressing tag information of at least two addressing types;

5. The storage process management method according to any one of claims 1 to 4, wherein the step of determining a target storage process running node of the current distributed storage node according to the target storage process characteristics includes:

6. The storage process management method according to any one of claims 1 to 4, wherein the step of determining the virtual process domain and the corresponding virtual process interface of the virtual memory page of the storage process category corresponding to the target storage process operation node includes:

selecting one process access function in the process access function set one by one to be respectively used as a current process access function, creating a virtual process interface according to the process access function, calculating a calling interval between the current process access function and the interface function of the virtual process interface, and obtaining a plurality of second calling interval values to be used as second matching degree calculation results;

judging whether each second calling interval value is smaller than a preset threshold value, if so, determining that the second matching degree calculation result meets a preset matching degree condition, and if not, determining that the second matching degree calculation result does not meet the preset matching degree condition;

7. The storage process management method according to claim 6, wherein the step of updating the storage process state information in the virtual process domain after performing virtual process access to the storage process address corresponding to the current storage process state information in the virtual process domain according to the virtual process interface comprises:

8. A storage process management apparatus, applied to a server communicatively connected to a distributed storage device, the apparatus comprising:

9. The storage process management apparatus of claim 8, wherein the determining module determines the target storage process run node of the current distributed storage node by:

and fusing the first characteristic and the second characteristic, and determining a target storage process running node of the current distributed storage node according to the fused characteristic.

10. The apparatus according to claim 8, wherein the determining module determines the virtual process domain and the corresponding virtual process interface of the virtual memory page of the storage process category corresponding to the target storage process running node by: