CN113687782B - Storage pool time delay determining method and device, electronic equipment and readable storage medium - Google Patents
Storage pool time delay determining method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN113687782B CN113687782B CN202110873249.3A CN202110873249A CN113687782B CN 113687782 B CN113687782 B CN 113687782B CN 202110873249 A CN202110873249 A CN 202110873249A CN 113687782 B CN113687782 B CN 113687782B
- Authority
- CN
- China
- Prior art keywords
- monitoring process
- storage pool
- time delay
- storage
- heartbeat information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3037—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a memory, e.g. virtual memory, cache
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Quality & Reliability (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application discloses a storage pool time delay determining method, a storage pool time delay determining device, electronic equipment and a computer readable storage medium, wherein the method comprises the following steps: the monitoring process obtains heartbeat information sent by a plurality of object storage devices; the heartbeat information comprises request processing time delay; generating storage pool time delays corresponding to a plurality of storage pools respectively by using the request processing time delays; responding to a time delay request sent by a management process, and sending a storage pool time delay to the management process; the management process does not need to interact with the object storage device, and only interacts with the management process, so that the blocking caused by opening too many handles is avoided. In addition, the communication objects are reduced, the storage Chi Shiyan is generated in advance, and the management process can quickly acquire the time delay of the storage pool, so that the corresponding display interface can be normally refreshed, and the refresh timeout error cannot be caused.
Description
Technical Field
The present disclosure relates to the field of distributed cluster technologies, and in particular, to a storage pool time delay determining method, a storage pool time delay determining device, an electronic device, and a computer readable storage medium.
Background
In the current distributed storage system, in order to inquire the time delay condition of processing requests of all storage pools in a cluster at an interface, a management process periodically obtains the time delay information of the processing requests through a Monitor process (Monitor) and an object storage device (Object Storage Device, OSD) and displays the time delay information on the interface after summarizing. Specifically, the management process obtains the information of the OSDs contained in each storage pool from the Monitor, then sends the information to each OSD in each storage pool, obtains the time delay of each OSD processing request, and finally averages the time delay of each OSD as the time delay of the storage pool to display on the interface. However, when the cluster size is large, the management process needs to send a message for acquiring the time delay to a large number of OSDs in order to acquire the time delay of the storage pool, so that a large number of handles are opened simultaneously to cause blocking, and in addition, the time required for acquiring the time delay each time is long, so that the display interface corresponding to the management process is refreshed and reported in error in a overtime mode.
Therefore, the problems of blocking and interface refresh timeout in the related art are technical problems that a person skilled in the art needs to solve.
Disclosure of Invention
In view of the foregoing, an object of the present application is to provide a storage pool latency determining method, a storage pool latency determining apparatus, an electronic device, and a computer-readable storage medium, which solve the problems of blocking and interface refresh timeout.
In order to solve the above technical problems, the present application provides a method for determining a storage pool latency, including:
the monitoring process obtains heartbeat information sent by a plurality of object storage devices; wherein the heartbeat information includes request processing delay;
generating storage pool time delays corresponding to a plurality of storage pools respectively by using the request processing time delays;
and responding to a delay request sent by a management process, and sending the storage pool delay to the management process.
Optionally, the monitoring process obtains heartbeat information sent by a plurality of object storage devices, including:
the monitoring process acquires a plurality of first heartbeat information; the first heartbeat information is sent by a number of first object storage devices in direct communication with the monitoring process.
Optionally, if the monitoring process is a non-master monitoring process, the generating, by using the request processing delay, a storage pool delay corresponding to each of the plurality of storage pools includes:
the first heartbeat information is sent to a main monitoring process;
and receiving and storing the storage pool time delay sent by the main monitoring process.
Optionally, if the monitoring process is a backup master monitoring process, the method further includes:
detecting whether the main monitoring process fails;
and if the main monitoring process fails, determining the main monitoring process as the main monitoring process.
Optionally, if the monitoring process is a master monitoring process, the obtaining heartbeat information sent by the plurality of object storage devices includes:
acquiring second heartbeat information sent by a non-main monitoring process;
correspondingly, the generating the storage pool time delays corresponding to the plurality of storage pools respectively by using the request processing time delay comprises the following steps:
obtaining the request processing time delay and the identity information by using the first heartbeat information and the second heartbeat information;
based on storage pool information, grouping the request processing time delays by using the identity information to obtain a plurality of time delay data sets;
generating said storages Chi Shiyan of the corresponding storage pool using each of said time lapse data sets;
and sending the storage pool delay to each non-master monitoring process.
Optionally, said generating said storage Chi Shi for a corresponding storage pool using each of said latency data groups comprises:
dividing the time delay data group according to the time delay type to obtain a plurality of time delay data clusters;
and calculating the data of the storage pool Shi Yanzi corresponding to each time delay type by using each time delay data cluster, and forming the time delay of the storage pool by using the data of the storage Chi Shiyan sub data.
Optionally, the management process preferentially sends the delay request to the monitoring process at the same node.
The application also provides a storage pool time delay determining device, which comprises:
the heartbeat acquisition module is used for acquiring heartbeat information sent by the object storage devices by the monitoring process; wherein the heartbeat information includes request processing delay;
the delay generating module is used for generating storage pool delays corresponding to a plurality of storage pools respectively by utilizing the request processing delays;
and the delay sending module is used for responding to a delay request sent by the management process and sending the delay of the storage pool to the management process.
The application also provides an electronic device comprising a memory and a processor, wherein:
the memory is used for storing a computer program;
the processor is configured to execute the computer program to implement the storage pool time delay determining method described above.
The application also provides a computer readable storage medium for storing a computer program, wherein the computer program realizes the storage pool time delay determining method when being executed by a processor.
According to the storage pool time delay determining method, a monitoring process obtains heartbeat information sent by a plurality of object storage devices; the heartbeat information comprises request processing time delay; generating storage pool time delays corresponding to a plurality of storage pools respectively by using the request processing time delays; and responding to the delay request sent by the management process, and sending the storage pool delay to the management process.
The method is characterized in that the heartbeat information is utilized to complete transmission of request processing time delay, the request processing time delay is added to the heartbeat information by the object storage device in daily operation, the monitoring process obtains the request processing time delay corresponding to each object storage device by acquiring and analyzing the heartbeat information, and the storage pool time delay corresponding to each storage pool is obtained by utilizing the request processing time delay according to the corresponding relation between the object storage device and the storage pool. Since the store Chi Shiyan has been previously obtained, when the monitor program detects a latency request sent by the management program, the request can be responded to directly with the pool latency. The management process does not need to interact with the object storage device, and only interacts with the management process, so that the blocking caused by opening too many handles is avoided. In addition, the communication objects are reduced, the storage Chi Shiyan is generated in advance, and the management process can quickly acquire the time delay of the storage pool, so that the corresponding display interface can be refreshed normally, the refresh timeout error cannot be caused, and the problems of blockage and interface refresh timeout in the related technology are solved.
In addition, the application also provides a storage pool time delay determining device, electronic equipment and a computer readable storage medium, and the storage pool time delay determining device and the electronic equipment have the same beneficial effects.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the related art, the drawings that are required to be used in the embodiments or the related technical descriptions will be briefly described below, and it is apparent that the drawings in the following description are only embodiments of the present application, and other drawings may be obtained according to the provided drawings without inventive effort to those of ordinary skill in the art.
FIG. 1 is a flowchart of a method for determining a latency of a storage pool according to an embodiment of the present application;
FIG. 2 is a specific data flow diagram provided in an embodiment of the present application;
fig. 3 is a schematic structural diagram of a storage pool time delay determining device according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
Referring to fig. 1, fig. 1 is a flowchart of a method for determining a storage pool latency according to an embodiment of the present application. The method comprises the following steps:
s101: the monitoring process acquires heartbeat information sent by a plurality of object storage device processes.
The monitoring process, which may be referred to as monitor process, refers to a process for monitoring the running state of nodes in the cluster. An object storage device, which may be referred to as an OSD process, generally corresponds to a disk in a node, and refers to a process for controlling the disk. It can be understood that the whole distributed cluster comprises a plurality of nodes, each node is provided with a monitoring process, and each monitoring process can be communicated with each other to form a monitoring network. There are several disks on each node, so several OSD processes are deployed on each node. The disks on the same node or on different nodes form a plurality of storage pools according to the requirement, so that the OSD processes deployed on the same node or on different nodes correspond to the plurality of storage pools. Each OSD process communicates with a monitoring process, reports the state of the OSD process to the monitoring process and executes the instruction issued by the monitoring process. The OSD process and the monitoring process in communication therewith may be at the same node, or may be at two nodes separately. Referring to fig. 2, fig. 2 is a specific data flow chart provided in the embodiment of the present application, where a communication connection relationship and a data flow between each process are recorded. It should be noted that the number of monitor processes in the cluster is plural.
The heartbeat detection refers to detection of sending a small data packet to the other interconnected party at intervals, and judging whether the communication link between the two interconnected parties is disconnected or not through the reply condition of the other party. The data packet sent during the heartbeat detection is the heartbeat information. The specific content of the heartbeat information is not limited, and in this embodiment, the heartbeat information includes a delay field for placing a processing delay of the request.
The request processing delay refers to the execution delay of the OSD process and the corresponding disk to the request, and the specific types of the execution delay are different according to different request types. The request processing latency may include one or more of a write request processing latency, a read request processing latency, and a read write request processing latency. The write request processing delay refers to the duration required by the OSD process to process the write request, the read request processing delay refers to the duration required by the OSD process to process the read request, and the read request processing delay refers to the average duration of the OSD request write request and the read request. It should be noted that the three types of request processing delays may be single delays or average delays. The single time delay refers to the duration of processing a certain request; the average time delay refers to an average value of time durations when a certain type or two types of requests are processed in a period of time, for example, the average value of time durations required by processing various types of requests between the current heartbeat detection and the last heartbeat detection can be obtained.
During heartbeat detection, the OSD process actively transmits heartbeat information to the monitoring process, and the monitoring process can analyze the heartbeat information to obtain request processing time delay. It should be noted that, the monitoring process cannot monitor all OSD processes in the cluster, so the request processing delay obtained through the heartbeat information is only a part of the request processing delay corresponding to all OSD processes in the cluster.
S102: and generating storage pool time delays corresponding to the plurality of storage pools respectively by using the request processing time delays.
After the request processing delay is obtained, the corresponding storage pool delays of a plurality of storage pools formed by the clusters can be generated by utilizing the corresponding relation between the disk and the storage pools. The storage Chi Shiyan refers to the average processing time length of the whole storage pool for various requests, and is generally obtained by carrying out average calculation on the request processing time delay of each disk corresponding to the storage pool.
It can be understood that there are multiple nodes in the cluster and multiple monitoring processes, where each monitoring process obtains the request processing delay reported by a part of OSD processes in the cluster. Therefore, if the storage pool time delays corresponding to all the storage pools in the cluster are to be obtained, the request processing time delays acquired by each monitoring process are required to be collected, all the request processing time delays are divided according to the corresponding relation between the storage pools and the magnetic disks, and then the storage pool time delays are calculated.
In this case, therefore, the process of acquiring the request processing delay includes at least the steps of:
step 11: the monitoring process acquires a plurality of first heartbeat information.
The first heartbeat information is sent by a plurality of first object storage device processes which are directly communicated with the monitoring process, namely each monitoring process respectively acquires a part of request processing time delay reported by an OSD process corresponding to each monitoring process. On this basis, since each monitoring process may communicate with the management process, each monitoring process needs to have a corresponding memory pool latency. In order to ensure that the storage Chi Shiyan obtained by each monitoring process is the same, and simultaneously in order to reduce the consumption of computing resources and communication resources, a storage pool time delay generation mode based on a protocol can be adopted in a monitoring cluster formed by the monitoring processes. Specifically, a master monitoring process is determined in the monitoring cluster, the master monitoring process gathers heartbeat signals or request processing time delays acquired by all monitoring processes, after gathering is finished, the time delay of a storage pool is calculated, and the calculated time delay of the storage pool is synchronized to all non-master monitoring processes.
Therefore, if the monitoring process is a non-master monitoring process, the process of generating the storage pool delays corresponding to the plurality of storage pools respectively by using the request processing delays includes:
step 21: the first heartbeat information is sent to a master monitoring process.
Step 22: and receiving and storing the storage pool time delay sent by the main monitoring process.
It should be noted that, the embodiment is not limited to a specific manner of determining whether the monitoring process is a master monitoring process, in one embodiment, each monitoring process may compare its own unique identity information with the unique identity information of the master node, if the two are matched, then the monitoring process is determined to be the master monitoring process, otherwise, the monitoring process is determined to be a non-master monitoring process.
After the self is determined to be a non-main monitoring process, the first heartbeat information is sent to the main monitoring process, so that the main monitoring process can acquire the request processing time delay and the OSD identity information, the storage pool corresponding to the request processing time delay is determined by using the OSD identity information, and the storage pool time delay is calculated. After the storage pool time delay is calculated, the master monitoring process synchronizes the storage pool time delay to other non-master monitoring processes, so that the storage Chi Shiyan sent by the master monitoring process can be received, and the generation process of the storage pool time delay on the monitoring process is completed.
In addition, in practical application, the main monitoring process may malfunction due to various reasons, and calculation of the storage pool delay cannot be continued. In order to avoid the problem that the delay of the storage pool cannot be generated due to the failure of the main monitoring process, a backup main monitoring process is further arranged in the embodiment. Specifically, if the monitoring process is a backup master monitoring process, the method further includes the following steps:
step 31: and detecting whether the main monitoring process fails.
Step 32: if the main monitoring process fails, the main monitoring process is determined to be the main monitoring process.
The embodiment does not limit the detection mode for detecting whether the main monitoring process is faulty, for example, the main monitoring process may communicate with the main monitoring process according to a preset period, if the main monitoring process responds normally, it is determined that the fault is not generated, otherwise, it is determined that the fault is generated. When the main monitoring process is detected to be faulty, the self-main monitoring process can be determined. Specifically, the unique identity information of the local main monitoring process can be updated, and the identity information of the main monitoring process is broadcasted in the monitoring cluster as the unique identity information.
For example, the unique identity information of each monitoring process can be sequenced, the unique identity information has a sequence, the monitoring process corresponding to the next unique identity information is the backup process of the monitoring process corresponding to the previous unique identity information, and the backup process corresponding to the master monitoring process is the backup master monitoring process.
Further, if the monitoring process is a master monitoring process, the process of acquiring heartbeat information sent by the plurality of object storage device processes includes the following steps:
step 41: and acquiring second heartbeat information sent by the non-main monitoring process.
Wherein the second heartbeat information is sent by a number of second object storage device processes in direct communication with the monitoring process.
Correspondingly, the process of generating the storage pool time delays corresponding to the storage pools respectively by using the request processing time delays comprises the following steps:
step 42: and obtaining request processing time delay and identity information by using the first heartbeat information and the second heartbeat information.
Step 43: based on the storage pool information, the identity information is utilized to group the request processing time delay, and a plurality of time delay data sets are obtained.
Step 44: and generating a storage pool delay of the corresponding storage pool by utilizing each delay data group.
Step 45: and sending the storage pool time delay to each non-master monitoring process.
After the directly acquired first heartbeat information and the forwarded second heartbeat information are obtained, the corresponding request processing time delay and identity information (namely OSD identity information) are extracted from the first heartbeat information and the forwarded second heartbeat information. The storage pool information is information recorded with the corresponding relation between the storage pool and the disk, and the corresponding relation between the OSD process and the storage pool can be determined by utilizing the storage pool information and the identity information, so that the corresponding relation between each request processing delay and the storage pool is determined. Based on the correspondence, the request processing delays may be grouped to obtain a plurality of delay data sets, each delay data set corresponding to a storage pool.
After the time delay data set is obtained, the average calculation is carried out by utilizing the request processing time delay in the time delay data set, the time delay of a storage pool of the storage pool is obtained, and the time delay is sent to each non-main monitoring process, so that the data synchronization is completed.
Further, in one possible implementation, the request processing delay includes more than two types of data, in which case, generating a storage pool delay of the corresponding storage pool using each delay data set includes:
step 51: and dividing the time delay data group according to the time delay type to obtain a plurality of time delay data clusters.
Step 52: and calculating the data of the storage pool Shi Yanzi corresponding to each time delay type by using each time delay data cluster, and forming the time delay of the storage pool by using the time delay sub data of the storage pool.
In this embodiment, the latency type includes at least two of a write request processing latency, a read request processing latency, and a read write request processing latency. And dividing each time delay data group according to different time delay types to obtain corresponding time delay data clusters, carrying out average calculation by taking the time delay data clusters as units to obtain time delay sub-data of a storage pool, and then combining each sub-data to obtain the time delay of the storage pool.
S103: and responding to the delay request sent by the management process, and sending the storage pool delay to the management process.
After the monitoring process obtains the corresponding storage pool, the monitoring process can provide service for the management process at any time. Management processes, which refer to processes that manage the entire cluster, typically have a corresponding visual interface through which to interact with the user. After detecting the delay request sent by the management process, the delay request can be responded by utilizing the own delay of the storage pool, and the delay of the storage pool is sent to the management process. The management process may send a delay request to the monitoring process at the same node preferentially, so as to increase the data acquisition speed. If the same node does not have a monitoring process, the management node can send a delay request to any monitoring process, or can select a corresponding management process according to the request sending priority. The request transmission priority may be determined according to factors such as communication resource consumption, communication duration, etc., which may be fixed or may be updated periodically.
By applying the storage pool time delay determining method provided by the embodiment of the application, the initial calculated quantity corresponding to each computing device is obtained through the theoretical calculated force of the computing device and the theoretical calculated quantity of the target model, and load balancing operation is carried out on the network layer in the target model according to the initial calculated quantity by adopting various device critical layer position dividing rules, so that various different balancing schemes, namely an initial balancing scheme, are obtained. And determining the time performance of a plurality of technical schemes by counting the time performance parameters, and selecting an initial equalization scheme with better performance as an intermediate equalization scheme. And finally, considering the influence of the data communication of the computing equipment, and adjusting the intermediate equalization scheme to obtain a final equalization scheme. The initial calculated amount is obtained through theoretical calculation force, and an initial balancing scheme is obtained according to the initial calculated amount, so that better balancing can be achieved in terms of the data amount required to be calculated by each computing device; the time performance parameter can be used for representing the overall computing efficiency of all computing devices in the initial equalization scheme; finally, the influence of the data communication process on each computing device is considered, and the intermediate balancing scheme is adjusted based on the influence to obtain a final balancing scheme, so that the load balancing among the computing devices can be achieved, the overall computing efficiency, namely the training efficiency, is ensured, and the problems of unbalanced load and lower training efficiency in the related technology are solved.
The storage pool time delay determining device provided in the embodiment of the present application is described below, and the storage pool time delay determining device described below and the storage pool time delay determining method described above may be referred to correspondingly.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a storage pool time delay determining apparatus according to an embodiment of the present application, including:
the heartbeat obtaining module 110 is configured to obtain heartbeat information sent by the plurality of object storage device processes by using the monitoring process; the heartbeat information comprises request processing time delay;
the delay generating module 120 is configured to generate a storage pool delay corresponding to each of the plurality of storage pools by using the request processing delay;
the delay sending module 130 is configured to send the storage pool delay to the management process in response to the delay request sent by the management process.
Optionally, the heartbeat acquisition module 110 includes:
the first acquisition unit is used for acquiring a plurality of first heartbeat information by the monitoring process; the first heartbeat information is sent by a number of first object storage device processes in direct communication with the monitoring process.
Optionally, the delay generating module 120 includes:
the sending unit is used for sending the first heartbeat information to the main monitoring process if the monitoring process is a non-main monitoring process;
and the receiving unit is used for receiving and storing the storage pool time delay sent by the main monitoring process.
Optionally, the method further comprises:
the fault detection module is used for detecting whether the main monitoring process has faults or not if the monitoring process is a backup main monitoring process;
and the identity determining module is used for determining the identity as the main monitoring process if the main monitoring process fails.
Optionally, the heartbeat acquisition module 110 includes:
the second acquisition unit is used for acquiring second heartbeat information sent by the non-master monitoring process if the monitoring process is the master monitoring process;
accordingly, the delay generation module 120 includes:
the analysis unit is used for obtaining request processing time delay and identity information by utilizing the first heartbeat information and the second heartbeat information;
the grouping unit is used for grouping the request processing time delay by utilizing the identity information based on the storage pool information to obtain a plurality of time delay data sets;
a computing unit, configured to generate a storage pool delay corresponding to the storage pool using each delay data set;
and the data synchronization unit is used for sending the storage pool time delay to each non-master monitoring process.
Optionally, the computing unit includes:
the clustering subunit is used for dividing the time delay data group according to the time delay type to obtain a plurality of time delay data clusters;
and the calculation subunit is used for calculating the storage pool Shi Yanzi data corresponding to each time delay type by using each time delay data cluster, and forming the storage pool time delay by using the storage pool time delay sub-data.
The electronic device provided in the embodiments of the present application is described below, and the electronic device described below and the storage pool time delay determining method described above may be referred to correspondingly.
Referring to fig. 4, fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application. Wherein the electronic device 100 may include a processor 101 and a memory 102, and may further include one or more of a multimedia component 103, an information input/information output (I/O) interface 104, and a communication component 105.
Wherein the processor 101 is configured to control the overall operation of the electronic device 100 to perform all or part of the steps in the storage pool delay determining method described above; the memory 102 is used to store various types of data to support operation at the electronic device 100, which may include, for example, instructions for any application or method operating on the electronic device 100, as well as application-related data. The Memory 102 may be implemented by any type or combination of volatile or non-volatile Memory devices, such as one or more of static random access Memory (Static Random Access Memory, SRAM), electrically erasable programmable Read-Only Memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), erasable programmable Read-Only Memory (Erasable Programmable Read-Only Memory, EPROM), programmable Read-Only Memory (Programmable Read-Only Memory, PROM), read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic disk, or optical disk.
The multimedia component 103 may include a screen and an audio component. Wherein the screen may be, for example, a touch screen, the audio component being for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signals may be further stored in the memory 102 or transmitted through the communication component 105. The audio assembly further comprises at least one speaker for outputting audio signals. The I/O interface 104 provides an interface between the processor 101 and other interface modules, which may be a keyboard, mouse, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication component 105 is used for wired or wireless communication between the electronic device 100 and other devices. Wireless communication, such as Wi-Fi, bluetooth, near field communication (Near Field Communication, NFC for short), 2G, 3G or 4G, or a combination of one or more thereof, the respective communication component 105 may thus comprise: wi-Fi part, bluetooth part, NFC part.
The electronic device 100 may be implemented by one or more application specific integrated circuits (Application Specific Integrated Circuit, abbreviated as ASIC), digital signal processors (Digital Signal Processor, abbreviated as DSP), digital signal processing devices (Digital Signal Processing Device, abbreviated as DSPD), programmable logic devices (Programmable Logic Device, abbreviated as PLD), field programmable gate arrays (Field Programmable Gate Array, abbreviated as FPGA), controllers, microcontrollers, microprocessors, or other electronic components for performing the pool time delay determination methods set forth in the above embodiments.
The following describes a computer readable storage medium provided in an embodiment of the present application, where the computer readable storage medium described below and the storage pool delay determining method described above may be referred to correspondingly.
The present application further provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps of the pool delay determination method described above.
The computer readable storage medium may include: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different point from other embodiments, so that the same or similar parts between the embodiments are referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant points refer to the description of the method section.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative elements and steps are described above generally in terms of functionality in order to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Those skilled in the art may implement the described functionality using different approaches for each particular application, but such implementation should not be considered to be beyond the scope of this application.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software modules may be disposed in Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
Finally, it is further noted that, in this document, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms include, comprise, or any other variation is intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
The principles and embodiments of the present application are described herein with specific examples, the above examples being provided only to assist in understanding the methods of the present application and their core ideas; meanwhile, as those skilled in the art will have modifications in the specific embodiments and application scope in accordance with the ideas of the present application, the present description should not be construed as limiting the present application in view of the above.
Claims (7)
1. A method for determining a latency of a storage pool, comprising:
the monitoring process acquires heartbeat information sent by a plurality of object storage device processes; wherein the heartbeat information includes request processing delay;
generating storage pool time delays corresponding to a plurality of storage pools respectively by using the request processing time delays;
transmitting the store Chi Shiyan to a management process in response to a latency request transmitted by the management process;
the monitoring process obtains heartbeat information sent by a plurality of object storage device processes, and the heartbeat information comprises:
the monitoring process acquires a plurality of first heartbeat information; the first heartbeat information is sent by a plurality of first object storage device processes which are directly communicated with the monitoring process;
if the monitoring process is a non-master monitoring process, generating storage pool delays corresponding to a plurality of storage pools respectively by using the request processing delays, including:
the first heartbeat information is sent to a main monitoring process;
receiving and storing the store Chi Shiyan sent by the master monitor program;
if the monitoring process is a master monitoring process, the obtaining heartbeat information sent by the plurality of object storage device processes includes:
acquiring second heartbeat information sent by a non-main monitoring process;
correspondingly, the generating the storage pool time delays corresponding to the plurality of storage pools respectively by using the request processing time delay comprises the following steps:
obtaining the request processing time delay and the identity information by using the first heartbeat information and the second heartbeat information;
based on storage pool information, grouping the request processing time delays by using the identity information to obtain a plurality of time delay data sets;
generating said storages Chi Shiyan of the corresponding storage pool using each of said time lapse data sets;
and sending the storage pool delay to each non-master monitoring process.
2. The method of claim 1, further comprising, if the monitor process is a backup master monitor process:
detecting whether the main monitoring process fails;
and if the main monitoring process fails, determining the main monitoring process as the main monitoring process.
3. The storage pool latency determination method of claim 1, wherein the generating the storage Chi Shi latency for a corresponding storage pool using each of the latency data groups comprises:
dividing the time delay data group according to the time delay type to obtain a plurality of time delay data clusters;
and calculating the data of the storage pool Shi Yanzi corresponding to each time delay type by using each time delay data cluster, and forming the time delay of the storage pool by using the data of the storage Chi Shiyan sub data.
4. The storage pool latency determination method of claim 1, wherein the management process preferentially sends the latency request to the monitoring process at the same node.
5. A storage pool latency determining apparatus, comprising:
the heartbeat acquisition module is used for acquiring heartbeat information sent by the processes of the object storage devices by the monitoring process; wherein the heartbeat information includes request processing delay;
the delay generating module is used for generating storage pool delays corresponding to a plurality of storage pools respectively by utilizing the request processing delays;
the delay sending module is used for responding to a delay request sent by a management process and sending the storage Chi Shiyan to the management process;
the heartbeat acquisition module is specifically used for acquiring a plurality of first heartbeat information by the monitoring process; the first heartbeat information is sent by a plurality of first object storage device processes which are directly communicated with the monitoring process;
if the monitoring process is a non-master monitoring process, generating storage Chi Shiyan corresponding to a plurality of storage pools respectively by using the request processing time delay, wherein the device is further configured to send the first heartbeat information to a master monitoring process; receiving and storing the store Chi Shiyan sent by the master monitor program;
if the monitoring process is a main monitoring process, the heartbeat information sent by a plurality of object storage device processes is obtained, and the device is also used for obtaining second heartbeat information sent by a non-main monitoring process;
correspondingly, the delay generating module is specifically configured to obtain the request processing delay and identity information by using the first heartbeat information and the second heartbeat information; based on storage pool information, grouping the request processing time delays by using the identity information to obtain a plurality of time delay data sets; generating said storages Chi Shiyan of the corresponding storage pool using each of said time lapse data sets; and sending the storage pool delay to each non-master monitoring process.
6. An electronic device comprising a memory and a processor, wherein:
the memory is used for storing a computer program;
the processor is configured to execute the computer program to implement the storage pool latency determination method according to any one of claims 1 to 4.
7. A computer readable storage medium for storing a computer program, wherein the computer program when executed by a processor implements the storage pool latency determination method of any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110873249.3A CN113687782B (en) | 2021-07-30 | 2021-07-30 | Storage pool time delay determining method and device, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110873249.3A CN113687782B (en) | 2021-07-30 | 2021-07-30 | Storage pool time delay determining method and device, electronic equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113687782A CN113687782A (en) | 2021-11-23 |
| CN113687782B true CN113687782B (en) | 2023-12-22 |
Family
ID=78578423
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110873249.3A Active CN113687782B (en) | 2021-07-30 | 2021-07-30 | Storage pool time delay determining method and device, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113687782B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1040162A (en) * | 1996-07-18 | 1998-02-13 | Nec Corp | System for monitoring memory pool |
| CN102473117A (en) * | 2009-08-13 | 2012-05-23 | 高通股份有限公司 | Apparatus and method for memory management and efficient data processing |
| CN110502259A (en) * | 2019-07-16 | 2019-11-26 | 视联动力信息技术股份有限公司 | Server version upgrade method, video network system, electronic equipment and storage medium |
| CN111142801A (en) * | 2019-12-26 | 2020-05-12 | 星辰天合（北京）数据科技有限公司 | Distributed storage system network sub-health detection method and device |
| CN111881135A (en) * | 2020-07-28 | 2020-11-03 | 苏州浪潮智能科技有限公司 | Data aggregation method, device, equipment and computer readable storage medium |
| CN111913667A (en) * | 2020-08-06 | 2020-11-10 | 平安科技（深圳）有限公司 | OSD blocking detection method, system, terminal and storage medium based on Ceph |
| CN112090065A (en) * | 2020-09-23 | 2020-12-18 | 努比亚技术有限公司 | Network delay regulation and control method, equipment and computer readable storage medium |
| WO2020259289A1 (en) * | 2019-06-26 | 2020-12-30 | 维塔科技(北京)有限公司 | Resource allocation method and apparatus, electronic device and storage medium |
| WO2021012871A1 (en) * | 2019-07-24 | 2021-01-28 | 维沃移动通信有限公司 | Method and device for setting delay |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190042089A1 (en) * | 2018-03-02 | 2019-02-07 | Intel Corporation | Method of improved data distribution among storage devices |
-
2021
- 2021-07-30 CN CN202110873249.3A patent/CN113687782B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1040162A (en) * | 1996-07-18 | 1998-02-13 | Nec Corp | System for monitoring memory pool |
| CN102473117A (en) * | 2009-08-13 | 2012-05-23 | 高通股份有限公司 | Apparatus and method for memory management and efficient data processing |
| WO2020259289A1 (en) * | 2019-06-26 | 2020-12-30 | 维塔科技(北京)有限公司 | Resource allocation method and apparatus, electronic device and storage medium |
| CN110502259A (en) * | 2019-07-16 | 2019-11-26 | 视联动力信息技术股份有限公司 | Server version upgrade method, video network system, electronic equipment and storage medium |
| WO2021012871A1 (en) * | 2019-07-24 | 2021-01-28 | 维沃移动通信有限公司 | Method and device for setting delay |
| CN111142801A (en) * | 2019-12-26 | 2020-05-12 | 星辰天合（北京）数据科技有限公司 | Distributed storage system network sub-health detection method and device |
| CN111881135A (en) * | 2020-07-28 | 2020-11-03 | 苏州浪潮智能科技有限公司 | Data aggregation method, device, equipment and computer readable storage medium |
| CN111913667A (en) * | 2020-08-06 | 2020-11-10 | 平安科技（深圳）有限公司 | OSD blocking detection method, system, terminal and storage medium based on Ceph |
| CN112090065A (en) * | 2020-09-23 | 2020-12-18 | 努比亚技术有限公司 | Network delay regulation and control method, equipment and computer readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 一种开放式架构的天基网络化计算平台体系设计;白保存;张越;陆洲;李斌;;中国电子科学研究院学报(第09期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113687782A (en) | 2021-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114070739B (en) | Cluster deployment method, device, equipment and computer readable storage medium | |
| CN108847982B (en) | Distributed storage cluster and node fault switching method and device thereof | |
| CN111090699A (en) | Method and device for synchronizing service data, storage medium, and electronic device | |
| CN110855737B (en) | Consistency level controllable self-adaptive data synchronization method and system | |
| US20120254652A1 (en) | Fault detection and recovery as a service | |
| CN109391528A (en) | Awakening method, device, equipment and the storage medium of speech-sound intelligent equipment | |
| EP2896187B1 (en) | Information management method and device | |
| US11595474B2 (en) | Accelerating data replication using multicast and non-volatile memory enabled nodes | |
| US11902362B2 (en) | Topology-aware load balancing method and apparatus, and computer device | |
| CN108696581A (en) | Caching method, device, computer equipment and the storage medium of distributed information | |
| US11902095B2 (en) | Cluster quorum method and apparatus, electronic device, and readable storage medium | |
| CN111198662A (en) | A data storage method, apparatus and computer-readable storage medium | |
| WO2011088256A2 (en) | Methods and apparatus for predicting the performance of a multi-tier computer software system | |
| CN114706675A (en) | Task deployment method and device based on cloud-edge collaborative system | |
| CN116701043A (en) | Faulty node switching method, device and equipment for heterogeneous computing systems | |
| CN113300914A (en) | Network quality monitoring method, device, system, electronic equipment and storage medium | |
| CN112653734A (en) | Server cluster real-time master-slave control and data synchronization system and method | |
| CN114531373A (en) | Node state detection method, node state detection device, equipment and medium | |
| CN114598743B (en) | A service discovery method, device, electronic device and storage medium | |
| CN114064217B (en) | OpenStack-based node virtual machine migration method and device | |
| CN106230622B (en) | Cluster implementation method and device | |
| CN109542627A (en) | Node switching method, device, supervisor, node device and distributed system | |
| CN115174692B (en) | A task scheduling system and method | |
| CN113687782A (en) | Storage pool time delay determination method and device, electronic equipment and readable storage medium | |
| CN119728498A (en) | A data center network element fault scheduling method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |