CN116909853A - Monitoring method and system of storage system, electronic equipment and readable storage medium - Google Patents

Monitoring method and system of storage system, electronic equipment and readable storage medium Download PDF

Info

Publication number
CN116909853A
CN116909853A CN202310823660.9A CN202310823660A CN116909853A CN 116909853 A CN116909853 A CN 116909853A CN 202310823660 A CN202310823660 A CN 202310823660A CN 116909853 A CN116909853 A CN 116909853A
Authority
CN
China
Prior art keywords
information
read
storage system
write
storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310823660.9A
Other languages
Chinese (zh)
Inventor
张帧
肖辉
李汉民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhongnan Hospital of Wuhan University
Original Assignee
Zhongnan Hospital of Wuhan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhongnan Hospital of Wuhan University filed Critical Zhongnan Hospital of Wuhan University
Priority to CN202310823660.9A priority Critical patent/CN116909853A/en
Publication of CN116909853A publication Critical patent/CN116909853A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
    • G06F11/324—Display of status information
    • G06F11/328—Computer systems status display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3034—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a storage system, e.g. DASD based or network based
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3051—Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3055—Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3089—Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
    • G06F11/3093—Configuration details thereof, e.g. installation, enabling, spatial arrangement of the probes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/80—Database-specific techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/805—Real-time
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The application discloses a monitoring method, a system, electronic equipment and a readable storage medium of a storage system, and relates to the technical field of storage management; storing the read-write information in a preset time sequence database; responding to an operation instruction of the front end for visually displaying the storage system, and acquiring current storage information and current read-write information of the storage system; acquiring a read-write data set in a preset time from a time sequence database; processing the current storage information, the current read-write information and the read-write data set to obtain monitoring information of the storage system; and pushing the monitoring information to the front end for visual display according to the WebSocket protocol. The method and the device can quickly carry out visual display on the monitoring information of the storage system, and greatly improve the monitoring efficiency of the storage system.

Description

Monitoring method and system of storage system, electronic equipment and readable storage medium
Technical Field
The present application relates to the field of storage management technologies, and in particular, to a method and a system for monitoring a storage system, an electronic device, and a readable storage medium.
Background
With the advent of the cloud era, big data began to explosively develop, attracting more and more attention. Big data are influencing the daily life style, working habit and thinking mode of people, and have huge use value. The cloud-architecture storage system may provide a more efficient data storage solution for the storage of large data.
The existing storage system generally adopts Zabbix (an enterprise-level open source solution for providing distributed system monitoring and network monitoring functions based on a WEB interface) proxy middleware to perform monitoring management, but the installation steps of the Zabbix proxy middleware are complicated, and meanwhile, the command line ssh connection of the storage system is limited by network bandwidth to acquire data of each monitoring item, so that the monitoring information of the storage system cannot be displayed in a rapid visual mode.
Disclosure of Invention
Aiming at the defects in the prior art, the application aims to provide a monitoring method, a system, electronic equipment and a readable storage medium of a storage system, which can rapidly carry out visual display on monitoring information of the storage system and greatly improve the monitoring efficiency of the storage system.
In order to achieve the above object, the present application provides a method for monitoring a storage system, which specifically includes the following steps:
accessing an API (application program interface) of a storage system to acquire real-time information of the storage system; the real-time information comprises read-write information and storage information of the storage system;
storing the read-write information in a preset time sequence database; the read-write information comprises read-write times, read-write data size and read-write delay rate;
responding to an operation instruction of the front end for visually displaying the storage system, and acquiring current storage information and current read-write information of the storage system;
acquiring a read-write data set in preset time from the time sequence database; wherein the read-write data set comprises a plurality of groups of read-write information;
processing the current storage information, the current read-write information and the read-write data set to obtain monitoring information of the storage system;
pushing the monitoring information to the front end according to a WebSocket protocol for visual display.
Based on the technical scheme, the method for accessing the API interface of the storage system comprises the following specific steps:
acquiring equipment information of the storage system; the device information comprises a device name, a device IP, alarm group information, port information, a login account and a login password;
generating a first request message for accessing an API interface of the storage system according to the equipment information;
and accessing an API interface of the storage system according to the first request message.
On the basis of the technical scheme, after the API interface of the storage system is accessed, the method further comprises the following steps:
receiving a response message sent by an API interface of the storage system;
and analyzing the response message to obtain the real-time information of the storage system.
On the basis of the technical scheme, after the API interface of the storage system is accessed, the method further comprises the following steps:
acquiring a request head of the first request message;
generating a second request message for accessing the API interface of the storage system according to the request header of the first request message;
and accessing the API interface of the storage system again according to the second request message.
On the basis of the above technical solution, after the storing the read-write information in the preset time sequence database, the method further includes:
and storing the storage information of the storage system in a preset cache database.
On the basis of the technical scheme, after the read-write data set in the preset time is acquired in the time sequence database, the method further comprises the following steps:
acquiring a stored data set in a preset time from the cache database; wherein the stored data set comprises a plurality of sets of the stored information;
processing the current stored information, the current read-write information, the read-write data set and the first stored information by adopting a decision tree algorithm to obtain first prediction information;
pushing the first prediction information to the front end according to a WebSocket protocol for visual display.
On the basis of the technical scheme, after the read-write data set in the preset time is acquired in the time sequence database, the method further comprises the following steps:
acquiring environmental control information of a machine room where the storage system is located, and acquiring a storage data set in a preset time from the cache database; wherein the stored data set comprises a plurality of sets of the stored information;
processing the current stored information, the current read-write information, the read-write data set, the first stored information and the environmental control information by adopting a decision tree algorithm to obtain second prediction information;
pushing the second prediction information to the front end according to a WebSocket protocol for visual display.
The application provides a monitoring system of a storage system, which comprises:
the first acquisition unit is used for accessing an API (application program interface) of the storage system to acquire real-time information of the storage system; the real-time information comprises read-write information and storage information of the storage system;
the storage unit is used for storing the read-write information in a preset time sequence database; the read-write information comprises read-write times, read-write data size and read-write delay rate;
the second acquisition unit is used for responding to an operation instruction of the front end for carrying out visual display on the storage system and acquiring current storage information and current read-write information of the storage system;
the third acquisition unit is used for acquiring a read-write data set in a preset time in the time sequence database; wherein the read-write data set comprises a plurality of groups of read-write information;
the processing unit is used for processing the current storage information, the current read-write information and the read-write data set to obtain monitoring information of the storage system;
and the pushing unit is used for pushing the monitoring information to the front end for visual display according to a WebSocket protocol.
The application provides an electronic device, which comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor realizes the monitoring method of the storage system when executing the computer program.
The present application provides a computer readable storage medium storing a computer program which when executed by a processor implements the steps in the method for monitoring a storage system described above.
Compared with the prior art, the application has the advantages that: accessing an API (application program interface) of the storage system to acquire real-time information of the storage system; the real-time information comprises read-write information and storage information of the storage system; storing the read-write information in a time sequence database; the read-write information comprises read-write times, read-write data size and read-write delay rate; responding to an operation instruction of the front end for visually displaying the storage system, and acquiring current storage information and current read-write information of the storage system; acquiring a read-write data set in a preset time from a time sequence database; the read-write data set comprises a plurality of groups of read-write information; processing the current storage information, the current read-write information and the read-write data set to obtain monitoring information of the storage system; pushing the monitoring information to the front end according to the WebSocket protocol for visual display; the method and the device can quickly carry out visual display on the monitoring information of the storage system, and greatly improve the monitoring efficiency of the storage system.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method for monitoring a storage system according to an embodiment of the present application;
FIG. 2 is a schematic flow chart of a monitoring method of a storage system according to an embodiment of the present application;
FIG. 3 is a schematic flow chart of a monitoring method of a storage system according to an embodiment of the present application;
FIG. 4 is a schematic flow chart of a monitoring method of a storage system according to an embodiment of the present application;
FIG. 5 is another flow chart of a monitoring method of a storage system according to an embodiment of the present application;
FIG. 6 is a schematic diagram of another flow chart of a monitoring method of a storage system according to an embodiment of the present application;
FIG. 7 is a schematic block diagram of a monitoring system of a storage system provided by an embodiment of the present application;
fig. 8 is a schematic block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
It should be understood that the terms "comprises" and "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be further understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
In the terminal device of the monitoring method of the storage system in the embodiment of the application, the method executes the monitoring method of the storage system through the application software installed in the terminal device. The terminal equipment can be electronic equipment such as a desktop computer, a notebook computer, a tablet computer or a mobile phone.
In one embodiment, the storage system is OceanStor 2600V3, which is middle-end entry-level storage for the optimized design of flash memory, and meets the requirements of the cloud era on higher performance, lower time delay and higher elasticity of the storage system. When in full flash memory configuration, the system can realize high performance and achieve low time delay of <1ms, and innovatively has the capabilities of SAN (Storage Area Network ) and NAS (Network Attached Storage, network attached storage) integration, multi-control, dual activity and the like. The ocean Stor 2600V3 supports the fusion of SAN and NAS, heterogeneous equipment, high, medium and low ends, HDD (Hard Disk Drive) and SSD (Solid State Disk), and the fusion of main storage and backup, and a safe, reliable, simple and efficient fusion storage system is built for users. OceanStor 2600V3 can be expanded to 8-control and 256-GB caches, supports 16Gbps FC, PCI-E3.0 and 12Gbps SAS, and provides extremely good performance and expansibility.
It should be noted that, the application scenario of the foregoing embodiment is merely an example, and the services and scenarios described in the embodiments of the present application are for more clearly describing the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided by the embodiments of the present application, and those skilled in the art can know that, with the evolution of the system and the appearance of the new service scenario, the technical solutions provided by the embodiments of the present application are equally applicable to similar technical problems. The following will describe in detail.
The following description of the embodiments is not intended to limit the preferred embodiments. The following describes the monitoring method of the storage system in detail.
As shown in fig. 1, the method for monitoring a storage system according to the embodiment of the present application specifically includes the following steps:
s110: accessing an API (Application Programming Interface ) interface of a storage system to obtain real-time information of the storage system; the real-time information comprises read-write information and storage information of the storage system;
s120: storing the read-write information in a preset time sequence database; the read-write information comprises read-write times, read-write data size and read-write delay rate;
s130: responding to an operation instruction of the front end for visually displaying the storage system, and acquiring current storage information and current read-write information of the storage system;
s140: acquiring a read-write data set in preset time from the time sequence database; wherein the read-write data set comprises a plurality of groups of read-write information;
s150: processing the current storage information, the current read-write information and the read-write data set to obtain monitoring information of the storage system;
s160: pushing the monitoring information to the front end according to a WebSocket protocol for visual display.
Specifically, the real-time information includes read-write information and storage information of the storage system, the read-write information includes read-write times, read-write data size and read-write delay rate, the storage information is real-time attribute information of the storage system, the storage information includes disk pool information, virtual disk information, IO (Input/Output) group information, alarm information, memory information and basic information of the storage system of the current storage system, the disk pool information includes name, state, physical disk number, virtual disk number, capacity use condition and the like of the disk pool, the virtual disk information includes basic information of the virtual disk and virtual copy disk, the basic information of the virtual disk includes basic information of name, state, capacity, type, whether formatted, serial number, reduced copy number, cache mode, fast read-write state, asynchronous rate and the like of the virtual disk, the basic information of the virtual disk copy includes basic information such as the state of the virtual disk copy, asynchronism, simplified copy, automatic expansion, over distribution, automatic deletion, encryption, capacity use condition and the like, the IO group information includes information such as the name of the IO group, the number of nodes, the number of hosts, a maintenance mode, encryption support, maximum refreshing copy and the like, the memory information includes information such as refreshing copy, remote copy, mirror copy, disk array copy and the like, and the basic information of the storage system includes information such as the name, version, model type, IP, frequency, total disk, total use, virtual disk and the like of the storage system.
In this embodiment, the monitoring information includes current storage information, current read-write information and read-write data set of the storage system, that is, when the monitoring information is visually displayed at the front end of the terminal device, only the current storage information of the storage system and the read-write information within a preset time are displayed. The read-write information is the data with the time tag, the storage information is the data without the time tag, and the read-write schedule of the storage system with the time tag can be generated through the read-write information. Specifically, the back end accesses the API of the storage system, so that real-time information of the monitoring storage system can be obtained, then the read-write information in the real-time information is stored in the time sequence database in advance, further when an operation instruction of the front end for visual display of the storage system is responded, current storage information and current read-write information of the storage system, namely the current real-time information of the storage system, are obtained through the API of the storage system, then a plurality of groups of read-write information, namely read-write data sets, in a preset time are obtained from the time sequence database, finally the current storage information, the current read-write information and the read-write data sets are subjected to corresponding processing to generate monitoring information which can be visually displayed at the front end, and the monitoring information can be pushed to the front end for visual display by adopting a WebSocket protocol, so that the monitoring information of the storage system cannot be quickly visually displayed, and meanwhile, the influence on the performance of the storage system is avoided.
The WebSocket protocol is a protocol for carrying out full duplex communication on a single TCP connection, so that data exchange between a client and a server becomes simpler, the server is allowed to actively push data to the client, meanwhile, the client and the server only need to complete one handshake, persistent connection can be directly established between the client and the server, bidirectional data transmission is carried out, and the stability of visual display of monitoring information of a storage system is greatly improved.
As shown in fig. 2, the specific steps of accessing the API interface of the storage system include:
s111: acquiring equipment information of the storage system; wherein the device information includes a device name, a device IP (Internet Protocol ), alarm group information, port information, a login account number, and a login password;
s112: generating a first request message for accessing an API interface of the storage system according to the equipment information;
s113: and accessing an API interface of the storage system according to the first request message.
In this embodiment, the device information includes a device name, a device IP, alarm group information, port information, a login account and a login password, and when the back end of the terminal device accesses the API interface of the storage system, only the device information of the storage system input at the front end needs to be acquired, so that a first request message for accessing the API interface of the storage system can be generated, and further access to the API interface of the storage system can be realized.
In other embodiments of the present application, as shown in fig. 3, after the access to the API of the storage system, the method further includes:
s114: receiving a response message sent by an API interface of the storage system;
s115: and analyzing the response message to obtain the real-time information of the storage system.
In this embodiment, after receiving a first request packet sent by the back end of the terminal device, the API of the storage system analyzes the first request packet, and queries the real-time information of the storage system in the storage system according to the analysis result, and after querying the real-time information of the storage system, the API of the storage system may send a response packet to the back end of the terminal device, and after receiving a response packet sent by the API of the storage system, the back end also performs corresponding analysis, so as to obtain the real-time information of the storage system.
In other embodiments of the present application, as shown in fig. 4, after the access to the API of the storage system, the method further includes:
s210: acquiring a request head of the first request message;
s220: generating a second request message for accessing the API interface of the storage system according to the request header of the first request message;
s230: and accessing the API interface of the storage system again according to the second request message.
In this embodiment, in the process that the back end of the terminal device calls the API of the storage system again to obtain the real-time information of the storage system, the request header of the second request packet sent to the API of the storage system refers to the request header of the first request packet to modify, specifically, the iBaseToken in the request header of the second request packet is set to be the same as the iBaseToken in the request header of the first request packet, so that the real-time information of the storage system can be quickly queried from the storage system.
In other embodiments of the present application, after the storing the read-write information in the preset time sequence database, the method further includes: and storing the storage information of the storage system in a preset cache database.
In this embodiment, after the back end of the terminal device accesses the API interface of the storage system to obtain the real-time information with the read-write information of the storage system, the storage information is stored in the preset cache database, so that when the storage system needs to be predicted by the storage information, the storage information under different time sequences can be quickly obtained. The cache database mentioned in this embodiment is a Redis database.
In other embodiments of the present application, as shown in fig. 5, after acquiring the read-write data set in the preset time in the time sequence database, the method further includes:
s310: acquiring a stored data set in a preset time from the cache database; wherein the stored data set comprises a plurality of sets of the stored information;
s320: processing the current stored information, the current read-write information, the read-write data set and the first stored information by adopting a decision tree algorithm to obtain first prediction information;
s330: pushing the first prediction information to the front end for visual display according to WebSocket protocol (a protocol for full duplex communication over a single TCP connection).
In this embodiment, the first prediction information is prediction information of a failure of the storage system, which may be obtained by predicting the storage information and the read/write information of the storage system. After a plurality of groups of storage information, current read-write information and a plurality of groups of read-write information in preset time are obtained, each data can be classified by adopting a decision tree algorithm, meanwhile, the feature with the greatest influence on the predicted information in the data is found out by adopting a induction method, then each data is processed into an inverted tree according to a fixed rule, and finally, the result is analyzed, so that first predicted information is obtained. The embodiment specifically adopts an ID3 algorithm to obtain the first prediction information, specifically takes the current stored information, the current read-write information, the read-write data set and the first stored information as one data set, classifies the data set based on a plurality of features (such as a read-write delay rate, a read-write data size, a read-write frequency and the like) in the data set, calculates the data set to generate an empirical entropy of the data set, calculates the empirical condition entropy of each feature on the data set, and further obtains a plurality of information gains of the data set according to the empirical entropy and the empirical condition entropy, wherein each information gain corresponds to one feature, classifies the data set according to the size of the information gain, analyzes the classification result and further obtains the first prediction information.
In other embodiments of the present application, as shown in fig. 6, after acquiring the read-write data set in the preset time in the time sequence database, the method further includes:
s410: acquiring environmental control information of a machine room where the storage system is located, and acquiring a storage data set in a preset time from the cache database; wherein the stored data set comprises a plurality of sets of the stored information;
s420: processing the current stored information, the current read-write information, the read-write data set, the first stored information and the environmental control information by adopting a decision tree algorithm to obtain second prediction information;
s430: pushing the second prediction information to the front end according to a WebSocket protocol for visual display.
In this embodiment, the second prediction information is also prediction information of failure of the storage system, which may be obtained by predicting the storage information, the read-write information, and the environmental control information of the machine room where the storage system is located. The environmental control information comprises information such as temperature, humidity and the like of the machine room, and the environmental control information can be obtained through corresponding sensors. After the plurality of sets of storage information, the current read-write information, the plurality of sets of read-write information and the environmental control information in the preset time are obtained, corresponding data processing can be performed by adopting the decision tree algorithm in the steps S310-S330, so that second prediction information can be obtained, and further the second prediction information can be pushed to the front end by adopting a WebSocket protocol for visual display.
In the monitoring method of the storage system provided by the embodiment of the application, the real-time information of the storage system is obtained by accessing the API interface of the storage system; the real-time information comprises read-write information and storage information of the storage system; storing the read-write information in a preset time sequence database; the read-write information comprises read-write times, read-write data size and read-write delay rate; responding to an operation instruction of the front end for visually displaying the storage system, and acquiring current storage information and current read-write information of the storage system; acquiring a read-write data set in preset time from the time sequence database; wherein the read-write data set comprises a plurality of groups of read-write information; processing the current storage information, the current read-write information and the read-write data set to obtain monitoring information of the storage system; pushing the monitoring information to the front end according to a WebSocket protocol for visual display. The method and the device can quickly carry out visual display on the monitoring information of the storage system, and greatly improve the monitoring efficiency of the storage system.
The embodiment of the application also provides a monitoring system 100 of a storage system, which is used for executing any embodiment of the monitoring method of the storage system.
In particular, referring to fig. 7, fig. 7 is a schematic block diagram of a monitoring system 100 of a storage system according to an embodiment of the present application.
As shown in fig. 7, the monitoring system 100 of the storage system includes: a first acquisition unit 110, a storage unit 120, a second acquisition unit 130, a third acquisition unit 140, a processing unit 150, and a pushing unit 160.
A first obtaining unit 110, configured to access an API interface of a storage system to obtain real-time information of the storage system; the real-time information comprises read-write information and storage information of the storage system;
the storage unit 120 is configured to store the read-write information in a preset time sequence database; the read-write information comprises read-write times, read-write data size and read-write delay rate;
a second obtaining unit 130, configured to obtain current storage information and current read-write information of the storage system in response to an operation instruction that the front end performs visual display on the storage system;
a third obtaining unit 140, configured to obtain a read-write data set in the time sequence database within a preset time; wherein the read-write data set comprises a plurality of groups of read-write information;
the processing unit 150 is configured to process the current stored information, the current read-write information, and the read-write data set to obtain monitoring information of the storage system;
and the pushing unit 160 is configured to push the monitoring information to the front end for visual display according to WebSocket protocol.
The monitoring system 100 of the storage system provided by the embodiment of the application is used for executing the above access to the API interface of the storage system to obtain the real-time information of the storage system; the real-time information comprises read-write information and storage information of the storage system; storing the read-write information in a preset time sequence database; the read-write information comprises read-write times, read-write data size and read-write delay rate; responding to an operation instruction of the front end for visually displaying the storage system, and acquiring current storage information and current read-write information of the storage system; acquiring a read-write data set in preset time from the time sequence database; wherein the read-write data set comprises a plurality of groups of read-write information; processing the current storage information, the current read-write information and the read-write data set to obtain monitoring information of the storage system; pushing the monitoring information to the front end according to a WebSocket protocol for visual display.
It should be noted that, as will be clearly understood by those skilled in the art, the specific implementation process of the monitoring system 100 and each unit of the storage system may refer to the corresponding description in the foregoing method embodiment, and for convenience and brevity of description, the description is omitted here.
The monitoring system of the storage system described above may be implemented in the form of a computer program that is executable on an electronic device as shown in fig. 8. The electronic device comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor realizes the monitoring method of the storage system when executing the computer program.
Referring to fig. 8, fig. 8 is a schematic block diagram of an electronic device according to an embodiment of the present application.
With reference to fig. 8, the device 500 includes a processor 502, a memory, and a network interface 505, which are connected by a system bus 501, wherein the memory may include a storage medium 503 and an internal memory 504.
The storage medium 503 may store an operating system 5031 and a computer program 5032. The computer program 5032, when executed, causes the processor 502 to perform a method of monitoring a storage system.
The processor 502 is used to provide computing and control capabilities to support the operation of the overall device 500.
The internal memory 504 provides an environment for the execution of a computer program 5032 in the non-volatile storage medium 503, which computer program 5032, when executed by the processor 502, causes the processor 502 to perform a method of monitoring a storage system.
The network interface 505 is used for network communication, such as providing for transmission of data information, etc. It will be appreciated by those skilled in the art that the structure shown in fig. 8 is merely a block diagram of a portion of the structure associated with the present inventive arrangements and is not limiting of the apparatus 500 to which the present inventive arrangements are applied, and that a particular apparatus 500 may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
Wherein the processor 502 is configured to execute a computer program 5032 stored in a memory to perform the following functions: accessing an API (application program interface) of a storage system to acquire real-time information of the storage system; the real-time information comprises read-write information and storage information of the storage system; storing the read-write information in a preset time sequence database; the read-write information comprises read-write times, read-write data size and read-write delay rate; responding to an operation instruction of the front end for visually displaying the storage system, and acquiring current storage information and current read-write information of the storage system; acquiring a read-write data set in preset time from the time sequence database; wherein the read-write data set comprises a plurality of groups of read-write information; processing the current storage information, the current read-write information and the read-write data set to obtain monitoring information of the storage system; pushing the monitoring information to the front end according to a WebSocket protocol for visual display.
Those skilled in the art will appreciate that the embodiment of the apparatus 500 shown in fig. 8 is not limiting of the specific construction of the apparatus 500, and in other embodiments, the apparatus 500 may include more or less components than illustrated, or certain components may be combined, or a different arrangement of components. For example, in some embodiments, the device 500 may include only the memory and the processor 502, and in such embodiments, the structure and the function of the memory and the processor 502 are consistent with the embodiment shown in fig. 8, and will not be described herein.
It should be appreciated that in an embodiment of the application, the processor 502 may be a central processing unit (Central Processing Unit, CPU), the processor 502 may also be other general purpose processors 502, digital signal processors 502 (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. Wherein the general purpose processor 502 may be the microprocessor 502 or the processor 502 may be any conventional processor 502 or the like.
In another embodiment of the present application, a computer storage medium is also provided. The storage medium may be a nonvolatile computer-readable storage medium or a volatile storage medium. The storage medium stores a computer program 5032, wherein the computer program 5032 when executed by the processor 502 performs the steps of: accessing an API (application program interface) of a storage system to acquire real-time information of the storage system; the real-time information comprises read-write information and storage information of the storage system; storing the read-write information in a preset time sequence database; the read-write information comprises read-write times, read-write data size and read-write delay rate; responding to an operation instruction of the front end for visually displaying the storage system, and acquiring current storage information and current read-write information of the storage system; acquiring a read-write data set in preset time from the time sequence database; wherein the read-write data set comprises a plurality of groups of read-write information; processing the current storage information, the current read-write information and the read-write data set to obtain monitoring information of the storage system; pushing the monitoring information to the front end according to a WebSocket protocol for visual display.
It will be clearly understood by those skilled in the art that, for convenience and brevity of description, specific working procedures of the apparatus, device and unit described above may refer to corresponding procedures in the foregoing method embodiments, which are not repeated herein. Those of ordinary skill in the art will appreciate that the elements and algorithm steps described in connection with the embodiments disclosed herein may be embodied in electronic hardware, in computer software, or in a combination of the two, and that the elements and steps of the examples have been generally described in terms of function in the foregoing description to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the several embodiments provided by the present application, it should be understood that the disclosed apparatus, device and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, and for example, the division of the units is merely a logical function division, there may be another division manner in actual implementation, or units having the same function may be integrated into one unit, for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. In addition, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices, or elements, or may be an electrical, mechanical, or other form of connection.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment of the present application.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units may be stored in a storage medium if implemented in the form of software functional units and sold or used as stand-alone products. Based on such understanding, the technical solution of the present application may be essentially or a part contributing to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, comprising several instructions for causing an apparatus 500 (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a magnetic disk, an optical disk, or other various media capable of storing program codes.
While the application has been described with reference to certain preferred embodiments, it will be understood by those skilled in the art that various changes and substitutions of equivalents may be made and equivalents will be apparent to those skilled in the art without departing from the scope of the application.

Claims (10)

1. The monitoring method of the storage system is characterized by comprising the following steps of:
accessing an API (application program interface) of a storage system to acquire real-time information of the storage system; the real-time information comprises read-write information and storage information of the storage system;
storing the read-write information in a preset time sequence database; the read-write information comprises read-write times, read-write data size and read-write delay rate;
responding to an operation instruction of the front end for visually displaying the storage system, and acquiring current storage information and current read-write information of the storage system;
acquiring a read-write data set in preset time from the time sequence database; wherein the read-write data set comprises a plurality of groups of read-write information;
processing the current storage information, the current read-write information and the read-write data set to obtain monitoring information of the storage system;
pushing the monitoring information to the front end according to a WebSocket protocol for visual display.
2. The method for monitoring a storage system according to claim 1, wherein the accessing the API of the storage system comprises the steps of:
acquiring equipment information of the storage system; the device information comprises a device name, a device IP, alarm group information, port information, a login account and a login password;
generating a first request message for accessing an API interface of the storage system according to the equipment information;
and accessing an API interface of the storage system according to the first request message.
3. The method for monitoring a storage system according to claim 2, further comprising, after said accessing the API of the storage system:
receiving a response message sent by an API interface of the storage system;
and analyzing the response message to obtain the real-time information of the storage system.
4. The method for monitoring a storage system according to claim 2, further comprising, after said accessing the API of the storage system:
acquiring a request head of the first request message;
generating a second request message for accessing the API interface of the storage system according to the request header of the first request message;
and accessing the API interface of the storage system again according to the second request message.
5. The method for monitoring a memory system according to claim 1, further comprising, after said storing said read-write information in a predetermined time-series database:
and storing the storage information of the storage system in a preset cache database.
6. The method for monitoring a memory system according to claim 5, further comprising, after acquiring the read-write data set in the time-series database for a predetermined time, the steps of:
acquiring a stored data set in a preset time from the cache database; wherein the stored data set comprises a plurality of sets of the stored information;
processing the current stored information, the current read-write information, the read-write data set and the first stored information by adopting a decision tree algorithm to obtain first prediction information;
pushing the first prediction information to the front end according to a WebSocket protocol for visual display.
7. The method for monitoring a memory system according to claim 5, further comprising, after acquiring the read-write data set in the time-series database for a predetermined time, the steps of:
acquiring environmental control information of a machine room where the storage system is located, and acquiring a storage data set in a preset time from the cache database; wherein the stored data set comprises a plurality of sets of the stored information;
processing the current stored information, the current read-write information, the read-write data set, the first stored information and the environmental control information by adopting a decision tree algorithm to obtain second prediction information;
pushing the second prediction information to the front end according to a WebSocket protocol for visual display.
8. A monitoring system for a storage system, comprising:
the first acquisition unit is used for accessing an API (application program interface) of the storage system to acquire real-time information of the storage system; the real-time information comprises read-write information and storage information of the storage system;
the storage unit is used for storing the read-write information in a preset time sequence database; the read-write information comprises read-write times, read-write data size and read-write delay rate;
the second acquisition unit is used for responding to an operation instruction of the front end for carrying out visual display on the storage system and acquiring current storage information and current read-write information of the storage system;
the third acquisition unit is used for acquiring a read-write data set in a preset time in the time sequence database; wherein the read-write data set comprises a plurality of groups of read-write information;
the processing unit is used for processing the current storage information, the current read-write information and the read-write data set to obtain monitoring information of the storage system;
and the pushing unit is used for pushing the monitoring information to the front end for visual display according to a WebSocket protocol.
9. An electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing a method of monitoring a storage system according to any one of claims 1 to 7 when the computer program is executed.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps in the method of monitoring a storage system according to any of claims 1 to 7.
CN202310823660.9A 2023-07-05 2023-07-05 Monitoring method and system of storage system, electronic equipment and readable storage medium Pending CN116909853A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310823660.9A CN116909853A (en) 2023-07-05 2023-07-05 Monitoring method and system of storage system, electronic equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310823660.9A CN116909853A (en) 2023-07-05 2023-07-05 Monitoring method and system of storage system, electronic equipment and readable storage medium

Publications (1)

Publication Number Publication Date
CN116909853A true CN116909853A (en) 2023-10-20

Family

ID=88355606

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310823660.9A Pending CN116909853A (en) 2023-07-05 2023-07-05 Monitoring method and system of storage system, electronic equipment and readable storage medium

Country Status (1)

Country Link
CN (1) CN116909853A (en)

Similar Documents

Publication Publication Date Title
US11860874B2 (en) Multi-partitioning data for combination operations
US11863408B1 (en) Generating event streams including modified network data monitored by remote capture agents
US11550829B2 (en) Systems and methods for load balancing in a system providing dynamic indexer discovery
US10180891B2 (en) Monitoring processes running on a platform as a service architecture
US11151137B2 (en) Multi-partition operation in combination operations
US9344515B2 (en) Social-driven precaching of accessible objects
US8145614B1 (en) Selection of a data path based on the likelihood that requested information is in a cache
KR101227769B1 (en) Mobile network background traffic data management with optimized polling intervals
CN109947668B (en) Method and device for storing data
US11062016B2 (en) Systems and methods for verifying user credentials for search
US7688753B1 (en) Selection of a data path based on one or more performance characteristics of a computer system
CN111124819B (en) Method and device for full link monitoring
CN108108286A (en) Method of data capture and device, server, storage medium
US10284443B2 (en) Monitoring of services
CN113010565B (en) Server real-time data processing method and system based on server cluster
US9838467B2 (en) Dynamically instantiating dual-queue systems
US20230237064A1 (en) Data processing method, apparatus, and system, computer device, readable storage medium, and computer program product
US20220286373A1 (en) Scalable real time metrics management
WO2020036763A1 (en) Testing data changes in production systems
JP2019016042A (en) Data acquisition program, device, and method
EP2811410B1 (en) Monitoring record management method and device
CN108667740B (en) Flow control method, device and system
US7962657B1 (en) Selection of a data path based on operation type
US11509669B2 (en) Network data timeline
US20150264113A1 (en) Dynamic Batching

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination