CN113741807B - Method, system, equipment and storage medium for improving system storage performance - Google Patents
Method, system, equipment and storage medium for improving system storage performance Download PDFInfo
- Publication number
- CN113741807B CN113741807B CN202110867262.8A CN202110867262A CN113741807B CN 113741807 B CN113741807 B CN 113741807B CN 202110867262 A CN202110867262 A CN 202110867262A CN 113741807 B CN113741807 B CN 113741807B
- Authority
- CN
- China
- Prior art keywords
- performance
- layering
- model
- storage
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 238000001514 detection method Methods 0.000 claims abstract description 14
- 230000005291 magnetic effect Effects 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 13
- 230000001133 acceleration Effects 0.000 abstract description 6
- 230000000737 periodic effect Effects 0.000 abstract description 6
- 230000008569 process Effects 0.000 description 11
- 230000001360 synchronised effect Effects 0.000 description 8
- 210000004027 cell Anatomy 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 238000013461 design Methods 0.000 description 4
- 238000010438 heat treatment Methods 0.000 description 4
- 230000007774 longterm Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000003068 static effect Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000005055 memory storage Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000005294 ferromagnetic effect Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000007334 memory performance Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 210000000352 storage cell Anatomy 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
- G06F3/0676—Magnetic disk device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application provides a method, a system, equipment and a storage medium for improving the storage performance of a system, wherein the method comprises the steps of carrying out preset layering on a disk module according to the disk medium, and periodically detecting the performance of an I/O model of the disk module after the preset layering to obtain the actual performance of the I/O model; the I/O model is used for representing the storage mode of the data block; judging whether the actual performance of the I/O model is the same as the preset layering performance, and if the actual performance is different in the preset period, adjusting layering of the disk module according to the ratio of the performance difference ratio; based on the method, a system, equipment and a storage medium for improving the storage performance of the system are also provided, the method comprehensively confirms the rationality of the data layering of the system where the system is located with a preset disk medium according to the periodic disk performance detection, and respectively calibrates the data layering according to the size data blocks, so that a high-efficiency layering acceleration function can be provided for the system all the time, and the performance of the whole system is further improved.
Description
Technical Field
The application belongs to the technical field of distributed file system storage, and particularly relates to a method, a system, equipment and a storage medium for improving the storage performance of a system.
Background
The memory array is composed of a large number of memory cells, and each memory cell can store 1-bit binary data (0, 1). Typically, the memory cells are arranged in a matrix of N rows by M columns. A plurality of magnetic disks are formed into an array, and the array is used as a single magnetic disk, and the data are stored in different magnetic disks in a segmented (string) mode, so that when the data are accessed, the relevant magnetic disks in the array act together, the access time of the data is greatly reduced, and meanwhile, the space utilization rate is better. Current unified array storage generally employs layered acceleration functionality for disk media to improve system performance. Different layering is carried out according to different types of magnetic discs such as FLASH, SAS, NLSAS and the like, hot data run on an SLC FLASH layer, warm data run on an TLC FLASH layer, cold data run on a low-rotation-speed HDD layer and the like. Where slc=single-Level Cell, i.e. 1 bit per Cell,1 memory storage Cell can hold 1 bit of data, only with two charge values of 0 and 1. tlc=triple-Level Cell, i.e. 3 bit per Cell,1 memory storage unit can hold 3 bits of data.
However, the method for layering the media is simple and rough, the layering finally depends on different performances of the magnetic disk, and according to different technical maturity or process gap, the condition that the performances of SLC FLASH of partial manufacturers are lower than those of MLC FLASH of other manufacturers exists, if SLC of low-performance manufacturers is set to run heat data at the moment, and compared with MLC run heat data of high-performance manufacturers, a heat data layer becomes a bottleneck in IO flow, so that the performances of the whole system are affected.
Disclosure of Invention
In order to solve the technical problems, the application provides a method, a system, equipment and a storage medium for improving the storage performance of a system, which are used for comprehensively confirming the rationality of data layering of the system where the system is located with a preset disk medium according to the periodic disk performance detection, respectively calibrating the data layering according to the size data blocks, ensuring that the high-efficiency layering acceleration function can be provided for the system all the time, and further improving the performance of the whole system.
In order to achieve the above purpose, the present application adopts the following technical scheme:
a method of improving system memory performance, comprising the steps of:
periodically detecting the performance of the I/O model of the disk module after preset layering to obtain the actual performance of the I/O model; the I/O model is used for representing the storage mode of the data block;
judging whether the actual performance of the I/O model is the same as the preset layering performance, and if the actual performance is different in the preset period, adjusting layering of the disk module according to the ratio of the performance difference ratio; the performance difference ratio is the ratio of the preset layering performance to the actual performance.
Further, before the periodic detection of the I/O model performance of the disk module after the layering, the method further includes: and carrying out preset layering on the disk module according to the disk medium, and sending the preset layering information to an operating system.
Further, the performing preset layering on the disk module according to the disk medium includes:
storing the thermal data to FLASH;
storing the temperature data to the SAS;
the cold data is stored to the NL SAS.
Further, the I/O model specifically comprises a big data block sequential storage model, a big data block random storage model, a small data sequential storage model and a small data block random storage model;
the large data block ranges from [256KB,1M ]; the small data block ranges from (0 KB,16 KB).
Further, the method for periodically detecting the performance of the I/O model of the disk module after the preset layering to obtain the actual performance of the I/O model includes:
and periodically polling the I/O models to obtain the performance value fed back by each I/O model.
Further, the adjusting the layering of the disk modules according to the ratio of the performance difference values includes:
judging whether the current system is fully loaded, if so, setting a first proportion of a performance difference ratio to be 10-15%, and adjusting layering of the disk module according to the first proportion; and if the magnetic disk module is not fully loaded, setting a second proportion of the performance difference ratio to be 3-5%, and adjusting layering of the magnetic disk module through the second proportion.
Furthermore, the method also comprises the step of not adjusting if the actual performance of the I/O model is the same as the preset layering performance.
The application also provides a system for improving the storage performance of the system, which comprises a detection module and an adjustment module;
the detection module is used for periodically detecting the performance of the I/O model of the disk module after the preset layering to obtain the actual performance of the I/O model; the I/O model is used for representing the storage mode of the data block;
the adjusting module is used for judging whether the actual performance of the I/O model is the same as the preset layering performance, and if the actual performance is different in the preset period, layering of the disk module is adjusted according to the proportion of the performance difference ratio; the performance difference ratio is the ratio of the preset layering performance to the actual performance.
The application also proposes a device comprising:
a memory for storing a computer program;
and a processor for implementing the method steps when executing the computer program.
The application also proposes a readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method steps.
The effects provided in the summary of the application are merely effects of embodiments, not all effects of the application, and one of the above technical solutions has the following advantages or beneficial effects:
the application provides a method, a system, equipment and a storage medium for improving the storage performance of a system, wherein the method comprises the steps of carrying out preset layering on a disk module according to the disk medium, sending preset layering information to an operating system, and periodically detecting the performance of an I/O model of the disk module after the preset layering to obtain the actual performance of the I/O model; the I/O model is used for representing the storage mode of the data block; judging whether the actual performance of the I/O model is the same as the preset layering performance, and if the actual performance is different in the preset period, adjusting layering of the disk module according to the ratio of the performance difference ratio; the performance difference ratio is the ratio of the preset layering performance to the actual performance. According to the method, the rationality of the data layering of the system where the periodic disk performance detection and the preset disk medium are comprehensively confirmed, and the data layering is respectively calibrated according to the size data blocks, so that the high-efficiency layering acceleration function can be provided for the system all the time, and the performance of the whole system is improved.
In the application, layering of the disk modules is regulated according to the proportion of the performance difference ratio, and the same medium disk of the same manufacturer can be judged to be different data layers if the performance difference is caused by the use time length and the process difference.
Based on a method for improving the storage performance of the system, the application also provides a system, equipment and a storage medium for improving the storage performance of the system, and the process realized by the method is realized in a modularized manner, so that the method has the functions and is not repeated herein.
Drawings
FIG. 1 is a flow chart of a method for improving the storage performance of a system according to embodiment 1 of the present application;
FIG. 2 is a schematic diagram of a method module implementation for improving the storage performance of a system according to embodiment 1 of the present application;
fig. 3 is a schematic diagram of a system for improving storage performance of a system according to embodiment 2 of the present application.
Detailed Description
In order to clearly illustrate the technical features of the present solution, the present application will be described in detail below with reference to the following detailed description and the accompanying drawings. The following disclosure provides many different embodiments, or examples, for implementing different structures of the application. In order to simplify the present disclosure, components and arrangements of specific examples are described below. Furthermore, the present application may repeat reference numerals and/or letters in the various examples. This repetition is for the purpose of simplicity and clarity and does not in itself dictate a relationship between the various embodiments and/or configurations discussed. It should be noted that the components illustrated in the figures are not necessarily drawn to scale. Descriptions of well-known components and processing techniques and processes are omitted so as to not unnecessarily obscure the present application.
Example 1
The embodiment 1 of the application provides a method for improving the storage performance of a system, which solves the technical problem that the system performance is affected by layering, simple and rough answers according to different media in the prior art.
A flowchart of a method for improving the storage performance of the system according to embodiment 1 of the present application is shown in fig. 1.
In step S101, the system initializes, and divides the storage module into a plurality of data layers according to a preset storage medium. FLASH is Tier0, SAS is Tier1 and NL SAS is Tier2. The instant heating data is stored into FLASH; storing the temperature data to the SAS; the cold data is stored to the NL SAS.
In step S102, periodically detecting the performance of the I/O model of the disk module after preset layering to obtain the actual performance of the I/O model;
wherein the I/O model is used to characterize the storage mode of the data block. The I/O model comprises, but is not limited to, the following four modes, namely a big data block sequential storage model, a big data block random storage model, a small data sequential storage model and a small data block random storage model; wherein the large data block ranges from [256KB,1M ]; the small data blocks range from (0 KB,16 KB).
The method for periodically detecting the performance of the I/O model of the disk module after the preset layering to obtain the actual performance of the I/O model comprises the following steps:
and periodically polling the I/O models to obtain the performance value fed back by each I/O model. The four I/O models are simulated, data are issued, and the performance value fed back by each I/O model is obtained. The different I/O models are then put into the performance optimized data layer.
In the application, the time period is different according to different media. If the system is initialized, the time period is set to be relatively short, typically 24 hours to 72 hours, if the time period is set to be 15 days after the system is stabilized, if the time period for the system to run is longer, the time period can be set to be 30 days after the system is more stabilized, the number of days of the time period protected in the present application is not limited to the number of days listed in embodiment 1, and the person skilled in the art can reasonably design the method. The time period may also be set shorter, say less than 24 hours, if the system detected I/O model is constantly changing. If the system detects an I/O pattern that is unchanged for a long period of time, such as sequential reading of long-term large data blocks, it is also possible to set a time period of more than 30 days.
In step S103, it is determined whether the actual performance of the I/O model is the same as the preset layering performance, and if the actual performance is different in the preset period, layering of the disk module is adjusted according to the ratio of the performance difference ratio; the performance difference ratio is the ratio of the preset layering performance to the actual performance.
The actual performance of the I/O model is the same as the preset layering performance, and no adjustment is made.
The preset period in the present application may be three periods. The scope of the present application is not limited to the number of cycles listed in example 1, and those skilled in the art can set the scope according to the actual situation.
The adjusting of the layering of the disk modules according to the ratio of the performance difference values comprises:
judging whether the current system is fully loaded, if so, setting a first proportion of a performance difference ratio to be 10-15%, and adjusting layering of the disk module according to the first proportion; if the disk module is not fully loaded, setting a second proportion of the performance difference ratio to be 3-5%, and adjusting layering of the disk module through the second proportion.
According to the principle, the same medium disk of the same manufacturer can be judged to be different data layers if the performance difference is caused by the use time length and the process difference. In addition, the real-time disk performance is layered according to different IO models.
FIG. 2 is a schematic diagram of a method module implementation for improving the storage performance of a system according to embodiment 1 of the present application; the method for improving the storage performance of the system disclosed in the embodiment 1 of the application is realized by adopting a dynamic hierarchical management module, wherein the dynamic hierarchical management module is positioned on a board card and mainly applied to programmable logic devices such as ARM and the like. In addition, the topology diagram also comprises an OS module, a hard disk module, an indication module, a wireless module and a serial port module
OS module: the module performs IO issuing according to the data layering mode provided by the dynamic layering management module.
And (3) a magnetic disk module: is directly managed by the dynamic hierarchical management module, and sends various disk management information to the dynamic hierarchical management module.
An indication module: the module is positioned on the board and is directly controlled by the serial port module to externally indicate the real-time state of the current dynamic hierarchical management module.
And a wireless module: the serial port module signals can be converted into wireless signals such as WIFI and the like, and the outside can interact information with the dynamic layering management module without using an entity serial port line.
Serial port module: the serial port module can be used for carrying out information interaction between the outside and the dynamic hierarchical management module and setting related parameters.
According to the method for improving the storage performance of the system, provided by the application, the rationality of the data layering of the system where the periodic magnetic disk performance detection is located is comprehensively confirmed with the preset magnetic disk medium, and the data layering is respectively calibrated according to the size data blocks, so that the high-efficiency layering acceleration function can be always provided for the system, and the performance of the whole system is further improved.
Example 2
Based on the method for improving the storage performance of the system provided by the embodiment 1 of the application, the embodiment 2 of the application also provides a system for improving the storage performance of the system. Fig. 3 is a schematic diagram of a system for improving storage performance of a system according to embodiment 2 of the present application. The system comprises a detection module and an adjustment module;
the detection module is used for periodically detecting the performance of the I/O model of the disk module after the preset layering to obtain the actual performance of the I/O model; the I/O model is used for representing the storage mode of the data block;
the adjusting module is used for judging whether the actual performance of the I/O model is the same as the preset layering performance, and if the actual performance is different in the preset period, layering of the disk module is adjusted according to the proportion of the performance difference ratio; the performance difference ratio is the ratio of the preset layering performance to the actual performance.
The system also comprises a sub-conversion module; the dividing module is used for initializing the system and dividing the storage module into a plurality of data layers according to a preset storage medium.
FLASH is Tier0, SAS is Tier1 and NL SAS is Tier2. The instant heating data is stored into FLASH; storing the temperature data to the SAS; the cold data is stored to the NL SAS.
Wherein, detection module realizes the in-process:
wherein the I/O model is used to characterize the storage mode of the data block. The I/O model comprises, but is not limited to, the following four modes, namely a big data block sequential storage model, a big data block random storage model, a small data sequential storage model and a small data block random storage model; wherein the large data block ranges from [256KB,1M ]; the small data blocks range from (0 KB,16 KB).
The method for periodically detecting the performance of the I/O model of the disk module after the preset layering to obtain the actual performance of the I/O model comprises the following steps:
and periodically polling the I/O models to obtain the performance value fed back by each I/O model. The four I/O models are simulated, data are issued, and the performance value fed back by each I/O model is obtained. The different I/O models are then put into the performance optimized data layer.
In the application, the time period is different according to different media. If the system is initialized, the time period is set to be relatively short, typically 24 hours to 72 hours, if the time period is set to be 15 days after the system is stabilized, if the time period for the system to run is longer, the time period can be set to be 30 days after the system is more stabilized, the number of days of the time period protected in the present application is not limited to the number of days listed in embodiment 1, and the person skilled in the art can reasonably design the method. The time period may also be set shorter, say less than 24 hours, if the system detected I/O model is constantly changing. If the system detects an I/O pattern that is unchanged for a long period of time, such as sequential reading of long-term large data blocks, it is also possible to set a time period of more than 30 days.
In the process of realizing the detection module: the actual performance of the I/O model is the same as the preset layering performance, and no adjustment is made.
The preset period in the present application may be three periods. The scope of the present application is not limited to the number of cycles listed in example 1, and those skilled in the art can set the scope according to the actual situation.
The adjusting of the layering of the disk modules according to the ratio of the performance difference values comprises:
judging whether the current system is fully loaded, if so, setting a first proportion of a performance difference ratio to be 10-15%, and adjusting layering of the disk module according to the first proportion; if the disk module is not fully loaded, setting a second proportion of the performance difference ratio to be 3-5%, and adjusting layering of the disk module through the second proportion.
According to the principle, the same medium disk of the same manufacturer can be judged to be different data layers if the performance difference is caused by the use time length and the process difference. In addition, the real-time disk performance is layered according to different IO models.
The embodiment 2 of the application provides a system for improving the storage performance of a system, which is characterized in that according to periodic disk performance detection, the rationality of the data layering of the system where the system is located is comprehensively confirmed with a preset disk medium, and the data layering is respectively calibrated according to the size data blocks, so that the system can be ensured to be always provided with a high-efficiency layering acceleration function, and the performance of the whole system is further improved.
Example 3
The application also proposes a device comprising:
a memory for storing a computer program;
the processor is used for realizing the following steps when executing the computer program:
in step S101, the system initializes, and divides the storage module into a plurality of data layers according to a preset storage medium. FLASH is Tier0, SAS is Tier1 and NL SAS is Tier2. The instant heating data is stored into FLASH; storing the temperature data to the SAS; the cold data is stored to the NL SAS.
In step S102, periodically detecting the performance of the I/O model of the disk module after preset layering to obtain the actual performance of the I/O model;
wherein the I/O model is used to characterize the storage mode of the data block. The I/O model comprises, but is not limited to, the following four modes, namely a big data block sequential storage model, a big data block random storage model, a small data sequential storage model and a small data block random storage model; wherein the large data block ranges from [256KB,1M ]; the small data blocks range from (0 KB,16 KB).
The method for periodically detecting the performance of the I/O model of the disk module after the preset layering to obtain the actual performance of the I/O model comprises the following steps:
and periodically polling the I/O models to obtain the performance value fed back by each I/O model. The four I/O models are simulated, data are issued, and the performance value fed back by each I/O model is obtained. The different I/O models are then put into the performance optimized data layer.
In the application, the time period is different according to different media. If the system is initialized, the time period is set to be relatively short, typically 24 hours to 72 hours, if the time period is set to be 15 days after the system is stabilized, if the time period for the system to run is longer, the time period can be set to be 30 days after the system is more stabilized, the number of days of the time period protected in the present application is not limited to the number of days listed in embodiment 1, and the person skilled in the art can reasonably design the method. The time period may also be set shorter, say less than 24 hours, if the system detected I/O model is constantly changing. If the system detects an I/O pattern that is unchanged for a long period of time, such as sequential reading of long-term large data blocks, it is also possible to set a time period of more than 30 days.
In step S103, it is determined whether the actual performance of the I/O model is the same as the preset layering performance, and if the actual performance is different in the preset period, layering of the disk module is adjusted according to the ratio of the performance difference ratio; the performance difference ratio is the ratio of the preset layering performance to the actual performance.
The actual performance of the I/O model is the same as the preset layering performance, and no adjustment is made.
The preset period in the present application may be three periods. The scope of the present application is not limited to the number of cycles listed in example 1, and those skilled in the art can set the scope according to the actual situation.
The adjusting of the layering of the disk modules according to the ratio of the performance difference values comprises:
judging whether the current system is fully loaded, if so, setting a first proportion of a performance difference ratio to be 10-15%, and adjusting layering of the disk module according to the first proportion; if the disk module is not fully loaded, setting a second proportion of the performance difference ratio to be 3-5%, and adjusting layering of the disk module through the second proportion.
According to the principle, the same medium disk of the same manufacturer can be judged to be different data layers if the performance difference is caused by the use time length and the process difference. In addition, the real-time disk performance is layered according to different IO models.
It is necessary to explain that: the technical scheme of the application also provides electronic equipment, which comprises: a communication interface capable of information interaction with other devices such as a network device and the like; and the processor is connected with the communication interface to realize information interaction with other devices, and is used for executing the method for improving the system storage performance provided by one or more of the technical schemes when running the computer program, and the computer program is stored in the memory. Of course, in practice, the various components in the electronic device are coupled together by a bus system. It will be appreciated that a bus system is used to enable connected communications between these components. The bus system includes a power bus, a control bus, and a status signal bus in addition to the data bus. The memory in the embodiments of the present application is used to store various types of data to support the operation of the electronic device. Examples of such data include: any computer program for operating on an electronic device. It will be appreciated that the memory can be either volatile memory or nonvolatile memory, and can include both volatile and nonvolatile memory. Wherein the nonvolatile Memory may be Read Only Memory (ROM), programmable Read Only Memory (PROM, programmable Read-Only Memory), erasable programmable Read Only Memory (EPROM, erasable Programmable Read-Only Memory), electrically erasable programmable Read Only Memory (EEPROM, electrically Erasable Programmable Read-Only Memory), magnetic random access Memory (FRAM, ferromagnetic random access Memory), flash Memory (Flash Memory), magnetic surface Memory, optical disk, or compact disk Read Only Memory (CD-ROM, compact Disc Read-Only Memory); the magnetic surface memory may be a disk memory or a tape memory. The volatile memory may be random access memory (RAM, random AccessMemory), which acts as external cache memory. By way of example, and not limitation, many forms of RAM are available, such as static random access memory (SRAM, static Random Access Memory), synchronous static random access memory (SSRAM, synchronous Static Random Access Memory), dynamic random access memory (DRAM, dynamic Random Access Memory), synchronous dynamic random access memory (SDRAM, synchronousDynamic Random Access Memory), double data rate synchronous dynamic random access memory (ddr sdram, double Data Rate Synchronous Dynamic Random Access Memory), enhanced synchronous dynamic random access memory (ESDRAM, enhanced Synchronous Dynamic Random Access Memory), synchronous link dynamic random access memory (SLDRAM, syncLink Dynamic Random Access Memory), direct memory bus random access memory (DRRAM, direct Rambus Random Access Memory). The memory described by embodiments of the present application is intended to comprise, without being limited to, these and any other suitable types of memory. The method disclosed by the embodiment of the application can be applied to a processor or realized by the processor. The processor may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in a processor or by instructions in the form of software. The processor may be a general purpose processor, a DSP (Digital Signal Processing, meaning a chip capable of implementing digital signal processing techniques), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. The processor may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the present application. The general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed in the embodiment of the application can be directly embodied in the hardware of the decoding processor or can be implemented by combining hardware and software modules in the decoding processor. The software modules may be located in a storage medium having a memory, and the processor reads the program in the memory and performs the steps of the method in combination with its hardware. The corresponding flow in each method of the embodiments of the present application is implemented when the processor executes the program, and for brevity, will not be described in detail herein.
Example 4
The application also provides a readable storage medium, the readable storage medium stores a computer program, and the computer program when executed by a processor realizes the following steps:
in step S101, the system initializes, and divides the storage module into a plurality of data layers according to a preset storage medium. FLASH is Tier0, SAS is Tier1 and NL SAS is Tier2. The instant heating data is stored into FLASH; storing the temperature data to the SAS; the cold data is stored to the NL SAS.
In step S102, periodically detecting the performance of the I/O model of the disk module after preset layering to obtain the actual performance of the I/O model;
wherein the I/O model is used to characterize the storage mode of the data block. The I/O model comprises, but is not limited to, the following four modes, namely a big data block sequential storage model, a big data block random storage model, a small data sequential storage model and a small data block random storage model; wherein the large data block ranges from [256KB,1M ]; the small data blocks range from (0 KB,16 KB).
The method for periodically detecting the performance of the I/O model of the disk module after the preset layering to obtain the actual performance of the I/O model comprises the following steps:
and periodically polling the I/O models to obtain the performance value fed back by each I/O model. The four I/O models are simulated, data are issued, and the performance value fed back by each I/O model is obtained. The different I/O models are then put into the performance optimized data layer.
In the application, the time period is different according to different media. If the system is initialized, the time period is set to be relatively short, typically 24 hours to 72 hours, if the time period is set to be 15 days after the system is stabilized, if the time period for the system to run is longer, the time period can be set to be 30 days after the system is more stabilized, the number of days of the time period protected in the present application is not limited to the number of days listed in embodiment 1, and the person skilled in the art can reasonably design the method. The time period may also be set shorter, say less than 24 hours, if the system detected I/O model is constantly changing. If the system detects an I/O pattern that is unchanged for a long period of time, such as sequential reading of long-term large data blocks, it is also possible to set a time period of more than 30 days.
In step S103, it is determined whether the actual performance of the I/O model is the same as the preset layering performance, and if the actual performance is different in the preset period, layering of the disk module is adjusted according to the ratio of the performance difference ratio; the performance difference ratio is the ratio of the preset layering performance to the actual performance.
The actual performance of the I/O model is the same as the preset layering performance, and no adjustment is made.
The preset period in the present application may be three periods. The scope of the present application is not limited to the number of cycles listed in example 1, and those skilled in the art can set the scope according to the actual situation.
The adjusting of the layering of the disk modules according to the ratio of the performance difference values comprises:
judging whether the current system is fully loaded, if so, setting a first proportion of a performance difference ratio to be 10-15%, and adjusting layering of the disk module according to the first proportion; if the disk module is not fully loaded, setting a second proportion of the performance difference ratio to be 3-5%, and adjusting layering of the disk module through the second proportion.
According to the principle, the same medium disk of the same manufacturer can be judged to be different data layers if the performance difference is caused by the use time length and the process difference. In addition, the real-time disk performance is layered according to different IO models.
The description of the relevant parts in the device and the storage medium for improving the storage performance of the system provided by the embodiment of the present application may refer to the detailed description of the corresponding parts in the method for improving the storage performance of the system provided by embodiment 1 of the present application, which is not repeated here.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements is inherent to. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. In addition, the parts of the above technical solutions provided in the embodiments of the present application, which are consistent with the implementation principles of the corresponding technical solutions in the prior art, are not described in detail, so that redundant descriptions are avoided.
While the specific embodiments of the present application have been described above with reference to the drawings, the scope of the present application is not limited thereto. Other modifications and variations to the present application will be apparent to those of skill in the art upon review of the foregoing description. It is not necessary here nor is it exhaustive of all embodiments. On the basis of the technical scheme of the application, various modifications or variations which can be made by the person skilled in the art without the need of creative efforts are still within the protection scope of the application.
Claims (9)
1. A method for improving storage performance of a system, comprising the steps of:
periodically detecting the performance of the I/O model of the disk module after preset layering to obtain the actual performance of the I/O model; the I/O model is used for representing the storage mode of the data block;
judging whether the actual performance of the I/O model is the same as the preset layering performance, and if the actual performance is different in the preset period, adjusting layering of the disk module according to the ratio of the performance difference ratio; the performance difference ratio is the ratio of the preset layering performance to the actual performance; the layering of the disk module according to the ratio of the performance difference value comprises the following steps:
judging whether the current system is fully loaded, if so, setting a first proportion of a performance difference ratio to be 10-15%, and adjusting layering of the disk module according to the first proportion; and if the magnetic disk module is not fully loaded, setting a second proportion of the performance difference ratio to be 3-5%, and adjusting layering of the magnetic disk module through the second proportion.
2. The method for improving storage performance of a system according to claim 1, wherein before periodically detecting the I/O model performance of the disk module after the layering, further comprises: and carrying out preset layering on the disk module according to the disk medium, and sending the preset layering information to an operating system.
3. The method for improving storage performance of a system according to claim 2, wherein the performing preset layering on the disk module according to the disk medium comprises:
storing the thermal data to FLASH;
storing the temperature data to the SAS;
the cold data is stored to the NL SAS.
4. The method for improving the storage performance of a system according to claim 1, wherein the I/O model specifically comprises a big data block sequential storage model, a big data block random storage model, a small data sequential storage model and a small data block random storage model;
the large data block ranges from [256KB,1M ]; the small data block ranges from (0 KB,16 KB).
5. The method for improving the storage performance of a system according to claim 4, wherein the method for periodically detecting the performance of the I/O model of the disc module after the preset layering to obtain the actual performance of the I/O model is as follows:
and periodically polling the I/O models to obtain the performance value fed back by each I/O model.
6. The method of claim 1, further comprising performing no adjustment if the actual performance of the I/O model is the same as the predetermined layered performance.
7. The system for improving the storage performance of the system is characterized by comprising a detection module and an adjustment module;
the detection module is used for periodically detecting the performance of the I/O model of the disk module after the preset layering to obtain the actual performance of the I/O model; the I/O model is used for representing the storage mode of the data block;
the adjusting module is used for judging whether the actual performance of the I/O model is the same as the preset layering performance, and if the actual performance is different in the preset period, layering of the disk module is adjusted according to the proportion of the performance difference ratio; the performance difference ratio is the ratio of the preset layering performance to the actual performance; the layering of the disk module according to the ratio of the performance difference value comprises the following steps: judging whether the current system is fully loaded, if so, setting a first proportion of a performance difference ratio to be 10-15%, and adjusting layering of the disk module according to the first proportion; and if the magnetic disk module is not fully loaded, setting a second proportion of the performance difference ratio to be 3-5%, and adjusting layering of the magnetic disk module through the second proportion.
8. An apparatus for improving storage performance of a system, comprising:
a memory for storing a computer program;
a processor for implementing the method steps of any one of claims 1 to 6 when executing said computer program.
9. A readable storage medium, characterized in that it has stored thereon a computer program which, when executed by a processor, implements the method steps of any of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110867262.8A CN113741807B (en) | 2021-07-29 | 2021-07-29 | Method, system, equipment and storage medium for improving system storage performance |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110867262.8A CN113741807B (en) | 2021-07-29 | 2021-07-29 | Method, system, equipment and storage medium for improving system storage performance |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113741807A CN113741807A (en) | 2021-12-03 |
| CN113741807B true CN113741807B (en) | 2023-08-11 |
Family
ID=78729487
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110867262.8A Active CN113741807B (en) | 2021-07-29 | 2021-07-29 | Method, system, equipment and storage medium for improving system storage performance |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113741807B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109240611A (en) * | 2018-08-28 | 2019-01-18 | 郑州云海信息技术有限公司 | The cold and hot data hierarchy method of small documents, small documents data access method and its device |
| CN109496292A (en) * | 2018-10-16 | 2019-03-19 | 深圳市锐明技术股份有限公司 | A kind of disk management method, disk management device and electronic equipment |
| CN111263931A (en) * | 2017-11-17 | 2020-06-09 | 国际商业机器公司 | Policy-based optimization of cloud resources on tiered storage operations |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109947787A (en) * | 2017-10-30 | 2019-06-28 | 阿里巴巴集团控股有限公司 | A kind of storage of data hierarchy, hierarchical query method and device |
-
2021
- 2021-07-29 CN CN202110867262.8A patent/CN113741807B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111263931A (en) * | 2017-11-17 | 2020-06-09 | 国际商业机器公司 | Policy-based optimization of cloud resources on tiered storage operations |
| CN109240611A (en) * | 2018-08-28 | 2019-01-18 | 郑州云海信息技术有限公司 | The cold and hot data hierarchy method of small documents, small documents data access method and its device |
| CN109496292A (en) * | 2018-10-16 | 2019-03-19 | 深圳市锐明技术股份有限公司 | A kind of disk management method, disk management device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113741807A (en) | 2021-12-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102580577B1 (en) | ZNSs in solid state drives | |
| KR102370760B1 (en) | Zone formation for zoned namespaces | |
| CN104737234B (en) | For the device of row hammering monitoring, memory and method | |
| US10714186B2 (en) | Method and apparatus for dynamically determining start program voltages for a memory device | |
| US9703494B1 (en) | Method and apparatus for protecting lower page data during programming in NAND flash | |
| KR101893895B1 (en) | Memory system, and method for controlling operation thereof | |
| WO2019068012A1 (en) | Method and apparatus for specifying read voltage offsets for a read command | |
| KR20120040974A (en) | Semiconductor device, memory module and memory system having the same and operating method thereof | |
| US10163502B2 (en) | Selective performance level modes of operation in a non-volatile memory | |
| US11853207B2 (en) | Configurable trim settings on a memory device | |
| CN114730604A (en) | Dynamic ZNS open zone activity restriction | |
| US20120030435A1 (en) | Memory device, memory management device, and memory management method | |
| US11809721B2 (en) | Memory sub-system temperature regulation by modifying a data parameter | |
| US9823880B1 (en) | Method and apparatus for initiating pre-read operation before completion of data load operation | |
| US11269715B2 (en) | Systems and methods for adaptive proactive failure analysis for memories | |
| CN113741807B (en) | Method, system, equipment and storage medium for improving system storage performance | |
| KR102589609B1 (en) | Snapshot management in partitioned storage | |
| CN104575598A (en) | Resistive memory device, operating method thereof, and system having the same | |
| US11704047B2 (en) | Temperature readings for memory devices to reduce temperature compensation errors | |
| US20230251792A1 (en) | Memory Device Based Accelerated Deep-Learning System | |
| US8639879B2 (en) | Sorting movable memory hierarchies in a computer system | |
| CN115497546A (en) | Read performance techniques for time retention | |
| CN114863969A (en) | Memory device skipping refresh operation and method of operating the same | |
| US8473674B2 (en) | Information processing device including a plurality of cells to store data, storage control device that controls a storage section including a plurality of cells to store data, and storage control method of controlling a refresh operation of a storage section including a plurality of cells to store data | |
| US20220101932A1 (en) | String current reduction during multistrobe sensing to reduce read disturb |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |