CN111708484A - Method, system, device and medium for controlling data brushing speed - Google Patents
Method, system, device and medium for controlling data brushing speed Download PDFInfo
- Publication number
- CN111708484A CN111708484A CN202010441456.7A CN202010441456A CN111708484A CN 111708484 A CN111708484 A CN 111708484A CN 202010441456 A CN202010441456 A CN 202010441456A CN 111708484 A CN111708484 A CN 111708484A
- Authority
- CN
- China
- Prior art keywords
- disk
- water level
- data
- cache
- cache disk
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 230000001680 brushing effect Effects 0.000 title claims abstract description 47
- 238000000034 method Methods 0.000 title claims abstract description 43
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims abstract description 101
- 238000011084 recovery Methods 0.000 claims abstract description 39
- 230000004044 response Effects 0.000 claims abstract description 9
- 238000004590 computer program Methods 0.000 claims description 9
- 238000011010 flushing procedure Methods 0.000 abstract description 7
- 230000006870 function Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0634—Configuration or reconfiguration of storage systems by changing the state or mode of one or more devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
- G06F3/0649—Lifecycle management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Memory System Of A Hierarchy Structure (AREA)
Abstract
The invention discloses a method, a system, equipment and a storage medium for controlling data brushing speed, wherein the method comprises the following steps: responding to the received data written by the cluster, and judging whether the data meets the condition of writing into a cache disk; responding to the condition that the data meets the condition of writing into the cache disk, writing the data into the cache disk and judging whether the cluster is in a fault recovery state or not; responding to the cluster in a fault recovery state, and judging whether the current disk water level of the cache disk is smaller than a reference water level; and in response to the current disk level of the cache disk being less than the baseline level, pausing the data flushing. According to the scheme provided by the invention, the data brushing speed in the cache disk is adjusted by acquiring the state of the storage cluster and integrating the cluster state and the self state, so that the water level of the disk in the cache disk can be kept in a healthy state.
Description
Technical Field
The present invention relates to the field of distributed storage, and more particularly, to a method, system, computer device, and readable medium for controlling a data brushing speed.
Background
With the rise and popularization of cloud computing technology, distributed shared storage systems are getting more and more concerned by the industry. Continuous and stable performance is required in video monitoring and broadcast and television resource scenes, and data recovery in the current fault scene has great influence on the performance, which can cause abnormal service access, so that the speed of data reconstruction is controlled, and the influence of the data recovery on the service is reduced; in addition, when a disk fault and a node fault occur in the cluster, data recovery and balancing are completed as soon as possible to avoid data loss, so that the data recovery speed is increased, and the data recovery can be completed in a short time.
In the current distributed storage system, generally, user read-write data is firstly stored in a Cache data disk, and then with the change of data access frequency and the water level of the Cache data disk, part of the data is printed from a Cache high-performance storage medium to a storage medium with relatively low performance, so that the read-write performance of a cluster is improved. When a cluster fails, the data refreshing can seriously affect the performance of data recovery, and the data refreshing rate is very low due to the data recovery, so that the reading and writing of the whole cluster can not be recovered to be normal for a long time.
Disclosure of Invention
In view of this, an object of the embodiments of the present invention is to provide a method, a system, a computer device, and a computer-readable storage medium for controlling a data flushing speed, in which a status of a storage cluster is obtained, and the data flushing speed in a cache disk is adjusted by integrating the cluster status and a self status, so as to slow down flushing in a fault scene, so that data recovery can be completed as soon as possible, reduce reading and writing of user services, and accelerate flushing after the cluster is recovered to be normal, so as to maintain a healthy disk level of the cache.
In view of the above, an aspect of the embodiments of the present invention provides a method for controlling a data brushing speed, including the following steps: responding to the received data written by the cluster, and judging whether the data meets the condition of writing into a cache disk; in response to the data meeting the condition of writing into a cache disk, writing the data into the cache disk and judging whether the cluster is in a fault recovery state; responding to the cluster in a fault recovery state, and judging whether the current disk water level of the cache disk is smaller than a reference water level; and responding to the current disk water level of the cache disk being less than the reference water level, and pausing the data brushing.
In some embodiments, further comprising: responding to the fact that the cluster is not in a fault recovery state, and judging whether the current disk water level of the cache disk is smaller than a first threshold value or not; and responding to the current disk water level of the cache disk not less than a first threshold value, and accelerating the data brushing speed.
In some embodiments, further comprising: responding to the current disk water level of the cache disk smaller than a first threshold, and judging whether the current disk water level of the cache disk is smaller than a second threshold below the first threshold; and responding to the current disk water level of the cache disk being smaller than a second threshold value, and slowing down the data brushing speed.
In some embodiments, the determining whether the data satisfies the condition for writing to a cache disk includes: judging whether the size of the data is smaller than a preset value or not; and/or judging whether the disk water level of the cache disk is less than the limit water level.
In another aspect of the embodiments of the present invention, a system for controlling a data brushing speed is further provided, including: the first judgment module is configured to respond to the received data written by the cluster and judge whether the data meets the condition of writing into a cache disk; the second judgment module is configured to respond to the condition that the data meets the condition of writing into a cache disk, write the data into the cache disk and judge whether the cluster is in a fault recovery state; the third judging module is configured to respond to the cluster being in a fault recovery state, and judge whether the current disk water level of the cache disk is less than a reference water level; and the execution module is configured to respond that the current disk water level of the cache disk is less than the reference water level and pause the data brushing.
In some embodiments, the apparatus further comprises a fourth determining module configured to: responding to the fact that the cluster is not in a fault recovery state, and judging whether the current disk water level of the cache disk is smaller than a first threshold value or not; and responding to the current disk water level of the cache disk not less than a first threshold value, and accelerating the data brushing speed.
In some embodiments, the apparatus further comprises a fifth determining module configured to: responding to the current disk water level of the cache disk smaller than a first threshold, and judging whether the current disk water level of the cache disk is smaller than a second threshold below the first threshold; and responding to the current disk water level of the cache disk being smaller than a second threshold value, and slowing down the data brushing speed.
In some embodiments, the first determining module is further configured to: judging whether the size of the data is smaller than a preset value or not; and/or judging whether the disk water level of the cache disk is less than the limit water level.
In another aspect of the embodiments of the present invention, there is also provided a computer device, including: at least one processor; and a memory storing computer instructions executable on the processor, the instructions when executed by the processor implementing the steps of the method as above.
In a further aspect of the embodiments of the present invention, a computer-readable storage medium is also provided, in which a computer program for implementing the above method steps is stored when the computer program is executed by a processor.
The invention has the following beneficial technical effects: the data brushing speed in the cache disk is adjusted by acquiring the state of the storage cluster and integrating the cluster state and the self state, so that the brushing is slowed down in a fault scene, the data recovery can be completed as soon as possible, the reading and writing of user services are reduced, and the brushing is accelerated to keep the healthy disk water level of the cache after the cluster is recovered to be normal.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.
FIG. 1 is a schematic diagram of an embodiment of a method for controlling a data brushing speed according to the present invention;
fig. 2 is a schematic diagram of a hardware structure of an embodiment of the computer device for controlling data brushing speed according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.
In view of the above objects, a first aspect of embodiments of the present invention proposes an embodiment of a method of controlling a data brushing speed. FIG. 1 is a schematic diagram illustrating an embodiment of a method for controlling data brushing speed according to the present invention. As shown in fig. 1, the embodiment of the present invention includes the following steps:
s1, responding to the received data written by the cluster, and judging whether the data meets the condition of writing into a cache disk;
s2, responding to the condition that the data meets the condition of writing into the cache disk, writing the data into the cache disk and judging whether the cluster is in a fault recovery state;
s3, responding to the cluster in the fault recovery state, and judging whether the current disk water level of the cache disk is less than the reference water level; and
and S4, in response to the current disk water level of the cache disk being less than the benchmark water level, suspending data brushing.
The embodiment of the invention discloses a method for controlling data refreshing in a distributed Storage system, which comprises a monitoring module, a client and three or more Object-based Storage Device (OSD) nodes. Firstly, determining whether to write in a cache disc according to the disk water level of the cache disc and the size of a user write-in object; secondly, acquiring the state of the cluster, judging whether the cluster is in a fault recovery state, and suspending data refreshing if the cluster is in the fault recovery state; finally, if the cluster is in a normal state and the water level of the cache disk is higher, the data is swiped down in an accelerated mode; therefore, the down-flushing is slowed down in a fault scene, the data recovery can be completed as soon as possible, and the reading and writing of user services are reduced.
The method comprises the following specific steps:
configuring a first threshold, a second threshold, a limit water level and a preset value of a cache disk of a cluster, where the first threshold may be a high water level high _ level and may be set to 70%, the second threshold may be a low water level low _ level and may be set to 20%, for example, the limit water level may be set to 90%, when the disk water level exceeds the limit water level, stopping writing of data and accelerating a data flushing speed, and the preset value is a maximum size max _ data _ size of data written into the cache.
And responding to the received data written by the cluster, and judging whether the data meets the condition of writing into the cache disk. In some embodiments, the determining whether the data satisfies the condition for writing to a cache disk includes: judging whether the size of the data is smaller than a preset value or not; and/or judging whether the disk water level of the cache disk is less than the limit water level. If the size of the data is larger than the preset value, the data is not written into the cache, and the data is directly written into a disk medium with lower performance. If the disk level of the cache disk is greater than or equal to the limit level, data is also written to the disk medium with lower performance.
And responding to the condition that the data meets the condition of writing into the cache disk, writing the data into the cache disk and judging whether the cluster is in a fault recovery state. For example, when the data size is less than or equal to a preset value, the disk level of the cache disk is less than a threshold level, and the data may be written to the cache disk. And acquiring the state of the cluster, and judging whether the cluster is in a fault recovery state.
And responding to the cluster in the fault recovery state, and judging whether the current disk water level of the cache disk is less than the reference water level. If the cluster is in the fault recovery state, whether the current disk water level of the cache disk is smaller than the benchmark water level is judged, the benchmark water level can be ten percent of the second threshold value or other percentages, and different settings can be carried out according to specific situations.
And in response to the current disk water level of the cache disk being less than the reference water level, suspending data brushing. If the current disk water level of the cache disk is less than the benchmark water level, the data in the cache disk is less, and the data is not flushed, so that the cluster can be recovered as soon as possible. When the cluster is switched to the normal state from the fault state and the disk level is higher than high _ level, data is flushed down at full speed to keep the healthy cache disk level.
In some embodiments, further comprising: responding to the fact that the cluster is not in a fault recovery state, and judging whether the current disk water level of the cache disk is smaller than a first threshold value or not; and responding to the current disk water level of the cache disk not less than a first threshold value, and accelerating the data brushing speed. If the cluster is in a normal state, whether the current water level is in a healthy state is judged, for example, whether the current disk water level of the cache disk is smaller than a first threshold value can be judged.
In some embodiments, further comprising: responding to the current disk water level of the cache disk smaller than a first threshold, and judging whether the current disk water level of the cache disk is smaller than a second threshold below the first threshold; and responding to the current disk water level of the cache disk being smaller than a second threshold value, and slowing down the data brushing speed. If the current disk water level of the cache disk is smaller than the first threshold, whether the current disk water level is smaller than a second threshold or not can be judged, if so, the cache disk is indicated to have less data, and the data brushing speed can be reduced.
It should be particularly noted that, the steps in the embodiments of the method for controlling data brushing speed described above can be mutually intersected, replaced, added, or deleted, and therefore, these methods for controlling data brushing speed that are transformed by reasonable permutation and combination also belong to the protection scope of the present invention, and the protection scope of the present invention should not be limited to the embodiments.
In view of the above object, according to a second aspect of the embodiments of the present invention, there is provided a system for controlling a data swipe speed, including: the first judgment module is configured to respond to the received data written by the cluster and judge whether the data meets the condition of writing into a cache disk; the second judgment module is configured to respond to the condition that the data meets the condition of writing into a cache disk, write the data into the cache disk and judge whether the cluster is in a fault recovery state; the third judging module is configured to respond to the cluster being in a fault recovery state, and judge whether the current disk water level of the cache disk is less than a reference water level; and the execution module is configured to respond that the current disk water level of the cache disk is less than the reference water level and pause the data brushing.
In some embodiments, the apparatus further comprises a fourth determining module configured to: responding to the fact that the cluster is not in a fault recovery state, and judging whether the current disk water level of the cache disk is smaller than a first threshold value or not; and responding to the current disk water level of the cache disk not less than a first threshold value, and accelerating the data brushing speed.
In some embodiments, the apparatus further comprises a fifth determining module configured to: responding to the current disk water level of the cache disk smaller than a first threshold, and judging whether the current disk water level of the cache disk is smaller than a second threshold below the first threshold; and responding to the current disk water level of the cache disk being smaller than a second threshold value, and slowing down the data brushing speed.
In some embodiments, the first determining module is further configured to: judging whether the size of the data is smaller than a preset value or not; and/or judging whether the disk water level of the cache disk is less than the limit water level.
In view of the above object, a third aspect of the embodiments of the present invention provides a computer device, including: at least one processor; and a memory storing computer instructions executable on the processor, the instructions being executable by the processor to perform the steps of: s1, responding to the received data written by the cluster, and judging whether the data meets the condition of writing into a cache disk; s2, responding to the condition that the data meets the condition of writing into the cache disk, writing the data into the cache disk and judging whether the cluster is in a fault recovery state; s3, responding to the cluster in the fault recovery state, and judging whether the current disk water level of the cache disk is less than the reference water level; and S4, in response to the current disk level of the cache disk being less than the benchmark level, suspending the data brushing.
In some embodiments, further comprising: responding to the fact that the cluster is not in a fault recovery state, and judging whether the current disk water level of the cache disk is smaller than a first threshold value or not; and responding to the current disk water level of the cache disk not less than a first threshold value, and accelerating the data brushing speed.
In some embodiments, further comprising: responding to the current disk water level of the cache disk smaller than a first threshold, and judging whether the current disk water level of the cache disk is smaller than a second threshold below the first threshold; and responding to the current disk water level of the cache disk being smaller than a second threshold value, and slowing down the data brushing speed.
In some embodiments, the determining whether the data satisfies the condition for writing to a cache disk includes: judging whether the size of the data is smaller than a preset value or not; and/or judging whether the disk water level of the cache disk is less than the limit water level.
Fig. 2 is a schematic diagram of a hardware structure of an embodiment of the computer device for controlling data brushing speed according to the present invention.
Taking the apparatus shown in fig. 2 as an example, the apparatus includes a processor 301 and a memory 302, and may further include: an input device 303 and an output device 304.
The processor 301, the memory 302, the input device 303 and the output device 304 may be connected by a bus or other means, and fig. 2 illustrates the connection by a bus as an example.
The memory 302, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions/modules corresponding to the method for controlling data brushing speed in the embodiments of the present application. The processor 301 executes various functional applications of the server and data processing, i.e., implements the method of controlling data brushing speed of the above-described method embodiment, by running the nonvolatile software program, instructions, and modules stored in the memory 302.
The memory 302 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the method of controlling the data brushing speed, and the like. Further, the memory 302 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 302 optionally includes memory located remotely from processor 301, which may be connected to a local module via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 303 may receive information such as a user name and a password that are input. The output means 304 may comprise a display device such as a display screen.
Program instructions/modules corresponding to one or more methods of controlling data brushing speed are stored in memory 302 and, when executed by processor 301, perform the method of controlling data brushing speed in any of the method embodiments described above.
Any embodiment of a computer apparatus for performing the method for controlling data brushing speed described above may achieve the same or similar effects as any of the preceding method embodiments corresponding thereto.
The invention also provides a computer readable storage medium storing a computer program which, when executed by a processor, performs the method as above.
Finally, it should be noted that, as one of ordinary skill in the art can appreciate that all or part of the processes of the methods of the above embodiments can be implemented by a computer program to instruct related hardware, and the program of the method for controlling the data brushing speed can be stored in a computer readable storage medium, and when executed, the program can include the processes of the embodiments of the methods as described above. The storage medium of the program may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like. The embodiments of the computer program may achieve the same or similar effects as any of the above-described method embodiments.
Furthermore, the methods disclosed according to embodiments of the present invention may also be implemented as a computer program executed by a processor, which may be stored in a computer-readable storage medium. Which when executed by a processor performs the above-described functions defined in the methods disclosed in embodiments of the invention.
Further, the above method steps and system elements may also be implemented using a controller and a computer readable storage medium for storing a computer program for causing the controller to implement the functions of the above steps or elements.
Further, it should be appreciated that the computer-readable storage media (e.g., memory) herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. By way of example, and not limitation, nonvolatile memory can include Read Only Memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which can act as external cache memory. By way of example and not limitation, RAM is available in a variety of forms such as synchronous RAM (DRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The storage devices of the disclosed aspects are intended to comprise, without being limited to, these and other suitable types of memory.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments of the present invention.
The various illustrative logical blocks, modules, and circuits described in connection with the disclosure herein may be implemented or performed with the following components designed to perform the functions herein: a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of these components. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP, and/or any other such configuration.
The steps of a method or algorithm described in connection with the disclosure herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.
In one or more exemplary designs, the functions may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a general-purpose or special-purpose computer, or a general-purpose or special-purpose processor. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk, blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of the embodiments of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.
Claims (10)
1. A method of controlling data swipe speed, comprising the steps of:
responding to the received data written by the cluster, and judging whether the data meets the condition of writing into a cache disk;
in response to the data meeting the condition of writing into a cache disk, writing the data into the cache disk and judging whether the cluster is in a fault recovery state;
responding to the cluster in a fault recovery state, and judging whether the current disk water level of the cache disk is smaller than a reference water level; and
and in response to the current disk water level of the cache disk being less than the reference water level, suspending data brushing.
2. The method of claim 1, further comprising:
responding to the fact that the cluster is not in a fault recovery state, and judging whether the current disk water level of the cache disk is smaller than a first threshold value or not; and
and responding to the current disk water level of the cache disk not less than a first threshold value, and accelerating the data brushing speed.
3. The method of claim 2, further comprising:
responding to the current disk water level of the cache disk smaller than a first threshold, and judging whether the current disk water level of the cache disk is smaller than a second threshold below the first threshold; and
and in response to the current disk water level of the cache disk being less than a second threshold, slowing down the data brushing speed.
4. The method of claim 1, wherein determining whether the data satisfies a condition for writing to a cache disk comprises:
judging whether the size of the data is smaller than a preset value or not; and/or
And judging whether the disk water level of the cache disk is less than the limit water level or not.
5. A system for controlling data swipe speed, comprising:
the first judgment module is configured to respond to the received data written by the cluster and judge whether the data meets the condition of writing into a cache disk;
the second judgment module is configured to respond to the condition that the data meets the condition of writing into a cache disk, write the data into the cache disk and judge whether the cluster is in a fault recovery state;
the third judging module is configured to respond to the cluster being in a fault recovery state, and judge whether the current disk water level of the cache disk is less than a reference water level; and
and the execution module is configured to respond that the current disk water level of the cache disk is less than the reference water level and pause the data brushing.
6. The system of claim 5, further comprising a fourth determining module configured to:
responding to the fact that the cluster is not in a fault recovery state, and judging whether the current disk water level of the cache disk is smaller than a first threshold value or not; and
and responding to the current disk water level of the cache disk not less than a first threshold value, and accelerating the data brushing speed.
7. The system of claim 6, further comprising a fifth determining module configured to:
responding to the current disk water level of the cache disk smaller than a first threshold, and judging whether the current disk water level of the cache disk is smaller than a second threshold below the first threshold; and
and in response to the current disk water level of the cache disk being less than a second threshold, slowing down the data brushing speed.
8. The system of claim 5, wherein the first determining module is further configured to:
judging whether the size of the data is smaller than a preset value or not; and/or
And judging whether the disk water level of the cache disk is less than the limit water level or not.
9. A computer device, comprising:
at least one processor; and
a memory storing computer instructions executable on the processor, the instructions when executed by the processor implementing the steps of the method of any one of claims 1 to 4.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010441456.7A CN111708484A (en) | 2020-05-22 | 2020-05-22 | Method, system, device and medium for controlling data brushing speed |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010441456.7A CN111708484A (en) | 2020-05-22 | 2020-05-22 | Method, system, device and medium for controlling data brushing speed |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111708484A true CN111708484A (en) | 2020-09-25 |
Family
ID=72537360
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010441456.7A Withdrawn CN111708484A (en) | 2020-05-22 | 2020-05-22 | Method, system, device and medium for controlling data brushing speed |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111708484A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112631521A (en) * | 2020-12-25 | 2021-04-09 | 苏州浪潮智能科技有限公司 | Method, system, equipment and medium for controlling water level of cache pool |
| CN112732192A (en) * | 2021-01-09 | 2021-04-30 | 苏州浪潮智能科技有限公司 | Method, system, equipment and medium for cutting disk distribution information |
| CN112905121A (en) * | 2021-02-20 | 2021-06-04 | 山东英信计算机技术有限公司 | Data brushing method and system |
| CN113315807A (en) * | 2021-04-16 | 2021-08-27 | 山东英信计算机技术有限公司 | Method, system, device and medium for optimizing cluster decision |
| CN113590547A (en) * | 2021-06-30 | 2021-11-02 | 济南浪潮数据技术有限公司 | Cache management method and system for ICFS |
| CN113609094A (en) * | 2021-07-09 | 2021-11-05 | 济南浪潮数据技术有限公司 | Method, system, equipment and medium for controlling data downloading and brushing |
| CN113687798A (en) * | 2021-10-26 | 2021-11-23 | 苏州浪潮智能科技有限公司 | Method, device and equipment for controlling data reconstruction and readable medium |
| CN113806087A (en) * | 2021-09-10 | 2021-12-17 | 济南浪潮数据技术有限公司 | Method and device for adjusting service speed based on brushing speed |
| CN113806085A (en) * | 2021-09-10 | 2021-12-17 | 济南浪潮数据技术有限公司 | Method and device for preventing cache pool from being full of writes through proxy transliteration |
| CN114546694A (en) * | 2022-01-28 | 2022-05-27 | 苏州浪潮智能科技有限公司 | Cache fault management method, system, storage medium and equipment |
| CN114661244A (en) * | 2022-04-18 | 2022-06-24 | 苏州浪潮智能科技有限公司 | Method, system, equipment and storage medium for reducing water level of storage pool |
| CN115268798A (en) * | 2022-09-27 | 2022-11-01 | 天津卓朗昆仑云软件技术有限公司 | Cache data flushing method and system |
-
2020
- 2020-05-22 CN CN202010441456.7A patent/CN111708484A/en not_active Withdrawn
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112631521B (en) * | 2020-12-25 | 2023-01-06 | 苏州浪潮智能科技有限公司 | Method, system, equipment and medium for controlling water level of cache pool |
| CN112631521A (en) * | 2020-12-25 | 2021-04-09 | 苏州浪潮智能科技有限公司 | Method, system, equipment and medium for controlling water level of cache pool |
| CN112732192A (en) * | 2021-01-09 | 2021-04-30 | 苏州浪潮智能科技有限公司 | Method, system, equipment and medium for cutting disk distribution information |
| CN112732192B (en) * | 2021-01-09 | 2023-01-10 | 苏州浪潮智能科技有限公司 | Method, system, equipment and medium for cutting disk distribution information |
| CN112905121A (en) * | 2021-02-20 | 2021-06-04 | 山东英信计算机技术有限公司 | Data brushing method and system |
| CN113315807A (en) * | 2021-04-16 | 2021-08-27 | 山东英信计算机技术有限公司 | Method, system, device and medium for optimizing cluster decision |
| CN113590547A (en) * | 2021-06-30 | 2021-11-02 | 济南浪潮数据技术有限公司 | Cache management method and system for ICFS |
| CN113590547B (en) * | 2021-06-30 | 2024-02-23 | 济南浪潮数据技术有限公司 | Cache management method and system for ICFS |
| CN113609094A (en) * | 2021-07-09 | 2021-11-05 | 济南浪潮数据技术有限公司 | Method, system, equipment and medium for controlling data downloading and brushing |
| CN113806087A (en) * | 2021-09-10 | 2021-12-17 | 济南浪潮数据技术有限公司 | Method and device for adjusting service speed based on brushing speed |
| CN113806085A (en) * | 2021-09-10 | 2021-12-17 | 济南浪潮数据技术有限公司 | Method and device for preventing cache pool from being full of writes through proxy transliteration |
| CN113806087B (en) * | 2021-09-10 | 2023-12-26 | 济南浪潮数据技术有限公司 | Method and device for adjusting service speed based on brushing speed |
| CN113687798A (en) * | 2021-10-26 | 2021-11-23 | 苏州浪潮智能科技有限公司 | Method, device and equipment for controlling data reconstruction and readable medium |
| CN114546694A (en) * | 2022-01-28 | 2022-05-27 | 苏州浪潮智能科技有限公司 | Cache fault management method, system, storage medium and equipment |
| CN114546694B (en) * | 2022-01-28 | 2024-06-28 | 苏州浪潮智能科技有限公司 | Cache fault management method, system, storage medium and equipment |
| CN114661244A (en) * | 2022-04-18 | 2022-06-24 | 苏州浪潮智能科技有限公司 | Method, system, equipment and storage medium for reducing water level of storage pool |
| CN115268798A (en) * | 2022-09-27 | 2022-11-01 | 天津卓朗昆仑云软件技术有限公司 | Cache data flushing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111708484A (en) | Method, system, device and medium for controlling data brushing speed | |
| CN111756571B (en) | Cluster node fault processing method, device, equipment and readable medium | |
| CN110620793B (en) | Method, device and medium for improving audio quality | |
| CN111177043B (en) | Method, system, device and medium for accelerating reading of field replaceable unit information | |
| CN111240595A (en) | Method, system, equipment and medium for optimizing storage cache | |
| CN111030892B (en) | Method, equipment and medium for testing network function in BMC NCSI adaptive mode | |
| CN107493180B (en) | Upgrading method and device of virtual switch | |
| CN111104232A (en) | Method, device and medium for accelerating message writing of message queue | |
| CN111258856A (en) | Method, system, equipment and medium for monitoring running state of solid state disk | |
| CN111708482B (en) | Method, system, device and medium for limiting bandwidth in distributed storage | |
| CN110780994A (en) | Method, equipment and medium for regulating and controlling memory | |
| CN111078430A (en) | Message notification processing method, device and storage medium | |
| CN111176932B (en) | Method and device for recording abnormal event log and readable medium | |
| CN111708664A (en) | Log management method, device and medium for client | |
| CN111813507A (en) | Method, system, equipment and medium for high availability of virtual machine based on sanlock | |
| CN111309264B (en) | Method, system, device and medium for making directory quota compatible with snapshot | |
| CN110727534B (en) | Method, equipment and storage medium for repairing file system | |
| CN111722959B (en) | Method, system, equipment and medium for expanding storage pool | |
| CN111092750B (en) | Switch management network system and white box switch based on intelligent monitoring | |
| CN111045989A (en) | Method, device and medium for querying CPLD version information | |
| US20220029849A1 (en) | Electronic device, method and storage medium for monitoring connection state of client devices | |
| CN111240933B (en) | Method, system, device and medium for monitoring performance data of multiple data centers | |
| CN111884919B (en) | Method, device, equipment and readable medium for clearing invalid virtual IP | |
| CN111090504B (en) | Method, equipment and medium for realizing timing task based on placemaker | |
| CN111737658B (en) | Method, system, device and medium for limiting quota of ZooKeeper data node |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200925 |
|
| WW01 | Invention patent application withdrawn after publication |