CN109375868A - A kind of date storage method, dispatching device, system, equipment and storage medium - Google Patents
A kind of date storage method, dispatching device, system, equipment and storage medium Download PDFInfo
- Publication number
- CN109375868A CN109375868A CN201811072602.2A CN201811072602A CN109375868A CN 109375868 A CN109375868 A CN 109375868A CN 201811072602 A CN201811072602 A CN 201811072602A CN 109375868 A CN109375868 A CN 109375868A
- Authority
- CN
- China
- Prior art keywords
- write request
- data
- size
- writing mode
- write
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0613—Improving I/O performance in relation to throughput
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0656—Data buffering arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/068—Hybrid storage device
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present embodiments relate to field of data storage, a kind of date storage method, dispatching device, system, equipment and storage medium are disclosed.In the present invention, date storage method comprises determining that the size of data of the write request received；According to the size of data of the write request, the writing mode of the data in write request is determined；Wherein, writing mode includes the first writing mode；Wherein, the first writing mode is directly to store the data in write request into memory；According to determining writing mode, the data in write request are stored.In which, according to the size of data of write request, data-storage system is adjusted flexibly to the writing mode of the data in write request, so that data-storage system has high IOPS performance and high throughput performance.
Description
Technical field
The present embodiments relate to field of data storage, in particular to a kind of date storage method, dispatching device, system,
Equipment and storage medium.
Background technique
With the development of Internet technology (Internet Technology, IT) and internet, especially cloud computing is emerging
It rises, more stringent requirements are proposed to storage system for the information content of huge increasing.Based on mechanical hard disk (Hard Disk Drive, HDD)
Although heritage storage system can pick up the pace on capacity, its rate is still the bottleneck of storage service.Novel storage
The fast development of medium --- solid state hard disk (Solid State Drives, SSD) injects new vitality to storage system.SSD
Read or write speed is fast, but capacity ratio HDD is much smaller, and expensive.And the appearance of storage system is mixed, it solves based on HDD
Heritage storage system performance is bad, using the cost excessively high problem again of SSD replacement HDD, balances Cost And Performance demand, has
There is very high application value.Enhanceio (Theo En Kan) software is a kind of realization for mixing memory technology, it is made using SSD
Caching between HDD and memory, to achieve the purpose that improving performance.Enhanceio is deposited as a complete available mixing
Storage scheme, it realizes the block device driver of processing application program read-write requests in kernel spacing, to the property of storage system
It can be obviously improved.
However, it is found by the inventors that at least there are the following problems in the prior art: the original design intention for mixing storage system is benefit
With the height number (Input/Output Operations Per Second, IOPS) per second for being written and read request of SSD, institute
With the property of mixing storage system read-write (Input/Output, the IO) operation (hereinafter referred to as small IO) smaller for data volume
It can be promoted obvious.But mix the storage system I/O operation (hereinafter referred to as big IO) bigger for data volume and unfriendly.It removes
Except this, it is random request or order request that mixing storage system, which does not distinguish write request, for order request with asking at random
Asking can all be cached.It, can be to entire storage system as the big data quantities such as disk scanning, file copy, the read-write of low-frequency sequence
The readwrite performance of system causes to fluctuate.The buffer scheduling mode for mixing storage system is too simple, cannot make full use of the height of SSD
The high throughput performance of IOPS performance and HDD.
Summary of the invention
Embodiment of the present invention is designed to provide a kind of date storage method, dispatching device, system, equipment and storage
Data-storage system is adjusted flexibly to the writing mode of the data in write request according to the size of data of write request in medium, so that
Data-storage system has the performance and high throughput performance of high read-write requests number.
In order to solve the above technical problems, embodiments of the present invention provide a kind of date storage method, including following step
It is rapid: to determine the size of data of the write request received；According to the size of data of write request, the write-in of the data in write request is determined
Mode；Wherein, writing mode is the first writing mode or the second writing mode；Wherein, the first writing mode is to pass through buffer
Data in write request are stored into memory；Second writing mode is directly to store the data in write request to memory
In；According to determining writing mode, the data in write request are stored.
Embodiments of the present invention additionally provide a kind of dispatching device, comprising: detection module, scheduler module；Detection module
For determining the size of data of the write request received；Scheduler module is used for the size of data according to write request, determines write request
In data writing mode；Wherein, writing mode includes the first writing mode；Wherein, the first writing mode is by write request
In data directly store into memory；According to determining writing mode, the data in write request are stored.
Embodiments of the present invention additionally provide a kind of data-storage system, comprising: dispatching device, memory and caching
Device；Dispatching device is for determining the size of data of the write request received；According to the size of data of write request, determine in write request
Data writing mode；Wherein, writing mode includes the first writing mode；Wherein, the first writing mode be will be in write request
Data directly store into memory；According to determining writing mode, the data in write request are stored.
Embodiments of the present invention additionally provide a kind of data storage device, comprising: at least one processor；And with
The program storage of at least one processor communication connection；Wherein, program storage, which is stored with, to be held by least one processor
Capable instruction, instruction are executed by least one processor, are mentioned so that at least one processor is able to carry out above embodiment such as
And date storage method.
Embodiments of the present invention additionally provide a kind of computer readable storage medium, are stored with computer program, calculate
The date storage method that above embodiment refers to is realized when machine program is executed by processor.
Embodiment of the present invention in terms of existing technologies, according to the size of data of write request, determines in write request
The writing mode of data, so that not only memory can be written by buffer in the data in write request by data-storage system, but also
Memory directly can be written into the data in write request, the height of the high IOPS performance and memory that have been provided simultaneously with buffer gulps down
Spit performance.
In addition, determining the writing mode of the data in write request according to the size of data of write request, specifically including: judgement
Whether the size of data of write request is greater than first threshold；If it is determined that being to determine that writing mode is the first writing mode；If it is determined that not
It is, according to the corresponding sector position of write request, to determine write request stream belonging to write request；Determine that the current data of write request stream is big
It is small；According to the current data size of write request stream, the writing mode of write request is determined.In the realization, big the writing of data volume is asked
Data in asking write direct memory, and the write request of big data quantity is avoided to cause wave to the readwrite performance of data-storage system
It is dynamic, improve the stability of system.Write request lesser for data volume, according to its in logic belonging to write request stream data
Size is measured, the writing mode of write request is determined, allows data-storage system that the data in the write request of order request are straight
Write-in memory is connect, avoids the replacement of data in caching as far as possible, more fully sharp memory-aided sequence write performance is reduced slow
The performance consumption of storage.
In addition, determining the writing mode of write request according to the current data size of write request stream, specifically including: determination is worked as
Preceding scheduling strategy；Wherein, current scheduling strategy is used to indicate the size of data pass corresponding with writing mode of write request stream
System；According to the current data size of current scheduling strategy and write request stream, the writing mode of write request is determined.
In addition, determining current scheduling strategy, specifically include: determining the number of a upper period received all write request stream
According to size；According to the size of data of received all write request stream of the upper period, the scheduling strategy of current period was determined；According to
The scheduling strategy of current period determines current scheduling strategy.In the realization, data-storage system can be write based on the received and ask
The case where seeking stream adjusts current scheduling strategy in real time, further improves data-storage system to memory and buffer
The utilization rate of performance.
In addition, determining the scheduling plan of current period according to the size of data of received all write request stream of the upper period
Slightly, it specifically includes: determining in a upper period received all write request stream, size of data is more than the write request stream of first threshold
Number, using size of data be more than first threshold write request stream number as first number；Determined that a upper period was received
In all write request streams, size of data is more than the number of the write request stream of second threshold, is more than second threshold by size of data
The number of write request stream is as second number；Wherein, second threshold is greater than first threshold；It calculates second number and first several
Ratio；According to ratio, the scheduling strategy of current period is determined.
In addition, writing mode further includes the second writing mode, the second writing mode is that first the data in write request are written
Buffer, then store from buffer into memory；It according to ratio, determines the scheduling strategy of current period, specifically includes: judgement
Whether ratio is more than third threshold value；If it is determined that being, it is determined that the scheduling strategy of current period is the first strategy；Wherein, the first plan
If slightly write request flow data size is no more than first threshold, the writing mode of the data in write request is the second writing mode,
If write request flow data size is more than first threshold, the writing mode of the data in write request is the first writing mode；If it is determined that
It is not, it is determined that the scheduling strategy of current period is the second strategy；Wherein, if the second strategy is write request, flow data size does not surpass
The 4th threshold value is crossed, the writing mode of the data in write request is the second writing mode, if write request flow data size is more than the 4th
Threshold value, the writing mode of the data in write request are the first writing mode, wherein the 4th threshold value is greater than first threshold.
In addition, according to determining writing mode, after storing the data in write request, date storage method further include:
If it is determined that the writing mode of the determination is the first writing mode, by data markers corresponding with the data in write request in buffer
It is invalid.In the realization, by data invalid corresponding in buffer, it ensure that memory is consistent with the data in buffer
Property.
In addition, scheduler module includes judgment module, the first processing submodule and second processing submodule；Judgment module is used for
Judge whether the size of data of write request is greater than first threshold；First processing submodule is used to determine write request in judgment module
After size of data is greater than first threshold, determine that writing mode is the first writing mode；Second processing submodule is for judging mould
Block determines that the size of data of write request no more than after first threshold, according to the corresponding sector position of write request, determines write request institute
The write request stream of category；Determine the current data size of write request stream；According to the current data size of write request stream, write request is determined
Writing mode.
In addition, second processing submodule is specifically used for: determining current scheduling strategy；Wherein, current scheduling strategy is used
In the size of data of instruction write request stream and the corresponding relationship of writing mode；According to current scheduling strategy and write request stream
Current data size, determine the writing mode of write request.
In addition, second processing submodule is specifically used for: determining that the data of a upper period received all write request stream are big
It is small；According to the size of data of received all write request stream of the upper period, the scheduling strategy of current period was determined；According to current
The scheduling strategy in period determines current scheduling strategy.
In addition, second processing submodule is specifically used for: determining in a upper period received all write request stream, data are big
Size of data is more than the number of the write request stream of first threshold as first by the number of the small write request stream more than first threshold
Number；It determines in a upper period received all write request streams, size of data is more than the number of the write request stream of second threshold, will
Size of data is more than the number of the write request stream of second threshold as second number；Wherein, second threshold is greater than first threshold；Meter
Calculate second number and first several ratio；According to ratio, the scheduling strategy of current period is determined.
In addition, writing mode further includes the second writing mode, the second writing mode is that first the data in write request are written
Buffer, then store from buffer into memory；Second processing submodule is specifically used for: judging whether ratio is more than third threshold
Value；If it is determined that being, it is determined that the scheduling strategy of current period is the first strategy；Wherein, if the first strategy is the number of write request stream
It is no more than first threshold according to size, the writing mode of the data in write request is the second writing mode, if the data of write request stream
Size is more than first threshold, and the writing mode of the data in write request is the first writing mode；If it is determined that not being, it is determined that current
The scheduling strategy in period is the second strategy；Wherein, it if the size of data that the second strategy is write request stream is no more than the 4th threshold value, writes
The writing mode of data in request is the second writing mode, if the size of data of write request stream is more than the 4th threshold value, write request
In data writing mode be the first writing mode, wherein the 4th threshold value be greater than first threshold.
Detailed description of the invention
One or more embodiments are illustrated by the picture in corresponding attached drawing, these exemplary theorys
The bright restriction not constituted to embodiment, the element in attached drawing with same reference numbers label are expressed as similar element, remove
Non- to have special statement, composition does not limit the figure in attached drawing.
Fig. 1 is the method flow diagram of the date storage method of first embodiment of the invention；
Fig. 2 is the method flow diagram of the date storage method of second embodiment of the invention；
Fig. 3 is the schematic diagram of the chained list of the tracking write request stream of second embodiment of the invention；
Fig. 4 was the schematic diagram of the write request stream in a upper period for second embodiment of the invention；
Fig. 5 is the structural schematic diagram of the dispatching device of third embodiment of the invention；
Fig. 6 is four embodiment of the invention ground dispatching device ground structure schematic diagram；
Fig. 7 is the structural schematic diagram of the data-storage system of fifth embodiment of the invention；
Fig. 8 is the interaction schematic diagram of each device in the data-storage system of fifth embodiment of the invention；
Fig. 9 is the structural schematic diagram of the data storage device of sixth embodiment of the invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with attached drawing to the present invention
Each embodiment be explained in detail.However, it will be understood by those skilled in the art that in each embodiment party of the present invention
In formula, in order to make the reader understand this application better, many technical details are proposed.But even if without these technical details
And various changes and modifications based on the following respective embodiments, the application technical solution claimed also may be implemented.
The first embodiment of the present invention is related to a kind of date storage methods, are applied to data-storage system.The present embodiment
In, data-storage system by Enhanceio mix storage system for, memory with mechanical hard disk (Hard Disk Drive,
HDD for), for buffer is with solid state hard disk (Solid State Drives, SSD), it will be understood by those skilled in the art that
Memory and buffer are also possible to other equipment with read-write capability.The detailed process of the date storage method such as Fig. 1 institute
Show, comprising the following steps:
Step 101: determining the size of data of the write request received.
Specifically, the dispatching device in data-storage system detects the I/O operation of arrival, the I/O operation is judged
It whether is write request, however, it is determined that be the size of data for determining the I/O operation (write request).
Step 102: according to the size of data of write request, determining the writing mode of the data in write request.
Specifically, writing mode includes the first writing mode.Wherein, the first writing mode is by the data in write request
Directly store into memory.
In the specific implementation, writing mode further includes the second writing mode, the second writing mode first will be in the write request
Buffer is written in data, then stores from buffer into the memory.Dispatching device is if it is determined that the size of data of write request reaches
To first threshold, HDD directly is written into the data in write request, however, it is determined that the size of data of write request is not up to first threshold,
SSD is written into data in write request, by way of asynchronous write, by the data in write request from SSD write-in HDD.
It is another in the specific implementation, dispatching device is if it is determined that the size of data of write request reaches first threshold, will be in write request
Data write direct HDD, however, it is determined that the size of data of write request is not up to first threshold, is further sentenced to write request
It is disconnected, to determine the writing mode of the data in the write request.
Step 103: according to determining writing mode, storing the data in write request.
It should be noted that being the first write-in side in the writing mode for determining the corresponding data of write request in practical application
Formula after HDD is written in the data in write request, detects in SSD whether be stored with data corresponding with the data in write request,
If it is determined that in the presence of being then invalid by data markers corresponding with the data in write request in buffer, however, it is determined that be not present, then directly
Return is connect, to execute the I/O operation of receipt of subsequent.
It is noted that data invalid corresponding in buffer ensure that the data in memory and buffer
Consistency.
It should be noted that the above is only limit for example, not constituting to technical solution of the present invention.
Compared with prior art, the date storage method provided in present embodiment, data-storage system is in write request
When data volume is larger, the data write-in memory in write request is directly passed through into buffer when the data volume of write request is smaller
Memory is written into data in write request, so that data-storage system has been provided simultaneously with the high IOPS performance and storage of buffer
The high throughput performance of device improves the utilization rate of buffer and memory.Also, since data-storage system is larger by data volume
Write request in data write direct in memory, avoid the write request of big data quantity to the readwrite performance of data-storage system
It causes to fluctuate, improves the stability of system.
Second embodiment of the present invention is related to a kind of date storage method, is applied to data-storage system, this embodiment party
Formula is the refinement to first embodiment, specifically illustrates a kind of implementation of step 102.
Specifically, as shown in Fig. 2, in the present embodiment, including step 201 to step 207, wherein step 201,
Step 207 is roughly the same with step 101, the step 103 in first embodiment respectively, and details are not described herein again.It is main below to be situated between
Continue difference:
Step 201: determining the size of data of the write request received.
Step 202: judging whether the size of data of write request is greater than first threshold.
Specifically, dispatching device if it is determined that write request size of data be greater than first threshold, execute step 203, otherwise,
Execute step 204.
It should be noted that it will be understood by those skilled in the art that first threshold can be according to memory in practical application
It is determined with the readwrite performance of buffer.
Step 203: the writing mode for determining the data in write request is the first writing mode.Step 207 is executed later.
Specifically, the data in the big write request of data volume are write direct memory by dispatching device, avoid counting
According to the fluctuation of storage system readwrite performance.
Step 204: according to the corresponding sector position of write request, determining write request stream belonging to write request.
Specifically, can just fall on physics magnetic by many applications since data-storage system is in storing data
On disk.For copying one big file, virtual file system, file system layer, generic block layer, IO can be passed through from top to bottom
Dispatch layer, device drive layer etc., finally just fall on physical disk.And the big file of each application may be split for
A many small documents issue, lower layer it can be seen that the instruction smaller write request of data volume one by one.Therefore, write request is being determined
When the writing mode of middle data, needs to carry out the smaller write request of these data volumes into recombination in logic, be gone back in logic
It originally was write request stream, to determine the type of the write request stream according to the size of data of the write request stream restored in logic.If writing
Request flow data size larger, illustrate the write request stream be the write request of order request probability it is bigger, therefore, can be straight by it
It connects in write-in HDD, to make full use of the high throughput performance of HDD.
It is noted that write request lesser for data volume, according to its in logic belonging to write request stream data
Size is measured, the writing mode of write request is determined, allows data-storage system that the data in the write request of order request are straight
Write-in memory is connect, avoids the replacement of data in caching as far as possible, more fully sharp memory-aided sequence write performance is reduced slow
The performance consumption of storage.
The method for determining write request stream belonging to write request is illustrated below.It is clear to illustrate, dispatching device is worked as
Before the write request that receives be denoted as the first write request, the corresponding sector position of the first write request is denoted as the first sector position.Scheduling
Device judges before receiving the first write request, if it is adjacent with the first sector position to receive sector position, and is located at the
Other write requests before one sector position；If it is determined that be, by other write requests for meeting above-mentioned requirements, (hereinafter referred to as second is write
Request) belonging to write request stream as write request stream belonging to the first write request, and by the second write request and the first write request into
Row logic reorganization in logic recombinates the first write request to write request stream belonging to the first write request；If it is determined that receiving
To before the first write request, the second write request is not received, then write request stream belonging to the first write request is the first write request sheet
Body.
In the specific implementation, being stored with one in dispatching device for tracking the chained list of write request stream, the chained list such as Fig. 3 institute
Show.Wherein, every a line is used to record the information of a write request stream.Dispatching device determines after receiving a write request
Write request stream belonging to the write request stream, and the write request is binned on write request stream belonging to the write request.
Step 205: determining the current data size of write request stream.
Specifically, dispatching device tracks and records the information such as the size of data of each write request stream, write request is being determined
After affiliated write request stream, according to the information of track record, the current data size of the write request stream is determined.
Step 206: according to the current data size of write request stream, determining the writing mode of write request.
Specifically, dispatching device determines current scheduling strategy, according to current scheduling strategy and write request stream
Current data size determines the writing mode of write request.Wherein, current scheduling strategy be used to indicate write request stream data it is big
The small corresponding relationship with writing mode.
It should be noted that it will be understood by those skilled in the art that current scheduling strategy can be fixed strategy,
It can be the case where dispatching device is according to write request stream, the strategy of dynamic adjustment.
The method of the scheduling strategy current to determination is illustrated below.In the specific implementation, dispatching device determines
The size of data of one period received all write request stream；According to a upper period, the data of received all write request stream are big
It is small, determine the scheduling strategy of current period；According to the scheduling strategy of current period, current scheduling strategy is determined.Specifically,
Dispatching device determines in a upper period received all write request stream that size of data is more than of the write request stream of first threshold
Size of data is more than the number of the write request stream of first threshold as first number by number.Dispatching device determined that a upper period connect
In all write request streams received, it is more than the second threshold by size of data that size of data, which is more than the number of the write request stream of second threshold,
The number of the write request stream of value is as second number.Wherein, second threshold is greater than first threshold.Dispatching device calculates second number
The scheduling strategy of current period is determined according to the ratio with first several ratio.
Wherein, dispatching device determines the side of the scheduling strategy of current period according to second several and first several ratio
Method includes: dispatching device judges whether second number and first several ratio are more than third threshold value；If it is determined that being, it is determined that when
The scheduling strategy in preceding period is the first strategy；If it is determined that not being, it is determined that the scheduling strategy of current period is the second strategy.Its
In, if the size of data that the first strategy is write request stream belonging to write request is no more than first threshold, the data in write request
Writing mode is the second writing mode, if the size of data of write request stream belonging to write request is more than first threshold, in write request
Data writing mode be the first writing mode.If the second strategy is that the size of data of write request stream belonging to write request does not surpass
The 4th threshold value is crossed, the writing mode of the data in write request is the second writing mode, if the number of write request stream belonging to write request
It is more than the 4th threshold value according to size, the writing mode of the data in write request is the first writing mode.Wherein, the 4th threshold value is greater than the
One threshold value.
Current scheduling was determined to dispatching device according to received write request stream of the upper period below in conjunction with actual scene
The method of strategy is illustrated.
Assuming that the write request stream in a upper period as shown in figure 4, include 4 write request streams (Seq_io 1, Seq_io 2,
Seq_io 3 and Seq_io 4), size of data is more than that the number (first number) of the write request stream of first threshold is 3, more than the
The number (second number) of the write request stream of two threshold values is 2.Therefore, second number and first several ratio=the second number/
First number=2/3.Judge whether the ratio is greater than third threshold value, however, it is determined that be greater than, it is determined that the scheduling strategy of current period
For the first strategy, i.e. dispatching device if it is determined that the size of data of write request stream belonging to write request is more than first threshold, then will write
Data in request write direct memory, if the size of data of write request stream belonging to write request is no more than first threshold,
Buffer is written into data in write request, is written back in memory by the way that buffer is asynchronous.If it is determined that second number and first
The ratio of number be not more than third threshold value, it is determined that the scheduling strategy of current period be second strategy, i.e., dispatching device if it is determined that
The size of data of write request stream belonging to write request is more than the 4th threshold value, then the data in write request is write direct memory,
If the size of data of write request stream belonging to write request is no more than the 4th threshold value, buffer is written into the data in write request,
It is written back in memory by the way that buffer is asynchronous.For example, third threshold value is set as 60%, then the scheduling strategy of current period is the
One scheduling strategy.
It should be noted that in the specific implementation, the case where dispatching device periodically counts write request stream, each period
Time span can be 10s or other times length.
It should be noted that it will be understood by those skilled in the art that the size of data of write request stream can belonging to write request
To be to recombinate current write request to write request stream in logic, the size of data of write request stream, being also possible to will be current
Write request recombinated to before write request stream in logic, the size of data of write request stream.
It should be noted that it will be understood by those skilled in the art that second threshold, third threshold value and the 4th threshold value can roots
It is arranged according to the readwrite performance of memory and buffer.Wherein, the 4th threshold value can be fixed value, be also possible to be stored according to data
The numerical value of the size of data dynamic adjustment of the received write request of system.4th threshold value receives big slightly larger than data-storage system
The size of data of partial write request, so, when the size of data of write request is greater than four threshold values, it is believed that the write request
Data volume it is very big, directly by the write request data write-in HDD in.
It is noted that the case where data-storage system can be according to current write request stream, adjusts currently in real time
Scheduling strategy further improves data-storage system to the utilization rate of the performance of memory and buffer.
Step 207: according to determining writing mode, storing the data in write request.
It should be noted that the above is only limit for example, not constituting to technical solution of the present invention.
Compared with prior art, a kind of date storage method provided in present embodiment, data-storage system are asked writing
When the data volume for the data asked is larger, memory directly is written into the data in write request, when the data volume of write request is smaller,
Memory is written into the data in write request by buffer, so that data-storage system has been provided simultaneously with the high IOPS of buffer
The high throughput performance of performance and memory takes full advantage of the performance of buffer and memory, improves buffer and memory
Utilization rate.Also, it since data-storage system writes direct the data in the biggish write request of data volume in memory, keeps away
The write request for exempting from big data quantity causes to fluctuate to the readwrite performance of data-storage system, improves the stability of system.Except this it
Outside, the case where data-storage system is according to current write request stream, adjusts current scheduling strategy in real time, further improves number
According to storage system to the utilization rate of the performance of memory and buffer.
The step of various methods divide above, be intended merely to describe it is clear, when realization can be merged into a step or
Certain steps are split, multiple steps are decomposed into, as long as including identical logical relation, all in the protection scope of this patent
It is interior；To adding inessential modification in algorithm or in process or introducing inessential design, but its algorithm is not changed
Core design with process is all in the protection scope of the patent.
Third embodiment of the invention is related to a kind of dispatching device, as shown in Figure 5, comprising: detection module 301, scheduling mould
Block 302.Detection module 301 is for determining that the size of data of the write request received, scheduler module 302 are used for according to write request
Size of data determines the writing mode of the data in write request；Wherein, writing mode includes the first writing mode, the first write-in
Mode is directly to store the data in write request into memory；According to determining writing mode, the number in write request is stored
According to.
It is not difficult to find that present embodiment is Installation practice corresponding with first embodiment, present embodiment can be with
First embodiment is worked in coordination implementation.The relevant technical details mentioned in first embodiment still have in the present embodiment
Effect, in order to reduce repetition, which is not described herein again.Correspondingly, the relevant technical details mentioned in present embodiment are also applicable in
In first embodiment.
It is noted that each module involved in present embodiment is logic module, and in practical applications, one
A logic unit can be a physical unit, be also possible to a part of a physical unit, can also be with multiple physics lists
The combination of member is realized.In addition, in order to protrude innovative part of the invention, it will not be with solution institute of the present invention in present embodiment
The technical issues of proposition, the less close unit of relationship introduced, but this does not indicate that there is no other single in present embodiment
Member.
Four embodiment of the invention is related to a kind of dispatching device, and present embodiment is to the further of third embodiment
Refinement, specifically illustrates the effect of scheduler module 302.
As shown in fig. 6, scheduler module 302 includes that judgment module 3021, first handles submodule 3022 and second processing
Module 3023.Judgment module 3021 is for judging whether the size of data of write request is greater than first threshold；First processing submodule
After 3022 for determining that the size of data of the write request is greater than first threshold in judgment module 3021, determine that writing mode is the
One writing mode.Second processing submodule 3023 is used to determine that the size of data of write request is not more than first in judgment module 3021
After threshold value, according to the corresponding sector position of write request, write request stream belonging to write request is determined；Determine the current number of write request stream
According to size；According to the current data size of write request stream, the writing mode of write request is determined.
Specifically, second processing submodule 3023 is specifically used for: determining current scheduling strategy；Wherein, current tune
Degree strategy is used to indicate the size of data of write request stream and the corresponding relationship of writing mode；According to current scheduling strategy, and
The current data size of write request stream, determines the writing mode of write request.Further, second processing submodule 3023 is specifically used
In: determine the size of data of a upper period received all write request stream；According to received all write requests of the upper period
The size of data of stream determines the scheduling strategy of current period；According to the scheduling strategy of current period, current scheduling plan is determined
Slightly.Further, second processing submodule 3023 is specifically used for: determining in a upper period received all write request stream, number
According to size be more than first threshold write request stream number, using size of data be more than first threshold write request stream number as
First number；It determines in a upper period received all write request streams, size of data is more than of the write request stream of second threshold
Size of data is more than the number of the write request stream of second threshold as second number by number；Wherein, second threshold is greater than described the
One threshold value；Calculate second number and first several ratio；According to ratio, the scheduling strategy of current period is determined.
Further, writing mode further includes the second writing mode, and the second writing mode is first by the data in write request
Buffer is written, then stores from buffer into memory.Second processing submodule 3023 is specifically used for: judging that the ratio is
No is more than third threshold value；If it is determined that being, it is determined that the scheduling strategy of current period is the first strategy；Wherein, if the first strategy is
The size of data of write request stream is no more than first threshold, and the writing mode of the data in write request is the second writing mode, if writing
The size of data of request stream is more than first threshold, and the writing mode of the data in write request is the first writing mode；If it is determined that not
It is, it is determined that the scheduling strategy of current period is the second strategy；Wherein, if the size of data that the second strategy is write request stream does not surpass
Cross the 4th threshold value, the writing mode of the data in write request is the second writing mode, if the size of data of write request stream is more than the
Four threshold values, the writing mode of the data in write request are the first writing mode, wherein the 4th threshold value is greater than first threshold.
It is not difficult to find that present embodiment is Installation practice corresponding with second embodiment, present embodiment can be with
Second embodiment is worked in coordination implementation.The relevant technical details mentioned in second embodiment still have in the present embodiment
Effect, in order to reduce repetition, which is not described herein again.Correspondingly, the relevant technical details mentioned in present embodiment are also applicable in
In second embodiment.
Fifth embodiment of the invention is related to a kind of data-storage system, for example, Enhanceio mixes storage system, such as
Shown in Fig. 6, comprising: dispatching device 401, memory 402 and buffer 403.Dispatching device 401 is for determining that is received writes and ask
The size of data asked；According to the size of data of write request, the writing mode of the data in write request is determined；Wherein, writing mode
Including the first writing mode；Wherein, the first writing mode is directly to store the data in write request into memory；According to true
Fixed writing mode stores the data in write request.
In the specific implementation, for the interaction schematic diagram of each device as shown in fig. 7, in Fig. 7, I O table shows read-write in data-storage system
Request, memory 402 is by taking HDD as an example, and buffer 403 is by taking SSD as an example.The detection module 301 of dispatching device 401 examines IO
It surveys, after determining that IO is write request, determines the size of data of write request, the scheduler module 302 of dispatching device 401 is according to write request
Size of data, determine the writing mode of the data in write request, it is according to determining writing mode, the data in write request are straight
Write-in memory 402 is connect, or, writing data into buffer 403, data asynchronous write is restored by reservoir 402 by buffer 403.
It is not difficult to find that present embodiment is system embodiment corresponding with first embodiment, present embodiment can be with
First embodiment is worked in coordination implementation.The relevant technical details mentioned in first embodiment still have in the present embodiment
Effect, in order to reduce repetition, which is not described herein again.Correspondingly, the relevant technical details mentioned in present embodiment are also applicable in
In first embodiment.
It is noted that each module involved in present embodiment is logic module, and in practical applications, one
A logic unit can be a physical unit, be also possible to a part of a physical unit, can also be with multiple physics lists
The combination of member is realized.In addition, in order to protrude innovative part of the invention, it will not be with solution institute of the present invention in present embodiment
The technical issues of proposition, the less close unit of relationship introduced, but this does not indicate that there is no other single in present embodiment
Member.
Sixth embodiment of the invention is related to a kind of data storage device, as shown in figure 9, including at least one processor
501；And the program storage 502 with the communication connection of at least one processor 501；Wherein, program storage 502 is stored with
The instruction that can be executed by least one processor 501, instruction are executed by least one processor 501, so that at least one is handled
Device 501 is able to carry out the date storage method referred to such as above embodiment.
The data storage device includes: one or more processors 501 and program storage 502, at one in Fig. 9
For reason device 501.Processor 501, program storage 502 can be connected by bus or other modes, by total in Fig. 9
For line connection.Program storage 502 is used as a kind of non-volatile computer readable storage medium storing program for executing, can be used for storing non-volatile
Software program, non-volatile computer executable program and module.Processor 501 is stored in program storage by operation
Non-volatile software program, instruction and module in 502, thereby executing the various function application and data processing of equipment,
Realize above-mentioned date storage method.
Program storage 502 may include storing program area and storage data area, wherein storing program area can store operation
Application program required for system, at least one function；It storage data area can the Save option list etc..In addition, program storage
502 may include high-speed random access memory, can also include nonvolatile memory, for example, at least a magnetic disk storage
Part, flush memory device or other non-volatile solid state memory parts.In some embodiments, program storage 502 is optional includes
The memory remotely located relative to processor 501, these remote memories can pass through network connection to external equipment.It is above-mentioned
The example of network includes but is not limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
One or more module is stored in program storage 502, is executed when by one or more processor 501
When, execute the date storage method in above-mentioned any means embodiment.
The said goods can be performed the application embodiment provided by method, have the corresponding functional module of execution method and
Beneficial effect, the not technical detail of detailed description in the present embodiment, reference can be made to method provided by the application embodiment.
Seventh embodiment of the invention is related to a kind of computer readable storage medium, is stored with computer program.Computer
Above method embodiment is realized when program is executed by processor.
That is, it will be understood by those skilled in the art that implement the method for the above embodiments be can be with
Relevant hardware is instructed to complete by program, which is stored in a storage medium, including some instructions are to make
It obtains an equipment (can be single-chip microcontroller, chip etc.) or processor (processor) executes side described in each embodiment of the application
The all or part of the steps of method.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can store journey
The medium of sequence code.
It will be understood by those skilled in the art that the respective embodiments described above are to realize specific embodiments of the present invention,
And in practical applications, can to it, various changes can be made in the form and details, without departing from the spirit and scope of the present invention.
Claims (16)
1. a kind of date storage method characterized by comprising
Determine the size of data of the write request received；
According to the size of data of the write request, the writing mode of the data in the write request is determined；Wherein, said write side
Formula includes the first writing mode；Wherein, first writing mode is directly to store the data in the write request to described
In memory；
According to determining writing mode, the data in the write request are stored.
2. date storage method according to claim 1, which is characterized in that the data according to the write request are big
It is small, it determines the writing mode of the data in the write request, specifically includes:
Judge whether the size of data of the write request is greater than first threshold；
If it is determined that being to determine that said write mode is first writing mode；
If it is determined that not being, according to the corresponding sector position of the write request, to determine write request stream belonging to the write request；It determines
The current data size of the write request stream；According to the current data size of the write request stream, writing for the write request is determined
Enter mode.
3. date storage method according to claim 2, which is characterized in that the current number according to the write request stream
According to size, determines the writing mode of the write request, specifically includes:
Determine current scheduling strategy；Wherein, the current scheduling strategy is used to indicate the size of data of the write request stream
With the corresponding relationship of said write mode；
According to the current data size of the current scheduling strategy and the write request stream, writing for the write request is determined
Enter mode.
4. date storage method according to claim 3, which is characterized in that the current scheduling strategy of the determination, specifically
Include:
Determine the size of data of a upper period received all write request stream；
According to the size of data of a upper period received all write request stream, the scheduling strategy of current period is determined；
According to the scheduling strategy of the current period, the current scheduling strategy is determined.
5. date storage method according to claim 4, which is characterized in that described according to a upper period received institute
The size of data of some write request stream, determines the scheduling strategy of current period, specifically includes:
It determined in received all write request stream of the upper period, size of data is more than the write request stream of the first threshold
Number, using size of data be more than the first threshold write request stream number as first number；
It determined in received all write request streams of the upper period, size of data is more than of the write request stream of second threshold
Size of data is more than the number of the write request stream of the second threshold as second number by number；Wherein, the second threshold is big
In the first threshold；
Calculate second number and first several ratio；
According to the ratio, the scheduling strategy of the current period is determined.
6. date storage method according to claim 5, which is characterized in that said write mode further includes the second write-in side
Formula, second writing mode are buffer first to be written in the data in the write request, then store to institute from the buffer
It states in memory；
It is described according to the ratio, determine the scheduling strategy of the current period, specifically include:
Judge whether the ratio is more than third threshold value；
If it is determined that being, it is determined that the scheduling strategy of the current period is the first strategy；Wherein, if first strategy is described
The size of data of write request stream is no more than the first threshold, and the writing mode of the data in the write request is write for described second
Enter mode, if the size of data of the write request stream is more than the first threshold, the writing mode of the data in the write request
For first writing mode；
If it is determined that not being, it is determined that the scheduling strategy of the current period is the second strategy；Wherein, if second strategy is institute
The size of data for stating write request stream is no more than the 4th threshold value, and the writing mode of the data in the write request is second write-in
Mode, if the size of data of the write request stream is more than the 4th threshold value, the writing mode of the data in the write request is
First writing mode, wherein the 4th threshold value is greater than the first threshold.
7. date storage method according to any one of claim 1 to 6, which is characterized in that described according to determining
Writing mode, after storing the data in the write request, the date storage method further include:
If it is determined that the writing mode of the determination is first writing mode, it will be corresponding with the write request in the buffer
Data markers be invalid.
8. a kind of dispatching device characterized by comprising detection module and scheduler module；
The detection module is for determining the size of data of the write request received；
The scheduler module is used for the size of data according to the write request, determines the write-in side of the data in the write request
Formula；Wherein, said write mode includes the first writing mode；Wherein, first writing mode be will be in the write request
Data are directly stored into the memory；According to determining writing mode, the data in the write request are stored.
9. dispatching device according to claim 8, which is characterized in that the scheduler module includes judgment module, at first
Manage submodule and second processing submodule；
The judgment module is for judging whether the size of data of the write request is greater than first threshold；
The first processing submodule is used to determine that the size of data of the write request is greater than described first in the judgment module
After threshold value, determine that said write mode is first writing mode；
The second processing submodule is used to determine the size of data of the write request no more than described the in the judgment module
After one threshold value, according to the corresponding sector position of the write request, write request stream belonging to the write request is determined；It is write described in determination
Request the current data size of stream；According to the current data size of the write request stream, the writing mode of the write request is determined.
10. dispatching device according to claim 9, which is characterized in that the second processing submodule is specifically used for:
Determine current scheduling strategy；Wherein, the current scheduling strategy is used to indicate the size of data of the write request stream
With the corresponding relationship of said write mode；
According to the current data size of the current scheduling strategy and the write request stream, writing for the write request is determined
Enter mode.
11. dispatching device according to claim 10, which is characterized in that the second processing submodule is specifically used for:
Determine the size of data of a upper period received all write request stream；
According to the size of data of a upper period received all write request stream, the scheduling strategy of current period is determined；
According to the scheduling strategy of the current period, the current scheduling strategy is determined.
12. dispatching device according to claim 11, which is characterized in that the second processing submodule is specifically used for:
It determined in received all write request stream of the upper period, size of data is more than the write request stream of the first threshold
Number, using size of data be more than the first threshold write request stream number as first number；
It determined in received all write request streams of the upper period, size of data is more than of the write request stream of second threshold
Size of data is more than the number of the write request stream of the second threshold as second number by number；Wherein, the second threshold is big
In the first threshold；
Calculate second number and first several ratio；
According to the ratio, the scheduling strategy of the current period is determined.
13. dispatching device according to claim 12, which is characterized in that said write mode further includes the second write-in side
Formula, second writing mode are buffer first to be written in the data in the write request, then store to institute from the buffer
It states in memory；
The second processing submodule is specifically used for:
Judge whether the ratio is more than third threshold value；
If it is determined that being, it is determined that the scheduling strategy of the current period is the first strategy；Wherein, if first strategy is described
The size of data of write request stream is no more than the first threshold, and the writing mode of the data in the write request is write for described second
Enter mode, if the size of data of the write request stream is more than the first threshold, the writing mode of the data in the write request
For first writing mode；
If it is determined that not being, it is determined that the scheduling strategy of the current period is the second strategy；Wherein, if second strategy is institute
The size of data for stating write request stream is no more than the 4th threshold value, and the writing mode of the data in the write request is second write-in
Mode, if the size of data of the write request stream is more than the 4th threshold value, the writing mode of the data in the write request is
First writing mode, wherein the 4th threshold value is greater than the first threshold.
14. a kind of data-storage system characterized by comprising dispatching device, memory and buffer；
The dispatching device is for determining the size of data of the write request received；According to the size of data of the write request, really
The writing mode of data in the fixed write request；Wherein, said write mode includes the first writing mode；Wherein, described
One writing mode is directly to store the data in the write request into the memory；According to determining writing mode, deposit
Store up the data in the write request.
15. a kind of data storage device characterized by comprising at least one processor；And
The program storage being connect at least one described processor communication；Wherein, be stored with can be by institute for described program memory
State the instruction of at least one processor execution, described instruction executed by least one described processor so that it is described at least one
Processor is able to carry out the date storage method as described in claim 1 to 7 is any.
16. a kind of computer readable storage medium, is stored with computer program, which is characterized in that the computer program is located
Reason device realizes date storage method described in any one of claims 1 to 7 when executing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811072602.2A CN109375868B (en) | 2018-09-14 | 2018-09-14 | Data storage method, scheduling device, system, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811072602.2A CN109375868B (en) | 2018-09-14 | 2018-09-14 | Data storage method, scheduling device, system, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109375868A true CN109375868A (en) | 2019-02-22 |
| CN109375868B CN109375868B (en) | 2022-07-08 |
Family
ID=65405269
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811072602.2A Active CN109375868B (en) | 2018-09-14 | 2018-09-14 | Data storage method, scheduling device, system, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109375868B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111324309A (en) * | 2020-02-21 | 2020-06-23 | 北京天融信网络安全技术有限公司 | Data storage method and electronic equipment |
| CN111352590A (en) * | 2020-02-26 | 2020-06-30 | 上海霄云信息科技有限公司 | File storage method and equipment |
| WO2019233500A3 (en) * | 2019-09-12 | 2020-07-09 | Alibaba Group Holding Limited | Log-structured storage systems |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070288692A1 (en) * | 2006-06-08 | 2007-12-13 | Bitmicro Networks, Inc. | Hybrid Multi-Tiered Caching Storage System |
| CN102662459A (en) * | 2012-04-22 | 2012-09-12 | 复旦大学 | Method for reducing energy consumption of server by using mixed storage of solid-state drive and mechanical hard disk |
| CN103399713A (en) * | 2013-08-02 | 2013-11-20 | 浙江大学 | Data buffering method for balancing multistage memory property and solid-state disk service life |
| CN103645995A (en) * | 2013-12-04 | 2014-03-19 | 华为技术有限公司 | Data writing method and device |
| CN105892947A (en) * | 2016-03-31 | 2016-08-24 | 华中科技大学 | SSD and HDD hybrid caching management method and system of energy-saving storage system |
| CN106681668A (en) * | 2017-01-12 | 2017-05-17 | 郑州云海信息技术有限公司 | Hybrid storage system and storage method based on solid state disk caching |
| CN106878414A (en) * | 2017-02-14 | 2017-06-20 | 北京奇虎科技有限公司 | Data write request processing method, device and distributed data-storage system |
| CN106933516A (en) * | 2017-03-16 | 2017-07-07 | 郑州云海信息技术有限公司 | A kind of storage controlling method and device of the storage system of blending agent |
| CN107092439A (en) * | 2017-03-07 | 2017-08-25 | 华为技术有限公司 | A kind of method and apparatus of data storage |
| CN107193494A (en) * | 2017-05-19 | 2017-09-22 | 深圳大学 | RDD (remote data description) persistence method based on SSD (solid State disk) and HDD (hard disk drive) hybrid storage system |
| WO2018028218A1 (en) * | 2016-08-12 | 2018-02-15 | 华为技术有限公司 | Data writing method and apparatus |
| CN108491162A (en) * | 2018-03-13 | 2018-09-04 | 山东超越数控电子股份有限公司 | A kind of method and device improving performance of storage system |
-
2018
- 2018-09-14 CN CN201811072602.2A patent/CN109375868B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070288692A1 (en) * | 2006-06-08 | 2007-12-13 | Bitmicro Networks, Inc. | Hybrid Multi-Tiered Caching Storage System |
| CN102662459A (en) * | 2012-04-22 | 2012-09-12 | 复旦大学 | Method for reducing energy consumption of server by using mixed storage of solid-state drive and mechanical hard disk |
| CN103399713A (en) * | 2013-08-02 | 2013-11-20 | 浙江大学 | Data buffering method for balancing multistage memory property and solid-state disk service life |
| CN103645995A (en) * | 2013-12-04 | 2014-03-19 | 华为技术有限公司 | Data writing method and device |
| CN105892947A (en) * | 2016-03-31 | 2016-08-24 | 华中科技大学 | SSD and HDD hybrid caching management method and system of energy-saving storage system |
| WO2018028218A1 (en) * | 2016-08-12 | 2018-02-15 | 华为技术有限公司 | Data writing method and apparatus |
| CN106681668A (en) * | 2017-01-12 | 2017-05-17 | 郑州云海信息技术有限公司 | Hybrid storage system and storage method based on solid state disk caching |
| CN106878414A (en) * | 2017-02-14 | 2017-06-20 | 北京奇虎科技有限公司 | Data write request processing method, device and distributed data-storage system |
| CN107092439A (en) * | 2017-03-07 | 2017-08-25 | 华为技术有限公司 | A kind of method and apparatus of data storage |
| CN106933516A (en) * | 2017-03-16 | 2017-07-07 | 郑州云海信息技术有限公司 | A kind of storage controlling method and device of the storage system of blending agent |
| CN107193494A (en) * | 2017-05-19 | 2017-09-22 | 深圳大学 | RDD (remote data description) persistence method based on SSD (solid State disk) and HDD (hard disk drive) hybrid storage system |
| CN108491162A (en) * | 2018-03-13 | 2018-09-04 | 山东超越数控电子股份有限公司 | A kind of method and device improving performance of storage system |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019233500A3 (en) * | 2019-09-12 | 2020-07-09 | Alibaba Group Holding Limited | Log-structured storage systems |
| CN111566611A (en) * | 2019-09-12 | 2020-08-21 | 阿里巴巴集团控股有限公司 | Log structure storage system |
| US10896006B1 (en) | 2019-09-12 | 2021-01-19 | Advanced New Technologies Co., Ltd. | Log-structured storage systems |
| US11074017B2 (en) | 2019-09-12 | 2021-07-27 | Advanced New Technologies Co., Ltd. | Log-structured storage systems |
| TWI737395B (en) * | 2019-09-12 | 2021-08-21 | 開曼群島商創新先進技術有限公司 | Log-structured storage systems and method |
| CN111566611B (en) * | 2019-09-12 | 2023-08-04 | 创新先进技术有限公司 | Log structured storage system |
| CN111324309A (en) * | 2020-02-21 | 2020-06-23 | 北京天融信网络安全技术有限公司 | Data storage method and electronic equipment |
| CN111352590A (en) * | 2020-02-26 | 2020-06-30 | 上海霄云信息科技有限公司 | File storage method and equipment |
| CN111352590B (en) * | 2020-02-26 | 2023-06-09 | 上海霄云信息科技有限公司 | File storage method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109375868B (en) | 2022-07-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103186350B (en) | The moving method of mixing storage system and hot spot data block | |
| CN103049397B (en) | A kind of solid state hard disc inner buffer management method based on phase transition storage and system | |
| CN106293521B (en) | A kind of flash translation layer (FTL) management method that mapping granule is adaptive | |
| US11977484B2 (en) | Adapting in-memory database in hybrid memory systems and operating system interface | |
| CN107168654B (en) | A kind of isomery memory allocation method and system based on data object temperature | |
| CN100590609C (en) | Method for managing dynamic internal memory base on discontinuous page | |
| CN109375868A (en) | A kind of date storage method, dispatching device, system, equipment and storage medium | |
| CN105243033A (en) | Data processing method and electronic device | |
| CN101048764A (en) | Memory management system having a forward progress bit | |
| CN107015888B (en) | A kind of data back up method and system based on submodule model | |
| CN107515728A (en) | Play the data managing method and device of concurrent characteristic inside flash memory device | |
| CN114780025B (en) | Software RAID request processing method, controller and RAID storage system | |
| CN102981783A (en) | Cache accelerating method based on Nand Flash | |
| CN109460186A (en) | A kind of method and its system promoting solid state hard disk reading performance | |
| CN105393228A (en) | Method, device and user equipment for reading/writing data in nand flash | |
| CN114138200A (en) | Pre-writing log method and system based on rocksDB | |
| CN104537003A (en) | Universal high-performance data writing method for Hbase database | |
| CN102520885B (en) | Data management system for hybrid hard disk | |
| CN109324979A (en) | The data buffer storage division methods and data distributing method of 3D flash memory solid-state disk system | |
| CN107577614A (en) | Method for writing data and memory system | |
| CN102929935A (en) | Transaction-based large-volume data read and write methods | |
| CN105045540B (en) | A kind of data layout method of Solid-state disc array | |
| CN107220069B (en) | Shuffle method for nonvolatile memory | |
| CN117573043A (en) | Transmission method, device, system, equipment and medium for distributed storage data | |
| CN115826882B (en) | Storage method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210802 Address after: 518000 b1-1302, building B, Kexing Science Park, No. 15, Keyuan Road, Science Park community, Yuehai street, Nanshan District, Shenzhen, Guangdong Applicant after: Shenzhen aijieyun Technology Co.,Ltd. Address before: 5 / F, building a, Guangqi Cultural Plaza, 2899 a, Xietu Road, Xuhui District, Shanghai 200030 Applicant before: WANGSU SCIENCE & TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |