CN109634874A - A kind of data processing method, device, electronic equipment and storage system - Google Patents
A kind of data processing method, device, electronic equipment and storage system Download PDFInfo
- Publication number
- CN109634874A CN109634874A CN201811494818.8A CN201811494818A CN109634874A CN 109634874 A CN109634874 A CN 109634874A CN 201811494818 A CN201811494818 A CN 201811494818A CN 109634874 A CN109634874 A CN 109634874A
- Authority
- CN
- China
- Prior art keywords
- reading
- data
- strategy
- writing data
- read
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
Abstract
This application discloses a kind of data processing method, device, electronic equipment and storage system, method includes: to receive reading and writing data instruction, and the reading and writing data instruction is the process instruction to target data；Obtain the corresponding reading and writing data strategy of the target data；With the reading and writing data strategy, the target data is written and read processing.It can be seen that, by the way that corresponding reading and writing data strategy is arranged to different data in the application, to when receiving the reading and writing data instruction to data, processing can be written and read with the corresponding reading and writing data strategy of the data, thus, for different file or data using preset customized read-write strategy, meets the needs of different, improve the extensive use of reading and writing data.
Description
Technical field
This application involves Data cache technology field more particularly to a kind of data processing method, device, electronic equipment and deposit
Storage system.
Background technique
In computer systems, the read-write operation of all data be all realized by file system read-write storage, for example,
The calculating data in CPU and memory are written in disk by file system.
And since the reading and writing data rate of CPU and memory are apparently higher than the rate of disk storage, therefore, it is necessary to disk it
Preceding setting cache, the storage of Lai Shixian data in magnetic disk.
But in current cache mechanism, usually to file using fixed cache policy, such as fixed caching
Rate etc..
Summary of the invention
In view of this, the application provides a kind of data processing method, device, electronic equipment and storage system, to solve
The technical problem for causing application lower using fixed cache policy file in the prior art.
This application provides a kind of data processing methods, comprising:
Reading and writing data instruction is received, the reading and writing data instruction is the process instruction to target data；
Obtain the corresponding reading and writing data strategy of the target data；
With the reading and writing data strategy, the target data is written and read processing.
The above method, it is preferred that obtain the corresponding reading and writing data strategy of the target data, comprising:
In the aiming field in the metadata area of the disk or the memory, it is corresponding to read the target data
Reading and writing data strategy.
The above method, it is preferred that reading and writing data strategy in the aiming field by preset file control interface into
Row write enters.
The above method, it is preferred that further include:
It is instructed in response to strategy modification, to the number in the aiming field in the metadata area of the disk and the memory
It modifies according to read-write strategy.
The above method, it is preferred that further include:
If in the aiming field being sky, the reading and writing data strategy for obtaining default is read as the data of the target data
Write strategy.
The above method, it is preferred that included at least in the reading and writing data strategy: read and write rate parameter, read-write timing parameters,
Read and write one or more of spacing parameter, read-write size parameter, read-while writing parameter.
The above method, it is preferred that the reading and writing data instruction permits that triggering command is triggered by the event received.
Present invention also provides a kind of data processing equipments, comprising:
Instruction receiving unit, read write command, the reading and writing data instruction are the processing to target data for receiving data
Instruction；
Tactful acquiring unit, for obtaining the corresponding reading and writing data strategy of the target data；
Data processing unit, for the reading and writing data strategy, the target data to be written and read processing.
Present invention also provides a kind of electronic equipment, comprising:
Memory runs generated data for storing application program and application program；
Processor, for executing the application program, to realize function: receiving reading and writing data instruction, the reading and writing data
Instruction is the process instruction to target data；Obtain the corresponding reading and writing data strategy of the target data；With the reading and writing data
The target data is written and read processing by strategy between memory and disk
Present invention also provides a kind of storage systems, including the first equipment, global scheduler and at least one second equipment；
Second equipment generates reading and writing data in response to the event license triggering command that the global scheduler is sent and refers to
It enables, the reading and writing data instruction is the process instruction to target data；
Second equipment obtains the corresponding reading and writing data strategy of the target data；It, will with the reading and writing data strategy
The target data is written and read processing on said first device.
It can be seen from the above technical proposal that a kind of data processing method disclosed in the present application, device, electronic equipment and depositing
Storage system, by the way that corresponding reading and writing data strategy is arranged to different data, thus receiving the reading and writing data instruction to data
When, processing can be written and read with the corresponding reading and writing data strategy of the data, accordingly, for different files or data using pre-
If customized read-write strategy, meet the needs of different, improve the extensive use of reading and writing data.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is a kind of flow chart for data processing method that the embodiment of the present application one provides；
Fig. 2 is a kind of structural schematic diagram for data processing equipment that the embodiment of the present application two provides；
Fig. 3 is the structural schematic diagram for a kind of electronic equipment that the embodiment of the present application three provides；
Fig. 4 is a kind of structural schematic diagram for storage system that the embodiment of the present application four provides.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on
Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall in the protection scope of this application.
With reference to Fig. 1, for a kind of implementation flow chart for data processing method that the embodiment of the present application one provides, in the present embodiment
Method suitable for being written and read processing to the file data such as file system.Specifically, the method in the present embodiment can
With the following steps are included:
Step 101: receiving reading and writing data instruction.
Wherein, reading and writing data instruction refers to the process instruction to target data, as to some file or some file
Read instruction or write instruction etc..The reading and writing data is instructed for target data being read or being written to disk from disk
In.
It is needing to carry out file system it should be noted that reading and writing data instruction can be computer operating system kernel
Instruction generated when reading and writing data.Here file system can be various types of file system, such as Linux file system
Deng.
Step 102: obtaining the corresponding reading and writing data strategy of target data.
Wherein, pre-defined for the data in file system to have corresponding reading and writing data strategy, different data institutes is right
The reading and writing data strategy answered can be different, it is also possible to which identical, user or terminal can be according to demand to different data as a result,
Corresponding reading and writing data strategy is set, to meet different application demands.
It should be noted that reading and writing data strategy is it is to be understood that the cache mechanism of target data, rule or write
Disk mechanism etc. reads and writes parameter, the read-write ginseng of different data containing at least one specifically, can wrap in the reading and writing data strategy
Number can be different.
Step 103: with reading and writing data strategy, target data being written and read processing.
For example, with the corresponding reading and writing data strategy of target data in the present embodiment, by target data in a computer in
It deposits and is written and read processing between disk, be such as written to target data in disk from memory, alternatively, reading mesh from disk
Mark data；Alternatively, with the corresponding reading and writing data strategy of target data, by target data in different computers such as running node and
Processing is written and read between memory node.Read-write process among these is complete based on reading and writing data strategy corresponding to the target data
At.
As above scheme it is found that a kind of data processing method disclosed in the embodiment of the present application one, by being set to different data
Corresponding reading and writing data strategy is set, thus when receiving the reading and writing data instruction to data, it can be with the corresponding number of the data
It is written and read processing according to read-write strategy, accordingly, for different file or data using preset customized read-write strategy, is met
Different demands improves the extensive use of reading and writing data.
In one implementation, the step 102 in the present embodiment is obtaining the corresponding reading and writing data strategy of target data
When, it can be accomplished by the following way:
In the aiming field in the metadata area of disk or memory, the corresponding reading and writing data plan of target data is read
Slightly.
Wherein, it is stored with the metadata of all data of disk in metadata area, includes corresponding in disk in metadata
The data attribute of data.It should be noted that opening some file in file system after computer operating system starting
When, metadata area in disk can be copied in memory, all there is in disk and memory metadata area as a result,.
In the concrete realization, aiming field is arranged in the present embodiment in metadata area, for example, in computer system
INode structure (i.e. metadata area) is extended, and cacheparams field is added in iNode structure, should
The reading and writing data strategy of data corresponding to the iNode structure is preset in cacheparams field.
It should be noted that in the present embodiment in the corresponding reading and writing data strategy of reading target data, it can be from disk
Metadata area in aiming field in read the corresponding reading and writing data strategy of target data, alternatively, can be beaten in file
Target data corresponding reading and writing data strategy is read when opening from the aiming field in the metadata area of memory.Specific implementation
In, it is from reading in disk or read from memory, computer operating system kernel can according to demand or File Open shape
State is configured.
Based on implementation above, the reading and writing data strategy in aiming field specifically can be pre- by preset file control interface
First be written, it is subsequent need to modify to the reading and writing data strategy in aiming field when, can also by this document control connect
Cause for gossip is existing.
Wherein, file control interface can be connects in existing Virtual File System VFS (virtual File System)
The new file control interface expanded on the basis of mouthful, dynamically can be written or modify data such as by this document control interface
The reading and writing data strategy of file.
In addition, can be by being instructed to the strategy modification received, to the meta-data region of disk and memory in the present embodiment
Reading and writing data strategy in aiming field in domain is modified.
It wherein, may include the modification instruction having at least one read-write parameter in strategy modification instruction, to the number
It is controlled according to particular state of the corresponding data of read-write strategy when being written and read.It should be noted that in the present embodiment
When modifying reading and writing data strategy, the reading and writing data strategy in the aiming field in the metadata area of disk can be carried out first
Modification, then modify to the reading and writing data strategy in aiming field corresponding in the metadata area of memory；Alternatively, can be first
It first modifies to the reading and writing data strategy in aiming field corresponding in the metadata area of memory, then to the metadata of disk
Reading and writing data strategy in region in corresponding aiming field is modified；Alternatively, simultaneously to the meta-data region of disk and memory
Reading and writing data strategy in aiming field in domain is modified.
Whether it is as a result, that sky shows whether the target data has preset reading and writing data strategy in aiming field, is based on
This is first read out aiming field, in the present embodiment in the corresponding reading and writing data strategy of acquisition target data if mesh
It is not sky in marking-up section, then show that the target data has been previously written customized reading and writing data strategy in aiming field,
At this point, directly reading the corresponding reading and writing data strategy of target data from aiming field, and corresponding based on the target data
Reading and writing data strategy is written and read processing to target data；If being sky in aiming field, show the target data not
There is the reading and writing data strategy of customized mistake, at this point, obtaining the reading and writing data strategy of default in the present embodiment as target data
Current reading and writing data strategy, and the reading and writing data strategy based on the default is written and read processing to target data.
Wherein, the reading and writing data strategy of default can be understood as general reading and writing data strategy, not have customized number
According to each data of read-write strategy when being written and read processing, processing is written and read based on the general reading and writing data strategy.
It in the concrete realization, may include one or any number of groups had in following various parameters in reading and writing data strategy
Close: read and write rate parameter (per unit time read and write size, etc.), read-write timing parameters (write after n times write operation disk, have it is more
Write disk after few containing dirty pages, containing dirty pages write disk, etc. after reaching File Percent), read-write spacing parameter (writing disk, etc. every 10S), read
Write size parameter (1M or other numerical values reciteds, etc.), read-while writing parameter (combination for supporting multiple read-write strategies), etc..
In one implementation, the reading and writing data instruction in the present embodiment permits triggering command institute for the event received
Triggering, that is to say, that computer operating system kernel generates after receiving event license triggering command and trigger data is read
Write command, and reading and writing data instruction is responded, for example, obtaining the corresponding data of target data in reading and writing data instruction
Read-write strategy, and with reading and writing data strategy, target data is written and read processing.
Wherein, event license triggering command can be computer equipment as in the cloud storage system where storage client
The instruction that global scheduler is issued according to demand, for example, global scheduler according to strategy voluntarily scheduling storage client to the
One equipment carries out reading and writing data processing, specifically, global scheduler sends event license triggering command in storage client
Notification module generates simultaneously trigger data read write command to storage client with notice, thereby executing corresponding data rule or reading
Access evidence arrives the data read-write operations such as caching.
With reference to Fig. 2, for a kind of structural schematic diagram for data processing equipment that the embodiment of the present application two provides, in the present embodiment
Device suitable for being written and read processing to the file data such as file system.Specifically, the device in the present embodiment can
To include following structural unit:
Instruction receiving unit 201, for receiving data read write command.
Wherein, reading and writing data instruction refers to the process instruction to target data, as to some file or some file
Read instruction or write instruction etc..The reading and writing data is instructed for target data being read or being written to disk from disk
In.
It is needing to carry out file system it should be noted that reading and writing data instruction can be computer operating system kernel
Instruction generated when reading and writing data.Here file system can be various types of file system, such as Linux file system
Deng.
Tactful acquiring unit 202, for obtaining the corresponding reading and writing data strategy of target data.
Wherein, pre-defined for the data in file system to have corresponding reading and writing data strategy, different data institutes is right
The reading and writing data strategy answered can be different, it is also possible to which identical, user or terminal can be according to demand to different data as a result,
Corresponding reading and writing data strategy is set, to meet different application demands.
It should be noted that reading and writing data strategy is it is to be understood that the cache mechanism of target data, rule or write
Disk mechanism etc. reads and writes parameter, the read-write ginseng of different data containing at least one specifically, can wrap in the reading and writing data strategy
Number can be different.
Data processing unit 203, for reading and writing data strategy, target data to be written and read processing.
For example, with the corresponding reading and writing data strategy of target data in the present embodiment, by target data in a computer in
It deposits and is written and read processing between disk, be such as written to target data in disk from memory, alternatively, reading mesh from disk
Mark data；Alternatively, with the corresponding reading and writing data strategy of target data, by target data in different computers such as running node and
Processing is written and read between memory node.Read-write process among these is complete based on reading and writing data strategy corresponding to the target data
At.
As above scheme it is found that a kind of data processing equipment disclosed in the embodiment of the present application two, by being set to different data
Corresponding reading and writing data strategy is set, thus when receiving the reading and writing data instruction to data, it can be with the corresponding number of the data
It is written and read processing according to read-write strategy, accordingly, for different file or data using preset customized read-write strategy, is met
Different demands improves the extensive use of reading and writing data.
In one implementation, reading and writing data instruction permits that triggering command is triggered by the event received.And it is tactful
Acquiring unit 202 obtains the corresponding reading and writing data strategy of target data, can be accomplished by the following way:
In the aiming field in the metadata area of disk or memory, the corresponding reading and writing data plan of target data is read
Slightly.
And the reading and writing data strategy in aiming field is written by preset file control interface.
In addition, the data processing equipment in the present embodiment may also respond to strategy modification instruction, to disk and memory
Reading and writing data strategy in aiming field in metadata area is modified.
Specifically, tactful acquiring unit 202 is when reading reading and writing data strategy, if it find that be sky in aiming field, that
Obtain reading and writing data strategy of the reading and writing data strategy of default as target data.
Wherein, include at least in reading and writing data strategy: read and write rate parameter, read-write spacing parameter, is read read-write timing parameters
Write one or more of size parameter, read-while writing parameter.
With reference to Fig. 3, for the structural schematic diagram for a kind of electronic equipment that the embodiment of the present application three provides, which can be with
To store the equipment such as client or computer, to be written and read processing to data.Specifically, the electronic equipment in the present embodiment
May include with flowering structure:
Memory 301 runs generated data for storing application program and application program.
Wherein, memory 301 may include the non-volatile memory in computer-readable medium, random access memory
(RAM) and/or the forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM), memory includes extremely
A few storage chip.
Processor 302 is used for executing application, to realize function: receiving reading and writing data instruction, reading and writing data instruction is
To the process instruction of target data；Obtain the corresponding reading and writing data strategy of target data；With reading and writing data strategy, by target data
Processing is written and read between memory and disk.
As above scheme it is found that a kind of electronic equipment disclosed in the embodiment of the present application three, by the way that phase is arranged to different data
The reading and writing data strategy answered, to can be read when receiving the reading and writing data instruction to data with the corresponding data of the data
It writes strategy and is written and read processing, accordingly, for different file or data using preset customized read-write strategy, meet different
Demand, improve the extensive use of reading and writing data.
In one implementation, reading and writing data instruction permits that triggering command is triggered by the event received.And it handles
Device 302 obtains the corresponding reading and writing data strategy of target data, can be accomplished by the following way:
In the aiming field in the metadata area of disk or memory, the corresponding reading and writing data plan of target data is read
Slightly.
And the reading and writing data strategy in aiming field is written by preset file control interface.
In addition, the processor 302 in the present embodiment may also respond to strategy modification instruction, to first number of disk and memory
It modifies according to the reading and writing data strategy in the aiming field in region.
Specifically, tactful acquiring unit 202 is when reading reading and writing data strategy, if it find that be sky in aiming field, that
Obtain reading and writing data strategy of the reading and writing data strategy of default as target data.
Wherein, include at least in reading and writing data strategy: read and write rate parameter, read-write spacing parameter, is read read-write timing parameters
Write one or more of size parameter, read-while writing parameter.
With reference to Fig. 4, for a kind of structural schematic diagram for storage system that the embodiment of the present application four provides, which can be with
May include having with flowering structure in storage system in the present embodiment for cloud storage system or storage cluster:
First equipment 401, global scheduler 402 and at least one second equipment 403.
Wherein, the first equipment 401 can be one or more, can be the server or terminal reality that can store various data
It is existing, such as storage server.Global scheduler 402 is connected with the second equipment 403, can be set by server or computer etc.
It is standby to realize, to notify the second equipment 403 to execute corresponding data read-write operation according to certain strategy.Second equipment 403
It can be that the server for being able to carry out data processing or terminal are realized, such as store client.
It is read specifically, the second equipment 403 generates data in response to the event license triggering command that global scheduler 402 is sent
Write command, reading and writing data instruction are the process instruction to target data；
Second equipment 403 obtains the corresponding reading and writing data strategy of target data；With reading and writing data strategy, target data is existed
Processing is written and read in first equipment 401.
As above scheme it is found that a kind of electronic equipment disclosed in the embodiment of the present application four, by the way that phase is arranged to different data
The reading and writing data strategy answered, to can be read when receiving the reading and writing data instruction to data with the corresponding data of the data
It writes strategy and is written and read processing, accordingly, for different file or data using preset customized read-write strategy, meet different
Demand, improve the extensive use of reading and writing data.
It is below storage server with the first equipment 401, the second equipment 403 is for storing client, to storage system
Proactive notification process is initiated to be illustrated:
I realizes data collection module in the storage client of storage system, can collect operating system/application to file
Access rule, such as work as the number of files of front opening, the Mean Speed of file read-write, file system cache size, file system is slow
The data such as service condition are deposited, and are reported to the global scheduler of storage system automatically.
II realizes an internal state monitoring and data collection module, collects the state of whole system inside storage system
With load information (such as screen menu type regulative mode OSD (on-screen display) number, transacter TPS
(Transaction processing systems), the number IOPS (Input/Output per second being written and read
Operations Per Second), disk read-write rate ...), it is reported to global scheduler；
For III when storage administrator carries out O&M operation by management system, all operations will also pass through overall scheduling
Device, global scheduler according to circumstances notify each storage client (or driving)；Certain global scheduler can be according to certain
Strategy, such as each node average access ensure the high node visit etc. of priority, execute scheduling automatically.
IV global scheduler sends instructions to the notification module in storage system driving/client.
Need to define a series of new events or semaphore, driving/client of storage system in V operation system kernel
In after notification module receives instruction, trigger corresponding event.
VI operating system nucleus is performed corresponding processing according to event, such as data rule or reads data to cache；
And corresponding event is notified upwards to application.
VII application performs corresponding processing after receiving corresponding event.
The implementation process that self-defining data cache policy is written and read processing in the present embodiment is illustrated below,
It is as follows:
1, new file control interface is extended on the basis of VFS interface, can dynamically specifies/modify the cache of file
Strategy, i.e. reading and writing data strategy, such as whether without using cache, using which kind of cache, cache size and writing disk strategy etc..
2, INode structure being extended, adds cacheparams field, the cache of the field record file is tactful,
If the field is sky without customized；If user's progress is customized, INode structure can be written to by VFS interface
In cacheparams field in.The file opened will be also written in addition to INode to be written when modifying cache strategy
In the INode Cache of memory.
3, operating system nucleus needs to inquire in cache in triggering pdflush or other events when carrying out memory management
Containing dirty pages and to its rule；Wherein, when traversing Inode, only handling cacheparam field is empty inode,
Cacheparam field is not that empty expression is customized by the user tactful processing.
4, new policy management module is extended in VFS, opens file/customized plan is arranged to open file in user
When slightly, customized policy management module can be written into its inode, and according to policing type, classify to inode.
The parameter in reading and writing data strategy is illustrated below:
Max_cache_size=1M (maximum read-write size)；
Max_cache_ratio_of_file=20 (maximum reading and writing of files ratio)；
Write_to_disk_writetimes=1 (writes disk) after n times write operation；
Write_to_disk_writesize=4K (writes disk after how many containing dirty pages)；
Write_to_disk_ratio_of_file=20 (containing dirty pages write disk after reaching File Percent)；
Write_to_disk_centisecs=10 (N*100) S writes disk interval；
Same file also supports the combination of multiple cache strategies；
Etc..
5, according to policing type and the writing disk manipulation of trigger condition triggering respective file.
Each embodiment in this specification is described in a progressive manner, the highlights of each of the examples are with other
The difference of embodiment, the same or similar parts in each embodiment may refer to each other.For device disclosed in embodiment
For, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, related place is said referring to method part
It is bright.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure
And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and
The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These
Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond scope of the present application.
The step of method described in conjunction with the examples disclosed in this document or algorithm, can directly be held with hardware, processor
The combination of capable software module or the two is implemented.Software module can be placed in random access memory (RAM), memory, read-only deposit
Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology
In any other form of storage medium well known in field.
The foregoing description of the disclosed embodiments makes professional and technical personnel in the field can be realized or use the application.
Various modifications to these embodiments will be readily apparent to those skilled in the art, as defined herein
General Principle can be realized in other embodiments without departing from the spirit or scope of the application.Therefore, the application
It is not intended to be limited to the embodiments shown herein, and is to fit to and the principles and novel features disclosed herein phase one
The widest scope of cause.
Claims (10)
1. a kind of data processing method, comprising:
Reading and writing data instruction is received, the reading and writing data instruction is the process instruction to target data；
Obtain the corresponding reading and writing data strategy of the target data；
With the reading and writing data strategy, the target data is written and read processing.
2. according to the method described in claim 1, obtaining the corresponding reading and writing data strategy of the target data, comprising:
In the aiming field in the metadata area of the disk or the memory, the corresponding data of the target data are read
Read-write strategy.
3. according to the method described in claim 2, the reading and writing data strategy in the aiming field passes through preset document control
Interface is written.
4. according to the method described in claim 2, further include:
It is instructed in response to strategy modification, the data in the aiming field in the metadata area of the disk and the memory is read
Strategy is write to modify.
5. according to the method described in claim 2, further include:
If being sky in the aiming field, reading and writing data plan of the reading and writing data strategy as the target data of default is obtained
Slightly.
6. according to the method described in claim 1, being included at least in the reading and writing data strategy: when read and write rate parameter, read-write
One or more of machine parameter, read-write spacing parameter, read-write size parameter, read-while writing parameter.
7. according to the method described in claim 1, reading and writing data instruction permits that triggering command is touched by the event received
Hair.
8. a kind of data processing equipment, comprising:
Instruction receiving unit, read write command, the reading and writing data instruction are the process instruction to target data for receiving data；
Tactful acquiring unit, for obtaining the corresponding reading and writing data strategy of the target data；
Data processing unit, for the reading and writing data strategy, the target data to be written and read processing.
9. a kind of electronic equipment, comprising:
Memory runs generated data for storing application program and application program；
Processor, for executing the application program, to realize function: receiving reading and writing data instruction, the reading and writing data instruction
For the process instruction to target data；Obtain the corresponding reading and writing data strategy of the target data；With the reading and writing data strategy,
The target data is written and read to processing between memory and disk.
10. a kind of storage system, including the first equipment, global scheduler and at least one second equipment；
Second equipment generates reading and writing data instruction, institute in response to the event license triggering command that the global scheduler is sent
Reading and writing data instruction is stated as the process instruction to target data；
Second equipment obtains the corresponding reading and writing data strategy of the target data；It, will be described with the reading and writing data strategy
Target data is written and read processing on said first device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811494818.8A CN109634874A (en) | 2018-12-07 | 2018-12-07 | A kind of data processing method, device, electronic equipment and storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811494818.8A CN109634874A (en) | 2018-12-07 | 2018-12-07 | A kind of data processing method, device, electronic equipment and storage system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109634874A true CN109634874A (en) | 2019-04-16 |
Family
ID=66071935
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811494818.8A Pending CN109634874A (en) | 2018-12-07 | 2018-12-07 | A kind of data processing method, device, electronic equipment and storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109634874A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111679623A (en) * | 2020-06-11 | 2020-09-18 | 北京裹裹科技有限责任公司 | Communication method, device, terminal, programmable logic controller and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040034746A1 (en) * | 2002-08-19 | 2004-02-19 | Horn Robert L. | Method of increasing performance and manageablity of network storage systems using optimized cache setting and handling policies |
| CN103685359A (en) * | 2012-09-06 | 2014-03-26 | 中兴通讯股份有限公司 | Data processing method and device |
| CN104598394A (en) * | 2013-10-31 | 2015-05-06 | 中国石油天然气集团公司 | Data caching method and system capable of conducting dynamic distribution |
| CN106648464A (en) * | 2016-12-22 | 2017-05-10 | 柏域信息科技（上海）有限公司 | Multi-node mixed block cache data read-writing method and system based on cloud storage |
| CN108052651A (en) * | 2017-12-26 | 2018-05-18 | 新华三技术有限公司 | Collocation method, device, pre-reading method of files and electronic equipment |
-
2018
- 2018-12-07 CN CN201811494818.8A patent/CN109634874A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040034746A1 (en) * | 2002-08-19 | 2004-02-19 | Horn Robert L. | Method of increasing performance and manageablity of network storage systems using optimized cache setting and handling policies |
| CN103685359A (en) * | 2012-09-06 | 2014-03-26 | 中兴通讯股份有限公司 | Data processing method and device |
| CN104598394A (en) * | 2013-10-31 | 2015-05-06 | 中国石油天然气集团公司 | Data caching method and system capable of conducting dynamic distribution |
| CN106648464A (en) * | 2016-12-22 | 2017-05-10 | 柏域信息科技（上海）有限公司 | Multi-node mixed block cache data read-writing method and system based on cloud storage |
| CN108052651A (en) * | 2017-12-26 | 2018-05-18 | 新华三技术有限公司 | Collocation method, device, pre-reading method of files and electronic equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111679623A (en) * | 2020-06-11 | 2020-09-18 | 北京裹裹科技有限责任公司 | Communication method, device, terminal, programmable logic controller and medium |
| CN111679623B (en) * | 2020-06-11 | 2022-08-09 | 北京裹裹科技有限责任公司 | Communication method, device, terminal, programmable logic controller and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8219777B2 (en) | Virtual storage systems, virtual storage methods and methods of over committing a virtual raid storage system | |
| US8375180B2 (en) | Storage application performance matching | |
| JP4733461B2 (en) | Computer system, management computer, and logical storage area management method | |
| WO2013164878A1 (en) | Management apparatus and management method for computer system | |
| JP4464378B2 (en) | Computer system, storage system and control method for saving storage area by collecting the same data | |
| US20070061540A1 (en) | Data storage system using segmentable virtual volumes | |
| JP2013509658A (en) | Allocation of storage memory based on future usage estimates | |
| WO2006015949A1 (en) | A prioritization system | |
| US9501396B2 (en) | Wear leveling with marching strategy | |
| US9792050B2 (en) | Distributed caching systems and methods | |
| WO2021057482A1 (en) | Method and device for generating bloom filter in blockchain | |
| US7032093B1 (en) | On-demand allocation of physical storage for virtual volumes using a zero logical disk | |
| US20090157969A1 (en) | Buffer cache management to prevent deadlocks | |
| CN109491605A (en) | A kind of date storage method based on COW, device and medium | |
| CN109086462A (en) | The management method of metadata in a kind of distributed file system | |
| CN109684271A (en) | Snapshot data management method, device, electronic equipment and machine readable storage medium | |
| JP2010225024A (en) | Storage apparatus, its file control method, and storage system | |
| US7509461B1 (en) | Method and apparatus for intelligent buffer cache pre-emption | |
| CN109634874A (en) | A kind of data processing method, device, electronic equipment and storage system | |
| CN109446115A (en) | A kind of mapping table management method, device and computer readable storage medium | |
| CN108108126A (en) | A kind of data processing method, device and equipment | |
| EP3293625B1 (en) | Method and device for accessing file, and storage system | |
| JP2005339299A (en) | Method for cache control of storage device | |
| CN108604231A (en) | Mirror processing method and computing device | |
| JP6079266B2 (en) | Control device, log storage method, and control program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |