CN103403709A - Method, device and system for data reading and writing - Google Patents

Method, device and system for data reading and writing Download PDF

Info

Publication number
CN103403709A
CN103403709A CN2012800032478A CN201280003247A CN103403709A CN 103403709 A CN103403709 A CN 103403709A CN 2012800032478 A CN2012800032478 A CN 2012800032478A CN 201280003247 A CN201280003247 A CN 201280003247A CN 103403709 A CN103403709 A CN 103403709A
Authority
CN
China
Prior art keywords
index
data
storage medium
feature values
index block
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2012800032478A
Other languages
Chinese (zh)
Other versions
CN103403709B (en
Inventor
雷晓松
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN103403709A publication Critical patent/CN103403709A/en
Application granted granted Critical
Publication of CN103403709B publication Critical patent/CN103403709B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation

Abstract

The invention discloses a method, a device and a system for data reading and writing, which relate to the field of computers and resolve the problems that a conventional method is much in spending, low in efficiency, and poor in resisting external interference. The data-writing method comprises the steps of obtaining index corresponding to the data characteristic value and obtaining index block; writing the physical address of the index and the index data stored in a storage medium into the index block and writing the index block into the storage medium. The data-reading method comprises the step of obtaining index corresponding to the data characteristic value based on the data characteristic value, and determining the physical address corresponding to the index, and at last reading data from the physical address. The invention is mainly used for a computer system.

Description

A kind of methods, devices and systems of reading and writing data
Technical field
The present invention relates to computer realm, particularly a kind of methods, devices and systems to the data read-write.
Background technology
In the prior art, generally, adopt the storage system of elongated Key-Value storage means to store by the mode of LSM-Tree, the mode of appending is upgraded.
At first system is the unique definite Key value of target data according to predefined rule (as filename), then by the target data write memory.When target data was very little, once whole write memories, sorted, when the data in internal memory reach certain scale or, after certain hour, write data into disk.When target data was larger, system was according to by data write memory in batches, and the data of each write memory, all according to certain rule compositor.When the data in internal memory reach certain scale or after certain hour, the data in internal memory are written to disk, form little order file.After target data file is all write disk, form some little order files, then system is carried out sort merge to these some little order files according to identical ordering rule, forms large order file, is stored in disk.In the time need to searching the data of storage, need to use Bloom Filter to filter, to determine target data.Bloom Filter is a kind of binary vector data structure, is used for detecting the member of an element in whether gathering.But due to the restriction of its data structure itself, make it can not make right-on judgement, that is, although the data after filtering have comprised target data, also comprise the data except target data.Like this, along with the increase of original data volume, error rate can increase.For avoiding the appearance of wrong phenomenon, system must be carried out the secondary selection to the data of carrying out filter operation.
In realizing process of the present invention, the inventor finds that in prior art, there are the following problems at least:
When data writing, need to carry out two minor sorts to data, namely, at internal memory, carry out a minor sort, in storage medium, carry out a minor sort, when reading out data, need to carry out the secondary selection to data, cause the efficiency of system read-write data low, expense is large, and the extraneous jamming performance of opposing poor (such as having a power failure in the process that writes in data etc.).
Summary of the invention
Embodiments of the invention provide a kind of methods, devices and systems of reading and writing data, and solution available data reading/writing method system overhead is large, efficiency is low, the problem of opposing external interference poor performance.
For achieving the above object, embodiments of the invention adopt following technical scheme:
First aspect, a kind of method that provides data to write comprises:
Obtain and write instruction, the said write instruction comprises data to be written;
According to described data, extract data feature values, described data feature values is the parameter of the described data of unique sign;
According to described data feature values, calculate the index corresponding with described data feature values, described index is corresponding to described data feature values;
According to the selected index block corresponding with described index of described index, wherein, in storage medium, store at least one index block;
Described index block is called in to internal memory;
Described data are write to described storage medium;
Obtain the physical address of described data in described storage medium;
Described index and described physical address are write in the described index block of calling in described internal memory in the lump;
The described index block of calling in described internal memory is write in described storage medium.
In conjunction with first aspect, in the possible implementation of the first of first aspect, described method also comprises:
When described data are write to storage medium, described index and described physical address are write in described storage medium.
In conjunction with first aspect, in the possible implementation of the second of first aspect, described according to the selected index block corresponding with described index of described index, further comprise:
According to default rule, described index is calculated;
According to the described value that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
Second aspect, a kind of method that provides data to read comprises:
Obtain reading command, in described reading command, comprise data feature values, the data that the unique sign of described data feature values is to be read;
According to described reading command, extract data feature values;
According to described data feature values, according to default algorithm, calculate the index corresponding with described data feature values;
The selected index block corresponding with described index, described index block is stored in storage medium, and described index block records the physical address corresponding to each index of at least one index and record;
Described index block is called in to internal memory;
In calling in the described index block of internal memory, whether uniquely detect the index corresponding with described data feature values;
When testing result is unique, in described index block, search the physical address that described index is corresponding;
According to physical address corresponding to described index from described storage medium, reading described data.
In conjunction with second aspect, in the possible implementation of the first of second aspect, when testing result is, while having at least two index corresponding with described data feature values, further to comprise:
In described index block, search the physical address that each index is corresponding, wherein, each physical address points to the different pieces of information in described storage medium;
From the data that each physical address points to, search the data that data feature values that described data feature values and reading command comprise is identical and read.
In conjunction with second aspect, in the possible implementation of the second of second aspect, the described selected index block corresponding with described index specifically comprises:
When depositing described storage medium in, the algorithm of selecting described index block according to the index of described data calculates according to described data;
According to the described result that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
In conjunction with second aspect, in the third possible implementation of second aspect, described default algorithm is that described data are when depositing described storage medium in, according to the described data feature values calculating of described data and the algorithm of described data feature values manipulative indexing.
The third aspect, the device that provides a kind of data to write comprises:
Write instruction fetch unit, be used to obtaining, write instruction, the said write instruction comprises data to be written;
Data writing eigenwert extraction unit, for according to described data, extract data feature values, and described data feature values is the parameter of the described data of unique sign;
Write the index acquiring unit, for according to described data feature values, calculating the index corresponding with described data feature values, described index is corresponding to described data feature values;
Write the index block acquiring unit, for according to the selected index block corresponding with described index of described index, wherein, in storage medium, store at least one index block;
Write index block and call in unit, for described index block is called in to internal memory;
The data writing unit, for writing described storage medium by described data;
Write the physical address acquiring unit, for obtaining the physical address of described data at described storage medium;
Write the index block unit, for described index and described physical address are write to the described index block of calling in described internal memory in the lump;
Write the storage medium unit, for the described index block that will call in described internal memory, write described storage medium.
In conjunction with the third aspect, in the possible implementation of the first of the third aspect, the said write data cell, also when described data are write to storage medium, write described index and described physical address in described storage medium.
In conjunction with the third aspect, in the possible implementation of the second of the third aspect, said write index block acquiring unit further comprises:
Write computation subunit, for the rule according to default, described index is calculated;
Write index block and determine subelement, for according to the described value that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
Fourth aspect, the device that provides a kind of data to read comprises:
The reading command acquiring unit, be used to obtaining reading command, comprise data feature values in described reading command, the data that the unique sign of described data feature values is to be read;
Read data features value extraction unit, for according to described reading command, extract data feature values;
Read the index acquiring unit, for according to described data feature values, according to default algorithm, calculate the index corresponding with described data feature values;
Read the index block acquiring unit, for the selected index block corresponding with described index, described index block is stored in storage medium, and described index block records the physical address corresponding to each index of at least one index and record;
Read index block and call in unit, for described index block is called in to internal memory;
Whether unique detecting unit, for calling in the described index block of internal memory, detect the index corresponding with described data feature values;
Read the physical address acquiring unit, for when testing result is unique, in described index block, search the physical address that described index is corresponding;
The reading out data unit, for reading described data according to physical address corresponding to described index from described storage medium.
In conjunction with fourth aspect, in the possible implementation of the first of fourth aspect, the result that detects when described detecting unit is while having at least two index corresponding with described data feature values,
The described physical address acquiring unit that reads, also at described index block, searching the physical address that each index is corresponding, wherein, each physical address points to the different pieces of information in described storage medium;
Described detecting unit, data for pointing to from each physical address also, search the identical data of data feature values that eigenwert and reading command comprise;
Described reading out data unit, also be used to reading the identical data of data feature values that comprise with reading command.
In conjunction with fourth aspect, in the possible implementation of the second of fourth aspect, the described index block acquiring unit that reads specifically comprises:
Read computation subunit, for according to described data when depositing described storage medium in, according to the algorithm of the selected described index block of the index of described data, calculate;
Read index block and determine subelement, for according to the described result that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
In conjunction with fourth aspect, in the third possible implementation of fourth aspect, the described described default algorithm that reads the use of index acquiring unit is that described data are when depositing described storage medium in, according to the described data feature values calculating of described data and the algorithm of described data feature values manipulative indexing.
The 5th aspect, the device that provides a kind of data to write comprises:
Processor, be used to obtaining reading command, comprise data feature values in described reading command, the data that the unique sign of described data feature values is to be read; According to described reading command, extract data feature values; According to described data feature values, according to default algorithm, calculate the index corresponding with described data feature values; The selected index block corresponding with described index, described index block is stored in storage medium, and described index block records the physical address corresponding to each index of at least one index and record; Described index block is called in to internal memory; In calling in the described index block of internal memory, whether uniquely detect the index corresponding with described data feature values; For when testing result is unique, in described index block, search the physical address that described index is corresponding; According to physical address corresponding to described index from described storage medium, reading described data.
Described internal memory is for auxiliary described processor reading out data;
Storage medium is for storing the data that described processor need to read;
Bus is for connecting described processor, described internal memory and described storage medium.
In conjunction with the 5th aspect, in the possible implementation of the first aspect the 5th, described processor, also when described data are write to storage medium, write described index and described physical address in described storage medium.
In conjunction with the 5th aspect, in the possible implementation of the second aspect the 5th, described processor also, for the rule according to default, calculates described index; According to the described value that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
The 6th aspect, the device that a kind of data read comprises:
Processor, be used to obtaining reading command, comprise data feature values in described reading command, the data that the unique sign of described data feature values is to be read; According to described reading command, extract data feature values; According to described data feature values, according to default algorithm, calculate the index corresponding with described data feature values; The selected index block corresponding with described index, described index block is stored in storage medium, and described index block records the physical address corresponding to each index of at least one index and record; Described index block is called in to internal memory; In calling in the described index block of internal memory, whether uniquely detect the index corresponding with described data feature values; For when testing result is unique, in described index block, search the physical address that described index is corresponding; According to physical address corresponding to described index from described storage medium, reading described data.
Described internal memory is for auxiliary described processor reading out data;
Storage medium is for storing the data that described processor need to read;
Bus is for connecting described processor, described internal memory and described storage medium.
In conjunction with the 6th aspect, in the possible implementation of the first aspect the 6th, described processor is also while having at least two index corresponding with described data feature values for the result that detects when described detecting unit, in described index block, search the physical address that each index is corresponding, wherein, each physical address points to the different pieces of information in described storage medium; From the data that each physical address points to, search the identical data of data feature values that eigenwert and reading command comprise; Read the identical data of data feature values that comprise with reading command.
In conjunction with the 6th aspect, in the possible implementation of the second aspect the 6th, described processor also for according to described data when depositing described storage medium in, according to the algorithm of the selected described index block of index of described data, calculate; According to the described result that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
In conjunction with the 6th aspect, in the third possible implementation aspect the 6th, the described default algorithm that described processor uses is that described data are when depositing described storage medium in, according to the described data feature values calculating of described data and the algorithm of described data feature values manipulative indexing.
The 7th aspect, provide a kind of computer system, it is characterized in that, comprising: processor, internal memory, storage medium, bus; Wherein,
Described processor comprises described any one the possible device of the third aspect and described any one the possible device of fourth aspect;
Described internal memory writes described storage medium for auxiliary described processor by data and from described storage medium reading out data;
The data that storage medium need to read for storing data that described processor need to write and described processor;
Bus is for connecting described processor, described internal memory and described storage medium.
Embodiments of the invention provide a kind of methods, devices and systems of reading and writing data.Data are write fashionable, at first according to data feature values, obtain the index corresponding with described data feature values, and then obtain index block; Then the physical address of index and index corresponding data being stored in storage medium writes index block, finally index block is write to storage medium.When data read, at first according to data feature values, obtain the index corresponding with data feature values, then determine physical address corresponding to index, finally from reading out data physical address.The present invention is mainly used in computer system.By such scheme, the system overhead while reducing reading and writing data, increase read-write efficiency, the extraneous jamming performance of raising opposing.
The accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, below will the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the FB(flow block) of a kind of method for writing data in the embodiment of the present invention 1;
Fig. 2 is the schematic diagram of index block inner structure in the embodiment of the present invention 1;
Fig. 3 writes the schematic diagram of index and physical address in the embodiment of the present invention 1;
Fig. 4 is the FB(flow block) of a kind of method for reading data in the embodiment of the present invention 1;
Fig. 5 is the FB(flow block) of a kind of method for writing data in the embodiment of the present invention 2;
Fig. 6 is the FB(flow block) of a kind of method for reading data in the embodiment of the present invention 2;
Fig. 7 is the block diagram of a kind of data transfer apparatus in the embodiment of the present invention 3;
Fig. 8 writes the schematic diagram of index block acquiring unit in the embodiment of the present invention 3;
Fig. 9 is the block diagram of a kind of data fetch device in the embodiment of the present invention 3;
Figure 10 reads the schematic diagram of index block acquiring unit in the embodiment of the present invention 3;
Figure 11 is the schematic diagram of a kind of data transfer apparatus in the embodiment of the present invention 4;
Figure 12 is the schematic diagram of a kind of data fetch device in the embodiment of the present invention 4;
Figure 13 is the schematic diagram of a kind of computer system in the embodiment of the present invention 4.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, rather than whole embodiment.Based on the embodiment in the present invention, those of ordinary skills, not making under the creative work prerequisite the every other embodiment that obtains, belong to the scope of protection of the invention.
Embodiment 1:
One embodiment of the present of invention provide a kind of method of reading and writing data.
On the one hand, a kind of method that data write, as shown in Figure 1, the method comprises the steps:
101, obtain and write instruction, the said write instruction comprises data to be written.
Data to be written described in step 101 comprise the data and the parameters relevant to these data that need to store in storage medium.Example 1, data to be written are song A.mp3, this song title is A.mp3, the storage space that needs is 5MB (Mega Byte, hundred megabyte), song itself is the data to be written described in step 101, and song title A is the parameters that these data are relevant with the storage space 5MB that needs, obviously, parameter associated with the data is including but not limited to the above-mentioned parameter of enumerating.
102, according to described data, extract data feature values, described data feature values is the parameter of the described data of unique sign.
Same take the parameter of example 1 as the described data of the described unique sign of example description of step 102.If need the title A.mp3 of the data song A.mp3 of storage can these data of unique sign, show that the title that does not have any one data is equally also A.mp3, A.mp3 can be used as the data feature values of these data.
103, according to described data feature values, calculate the index corresponding with described data feature values.
The described calculating of step 103 can be hash algorithm, and index is exactly the value that arrives after the data eigenwert is calculated according to hash algorithm, i.e. cryptographic hash.Index is included in index block, and index block is stored in storage medium, and each index block comprises the index that presets number.
What Fig. 2 represented is the inner structure that is stored in the index block in storage medium.201 is storage medium, and 202 for being stored in the index block in storage medium.Wherein, in each index block, comprise predefined many entries 205.Entry 205 forms by 203 and 204, recording indexes in 203 wherein, and record data are stored in the physical address in storage medium in 204.From figure, finding out clearly, 203 and 204 have corresponding relation.
104, according to the selected index block corresponding with described index of described index, wherein, in storage medium, store at least one index block.
Selected operation described in step 104 can be specifically:
According to default rule, described index is calculated; According to the described value that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
Illustrate, namely at first index block is numbered to (this process is determined when design system), then (complementation is default rule index to be carried out to complementation, obviously, with other algorithm of complementation same effect, also can be used as default rule, the present embodiment is take complementation as example, but conduct does not limit.), finally according to the value that obtains after computing, determine the index block that index is corresponding.Suppose to be stored in totally 3 of index blocks in storage medium, index is 10.Index block is extremely little of greatly uninterruptedly numbering according to integer, and the index block after the numbering is: No. 0 index block, No. 1 index block, No. 2 index blocks.Then index of reference 10 is 1 divided by the result of number 3 remainders of index block, and the index block that this index is corresponding is No. 1 index block.
105, described index block is called in to internal memory.
106, described data are write to described storage medium.
107, obtain the physical address of described data in described storage medium.
108, described index and described physical address are write in the described index block of calling in described internal memory in the lump.
In conjunction with Fig. 3, ablation process is described, at first selected index block 302 is called in to internal memory 301, then index and physical address are write in the entry 305 in index block 302, be about to index and write in storage space 303, physical address is write in the storage space 304 of 303 correspondences.
109, the described index block that will call in described internal memory writes in described storage medium.
A kind of method that embodiments of the invention provide data to write.At first according to data feature values, obtain the index corresponding with described data feature values, and then obtain index block; Then the physical address of index and index corresponding data being stored in storage medium writes index block, finally index block is write to storage medium.By such scheme, reduce data and write fashionable system overhead, increase write efficiency.
On the other hand, a kind of method that the embodiment of the present invention also provides data to read, as shown in Figure 4, the method comprises the steps:
401, obtain reading command, in described reading command, comprise data feature values, the data that the unique sign of described data feature values is to be read.
Data feature values described in step 401 can be the parameter that the data name of data or other can unique characterization datas.Data feature values is mainly used in the selected data that need to read in the data from be stored in storage medium.
402,, according to described reading command, extract data feature values.
If the name A.mp3 that the data that need to read are song A.mp3 and song can these data of unique sign, the data feature values of extracting in step 402 is A.mp3.
403,, according to described data feature values, according to default algorithm, calculate the index corresponding with described data feature values.
It needs to be noted the be written as basis of the read operation of data with data, just namely how to write and should how to read.Default algorithm described in step 403 is that described data are when depositing described storage medium in, according to the described data feature values calculating of described data and the algorithm of described data feature values manipulative indexing.For instance, establishing the data that write is song A.mp3, and the data feature values of extraction is A.mp3, by hash algorithm, A.mp3 is calculated, and obtains index.When reading out data song A.mp3, also need to be according to same computing method, namely hash algorithm calculates A.mp3, thereby obtains index.As can be known according to foregoing description, in order to guarantee data, can be read out, when reading out data, obtaining the algorithm of index, to obtain the algorithm of index should be with data writing the time identical.If namely data writing adopts the X algorithm to obtain index, during reading out data, also adopt the X algorithm to obtain index.
404, the selected index block corresponding with described index, described index block is stored in storage medium, and described index block records the physical address corresponding to each index of at least one index and record.
Detailed process selected described in step 404 is as follows:
When depositing described storage medium in, the algorithm of selecting described index block according to the index of described data calculates according to described data; According to the described result that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
illustrate, if the data that write are song A.mp3, the index that calculates is 10, 3 altogether of index blocks in storage medium, be numbered index block No. 0, No. 1 index block, No. 2 index blocks, and adopt the algorithm of remainder to determine index block, be that index of reference 10 is divided by index block number 3, obtain remainder 1, thereby the index block of determining index 10 correspondences is No. 1 index block, , when reading out data, also should obtain index block according to the algorithm of remainder, namely by calculating, convert data song A.mp3 to index 10, then index of reference 10 is divided by the number 3 of index block, obtain remainder 1, thereby index block corresponding to index of determining data to be read is No. 1 index block.
405, described index block is called in to internal memory.
406,, in calling in the described index block of internal memory, whether uniquely detect the index corresponding with described data feature values.
Detection described in step 406 is to mate with the index that obtains in step 403 and the index that is stored in the index block of calling in internal memory.Because index is that the data eigenwert is calculated, although data feature values can unique characterization data, after data feature values is carried out to computing, the identical situation of result of calculation of different data feature values may appear, namely produced identical index.Concrete, when adopting hash algorithm when obtaining the computing method of index, hash-collision may appear, the situation that causes same index occurring occurs.Therefore, two identical index likely appear in same index block existing.
407,, when testing result is unique, in described index block, search the physical address that described index is corresponding.
408, according to physical address corresponding to described index from described storage medium, reading described data.
A kind of method that embodiments of the invention provide data to read.At first according to data feature values, obtain the index corresponding with data feature values, then determine physical address corresponding to index, finally from reading out data physical address.The present invention is mainly used in computer system.By such scheme, the system overhead while reducing reading and writing data, increase read-write efficiency, the extraneous jamming performance of raising opposing.
Embodiment 2
Embodiments of the invention provide a kind of method of reading and writing data.
On the one hand, a kind of method that data write, as shown in Figure 5, the method comprises the steps:
501, obtain and write instruction, the said write instruction comprises data to be written.
502, according to described data, extract data feature values, described data feature values is the parameter of the described data of unique sign.
503, according to described data feature values, calculate the index corresponding with described data feature values, described index is corresponding to described data feature values.
504, according to the selected index block corresponding with described index of described index, wherein, in storage medium, store at least one index block.
505, described index block is called in to internal memory;
506, described data, described index and described physical address are write to described storage medium;
The implementation of step 506 can be storage index and physical address on the memory address of storage data, can be also to store data on an address of storage space, storage index and physical address on another address of storage medium, for sake of convenience, take storage index and physical address on the memory address in the storage data as example.It should be noted that as saving storage space, after execution of step 506, system is index and the physical address of the last storage of deletion automatically, that is to say, on the address of storage data, only keeps an index and physical address corresponding to this index.
507, obtain the physical address of described data in described storage medium.
508, described index and described physical address are write in the described index block of calling in described internal memory in the lump.
509, the described index block that will call in described internal memory writes in described storage medium.
510, the system accident recovers again normal after quitting work, the index and the physical address that are stored in storage medium are read, and obtain the manipulative indexing piece in storage medium according to index, then index and physical address are write to the index block that is stored in storage medium.
The physical address of data and index have corresponding relation, and (corresponding relation is fashionablely determined writing, specific implementation as described in Example 1, does not repeat them here), therefore, when reading out data, as long as find, need the index that reading out data is corresponding just can find these data.But because the step of data writing is at first data to be write to storage medium, and then index block is write to storage medium (store index and physical address and both in index block and be corresponding relation).After data write storage medium, while in time index block not being write to storage medium, unexpected something unexpected happened, such as having a power failure etc., can produce such consequence: owing in the index block of storing in storage medium, there is no the index of data writing, even, therefore data have successfully write storage medium, still can not successfully read this data.
The purpose of step 510 is to eliminate above-mentioned fortuitous event: after system is resumed work at every turn, in obtaining step 506, write index and the physical address of storage medium, and determine to be stored in the manipulative indexing piece in storage medium according to index, then index and physical address are write to the index block that is stored in storage medium.
Illustrate, the address that data song A.mp3 is write to storage medium is a, and index is 10.After execution step 506, address a, index 10 is stored on an address of storage medium with song A.mp3.At this moment, something unexpected happened, cause and fail to perform step 507 to 509, in the index block in storage medium, do not have index 10 and address a.At this moment, after system is recovered normally, at first from storage medium, index 10 and address a are taken out, then according to index 10, obtain the index block of index 10 correspondences, then index 10 and address a are write to this index block.
A kind of method that embodiments of the invention provide data to write.At first according to data feature values, obtain the index corresponding with described data feature values, and then obtain index block; Then described index and described physical address and described data write simultaneously in described storage medium and index and index corresponding data are stored in storage medium physical address is write to index block, finally index block being write to storage medium.By such scheme, reduce data and write fashionable system overhead, increase write efficiency, the increase system is supported jamproof ability.
On the other hand, a kind of method that provides data to read as shown in Figure 6, comprising:
601, obtain reading command, in described reading command, comprise data feature values, the data that the unique sign of described data feature values is to be read.
602,, according to described reading command, extract data feature values.
603,, according to described data feature values, according to default algorithm, calculate the index corresponding with described data feature values.
604, the selected index block corresponding with described index, described index block is stored in storage medium, and described index block records the physical address corresponding to each index of at least one index and record.
605, described index block is called in to internal memory.
606,, in calling in the described index block of internal memory, whether uniquely detect the index corresponding with described data feature values.
607, when testing result be, while having at least two index corresponding with described data feature values, in described index block, to search the physical address that each index is corresponding, wherein, each physical address points to the different pieces of information in described storage medium.
608,, from the data that each physical address points to, search the data that data feature values that described data feature values and reading command comprise is identical and read.
Illustrate step 607 to 608: establishing data to be read is song A.mp3, and data feature values is A.mp3, and index is 10, and the index block of index 10 correspondences is No. 1 index block.In No. 1 index block, recorded 3 index, i.e. the first index, this index is 10, the second index, and this index is 10, the three index, and this index is 11.Then respectively the data on the first index and physical address corresponding to the second index are taken out, the data that the first index is corresponding are song A.mp3, and the data that the second index is corresponding are film B.avi.Because the data feature values A.mp3 of song A.mp3 is identical with the data feature values A.mp3 that reading command comprises, therefore take out and return to the user by song A.mp3.
Embodiments of the invention provide a kind of method that data are read, at first according to data feature values, obtain the index corresponding with data feature values, when having index corresponding at least two data eigenwerts, from the data that each physical address points to, search the data that data feature values that described data feature values and reading command comprise is identical and read.By such scheme, improve the extraneous jamming performance of opposing, the system overhead while reducing reading and writing data, increase read-write efficiency.
Embodiment 3:
One embodiment of the present of invention provide a kind of device of reading and writing data.
On the one hand, the device that a kind of data write, as shown in Figure 7, this device comprises:
Write instruction fetch unit 71, be used to obtaining, write instruction, the said write instruction comprises data to be written.
Data writing eigenwert extraction unit 72, for according to described data, extract data feature values, and described data feature values is the parameter of the described data of unique sign.
Write index acquiring unit 73, for according to described data feature values, calculating the index corresponding with described data feature values, described index is corresponding to described data feature values.
Write index block acquiring unit 74, for according to the selected index block corresponding with described index of described index, wherein, in storage medium, store at least one index block.
Write index block and call in unit 75, for described index block is called in to internal memory.
Data writing unit 76, for writing described storage medium by described data.
Write physical address acquiring unit 77, for obtaining the physical address of described data at described storage medium.
Write index block unit 78, for described index and described physical address are write to the described index block of calling in described internal memory in the lump.
Write storage medium unit 79, for the described index block that will call in described internal memory, write described storage medium.
Further, said write data cell 76, also when described data are write to storage medium, write described index and described physical address in described storage medium.
Further, as shown in Figure 8, write index block acquiring unit 75 and also comprise:
Write computation subunit 751, for the rule according to default, described index is calculated.
Write index block and determine subelement 752, for according to the described value that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
It is to be noted, write instruction fetch unit 71, data writing eigenwert extraction unit 72, write index acquiring unit 73, writes index block acquiring unit 74, write index block and call in unit 75, data writing unit 76, write physical address acquiring unit 77, writes index block unit 78, writing storage medium unit 79 can be integrated in CPU (Centra l Processing Unit, central processing unit).
The device that embodiments of the invention provide a kind of data to write.At first according to data feature values, obtain the index corresponding with described data feature values, and then obtain index block; Then described index and described physical address and described data write simultaneously in described storage medium and index and index corresponding data are stored in storage medium physical address is write to index block, finally index block being write to storage medium.By such scheme, reduce data and write fashionable system overhead, increase write efficiency, the increase system is supported jamproof ability.
On the other hand, the device that a kind of data read, as shown in Figure 9, this device comprises:
Reading command acquiring unit 81, be used to obtaining reading command, comprise data feature values in described reading command, the data that the unique sign of described data feature values is to be read.
Read data features value extraction unit 82, for according to described reading command, extract data feature values;
Read index acquiring unit 83, for according to described data feature values, according to default algorithm, calculate the index corresponding with described data feature values.
Read index block acquiring unit 84, for the selected index block corresponding with described index, described index block is stored in storage medium, and described index block records the physical address corresponding to each index of at least one index and record.
Read index block and call in unit 85, for described index block is called in to internal memory.
Whether unique detecting unit 86, for calling in the described index block of internal memory, detect the index corresponding with described data feature values.
Read physical address acquiring unit 87, for when testing result is unique, in described index block, search the physical address that described index is corresponding.
Reading out data unit 88, for reading described data according to physical address corresponding to described index from described storage medium.
Further, the result that described detecting unit 86 detects is while having at least two index corresponding with described data feature values,
The described physical address acquiring unit 87 that reads, also at described index block, searching the physical address that each index is corresponding, wherein, each physical address points to the different pieces of information in described storage medium.
Described detecting unit 86, data for pointing to from each physical address also, search the identical data of data feature values that eigenwert and reading command comprise.
Described reading out data unit 88, also be used to reading the identical data of data feature values that comprise with reading command.
Further, as shown in figure 10, the described index block acquiring unit 84 that reads specifically comprises:
Read computation subunit 841, for according to described data when depositing described storage medium in, according to the algorithm of the selected described index block of the index of described data, calculate.
Read index block and determine subelement 842, for according to the described result that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
Further, the described described default algorithm that reads 83 uses of index acquiring unit is that described data are when depositing described storage medium in, according to the described data feature values calculating of described data and the algorithm of described data feature values manipulative indexing.
It is to be noted, reading command acquiring unit 81, read data features value extraction unit 82, read index acquiring unit 83, read index block acquiring unit 84, read index block and call in unit 85, detecting unit 86, read physical address acquiring unit 87, reading out data unit 88 can be integrated in CPU (Central Processing Unit, central processing unit).
Embodiments of the invention provide a kind of device that data are read, at first according to data feature values, obtain the index corresponding with data feature values, when having index corresponding at least two data eigenwerts, from the data that each physical address points to, search the data that data feature values that described data feature values and reading command comprise is identical and read.By such scheme, improve the extraneous jamming performance of opposing, the system overhead while reducing reading and writing data, increase read-write efficiency.
Embodiment 4:
One embodiment of the present of invention provide a kind of device of reading and writing data.
The device that provides a kind of data to write on the one hand as shown in figure 11, comprising:
Processor 91, write instruction be used to obtaining, and the said write instruction comprises data to be written; According to described data, extract data feature values, described data feature values is the parameter of the described data of unique sign; According to described data feature values, calculate the index corresponding with described data feature values, described index is corresponding to described data feature values; According to the selected index block corresponding with described index of described index, wherein, in storage medium, store at least one index block; Described index block is called in to internal memory; Obtain the physical address of described data in described storage medium; Described index and described physical address are write in the described index block of calling in described internal memory in the lump; For described data are write to described storage medium; The described index block of calling in described internal memory is write in described storage medium.
Internal memory 92, write described storage medium for auxiliary described processor by data.
Storage medium 93, the data that need to write be used to storing described processor.
Bus 94, be used to connecting described processor, described internal memory and described storage medium.
Further, described processor 91 also when described data are write to storage medium, writes described index and described physical address in described storage medium.
Further, described processor 91 also, for the rule according to default, calculates described index; According to the described value that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
The device that embodiments of the invention provide a kind of data to write.At first according to data feature values, obtain the index corresponding with described data feature values, and then obtain index block; Then described index and described physical address and described data write simultaneously in described storage medium and index and index corresponding data are stored in storage medium physical address is write to index block, finally index block being write to storage medium.By such scheme, reduce data and write fashionable system overhead, increase write efficiency, the increase system is supported jamproof ability.
On the other hand, the device that provides a kind of data to read as shown in figure 12, comprising:
Processor 1001, be used to obtaining reading command, comprise data feature values in described reading command, the data that the unique sign of described data feature values is to be read; According to described reading command, extract data feature values; According to described data feature values, according to default algorithm, calculate the index corresponding with described data feature values; The selected index block corresponding with described index, described index block is stored in storage medium, and described index block records the physical address corresponding to each index of at least one index and record; Described index block is called in to internal memory; In calling in the described index block of internal memory, whether uniquely detect the index corresponding with described data feature values; For when testing result is unique, in described index block, search the physical address that described index is corresponding; According to physical address corresponding to described index from described storage medium, reading described data.
Internal memory 1002, for auxiliary described processor reading out data.
Storage medium 1003, the data that need to read be used to storing described processor.
Bus 1004, be used to connecting described processor, described internal memory and described storage medium.
Further, described processor 1001 is also while having at least two index corresponding with described data feature values for the result that detects when described detecting unit, in described index block, search the physical address that each index is corresponding, wherein, each physical address points to the different pieces of information in described storage medium; From the data that each physical address points to, search the identical data of data feature values that eigenwert and reading command comprise; Read the identical data of data feature values that comprise with reading command.
Further, described processor 1001 also for according to described data when depositing described storage medium in, according to the algorithm of the selected described index block of the index of described data, calculate; According to the described result that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
Further, the described default algorithm that described processor 1001 uses is that described data are when depositing described storage medium in, according to the described data feature values calculating of described data and the algorithm of described data feature values manipulative indexing.
Embodiments of the invention provide a kind of device that data are read, at first according to data feature values, obtain the index corresponding with data feature values, when having index corresponding at least two data eigenwerts, from the data that each physical address points to, search the data that data feature values that described data feature values and reading command comprise is identical and read.By such scheme, improve the extraneous jamming performance of opposing, the system overhead while reducing reading and writing data, increase read-write efficiency.
On the one hand, as shown in figure 13, provide a kind of computer system again, it is characterized in that, comprising: processor 1101, internal memory 1102, storage medium 1103, bus 1104; Wherein,
Described processor 1101 comprises the described any one device of claim 8 to 10 and the described any one device of claim 11 to 14.
Described internal memory 1102 writes described storage medium for auxiliary described processor by data and from described storage medium reading out data;
The data that described storage medium 1103 need to read be used to the data of storing described processor and need to write and described processor.
Described bus 1104 is be used to connecting described processor 1101, described internal memory 1102 and described storage medium 1103.
It is pointed out that processor 91, processor 1001, processor 1101 in this enforcement can be that CPU (Central Processing Unit, central processing unit) can be also that other has the device of carrying out described function.
Embodiments of the invention provide a kind of system of reading and writing data.Data are write fashionable, at first according to data feature values, obtain the index corresponding with described data feature values, and then obtain index block; Then the physical address of index and index corresponding data being stored in storage medium writes index block, finally index block is write to storage medium.When data read, at first according to data feature values, obtain the index corresponding with data feature values, then determine physical address corresponding to index, finally from reading out data physical address.The present invention is mainly used in computer system.By such scheme, the system overhead while reducing reading and writing data, increase read-write efficiency, the extraneous jamming performance of raising opposing.
Through the above description of the embodiments, the those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential common hardware, can certainly pass through hardware, but in a lot of situation, the former is better embodiment.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words can embody with the form of software product, this computer software product is stored in the storage medium that can read, floppy disk as computing machine, hard disk or CD etc., comprise some instructions with so that computer equipment (can be personal computer, server, or the network equipment etc.) carry out the described method of each embodiment of the present invention.
The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited to this, anyly is familiar with those skilled in the art in the technical scope that the present invention discloses; the variation that can expect easily or replacement, within all should being encompassed in protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection domain of described claim.

Claims (22)

1. the method that data write, is characterized in that, comprising:
Obtain and write instruction, the said write instruction comprises data to be written;
According to described data, extract data feature values, described data feature values is the parameter of the described data of unique sign;
According to described data feature values, calculate the index corresponding with described data feature values, described index is corresponding to described data feature values;
According to the selected index block corresponding with described index of described index, wherein, in storage medium, store at least one index block;
Described index block is called in to internal memory;
Described data are write to described storage medium;
Obtain the physical address of described data in described storage medium;
Described index and described physical address are write in the described index block of calling in described internal memory in the lump;
The described index block of calling in described internal memory is write in described storage medium.
2. method according to claim 1, is characterized in that, described method also comprises:
When described data are write to storage medium, described index and described physical address are write in described storage medium.
3. method according to claim 1, is characterized in that, and is described according to the selected index block corresponding with described index of described index, further comprises:
According to default rule, described index is calculated;
According to the described value that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
4. the method that data read, is characterized in that, comprising:
Obtain reading command, in described reading command, comprise data feature values, the data that the unique sign of described data feature values is to be read;
According to described reading command, extract data feature values;
According to described data feature values, according to default algorithm, calculate the index corresponding with described data feature values;
The selected index block corresponding with described index, described index block is stored in storage medium, and described index block records the physical address corresponding to each index of at least one index and record;
Described index block is called in to internal memory;
In calling in the described index block of internal memory, whether uniquely detect the index corresponding with described data feature values;
When testing result is unique, in described index block, search the physical address that described index is corresponding;
According to physical address corresponding to described index from described storage medium, reading described data.
5. method according to claim 4, is characterized in that, when testing result is, while having at least two index corresponding with described data feature values, further to comprise:
In described index block, search the physical address that each index is corresponding, wherein, each physical address points to the different pieces of information in described storage medium;
From the data that each physical address points to, search the data that data feature values that described data feature values and reading command comprise is identical and read.
6. method according to claim 4, is characterized in that, the selected index block corresponding with described index specifically comprises:
When depositing described storage medium in, the algorithm of selecting described index block according to the index of described data calculates according to described data;
According to the described result that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
7. method according to claim 4, is characterized in that, described default algorithm is that described data are when depositing described storage medium in, according to the described data feature values calculating of described data and the algorithm of described data feature values manipulative indexing.
8. the device that data write, is characterized in that, comprising:
Write instruction fetch unit, be used to obtaining, write instruction, the said write instruction comprises data to be written;
Data writing eigenwert extraction unit, for according to described data, extract data feature values, and described data feature values is the parameter of the described data of unique sign;
Write the index acquiring unit, for according to described data feature values, calculating the index corresponding with described data feature values, described index is corresponding to described data feature values;
Write the index block acquiring unit, for according to the selected index block corresponding with described index of described index, wherein, in storage medium, store at least one index block;
Write index block and call in unit, for described index block is called in to internal memory;
The data writing unit, for writing described storage medium by described data;
Write the physical address acquiring unit, for obtaining the physical address of described data at described storage medium;
Write the index block unit, for described index and described physical address are write to the described index block of calling in described internal memory in the lump;
Write the storage medium unit, for the described index block that will call in described internal memory, write described storage medium.
9. device according to claim 8, is characterized in that, the said write data cell also when described data are write to storage medium, writes described index and described physical address in described storage medium.
10. device according to claim 8, is characterized in that, said write index block acquiring unit further comprises:
Write computation subunit, for the rule according to default, described index is calculated;
Write index block and determine subelement, for according to the described value that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
11. the device that data read, is characterized in that, comprising:
The reading command acquiring unit, be used to obtaining reading command, comprise data feature values in described reading command, the data that the unique sign of described data feature values is to be read;
Read data features value extraction unit, for according to described reading command, extract data feature values;
Read the index acquiring unit, for according to described data feature values, according to default algorithm, calculate the index corresponding with described data feature values;
Read the index block acquiring unit, for the selected index block corresponding with described index, described index block is stored in storage medium, and described index block records the physical address corresponding to each index of at least one index and record;
Read index block and call in unit, for described index block is called in to internal memory;
Whether unique detecting unit, for calling in the described index block of internal memory, detect the index corresponding with described data feature values;
Read the physical address acquiring unit, for when testing result is unique, in described index block, search the physical address that described index is corresponding;
The reading out data unit, for reading described data according to physical address corresponding to described index from described storage medium.
12. device according to claim 11, is characterized in that, the result that detects when described detecting unit is while having at least two index corresponding with described data feature values,
The described physical address acquiring unit that reads, also at described index block, searching the physical address that each index is corresponding, wherein, each physical address points to the different pieces of information in described storage medium;
Described detecting unit, data for pointing to from each physical address also, search the identical data of data feature values that eigenwert and reading command comprise;
Described reading out data unit, also be used to reading the identical data of data feature values that comprise with reading command.
13. device according to claim 11, is characterized in that, the described index block acquiring unit that reads specifically comprises:
Read computation subunit, for according to described data when depositing described storage medium in, according to the algorithm of the selected described index block of the index of described data, calculate;
Read index block and determine subelement, for according to the described result that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
14. device according to claim 11, it is characterized in that, the described described default algorithm that reads the use of index acquiring unit is that described data are when depositing described storage medium in, according to the described data feature values calculating of described data and the algorithm of described data feature values manipulative indexing.
15. the device that data write, is characterized in that, comprising:
Processor, write instruction be used to obtaining, and the said write instruction comprises data to be written; According to described data, extract data feature values, described data feature values is the parameter of the described data of unique sign; According to described data feature values, calculate the index corresponding with described data feature values, described index is corresponding to described data feature values; According to the selected index block corresponding with described index of described index, wherein, in storage medium, store at least one index block; Described index block is called in to internal memory; Obtain the physical address of described data in described storage medium; Described index and described physical address are write in the described index block of calling in described internal memory in the lump; For described data are write to described storage medium; The described index block of calling in described internal memory is write in described storage medium.
Described internal memory writes described storage medium for auxiliary described processor by data;
Storage medium is for storing the data that described processor need to write;
Bus is for connecting described processor, described internal memory and described storage medium.
16. device according to claim 15, is characterized in that, described processor also when described data are write to storage medium, writes described index and described physical address in described storage medium.
17. device according to claim 15, is characterized in that, described processor also, for the rule according to default, calculates described index; According to the described value that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
18. the device that data read, is characterized in that, comprising:
Processor, for be used to obtaining reading command, comprise data feature values in described reading command, the data that the unique sign of described data feature values is to be read; According to described reading command, extract data feature values; According to described data feature values, according to default algorithm, calculate the index corresponding with described data feature values; The selected index block corresponding with described index, described index block is stored in storage medium, and described index block records the physical address corresponding to each index of at least one index and record; Described index block is called in to internal memory; In calling in the described index block of internal memory, whether uniquely detect the index corresponding with described data feature values; For when testing result is unique, in described index block, search the physical address that described index is corresponding; According to physical address corresponding to described index from described storage medium, reading described data.
Internal memory is for auxiliary described processor reading out data;
Storage medium is for storing the data that described processor need to read;
Bus is for connecting described processor, described internal memory and described storage medium.
19. device according to claim 18, it is characterized in that, described processor is also while having at least two index corresponding with described data feature values for the result that detects when described detecting unit, in described index block, search the physical address that each index is corresponding, wherein, each physical address points to the different pieces of information in described storage medium; From the data that each physical address points to, search the identical data of data feature values that eigenwert and reading command comprise; Read the identical data of data feature values that comprise with reading command.
20. device according to claim 18, is characterized in that, described processor also for according to described data when depositing described storage medium in, according to the algorithm of the selected described index block of the index of described data, calculate; According to the described result that calculates, in the index block in being stored in described storage medium, determine the described index block corresponding with described index.
21. device according to claim 17, it is characterized in that, the described default algorithm that described processor uses is that described data are when depositing described storage medium in, according to the described data feature values calculating of described data and the algorithm of described data feature values manipulative indexing.
22. a computer system, is characterized in that, comprising: processor, internal memory, storage medium, bus; Wherein,
Described processor comprises the described any one device of claim 8 to 10 and the described any one device of claim 11 to 14;
Described internal memory writes described storage medium for auxiliary described processor by data and from described storage medium reading out data;
The data that described storage medium need to read for storing data that described processor need to write and described processor;
Described bus is for connecting described processor, described internal memory and described storage medium.
CN201280003247.8A 2012-11-15 2012-11-15 A kind of methods, devices and systems of reading and writing data Active CN103403709B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2012/084684 WO2014075273A1 (en) 2012-11-15 2012-11-15 Data read/write method, device and system

Publications (2)

Publication Number Publication Date
CN103403709A true CN103403709A (en) 2013-11-20
CN103403709B CN103403709B (en) 2016-10-05

Family

ID=49565847

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201280003247.8A Active CN103403709B (en) 2012-11-15 2012-11-15 A kind of methods, devices and systems of reading and writing data

Country Status (2)

Country Link
CN (1) CN103403709B (en)
WO (1) WO2014075273A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104809237A (en) * 2015-05-12 2015-07-29 百度在线网络技术(北京)有限公司 LSM-tree (The Log-Structured Merge-Tree) index optimization method and LSM-tree index optimization system
CN106445416A (en) * 2016-09-22 2017-02-22 飞天诚信科技股份有限公司 Data record storage, query and retrieval method and device
CN107315543A (en) * 2017-07-03 2017-11-03 合肥联宝信息技术有限公司 The reading/writing method and device of data in a kind of memory to EC
CN108614668A (en) * 2016-12-12 2018-10-02 北京忆恒创源科技有限公司 Data access method based on KV models and solid storage device
CN108614669A (en) * 2016-12-12 2018-10-02 北京忆恒创源科技有限公司 Solve the key-data access method and solid storage device of hash-collision
CN108614671A (en) * 2016-12-12 2018-10-02 北京忆恒创源科技有限公司 Key-data access method based on NameSpace and solid storage device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101221538A (en) * 2008-01-24 2008-07-16 杭州华三通信技术有限公司 System and method for implementing fast data search in caching
CN101686209A (en) * 2008-09-24 2010-03-31 阿里巴巴集团控股有限公司 Method and device for storing message in message retransmission system
CN102567434A (en) * 2010-12-31 2012-07-11 百度在线网络技术(北京)有限公司 Data block processing method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101639833A (en) * 2008-08-01 2010-02-03 财团法人资讯工业策进会 Intermediary device, intermediary method, computer program product and data storage system
CN101546342B (en) * 2009-05-08 2012-07-04 阿里巴巴集团控股有限公司 Method and system for implementing search service
US8924663B2 (en) * 2010-09-09 2014-12-30 Nec Corporation Storage system, computer-readable medium, and data management method having a duplicate storage elimination function

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101221538A (en) * 2008-01-24 2008-07-16 杭州华三通信技术有限公司 System and method for implementing fast data search in caching
CN101686209A (en) * 2008-09-24 2010-03-31 阿里巴巴集团控股有限公司 Method and device for storing message in message retransmission system
CN102567434A (en) * 2010-12-31 2012-07-11 百度在线网络技术(北京)有限公司 Data block processing method

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104809237A (en) * 2015-05-12 2015-07-29 百度在线网络技术(北京)有限公司 LSM-tree (The Log-Structured Merge-Tree) index optimization method and LSM-tree index optimization system
CN104809237B (en) * 2015-05-12 2018-12-14 百度在线网络技术(北京)有限公司 The optimization method and device of LSM-tree index
CN106445416A (en) * 2016-09-22 2017-02-22 飞天诚信科技股份有限公司 Data record storage, query and retrieval method and device
CN106445416B (en) * 2016-09-22 2019-08-09 飞天诚信科技股份有限公司 A kind of method and device of the storage of data record, inquiry and retrieval
CN108614668A (en) * 2016-12-12 2018-10-02 北京忆恒创源科技有限公司 Data access method based on KV models and solid storage device
CN108614669A (en) * 2016-12-12 2018-10-02 北京忆恒创源科技有限公司 Solve the key-data access method and solid storage device of hash-collision
CN108614671A (en) * 2016-12-12 2018-10-02 北京忆恒创源科技有限公司 Key-data access method based on NameSpace and solid storage device
CN108614669B (en) * 2016-12-12 2023-02-17 北京忆恒创源科技股份有限公司 Key-data access method for solving hash collision and solid-state storage device
CN108614671B (en) * 2016-12-12 2023-02-28 北京忆恒创源科技股份有限公司 Key-data access method based on namespace and solid-state storage device
CN107315543A (en) * 2017-07-03 2017-11-03 合肥联宝信息技术有限公司 The reading/writing method and device of data in a kind of memory to EC

Also Published As

Publication number Publication date
WO2014075273A1 (en) 2014-05-22
CN103403709B (en) 2016-10-05

Similar Documents

Publication Publication Date Title
CN101923568B (en) Method for increasing and canceling elements of Bloom filter and Bloom filter
CN103403709A (en) Method, device and system for data reading and writing
CN102707990B (en) Container based processing method and device
CN102663090B (en) Method and device for inquiry metadata
CN106886370B (en) data safe deletion method and system based on SSD (solid State disk) deduplication technology
CN103902623A (en) Method and system for accessing files on a storage system
CN104461390A (en) Method and device for writing data into imbricate magnetic recording SMR hard disk
US10468061B1 (en) Indexing zones for storage devices
CN102521330A (en) Mirror distributed storage method under desktop virtual environment
CN103019887A (en) Data backup method and device
CN104077380A (en) Method and device for deleting duplicated data and system
CN109976669B (en) Edge storage method, device and storage medium
US10169168B2 (en) Metadata recovery for de-duplicated data
CN100437504C (en) Hard disc data backup system and method
EP3336702B1 (en) Metadata recovery method and device
CN112052121B (en) Hard disk data recovery method and system
CN110187834B (en) Data processing method and device for duplicate copies and electronic equipment
CN102609531A (en) Method for pegging files according to keywords
CN105589733A (en) Data processing method and device
WO2015116141A1 (en) Identifying memory regions that contain remapped memory locations
CN106909514B (en) Method and device for positioning snapshot disk address
CN116450656B (en) Data processing method, device, equipment and storage medium
CN105260130B (en) A kind of reading/writing method of Seagate hard-disk system file
CN109325005A (en) A kind of data processing method and electronic equipment
CN111399774B (en) Data processing method and device based on snapshot under distributed storage system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant