CN103186617A - Data storage method and device - Google Patents
Data storage method and device Download PDFInfo
- Publication number
- CN103186617A CN103186617A CN201110457404XA CN201110457404A CN103186617A CN 103186617 A CN103186617 A CN 103186617A CN 201110457404X A CN201110457404X A CN 201110457404XA CN 201110457404 A CN201110457404 A CN 201110457404A CN 103186617 A CN103186617 A CN 103186617A
- Authority
- CN
- China
- Prior art keywords
- data
- list item
- data cell
- index
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data storage method and device. The method comprises the steps as follows: 1, dividing a file in a disc into a plurality of sub-files, wherein each sub-file comprises one or more data units; 2, building a mapping relation between a memory and each sub-file; and 3, building an index table for the file, and enabling table items in the index table to correspond to the data units in a one-to-one way, wherein indexes recorded by data in the data units corresponding to the table items are stored in the table items. The method can solve the problem of lower processing efficiency as only the 2G file can be supported to the maximum extent and only the serial sequential processing operation can be performed when a large amount of concurrent requests come.
Description
Technical field
The present invention relates to computer realm, particularly a kind of data storing method and device.
Background technology
Along with the development of internet, applications service, common data source is Database Systems and file system.Mainstream operation system in the prior art, Windows for example, Unix, Solaris has supported MMF (Memory Mapped File, Memory Mapping File and its) mechanism, has improved the efficient of file read-write.In MMF mechanism, as data source, open up an internal memory with a certain specific file, be mapped to this document, when needs read and write data operation, directly this piece internal memory to be operated, the MMF mechanism of last operation system writes file with the data variation in the internal memory.By the zone of a memory address space of Memory Mapping File and its reservation, simultaneously physical storage is submitted to this zone.When using MMF mechanism to handle the file that is stored on the disk, needn't carry out the I/O operation to file, processing speed is faster.
But there is following defective in this MMF mechanism, for 32 operating system, and the maximum file that only can support 2G, in the file read-write operation, can pin the position mark (position) of file, only can serial order handle when having a large amount of concurrent requests to arrive, efficient is lower.
Summary of the invention
A kind of data storing method provided by the invention and device solving the maximum file that only can support 2G, and only can serial order be handled when having a large amount of concurrent requests to arrive, and make the problem that treatment effeciency is lower.
The invention discloses a kind of data storing method, described method comprises:
Step 1 is divided into a plurality of son files by configuration with file in the disk, and son file comprises one or more data cells;
Step 2, the mapping of setting up internal memory and son file;
Step 3, for described file is set up concordance list that the list item in the concordance list is corresponding one by one with data cell, the index of data recording in the data cell of this list item correspondence of storage in the described list item.
Wherein, also comprise after the described step 3:
Step 21 when writing data, is searched the sky list item from concordance list, deposit the index of data to be written in described empty list item;
Step 22 writes data in the internal memory of data cell mapping of described empty list item correspondence;
Step 23, with the data sync that writes in the internal memory in described data cell.
Wherein, also comprise after the described step 3:
Step 31 when revising data, finds the index of data to be revised from concordance list;
Step 32, the data in EMS memory of the data cell mapping of the list item correspondence of the described index of modification storage;
Step 33 is synchronized to described data cell with the data modification in the internal memory.
Wherein, also comprise after the described step 3:
Step 41 when the deletion data, finds the index for the treatment of delete data record from concordance list;
Step 42 is deleted described index from concordance list.
Wherein, described that list item in the concordance list is corresponding one by one with data cell, in the described list item in the data cell of this list item correspondence of storage the index of data recording further comprise:
Step 51, the data cell place son file of determining list item correspondence serial number and the serial number of described data cell in the son file location label of forming described data cell hereof;
Step 52 by Hash table storage index and location label, is major key with the index of list item storage, is value with the location label of the data cell of list item correspondence, forms key-value pair.
Wherein, also comprise after the described step 3:
Step 61 when revising data, is major key with the index of waiting to revise data;
Step 62 obtains the value of the key-value pair of described major key correspondence, according to described value specified data unit, revises the data in EMS memory of data cell mapping;
Step 63 is synchronized to described data cell with the data modification in the internal memory.
Wherein, also comprise after the described step 21:
Step 71 for described empty list item, is determined data cell place son file serial number and the serial number of described data cell in son file hereof of list item correspondence, forms the location label of described data cell;
Step 72 is major key with the index of list item storage, is value with the location label of the data cell of list item correspondence, stores the key-value pair that described major key and described value are formed by Hash table.
Wherein, the quantity of data cell is the element number of configuration in the described son file;
Describedly further comprise the list item in the concordance list and data cell are corresponding one by one:
Step 81, the list item in the concordance list is corresponding with the data cell order;
The data cell place son file of described definite list item correspondence serial number and the serial number of described data cell in son file hereof further comprises:
Step 82 is divided by serial number and the described element number of list item in concordance list, and the gained merchant is described data cell place son file serial number hereof, and the gained remainder is the serial number of described data cell in son file;
Serial number, son file hereof serial number and data cell the serial number in son file of described list item in concordance list is initial with 0 all.
The invention also discloses a kind of device of storing data, described device comprises:
Son file is divided module, is used for by configuration file of disk being divided into a plurality of son files, and son file comprises one or more data cells;
Module is set up in mapping, is used for the mapping of setting up internal memory and son file;
Module set up in index, is used to described file to set up concordance list, and the list item in the concordance list is corresponding one by one with data cell, the index of data recording in the data cell of this list item correspondence of storage in the described list item.
Wherein, described device also comprises:
The data writing module, be used for when writing data, from concordance list, searching the sky list item, deposit the index of data to be written in described empty list item, data are write in the internal memory of data cell mapping of described empty list item correspondence, with the data sync that writes in the internal memory in described data cell;
And/or,
The data modification module is used for finding the index of data to be revised from concordance list when revising data, revises the data in EMS memory of the data cell mapping of the list item correspondence of storing described index, and the data modification in the internal memory is synchronized to described data cell;
And/or,
The data removing module is used for finding the index for the treatment of delete data record from concordance list when the deletion data, and described index is deleted from concordance list.
The beneficial effect of the embodiment of the invention is: by file being divided into a plurality of son files, use the index table stores data directory, with the storage unit correspondence of concordance list list item with the storage data, can make file not be subjected to the limitation of 2G size, and the parallel processing of realization multifile, improve treatment effeciency; By using the corresponding relation of Hash table record list item and storage unit, in the time of can improving data manipulation, carry out the speed of data search according to index, further improve treatment effeciency.
Description of drawings
Fig. 1 is the process flow diagram of a kind of data storing method of the present invention;
Fig. 2 is the synoptic diagram of concordance list among a kind of data storing method embodiment of the present invention;
Fig. 3 is a kind of structural drawing of storing the device of data of the present invention.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, embodiment of the present invention is described further in detail below in conjunction with accompanying drawing.
Referring to Fig. 1, be the process flow diagram of a kind of data storing method of the present invention.
Step S100 is divided into a plurality of son files by configuration with file in the disk, and son file comprises one or more data cells.
File is data source in the disk.Each data cell is used for data recording of storage.
Step S200, the mapping of setting up internal memory and son file for this document.
Step S300 sets up concordance list, and the list item in the concordance list is corresponding one by one with data cell, the index of data recording in the data cell of this list item correspondence of storage in the described list item.
Can be in several ways that the list item in the concordance list is corresponding one by one with data cell.For example, the location label of the data cell of list item sequence number and correspondence in the use charting concordance list.The location label of data cell is made up of data cell place son file serial number and the serial number of data cell in son file hereof.
Adopt technique scheme, improved the extendability of file storage, only support to be to the maximum the file of 2G in the prior art, because this programme is divided into file the son file of a plurality of 2G of being not more than, a plurality of son files are adopted same index, obtain the position of data cell in the different son files by index, can in son file, read data, the maximum storage of support can by configuration set for hardware device any number in can the support scope.
Each file has a tick lables (position) in the prior art in read-write, has pointed to the current operated position of file, for fear of data corruption, all should indicate and pin a period of time in any read-write operation, finishes up to operation.Because only open a file in the prior art, same lock can be fought for and wait for to read-write operation all each time, and efficient is lower.Adopt said method, because file is divided into a plurality of son files, can handle each son file simultaneously, realize parallel processing, with prior art a file processing is compared, raise the efficiency multiple and be the quantity of the son file of division.
In a preferred implementation, use the corresponding relation of Hash table storage concordance list list item and data cell.
Described that list item in the concordance list is corresponding one by one with data cell, in the described list item in the data cell of this list item correspondence of storage the index of data recording further comprise:
Step S310 determines place, list item corresponding data unit son file serial number and the serial number of data cell in son file hereof, forms the location label of described data cell.
Step S320 by Hash table storage index and location label, is major key (key) with the index of list item storage, is value (value) with the location label of the data cell of list item correspondence, the composition key-value pair.
For example, value is a long numeral, and long occupies 8 bytes, the son file serial number hereof at preceding four byte representation data cell places, back four byte representation data cells serial number in son file.In Fig. 2, data cell 0 in the son file 1, and the location label of this data cell is 00010000.
The quantity of data cell is the element number of configuration in the described son file; Describedly comprise that further the list item in the concordance list is corresponding with the data cell order with the list item in the concordance list and data cell are corresponding one by one.
The data cell place son file of described definite list item correspondence serial number and the serial number of described data cell in son file hereof specifically can comprise: serial number and the described element number of list item in concordance list is divided by, the gained merchant is described data cell place son file serial number hereof, and the gained remainder is the serial number of described data cell in son file; Serial number, son file hereof serial number and data cell the serial number in son file of described list item in concordance list is initial with 0 all.
And, when the application program of application data source restarts, the traversal concordance list, serial number and the described element number of list item in concordance list is divided by, the gained merchant is the data cell place son file serial number hereof of list item correspondence, and the gained remainder is the serial number of data cell in son file of list item correspondence.Described serial number is initial with 0 all.With data cell place son file serial number and the serial number of described data cell in the son file location label of forming described data cell hereof.By Hash table storage index and location label, be major key with the index of list item storage, be value with the location label of the data cell of list item correspondence, form key-value pair.
Adopt this method, with the Hash of the serial number of major key and son file, and the Hash of the serial number of major key and data cell, merge into a Hash table, reduced the resource that expends and the efficient of operation index.
After the application program of application data source restarts, travel through whole concordance list, because the position of the list item of storage major key is corresponding with the position of data cell in the son file in the concordance list, determine the value in the key-value pair in the Hash table according to the position of the list item of storage major key in the index.
Further, when revising data, use the index of data, obtain the location label of the data cell of these data of storage according to Hash table.
Step S410 when revising data, is major key with the index of waiting to revise data;
Step S420 obtains the value of the key-value pair of described major key correspondence, according to described value specified data unit, revises the data in EMS memory of data cell mapping;
Step S430 is synchronized to described data cell with the data modification in the internal memory.
Adopt the hash index mode, search convenient.Restarting, in the time of need being reloaded into index in the internal memory, need not to travel through whole data source file, only need read the index of each data recording after, with the key-value pair of the location label composition Hash table of index and data recording place data cell.
In a preferred implementation, when writing data, data are write in the data cell of concordance list hollow list item correspondence.
Step S510 when writing data, searches the sky list item from concordance list, deposit the index of data to be written in described empty list item.
Empty list item represents that the data cell of this list item correspondence is also for empty.
Step S520 writes data in the internal memory of data cell mapping of described empty list item correspondence.
Step S530, with the data sync that writes in the internal memory in described data cell.
When adopting Hash table storage index and data unit data label, when writing data, set up key-value pair.
Also comprise behind the described step S510:
For described empty list item, determine data cell place son file serial number and the serial number of described data cell in son file hereof of described empty list item correspondence, form the location label of described data cell.
Wherein, the quantity of data cell is the element number of configuration in the described son file; Describedly comprise that further the list item in the concordance list is corresponding with the data cell order with the list item in the concordance list and data cell are corresponding one by one.
Data cell place son file serial number and the serial number of described data cell in son file hereof of described definite described empty list item correspondence further comprises: serial number and the described element number of described empty list item in concordance list is divided by, the gained merchant is described data cell place son file serial number hereof, and the gained remainder is the serial number of described data cell in son file.Described serial number is initial with 0 all.
Index with list item storage is major key, is value with the location label of the data cell of list item correspondence, stores the key-value pair that described major key and described value are formed by Hash table.
In a preferred implementation, when revising data, utilize concordance list to determine data place data cell to be revised.
Step S610 when revising data, finds the index of data to be revised from concordance list.
Step S620, the data in EMS memory of the data cell mapping of the list item correspondence of the described index of modification storage.
Step S630 is synchronized to described data cell with the data modification in the internal memory.
In a preferred implementation, when the deletion data, utilize concordance list deletion data.
Step 710 when the deletion data, finds the index for the treatment of delete data record from concordance list.
Step 720 is deleted described index from concordance list.
Like this, when writing data next time, judge that this list item for empty, then writes data the data cell of waiting to delete the data place, thereby reach the identical effect of deletion data in the file that coexists by deletion index in concordance list.
Referring to Fig. 2, be the synoptic diagram of concordance list among a kind of data storing method embodiment of the present invention.
At first, create configuration file.
Comprise a plurality of configuration informations in the configuration file, the son file quantity that file is divided is expressed as m; Each son file size that takes up room is expressed as Y; The data cell size that takes up room is expressed as Z; And information such as file directory, filename.
Can revise for the configuration of storing by the change configuration file.
Secondly, before the application program launching of application data source, when storing as data source with file, according to configuration, file in the disk is divided into a plurality of son files, each son file takes up room less than 2G.Each son file comprises one or more data cells.
The 3rd, the mapping of setting up internal memory and son file.
The 4th, for file is set up concordance list that the list item in the concordance list is corresponding one by one with data cell, the index of data recording in the data cell of this list item correspondence of storage in the described list item.
Data cell place son file serial number hereof and the location label of the serial number composition data cell of data cell in son file.As shown in Figure 2, the corresponding son file of each data cell, son file serial number hereof are 0 to m-1, the quantity of the son file that m divides for the file of configuration, and each son file comprises n data unit, and data cell serial number in son file is 0 to n-1.
For example, in the configuration, the son file quantity of opening is m, and son file takes up room size for Y, and the data cell size that takes up room is Z, and then file total size that takes up room is Y * m, and the data recording number that file can be stored is m * Y/Z.Wherein, Y/Z is the data cell quantity n that each son file comprises.A data recording in each data cell respective file.Each bar data is recorded in has its index in the concordance list.Each list item size that takes up room is 8 bytes in the concordance list, and then the concordance list size that takes up room is 8 * m * n byte, as shown in Figure 2.
Index is with the location label of the data cell of list item correspondence in the employing Hash table storage item.Being key (major key) with index in the list item, is value (value) with the location label of the data cell of list item correspondence, forms key-value pair.Press hash algorithm regulation, according to key in accordance with regulations algorithm draw the address, in described address, store value.Value is a long numeral, occupies 8 bytes, and preceding four bytes represent son file serial number hereof, back four byte representative data unit serial numbers in son file.
When writing data, from concordance list, search the sky list item, deposit the index of data to be written in described empty list item; Data are write in the internal memory of data cell mapping of described empty list item correspondence; With the data sync that writes in the internal memory in described data cell.
And divided by n, this serial number is since 0 with the serial number of list item, and the gained merchant is son file serial number hereof, and the gained remainder is data cell serial number in son file, forms the location label of described data cell.Index is with the location label of the data cell of list item correspondence in the employing Hash table storage item.
When revising data, from concordance list, find the index of data to be revised; Be key with this index, obtain value, from value, split out the serial number of son file and the serial number of data cell.By son file serial number and data cell serial number specified data unit.Revise the data in EMS memory of this data cell mapping, in internal memory, the data modification in the internal memory is synchronized to this data cell.
When the deletion data, from concordance list, find the index for the treatment of delete data record; This index is deleted from concordance list.
When writing data, search concordance list, determine that this list item is empty list item, then data are write in the data cell of this list item correspondence, thereby reach the identical effect of deletion data in the file that coexists by deletion index in concordance list.
Referring to Fig. 3, store the structural drawing of the device of data for the present invention is a kind of.
Son file is divided module 100, is used for by configuration file of disk being divided into a plurality of son files, and son file comprises one or more data cells.
Further, described device also comprises:
The data writing module, be used for when writing data, from concordance list, searching the sky list item, deposit the index of data to be written in described empty list item, data are write in the internal memory of data cell mapping of described empty list item correspondence, with the data sync that writes in the internal memory in described data cell.
Wherein, the data cell place son file that described data writing module also be used for to be determined described empty list item correspondence hereof serial number and described data cell at the serial number of son file, form the location label of described data cell; Index with list item storage is major key, is value with the location label of the data cell of list item correspondence, stores the key-value pair that described major key and described value are formed by Hash table.
Wherein, the quantity of data cell is the element number of configuration in the described son file;
Described index set up module with the list item in the concordance list and data cell one by one to specifically being used at once: the list item of concordance list is corresponding with the data cell order;
Described data writing module the data cell place son file of determining described empty list item correspondence hereof serial number and specifically can be used for during the serial number of described data cell in son file: described empty list item is divided by in serial number and the described element number of concordance list, the gained merchant is described data cell place son file serial number hereof, and the gained remainder is the serial number of described data cell in son file.Serial number, son file hereof serial number and data cell the serial number in son file of described list item in concordance list is initial with 0 all.
Further, described device can also comprise:
The data modification module is used for finding the index of data to be revised from concordance list when revising data, revises the data in EMS memory of the data cell mapping of the list item correspondence of storing described index, and the data modification in the internal memory is synchronized to described data cell.
The data removing module is used for finding the index for the treatment of delete data record from concordance list when the deletion data, and described index is deleted from concordance list.
Further, index is set up module in that the list item in the concordance list is corresponding one by one with data cell, specifically can be used for during the index of data recording in the data cell of this list item correspondence of storage in the described list item: the data cell place son file of determining the list item correspondence hereof serial number and described data cell at the serial number of son file, form the location label of described data cell; By Hash table storage index and location label, be major key with the index of list item storage, be value with the location label of the data cell of list item correspondence, form key-value pair.
Wherein, described index set up module the data cell place son file of determining described list item correspondence hereof serial number and specifically can be used for during the serial number of described data cell in son file: described list item is divided by in serial number and the described element number of concordance list, the gained merchant is described data cell place son file serial number hereof, and the gained remainder is the serial number of described data cell in son file.Serial number, son file hereof serial number and data cell the serial number in son file of described list item in concordance list is initial with 0 all.
Wherein, the data modification module is further used for when revising data, be major key with the index of waiting to revise data, obtain the value of the key-value pair of described major key correspondence, according to described value specified data unit, revise the data in EMS memory of data cell mapping, the data modification in the internal memory is synchronized to described data cell.
The above is preferred embodiment of the present invention only, is not for limiting protection scope of the present invention.All any modifications of doing within the spirit and principles in the present invention, be equal to replacement, improvement etc., all be included in protection scope of the present invention.
Claims (10)
1. a data storing method is characterized in that, described method comprises:
Step 1 is divided into a plurality of son files by configuration with file in the disk, and son file comprises one or more data cells;
Step 2, the mapping of setting up internal memory and son file;
Step 3, for described file is set up concordance list that the list item in the concordance list is corresponding one by one with data cell, the index of data recording in the data cell of this list item correspondence of storage in the described list item.
2. data storing method according to claim 1 is characterized in that,
Also comprise after the described step 3:
Step 21 when writing data, is searched the sky list item from concordance list, deposit the index of data to be written in described empty list item;
Step 22 writes data in the internal memory of data cell mapping of described empty list item correspondence;
Step 23, with the data sync that writes in the internal memory in described data cell.
3. data storing method according to claim 1 is characterized in that,
Also comprise after the described step 3:
Step 31 when revising data, finds the index of data to be revised from concordance list;
Step 32, the data in EMS memory of the data cell mapping of the list item correspondence of the described index of modification storage;
Step 33 is synchronized to described data cell with the data modification in the internal memory.
4. data storing method according to claim 1 is characterized in that,
Also comprise after the described step 3:
Step 41 when the deletion data, finds the index for the treatment of delete data record from concordance list;
Step 42 is deleted described index from concordance list.
5. data storing method according to claim 1 is characterized in that,
Described that list item in the concordance list is corresponding one by one with data cell, in the described list item in the data cell of this list item correspondence of storage the index of data recording comprise:
Step 51 is determined data cell place son file serial number and the serial number of described data cell in son file hereof of list item correspondence, forms the location label of described data cell;
Step 52 by Hash table storage index and location label, is major key with the index of list item storage, is value with the location label of the data cell of list item correspondence, forms key-value pair.
6. data storing method according to claim 5 is characterized in that,
Also comprise after the described step 3:
Step 61 when revising data, is major key with the index of waiting to revise data;
Step 62 obtains the value of the key-value pair of described major key correspondence, according to described value specified data unit, revises the data in EMS memory of data cell mapping;
Step 63 is synchronized to described data cell with the data modification in the internal memory.
7. data storing method according to claim 2 is characterized in that,
Also comprise after the described step 21:
Step 71 for described empty list item, is determined data cell place son file serial number and the serial number of described data cell in son file hereof of list item correspondence, forms the location label of described data cell;
Step 72 is major key with the index of list item storage, is value with the location label of the data cell of list item correspondence, stores the key-value pair that described major key and described value are formed by Hash table.
8. according to claim 5 or 7 described data storing method, it is characterized in that,
The quantity of data cell is the element number of configuration in the described son file;
Describedly further comprise the list item in the concordance list and data cell are corresponding one by one:
Step 81, the list item in the concordance list is corresponding with the data cell order;
The data cell place son file of described definite list item correspondence serial number and the serial number of described data cell in son file hereof comprises:
Step 82 is divided by serial number and the described element number of list item in concordance list, and the gained merchant is described data cell place son file serial number hereof, and the gained remainder is the serial number of described data cell in son file;
Serial number, son file hereof serial number and data cell the serial number in son file of described list item in concordance list is initial with 0 all.
9. a device of storing data is characterized in that, described device comprises:
Son file is divided module, is used for by configuration file of disk being divided into a plurality of son files, and son file comprises one or more data cells;
Module is set up in mapping, is used for the mapping of setting up internal memory and son file;
Module set up in index, is used to described file to set up concordance list, and the list item in the concordance list is corresponding one by one with data cell, the index of data recording in the data cell of this list item correspondence of storage in the described list item.
10. the device of storage data according to claim 9 is characterized in that,
Described device also comprises:
The data writing module, be used for when writing data, from concordance list, searching the sky list item, deposit the index of data to be written in described empty list item, data are write in the internal memory of data cell mapping of described empty list item correspondence, with the data sync that writes in the internal memory in described data cell;
And/or,
The data modification module is used for finding the index of data to be revised from concordance list when revising data, revises the data in EMS memory of the data cell mapping of the list item correspondence of storing described index, and the data modification in the internal memory is synchronized to described data cell;
And/or,
The data removing module is used for finding the index for the treatment of delete data record from concordance list when the deletion data, and described index is deleted from concordance list.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110457404.XA CN103186617B (en) | 2011-12-30 | 2011-12-30 | A kind of method and apparatus storing data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110457404.XA CN103186617B (en) | 2011-12-30 | 2011-12-30 | A kind of method and apparatus storing data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103186617A true CN103186617A (en) | 2013-07-03 |
| CN103186617B CN103186617B (en) | 2016-04-06 |
Family
ID=48677786
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110457404.XA Active CN103186617B (en) | 2011-12-30 | 2011-12-30 | A kind of method and apparatus storing data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103186617B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104346347A (en) * | 2013-07-25 | 2015-02-11 | 深圳市腾讯计算机系统有限公司 | Data storage method, device, server and system |
| CN104881441A (en) * | 2015-05-12 | 2015-09-02 | 福建天晴数码有限公司 | File receiving and storing method based on local area network, checking method and system |
| CN105302912A (en) * | 2015-11-11 | 2016-02-03 | 中国联合网络通信集团有限公司 | Data storage method and device |
| CN105812291A (en) * | 2016-03-07 | 2016-07-27 | 北京左江科技有限公司 | Dynamic buffer management method |
| CN106020718A (en) * | 2016-05-09 | 2016-10-12 | 福建联迪商用设备有限公司 | A method and a system for improving virtual disk write-in performance |
| CN106936917A (en) * | 2017-03-24 | 2017-07-07 | 联想(北京)有限公司 | A kind of cloud storage method and device, electronic equipment |
| CN111326216A (en) * | 2020-02-27 | 2020-06-23 | 中国科学院计算技术研究所 | Rapid partitioning method for big data gene sequencing file |
| CN115878612A (en) * | 2022-11-17 | 2023-03-31 | 石家庄纵宇科技有限公司 | Database structure and retrieval method thereof |
| CN116910160A (en) * | 2023-09-13 | 2023-10-20 | 天津普智芯网络测控技术有限公司 | Pattern file quick issuing method for aging test integrated machine |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0632364B1 (en) * | 1993-06-30 | 2002-03-06 | Microsoft Corporation | Efficient storage of object in a file system |
| EP1739575A2 (en) * | 2005-07-01 | 2007-01-03 | QNX Software Systems GmbH & Co. KG | File system having inverted hierarchical structure |
| CN101551807A (en) * | 2009-05-07 | 2009-10-07 | 山东中创软件商用中间件股份有限公司 | Multilevel index technology for file database |
| CN102207964A (en) * | 2011-05-31 | 2011-10-05 | 广州从兴电子开发有限公司 | Real-time massive data index construction method and system |
-
2011
- 2011-12-30 CN CN201110457404.XA patent/CN103186617B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0632364B1 (en) * | 1993-06-30 | 2002-03-06 | Microsoft Corporation | Efficient storage of object in a file system |
| EP1739575A2 (en) * | 2005-07-01 | 2007-01-03 | QNX Software Systems GmbH & Co. KG | File system having inverted hierarchical structure |
| CN101551807A (en) * | 2009-05-07 | 2009-10-07 | 山东中创软件商用中间件股份有限公司 | Multilevel index technology for file database |
| CN102207964A (en) * | 2011-05-31 | 2011-10-05 | 广州从兴电子开发有限公司 | Real-time massive data index construction method and system |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104346347A (en) * | 2013-07-25 | 2015-02-11 | 深圳市腾讯计算机系统有限公司 | Data storage method, device, server and system |
| CN104881441A (en) * | 2015-05-12 | 2015-09-02 | 福建天晴数码有限公司 | File receiving and storing method based on local area network, checking method and system |
| CN104881441B (en) * | 2015-05-12 | 2018-11-06 | 福建天晴数码有限公司 | File reception and storage method, inspection method based on LAN and system |
| CN105302912A (en) * | 2015-11-11 | 2016-02-03 | 中国联合网络通信集团有限公司 | Data storage method and device |
| CN105302912B (en) * | 2015-11-11 | 2018-06-29 | 中国联合网络通信集团有限公司 | A kind of date storage method and equipment |
| CN105812291A (en) * | 2016-03-07 | 2016-07-27 | 北京左江科技有限公司 | Dynamic buffer management method |
| WO2017193488A1 (en) * | 2016-05-09 | 2017-11-16 | 福建联迪商用设备有限公司 | Method and system for improving write performance of virtual disk |
| CN106020718A (en) * | 2016-05-09 | 2016-10-12 | 福建联迪商用设备有限公司 | A method and a system for improving virtual disk write-in performance |
| CN106936917A (en) * | 2017-03-24 | 2017-07-07 | 联想(北京)有限公司 | A kind of cloud storage method and device, electronic equipment |
| CN111326216A (en) * | 2020-02-27 | 2020-06-23 | 中国科学院计算技术研究所 | Rapid partitioning method for big data gene sequencing file |
| CN111326216B (en) * | 2020-02-27 | 2023-07-21 | 中国科学院计算技术研究所 | Rapid partitioning method for big data gene sequencing file |
| CN115878612A (en) * | 2022-11-17 | 2023-03-31 | 石家庄纵宇科技有限公司 | Database structure and retrieval method thereof |
| CN115878612B (en) * | 2022-11-17 | 2023-12-15 | 北京东方京融教育科技股份有限公司 | Database structure and retrieval method thereof |
| CN116910160A (en) * | 2023-09-13 | 2023-10-20 | 天津普智芯网络测控技术有限公司 | Pattern file quick issuing method for aging test integrated machine |
| CN116910160B (en) * | 2023-09-13 | 2023-11-14 | 天津普智芯网络测控技术有限公司 | Pattern file quick issuing method for aging test integrated machine |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103186617B (en) | 2016-04-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103186617A (en) | Data storage method and device | |
| CN102541757B (en) | Write cache method, cache synchronization method and device | |
| US10289315B2 (en) | Managing I/O operations of large data objects in a cache memory device by dividing into chunks | |
| CN104199815B (en) | The method and system of summary storage consumption is reduced in data deduplication system | |
| CN103164490B (en) | A kind of efficient storage implementation method of not fixed-length data and device | |
| JP6362316B2 (en) | Method, system and computer program product for hybrid table implementation using buffer pool as resident in-memory storage for memory resident data | |
| CN102779180B (en) | The operation processing method of data-storage system, data-storage system | |
| US9043334B2 (en) | Method and system for accessing files on a storage system | |
| EP2863310B1 (en) | Data processing method and apparatus, and shared storage device | |
| US8412881B2 (en) | Modified B+ tree to store NAND memory indirection maps | |
| US20160283538A1 (en) | Fast multi-tier indexing supporting dynamic update | |
| US10310904B2 (en) | Distributed technique for allocating long-lived jobs among worker processes | |
| CN109726177A (en) | A kind of mass file subregion indexing means based on HBase | |
| CN102890722A (en) | Indexing method applied to time sequence historical database | |
| CN103246700A (en) | Mass small file low latency storage method based on HBase | |
| CN104881481A (en) | Method and device for accessing mass time sequence data | |
| CN102169460A (en) | Method and device for managing variable length data | |
| CN102567427A (en) | Method and device for processing object data | |
| CN109726175A (en) | A kind of offline partition management method of mass file based on HBase | |
| CN103678603A (en) | Multi-source heterogeneous data efficient converging and storing frame system | |
| CN102567415B (en) | Control method and device of database | |
| CN101963977A (en) | A search method and mobile terminal without urban search | |
| US20180067974A1 (en) | Index b-tree maintenance for linear sequential insertion | |
| CN102411632B (en) | Chain table-based memory database page type storage method | |
| CN110109866A (en) | A kind of management method and equipment of file system directories |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder |
Address after: Room 810, 8 / F, 34 Haidian Street, Haidian District, Beijing 100080 Patentee after: BEIJING D-MEDIA COMMUNICATION TECHNOLOGY Co.,Ltd. Address before: 100089 Beijing city Haidian District wanquanzhuang Road No. 28 Wanliu new building 6 storey block A room 602 Patentee before: BEIJING D-MEDIA COMMUNICATION TECHNOLOGY Co.,Ltd. |
|
| CP02 | Change in the address of a patent holder |