CN103186617B - A kind of method and apparatus storing data - Google Patents
A kind of method and apparatus storing data Download PDFInfo
- Publication number
- CN103186617B CN103186617B CN201110457404.XA CN201110457404A CN103186617B CN 103186617 B CN103186617 B CN 103186617B CN 201110457404 A CN201110457404 A CN 201110457404A CN 103186617 B CN103186617 B CN 103186617B
- Authority
- CN
- China
- Prior art keywords
- data
- data cell
- list item
- index
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The present invention discloses a kind of method and apparatus storing data, and described method comprises: step 1, and be multiple son file by configuring a Divide File in disk, son file comprises one or more data cell; Step 2, sets up the mapping of internal memory and son file; Step 3 is described file set up concordance list, by the list item in concordance list and data cell one_to_one corresponding, stores the index of data record in data cell corresponding to this list item in described list item.The present invention can solve the maximum file only can supporting 2G, and only can serial order process when there being a large amount of concurrent request to arrive, and makes the problem that treatment effeciency is lower.
Description
Technical field
The present invention relates to computer realm, particularly a kind of method and apparatus storing data.
Background technology
Along with the development of internet, applications service, common data source is Database Systems and file system.Mainstream operation system in prior art, such as Windows, Unix, Solaris, support MMF (MemoryMappedFile, Memory Mapping File and its) mechanism, improve the efficiency of file read-write.In MMF mechanism, using a certain specific file as data source, open up one piece of internal memory, be mapped to this file, when needs read and write data operation, directly operate this block internal memory, the MMF mechanism of last operation system is by the data variation writing in files in internal memory.Retained the region of a memory address space by Memory Mapping File and its, physical storage is submitted to this region simultaneously.When using the process of MMF mechanism to be stored in the file on disk, need not perform I/O operation to file, processing speed is faster.
But there is following defect in this MMF mechanism, for the operating system of 32, the maximum file only can supporting 2G, when file read-write operations, the position mark (position) of file can be pinned, only can serial order process when there being a large amount of concurrent request to arrive, efficiency is lower.
Summary of the invention
A kind of method and apparatus storing data provided by the invention, to solve the maximum file only can supporting 2G, and only can serial order process when there being a large amount of concurrent request to arrive, make the problem that treatment effeciency is lower.
The invention discloses a kind of method storing data, described method comprises:
Step 1, be multiple son file by configuring a Divide File in disk, son file comprises one or more data cell;
Step 2, sets up the mapping of internal memory and son file;
Step 3 is described file set up concordance list, by the list item in concordance list and data cell one_to_one corresponding, stores the index of data record in data cell corresponding to this list item in described list item.
Wherein, also comprise after described step 3:
Step 21, when writing data, searches sky list item, by the index of data to be written stored in described empty list item from concordance list;
Data are write in the internal memory of data cell mapping corresponding to described empty list item by step 22;
Step 23, by the data syn-chronization that writes in internal memory in described data cell.
Wherein, also comprise after described step 3:
Step 31, when Update Table, finds the index of data to be modified from concordance list;
Step 32, amendment stores the data in EMS memory that data cell corresponding to the list item of described index maps;
Step 33, is synchronized to described data cell by the data modification in internal memory.
Wherein, also comprise after described step 3:
Step 41, when deleting data, finds the index of data record to be deleted from concordance list;
Step 42, deletes described index from concordance list.
Wherein, described by the list item in concordance list and data cell one_to_one corresponding, the index storing data record in data cell corresponding to this list item in described list item comprises further:
Step 51, determines that data cell place son file that list item is corresponding serial number hereof and the serial number of described data cell in son file form the location label of described data cell;
Step 52, stores index and location label by Hash table, the index stored with list item for major key, with the location label of data cell corresponding to list item for value, composition key-value pair.
Wherein, also comprise after described step 3:
Step 61, when Update Table, with the index of data to be modified for major key;
Step 62, obtains the value of key-value pair corresponding to described major key, determines data cell according to described value, the data in EMS memory of Update Table unit maps;
Step 63, is synchronized to described data cell by the data modification in internal memory.
Wherein, also comprise after described step 21:
Step 71, for described empty list item, determines data cell place son file that list item is corresponding serial number hereof and the serial number of described data cell in son file, forms the location label of described data cell;
Step 72, the index stored with list item, for major key, with the location label of data cell corresponding to list item for value, stores the key-value pair of described major key and described value composition by Hash table.
Wherein, in described son file, the quantity of data cell is the element number of configuration;
Described list item in concordance list and data cell one_to_one corresponding to be comprised further:
Step 81, the list item in concordance list is corresponding with data unit sequence;
Describedly determine that data cell place son file that list item is corresponding serial number hereof and the serial number of described data cell in son file comprise further:
Step 82, the serial number of list item in concordance list and described element number are divided by, gained business is described data cell place son file serial number hereof, and gained remainder is the serial number of described data cell in son file;
The serial number of described list item in concordance list, son file serial number hereof and the serial number of data cell in son file are all initial with 0.
The invention also discloses a kind of device storing data, described device comprises:
Son file divides module, and for being multiple son file by configuring a Divide File in disk, son file comprises one or more data cell;
Module is set up in mapping, for setting up the mapping of internal memory and son file;
Module set up in index, for being described file set up concordance list, by the list item in concordance list and data cell one_to_one corresponding, stores the index of data record in data cell corresponding to this list item in described list item.
Wherein, described device also comprises:
Data write. module, for when writing data, from concordance list, search sky list item, by the index of data to be written stored in described empty list item, data are write in the internal memory that data cell corresponding to described empty list item map, by the data syn-chronization that writes in internal memory in described data cell;
And/or,
Data modification module, for when Update Table, finds the index of data to be modified from concordance list, and amendment stores the data in EMS memory that data cell corresponding to the list item of described index maps, and the data modification in internal memory is synchronized to described data cell;
And/or,
Data removing module, for when deleting data, finding the index of data record to be deleted, being deleted by described index from concordance list from concordance list.
The beneficial effect of the embodiment of the present invention is: by being multiple son file by Divide File, concordance list is used to store data directory, concordance list list item is corresponding with the storage unit storing data, file can be made not by the limitation of 2G size, and realize the parallel processing of multifile, improve treatment effeciency; By using the corresponding relation of Hash table record list item and storage unit, when can improve data manipulation, carrying out the speed of data search according to index, improving treatment effeciency further.
Accompanying drawing explanation
Fig. 1 is a kind of process flow diagram storing the method for data of the present invention;
Fig. 2 is a kind of schematic diagram storing concordance list in the embodiment of the method for data of the present invention;
Fig. 3 is a kind of structural drawing storing the device of data of the present invention.
Embodiment
For making the object, technical solutions and advantages of the present invention clearly, below in conjunction with accompanying drawing, embodiment of the present invention is described further in detail.
See Fig. 1, store the process flow diagram of the method for data for the present invention is a kind of.
Step S100, be multiple son file by configuring a Divide File in disk, son file comprises one or more data cell.
Disk file is data source.Each data cell is for storing a data record.
Step S200 is the mapping of this file set up internal memory and son file.
Step S300, sets up concordance list, by the list item in concordance list and data cell one_to_one corresponding, stores the index of data record in data cell corresponding to this list item in described list item.
Can in several ways by the list item in concordance list and data cell one_to_one corresponding.Such as, the location label of list item sequence number and corresponding data cell in charting concordance list is used.The location label of data cell is made up of data cell place son file serial number hereof and the serial number of data cell in son file.
Adopt technique scheme, improve the extendability that file stores, the file being 2G to the maximum is only supported in prior art, because Divide File is multiple son files being not more than 2G by this programme, same index is adopted to multiple son file, obtained the position of data cell in different son file by index, can read data in son file, the maximum storage of support can be set to any number within the scope of the energy support of hardware device institute by configuration.
In prior art, each file is when read-write, there is a tick lables (position), pointed to file current by the position operated, when any read-write operation in order to avoid data corruption, all this mark is pinned a period of time, until operated.Because only open a file in prior art, same lock be fought for and be waited for read-write operation all can each time, and efficiency is lower.Adopt said method, due to file is divided into multiple son file, can processes each son file simultaneously, realize parallel processing, with prior art, a file processing be compared, raise the efficiency the quantity that multiple is the son file divided.
In one preferably embodiment, Hash table is used to store the corresponding relation of concordance list list item and data cell.
Described by the list item in concordance list and data cell one_to_one corresponding, the index storing data record in data cell corresponding to this list item in described list item comprises further:
Step S310, determines list item corresponding data unit place son file serial number hereof and the serial number of data cell in son file, forms the location label of described data cell.
Step S320, stores index and location label by Hash table, the index stored with list item for major key (key), with the location label of data cell corresponding to list item for value (value), composition key-value pair.
Such as, value is a long numeral, and long occupies 8 bytes, the son file serial number hereof at front four byte representation data cell places, rear four byte representation data cells serial number in son file.As in Fig. 2, data cell 0 in son file 1, the location label of this data cell is 00010000.
In described son file, the quantity of data cell is the element number of configuration; Described list item list item in concordance list and data cell one_to_one corresponding comprised further in concordance list is corresponding with data unit sequence.
Describedly determine that data cell place son file that list item is corresponding serial number hereof and the serial number of described data cell in son file specifically can comprise: the serial number of list item in concordance list and described element number are divided by, gained business is described data cell place son file serial number hereof, and gained remainder is the serial number of described data cell in son file; The serial number of described list item in concordance list, son file serial number hereof and the serial number of data cell in son file are all initial with 0.
And, when the application program of application data source restarts, traversal concordance list, the serial number of list item in concordance list and described element number are divided by, gained business is the data cell place son file serial number hereof that list item is corresponding, and gained remainder is the serial number of data cell in son file that list item is corresponding.Described serial number is all initial with 0.Data cell place son file serial number hereof and the serial number of described data cell in son file are formed the location label of described data cell.Store index and location label by Hash table, the index stored with list item for major key, with the location label of data cell corresponding to list item for value, composition key-value pair.
Adopt the method, by the Hash of the serial number of major key and son file, and the Hash of the serial number of major key and data cell, merge into a Hash table, decrease the resource expended and efficiency that operate index.
After the application program of application data source restarts, travel through whole concordance list, because the position storing the list item of major key in concordance list is corresponding with the position of data cell in son file, determine the value in Hash table in key-value pair according to the position of the list item storing major key in index.
Further, when Update Table, the index of usage data, obtains the location label of the data cell storing these data according to Hash table.
Step S410, when Update Table, with the index of data to be modified for major key;
Step S420, obtains the value of key-value pair corresponding to described major key, determines data cell according to described value, the data in EMS memory of Update Table unit maps;
Step S430, is synchronized to described data cell by the data modification in internal memory.
Adopt hash index mode, search convenient.Restarting, when needing index to be reloaded in internal memory, without the need to traveling through whole data source file, after only need reading the index of each data record, the location label of index and data record place data cell being formed the key-value pair of Hash table.
In one preferably embodiment, when writing data, data are write in data cell corresponding to concordance list hollow list item.
Step S510, when writing data, searches sky list item, by the index of data to be written stored in described empty list item from concordance list.
Empty list item represents that the data cell that this list item is corresponding is also sky.
Data are write in the internal memory of data cell mapping corresponding to described empty list item by step S520.
Step S530, by the data syn-chronization that writes in internal memory in described data cell.
When adopting Hash table to store index and data unit data label, while write data, set up key-value pair.
Also comprise after described step S510:
For described empty list item, determine data cell place son file that described empty list item is corresponding serial number hereof and the serial number of described data cell in son file, form the location label of described data cell.
Wherein, in described son file, the quantity of data cell is the element number of configuration; Described list item list item in concordance list and data cell one_to_one corresponding comprised further in concordance list is corresponding with data unit sequence.
Describedly determine that data cell place son file that described empty list item is corresponding serial number hereof and the serial number of described data cell in son file comprise further: the serial number of described empty list item in concordance list and described element number are divided by, gained business is described data cell place son file serial number hereof, and gained remainder is the serial number of described data cell in son file.Described serial number is all initial with 0.
The index stored with list item, for major key, with the location label of data cell corresponding to list item for value, stores the key-value pair of described major key and described value composition by Hash table.
In one preferably embodiment, when Update Table, concordance list is utilized to determine data place data cell to be modified.
Step S610, when Update Table, finds the index of data to be modified from concordance list.
Step S620, amendment stores the data in EMS memory that data cell corresponding to the list item of described index maps.
Step S630, is synchronized to described data cell by the data modification in internal memory.
In one preferably embodiment, when deleting data, concordance list is utilized to delete data.
Step 710, when deleting data, finds the index of data record to be deleted from concordance list.
Step 720, deletes described index from concordance list.
Like this, when writing data next time, judging that this list item is as empty, then write the data cell at data place to be deleted by data, thus reaching with deleting the identical effect of data hereof by deleting index in concordance list.
See Fig. 2, store the schematic diagram of concordance list in the embodiment of the method for data for the present invention is a kind of.
First, configuration file is created.
Comprise multiple configuration information in configuration file, the son file quantity of Divide File, is expressed as m; Each son file takes up room size, is expressed as Y; Data cell takes up room size, is expressed as Z; And the information such as file directory, filename.
Can by the amendment of change configuration file for the configuration stored.
Secondly, before the application program launching of application data source, when storing using file as data source, according to configuration, be multiple son file by a Divide File in disk, each son file takes up room and is less than 2G.Each son file comprises one or more data cell.
3rd, set up the mapping of internal memory and son file.
4th, be file set up concordance list, by the list item in concordance list and data cell one_to_one corresponding, in described list item, store the index of data record in data cell corresponding to this list item.
Data cell place son file serial number hereof and the location label of the serial number composition data cell of data cell in son file.As shown in Figure 2, the corresponding son file of each data cell, the quantity of son file serial number to be 0 to m-1, m the be son file of the Divide File of configuration hereof, each son file comprises n data cell, and data cell serial number in son file is 0 to n-1.
Such as, in configuration, the son file quantity opened is m, and the son file size that takes up room is Y, and the data cell size that takes up room is Z, then file total size that takes up room is Y × m, and the data record number that file can store is m × Y/Z.Wherein, Y/Z is the data cell quantity n that each son file comprises.A data record in each data cell respective file.Each data is recorded in concordance list has its index.In concordance list, each list item size that takes up room is 8 bytes, then the concordance list size that takes up room is 8 × m × n byte, as shown in Figure 2.
Adopt index in Hash table storage item with the location label of data cell corresponding to list item.With index in list item for key (major key), with the location label of data cell corresponding to list item for value (value), composition key-value pair.By hash algorithm regulation, draw address according to key by regulation algorithm, in described address, store value.Value is a long numeral, occupies 8 bytes, and front four bytes represent son file serial number hereof, rear four byte representative data unit serial number in son file.
When writing data, from concordance list, search sky list item, by the index of data to be written stored in described empty list item; Data are write in the internal memory of data cell mapping corresponding to described empty list item; By the data syn-chronization that writes in internal memory in described data cell.
Further, by the serial number of list item divided by n, this serial number is from 0, and gained business is son file serial number hereof, and gained remainder is data cell serial number in son file, forms the location label of described data cell.Adopt index in Hash table storage item with the location label of data cell corresponding to list item.
When Update Table, from concordance list, find the index of data to be modified; With this index for key, obtain value, from value, split out the serial number of son file and the serial number of data cell.By son file serial number and data unit sequence number determination data cell.Revise the data in EMS memory that this data cell maps, in internal memory, the data modification in internal memory is synchronized to this data cell.
When deleting data, from concordance list, find the index of data record to be deleted; This index is deleted from concordance list.
When the data is written, searching concordance list, determine that this list item is empty list item, then data are write in data cell corresponding to this list item, thus reaching with deleting the identical effect of data hereof by deleting index in concordance list.
See Fig. 3, store the structural drawing of the device of data for the present invention is a kind of.
Son file divides module 100, and for being multiple son file by configuring a Divide File in disk, son file comprises one or more data cell.
Module 200 is set up in mapping, for setting up the mapping of internal memory and son file.
Module 300 set up in index, for being described file set up concordance list, by the list item in concordance list and data cell one_to_one corresponding, stores the index of data record in data cell corresponding to this list item in described list item.
Further, described device also comprises:
Data write. module, for when writing data, from concordance list, search sky list item, by the index of data to be written stored in described empty list item, data are write in the internal memory that data cell corresponding to described empty list item map, by the data syn-chronization that writes in internal memory in described data cell.
Wherein, described Data write. module also for determining data cell place son file that described empty list item is corresponding serial number hereof and the serial number of described data cell in son file, forms the location label of described data cell; The index stored with list item, for major key, with the location label of data cell corresponding to list item for value, stores the key-value pair of described major key and described value composition by Hash table.
Wherein, in described son file, the quantity of data cell is the element number of configuration;
Described index is set up module and specifically be may be used for during data cell one_to_one corresponding by the list item in concordance list: by corresponding with data unit sequence for the list item in concordance list;
Described Data write. module specifically may be used for when determining serial number in son file of data cell place son file that described empty list item is corresponding serial number hereof and described data cell: the serial number of described empty list item in concordance list and described element number are divided by, gained business is described data cell place son file serial number hereof, and gained remainder is the serial number of described data cell in son file.The serial number of described list item in concordance list, son file serial number hereof and the serial number of data cell in son file are all initial with 0.
Further, described device can also comprise:
Data modification module, for when Update Table, finds the index of data to be modified from concordance list, and amendment stores the data in EMS memory that data cell corresponding to the list item of described index maps, and the data modification in internal memory is synchronized to described data cell.
Data removing module, for when deleting data, finding the index of data record to be deleted, being deleted by described index from concordance list from concordance list.
Further, index sets up module by the list item in concordance list and data cell one_to_one corresponding, specifically may be used for when storing the index of data record in data cell corresponding to this list item in described list item: determine data cell place son file that list item is corresponding serial number hereof and the serial number of described data cell in son file, form the location label of described data cell; Store index and location label by Hash table, the index stored with list item for major key, with the location label of data cell corresponding to list item for value, composition key-value pair.
Wherein, described index is set up module and specifically be may be used for when determining serial number in son file of data cell place son file that described list item is corresponding serial number hereof and described data cell: the serial number of described list item in concordance list and described element number are divided by, gained business is described data cell place son file serial number hereof, and gained remainder is the serial number of described data cell in son file.The serial number of described list item in concordance list, son file serial number hereof and the serial number of data cell in son file are all initial with 0.
Wherein, data modification module is further used for when Update Table, with the index of data to be modified for major key, obtain the value of key-value pair corresponding to described major key, data cell is determined according to described value, the data in EMS memory of Update Table unit maps, is synchronized to described data cell by the data modification in internal memory.
The foregoing is only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.All any amendments done within the spirit and principles in the present invention, equivalent replacement, improvement etc., be all included in protection scope of the present invention.
Claims (10)
1. store a method for data, it is characterized in that, described method comprises:
Step 1, be multiple son file by configuring a Divide File in disk, son file comprises one or more data cell; Each data cell is for storing a data record;
Step 2, sets up the mapping of internal memory and son file;
Step 3 is described file set up concordance list, by the list item in concordance list and data cell one_to_one corresponding, stores the index of data record in data cell corresponding to this list item in described list item.
2. the method for storage data according to claim 1, is characterized in that,
Also comprise after described step 3:
Step 21, when writing data, searches sky list item, by the index of data to be written stored in described empty list item from concordance list;
Data are write in the internal memory of data cell mapping corresponding to described empty list item by step 22;
Step 23, by the data syn-chronization that writes in internal memory in described data cell.
3. the method for storage data according to claim 1, is characterized in that,
Also comprise after described step 3:
Step 31, when Update Table, finds the index of data to be modified from concordance list;
Step 32, amendment stores the data in EMS memory that data cell corresponding to the list item of described index maps;
Step 33, is synchronized to described data cell by the data modification in internal memory.
4. the method for storage data according to claim 1, is characterized in that,
Also comprise after described step 3:
Step 41, when deleting data, finds the index of data record to be deleted from concordance list;
Step 42, deletes described index from concordance list.
5. the method for storage data according to claim 1, is characterized in that,
Described by the list item in concordance list and data cell one_to_one corresponding, the index storing data record in data cell corresponding to this list item in described list item comprises:
Step 51, determines data cell place son file that list item is corresponding serial number hereof and the serial number of described data cell in son file, forms the location label of described data cell;
Step 52, stores index and location label by Hash table, the index stored with list item for major key, with the location label of data cell corresponding to list item for value, composition key-value pair.
6. the method for storage data according to claim 5, is characterized in that,
Also comprise after described step 3:
Step 61, when Update Table, with the index of data to be modified for major key;
Step 62, obtains the value of key-value pair corresponding to described major key, determines data cell according to described value, the data in EMS memory of Update Table unit maps;
Step 63, is synchronized to described data cell by the data modification in internal memory.
7. the method for storage data according to claim 2, is characterized in that,
Also comprise after described step 21:
Step 71, for described empty list item, determines data cell place son file that list item is corresponding serial number hereof and the serial number of described data cell in son file, forms the location label of described data cell;
Step 72, the index stored with list item, for major key, with the location label of data cell corresponding to list item for value, stores the key-value pair of described major key and described value composition by Hash table.
8. the method for the storage data according to claim 5 or 7, is characterized in that,
In described son file, the quantity of data cell is the element number of configuration;
Described list item in concordance list and data cell one_to_one corresponding to be comprised further:
Step 81, the list item in concordance list is corresponding with data unit sequence;
Describedly determine that data cell place son file that list item is corresponding serial number hereof and the serial number of described data cell in son file comprise:
Step 82, the serial number of list item in concordance list and described element number are divided by, gained business is described data cell place son file serial number hereof, and gained remainder is the serial number of described data cell in son file;
The serial number of described list item in concordance list, son file serial number hereof and the serial number of data cell in son file are all initial with 0.
9. store a device for data, it is characterized in that, described device comprises:
Son file divides module, and for being multiple son file by configuring a Divide File in disk, son file comprises one or more data cell; Each data cell is for storing a data record;
Module is set up in mapping, for setting up the mapping of internal memory and son file;
Module set up in index, for being described file set up concordance list, by the list item in concordance list and data cell one_to_one corresponding, stores the index of data record in data cell corresponding to this list item in described list item.
10. the device of storage data according to claim 9, is characterized in that,
Described device also comprises:
Data write. module, for when writing data, from concordance list, search sky list item, by the index of data to be written stored in described empty list item, data are write in the internal memory that data cell corresponding to described empty list item map, by the data syn-chronization that writes in internal memory in described data cell;
And/or,
Data modification module, for when Update Table, finds the index of data to be modified from concordance list, and amendment stores the data in EMS memory that data cell corresponding to the list item of described index maps, and the data modification in internal memory is synchronized to described data cell;
And/or,
Data removing module, for when deleting data, finding the index of data record to be deleted, being deleted by described index from concordance list from concordance list.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110457404.XA CN103186617B (en) | 2011-12-30 | 2011-12-30 | A kind of method and apparatus storing data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110457404.XA CN103186617B (en) | 2011-12-30 | 2011-12-30 | A kind of method and apparatus storing data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103186617A CN103186617A (en) | 2013-07-03 |
| CN103186617B true CN103186617B (en) | 2016-04-06 |
Family
ID=48677786
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110457404.XA Active CN103186617B (en) | 2011-12-30 | 2011-12-30 | A kind of method and apparatus storing data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103186617B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104346347A (en) * | 2013-07-25 | 2015-02-11 | 深圳市腾讯计算机系统有限公司 | Data storage method, device, server and system |
| CN104881441B (en) * | 2015-05-12 | 2018-11-06 | 福建天晴数码有限公司 | File reception and storage method, inspection method based on LAN and system |
| CN105302912B (en) * | 2015-11-11 | 2018-06-29 | 中国联合网络通信集团有限公司 | A kind of date storage method and equipment |
| CN105812291A (en) * | 2016-03-07 | 2016-07-27 | 北京左江科技有限公司 | Dynamic buffer management method |
| CN106020718A (en) * | 2016-05-09 | 2016-10-12 | 福建联迪商用设备有限公司 | A method and a system for improving virtual disk write-in performance |
| CN106936917A (en) * | 2017-03-24 | 2017-07-07 | 联想(北京)有限公司 | A kind of cloud storage method and device, electronic equipment |
| CN111326216B (en) * | 2020-02-27 | 2023-07-21 | 中国科学院计算技术研究所 | Rapid partitioning method for big data gene sequencing file |
| CN115878612B (en) * | 2022-11-17 | 2023-12-15 | 北京东方京融教育科技股份有限公司 | Database structure and retrieval method thereof |
| CN116910160B (en) * | 2023-09-13 | 2023-11-14 | 天津普智芯网络测控技术有限公司 | Pattern file quick issuing method for aging test integrated machine |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0632364B1 (en) * | 1993-06-30 | 2002-03-06 | Microsoft Corporation | Efficient storage of object in a file system |
| EP1739575A2 (en) * | 2005-07-01 | 2007-01-03 | QNX Software Systems GmbH & Co. KG | File system having inverted hierarchical structure |
| CN101551807A (en) * | 2009-05-07 | 2009-10-07 | 山东中创软件商用中间件股份有限公司 | Multilevel index technology for file database |
| CN102207964A (en) * | 2011-05-31 | 2011-10-05 | 广州从兴电子开发有限公司 | Real-time massive data index construction method and system |
-
2011
- 2011-12-30 CN CN201110457404.XA patent/CN103186617B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0632364B1 (en) * | 1993-06-30 | 2002-03-06 | Microsoft Corporation | Efficient storage of object in a file system |
| EP1739575A2 (en) * | 2005-07-01 | 2007-01-03 | QNX Software Systems GmbH & Co. KG | File system having inverted hierarchical structure |
| CN101551807A (en) * | 2009-05-07 | 2009-10-07 | 山东中创软件商用中间件股份有限公司 | Multilevel index technology for file database |
| CN102207964A (en) * | 2011-05-31 | 2011-10-05 | 广州从兴电子开发有限公司 | Real-time massive data index construction method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103186617A (en) | 2013-07-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103186617B (en) | A kind of method and apparatus storing data | |
| CN103765393B (en) | Storage system | |
| US8412881B2 (en) | Modified B+ tree to store NAND memory indirection maps | |
| US10248356B2 (en) | Using scratch extents to facilitate copying operations in an append-only storage system | |
| CN102541968B (en) | Indexing method | |
| CN104246764B (en) | The method and apparatus for placing record in non-homogeneous access memory using non-homogeneous hash function | |
| JP5996088B2 (en) | Cryptographic hash database | |
| CN102541757B (en) | Write cache method, cache synchronization method and device | |
| CN103164490B (en) | A kind of efficient storage implementation method of not fixed-length data and device | |
| CN102567434B (en) | Data block processing method | |
| CN102682015B (en) | High-definition media-oriented embedded file storage structure and method | |
| US9569515B2 (en) | Facilitating distributed deletes in a replicated storage system | |
| CN102779180A (en) | Operation processing method of data storage system and data storage system | |
| CN106682110B (en) | Image file storage and management system and method based on Hash grid index | |
| US10310904B2 (en) | Distributed technique for allocating long-lived jobs among worker processes | |
| US10409692B1 (en) | Garbage collection: timestamp entries and remove reference counts | |
| CN102567415B (en) | Control method and device of database | |
| US11169968B2 (en) | Region-integrated data deduplication implementing a multi-lifetime duplicate finder | |
| CN102169460A (en) | Method and device for managing variable length data | |
| US20160139980A1 (en) | Erasure-coding extents in an append-only storage system | |
| CN104166627B (en) | A kind of SCM Based NAND FLASH write operation methods | |
| CN103942301A (en) | Distributed file system oriented to access and application of multiple data types | |
| CN110427347A (en) | Method, apparatus, memory node and the storage medium of data de-duplication | |
| CN102650972A (en) | Data storage method, device and system | |
| CN113253926A (en) | Memory internal index construction method for improving query and memory performance of novel memory |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: Room 810, 8 / F, 34 Haidian Street, Haidian District, Beijing 100080 Patentee after: BEIJING D-MEDIA COMMUNICATION TECHNOLOGY Co.,Ltd. Address before: 100089 Beijing city Haidian District wanquanzhuang Road No. 28 Wanliu new building 6 storey block A room 602 Patentee before: BEIJING D-MEDIA COMMUNICATION TECHNOLOGY Co.,Ltd. |