CN102096679A - Method and device for merging and writing index segments in disk - Google Patents

Method and device for merging and writing index segments in disk Download PDF

Info

Publication number
CN102096679A
CN102096679A CN 200910242490 CN200910242490A CN102096679A CN 102096679 A CN102096679 A CN 102096679A CN 200910242490 CN200910242490 CN 200910242490 CN 200910242490 A CN200910242490 A CN 200910242490A CN 102096679 A CN102096679 A CN 102096679A
Authority
CN
China
Prior art keywords
index
file
index file
segment
size
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 200910242490
Other languages
Chinese (zh)
Inventor
徐剑波
李晓蕊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Peking University Founder Group Co Ltd
Beijing Founder Apabi Technology Co Ltd
Original Assignee
Peking University Founder Group Co Ltd
Beijing Founder Apabi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Peking University Founder Group Co Ltd, Beijing Founder Apabi Technology Co Ltd filed Critical Peking University Founder Group Co Ltd
Priority to CN 200910242490 priority Critical patent/CN102096679A/en
Publication of CN102096679A publication Critical patent/CN102096679A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a method and device for merging and writing index segments in a disk, wherein the method comprises the steps of: determining the size of a total storage space required by second index files according to the size of each first index file with same types in each index segment; creating each second index file in the merged new index segment in the disk, preserving a storage space with same size as the total storage space for each created second index file; and merging all first index files with same types in the index segments to be merged and writing the merged first index files into corresponding second index files. Because the size of the total storage space required by the merged first index files with same types in the index segments is determined in advance, data of the merged second index files are written in the preserved storage space more completely in a merging and writing process, and the problem of file fragmentation generated in the process of merging and writing the index segments in the disk is effectively avoided.

Description

A kind of index segment merges and writes the method and the device of disk
Technical field
The present invention relates to information retrieval field, relate in particular to method and device that a kind of index segment merges and write disk.
Background technology
The index process of search engine is carried out in internal memory, the way of existing index technology is that each document of handling through search engine is independently generated an index segment, when the index segment in the internal memory reaches certain quantity, these index segments need be merged into new index segment and write in the disk and preserve.
Each index segment is made up of a plurality of index files, and therefore, the merging of index segment is actually the merging of each index file in the index segment.Be merged into new index segment and write in the process of disk at each index segment, need open each index file in each index segment that needs to merge simultaneously, the index file of the same file type in each index segment is merged and progressively write in the disk.
The process that polytype index file that each index segment comprised all merges simultaneously and writes, merging process with Fig. 1 stage casing 1 and section 2 is an example, comprise the index file of * .tis type and the index file of * .fdt type respectively in section of hypothesis 1 and the section 2, * .tis in * .tis file in the section 1 and the section 2 is merged into the new.tis file, * .fdt in * .fdt file in the section 1 and the section 2 is merged into the new.fdt file, new.tis file after will merging and new.fdt file write in the process of disk, operating system can be respectively new.tis file and the certain storage space of new.fdt file allocation, in the new index segment after the merging as shown in fig. 1 101 and 102, because the index file after each merges is simultaneously and progressively writes disk, the storage space 101 of system assignment is full if the new.tis file after merging has not been write, so, can only in the storage space 103 after the storage space 102 that is the new.fdt file allocation, continue to write the remainder of new.tis file; The storage space 102 that has distributed if the new.fdt file after merging has not been write is full, so can only be in the storage space after the storage space 103 104, continue to write the remainder of new.fdt file, up to new.tis file and new.fdt file are write in the disk fully.Because the space size that operating system is distributed is certain, and generally can be much smaller than the size of the index file after merging, therefore, above-mentioned merging and the process that writes can produce a large amount of file fragmentations in disk.
Actual test shows, to the index file after the merging that is 1G of a size, its file fragmentation quantity can reach up to ten thousand.The index file fragment too much not only can cause system's tracking back and forth ceaselessly when reading file, thereby causes that retrieval performance descends, and also can cause reading index file failure retrieval when serious and make mistakes.
Traditional index file way to manage puts chips of the magnetic disc in order with needing not timing.Defragmentation is exactly a process of the discontinuous file of depositing being write again the hard disk contiguous sector, and its effect can improve data access efficiency, but to put chips of the magnetic disc in order be a job of wasting time and energy, to infringement is also arranged in serviceable life of hard disk.
Summary of the invention
Method and device that the embodiment of the invention provides a kind of index segment to merge and write disk are in order to solve the process that has the index segment merging now and write disk produces a large amount of index file fragments in disk problem.
A kind of index segment that the embodiment of the invention provides merges and writes the method for disk, comprising:
According to the respectively file size of first index file of same type in each index segment, determine total storage size that second index file is required;
In disk, create each second index file in the new index segment, and be respectively the storage space that each second index file reservation equals described total storage size;
Each first index file of same type in each index segment to be combined is merged and be written in the second corresponding index file.
According to the respectively file size of first index file of same type in each index segment, determine total storage size that second index file is required, comprising:
Open each first index file of same type in described each index segment, obtain the file size of each first index file of opening;
Calculate the summation of the file size of each first index file of same type in described each index segment;
Each first index file of determining same type in each index segment merges the described summation that the size of the required total storage space of second index file that the back generates equals to calculate.
Be that second index file reserves the storage space that equals total storage size, comprise:
The reference position of second index file created is added the above summation, as the end position of the storage space that reserves for described second index file;
The file pointer that moves described second index file is provided with the EOF of second index file to described end position at described end position.
Each first index file of same type in each index segment merged and be written in the second corresponding index file, comprising:
Move the reference position of the file pointer of described second index file to described second index file;
From described reference position, the data after each first index file merging of same type in each index segment progressively are written in the described storage space that reserves, constantly move the end of the file pointer of described second index file to the data that write;
When described first index file merge and write finish after, reset the EOF of second index file in the position at the file pointer place of second index file.
The embodiment of the invention also provides a kind of index segment to merge and write the device of disk, comprising:
Determining unit is used for the file size according to each first index file of each index segment same type, determines total storage size that second index file is required;
Creating unit is used for creating each second index file in the new index segment at disk, and is respectively each second index file and reserves the storage space that equals described total storage size;
Merge writing unit, each first index file of same type in each index segment to be combined is merged and be written in the second corresponding index file.
Further, described determining unit comprises:
Obtain subelement, be used for opening each first index file of described each index segment same type, obtain the file size of each first index file of opening;
Computation subunit is calculated the summation of file size of each first index file of same type in described each index segment;
Determine subelement, each first index file of determining same type in each index segment merges the described summation that the size of the required total storage space of second index file that the back generates equals to calculate.
Further, described creating unit, the reference position that also is used for second index file that will create adds the above summation, as the end position of the storage space that reserves for described second index file;
The file pointer that moves described second index file is provided with the EOF of second index file to the end position of determining at described end position.
Described merging writing unit also is used for moving the reference position of the file pointer of described second index file to described second index file; From described reference position, the data after each first index file merging of same type in each index segment progressively are written in the described storage space that reserves, constantly move the end of the file pointer of described second index file to the data that write; When described first index file merge and write finish after, reset the EOF of second index file in the position at the file pointer place of second index file.
The beneficial effect of the embodiment of the invention comprises:
A kind of index segment that the embodiment of the invention provides merges and writes the method and the device of disk, according to the respectively file size of first index file of same type in each index segment, determines total storage size that second index file is required; In disk, create each second index file that merges in the new index segment in back, and be that each second index file of creating reserves the storage space that equals total storage size; First index file of all same types in each index segment to be combined is merged and be written in the second corresponding index file.Merge the required total storage size in back owing to pre-determine out first index file of same type in each index segment, in the process that merges and write, the data of second index file after merging more intactly can be write in the storage space of reservation, avoided index segment to merge effectively and write the problem that produces file fragmentation in the process of disk.
Description of drawings
Fig. 1 is the merging synoptic diagram of index segment in the prior art;
The index segment that Fig. 2 provides for the embodiment of the invention merges and writes the process flow diagram of the method for disk;
All same type first index files merge the process flow diagram of the required total storage space in back in each index segment definite to be combined that Fig. 3 provides for the embodiment of the invention;
The synoptic diagram of the reserved storage space of " new.tis " index file that Fig. 4 provides for the embodiment of the invention;
The finish synoptic diagram of storage space of back " new.tis " index file of merging that Fig. 5 provides for the embodiment of the invention and ablation process;
The index segment that Fig. 6 provides for the embodiment of the invention merges and writes the structural representation of the device of disk;
The index segment that Fig. 7 provides for the embodiment of the invention merges and writes the structural representation of determining unit in the device of disk.
Embodiment
Below in conjunction with accompanying drawing, a kind of index segment provided by the invention is merged and write the disk method and device is described in detail with specific embodiment.
As shown in Figure 2, a kind of index segment that the embodiment of the invention provides merges and writes the disk method, comprises the steps:
S201, according to the file size of each first index file of same type in each index segment, determine total storage size that second index file is required;
S202, in disk, create each second index file in the new index segment, and reserve the storage space that equals total storage size for each second index file of creating;
S203, each first index file of same type in each index segment to be combined is merged and be written in the second corresponding index file.
Because the merging of each index segment to be combined comes down to the merging of the index file of same type in each index segment, for the convenience that illustrates, in embodiments of the present invention, index file in each index segment before merging is called first index file, the index file in the new index segment of merging back generation (each first index file by same type in each index segment merges generation) is called second index file.
In the process that index segment merges; usually can adopt existing residual quantity memory technology; therefore, first index file of same type merges the size of second index file of back generation in each index segment, and is littler than each first index file sum before merging usually.
In order to guarantee to be that second index file is reserved enough storage spaces, make the data total amount of second index file that writes after the merging can not overflow the storage space of reservation and produce file fragmentation, preferably, in embodiments of the present invention, with the file size sum of all index files of same type in each index segment as merging the space size that back second index file is reserved, certainly, the space size of this reservation also can be chosen other empirical values.
Below above steps is further detailed.
Among the above-mentioned steps S201, determine that all same type first index files merge the required total storage space in back in each index segment to be combined, as shown in Figure 3, specifically comprise:
S301, open each first index file of same type in each index segment to be combined, obtain the file size of each first index file of opening;
S302, calculate the summation of the file size of each first index file of same type in each index segment to be combined;
S303, each first index file of determining same type in each index segment merge the summation that the size of the required total storage space of second index file that the back generates equals to calculate.
In above-mentioned steps S202, for each second index file of creating reserves the storage space that equals total storage size, specifically realize: after second index file of establishment by following manner, the reference position of second index file is added the summation that calculates among the step S101, as the end position that is the storage space that reserves of second index file, the file pointer that moves second index file is to this end position, and the EOF of second index file is set at this end position.
In above-mentioned steps S203, before the process that merges and write begins, need to move the reference position of the file pointer of second index file to second index file, from reference position, each first index file of same type in each index segment is merged, simultaneously, data after merging progressively are written in the storage space of reservation, in the process that writes, constantly move the file pointer of second index file to the end that writes data, the file pointer that is to say second index file is followed data and the reach gradually that writes, and the data after merging all write in the storage space of reservation.When first index file merge and write finish after, reset the EOF of second index file in the position at the file pointer place of second index file, reclaim the unnecessary disk space of reserving.
Explanation below cites an actual example.
In this example, suppose all to comprise in each index segment to be combined the index file of " * .tis " type, certainly each index segment also can comprise the index file of other types, easy for what illustrate, only illustrate that index segment merges and ablation process in, the merging of the index file of " * .tis " type and write the process of disk in each index segment.The merging process of the other types index file in each index segment to be combined is identical therewith, does not repeat them here.
Suppose that index segment to be combined is N, the merging of this N index segment and to write the detailed process of disk as follows:
(1), open first index file of " * .tis " type in each N to be combined index segment, calculate the length sum of the index file of N " * .tis " type opening;
The length sum that calculates is represented with TisLength.
Second index file " new.tis " of " * .tis " type in the new index segment after (2), establishment merges in disk, the reference position of " new.tis " index file of creating is added the TisLength that calculates, as the end position that is the storage space of " new.tis " index file reservation, the file pointer that moves " new.tis " index file is to this end position, and at this end position EOF is set.
As shown in Figure 4, bar shaped box indicating is the storage space that " new.tis " index file is reserved.The reference position of supposing " new.tis " index file is 0, is that the end position of the storage space of " new.tis " index file reservation drops on the TisLength place so.The file pointer that moves " new.tis " index file is to the TisLength place, and EOF is set herein.
Set up after the EOF, the file pointer of " new.tis " index file is got back to reference position, waits writing of data after to be combined.
(3), first index file that merges all " * .tis " types in this N index segment, when merging, be written in the storage space of reserving into " new.tis " index file merging the data that generate, writing fashionablely, constantly moving the end of the file pointer of " new.tis " index file to the data that write.
Along with the increase of the data total amount that writes, the file pointer of " new.tis " index file also can not had no progeny and be moved data until N " * .tis " index file and all merge and write.
Be the synoptic diagram that has been filled the storage space of second index file that merges the back data as shown in Figure 5, the size of the data after N " * .tis " index file merges equals Total Length (TotalLength<TisLength), as can be seen from Figure 5, owing to adopted the residual quantity memory technology, in the storage space of keeping for second index file, also have the remaining storage space of part not take.
(4), when N " * .tis " index file merge and write finish after, reset EOF in the position at the file pointer place of " new.tis " index file.
N " * .tis " index file merge and write finish after, the file pointer of " new.tis " index file can be in this position of Total Length, as shown in Figure 5, EOF also can be reset in this position of Total Length, and the additional part of the disk space of Yu Liuing can reclaim and re-use so.
Also as can be seen, index files such as " new.tis " index file in the new index segment after the merging, " new.dft " no longer include file fragmentation from Fig. 5.
The data of actual test show, according to existing way, index file that size is 500Mb in the new index segment after the merging, nearly 20000 of the file fragmentation that in disk, produces, the size of average each fragment is 256KB, and the above-mentioned index segment that adopts the embodiment of the invention to provide merges and write the disk method, can not produce file fragmentation, therefore, read the efficient of file in the time of can improving on the one hand retrieval, can avoid on the other hand carrying out that the disk arrangement brought wastes time and energy and easily damage the problem in disk life-span.
Based on same inventive concept, also provide a kind of index segment to merge and write the device of disk in the embodiment of the invention, because this device merges and writes the method realization of disk based on the aforementioned index section, the principle of being dealt with problems merges similar with the principle of work of the method that writes disk to aforementioned a kind of index segment, therefore the concrete enforcement of this device can repeat part and not give unnecessary details referring to the enforcement of method.
A kind of index segment that the embodiment of the invention provides merges and writes the device of disk, as shown in Figure 6, comprising:
Determining unit 601 is used for determining that each first index file of each index segment same type to be combined merges the required total storage space of second index file that the back generates;
Creating unit 602 is used for creating each second index file in the new index segment at disk, and each second index file that is respectively establishment reserves the storage space of the total storage size that equals to determine;
Merge writing unit 603, each first index file of same type in each index segment to be combined is merged and be written in the second corresponding index file.
Index segment that the embodiment of the invention provides merges and writes in the device of disk order unit 601 really, as shown in Figure 7, comprising:
Obtain subelement 6011, be used for opening each first index file of each index segment same type, obtain the file size of each first index file of opening;
Computation subunit 6012 is calculated the summation of file size of each first index file of same type in each index segment;
Determine subelement 6013, each first index file of determining same type in each index segment merges the summation that the size of the required total storage space of second index file that the back generates equals to calculate.
Index segment that the embodiment of the invention provides merges and writes creating unit 502 in the device of disk, and the reference position that also is used for second index file that will create adds the summation that calculates, as the end position that is the storage space that reserves of second index file; The file pointer that moves second index file is provided with the EOF of second index file to the end position of determining at end position.
Index segment that the embodiment of the invention provides merges and writes merging writing unit 503 in the device of disk, also is used for moving the reference position of file pointer to the second index file of second index file; From reference position, the data after all same type first index files merge in each index segment progressively are written in the storage space that reserves, constantly move the end of the file pointer of second index file to the data that write; When first index file merge and write finish after, reset the EOF of second index file in the position at the file pointer place of second index file.
A kind of index segment that the embodiment of the invention provides merges and writes the method and the device of disk, determines that first index file of all same types in each index segment to be combined merges the required total storage space in back; In disk, create each second index file that merges in the new index segment in back, and be that each second index file of creating reserves the storage space that equals total storage size; First index file of all same types in each index segment to be combined is merged and be written in the second corresponding index file.Merge the required total storage size in back owing to pre-determine out first index file of same type in each index segment, in the process that merges and write, the data of second index file after merging more intactly can be write in the storage space of reservation, can avoid producing the problem of file fragmentation so effectively.
In addition, in the embodiment of the invention, first index file of same type merges and is written as after second index file in each index segment, if the size of data that merges and write is less than being the storage space that second index file is reserved, then at the end position of the data that merge and write, reset the EOF of second index file, reclaim those a part of disk spaces of reserving more, improved the utilization factor of disk storage resource.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, if of the present invention these are revised and modification belongs within the scope of claim of the present invention and equivalent technologies thereof, then the present invention also is intended to comprise these changes and modification interior.

Claims (8)

1. an index segment merges and writes the method for disk, it is characterized in that, comprising:
According to the respectively file size of first index file of same type in each index segment, determine total storage size that second index file is required;
In disk, create each second index file in the new index segment, and be respectively the storage space that each second index file reservation equals described total storage size;
Each first index file of same type in each index segment to be combined is merged and be written in the second corresponding index file.
2. the method for claim 1 is characterized in that, according to the respectively file size of first index file of same type in each index segment, determines total storage size that second index file is required, comprising:
Open each first index file of same type in described each index segment, obtain the file size of each first index file of opening;
Calculate the summation of the file size of each first index file of same type in described each index segment;
Each first index file of determining same type in each index segment merges the described summation that the size of the required total storage space of second index file that the back generates equals to calculate.
3. method as claimed in claim 2 is characterized in that, is that second index file reserves the storage space that equals total storage size, comprising:
The reference position of second index file created is added the above summation, as the end position of the storage space that reserves for described second index file;
The file pointer that moves described second index file is provided with the EOF of second index file to described end position at described end position.
4. method as claimed in claim 3 is characterized in that, each first index file of same type in each index segment is merged and is written in the second corresponding index file, comprising:
Move the reference position of the file pointer of described second index file to described second index file;
From described reference position, the data after each first index file merging of same type in each index segment progressively are written in the described storage space that reserves, constantly move the end of the file pointer of described second index file to the data that write;
When described first index file merge and write finish after, reset the EOF of second index file in the position at the file pointer place of second index file.
5. an index segment merges and writes the device of disk, it is characterized in that, comprising:
Determining unit is used for the file size according to each first index file of each index segment same type, determines total storage size that second index file is required;
Creating unit is used for creating each second index file in the new index segment at disk, and is respectively each second index file and reserves the storage space that equals described total storage size;
Merge writing unit, each first index file of same type in each index segment to be combined is merged and be written in the second corresponding index file.
6. the device shown in claim 5 is characterized in that, described determining unit comprises:
Obtain subelement, be used for opening each first index file of described each index segment same type, obtain the file size of each first index file of opening;
Computation subunit is calculated the summation of file size of each first index file of same type in described each index segment;
Determine subelement, each first index file of determining same type in each index segment merges the described summation that the size of the required total storage space of second index file that the back generates equals to calculate.
7. the device shown in claim 6 is characterized in that, described creating unit, and the reference position that also is used for second index file that will create adds the above summation, as the end position of the storage space that reserves for described second index file;
The file pointer that moves described second index file is provided with the EOF of second index file to the end position of determining at described end position.
8. the device shown in claim 7 is characterized in that, described merging writing unit also is used for moving the reference position of the file pointer of described second index file to described second index file; From described reference position, the data after each first index file merging of same type in each index segment progressively are written in the described storage space that reserves, constantly move the end of the file pointer of described second index file to the data that write; When described first index file merge and write finish after, reset the EOF of second index file in the position at the file pointer place of second index file.
CN 200910242490 2009-12-15 2009-12-15 Method and device for merging and writing index segments in disk Pending CN102096679A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200910242490 CN102096679A (en) 2009-12-15 2009-12-15 Method and device for merging and writing index segments in disk

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200910242490 CN102096679A (en) 2009-12-15 2009-12-15 Method and device for merging and writing index segments in disk

Publications (1)

Publication Number Publication Date
CN102096679A true CN102096679A (en) 2011-06-15

Family

ID=44129775

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200910242490 Pending CN102096679A (en) 2009-12-15 2009-12-15 Method and device for merging and writing index segments in disk

Country Status (1)

Country Link
CN (1) CN102096679A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102693325A (en) * 2012-06-12 2012-09-26 腾讯科技(深圳)有限公司 File storing method and device
CN102087646B (en) * 2009-12-07 2013-03-20 北大方正集团有限公司 Method and device for establishing index
CN103207907A (en) * 2013-03-28 2013-07-17 新浪网技术(中国)有限公司 Method and device for combining index files
CN103488685A (en) * 2013-09-02 2014-01-01 上海网达软件股份有限公司 Fragmented-file storage method based on distributed storage system
CN104246764A (en) * 2012-02-24 2014-12-24 森普利维蒂公司 Method and apparatus utilizing non-uniform hash functions for placing records in non-uniform access memory
WO2015024416A1 (en) * 2013-08-21 2015-02-26 华为技术有限公司 Indexing mechanism merging method, search method, apparatus and equipment
CN108776578A (en) * 2018-06-01 2018-11-09 南京紫光云信息科技有限公司 A kind of method and system of quick combining objects
CN108920687A (en) * 2018-07-12 2018-11-30 重庆邮电大学 A kind of merging optimization method based on Lucene index segment

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102087646B (en) * 2009-12-07 2013-03-20 北大方正集团有限公司 Method and device for establishing index
CN104246764A (en) * 2012-02-24 2014-12-24 森普利维蒂公司 Method and apparatus utilizing non-uniform hash functions for placing records in non-uniform access memory
CN104246764B (en) * 2012-02-24 2017-09-15 慧与发展有限责任合伙企业 The method and apparatus for placing record in non-homogeneous access memory using non-homogeneous hash function
US10013419B2 (en) 2012-06-12 2018-07-03 Tencent Technology (Shenzhen) Company Limited File storage method and apparatus, and storage medium
CN102693325A (en) * 2012-06-12 2012-09-26 腾讯科技(深圳)有限公司 File storing method and device
CN102693325B (en) * 2012-06-12 2014-06-11 腾讯科技(深圳)有限公司 File storing method and device
CN103207907B (en) * 2013-03-28 2016-06-29 新浪网技术(中国)有限公司 A kind of index file merges method and device
CN103207907A (en) * 2013-03-28 2013-07-17 新浪网技术(中国)有限公司 Method and device for combining index files
CN104424204B (en) * 2013-08-21 2017-08-11 华为技术有限公司 Indexing Mechanism merging method, searching method, device and equipment
CN104424204A (en) * 2013-08-21 2015-03-18 华为技术有限公司 Index mechanism combining method and searching method, unit and device
WO2015024416A1 (en) * 2013-08-21 2015-02-26 华为技术有限公司 Indexing mechanism merging method, search method, apparatus and equipment
CN103488685B (en) * 2013-09-02 2017-02-01 上海网达软件股份有限公司 Fragmented-file storage method based on distributed storage system
CN103488685A (en) * 2013-09-02 2014-01-01 上海网达软件股份有限公司 Fragmented-file storage method based on distributed storage system
CN108776578A (en) * 2018-06-01 2018-11-09 南京紫光云信息科技有限公司 A kind of method and system of quick combining objects
CN108776578B (en) * 2018-06-01 2021-10-26 紫光西部数据(南京)有限公司 Method and system for rapidly merging objects
CN108920687A (en) * 2018-07-12 2018-11-30 重庆邮电大学 A kind of merging optimization method based on Lucene index segment
CN108920687B (en) * 2018-07-12 2021-08-31 重庆邮电大学 Lucene index segment-based merging optimization method

Similar Documents

Publication Publication Date Title
CN102096679A (en) Method and device for merging and writing index segments in disk
US8996791B2 (en) Flash memory device, memory control device, memory control method, and storage system
CN103577338B (en) A kind of method reclaiming junk data and storage device
KR101086857B1 (en) Control Method of Solid State Storage System for Data Merging
US8650379B2 (en) Data processing method for nonvolatile memory system
CN101727295B (en) Method for writing in and reading out data based on virtual block flash memory address mapping
US20080195833A1 (en) Systems, methods and computer program products for operating a data processing system in which a file system's unit of memory allocation is coordinated with a storage system's read/write operation unit
US20120110239A1 (en) Causing Related Data to be Written Together to Non-Volatile, Solid State Memory
CN102768645B (en) The solid state hard disc forecasting method of hybrid cache and solid-state hard disk SSD
US20120159050A1 (en) Memory system and data transfer method
CN111007991B (en) Method for separating read-write requests based on NVDIMM and computer thereof
CN101645043B (en) Methods for reading and writing data and memory device
TWI434175B (en) Method for performing block management, and associated memory device and controller thereof
EP2665065A2 (en) Electronic device employing flash memory
CN110968253B (en) Data storage method, device and system
US20080120456A1 (en) Method for flash memory data management
CN101833510B (en) Address translation method for flash storage FTL
CN104424103A (en) Management method for cache in solid state storage device
CN103135945A (en) Multi-channel dynamic read-write dispatching method used in solid state drive (SSD)
CN103514249A (en) Method and system for automatic data reduction and storage device
CN102306124A (en) Method for implementing hardware driver layer of Nand Flash chip
CN101324899B (en) Method for rapidly writing NAND type FLASH
KR101077901B1 (en) Apparatus and method for managing flash memory using log block level mapping algorithm
US20160117251A1 (en) Managing method for cache memory of solid state drive
CN102122267A (en) Multi-channel NANDflash controller capable of simultaneously carrying out data transmission and FTL (Flash Transition Layer) management

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20110615