CN107958079A - Aggregate file delet method, system, device and readable storage medium storing program for executing - Google Patents

Aggregate file delet method, system, device and readable storage medium storing program for executing Download PDF

Info

Publication number
CN107958079A
CN107958079A CN201711340624.8A CN201711340624A CN107958079A CN 107958079 A CN107958079 A CN 107958079A CN 201711340624 A CN201711340624 A CN 201711340624A CN 107958079 A CN107958079 A CN 107958079A
Authority
CN
China
Prior art keywords
file
file destination
object head
aggregate
destination
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711340624.8A
Other languages
Chinese (zh)
Inventor
张书扬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhengzhou Yunhai Information Technology Co Ltd
Original Assignee
Zhengzhou Yunhai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhengzhou Yunhai Information Technology Co Ltd filed Critical Zhengzhou Yunhai Information Technology Co Ltd
Priority to CN201711340624.8A priority Critical patent/CN107958079A/en
Publication of CN107958079A publication Critical patent/CN107958079A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/16File or folder operations, e.g. details of user interfaces specifically adapted to file systems
    • G06F16/162Delete operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • G06F16/148File search processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems

Abstract

This application discloses a kind of distributed memory system aggregate file delet method, system, device and computer-readable recording medium, including:Using file deletion requests, the metadata information of delete target file, and file destination is labeled as having deleted;Object head corresponding with file destination is found from OSD, the call number of file destination in object head and bitmap are marked as state, obtains new object head, and new object head is write into user terminal, so that user terminal utilizes new object head delete target file.The application no longer directly deletes the file destination in user terminal, but by deleting metadata information corresponding with file destination and modification object head corresponding with file destination in meta data server, so that when user terminal backstage carries out file clean-up, based on object head delete target file corresponding with file destination, so as to reduce interacting for meta data server and user terminal, shorten I/O path, improve user experience, accelerate to delete speed.

Description

Aggregate file delet method, system, device and readable storage medium storing program for executing
Technical field
The present invention relates to distributed memory system field, more particularly to a kind of distributed memory system aggregate file deletion side Method, system, device and computer-readable recording medium.
Background technology
In distributed memory system, small documents scene is one of core scenario needed to be considered of storage system, social Shopping website, broadcasting and TV, Internet video etc. produce the large amount of small documents scenes such as text, picture, music, and small documents performance issue is text One of part system key issue needed to be considered.Multiple small documents are aggregated in one big file, the read-write to small documents turns It is optimization method important in small documents scene to be changed into the read-write to aggregate file data.Polymerizable functional can reduce small documents magnetic Disk takes, and improves disk utilization, improves small documents read or write speed.
Using polymerizable functional, multiple small documents are polymerize with aggregate objects (object, OBJ) for unit, aggregate objects Data as aggregate file are deposited into disk.When small documents are deleted in polymerizable functional, if deleting file corresponding data, need First pass through small documents metadata information and find aggregate file belonging to it, then according to its offset in aggregate file, The corresponding aggregate objects of small documents are found out, if other small documents are not stored in the aggregate objects, can directly be deleted poly- Close object;But when storing other small documents data at the same time in aggregate objects, then it cannot delete, it is necessary to wait until the polymerization pair As data in aggregate objects are deleted and then deleted to middle All Files.In this way, it is required for judging that this is small when deleting small documents every time Whether file is last file in said polymeric object.Such a mode flow is cumbersome, and deletion small documents I/O path is tediously long, patrols Complexity is collected, deletion efficiency is low.
Therefore, it is short to research and develop a kind of I/O path, user experience is high, and the high distributed memory system aggregate file of deletion efficiency is deleted Except method is to be currently needed for solving the problems, such as.
The content of the invention
In view of this, it is an object of the invention to provide a kind of distributed memory system aggregate file delet method, system, Device and computer-readable recording medium, make I/O path short, and user experience is high, improve and delete speed.Its concrete scheme is as follows:
A kind of distributed memory system aggregate file delet method, including:
Using file deletion requests, the metadata information of delete target file, and the file destination is labeled as having deleted Remove;
Object head corresponding with the file destination is found from OSD, by the index of file destination in the object head Number and bitmap mark as state, new object head is obtained, and the new object head is write into user terminal, so that the use Family terminal utilizes the new object head delete target file.
Optionally, after the metadata information of the delete target file, further include:
Send and delete successful information to the user terminal.
Optionally, it is described to utilize file deletion requests, the metadata information of delete target file, and by the file destination Labeled as deleted process, including:
Judge the file destination whether be Aggregate attribute file;
If it is, judging whether the call number of the file destination is stored in polymerization caching;
If it is not, then using the file deletion requests, the metadata information of the file destination is deleted, and by the mesh Mark file mark is to have deleted.
Optionally, the process that object head corresponding with the file destination is found from OSD, including:
Inode number and institute using the aggregate file corresponding with the file destination recorded in file inode Offset of the file destination in the aggregate file is stated, aggregate objects corresponding with the file destination is found, finds Object head described in the aggregate objects.
Optionally, after the metadata information for deleting the file destination, further include:
Idle space in renewal aggregate file corresponding with the file destination, when the idle space exceedes default threshold Value, then preserve not deleted file in the aggregate file into new aggregate file, delete the aggregate file.
Optionally, the mistake call number of file destination and bitmap in the object head marked for state Journey, including:
Data in the object head are converted to the array of storage call number and the sets of bit-maps of mark disk storage state;
The array is traveled through, the call number of the file destination is labeled as deletion state;
Using the offset of the file destination and size of the file destination, find out in the sets of bit-maps with institute The corresponding bitmap of file destination is stated, bitmap corresponding with the file destination is labeled as deletion state.
Optionally, after traveling through the array, further include:
If not finding the call number of the file destination, generation include the file destination call number, The error log of offset and size information.
The invention also discloses a kind of distributed memory system aggregate file deletion system, including:
Metadata removing module, for using file deletion requests, the metadata information of delete target file, and will described in File destination is labeled as having deleted;
Object labeling head module, for finding object head corresponding with the file destination from OSD, by the object The call number of file destination and bitmap are marked as state in head, obtain new object head, and the new object head is write User terminal, so that the user terminal utilizes the new object head delete target file.
The invention also discloses a kind of distributed memory system aggregate file to delete device, including:
Memory, for storing instruction;Wherein, described instruction is using file deletion requests, delete target file Metadata information, and the file destination is labeled as having deleted;Object corresponding with the file destination is found from OSD Head, the call number of file destination and bitmap in the object head are marked as state, obtain new object head, and will described in New object head writes user terminal, so that the user terminal utilizes the new object head delete target file;
Processor, for performing the instruction in the memory.
The invention also discloses a kind of computer-readable recording medium, it is stored with the computer-readable recording medium point Cloth storage system aggregate file deletes program, when the distributed memory system aggregate file deletion program is executed by processor Realize such as the step of foregoing distributed memory system aggregate file delet method.
In the present invention, distributed memory system aggregate file delet method, including:Using file deletion requests, mesh is deleted The metadata information of file is marked, and file destination is labeled as having deleted;Object corresponding with file destination is found from OSD Head, the call number of file destination in object head and bitmap are marked as state, obtain new object head, and by new object head User terminal is write, so that user terminal utilizes new object head delete target file.The metadata of delete target file of the present invention Information, and file destination is labeled as having deleted, then object head corresponding with file destination is found from OSD, by object head The call number and bitmap of middle file destination are marked as state, obtain new object head, and new object head write-in user is whole End, no longer directly deletes the file destination in user terminal, but corresponding with file destination in meta data server by deleting Metadata information and corresponding with the file destination object head of modification so that during the progress file clean-up of user terminal backstage, base In object head delete target file corresponding with file destination, so as to reduce interacting for meta data server and user terminal, contract Short I/O path, improves user experience, accelerates to delete speed.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing There is attached drawing needed in technology description to be briefly described, it should be apparent that, drawings in the following description are only this The embodiment of invention, for those of ordinary skill in the art, without creative efforts, can also basis The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of distributed memory system aggregate file delet method flow diagram disclosed in present invention implementation;
Fig. 2 is a kind of distributed memory system aggregate file deletion system structure diagram disclosed in present invention implementation.
Embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, those of ordinary skill in the art are obtained every other without making creative work Embodiment, belongs to the scope of protection of the invention.
The embodiment of the invention discloses a kind of distributed memory system aggregate file delet method, shown in Figure 1, the party Method includes:
S11:Using file deletion requests, the metadata information of delete target file, and file destination is labeled as having deleted Remove.
Sent into meta data server, connect by user terminal specifically, file deletion requests can be user After receiving file deletion requests, the fileinfo to be deleted according to described in file deletion requests, by file destination target member number It is believed that breath is deleted, make user can not browse with access target file, and by file destination labeled as having deleted.
It should be noted that when file destination is labeled as having deleted, file destination is not in the disk of user terminal Delete.
S12:Found from OSD (Object-based Storage Device, object storage device) and file destination Corresponding object head, the call number of file destination in object head and bitmap are marked as state, obtain new object head, and New object head is write into user terminal, so that user terminal utilizes new object head delete target file.
Specifically, preserve the aggregate objects of each small documents in aggregate file in OSD, and preserved in aggregate objects with The call number of small documents and the object head of bitmap are recorded, it is therefore, corresponding with file destination using what is recorded in file inode Aggregate file offset in aggregate file of inode number and file destination, find corresponding with file destination poly- Object is closed, object head in aggregate objects is found, the call number of file destination in object head and bitmap is marked as shape State, obtains new object head, and new object head is write user terminal, so that the utilization of user terminal background liquidation procedures is new right As head delete target file.
For example, the call number of file destination and bitmap are defaulted as 1 in object head, by the call number of file destination and bitmap mark Deletion state is denoted as, then the call number of file destination and bitmap in object head is denoted as 0, obtains new object head.
Wherein, each bitmap corresponds to a memory space on disk, such as 4K, and a file corresponds to one or more positions Figure, each bitmap is corresponding with unique file, i.e., the data content of a file is only recorded in each bitmap, and a such as file is 5K, then need to take the memory space of two 4K, two memory spaces correspond to two bitmaps, the corresponding memory space of a bitmap again The 4K data of this document are stored with, the corresponding memory space of another bitmap is stored with the 1K data of this document, remaining 3K storages Space is then sky, and when the corresponding memory space of a bitmap is sky, then it is 0 that can set state, is deposited when a bitmap is corresponding Storage has data in space, then it is 1 that can set state.
In the embodiment of the present invention, file destination is the small documents for meeting polymerizing condition, for example, text, picture, music etc. are big Measure fragment type file.
As it can be seen that the metadata information of delete target file of the embodiment of the present invention, and file destination is labeled as having deleted, then Object head corresponding with file destination is found from OSD, by the call number of file destination in object head and bitmap mark for Deletion state, obtains new object head, and new object head is write user terminal, no longer directly deletes the target text in user terminal Part, but it is corresponding with file destination by deleting metadata information corresponding with file destination and modification in meta data server Object head, so that when user terminal backstage carries out file clean-up, based on object head delete target corresponding with file destination text Part, so as to reduce interacting for meta data server and user terminal, shortens I/O path, improves user experience, accelerates to delete speed.
The embodiment of the invention discloses a kind of specific distributed memory system aggregate file delet method, relative to upper one Embodiment, the present embodiment have made further instruction and optimization to technical solution.Specifically:
In the embodiment of the present invention, for preferably carry out Disk Cleanup, above-mentioned delete target file metadata information it Afterwards, idle space in aggregate file corresponding with file destination can also be updated, then will be poly- when idle space exceedes predetermined threshold value Close not deleted file in file to preserve into new aggregate file, delete aggregate file.
Specifically, idle space is the memory space for not preserving data in aggregate file, idle space can pass through position Figure is updated, and the memory space for not preserving the bitmap of data is just a part for idle space, and certain idle space can also Data are not preserved by the way that how many specific space in aggregate file calculated to update, and by updating idle space, can be reflected How many memory space does not preserve data in aggregate objects, the aggregate file low by reducing memory space utilization rate, Ke Yiti High disk storage space utilization rate, therefore, when idle space exceedes predetermined threshold value, then protects not deleted file in aggregate file Deposit into new aggregate file, delete aggregate file, predetermined threshold value can be that idle space is 70%.
The call number of file destination and bitmap in object head are marked in the embodiment of the present invention, in above-mentioned S12 and are The process of state, can specifically include S121 to S123;Wherein,
S121:Data in object head are converted to the array of storage call number and the bitmap of mark disk storage state Collection;
S122:Array is traveled through, the call number of file destination is labeled as deletion state;
S123:Using the offset of the file destination and size of file destination, find out in sets of bit-maps with file destination Corresponding bitmap, deletion state is labeled as by bitmap corresponding with file destination.
Specifically, the offset of file destination is stored in aggregate file, the size of file destination is stored in file index In node.
It should be noted that during array is traveled through, it is possible that mistake causes not preserving target text in array The call number of part, at this time, if not finding the call number of file destination, generation include file destination call number, The error log of offset and size information, so that user or repair procedure repair mistake according to error log.
It is understood that not only including the file with Aggregate attribute in distributed memory system, other texts are further included Part, therefore, it is necessary to judge whether file destination is the file with Aggregate attribute after file deletion requests are received, specifically It is above-mentioned utilize file deletion requests, file destination is labeled as deleted process, S111 to S113 can be included;Wherein,
S111:Judge file destination whether be Aggregate attribute file.
Specifically, judging the attribute of file destination, whether verification file destination is the file i.e. target with Aggregate attribute Whether file is file in aggregate file.
S112:If it is, judging whether the call number of file destination is stored in polymerization caching.
Specifically, when judge file destination for file in aggregate file after, file destination can be saved to user In the disk of terminal, it is also possible to not yet preserve to user terminal, be still stored in polymerization caching, therefore, it is necessary to judge target text Whether the call number of part is stored in polymerization caching, and follow-up delete operation is determined with this.
Wherein, if file destination is not the file in aggregate file, using the delet method pair that ordinary file is general File destination is deleted.
S113:If it is not, then using file deletion requests, file destination is labeled as having deleted.
Specifically, polymerizeing when the call number for judging file destination is not stored in caching, show that file destination has preserved Into the disk of user terminal, therefore, using file deletion requests, by file destination labeled as having deleted, if file destination Call number be stored in polymerization caching in, then show that file destination is not preserved into the disk of user terminal, be still stored in poly- Close caching in, at this time can directly polymerization cache in delete target file, the delete target by the way of ordinary file is deleted The metadata information of file.
To improve user experience, allow users to obtain deleting feedback of status in time, in the metadata of delete target file After information, send and delete successful information to user terminal, so that user learns that deletion is completed.
Correspondingly, the embodiment of the invention also discloses a kind of distributed memory system aggregate file deletion system, referring to Fig. 2 Shown, which includes:
Metadata removing module 11, for using file deletion requests, the metadata information of delete target file, and by mesh Mark file mark is to have deleted;
Object labeling head module 12, for finding object head corresponding with file destination from OSD, by mesh in object head Mark the call number of file and bitmap is marked as state, obtain new object head, and new object head is write into user terminal, with User terminal is set to utilize new object head delete target file.
As it can be seen that the metadata information of delete target file of the embodiment of the present invention, and file destination is labeled as having deleted, then Object head corresponding with file destination is found from OSD, by the call number of file destination in object head and bitmap mark for Deletion state, obtains new object head, and new object head is write user terminal, no longer directly deletes the target text in user terminal Part, but it is corresponding with file destination by deleting metadata information corresponding with file destination and modification in meta data server Object head, so that when user terminal backstage carries out file clean-up, based on object head delete target corresponding with file destination text Part, so as to reduce interacting for meta data server and user terminal, shortens I/O path, improves user experience.
In the embodiment of the present invention, it can also include deleting information sending module, idle space update module and aggregate file Recombination module;Wherein,
Information sending module is deleted, successful information is deleted to user terminal for sending.
Idle space update module, for updating idle space in aggregate file corresponding with file destination.
Aggregate file recombination module, for exceeding predetermined threshold value when idle space, then by not deleted text in aggregate file Part is preserved into new aggregate file, deletes aggregate file.
In the embodiment of the present invention, above-mentioned metadata removing module 11, can specifically include file attribute judging unit, index Number judging unit and metadata delete unit;Wherein,
File attribute judging unit, for judge file destination whether be Aggregate attribute file;
Call number judging unit, for judging file of the file destination for Aggregate attribute when file attribute judging unit, then Judge whether the call number of file destination is stored in polymerization caching;
Metadata deletes unit, and it is slow that the call number for judging file destination when call number judging unit is not held in polymerization In depositing, then using file deletion requests, the metadata information of delete target file, and file destination is labeled as having deleted.
Above-mentioned object labeling head module 12, can specifically include object head searching unit, Date Conversion Unit, call number mark Remember unit and bitmap indexing unit;
Object head searching unit, for utilizing the aggregate file corresponding with file destination recorded in file inode The offset of inode number and file destination in aggregate file, finds aggregate objects corresponding with file destination, searches The object head into aggregate objects.
Date Conversion Unit, for the data in object head to be converted to array and the mark disk storage of storage call number The sets of bit-maps of state;
Call number indexing unit, for traveling through array, deletion state is labeled as by the call number of file destination;
Bitmap indexing unit, for the offset and the size of file destination using file destination, finds out in sets of bit-maps In bitmap corresponding with file destination, bitmap corresponding with file destination is labeled as deletion state.
Further, distributed memory system aggregate file system, can also include error log generation module;Wherein,
Error log generation module, for not finding the call number of file destination when call number indexing unit, then generates The error log of call number including file destination, offset and size information.
In addition, the embodiment of the invention also discloses a kind of distributed memory system aggregate file to delete device, the device bag Include:
Memory, for storing instruction;Wherein, instruct using file deletion requests, first number of delete target file It is believed that breath, and file destination is labeled as having deleted;Object head corresponding with file destination is found from OSD, by object head The call number and bitmap of middle file destination are marked as state, obtain new object head, and new object head write-in user is whole End, so that user terminal utilizes new object head delete target file;
Processor, for performing the instruction in memory.
On more specifically being instructed in memory, the corresponding contents disclosed in previous embodiment are may be referred to, herein not Repeated again.
The embodiment of the invention also discloses a kind of computer-readable recording medium, it is stored with computer-readable recording medium Distributed memory system aggregate file deletes program, and distributed memory system aggregate file is deleted real when program is executed by processor Now such as the step of foregoing distributed memory system aggregate file delet method.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation Between there are any actual relationship or order.Moreover, term " comprising ", "comprising" or its any other variant meaning Covering non-exclusive inclusion, so that process, method, article or equipment including a series of elements not only include that A little key elements, but also including other elements that are not explicitly listed, or further include for this process, method, article or The intrinsic key element of equipment.In the absence of more restrictions, the key element limited by sentence "including a ...", is not arranged Except also there are other identical element in the process, method, article or apparatus that includes the element.
Professional further appreciates that, with reference to each exemplary unit of the embodiments described herein description And algorithm steps, can be realized with electronic hardware, computer software or the combination of the two, in order to clearly demonstrate hardware and The interchangeability of software, generally describes each exemplary composition and step according to function in the above description.These Function is performed with hardware or software mode actually, application-specific and design constraint depending on technical solution.Specialty Technical staff can realize described function to each specific application using distinct methods, but this realization should not Think beyond the scope of this invention.
Above to a kind of distributed memory system aggregate file delet method, system, device and meter provided by the present invention Calculation machine readable storage medium storing program for executing is described in detail, specific case used herein to the principle of the present invention and embodiment into Elaboration is gone, the explanation of above example is only intended to help to understand the method and its core concept of the present invention;Meanwhile for this The those skilled in the art in field, according to the thought of the present invention, there will be changes in specific embodiments and applications, In conclusion this specification content should not be construed as limiting the invention.

Claims (10)

  1. A kind of 1. distributed memory system aggregate file delet method, it is characterised in that including:
    Using file deletion requests, the metadata information of delete target file, and the file destination is labeled as having deleted;
    Object head corresponding with the file destination is found from OSD, by the call number of file destination in the object head and Bitmap is marked as state, obtains new object head, and the new object head is write user terminal, so that the user is whole End utilizes the new object head delete target file.
  2. 2. distributed memory system aggregate file delet method according to claim 1, it is characterised in that the deletion mesh After the metadata information for marking file, further include:
    Send and delete successful information to the user terminal.
  3. 3. distributed memory system aggregate file delet method according to claim 1, it is characterised in that described to utilize text Part removal request, the metadata information of delete target file, and the file destination is labeled as deleted process, including:
    Judge the file destination whether be Aggregate attribute file;
    If it is, judging whether the call number of the file destination is stored in polymerization caching;
    If it is not, then using the file deletion requests, the metadata information of the file destination is deleted, and by target text Part is labeled as having deleted.
  4. 4. distributed memory system aggregate file delet method according to claim 1, it is characterised in that described from OSD In find the process of object head corresponding with the file destination, including:
    Inode number and the mesh using the aggregate file corresponding with the file destination recorded in file inode Offset of the file in the aggregate file is marked, finds aggregate objects corresponding with the file destination, is found described Object head described in aggregate objects.
  5. 5. distributed memory system aggregate file delet method according to claim 1, it is characterised in that the deletion institute After the metadata information for stating file destination, further include:
    Idle space in corresponding with the file destination aggregate file of renewal, when the idle space exceedes predetermined threshold value, then Not deleted file in the aggregate file is preserved into new aggregate file, deletes the aggregate file.
  6. 6. distributed memory system aggregate file delet method according to any one of claims 1 to 5, it is characterised in that The process call number of file destination and bitmap in the object head marked for state, including:
    Data in the object head are converted to the array of storage call number and the sets of bit-maps of mark disk storage state;
    The array is traveled through, the call number of the file destination is labeled as deletion state;
    Using the offset of the file destination and size of the file destination, find out in the sets of bit-maps with the mesh The corresponding bitmap of file is marked, bitmap corresponding with the file destination is labeled as deletion state.
  7. 7. distributed memory system aggregate file delet method according to claim 6, it is characterised in that travel through the number After group, further include:
    If not finding the call number of the file destination, generation include the call number of the file destination, offset and The error log of size information.
  8. A kind of 8. distributed memory system aggregate file deletion system, it is characterised in that including:
    Metadata removing module, for using file deletion requests, the metadata information of delete target file, and by the target File mark is to have deleted;
    Object labeling head module, for finding object head corresponding with the file destination from OSD, by the object head The call number and bitmap of file destination are marked as state, obtain new object head, and the new object head is write user Terminal, so that the user terminal utilizes the new object head delete target file.
  9. 9. a kind of distributed memory system aggregate file deletes device, it is characterised in that including:
    Memory, for storing instruction;Wherein, described instruction is using file deletion requests, first number of delete target file It is believed that breath, and the file destination is labeled as having deleted;Object head corresponding with the file destination is found from OSD, The call number of file destination and bitmap in the object head are marked as state, obtain new object head, and will be described new Object head writes user terminal, so that the user terminal utilizes the new object head delete target file;
    Processor, for performing the instruction in the memory.
  10. 10. a kind of computer-readable recording medium, it is characterised in that be stored with distribution on the computer-readable recording medium Storage system aggregate file deletes program, and the distributed memory system aggregate file is deleted when program is executed by processor and realized As described in any one of claim 1 to 7 the step of distributed memory system aggregate file delet method.
CN201711340624.8A 2017-12-14 2017-12-14 Aggregate file delet method, system, device and readable storage medium storing program for executing Pending CN107958079A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711340624.8A CN107958079A (en) 2017-12-14 2017-12-14 Aggregate file delet method, system, device and readable storage medium storing program for executing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711340624.8A CN107958079A (en) 2017-12-14 2017-12-14 Aggregate file delet method, system, device and readable storage medium storing program for executing

Publications (1)

Publication Number Publication Date
CN107958079A true CN107958079A (en) 2018-04-24

Family

ID=61958958

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711340624.8A Pending CN107958079A (en) 2017-12-14 2017-12-14 Aggregate file delet method, system, device and readable storage medium storing program for executing

Country Status (1)

Country Link
CN (1) CN107958079A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109271363A (en) * 2018-09-17 2019-01-25 平安科技(深圳)有限公司 A kind of method and apparatus of file storage
CN110874182A (en) * 2018-08-31 2020-03-10 杭州海康威视系统技术有限公司 Processing method, device and equipment for stripe index
CN110908996A (en) * 2018-09-18 2020-03-24 北京京东尚科信息技术有限公司 Data processing method and device
CN111291006A (en) * 2020-01-21 2020-06-16 苏州浪潮智能科技有限公司 Data recovery processing method, device and equipment and readable storage medium
CN112527742A (en) * 2020-11-05 2021-03-19 武汉大千信息技术有限公司 Method for quickly and accurately deleting massive picture data files in system in batch
CN113031871A (en) * 2021-03-26 2021-06-25 山东英信计算机技术有限公司 Data adding and aggregating method and device, electronic equipment and readable storage medium
CN113626382A (en) * 2021-06-30 2021-11-09 济南浪潮数据技术有限公司 Index method, system and related device for aggregation object in distributed file system
CN113778329A (en) * 2021-06-30 2021-12-10 济南浪潮数据技术有限公司 Data aggregation method, device, equipment and computer readable storage medium
CN115309766A (en) * 2022-10-12 2022-11-08 北京奥星贝斯科技有限公司 Method and device for executing database service
CN116737670A (en) * 2023-08-11 2023-09-12 英诺达(成都)电子科技有限公司 Method, device, equipment and storage medium for deleting UPF file

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101706805A (en) * 2009-10-30 2010-05-12 中国科学院计算技术研究所 Method and system for storing object
CN103064639A (en) * 2012-12-28 2013-04-24 华为技术有限公司 Method and device for storing data
US20140253778A1 (en) * 2004-12-28 2014-09-11 Pantech Co., Ltd. Method of providing osd in mobile communication terminal using q-camera
CN105095489A (en) * 2015-08-18 2015-11-25 浪潮(北京)电子信息产业有限公司 Distributed file deletion method, device and system
CN107168651A (en) * 2017-05-19 2017-09-15 郑州云海信息技术有限公司 A kind of small documents polymerize storage processing method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140253778A1 (en) * 2004-12-28 2014-09-11 Pantech Co., Ltd. Method of providing osd in mobile communication terminal using q-camera
CN101706805A (en) * 2009-10-30 2010-05-12 中国科学院计算技术研究所 Method and system for storing object
CN103064639A (en) * 2012-12-28 2013-04-24 华为技术有限公司 Method and device for storing data
CN105095489A (en) * 2015-08-18 2015-11-25 浪潮(北京)电子信息产业有限公司 Distributed file deletion method, device and system
CN107168651A (en) * 2017-05-19 2017-09-15 郑州云海信息技术有限公司 A kind of small documents polymerize storage processing method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ANA AVILES-GONZALEZ: "Scalable Huge Directories through OSD+ Devices", 《PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING》 *
刘景宁: "对象存储设备端数据管理策略研究", 《计算机研究与发展》 *

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110874182A (en) * 2018-08-31 2020-03-10 杭州海康威视系统技术有限公司 Processing method, device and equipment for stripe index
CN110874182B (en) * 2018-08-31 2023-12-26 杭州海康威视系统技术有限公司 Processing method, device and equipment for strip index
CN109271363A (en) * 2018-09-17 2019-01-25 平安科技(深圳)有限公司 A kind of method and apparatus of file storage
CN109271363B (en) * 2018-09-17 2023-05-26 平安科技(深圳)有限公司 File storage method and device
CN110908996A (en) * 2018-09-18 2020-03-24 北京京东尚科信息技术有限公司 Data processing method and device
CN111291006B (en) * 2020-01-21 2023-01-10 苏州浪潮智能科技有限公司 Data recovery processing method, device and equipment and readable storage medium
CN111291006A (en) * 2020-01-21 2020-06-16 苏州浪潮智能科技有限公司 Data recovery processing method, device and equipment and readable storage medium
CN112527742A (en) * 2020-11-05 2021-03-19 武汉大千信息技术有限公司 Method for quickly and accurately deleting massive picture data files in system in batch
CN113031871A (en) * 2021-03-26 2021-06-25 山东英信计算机技术有限公司 Data adding and aggregating method and device, electronic equipment and readable storage medium
CN113626382A (en) * 2021-06-30 2021-11-09 济南浪潮数据技术有限公司 Index method, system and related device for aggregation object in distributed file system
CN113778329A (en) * 2021-06-30 2021-12-10 济南浪潮数据技术有限公司 Data aggregation method, device, equipment and computer readable storage medium
CN113778329B (en) * 2021-06-30 2023-12-22 济南浪潮数据技术有限公司 Data aggregation method, device, equipment and computer readable storage medium
CN113626382B (en) * 2021-06-30 2024-02-23 济南浪潮数据技术有限公司 Index method, system and related device for aggregation object in distributed file system
CN115309766A (en) * 2022-10-12 2022-11-08 北京奥星贝斯科技有限公司 Method and device for executing database service
CN116737670B (en) * 2023-08-11 2023-11-17 英诺达(成都)电子科技有限公司 Method, device, equipment and storage medium for deleting UPF file
CN116737670A (en) * 2023-08-11 2023-09-12 英诺达(成都)电子科技有限公司 Method, device, equipment and storage medium for deleting UPF file

Similar Documents

Publication Publication Date Title
CN107958079A (en) Aggregate file delet method, system, device and readable storage medium storing program for executing
US11645183B1 (en) User interface for correlation of virtual machine information and storage information
CN103136243B (en) File system duplicate removal method based on cloud storage and device
US10275177B2 (en) Data layout schemas for seamless data migration
CN107918612B (en) The implementation method and device of key assignments memory system data structure
US9043540B2 (en) Systems and methods for tracking block ownership
US9798728B2 (en) System performing data deduplication using a dense tree data structure
US10620860B2 (en) System for storing data in tape volume containers
US10509701B2 (en) Performing data backups using snapshots
US8719237B2 (en) Method and apparatus for deleting duplicate data
US9047330B2 (en) Index compression in databases
EP1176523A2 (en) System for providing extended file attributes
CN106021256A (en) De-duplicating distributed file system using cloud-based object store
US10956051B2 (en) Data-packed storage containers for streamlined access and migration
CN104408111A (en) Method and device for deleting duplicate data
CN104778192B9 (en) Directory structure representing content addressable storage system
CN109522283B (en) Method and system for deleting repeated data
CN103678491A (en) Method based on Hadoop small file optimization and reverse index establishment
CN107817946A (en) For mixing the method and device of storage device read-write data
CN108287869A (en) A kind of mass small documents solution based on speedy storage equipment
CN108897859A (en) A kind of metadata retrieval method, apparatus, equipment and computer readable storage medium
CN104598550A (en) Network video index updating method and device
CN110008197A (en) A kind of data processing method, system and electronic equipment and storage medium
CN109947729A (en) A kind of real-time data analysis method and device
KR101299555B1 (en) Apparatus and method for text search using index based on hash function

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180424