CN109471843A - A kind of metadata cache method, system and relevant apparatus - Google Patents

A kind of metadata cache method, system and relevant apparatus Download PDF

Info

Publication number
CN109471843A
CN109471843A CN201811585056.2A CN201811585056A CN109471843A CN 109471843 A CN109471843 A CN 109471843A CN 201811585056 A CN201811585056 A CN 201811585056A CN 109471843 A CN109471843 A CN 109471843A
Authority
CN
China
Prior art keywords
metadata
cache
target
request instruction
memory
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811585056.2A
Other languages
Chinese (zh)
Other versions
CN109471843B (en
Inventor
李长春
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhengzhou Yunhai Information Technology Co Ltd
Original Assignee
Zhengzhou Yunhai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhengzhou Yunhai Information Technology Co Ltd filed Critical Zhengzhou Yunhai Information Technology Co Ltd
Priority to CN201811585056.2A priority Critical patent/CN109471843B/en
Publication of CN109471843A publication Critical patent/CN109471843A/en
Application granted granted Critical
Publication of CN109471843B publication Critical patent/CN109471843B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Memory System Of A Hierarchy Structure (AREA)

Abstract

A kind of metadata cache method provided herein, comprising: receive the request instruction of cache metadata;Metadata is carried out according to request instruction to simplify processing, obtains simplifying metadata;Preset cache area of the metadata cache into memory node will be simplified.This method received the request instruction of cache metadata before this, carried out simplifying processing to metadata further according to request instruction, obtained simplifying metadata, will finally simplify preset cache area of the metadata cache into memory node.As it can be seen that this method has carried out metadata compared to the relevant technologies to simplify processing, the metadata total amount of caching can be improved in the case where the total memory of memory node is constant, and then improve the reading speed of file.The application also provides a kind of metadata cache system, equipment and computer readable storage medium, all has above-mentioned beneficial effect.

Description

A kind of metadata cache method, system and relevant apparatus
Technical field
This application involves metadata cache technical field, in particular to a kind of metadata cache method, system, equipment and meter Calculation machine readable storage medium storing program for executing.
Background technique
Performance issue in the mass small documents scene of distributed file system is always the technical problem for being difficult breakthrough. In distributed file system, if access file can not be in locally hit caching, the feature based on distributed file system Access file is required in cluster network inter access metadata every time, and the implementation procedure of IO read-write may also can across a network Metadata is read, each file operation all goes across a network to obtain metadata and increases the time delay of file reading, therefore needs to first number According to being cached, but directly metadata is cached in the related technology, is delayed in the case where the total memory of memory node is constant The metadata total amount deposited is less, causes when reading file, is difficult to accomplish hit caching, so as to cause read file when Time needs to be traversed for locating file, considerably increases reading time delay, the reading speed of reduced file.
Therefore, the metadata total amount of caching how is improved in the case where the total memory of memory node is constant, and then improves text The reading speed of part is those skilled in the art's technical issues that need to address.
Summary of the invention
The purpose of the application is to provide a kind of metadata cache method, system, equipment and computer readable storage medium, energy Enough metadata total amounts that caching is improved in the case where the total memory of memory node is constant, and then improve the reading speed of file.
In order to solve the above technical problems, the application provides a kind of metadata cache method, comprising:
Receive the request instruction of cache metadata;
The metadata is carried out according to the request instruction to simplify processing, obtains simplifying metadata;
By the preset cache area for simplifying metadata cache into memory node.
It preferably, will be after the preset cache area that metadata cache be simplified into memory node, further includes:
When reading target metadata, judge in the preset cache area with the presence or absence of the target metadata;
If so, reading the target metadata from the preset cache area;
If it is not, then reading the target metadata from the memory of the memory node.
Preferably, after reading the target metadata in the memory of the memory node, further includes:
Processing is simplified to described in target metadata progress, target is obtained and simplifies metadata;
The target is simplified into the preset cache area of the metadata cache into the memory node.
Preferably, described that the metadata is carried out according to the request instruction to simplify processing, it obtains simplifying metadata, wrap It includes:
According to the request instruction, the service operation data in the metadata is rejected, obtains described simplifying metadata.
The application provides, after the request instruction for receiving cache metadata, further includes:
Judge whether the quantity of the metadata reaches preset threshold;
The metadata is carried out according to the request instruction to simplify processing if so, execution is described, obtains simplifying first number According to the step of.
The application also provides a kind of metadata cache system, comprising:
Request instruction receiving module, for receiving the request instruction of cache metadata;
Processing module is simplified, processing is simplified for carrying out according to the request instruction to the metadata, obtains simplifying member Data;
Metadata cache module, for by the preset cache area for simplifying metadata cache into memory node.
Preferably, the metadata cache system further include:
Judgment module, for when reading target metadata, judging in the preset cache area with the presence or absence of the target Metadata;
First read module, if delaying for there are the target metadatas in the preset cache area from described preset It deposits and reads the target metadata in area;
Second read module, if for the target metadata to be not present in the preset cache area, from the storage The target metadata is read in the memory of node.
It is preferably, described to simplify processing module, comprising:
Processing unit is simplified, for the service operation data in the metadata being rejected, being obtained according to the request instruction It is described to simplify metadata.
The application also provides a kind of equipment, comprising:
Memory and processor;Wherein, the memory is for storing computer program, and the processor is for executing institute The step of metadata cache method described above is realized when stating computer program.
The application also provides a kind of computer readable storage medium, and the computer-readable recording medium storage has computer The step of program, the computer program realizes metadata cache method described above when being executed by processor.
A kind of metadata cache method provided herein, comprising: receive the request instruction of cache metadata;According to institute It states request instruction the metadata is carried out to simplify processing, obtains simplifying metadata;By the metadata cache of simplifying to storage Preset cache area in node.
This method received the request instruction of cache metadata before this, carried out further according to the request instruction to the metadata Processing is simplified, obtains simplifying metadata, finally by the preset cache area for simplifying metadata cache into memory node.It can See, this method has carried out metadata compared to the relevant technologies to simplify processing, situation that can be constant in the total memory of memory node The lower metadata total amount for improving caching, and then improve the reading speed of file.The application also provide a kind of metadata cache system, Equipment and computer readable storage medium all have above-mentioned beneficial effect, and details are not described herein.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this The embodiment of application for those of ordinary skill in the art without creative efforts, can also basis The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of flow chart of metadata cache method provided by the embodiment of the present application;
Fig. 2 is a kind of structural block diagram of metadata cache system provided by the embodiment of the present application.
Specific embodiment
The core of the application is to provide a kind of metadata cache method, can be in the case where the total memory of memory node is constant The metadata total amount of caching is improved, and then improves the reading speed of file.Another core of the application is to provide a kind of metadata Caching system, equipment and computer readable storage medium.
To keep the purposes, technical schemes and advantages of the embodiment of the present application clearer, below in conjunction with the embodiment of the present application In attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is Some embodiments of the present application, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art Every other embodiment obtained without making creative work, shall fall in the protection scope of this application.
Performance issue in the mass small documents scene of distributed file system is always the technical problem for being difficult breakthrough. In distributed file system, if access file can not be in locally hit caching, the feature based on distributed file system Access file is required in cluster network inter access metadata every time, and the implementation procedure of IO read-write may also can across a network Metadata is read, each file operation all goes across a network to obtain metadata and increases the time delay of file reading, therefore needs to first number According to being cached, but directly metadata is cached in the related technology, is delayed in the case where the total memory of memory node is constant The metadata total amount deposited is less, causes when reading file, is difficult to accomplish hit caching, so as to cause read file when Time needs to be traversed for locating file, considerably increases reading time delay, the reading speed of reduced file.The embodiment of the present application can be The metadata total amount of caching is improved in the case that the total memory of memory node is constant, and then improves the reading speed of file.Specifically ask With reference to Fig. 1, Fig. 1 is a kind of flow chart of metadata cache method provided by the embodiment of the present application, the metadata cache method It specifically includes:
S101, the request instruction for receiving cache metadata;
The executing subject of the embodiment of the present application is any memory node in distributed memory system, and the memory node was before this Receive the request instruction of cache metadata.Each memory node is usually storage server in distributed memory system, It is interconnected between storage server by high speed network, i.e., is interconnected between memory node by high speed network.Distribution is deposited at this The quantity of memory node is not especially limited in storage node, should be made according to the actual situation by those skilled in the art and be set accordingly It is fixed.Client for request instruction for sending cache metadata is also not especially limited at this, such as can be application server, It can also be terminal user.
Further, after the request instruction for receiving cache metadata, also typically include: judging the quantity of metadata is It is no to reach preset threshold;Metadata is carried out according to request instruction to simplify processing if so, executing, obtains the step for simplifying metadata Suddenly.The numerical values recited of preset threshold is not especially limited herein, should be made according to the actual situation by those skilled in the art Corresponding setting.If the quantity of metadata reaches preset threshold, the embodiment of the present application can be unified to carry out essence to these metadata Letter processing, obtains simplifying metadata.Preset threshold such case is not reached for the quantity of metadata, it is subsequent to execute operation It is not especially limited, it will usually continue waiting for until the quantity of metadata reaches preset threshold.
S102, metadata is carried out according to request instruction to simplify processing, obtains simplifying metadata;
Memory node is after the request instruction for receiving cache metadata in the embodiment of the present application, according to request instruction to first number According to carrying out simplifying processing, obtain simplifying metadata.Metadata is briefly described at this: the data point in any file system For data and metadata;Data refer to the real data in ordinary file, and metadata refers to the feature for describing a file System data, such as access authority, file owner and the distributed intelligence of file data blocks etc..In distributed field system In system, distributed intelligence includes position and disk position in the cluster of the file on disk.User needs to operate a text Part must obtain its metadata first, can just navigate to the position of file and obtain the interior perhaps association attributes of file.
Mode of metadata management is not especially limited at this, should be made according to the actual situation by those skilled in the art Corresponding setting, generallys use distributed management mode.Distributed management refers to the arbitrary node that metadata is stored in system And the migration of dynamic is also distributed on each different node the responsibility of metadata management.Distributed meta-data management Benefit be the single failpoint for solving the problems, such as centralized management, and performance bottleneck will not occur with frequent operation.
Metadata includes two parts, and respectively user preset need to be stored in the data and service operation data of disk.For with The content of the default data that need to be stored in disk in family and the content of service operation data, are not especially limited herein, should be by ability Field technique personnel make corresponding setting according to the actual situation.It is user preset that the embodiment of the present application obtained, which simplifies metadata, The data of disk need to be stored in, therefore the mode for simplify processing to metadata is not especially limited, such as can be directly by user The default data that need to be stored in disk are stripped out from metadata, can also weed out service operation data in metadata.
Further, above-mentioned that metadata is carried out according to request instruction to simplify processing, it obtains simplifying metadata, usually wrap It includes: according to request instruction, rejecting the service operation data in metadata, obtain simplifying metadata.For rejecting in metadata The mode of service operation data, is not specifically limited herein, and should be made according to the actual situation by those skilled in the art corresponding Setting usually executes the rejecting operation that preset program carries out service operation data.Why service operation data can be rejected It is because can reload these service operation datas in subsequent processes, therefore while caching need to only cache and simplify metadata i.e. It can.
S103, preset cache area of the metadata cache into memory node will be simplified.
Memory node will simplify metadata cache into memory node after obtaining simplifying metadata in the embodiment of the present application Preset cache area.The memory size of position and preset cache area at this to the preset cache area in memory node is not made to have Body limits, and corresponding setting should be made according to the actual situation by those skilled in the art, and usual preset cache area is located at storage section In RAM in point.Further, for the model of RAM and caching speed of the metadata cache to RAM will be simplified, herein It is not especially limited, corresponding setting should be made according to the actual situation by those skilled in the art.
Further, it after preset cache area of the metadata cache into memory node being simplified, also typically includes: reading When taking target metadata, judge in preset cache area with the presence or absence of target metadata;If so, reading mesh from preset cache area Mark metadata;If it is not, then reading target metadata from the memory of memory node.For distributed file system, read Directory metadata need to be read out from mass file, if can not read in the preset cache area that node is locally stored needs The directory metadata or file of reading require then the feature based on distributed file system accesses file every time in cluster net Network inter access metadata, an IO read-write implementation procedure may also can across a network read metadata, every time read file behaviour It all goes across a network to obtain metadata and increases the time delay of file reading.From the foregoing, it can be understood that the embodiment of the present application to metadata into Row simplifies processing, the metadata total amount of caching can be improved in the case where the total memory of memory node is constant, therefore the application is implemented Example is judged first when reading target metadata with the presence or absence of target metadata in preset cache area, if in preset cache area There are target metadatas, then target metadata are directly read from preset cache area, and then improve the reading speed of file.If pre- If target metadata is not present in buffer area, then target metadata is read from the memory of memory node, can satisfy business Demand.The type of memory affiliated for memory and the amount of capacity of memory are not especially limited herein, should be by this field skill Art personnel make corresponding setting according to the actual situation.
Further, it after reading target metadata in the memory from memory node, also typically includes: to target element number According to carrying out simplifying processing, obtains target and simplify metadata;Target is simplified into preset cache of the metadata cache into memory node Area.From the foregoing, it can be understood that the mode that the embodiment of the present application simplify processing to metadata is not especially limited, therefore herein to target The mode that metadata simplify processing is also not especially limited, such as user preset need to directly can be stored in the data of disk It is stripped out, service operation data in target metadata can also be weeded out from target metadata.Because reading in memory The speed of target metadata is taken to be compared to the speed directly read from preset cache area slow, therefore out of memory node It deposits after reading target metadata, target metadata is carried out to simplify processing, target is obtained and simplifies metadata, target is simplified Preset cache area of the metadata cache into memory node, primarily to can be direct when reading again target metadata next time It is directly read from preset cache area, accelerates read or write speed.
The embodiment of the present application received the request instruction of cache metadata before this, carried out essence to metadata further according to request instruction Letter processing, obtains simplifying metadata, will finally simplify preset cache area of the metadata cache into memory node.As it can be seen that the party Method has carried out metadata compared to the relevant technologies to simplify processing, can improve in the case where the total memory of memory node is constant slow The metadata total amount deposited, and then improve the reading speed of file.
Below to a kind of metadata cache system provided by the embodiments of the present application, equipment and computer readable storage medium into Row is introduced, and metadata cache system, equipment and computer readable storage medium described below and above-described metadata are slow The method of depositing can correspond to each other reference.
Referring to FIG. 2, Fig. 2 is a kind of structural block diagram of metadata cache system provided by the embodiment of the present application;This yuan Data buffering system includes:
Request instruction receiving module 201, for receiving the request instruction of cache metadata;
Processing module 202 is simplified, processing is simplified for carrying out according to request instruction to metadata, obtains simplifying metadata;
Metadata cache module 203, for preset cache area of the metadata cache into memory node will to be simplified.
Based on the above embodiment, metadata cache system in the present embodiment, also typically includes:
Judgment module, for when reading target metadata, judging in preset cache area with the presence or absence of target metadata;
First read module, if reading mesh from preset cache area for there are target metadatas in preset cache area Mark metadata;
Second read module, if for target metadata to be not present in preset cache area, from the memory of memory node Read target metadata.
Based on the above embodiment, metadata cache system in the present embodiment, also typically includes:
Target simplifies metadata and obtains module, simplifies processing for carrying out to target metadata, obtains target and simplify first number According to;
Target simplifies metadata cache module, for target to be simplified preset cache of the metadata cache into memory node Area.
Based on the above embodiment, processing module 202 is simplified in the present embodiment, is generally included:
Processing unit is simplified, for the service operation data in metadata being rejected, obtaining simplifying first number according to request instruction According to.
Based on the above embodiment, metadata cache system in the present embodiment, also typically includes:
Quantity judgment module, for judging whether the quantity of metadata reaches preset threshold;
Simplifying processing module 202 is specially when the quantity of metadata reaches preset threshold, according to request instruction to first number According to carrying out simplifying processing, the module for simplifying metadata is obtained.
The application also provides a kind of equipment, comprising: memory and processor;Wherein, memory is for storing computer journey The step of sequence, processor is for realizing the metadata cache method of above-mentioned any embodiment when executing computer program.
The application also provides a kind of computer readable storage medium, and computer-readable recording medium storage has computer journey Sequence, the step of metadata cache method of above-mentioned any embodiment is realized when computer program is executed by processor.
The computer readable storage medium may include: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic or disk etc. is various to deposit Store up the medium of program code.
Each embodiment is described in a progressive manner in specification, the highlights of each of the examples are with other realities The difference of example is applied, the same or similar parts in each embodiment may refer to each other.For embodiment provide system and Speech, since it is corresponding with the method that embodiment provides, so being described relatively simple, related place is referring to method part illustration ?.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered Think beyond the scope of this invention.
The step of method described in conjunction with the examples disclosed in this document or algorithm, can directly be held with hardware, processor The combination of capable software module or the two is implemented.Software module can be placed in random access memory (RAM), memory, read-only deposit Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology In any other form of storage medium well known in field.
Above to a kind of metadata cache method, system, equipment and computer readable storage medium provided herein It is described in detail.Specific examples are used herein to illustrate the principle and implementation manner of the present application, the above reality The explanation for applying example is merely used to help understand the present processes and its core concept.It should be pointed out that for the art For those of ordinary skill, under the premise of not departing from the application principle, can also to the application, some improvement and modification can also be carried out, These improvement and modification are also fallen into the protection scope of the claim of this application.

Claims (10)

1. a kind of metadata cache method characterized by comprising
Receive the request instruction of cache metadata;
The metadata is carried out according to the request instruction to simplify processing, obtains simplifying metadata;
By the preset cache area for simplifying metadata cache into memory node.
2. metadata cache method according to claim 1, which is characterized in that by the metadata cache of simplifying to storage After preset cache area in node, further includes:
When reading target metadata, judge in the preset cache area with the presence or absence of the target metadata;
If so, reading the target metadata from the preset cache area;
If it is not, then reading the target metadata from the memory of the memory node.
3. metadata cache method according to claim 2, which is characterized in that read from the memory of the memory node After the target metadata, further includes:
Processing is simplified to described in target metadata progress, target is obtained and simplifies metadata;
The target is simplified into the preset cache area of the metadata cache into the memory node.
4. metadata cache method according to claim 1, which is characterized in that it is described according to the request instruction to described Metadata carries out simplifying processing, obtains simplifying metadata, comprising:
According to the request instruction, the service operation data in the metadata is rejected, obtains described simplifying metadata.
5. metadata cache method according to claim 1, which is characterized in that receive cache metadata request instruction it Afterwards, further includes:
Judge whether the quantity of the metadata reaches preset threshold;
The metadata is carried out according to the request instruction to simplify processing if so, execution is described, obtains simplifying metadata Step.
6. a kind of metadata cache system characterized by comprising
Request instruction receiving module, for receiving the request instruction of cache metadata;
Processing module is simplified, processing is simplified for carrying out according to the request instruction to the metadata, obtains simplifying metadata;
Metadata cache module, for by the preset cache area for simplifying metadata cache into memory node.
7. metadata cache system according to claim 6, which is characterized in that further include:
Judgment module, for when reading target metadata, judging in the preset cache area with the presence or absence of the target element number According to;
First read module, if for there are the target metadatas in the preset cache area, from the preset cache area It is middle to read the target metadata;
Second read module, if for the target metadata to be not present in the preset cache area, from the memory node Memory in read the target metadata.
8. metadata cache system according to claim 6, which is characterized in that described to simplify processing module, comprising:
Processing unit is simplified, for rejecting the service operation data in the metadata according to the request instruction, is obtained described Simplify metadata.
9. a kind of equipment characterized by comprising
Memory and processor;Wherein, the memory is for storing computer program, the processor by execute it is described based on It realizes when calculation machine program such as the step of metadata cache method described in any one of claim 1 to 5.
10. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer journey Sequence is realized when the computer program is executed by processor such as metadata cache method described in any one of claim 1 to 5 Step.
CN201811585056.2A 2018-12-24 2018-12-24 Metadata caching method, system and related device Active CN109471843B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811585056.2A CN109471843B (en) 2018-12-24 2018-12-24 Metadata caching method, system and related device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811585056.2A CN109471843B (en) 2018-12-24 2018-12-24 Metadata caching method, system and related device

Publications (2)

Publication Number Publication Date
CN109471843A true CN109471843A (en) 2019-03-15
CN109471843B CN109471843B (en) 2021-08-10

Family

ID=65677873

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811585056.2A Active CN109471843B (en) 2018-12-24 2018-12-24 Metadata caching method, system and related device

Country Status (1)

Country Link
CN (1) CN109471843B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110764708A (en) * 2019-10-25 2020-02-07 北京浪潮数据技术有限公司 Data reading method, device, equipment and storage medium
CN111143290A (en) * 2019-12-27 2020-05-12 浪潮电子信息产业股份有限公司 Memory management method, system, equipment and computer readable storage medium
CN111611179A (en) * 2020-05-21 2020-09-01 深圳佰维存储科技股份有限公司 Metadata hit rate improving method and device, storage medium and electronic equipment
CN113660530A (en) * 2021-07-27 2021-11-16 中央广播电视总台 Program stream data capturing method and device, computer equipment and readable storage medium
CN115470008A (en) * 2022-11-14 2022-12-13 杭州拓数派科技发展有限公司 Metadata access method and device and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101706756A (en) * 2009-12-10 2010-05-12 金蝶软件(中国)有限公司 Method and device for caching metadata
CN104035887A (en) * 2014-05-22 2014-09-10 中国科学院计算技术研究所 Block device caching device and method based on simplification configuration system
CN105095495A (en) * 2015-08-21 2015-11-25 浪潮(北京)电子信息产业有限公司 Distributed file system cache management method and system
CN109002400A (en) * 2018-06-01 2018-12-14 暨南大学 A kind of perception of content type Computer Cache management system and method
US20180365145A1 (en) * 2016-04-29 2018-12-20 Netapp, Inc. Managing input/output operations for shingled magnetic recording in a storage system
CN109582649A (en) * 2018-12-03 2019-04-05 郑州云海信息技术有限公司 A kind of metadata storing method, device, equipment and readable storage medium storing program for executing

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101706756A (en) * 2009-12-10 2010-05-12 金蝶软件(中国)有限公司 Method and device for caching metadata
CN104035887A (en) * 2014-05-22 2014-09-10 中国科学院计算技术研究所 Block device caching device and method based on simplification configuration system
CN105095495A (en) * 2015-08-21 2015-11-25 浪潮(北京)电子信息产业有限公司 Distributed file system cache management method and system
US20180365145A1 (en) * 2016-04-29 2018-12-20 Netapp, Inc. Managing input/output operations for shingled magnetic recording in a storage system
CN109002400A (en) * 2018-06-01 2018-12-14 暨南大学 A kind of perception of content type Computer Cache management system and method
CN109582649A (en) * 2018-12-03 2019-04-05 郑州云海信息技术有限公司 A kind of metadata storing method, device, equipment and readable storage medium storing program for executing

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110764708A (en) * 2019-10-25 2020-02-07 北京浪潮数据技术有限公司 Data reading method, device, equipment and storage medium
CN111143290A (en) * 2019-12-27 2020-05-12 浪潮电子信息产业股份有限公司 Memory management method, system, equipment and computer readable storage medium
CN111611179A (en) * 2020-05-21 2020-09-01 深圳佰维存储科技股份有限公司 Metadata hit rate improving method and device, storage medium and electronic equipment
CN111611179B (en) * 2020-05-21 2023-09-12 深圳佰维存储科技股份有限公司 Metadata hit rate improving method and device, storage medium and electronic equipment
CN113660530A (en) * 2021-07-27 2021-11-16 中央广播电视总台 Program stream data capturing method and device, computer equipment and readable storage medium
CN113660530B (en) * 2021-07-27 2024-03-19 中央广播电视总台 Program stream data grabbing method and device, computer equipment and readable storage medium
CN115470008A (en) * 2022-11-14 2022-12-13 杭州拓数派科技发展有限公司 Metadata access method and device and storage medium
CN115470008B (en) * 2022-11-14 2023-03-10 杭州拓数派科技发展有限公司 Metadata access method and device and storage medium

Also Published As

Publication number Publication date
CN109471843B (en) 2021-08-10

Similar Documents

Publication Publication Date Title
CN109471843A (en) A kind of metadata cache method, system and relevant apparatus
CN108647151A (en) It is a kind of to dodge system metadata rule method, apparatus, equipment and storage medium entirely
CN103136243B (en) File system duplicate removal method based on cloud storage and device
CN109614377A (en) File delet method, device, equipment and the storage medium of distributed file system
CN110008142A (en) Storing data management method, device, equipment and computer readable storage medium
CN107436725A (en) A kind of data are write, read method, apparatus and distributed objects storage cluster
CN104123238A (en) Data storage method and device
CN110018788A (en) It is classified storage method, device, electronic equipment and computer readable storage medium
CN109977129A (en) Multi-stage data caching method and equipment
US20100049937A1 (en) Volume record data set optimization apparatus and method
CN107239569A (en) A kind of distributed file system subtree storage method and device
CN105393228B (en) Read and write the method, apparatus and user equipment of data in flash memory
CN107632791A (en) The distribution method and system of a kind of memory space
CN109086462A (en) The management method of metadata in a kind of distributed file system
CN111737168A (en) Cache system, cache processing method, device, equipment and medium
CN110007870A (en) A kind of storage equipment write request processing method and relevant apparatus
CN107391050A (en) A kind of data migration method, system, device and computer-readable recording medium
CN110399096A (en) Metadata of distributed type file system caches the method, apparatus and equipment deleted again
CN105653209A (en) Object storage data transmitting method and device
CN109213450A (en) A kind of associated metadata delet method, device and equipment based on flash array
US11385900B2 (en) Accessing queue data
CN107506466A (en) A kind of small documents storage method and system
CN109299043A (en) The big file delet method of distributed cluster system, device, equipment and storage medium
CN109325001A (en) The method, device and equipment of small documents is deleted based on meta data server
CN111061652B (en) Nonvolatile memory management method and system based on MPI-IO middleware

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant