CN103902473A - Data processing method and data caching system - Google Patents

Data processing method and data caching system Download PDF

Info

Publication number
CN103902473A
CN103902473A CN201210590079.9A CN201210590079A CN103902473A CN 103902473 A CN103902473 A CN 103902473A CN 201210590079 A CN201210590079 A CN 201210590079A CN 103902473 A CN103902473 A CN 103902473A
Authority
CN
China
Prior art keywords
data block
spatial cache
data
temperature
access temperature
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201210590079.9A
Other languages
Chinese (zh)
Other versions
CN103902473B (en
Inventor
夏静霆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Shangge Intellectual Property Service Co ltd
Wuxi Suhui Information Technology Service Co ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201210590079.9A priority Critical patent/CN103902473B/en
Publication of CN103902473A publication Critical patent/CN103902473A/en
Application granted granted Critical
Publication of CN103902473B publication Critical patent/CN103902473B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Memory System Of A Hierarchy Structure (AREA)

Abstract

The embodiment of the invention discloses a data processing method and a data caching system, and is applied to the technical field of data processing. According to the method, the data caching system can determine first access temperatures of data blocks to be read in a memory space firstly, obtain a first radiation range according to the first access temperatures and then read the data blocks to be read and data blocks within the first radiation range into a caching space. The data caching system takes access heat degrees, namely the access temperatures, of the data blocks to be read and data blocks influenced by the data blocks to be read into consideration, data blocks equivalent to access frequency can be read into the caching space to the greatest extent, and therefore the hit rate of the caching space in a memory is improved and access efficiency of the system for input and output ports of the memory is improved.

Description

A kind of data processing method and data buffering system
Technical field
The present invention relates to technical field of data processing, particularly data processing method and data buffering system.
Background technology
Buffer memory (Cache) technology is common for improving the technology of data access speed in computer system, this technology improves the access efficiency of low-speed memory while being widely used between the different storer of speed swap data, common buffer memory application has central processing unit (Central Processing Unit, CPU) buffer memory and disk buffering.
Generally, in buffer memory, depositing stale data and pre-read data, the probability that data in buffer memory are used to is higher, the hit rate of buffer memory is higher, the lifting of the data access speed that buffer memory brings is also more obvious, therefore for the replacement of data in buffer memory with to look ahead be the key factor that determines buffer efficiency.Data cached looking ahead is at present mainly the access history by data, estimate and be about to data cached possible access mode, and according to the mode of estimating, data are read in buffer memory, but this method is dumb and adaptability is poor, makes the hit rate of buffer memory lower.
Summary of the invention
The embodiment of the present invention provides data processing method and data buffering system, improves the access efficiency of the IO interface of storer.
Embodiment of the present invention first aspect provides a kind of data processing method, is applied to the data processing of the storer to comprising spatial cache and storage space, comprising:
Determine the first initial access temperature of data block to be read in described storage space, described the first access temperature is used to indicate the access temperature to described data block to be read;
According to determining described the first initial access temperature, and the corresponding relation of preset access temperature and radiation scope, determine the first radiation scope of described data block to be read, described the first radiation scope is used to indicate other data block that described data block to be read has influence on;
By data block to be read described in described storage space, and multiple data blocks in described the first radiation scope read in described spatial cache.
In the possible implementation of the first of embodiment of the present invention first aspect, described method also comprises:
Set up the management information table of data block in described spatial cache, described data management information table comprises the binding information of each data block in described spatial cache, and described binding information comprises the positional information of data block in described spatial cache and the positional information in described storage space.
In conjunction with embodiment of the present invention first aspect, or the first of first aspect may implementation, and in the second implementation of the first aspect of the embodiment of the present invention, described method also comprises:
Record and upgrade the access temperature of data block in described spatial cache;
If the access temperature difference of the access temperature of the first data block and certain data block of periphery exceedes the first preset temperature difference, by the place-exchange of the second data block in described spatial cache and described the first data block, or by the 3rd data block in described spatial cache and the place-exchange of described the first data block;
The difference of the access temperature of described the second data block and the access temperature of described certain data block of periphery is within the scope of the second preset temperature difference; Described the 3rd data block is nearest with described perimeter data piece physically, and the data block nearest with described the first data block logically.
May implementation in conjunction with the second of embodiment of the present invention first aspect, in the third implementation of the first aspect of the embodiment of the present invention, described method also comprises:
By described the first data block storing in described storage space and the physical location of the second data block, or by the physical location exchange of described the first data block storing in described storage space and the 3rd data block.
May implementation or the third implementation in conjunction with the second of embodiment of the present invention first aspect, in the 4th kind of implementation of the first aspect of the embodiment of the present invention, in the described spatial cache of described renewal, the access temperature of data block specifically comprises:
When described data block accessed, the access temperature of the data block being accessed to described in increase;
Reach the preset time when the not accessed time of described data block, by the access temperature reduction of the described data block not being accessed to.
In conjunction with the second possibility implementation or the third implementation of embodiment of the present invention first aspect, in the 5th kind of implementation of the first aspect of the embodiment of the present invention, described by the second data block in described spatial cache or the 3rd data block, place-exchange with described the first data block also comprises before:
The described data block that need to exchange is labeled as and need to carries out place-exchange;
Trigger execution according to exchange trigger event described by the place-exchange of the second data block in described spatial cache and described the first data block, or by the step of the place-exchange of the 3rd data block in described spatial cache and described the first data block.
In conjunction with embodiment of the present invention first aspect, or the first of first aspect may implementation to the arbitrary implementation in five kinds of implementations, in the 6th kind of implementation of the first aspect of the embodiment of the present invention, described method also comprises:
When described spatial cache is full, replace and in described spatial cache, access temperature and/or the minimum data block of radiation temperature by data block new in described storage space.
In conjunction with embodiment of the present invention first aspect, or the first of first aspect may implementation to the arbitrary implementation in six kinds of implementations, in the 7th kind of implementation of the first aspect of the embodiment of the present invention, described method also comprises:
Determine the second access temperature of caching data block in described spatial cache;
According to the second access temperature of described caching data block, and preset access temperature and the corresponding relation of radiation scope, determine the second radiation scope of described caching data block;
According to described the second radiation scope, if need to be from described storage space read block, the data block in described the second radiation scope in described storage space is read in described spatial cache.
Embodiment of the present invention second aspect provides a kind of data buffering system, comprises storer, comprises spatial cache and storage space on described storer, and described system also comprises:
The first temperature determining unit, for the first access temperature of determining that described storage space data block to be read is initial, described the first access temperature is used to indicate the access temperature to described data block to be read;
The first scope determining unit, for the first access temperature of determining according to described the first temperature determining unit, and preset access temperature and the corresponding relation of radiation scope, determine the first radiation scope of described data block to be read, described the first radiation scope is used to indicate other data block that described data block to be read has influence on;
The first reading unit, for by described data block to be read, and multiple data blocks in the first radiation scope read in described spatial cache.
In the first implementation of embodiment of the present invention second aspect, described system also comprises:
Information table is set up unit, for setting up the management information table of data block, the management information table of described data block comprises the binding information of each data block in described spatial cache, and described binding information comprises the positional information of data block in described spatial cache and the positional information in described storage space.
In conjunction with the first implementation of embodiment of the present invention second aspect or second aspect, in the second implementation of embodiment of the present invention second aspect, described system also comprises:
Thermograph unit, for recording and upgrade the access temperature of described spatial cache data block;
The first crosspoint, if exceed the first preset temperature difference for the access temperature of the first data block and the access temperature difference of certain data block of periphery, by the place-exchange of the second data block in described spatial cache and described the first data block, or by the 3rd data block in described spatial cache and the place-exchange of described the first data block;
The difference of the access temperature of described the second data block and the access temperature of described certain data block of periphery is within the scope of the second preset temperature difference; Described the 3rd data block is nearest with described perimeter data piece physically, and the data block nearest with described the first data block logically.
In conjunction with the second implementation of embodiment of the present invention second aspect, in the third implementation of embodiment of the present invention second aspect, described system also comprises:
The second crosspoint, for by described the first data block storing in described storage space and the physical location of the second data block, or by the physical location exchange of described the first data block storing in described storage space and the 3rd data block.
In conjunction with the second or the third implementation of embodiment of the present invention second aspect, in the 4th kind of implementation of embodiment of the present invention second aspect:
Described thermograph unit, in the time that described data block is accessed, the access temperature of the data block being accessed to described in increase; Reach the preset time when the not accessed time of described data block, by the access temperature reduction of the described data block not being accessed to.
In conjunction with the second or the third implementation of embodiment of the present invention second aspect, in the 5th kind of implementation of embodiment of the present invention second aspect, described system also comprises:
Indexing unit, for being labeled as the described data block that need to exchange need to carry out place-exchange;
Described the first crosspoint, for triggering and carry out the place-exchange of the second data block of described spatial cache and described the first data block according to exchange trigger event, or by the step of the place-exchange of the 3rd data block in described spatial cache and described the first data block.
In conjunction with embodiment of the present invention second aspect, or arbitrary implementation in five kinds of implementations of the first to the of second aspect, in the 6th kind of implementation of embodiment of the present invention second aspect, described system also comprises:
Replacement unit, for when described spatial cache full, replace and in described spatial cache, access temperature and/or the minimum data block of radiation temperature by data block new in described storage space.
In conjunction with embodiment of the present invention second aspect, or arbitrary implementation in six kinds of implementations of the first to the of second aspect, in the 7th kind of implementation of embodiment of the present invention second aspect, described system also comprises:
The second temperature determining unit, for determining the second access temperature of described spatial cache caching data block;
The second scope determining unit, for according to the second access temperature of the definite caching data block of described the second temperature determining unit, and preset access temperature and the corresponding relation of radiation scope, determine the second radiation scope of described caching data block;
The second reading unit, for the second radiation scope of determining according to described the second scope determining unit, if need to be from described storage space read block, the data block in described the second radiation scope in described storage space is read in described spatial cache.
In the method for the embodiment of the present invention, data buffering system can first be determined the first access temperature of data block to be read in storage space, and obtain the first radiation scope according to the first access temperature, then this data block to be read and the multiple data blocks in the first radiation scope are read in spatial cache.In the present embodiment, data buffering system has considered that the access temperature for the treatment of read block access temperature, and other data block of having influence on of this data block to be read, can realize as far as possible data block suitable access frequency is read to spatial cache, thereby improve the hit rate of spatial cache in storer, and then improved the access efficiency of input and output (IO) interface of system to storer.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, to the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the structural representation of a kind of data buffering system of providing of the embodiment of the present invention;
Fig. 2 is the process flow diagram of a kind of data processing method of providing of the embodiment of the present invention;
Fig. 3 is the storage space of storer in the embodiment of the present invention and the structural representation of spatial cache storage data piece;
Fig. 4 is the indication schematic diagram of data block chained list in the embodiment of the present invention;
Fig. 5 is the process flow diagram of the another kind of data processing method that provides of the embodiment of the present invention;
Fig. 6 a is the schematic diagram that the embodiment of the present invention reads the data block in storage space spatial cache;
Fig. 6 b is the schematic diagram that the embodiment of the present invention increases data block in the spatial cache of storer;
Fig. 6 c is that the embodiment of the present invention is by the schematic diagram of data block exchange in the storage space of storer and spatial cache;
Fig. 7 is the process flow diagram of the another kind of data processing method that provides of the embodiment of the present invention;
Fig. 8 is the structural representation of a kind of data buffering system of providing of the embodiment of the present invention;
Fig. 9 is the structural representation of the another kind of data buffering system that provides of the embodiment of the present invention;
Figure 10 is the structural representation of the another kind of data buffering system that provides of the embodiment of the present invention;
Figure 11 is the structural representation of the another kind of data buffering system that provides of the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, rather than whole embodiment.Based on the embodiment in the present invention, those of ordinary skills, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
The embodiment of the present invention provides a kind of data processing method, be mainly used in data buffering system to comprising the data processing on the storer (such as disk etc. has the device of memory function) of spatial cache and storage space, shown in figure 1, comprise storer and processor at data buffering system, wherein processor can read the data block storing in the storage space of storer the spatial cache of storer, improves the data access efficiency of low-speed memory.
The method of the present embodiment is the performed method of processor in data buffering system, and method flow diagram as shown in Figure 2, comprising:
Step 101, determine the first initial access temperature of data block to be read in storage space, the access temperature of one of them data block is used to indicate the access temperature of this data block, the number of times that specifically can be accessed to by data block represents, or the changing value of the number of times being accessed to by data block represents, or the information such as the number of times being accessed to by data block and/or time of not having access to represents.
Be appreciated that, in each space of storer, carry out storage data take data block as least unit, the corresponding physical address of each data block, these data blocks can be according to physical address serial number, the physical distance of data block refers to the distance between the physical location that two data blocks deposit at storer, the absolute value of the difference of physical address that specifically can be by these two data blocks, or represent by the difference of physical address serial number.Wherein some data block is logically associated, multiple data blocks of association in logic can form a file, multiple data blocks corresponding same file can be carried out to serial number and are associated to same file like this, be file1-1 such as file f ile1 can become three data blocks, file1-2 and file1-3.The logical reach of data block refers to the distance between the logic of two data blocks of same file, specifically can represent with the absolute value of the difference of the numbering of these two data blocks.
In the time that system needs a certain data block (being data block to be read) in reference-to storage space, just need this data block to be read to read in spatial cache, data buffering system need to be first just that this data block to be read is determined a first initial access temperature, particularly:
If the capacity in spatial cache is enough, can directly set a first initial access temperature (such as 1) according to preset regulation, or set this first initial access temperature according to the historical record of accessing this data block to be read before data buffering system, if the number of times that in historical record, this is accessed to read block is higher, the first access temperature of determining in this step is also higher; If the capacity in spatial cache stores this data block to be read not, system need to be replaced a data block in spatial cache by this data block to be read, the access temperature of a data block in the spatial cache that the first initial this data block to be read access temperature can be defined as being replaced, or access temperature+1 of a data block in this spatial cache, or rule of thumb get other coefficient.
Step 102, according to the first access temperature and preset access temperature and the corresponding relation of radiation scope determined in step 101, determine the first radiation scope of above-mentioned data block to be read, this first radiation scope is used to indicate other data block that above-mentioned data block to be read has influence on, i.e. this data block to be read other data block that can which have influence on, here have influence on and refer to the impact during on the access of data block in system, this first radiation scope can with and this data block to be read between physical distance and/or logical reach represent, particularly, can represent by the number of data block etc.
In the present embodiment, an accessed temperature of data block can be weighed by above-mentioned access temperature, and the accessed temperature of at least one data block of this data block periphery can be weighed by the radiation temperature of this data block, wherein radiation temperature is because the access temperature of at least one data block of a data block periphery produces the radiation of this data block, the access temperature of perimeter data piece is higher, the radiation temperature of this data block is also higher, specifically can represent by the accessed number of times of perimeter data piece, such as perimeter data piece is accessed to once, the radiation temperature of this data block can add 1, the data block of one of them data block periphery refers at least one geographically adjacent with this data block data block, comprise the data block on this data block previous (or multiple) and rear (or multiple) physical location.
In data buffering system, can rule of thumb preset access temperature and this corresponding relation of corresponding relation of radiation scope and can be direct corresponding in exponential quantity, can also refer to function corresponding relation, such as corresponding relation is F=k (T), wherein F is radiation scope, k is experience factor, T is access temperature, and this corresponding relation is that radiation scope is the functional relation of experience factor and access temperature.In the time carrying out this step, data buffering system can be searched and obtain according to the first access temperature obtaining in step 101 from this preset corresponding relation, or calculates according to corresponding relation.The wherein higher larger radiation scope of access temperature correspondence, thinks that the probability that data block in radiation scope is accessed to also can be higher.
Step 103, by the data block to be read described in above-mentioned steps 101, and multiple data blocks in the first radiation scope read in the spatial cache of storer.
Wherein suppose the first radiation scope for and 0 between N data block, data buffering system can read multiple data blocks that physical distance between this data block to be read is less than N, or read multiple data blocks that logical reach between this data block to be read is less than N, or the logical reach reading between this data block to be read adds multiple data blocks that physical distance is less than N, or read logical reach between this data block to be read be less than N multiple data blocks and and this data block to be read between physical distance be less than multiple data blocks of N.
When the data block of storage space is read the spatial cache of storer by data buffering system, can deposit according to grouping, like this in the time that the data block of buffer memory is conducted interviews, just can be to the data block concurrent access of multiple groupings.For example, as shown in Figure 3, the spatial cache of storer can store 6 groups of data blocks, each grouping comprises 6 data blocks, if when 18 data blocks that store in storage space are read to spatial cache respectively, the physical location order that can store this multiple (18) data block according to storage space is stored in spatial cache, particularly, can be by data block 1, 7, 13 are stored in the first grouping, by data block 2, 8, 14 are stored in the second grouping, by data block 3, 9, 15 are stored in the 3rd grouping, by data block 4, 10, 16 are stored in the 4th grouping, by data block 5, 11, 17 are stored in the 5th grouping, by data block 6, 12, 18 are stored in the 6th grouping.
Further, for the data block that reads spatial cache is managed, data buffering system can also be set up the management information table of data block in spatial cache, and this management information table is the relevant information for storing data block in spatial cache, such as data block title etc.Can be specifically data block chained list or other forms of table etc., in data block chained list, each node represents a data block in spatial cache, and this data block chained list comprises the binding information of each node, this binding information can comprise the positional information of data block in spatial cache and the positional information in storage space, can also comprise data block logical number, physical location numbering, the positional information of other data block relevant to this data block logic in spatial cache, and the positional information of the perimeter data piece of this data block in storage space in spatial cache etc.Like this can be by a node in data block chained list, can point to data block and the data block relevant to this data block logic etc. of spatial cache.Example as shown in Figure 4, the data block that in node Inode corresponding stored device space in data block chained list, logical number is 2, this data block 2 saves as the 4th data block of spatial cache the 2nd grouping, and logically the data block 1 and 3 relevant and adjacent to this data block 2 saves as respectively the 2nd data block and the 3rd the 5th data block of dividing into groups of the 1st grouping in spatial cache.
Visible, in the method for the embodiment of the present invention, data buffering system can first be determined the first access temperature of data block to be read in storage space, and obtain the first radiation scope according to the first access temperature, then this data block to be read and the multiple data blocks in the first radiation scope are read in spatial cache.In the present embodiment, data buffering system has considered that the access temperature for the treatment of read block access temperature, and other data block of having influence on of this data block to be read, can realize as far as possible data block suitable access frequency is read to spatial cache, thereby improve the hit rate of spatial cache in storer, and then improved the access efficiency of input and output (IO) interface of system to storer.
Shown in figure 5, in a specific embodiment, data buffering system, except carrying out above-mentioned steps 101 to 103, also comprises and carries out following step, dynamically upgrade the position of data block in spatial cache, guarantee that the suitable data block of access frequency intensively stores in spatial cache:
Step 104, record and upgrade the access temperature of data block in spatial cache, data buffering system needs access temperature and the radiation temperature of each data block in record buffer memory space, and after each data block is accessed, upgrade the access temperature of accessed data block, on the former basis that visits temperature, add 1, and the radiation temperature that need to upgrade accessed data block perimeter data piece adds 1 on the basis of original radiation temperature.Can weigh the temperature of a data block by above-mentioned access temperature, in other specific embodiment, the temperature of data block is also relevant with the time, arrive the preset time when the not accessed time of data block in spatial cache, data buffering system can be by the access temperature of this data block and radiation temperature reduction, and the radiation temperature of the data block of this data block periphery also can be reduced, and reduction was directly proportional to the time.
Step 105, judge that the access temperature of a certain data block in spatial cache (i.e. the first data block) and certain data block of periphery are (in spatial cache on a last and/or rear physical location, or data block on front n and/or rear m physical location) access temperature difference whether looked into the first preset temperature difference, if exceeded, perform step 106, if do not exceeded, can repeat above-mentioned steps 104.
Step 106, by the place-exchange of the second data block in spatial cache and the first data block, or by the 3rd data block in spatial cache and the place-exchange of the first data block.The difference of the access temperature of the access temperature of this second data block and above-mentioned first certain data block of data block periphery is within the scope of the second preset temperature difference, together with being aggregated to certain data block of the first data block periphery by the second suitable data block of access temperature, the physical location of this second data block and the first data block can differ far away; The 3rd data block is nearest with above-mentioned first certain data block of data block periphery physically, and the data block nearest with the first data block logically.By the exchange of this step, can realize and working as and the increase of distant and close together in logic physically another data block of the first data block due to access times, its access temperature has exceeded while closing on physically the radiation temperature of the but incoherent perimeter data piece of logic with the first data block, can be by the first data block and another data block switch.
Data block suitable temperature can be aggregated to together by above-mentioned step 104 to 106, because system is after closing, data block on spatial cache can be lost, can remember for after restarting in system the data block that this temperature is suitable, not only need to perform step 106 at data buffering system, also need further according to the exchange in step 106, by the physical location exchange of two data blocks of the needs exchange storing in the storage space of storer, be the first data block of storing in storage space and the physical location of the second data block, or by the physical location exchange of the first data block storing in storage space and the 3rd data block.System, after restarting, can directly read data block in spatial cache according to the storage order of data block in storage space like this.
It should be noted that, in the time of the swap operation of execution step 106, can place-exchange physical location exchange in spatial cache by two data blocks (i.e. the first data block and the second data block, or the first data block and the 3rd data block) of needs exchange will need to be carried out immediately; Or first the data block of needs exchanges is labeled as and need to carries out place-exchange, and the information can also mark exchanging with which data block, and according to exchange trigger event trigger the data block of mark carry out step 106 in the operation that exchanges of physical location.Wherein exchange trigger event and comprise that the load of data buffering system is lower, or the number of the data block of mark exceedes threshold value, or in system, other process finishes or unlatching etc.Further, when after execution of step 106, because the data block of data block (above-mentioned the second data block or the 3rd data block) periphery after exchange changes, and the access temperature of data block after this exchange from exchanged after data block (above-mentioned the first data block) and the access temperature of perimeter data piece different, data block and the radiation that is subject to of perimeter data piece thereof after exchange are changed, data buffering system also needs to redefine the radiation temperature of the data block of data block after exchange and periphery thereof, particularly, the radiation temperature that can be the data block of the second data block or the 3rd data block periphery by the data block after exchanging is updated to the access temperature of the data block after exchange, the radiation temperature of the data block after this exchange is upgraded to the access temperature of certain data block of rear perimeter edge etc., and also need to upgrade the management information table of data block in the spatial cache of above-mentioned foundation.
Above-mentioned steps 106 is mainly to carry out swap data piece according to access temperature difference, in another specific embodiment, in spatial cache, the exchange of the physical location of data block can also be according to other aggregation strategy, such as the data block of close together is in logic aggregated to together, or radiation temperature differs nearer data block and is aggregated to together etc.Final make as much as possible in spatial cache the physical distance between data block that two access temperature are higher consistent with logical reach, that is to say, as much as possible the data block of same file in spatial cache (data block that logic is relevant) is exchanged to together, while storer being carried out to data access due to system again, directly the data block in the spatial cache of storer is conducted interviews, the data block reading like this in spatial cache is all the data block that access temperature is higher and accessed probability is very large, thereby improve the hit rate of the spatial cache of storer, make the access efficiency of the IO interface of system to storer higher, if the data block in storage space is carried out after polymerization according to the data block of spatial cache, making the data block of storage space is continuous mostly, has improved the access speed of the IO interface of this storer itself simultaneously.
In other specific embodiment, data buffering system is except carrying out above-mentioned steps 101 to 106, can also carry out following operation: in the time that spatial cache is expired, if new data block need to be read to spatial cache time, data buffering system can be replaced in spatial cache and access temperature and/or the minimum data block of radiation temperature by new data block, and the access temperature that this new data block can also be set is greater than the access temperature of the data block that is replaced out spatial cache; And according to the access temperature of this new data block, the radiation temperature that resets new data block perimeter data piece is greater than the access temperature of the data block that is replaced out spatial cache.In addition, also need information that data block new to this in the management information table of new data block is more relevant etc.
Example as shown in Figure 6 a, the Fi1e1-1 that the data block comprising in storage space is correlated with is in logic to Fi1e1-5, data block File2-2 is to File2-6, and data block File3-4 etc., if data block File1-3 need to be read to spatial cache, the radiation scope of supposing this data block File1-3 is 1, can be by the data block File1-2 and the File2-2 that are 1 with the physical distance of data block File1-3 in storage space, and read in spatial cache according to the order in storage space with the data block File1-4 that the logical reach of data block File1-3 is 1.Example as shown in Figure 6 b, along with the access to data block File1-3, the access temperature of this data block File1-3 raises, and radiation scope corresponding to this access temperature increases, and the data block File1-1 in the radiation scope of increase, File2-3 and File1-5 can be read in spatial cache subsequently.For example, shown in Fig. 6 c, along with the access to data block in spatial cache, when the temperature of data block File1-4 raises, physical location exchange by data block File1-4 in spatial cache and storage space with the data block File2-3 close to from data block File1-3, this data block File2-3 is because the radiation area away from data block File1-3 can preferentially be replaced out spatial cache.
Visible, the method for reading data of a kind of access temperature based on data block (weighing by access temperature) has been proposed in the embodiment of the present invention, make to access the data block that temperature is higher and condense together in spatial cache, improved the hit rate of spatial cache; If the data block simultaneously in storage space along with the data block in buffer space, polymerization makes the data block in storage space mostly continuous, finally make the access of storer continuously, improved the access efficiency of the IO interface of storer; And utilize the access hot statistics to data block in spatial cache, dynamically adjust the position of data block in spatial cache, make system can improve according to practical operation situation the data access efficiency of storer.Method in above-described embodiment can, for promoting the performance of storer in unit, equally also can be used group system and improve the access efficiency of group system to hot spot data in addition.
It should be noted that, after above-mentioned steps 101 to 103, in process spatial cache data block being conducted interviews at data buffering system, shown in figure 7, in another specific embodiment, due to the change of the access temperature of data block in spatial cache, its radiation scope also can change, and determines whether at any time to have new data block to read in spatial cache from storage space according to the variation of radiation scope.Particularly, data buffering system can also be carried out following steps read block from storage space:
Step 107, determines the second access temperature of caching data block in spatial cache, and this second access temperature is used to indicate the access temperature to this caching data block.
Step 108, according to the second access temperature of caching data block definite in step 107, and preset access temperature and the corresponding relation of radiation scope in system, determine the second radiation scope of caching data block, this second radiation scope is used to indicate other data block that this caching data block has influence on, i.e. this caching data block other data block that can which have influence on, here have influence on and refer to the impact during on the access of data block in system, specifically can with and this caching data block between physical distance and/or logical reach represent.Above-mentioned the first and second radiation scopes, and not order of representation relation of the first and second access temperature, but represent different radiation scopes and different access temperature values; And determine that the method for the second radiation scope and definite method of above-mentioned the first radiation scope are similar, do not repeat at this here.
Step 109, according to the second radiation scope of determining in step 108, if need to be from storage space read block, such as be greater than the data block number of this caching data block periphery in current cache space when the number of data block in this second radiation scope, need to be from storage space read block, data buffering system can read the data block in the second radiation scope in spatial cache.Can pass through like this step 107 to 109, dynamically change the data block in spatial cache.
The embodiment of the present invention also provides a kind of data buffering system, and its structural representation as shown in Figure 8, comprising: storer 10, on storer 10, comprise spatial cache 110 and storage space 120, and this system can also comprise:
The first temperature determining unit 20, for determining the first access temperature of described storage space 120 data blocks to be read, described the first access temperature is used to indicate the access temperature to described data block to be read.
The first scope determining unit 21, for the first access temperature of determining according to described the first temperature determining unit 20, and preset access temperature and the corresponding relation of radiation scope, determine the first radiation scope of described data block to be read, described the first radiation scope is used to indicate other data block that described data block to be read has influence on.
The first reading unit 22, for by described storage space 120 data block to be read, and multiple data blocks in the first radiation scope of determining in described the first scope determining unit 21 read in described spatial cache 110.
Visible, in the data buffering system of the embodiment of the present invention, the first temperature determining unit 20 can first be determined the first access temperature of data block to be read, and obtain the first radiation scope by the first scope determining unit 21 according to the first access temperature, then the first reading unit 22 reads data block to be read and the data block in the first radiation scope in spatial cache 110.In the present embodiment, data buffering system has been considered i.e. the first access temperature of temperature for the treatment of reading out data block access, and the data block that has influence on of this data block to be read, can realize as far as possible data block suitable access frequency is read to spatial cache, thereby improve the hit rate of spatial cache in storer, and then improved the access efficiency of the IO interface of system to storer.
Shown in figure 9, in a specific embodiment, data buffering system is except comprising structure as shown in Figure 8, can also comprise that information table sets up unit 23, thermograph unit 24, the first crosspoint 25, the second crosspoint 26, indexing unit 27 and replacement unit 28, wherein:
Information table is set up unit 23, for setting up the management information table of spatial cache 110 data blocks, a data block in described management information table in the corresponding spatial cache 110 of each node, and in management information table, can comprise the binding information of each data block in described spatial cache 110, described binding information comprises the positional information of data block in described spatial cache 110 and the positional information in described storage space 120, can also comprise data block logical number, physical location numbering, the positional information of other data block relevant to this data block logic in spatial cache 110, and the positional information of the perimeter data piece of this data block in storage space 120 in spatial cache etc.
Thermograph unit 24, for recording and upgrade the access temperature of spatial cache 110 data blocks, thermograph unit 24 can be in the time that data block initial read be got spatial cache 110 particularly, record the first initial access temperature, and data block in spatial cache 110 is when accessed, the access temperature of the data block being accessed to described in increase; Reach the preset time when the not accessed time of described data block, by the access temperature reduction of the described data block not being accessed to, and reduction was directly proportional to the time not being accessed to.And the radiation temperature of data block in these 24 all right record buffer memory spaces 110, thermograph unit, concrete recording method can, referring to described in said method embodiment, not repeat at this.
The first crosspoint 25, if the access temperature of the first data block and the access temperature difference of certain data block of periphery that record for thermograph unit 24 exceed the first preset temperature difference, by the place-exchange of the second data block in described spatial cache 110 and described the first data block, or by the 3rd data block in described spatial cache and the place-exchange of described the first data block; The difference of the access temperature of described the second data block and the access temperature of described certain data block of periphery is within the scope of the second preset temperature difference; Described the 3rd data block is nearest with described perimeter data piece physically, and the data block nearest with described the first data block logically.This first crosspoint 25 can also be according to other aggregation strategy to the physical location exchange of data block in spatial cache 110, and such as the data block of close together is in logic aggregated to together, or radiation temperature differs nearer data block and be aggregated to together etc.
The second crosspoint 26, be used for according to the exchange of the first crosspoint 25, correspondingly by described the first data block storing in described storage space 120 and the physical location of the second data block, or by the physical location exchange of described the first data block storing in described storage space 120 and the 3rd data block, such as the first crosspoint 25 is by the place-exchange of data block in spatial cache 1 and 4, the second crosspoint 26 can be by the place-exchange of data block in storage space 120 1 and 4.
Indexing unit 27, for the data block of needs exchange is labeled as and need to carries out place-exchange, and the information of the data block of all right mark and the exchange of each data block.
Replacement unit 28, for when described spatial cache 110 full, replace and in described spatial cache 110, access temperature and/or the minimum data block of radiation temperature by new data block in described storage space 120.This replacement unit 28 can also be after replacement, trigger access temperature and radiation temperature that thermograph unit 24 upgrades this new data block, and the information such as the radiation temperature of the data block of this new data block periphery, the concrete method of upgrading is referring to described in said method embodiment, and can set up the relevant information of data block new to this in unit 23 lastest imformation admin tables by trigger message table.
In the system of the present embodiment, can the data block in storage space 120 be read after spatial cache 110 by the first temperature determining unit 20, the first scope determining unit 21 and the first reading unit 22, information table is set up unit 23 and can set up the management information table of data block in spatial cache 110, is convenient to the data block in spatial cache 110 to manage.
Data buffering system to spatial cache 110 in the access process of data block, the access temperature that can directly be recorded according to thermograph unit 24 by the first crosspoint 25 be carried out the data block in cache exchanging space 110; Also can be first to need the data block of exchange to carry out mark by indexing unit 27, and then it is described by the second data block in spatial cache 110 or the 3rd data block to trigger execution by the first crosspoint 25 according to exchange trigger event, place-exchange with described the first data block, and other data blocks that trigger the needs exchange to 27 marks of indexing unit are carried out place-exchange, wherein exchange trigger event and comprise that the load of data buffering system is lower, or the number of the data block of 27 marks of indexing unit exceedes threshold value, or in system, other process finishes or unlatching etc.Simultaneously, in order to make system can remember the position of the stored data block of the spatial cache 110 of current storage after restarting, the second crosspoint 26 also needs the data block in storage space 120 to carry out corresponding place-exchange.
Carry out after place-exchange at the first crosspoint 25, can trigger the radiation temperature that thermograph unit 24 upgrades the data block of data block (being above-mentioned the second data block or the 3rd data block) periphery after this exchange, and the information such as the radiation temperature of data block after this exchange, and can trigger message table set up unit 23 more in the management information table of new data block to data block after exchange and with exchanged data block relevant information.
Shown in Figure 10, in a specific embodiment, data buffering system, except comprising structure as shown in Figure 8, can also comprise the second temperature determining unit 29, the second scope determining unit 30 and the second reading unit 31, wherein:
Due to the access of data buffering system to data in spatial cache 110, make the access temperature change of data block in above-mentioned spatial cache 110, above-mentioned the second temperature determining unit 29, for timing or not timing determine spatial cache 110 caching data blocks second access temperature; And the second scope determining unit 30 can also be according to the second access temperature of caching data block in the definite spatial cache of the second temperature determining unit 29, and preset access temperature and the corresponding relation of radiation scope, determine the second radiation scope of caching data block; And the second radiation scope that the second reading unit 12 can also be determined according to the second scope determining unit 30, if need to read new data block from storage space 120, the data block in the second radiation scope in storage space 120 is read in described spatial cache 110.Can dynamically change the data block in spatial cache by the second temperature determining unit 29, the second scope determining unit 30 and the second reading unit 31 like this.
The embodiment of the present invention also provides another kind of data buffering system, and structural representation as shown in figure 11, comprises the storer 40, processor 41, input media 43 and the output unit 44 that are connected respectively in bus, wherein:
In storer 40, be used for storing the data inputted from input media 43, and can also store the information such as necessary file of processor 41 deal with data, in the present embodiment, storer 40 comprises storage space and spatial cache;
Input media 43 and output unit 44 are ports of data buffering system and other devices communicatings, can also comprise that the external output device of data buffering system is such as display, keyboard, mouse and printer etc., wherein input media 43 can comprise mouse and keyboard etc., and output unit 44 comprises display etc.;
Processor 41 in the present embodiment can be for determining the first access temperature of data block to be read in described storage space, and described the first access temperature is used to indicate the access temperature to described data block to be read; Determine according to described the first definite access temperature, and preset access temperature and the corresponding relation of radiation scope, the first radiation scope of described data block to be read, described the first radiation scope is used to indicate other data block that described data block to be read has influence on; By described data block to be read, and multiple data blocks in described the first radiation scope read in described spatial cache.For the convenient management to data in spatial cache, processor 41 can also be set up the management information table of data block in spatial cache, described management information table comprises the binding information of each data block in described spatial cache, and described binding information comprises the information such as the positional information of data block in described spatial cache and the positional information in described storage space.
Further, in the accessed process of data block in spatial cache, processor 41 can also be determined the second access temperature of caching data block in described spatial cache; And according to the second access temperature of definite caching data block, and preset access temperature and the corresponding relation of radiation scope, determine the second radiation scope of described caching data block; Then according to the second radiation scope of determining, if need to read new data block from described storage space, the data block in described the second radiation scope in described storage space is read in described spatial cache.The access situation to data block according to system reality, has dynamically adjusted the data block in spatial cache like this.
Further, processor 41 can also record and upgrade the access temperature of data block in described spatial cache, particularly, upgrading access when temperature, when described data block accessed, the access temperature of the data block being accessed to described in increase; Reach the preset time when the not accessed time of described data block, by access temperature reduction of the described data block not being accessed to etc.; If the access temperature difference of the access temperature of the first data block and certain data block of periphery exceedes the first preset temperature difference, processor 41 can also be by the place-exchange of the second data block in described spatial cache and described the first data block, or by the 3rd data block in described spatial cache and the place-exchange of described the first data block; The difference of the access temperature of described the second data block and the access temperature of described certain data block of periphery is within the scope of the second preset temperature difference; Described the 3rd data block is nearest with described perimeter data piece physically, and the data block nearest with described the first data block logically.Simultaneous processor 41 can be according to the exchange to data block in spatial cache, by described the first data block storing in described storage space and the physical location of the second data block, or by the physical location exchange of described the first data block storing in described storage space and the 3rd data block.
In another case, processor 41 can first be labeled as the described data block that need to exchange need to carry out place-exchange, then trigger and carry out the place-exchange of the second data block in described spatial cache and described the first data block according to exchange trigger event, or by the step of the place-exchange of the 3rd data block in described spatial cache and described the first data block, and also need the place-exchange of all data blocks of carrying out mark.After in to spatial cache, data block exchanges, processor 41 also needs to occur in more newly-established management information table the information of the data block of exchange, and also needs to redefine the radiation temperature of the rear data block of exchange and perimeter data piece thereof.
Further, it is full that processor 41 can also be worked as described spatial cache, replaces and in described spatial cache, access temperature and/or the minimum data block of radiation temperature by data block new in described storage space.And processor 41 also needs to determine and record radiation temperature and the access temperature of this new data block, and the information such as the radiation temperature of the data block of this new data block periphery, and in management information table the data block new to this and with the data block being replaced relevant information etc.
One of ordinary skill in the art will appreciate that all or part of step in the whole bag of tricks of above-described embodiment is can carry out the hardware that instruction is relevant by program to complete, this program can be stored in a computer-readable recording medium, and storage medium can comprise: ROM (read-only memory) (ROM), random access memory (RAM), disk or CD etc.
The data processing method and the data buffering system that above the embodiment of the present invention are provided are described in detail, applied specific case herein principle of the present invention and embodiment are set forth, the explanation of above embodiment is just for helping to understand method of the present invention and core concept thereof; , for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention meanwhile.

Claims (16)

1. a data processing method, is characterized in that, is applied to the data processing of the storer to comprising spatial cache and storage space, comprising:
Determine the first initial access temperature of data block to be read in described storage space, described the first access temperature is used to indicate the access temperature to described data block to be read;
According to determining described the first initial access temperature, and the corresponding relation of preset access temperature and radiation scope, determine the first radiation scope of described data block to be read, described the first radiation scope is used to indicate other data block that described data block to be read has influence on;
By data block to be read described in described storage space, and multiple data blocks in described the first radiation scope read in described spatial cache.
2. the method for claim 1, is characterized in that, described method also comprises:
Set up the management information table of data block in described spatial cache, described data management information table comprises the binding information of each data block in described spatial cache, and described binding information comprises the positional information of data block in described spatial cache and the positional information in described storage space.
3. method as claimed in claim 1 or 2, is characterized in that, described method also comprises:
Record and upgrade the access temperature of data block in described spatial cache;
If the access temperature difference of the access temperature of the first data block and certain data block of periphery exceedes the first preset temperature difference, by the place-exchange of the second data block in described spatial cache and described the first data block, or by the 3rd data block in described spatial cache and the place-exchange of described the first data block;
The difference of the access temperature of described the second data block and the access temperature of described certain data block of periphery is within the scope of the second preset temperature difference; Described the 3rd data block is nearest with described perimeter data piece physically, and the data block nearest with described the first data block logically.
4. method as claimed in claim 3, is characterized in that, described method also comprises:
By described the first data block storing in described storage space and the physical location of the second data block, or by the physical location exchange of described the first data block storing in described storage space and the 3rd data block.
5. the method as described in claim 3 or 4, is characterized in that, in the described spatial cache of described renewal, the access temperature of data block specifically comprises:
When described data block accessed, the access temperature of the data block being accessed to described in increase;
Reach the preset time when the not accessed time of described data block, by the access temperature reduction of the described data block not being accessed to.
6. the method as described in claim 3 or 4, is characterized in that, described by the second data block in described spatial cache or the 3rd data block, the place-exchange with described the first data block also comprises before:
The described data block that need to exchange is labeled as and need to carries out place-exchange;
Trigger execution according to exchange trigger event described by the place-exchange of the second data block in described spatial cache and described the first data block, or by the step of the place-exchange of the 3rd data block in described spatial cache and described the first data block.
7. the method as described in claim 1 to 5 any one, is characterized in that, described method also comprises:
When described spatial cache is full, replace and in described spatial cache, access temperature and/or the minimum data block of radiation temperature by data block new in described storage space.
8. the method as described in claim 1 to 7 any one, is characterized in that, described method also comprises:
Determine the second access temperature of caching data block in described spatial cache;
According to the second access temperature of described caching data block, and preset access temperature and the corresponding relation of radiation scope, determine the second radiation scope of described caching data block;
According to described the second radiation scope, if need to be from described storage space read block, the data block in described the second radiation scope in described storage space is read in described spatial cache.
9. a data buffering system, is characterized in that, comprises storer, comprises spatial cache and storage space on described storer, and described system also comprises:
The first temperature determining unit, for the first access temperature of determining that described storage space data block to be read is initial, described the first access temperature is used to indicate the access temperature to described data block to be read;
The first scope determining unit, for the first access temperature of determining according to described the first temperature determining unit, and preset access temperature and the corresponding relation of radiation scope, determine the first radiation scope of described data block to be read, described the first radiation scope is used to indicate other data block that described data block to be read has influence on;
The first reading unit, for by described data block to be read, and multiple data blocks in the first radiation scope read in described spatial cache.
10. system as claimed in claim 9, is characterized in that, described system also comprises:
Information table is set up unit, for setting up the management information table of data block, the management information table of described data block comprises the binding information of each data block in described spatial cache, and described binding information comprises the positional information of data block in described spatial cache and the positional information in described storage space.
11. systems as described in claim 9 or 10, is characterized in that, described system also comprises:
Thermograph unit, for recording and upgrade the access temperature of described spatial cache data block;
The first crosspoint, if exceed the first preset temperature difference for the access temperature of the first data block and the access temperature difference of certain data block of periphery, by the place-exchange of the second data block in described spatial cache and described the first data block, or by the 3rd data block in described spatial cache and the place-exchange of described the first data block;
The difference of the access temperature of described the second data block and the access temperature of described certain data block of periphery is within the scope of the second preset temperature difference; Described the 3rd data block is nearest with described perimeter data piece physically, and the data block nearest with described the first data block logically.
12. systems as claimed in claim 11, is characterized in that, described system also comprises:
The second crosspoint, for by described the first data block storing in described storage space and the physical location of the second data block, or by the physical location exchange of described the first data block storing in described storage space and the 3rd data block.
13. systems as described in claim 11 or 12, is characterized in that, described thermograph unit, and in the time that described data block is accessed, the access temperature of the data block being accessed to described in increase; Reach the preset time when the not accessed time of described data block, by the access temperature reduction of the described data block not being accessed to.
14. systems as described in claim 11 or 12, is characterized in that, described system also comprises:
Indexing unit, for being labeled as the described data block that need to exchange need to carry out place-exchange;
Described the first crosspoint, for triggering and carry out the place-exchange of the second data block of described spatial cache and described the first data block according to exchange trigger event, or by the step of the place-exchange of the 3rd data block in described spatial cache and described the first data block.
15. systems as described in claim 9 to 14 any one, is characterized in that, described system also comprises:
Replacement unit, for when described spatial cache full, replace and in described spatial cache, access temperature and/or the minimum data block of radiation temperature by data block new in described storage space.
16. systems as described in claim 9 to 15 any one, is characterized in that, also comprise:
The second temperature determining unit, for determining the second access temperature of described spatial cache caching data block;
The second scope determining unit, for according to the second access temperature of the definite caching data block of described the second temperature determining unit, and preset access temperature and the corresponding relation of radiation scope, determine the second radiation scope of described caching data block;
The second reading unit, for the second radiation scope of determining according to described the second scope determining unit, if need to be from described storage space read block, the data block in described the second radiation scope in described storage space is read in described spatial cache.
CN201210590079.9A 2012-12-31 2012-12-31 A kind of data processing method and data buffering system Expired - Fee Related CN103902473B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210590079.9A CN103902473B (en) 2012-12-31 2012-12-31 A kind of data processing method and data buffering system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210590079.9A CN103902473B (en) 2012-12-31 2012-12-31 A kind of data processing method and data buffering system

Publications (2)

Publication Number Publication Date
CN103902473A true CN103902473A (en) 2014-07-02
CN103902473B CN103902473B (en) 2018-07-03

Family

ID=50993807

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210590079.9A Expired - Fee Related CN103902473B (en) 2012-12-31 2012-12-31 A kind of data processing method and data buffering system

Country Status (1)

Country Link
CN (1) CN103902473B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104182514A (en) * 2014-08-21 2014-12-03 杭州华为数字技术有限公司 Replacing method and terminal
CN104320448A (en) * 2014-10-17 2015-01-28 张维加 Method and device for accelerating caching and prefetching of computing device based on big data
CN107168652A (en) * 2017-05-19 2017-09-15 郑州云海信息技术有限公司 A kind of method of lifting SSD Cache reading performances
CN107329908A (en) * 2017-07-07 2017-11-07 联想(北京)有限公司 A kind of data processing method and electronic equipment
CN110990300A (en) * 2019-12-20 2020-04-10 山东方寸微电子科技有限公司 Cache memory replacement method and system based on use heat
CN111881096A (en) * 2020-07-24 2020-11-03 北京浪潮数据技术有限公司 File reading method, device, equipment and storage medium
CN112328513A (en) * 2020-10-14 2021-02-05 合肥芯碁微电子装备股份有限公司 Scanning type exposure system and data caching and scheduling method and device thereof
CN113608685A (en) * 2021-06-30 2021-11-05 济南浪潮数据技术有限公司 Hot spot identification method and system of distributed storage block device
CN118170327A (en) * 2024-05-14 2024-06-11 苏州元脑智能科技有限公司 Solid state disk address mapping method, device and product

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5446861A (en) * 1979-06-04 1995-08-29 Unisys Corporation Variable data rate improvement of disc cache subsystem
WO2001046809A1 (en) * 1999-12-20 2001-06-28 Telefonaktiebolaget Lm Ericsson (Publ) Caching of objects in disk-based databases
CN102314397A (en) * 2011-09-23 2012-01-11 浙江大学 Method for processing cache data block
CN102511043A (en) * 2011-11-26 2012-06-20 华为技术有限公司 Method for replacing cache files, device and system thereof
CN102523279A (en) * 2011-12-12 2012-06-27 云海创想信息技术(无锡)有限公司 Distributed file system and hot file access method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5446861A (en) * 1979-06-04 1995-08-29 Unisys Corporation Variable data rate improvement of disc cache subsystem
WO2001046809A1 (en) * 1999-12-20 2001-06-28 Telefonaktiebolaget Lm Ericsson (Publ) Caching of objects in disk-based databases
CN102314397A (en) * 2011-09-23 2012-01-11 浙江大学 Method for processing cache data block
CN102511043A (en) * 2011-11-26 2012-06-20 华为技术有限公司 Method for replacing cache files, device and system thereof
CN102523279A (en) * 2011-12-12 2012-06-27 云海创想信息技术(无锡)有限公司 Distributed file system and hot file access method thereof

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104182514A (en) * 2014-08-21 2014-12-03 杭州华为数字技术有限公司 Replacing method and terminal
CN104182514B (en) * 2014-08-21 2018-02-06 杭州华为数字技术有限公司 A kind of method of replacing and terminal
CN104320448A (en) * 2014-10-17 2015-01-28 张维加 Method and device for accelerating caching and prefetching of computing device based on big data
CN104320448B (en) * 2014-10-17 2019-11-01 张维加 A kind of caching of the calculating equipment based on big data and prefetch acceleration method and device
CN107168652A (en) * 2017-05-19 2017-09-15 郑州云海信息技术有限公司 A kind of method of lifting SSD Cache reading performances
CN107329908A (en) * 2017-07-07 2017-11-07 联想(北京)有限公司 A kind of data processing method and electronic equipment
CN110990300A (en) * 2019-12-20 2020-04-10 山东方寸微电子科技有限公司 Cache memory replacement method and system based on use heat
CN110990300B (en) * 2019-12-20 2021-12-14 山东方寸微电子科技有限公司 Cache memory replacement method and system based on use heat
CN111881096A (en) * 2020-07-24 2020-11-03 北京浪潮数据技术有限公司 File reading method, device, equipment and storage medium
CN111881096B (en) * 2020-07-24 2022-06-17 北京浪潮数据技术有限公司 File reading method, device, equipment and storage medium
CN112328513A (en) * 2020-10-14 2021-02-05 合肥芯碁微电子装备股份有限公司 Scanning type exposure system and data caching and scheduling method and device thereof
CN112328513B (en) * 2020-10-14 2024-02-02 合肥芯碁微电子装备股份有限公司 Scanning exposure system and data caching and scheduling method and device thereof
CN113608685A (en) * 2021-06-30 2021-11-05 济南浪潮数据技术有限公司 Hot spot identification method and system of distributed storage block device
CN113608685B (en) * 2021-06-30 2024-06-14 济南浪潮数据技术有限公司 Hot spot identification method and system for distributed storage block equipment
CN118170327A (en) * 2024-05-14 2024-06-11 苏州元脑智能科技有限公司 Solid state disk address mapping method, device and product

Also Published As

Publication number Publication date
CN103902473B (en) 2018-07-03

Similar Documents

Publication Publication Date Title
CN103902473A (en) Data processing method and data caching system
CN107526546B (en) Spark distributed computing data processing method and system
CN104115133B (en) For method, system and the equipment of the Data Migration for being combined non-volatile memory device
KR101502896B1 (en) Distributed memory cluster control apparatus and method using map reduce
CN108139902A (en) The method and apparatus of SSD drive are accessed for providing mixed mode
CN105095116A (en) Cache replacing method, cache controller and processor
CN104462240A (en) Method and system for realizing hierarchical storage and management in cloud storage
CN102314397B (en) Method for processing cache data block
CN110795363B (en) Hot page prediction method and page scheduling method of storage medium
CN103984648A (en) Method to throttle rate of data caching for improved I/O performance
CN104571954B (en) A kind of date storage method and device
CN104503703B (en) The treating method and apparatus of caching
CN106354431A (en) Data storage method and device
CN101694640B (en) Method for realizing replacement policies of shared second-level cache under multi-core architecture
US20190004968A1 (en) Cache management method, storage system and computer program product
CN104991743B (en) Loss equalizing method applied to solid state hard disc resistance-variable storing device caching
CN101510176A (en) Control method of general-purpose operating system for accessing CPU two stage caching
CN104077242A (en) Cache management method and device
CN109086141A (en) EMS memory management process and device and computer readable storage medium
CN103942161A (en) Redundancy elimination system and method for read-only cache and redundancy elimination method for cache
CN110532200B (en) Memory system based on hybrid memory architecture
CN102354301B (en) Cache partitioning method
CN102521161B (en) Data caching method, device and server
CN104504076A (en) Method for implementing distributed caching with high concurrency and high space utilization rate
CN109947669A (en) The address conversion method and system of KV storage equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20200615

Address after: 214000 b333, China Sensor Network International Innovation Park, No.200 Linghu Avenue, Taihu International Science and Technology Park, Xinwu District, Wuxi City, Jiangsu Province

Patentee after: Wuxi Suhui Information Technology Service Co.,Ltd.

Address before: 625, room 269, Connaught platinum Plaza, No. 518101, Qianjin Road, Xin'an street, Shenzhen, Guangdong, Baoan District

Patentee before: SHENZHEN SHANGGE INTELLECTUAL PROPERTY SERVICE Co.,Ltd.

Effective date of registration: 20200615

Address after: 625, room 269, Connaught platinum Plaza, No. 518101, Qianjin Road, Xin'an street, Shenzhen, Guangdong, Baoan District

Patentee after: SHENZHEN SHANGGE INTELLECTUAL PROPERTY SERVICE Co.,Ltd.

Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd.

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180703

Termination date: 20211231