CN103927136B - Identification method and device for input and output IO types - Google Patents
Identification method and device for input and output IO types Download PDFInfo
- Publication number
- CN103927136B CN103927136B CN201410160560.3A CN201410160560A CN103927136B CN 103927136 B CN103927136 B CN 103927136B CN 201410160560 A CN201410160560 A CN 201410160560A CN 103927136 B CN103927136 B CN 103927136B
- Authority
- CN
- China
- Prior art keywords
- request
- type set
- criterion
- existing
- spacing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 230000002123 temporal effect Effects 0.000 claims description 18
- 238000012545 processing Methods 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention provides an identification method and device for input and output IO types. The identification method for the input and output IO types comprises the steps that an IO request is received, whether the IO request meets the criterion of existing type sets is judged according to the attribute information of the IO request and the preset algorithm, IO requests of the existing type sets belong to the same IO sequence flow, and if it is learned that the IO request meets the criterion of one existing type set according to judgment, the IO request is added to the existing type set as a new element. According to the method and the device, identification of the sequence flow is achieved, the pre-fetched hit rate is increased, and the performance of reading data is improved greatly.
Description
Technical field
The present embodiments relate to communication and memory technology, more particularly, to a kind of recognition methods of input and output I/O type and
Device.
Background technology
With the broad development of Streaming Media, more and more higher is required to the reading performance of storage system.It is only the reading main frame
Ask the mode being issued in disk can meet business, but each read request is required for lower wall and causes a bulk continuous
Data may need could obtain through multiple disk-read, the at this moment high time delay of disk body to data access by extreme influence user
Test.So, according to existing input and output（Input/Output, abbreviation IO）Model is judged the number it would be possible to can be read
Wait host read request to come to directly hit according to being prefetched in advance in the internal memory of storage system, prefetch and be an up reading performance particularly
Bulk order reads the most important method of service feature.
IO is broadly divided into order IO and random IO two class.And in order to improve the reading performance of storage system need to judge whether pre-
Take, depend on the identification of the IO to sequential flow.In order stream recognition method of the prior art, each data block is introduced
One order degree counts；Data block is read into cache area（cache）When, the order degree of this data block counts before being it
Count is incremented for the order degree of one position data block；If the data block on previous position does not exist, then the order degree meter of itself
Number is exactly 1；If the order degree of current data block counts and is not reaching to order bottom valve value, it is considered that this data block is random number
According to；If the order degree of current data block counts reaches order bottom valve value, it is considered that this data block is alphabetic data.
When main frame IO being identified using existing order stream recognition method, the request that main frame sends is order, but arrives
Reach storage system not necessarily order, be possible to occur out of order in transmitting procedure, the program can not identify out of order suitable
Sequence stream, and if have multiple sequential flow business when execution, the method for prior art often nor correctly identifies. simultaneously
Sequential flow.Wherein topmost reason is, is to there is interference between multichannel sequential flow business.When in a memory cell
（One LUN（Logical Unit Number, abbreviation LUN）Or disk array（Redundant Arrays of
Independent Disks, abbreviation RAID））When there is multiple order business, there is not correlation due between these IO, but
Identified algorithm unification is included algorithm and is calculated and judge, so causes the IO being not belonging between same sequential flow mutually dry
Disturb, be not only helpless to sequential flow identification, be each the identification of influence of noise recognizer on the contrary.Reach in the quantity of order business
The IO receiving to disk array during thousands of road is nearly identical to random IO, and sequential flow recognizer will be led to lose efficacy thus cannot adopt
Take and effectively prefetch strategy to improve reading performance.
Content of the invention
The embodiment of the present invention provides a kind of recognition methods of input and output I/O type and device, with solve in prior art when
Problem to sequential flow identification mistake when IO is out of order.
In a first aspect, the embodiment of the present invention provides a kind of recognition methods of input and output I/O type, including：
Receive I/O Request；
Attribute information according to described I/O Request and preset algorithm judge whether described I/O Request meets existing set of types
The criterion closed；In each existing type set, included each I/O Request belongs to same IO sequential flow；
If judging to know the criterion that described I/O Request meets an existing type set, using described I/O Request as one
Individual new element is added in described existing type set.
In conjunction with a first aspect, in the first mode in the cards of first aspect, described attribute information includes described
The temporal information of I/O Request and the positional information of corresponding storage device；Described preset algorithm is euclidean distance method；
Correspondingly, the attribute information according to described I/O Request and preset algorithm judge whether described I/O Request meets and have
The criterion of type set include：
According to described temporal information and described positional information, calculate described I/O Request and each existing class using euclidean distance method
Spacing between the center of type set；
The spacing calculating is compared with the distance threshold of corresponding existing type set, if spacing is not more than distance
Threshold value, then know that described I/O Request meets the criterion of described corresponding existing type set.
In conjunction with the first mode in the cards of first aspect, in the second of first aspect mode in the cards
In, also include：
If spacing is more than distance threshold, know that described I/O Request is unsatisfactory for the criterion of described type set；If institute
State the criterion that I/O Request is unsatisfactory for all existing type set, then using described I/O Request as unique element, generate one
Individual new type set.
In conjunction with first aspect, first aspect the first to second any one mode in the cards, in first aspect
In the third mode in the cards, described described I/O Request is added in described type set it as new element
Afterwards, also include：
According to the attribute information of described I/O Request, update the criterion of described type set.
The third mode in the cards in conjunction with first aspect, in the 4th kind of mode in the cards of first aspect,
Also include：
Delete the type set not having new element to add in the scheduled time.
Second aspect, the embodiment of the present invention provides a kind of identifying device of I/O type, including：
Receiver module, for receiving I/O Request；
For the attribute information according to described I/O Request and preset algorithm, judge module, judges whether described I/O Request is full
Foot has the criterion of type set；In each existing type set, included each I/O Request belongs to same IO sequential flow；
Processing module, if for judging to know the criterion that described I/O Request meets an existing type set, by institute
State I/O Request to be added in described existing type set as a new element.
In conjunction with second aspect, in the first mode in the cards of second aspect, described attribute information includes described
The temporal information of I/O Request and the positional information of corresponding storage device；Described preset algorithm is euclidean distance method；
Correspondingly, described judge module includes：
Computing unit, for according to described temporal information and described positional information, calculating described IO using euclidean distance method
Spacing between the center of request and each existing type set；
Comparing unit, for the spacing calculating is compared with the distance threshold of corresponding existing type set, if
Spacing is not more than distance threshold, then know that described I/O Request meets the criterion of described corresponding existing type set.
The first mode in the cards in conjunction with second aspect, in the second mode in the cards of second aspect,
If described comparing unit is additionally operable to spacing is more than distance threshold, know that described I/O Request is unsatisfactory for the differentiation of described type set
Condition；If described I/O Request is unsatisfactory for the criterion of all existing type set, using described I/O Request as unique unit
Element, generates a new type set.
In conjunction with second aspect, second aspect the first to second any one mode in the cards, in second aspect
In three kinds of modes in the cards, also include：
Described I/O Request is added in described type set it as new element for described by update module
Afterwards, the attribute information according to described I/O Request, updates the criterion of described type set.
The third mode in the cards in conjunction with second aspect, in the 4th kind of mode in the cards of second aspect,
Also include：
Removing module, for deleting the type set not having new element to add in the scheduled time.
The recognition methods of embodiment of the present invention input and output I/O type and device, by receiving I/O Request, according to described IO
The attribute information of request and preset algorithm judge whether described I/O Request meets the criterion of existing type set；Each existing
In type set, included each I/O Request belongs to same IO sequential flow, if judging to know that described I/O Request meets an existing class
The criterion of type set, then be added to described I/O Request in described existing type set as a new element.I.e. root
I/O Request is divided in suitable type set attribute information according to I/O Request, and belonging to the I/O Request in same type set is one
Road sequential flow, it is achieved thereby that the identification to sequential flow, lifts the hit rate prefetching, the performance of reading data is greatly improved, solve
In prior art when IO is out of order the problem to sequential flow identification mistake.
Brief description
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
Have technology description in required use accompanying drawing be briefly described it should be apparent that, drawings in the following description are these
Some bright embodiments, for those of ordinary skill in the art, without having to pay creative labor, acceptable
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is the flow chart of the recognition methods embodiment one of input and output I/O type of the present invention；
Fig. 2 is the flow chart of the recognition methods embodiment two of present invention I O type；
Fig. 3 is the flow chart of the recognition methods embodiment three of present invention I O type；
Fig. 4 is the structural representation of the recognition methods embodiment three of present invention I O type；
Fig. 5 is the structural representation of the device embodiment one of identification of present invention I O type；
Fig. 6 is the structural representation of the device embodiment two of present invention I O type identification.
Specific embodiment
Purpose, technical scheme and advantage for making the embodiment of the present invention are clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described it is clear that described embodiment is
The a part of embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art
The every other embodiment being obtained under the premise of not making creative work, broadly falls into the scope of protection of the invention.
Fig. 1 is the flow chart of the recognition methods embodiment one of input and output I/O type of the present invention, as shown in figure 1, this enforcement
The method of example can include：
Step 101, reception I/O Request.
Wherein it is possible to the I/O Request sending for Receiving Host, this I/O Request can be order IO or random IO.
Step 102, the attribute information according to described I/O Request and preset algorithm judge whether described I/O Request meets
There is the criterion of type set；In each existing type set, included each I/O Request belongs to same IO sequential flow.
Wherein, the attribute information of described I/O Request can include the temporal information of I/O Request, the size of I/O Request and IO
Arbitrary attribute such as the positional information of the corresponding storage device of request or multiple combinations of attributes are using the described I/O Request of composition
Attribute information, in addition flexibly can also be configured according to the service feature of I/O Request.
Wherein, described existing type set criterion flexibly can be set according to the attribute information of described I/O Request
Put.
If step 103 judges to know the criterion that described I/O Request meets an existing type set, please by described IO
Ask and be added in described existing type set as a new element.
The present embodiment, by receiving I/O Request, described in the attribute information according to described I/O Request and preset algorithm judgement
Whether I/O Request meets the criterion of existing type set；In all types of set, included each I/O Request belongs to same IO
Sequential flow, if judging to know the criterion that described I/O Request meets an existing type set, using described I/O Request as one
Individual new element is added in described existing type set.I.e. I/O Request is divided into suitable class by the attribute information according to I/O Request
In type set, belonging to the I/O Request in same type set is a road sequential flow, it is achieved thereby that the identification to sequential flow, lifting
The hit rate prefetching, is greatly improved the performance reading data, solves in prior art and identifies mistake when IO is out of order to sequential flow
Problem.
Fig. 2 is the flow chart of the recognition methods embodiment two of present invention I O type, as shown in Fig. 2 the method for the present embodiment
Can include：
Step 201, reception I/O Request.
Wherein it is possible to the I/O Request that Receiving Host sends, this I/O Request can be order IO can also be random IO.
Step 202, the attribute information according to described I/O Request and preset algorithm judge whether described I/O Request meets
There is the criterion of type set；If meeting, execution step 203, if being unsatisfactory for, execution step 204.
Wherein, in all types of set, included each I/O Request belongs to same IO sequential flow.
Wherein, described attribute information includes the temporal information of described I/O Request and the positional information of corresponding storage device；Institute
Stating preset algorithm is euclidean distance method；
Correspondingly, the attribute information according to described I/O Request and preset algorithm judge whether described I/O Request meets and have
The criterion of type set include：According to described temporal information and described positional information, calculate institute using euclidean distance method
State the spacing between I/O Request and the center of each existing type set；By the spacing calculating and corresponding existing type set
Distance threshold is compared.
If spacing is not more than distance threshold, know that I/O Request meets the criterion of described type set；If spacing is big
In distance threshold, then know that described I/O Request is unsatisfactory for the criterion of described type set, when described I/O Request is unsatisfactory for institute
Have existing type set criterion when, then execution step 204.
Specifically, the positional information of the corresponding storage device of I/O Request is position in disk for the corresponding data block of I/O Request
Information.
Step 203, described I/O Request is added in described type set as a new element.
Step 204, using described I/O Request as unique element, generate a new type set.
If having new element to add in step 205 described type set, according to the attribute letter of the new I/O Request adding
Breath, updates the criterion of described type set.
Step 206, delete the scheduled time in do not have new element add type set.
The present embodiment by accepting I/O Request, sentence by the temporal information according to described I/O Request and the position of corresponding storage device
Whether the described I/O Request that breaks meets the criterion of existing type set, if meeting the criterion of existing type set, will
Described I/O Request is added in described type set as new element, and according to the attribute information of the new I/O Request adding more
The newly criterion of described type set, if be unsatisfactory for the criterion of all existing type set, using I/O Request as only
The new type set of one Element generation, further, is carried out to the type set not having new element to add in the scheduled time
Delete, it is achieved thereby that the identification to I/O type, the I/O Request being divided into same type set belongs to same sequential flow IO, respectively
Set of types is combined into different sequential flow IO, and then realizes the identification of multichannel sequential flow, lifts the hit rate prefetching, reading is greatly improved
The performance of data.
Adopt a specific embodiment below, the technical scheme of embodiment of the method shown in Fig. 2 is described in detail.Figure
3 is the flow chart of the recognition methods embodiment three of present invention I O type, and Fig. 4 is the recognition methods embodiment three of present invention I O type
Structural representation, as shown in figure 3, the method for the present embodiment can include：
S301：The I/O Request a that storage device Receiving Host sends.
S302：Storage device judges its place segment data cell according to the temporal information of I/O Request a and positional information
（Chunk）Whether belong to existing type.
Wherein, temporal information receives the time of the I/O Request a of main frame transmission for storage device, and positional information is I/O Request
Positional information in disk for a corresponding data block.
Specifically, judge whether to belong to existing type procedure as follows：Please according to each IO in a set in existing type
The temporal information asked and positional information calculation go out the average time information of this set and average range information, will each I/O Request make
For an object, map that to, in 2 dimension spaces, calculate the central information of this set within this space, using identical
Method calculate the central information of each set in existing type set；When receive I/O Request a then according to its temporal information and
Positional information uses euclidean distance method to calculate the spacing at the center to each existing type set for the I/O Request a, by the spacing calculating
It is compared with the distance threshold of corresponding type set.
S303：If belonging to arbitrary set in existing type set, enter step 304, if being not belonging in existing type set
Arbitrary set then enters step 305.
Specifically, if the center distance of the I/O Request a calculating in S302 to each existing type set is not more than correspondence
All types of set distance threshold, then know that I/O Request a meets the criterion of the type set；If it is not, then knowing that IO please
A is asked to be unsatisfactory for the criterion of the type combination.
S304：I/O Request a is added in suitable type set, as shown in figure 4, and the attribute letter according to I/O Request a
Breath updates the criterion of the type set, and enters S306.
Specifically, after each is integrated into generation, because order IO is to conduct interviews a sector address is spatially unidirectional
, the object in set is to constantly update with the I/O Request newly arriving, so the criterion of set also should be corresponding
It is updated, to adapt to new I/O type is identified.
S305：Using I/O Request a as unique element, generate a new set, as shown in figure 4, and according to I/O Request a
Attribute information update the criterion of this new set, enter S306.
In S304 and S305, when I/O Request a is put under in appropriate set, according to I/O Request a, main frame desired data is returned
After main frame, the Chunk that I/O Request a can be located retains its IO attribute information, for safeguarding its affiliated type set
Aggregate information, in Chunk, other data messages are purged.
S306：The type set not having new element to add in Preset Time is deleted.
Specifically, because the data entering storage system is to constantly update, in such as video request program, play regards
Frequency file must be eliminated as early as possible and can not be always present in internal memory, so the either establishment of new type set or I/O type
Identification be all dynamic.
The concrete recognition methods of S301-S306 when storage device receives other I/O Request, can be adopted, the method can
It is applied to the identification of any type IO, according to above-mentioned steps, I/O Request is divided in suitable type set, a type set
In each I/O Request, corresponding same sequential flow, different type set corresponds to different order stream, and then have effectively achieved multichannel
The identification of sequential flow, lifts the hit rate prefetching, and the performance of reading data is greatly improved.Further, permissible using said method
It is prevented effectively from sequential flow and random IO is erroneously interpreted as due to the presence of other road orders IO, eliminate between multichannel sequential flow
Interference, in the case of identifying multichannel sequential flow respectively, can take to prefetch accordingly/cache to each road order IO and arrange
Apply, reach performance of storage system and optimize；In multichannel sequential flow IO and random IO and in the case of depositing, exclude the dry of random IO
Disturb, can correctly identify sequential flow IO, it is to avoid random IO is misidentified as order IO, causes to prefetch/cache measure mistake, band
Carry out unnecessary performance loss；For the flexible configuration of IO attribute, multiple dimensions are identified to order IO and random IO,
Largely relax the out of order impact that algorithm is caused of IO.
Fig. 5 is the structural representation of the device embodiment one of identification of present invention I O type, as shown in figure 5, the present embodiment
Device can include：Receiver module 11, judge module 12 and processing module 13, wherein, receiver module 11 is used for receiving IO
Request, judge module 12 is used for judging whether described I/O Request meets according to the attribute information of described I/O Request and preset algorithm
The criterion of existing type set；In each existing type set, included each I/O Request belongs to same IO sequential flow, place
If reason module 13 is used for the criterion judging to know that described I/O Request meets an existing type set, described I/O Request is made
It is added in described existing type set for a new element.
The device of the present embodiment, can be used for executing the technical scheme of embodiment of the method shown in Fig. 1, it realizes principle and skill
Art effect is similar to, and here is omitted.
Fig. 6 is the structural representation of the device embodiment two of present invention I O type identification, as shown in fig. 6, the present embodiment
Device on the basis of Fig. 5 shown device structure, further, described attribute information include described I/O Request temporal information and
The positional information of corresponding storage device, described preset algorithm is euclidean distance method, and judge module 12 can include：Computing unit
121 and comparing unit 122, wherein, computing unit 121 is used for according to described temporal information and described positional information, using European
Furthest Neighbor calculates the spacing between described I/O Request and the center of each existing type set, and comparing unit 122 is used for calculating
Spacing be compared with the distance threshold of corresponding existing type set, if spacing is not more than distance threshold, know described
I/O Request meets the criterion of described corresponding existing type set.
Wherein, if described comparing unit 122 is additionally operable to spacing and is more than distance threshold, know that described I/O Request is unsatisfactory for institute
State the criterion of type set；If described I/O Request is unsatisfactory for the criterion of all existing type set, by described IO
Request, as unique element, generates a new type set.
Further, this device also includes update module 61 and removing module 62, and wherein, update module 61 is used for described general
After described I/O Request is added in described type set as a new element, according to the attribute information of described I/O Request,
Update the criterion of described type set, removing module 62 is used for deleting the set of types not having new element to add in the scheduled time
Close.
The device of the present embodiment, can be used for executing the technical scheme of embodiment of the method shown in Fig. 2, it realizes principle and skill
Art effect is similar to, and here is omitted.
It should be understood that disclosed apparatus and method in several embodiments provided by the present invention, can be passed through it
Its mode is realized.For example, device embodiment described above is only schematically, for example, the division of described unit, and only
It is only a kind of division of logic function, actual can have other dividing mode when realizing, and for example multiple units or assembly can be tied
Close or be desirably integrated into another system, or some features can be ignored, or do not execute.Another, shown or discussed
Coupling each other or direct-coupling or communication connection can be by some interfaces, the INDIRECT COUPLING of device or unit or logical
Letter connects, and can be electrical, mechanical or other forms.
The described unit illustrating as separating component can be or may not be physically separate, show as unit
The part showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.The mesh to realize this embodiment scheme for some or all of unit therein can be selected according to the actual needs
's.
In addition, can be integrated in a processing unit in each functional unit in each embodiment of the present invention it is also possible to
It is that unit is individually physically present it is also possible to two or more units are integrated in a unit.Above-mentioned integrated list
Unit both can be to be realized in the form of hardware, it would however also be possible to employ the form that hardware adds SFU software functional unit is realized.
The above-mentioned integrated unit realized in the form of SFU software functional unit, can be stored in an embodied on computer readable and deposit
In storage media.Above-mentioned SFU software functional unit is stored in a storage medium, including some instructions with so that a computer
Equipment（Can be personal computer, server, or network equipment etc.）Or processor（processor）Execution the present invention each
The part steps of embodiment methods described.And aforesaid storage medium includes：USB flash disk, portable hard drive, read-only storage（Read-
Only Memory, ROM）, random access memory（Random Access Memory, RAM）, magnetic disc or CD etc. various
Can be with the medium of store program codes.
Those skilled in the art can be understood that, for convenience and simplicity of description, only with above-mentioned each functional module
Division be illustrated, in practical application, can as desired will above-mentioned functions distribution complete by different functional modules
Become, the internal structure of device will be divided into different functional modules, to complete all or part of function described above.On
State the specific work process of the device of description, may be referred to the corresponding process in preceding method embodiment, will not be described here.
Finally it should be noted that：Various embodiments above only in order to technical scheme to be described, is not intended to limit；To the greatest extent
Pipe has been described in detail to the present invention with reference to foregoing embodiments, it will be understood by those within the art that：Its according to
So the technical scheme described in foregoing embodiments can be modified, or wherein some or all of technical characteristic is entered
Row equivalent；And these modifications or replacement, do not make the essence of appropriate technical solution depart from various embodiments of the present invention technology
The scope of scheme.
Claims (8)
1. a kind of recognition methods of input and output I/O type is it is characterised in that include：
Receive I/O Request；
Attribute information according to described I/O Request and preset algorithm judge whether described I/O Request meets existing type set
Criterion；In each existing type set, included each I/O Request belongs to same IO sequential flow；
If judging to know the criterion that described I/O Request meets an existing type set, described I/O Request is new as one
Element be added in described existing type set；
Described attribute information includes the temporal information of described I/O Request and the positional information of corresponding storage device；Described preset algorithm
For euclidean distance method；
Correspondingly, the attribute information according to described I/O Request and preset algorithm judge whether described I/O Request meets existing class
The criterion of type set includes：
According to described temporal information and described positional information, calculate described I/O Request and each existing set of types using euclidean distance method
Spacing between the center closed；
The spacing calculating is compared with the distance threshold of corresponding existing type set, if spacing is not more than apart from threshold
Value, then know that described I/O Request meets the criterion of described corresponding existing type set.
2. method according to claim 1 is it is characterised in that also include：
If spacing is more than distance threshold, know that described I/O Request is unsatisfactory for the criterion of described type set；If described IO
Request is unsatisfactory for the criterion of all existing type set, then using described I/O Request as unique element, generate one newly
Type set.
3. method according to claim 1 and 2 it is characterised in that described using described I/O Request as a new element
After being added in described type set, also include：
According to the attribute information of described I/O Request, update the criterion of described type set.
4. method according to claim 3 is it is characterised in that also include：
Delete the type set not having new element to add in the scheduled time.
5. a kind of identifying device of input and output I/O type is it is characterised in that include：
Receiver module, for receiving I/O Request；
For the attribute information according to described I/O Request and preset algorithm, judge module, judges whether described I/O Request meets
There is the criterion of type set；In each existing type set, included each I/O Request belongs to same IO sequential flow；
Processing module, if for judging to know the criterion that described I/O Request meets an existing type set, by described IO
Request is added in described existing type set as a new element；
Described attribute information includes the temporal information of described I/O Request and the positional information of corresponding storage device；Described preset algorithm
For euclidean distance method；
Correspondingly, described judge module includes：
Computing unit, for according to described temporal information and described positional information, calculating described I/O Request using euclidean distance method
The spacing and center of each existing type set between；
Comparing unit, for being compared the spacing calculating with the distance threshold of corresponding existing type set, if spacing
It is not more than distance threshold, then know that described I/O Request meets the criterion of described corresponding existing type set.
If 6. device according to claim 5 is it is characterised in that described comparing unit is additionally operable to spacing more than apart from threshold
Value, then know that described I/O Request is unsatisfactory for the criterion of described type set；If described I/O Request is unsatisfactory for all existing classes
The criterion of type set, then using described I/O Request as unique element, generate a new type set.
7. the device according to claim 5 or 5 is it is characterised in that also include：
Update module, for described described I/O Request is added in described type set as a new element after, root
According to the attribute information of described I/O Request, update the criterion of described type set.
8. device according to claim 7 is it is characterised in that also include：
Removing module, for deleting the type set not having new element to add in the scheduled time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410160560.3A CN103927136B (en) | 2014-04-21 | 2014-04-21 | Identification method and device for input and output IO types |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410160560.3A CN103927136B (en) | 2014-04-21 | 2014-04-21 | Identification method and device for input and output IO types |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103927136A CN103927136A (en) | 2014-07-16 |
| CN103927136B true CN103927136B (en) | 2017-02-22 |
Family
ID=51145371
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410160560.3A Active CN103927136B (en) | 2014-04-21 | 2014-04-21 | Identification method and device for input and output IO types |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103927136B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104156321B (en) * | 2014-07-23 | 2017-06-09 | 华为技术有限公司 | The method and device of a kind of data pre-fetching |
| CN104391656A (en) * | 2014-11-19 | 2015-03-04 | 华为技术有限公司 | IO (input/ output) resource allocation method and device of storage device and storage device |
| CN111625482B (en) * | 2016-03-23 | 2022-02-01 | 北京忆恒创源科技股份有限公司 | Sequential flow detection method and device |
| CN106294211B (en) * | 2016-08-08 | 2019-05-28 | 浪潮(北京)电子信息产业有限公司 | A kind of detection method and device of multichannel sequential flow |
| CN106557435B (en) * | 2016-11-16 | 2020-03-06 | 苏州浪潮智能科技有限公司 | Cache mode identification method, cache module and storage system |
| CN108182151B (en) * | 2018-01-24 | 2019-02-01 | 北京百度网讯科技有限公司 | Method, apparatus, storage medium and the terminal device of sequential flow caching and detection |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6427184B1 (en) * | 1997-06-03 | 2002-07-30 | Nec Corporation | Disk drive with prefetch and writeback algorithm for sequential and nearly sequential input/output streams |
| US7822731B1 (en) * | 2008-03-28 | 2010-10-26 | Emc Corporation | Techniques for management of information regarding a sequential stream |
| CN102023931A (en) * | 2010-12-17 | 2011-04-20 | 曙光信息产业(北京)有限公司 | Self-adaption cache pre-fetching method |
| CN102298556A (en) * | 2011-08-26 | 2011-12-28 | 成都市华为赛门铁克科技有限公司 | Data stream recognition method and device |
-
2014
- 2014-04-21 CN CN201410160560.3A patent/CN103927136B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6427184B1 (en) * | 1997-06-03 | 2002-07-30 | Nec Corporation | Disk drive with prefetch and writeback algorithm for sequential and nearly sequential input/output streams |
| US7822731B1 (en) * | 2008-03-28 | 2010-10-26 | Emc Corporation | Techniques for management of information regarding a sequential stream |
| CN102023931A (en) * | 2010-12-17 | 2011-04-20 | 曙光信息产业(北京)有限公司 | Self-adaption cache pre-fetching method |
| CN102298556A (en) * | 2011-08-26 | 2011-12-28 | 成都市华为赛门铁克科技有限公司 | Data stream recognition method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103927136A (en) | 2014-07-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103927136B (en) | Identification method and device for input and output IO types | |
| US8521986B2 (en) | Allocating storage memory based on future file size or use estimates | |
| CN102486752B (en) | Data pre-fetching in SAS expander | |
| US10725684B2 (en) | Method and apparatus for cost-based load balancing for port selection | |
| US7743216B2 (en) | Predicting accesses to non-requested data | |
| US7996623B2 (en) | Read ahead storage control | |
| US7840720B2 (en) | Using priority to determine whether to queue an input/output (I/O) request directed to storage | |
| US20210096777A1 (en) | Method for predicting lba information, and ssd | |
| US9507720B2 (en) | Block storage-based data processing methods, apparatus, and systems | |
| CN105045723A (en) | Processing method, apparatus and system for cached data | |
| CN109213696B (en) | Method and apparatus for cache management | |
| KR20170056414A (en) | Apparatus, method, and multimode storage device for performing selective underlying exposure mapping on user data | |
| CN103635887B (en) | Data caching method and storage system | |
| KR20170056411A (en) | Management system for operating storage media in multi-mode, storage system including the same, and method of managing storage media using the same | |
| CN101951395A (en) | Access prediction-based data cache strategy for P2P Video-on-Demand (VoD) system server | |
| CN109684231A (en) | The system and method for dsc data in solid-state disk and stream for identification | |
| CN106649145A (en) | Self-adaptive cache strategy updating method and system | |
| CN110377233A (en) | SSD reading performance optimization method, device, computer equipment and storage medium | |
| CN110297787A (en) | The method, device and equipment of I/O equipment access memory | |
| US11099740B2 (en) | Method, apparatus and computer program product for managing storage device | |
| CN112559388A (en) | Data caching method and device | |
| US11416152B2 (en) | Information processing device, information processing method, computer-readable storage medium, and information processing system | |
| CN109976896A (en) | Business re-scheduling treating method and apparatus | |
| US8055815B2 (en) | Optimal paths with SCSI I/O referrals | |
| CN110658999B (en) | Information updating method, device, equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20191211 Address after: 235025 room 103, building 1, Nanhu Yayuan, Yangzhuang street, Lieshan District, Huaibei City, Anhui Province Patentee after: Huaibei Shanda Intellectual Property Operation Co.,Ltd. Address before: 510000 unit 2414-2416, building, No. five, No. 371, Tianhe District, Guangdong, China Patentee before: GUANGDONG GAOHANG INTELLECTUAL PROPERTY OPERATION Co.,Ltd. Effective date of registration: 20191211 Address after: 510000 unit 2414-2416, building, No. five, No. 371, Tianhe District, Guangdong, China Patentee after: GUANGDONG GAOHANG INTELLECTUAL PROPERTY OPERATION Co.,Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Method and device for identifying input/output IO types Granted publication date: 20170222 Pledgee: Huishang Bank Co.,Ltd. Huaibei Lieshan sub branch Pledgor: Huaibei Shanda Intellectual Property Operation Co.,Ltd. Registration number: Y2024980034857 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |