CN106959826A - A kind of data-storage system and method - Google Patents
A kind of data-storage system and method Download PDFInfo
- Publication number
- CN106959826A CN106959826A CN201710192800.1A CN201710192800A CN106959826A CN 106959826 A CN106959826 A CN 106959826A CN 201710192800 A CN201710192800 A CN 201710192800A CN 106959826 A CN106959826 A CN 106959826A
- Authority
- CN
- China
- Prior art keywords
- data
- hard disk
- type
- storage hard
- storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention provides a kind of data-storage system and method, wherein processor can determine the type of data according to the use temperature of data, such as when the use temperature of data is located in the corresponding use heating range of first kind storage hard disk, it is first kind data to determine data, and is stored by first kind storage hard disk；When the use temperature of data is located in the corresponding use heating range of Second Type storage hard disk, it is Second Type data to determine data, and is stored by Second Type storage hard disk；When the use temperature of data is located in the corresponding use heating range of the 3rd type storage hard disk, it is the 3rd categorical data to determine data, and is stored by the 3rd type storage hard disk, realizes that the classification according to the use temperature of data to data is stored.And it can increase by three type storage hard disks or replace the 3rd type storage hard disk at any time to store more data, the amount of storage of data can be so improved in the case where not reducing data granularity, the losing probability of data is reduced.
Description
Technical field
The invention belongs to technical field of data processing, in particular, more particularly to a kind of data-storage system and method.
Background technology
Found according to the research in 5 years IDC (Internet data center) past, global metadata amount is about every two years doubled；
Global metadata amount in 2010 strides into ZB (the 10000100000000 byte) epoch, it is contemplated that is up to the year two thousand twenty global metadata amount and makes us terrified
35ZB, so huge data volume brings great challenge to data-storage system.
Storage of the current data-storage system to mass data uses distributed storage mode, and such as data-storage system includes
Multiple servers, every server stores the partial data in mass data respectively, realizes that the distribution of mass data is deposited with this
Storage, but with the growth of data volume, multiple servers can not also bear growing data volume, be this data-storage system
In every server can carry out data storage in the following way：
A kind of mode：Sample frequency is reduced, such as original sample frequency is 1 second/time, i.e., at interval of one second collection number
According to such server can collect new data at interval of one second, and if sample frequency is reduced into 1 point/time, such server
New data will be collected at interval of one minute；Another way：Stored by way of the granularity for reducing data storage
Data.But both modes are and realize that the classification to mass data is stored, and both modes can cause partial data
Lose.
The content of the invention
In view of this, it is an object of the invention to provide a kind of data-storage system and method, for realizing according to data
Use temperature come data storage of classifying, and in the case where not reducing the data granularity of data storage, improve depositing for data
Reserves, to reduce the losing probability of data.Technical scheme is as follows：
The present invention provides a kind of data-storage system, and the system includes：Processor, the storage of at least one first kind are hard
Disk, at least one Second Type storage hard disk and at least one the 3rd type storage hard disk；
The processor, the use temperature for obtaining data, when the use temperature of the data is deposited positioned at the first kind
When storing up in the corresponding use heating range of hard disk, it is first kind data to determine the data；When the use temperature of the data
When in the corresponding use heating range of Second Type storage hard disk, it is Second Type data to determine the data；When described
When the use temperature of data is located in the corresponding use heating range of the 3rd type storage hard disk, it is the 3rd class to determine the data
Type data；
The first kind storage hard disk is used to store first kind data；The Second Type storage hard disk is used to store
Second Type data, the 3rd type storage hard disk is used to store the 3rd categorical data；
Wherein, the use temperature of the first kind data is more than the use temperature of the Second Type data, described the
The use temperature of two categorical datas is more than the use temperature of the 3rd categorical data.
It is preferred that, the read or write speed of the first kind storage hard disk is better than the Second Type storage hard disk and described the
The read or write speed of three type storage hard disks.
It is preferred that, the processor, for obtaining the first kind data stored in the first kind storage hard disk, when
The use temperature of the first kind data stored in the first kind storage hard disk be decreased to less than first it is default use temperature, will
The first default first kind data using temperature that are decreased to less than are defined as the Second Type data, and will be identified
Second Type data are transferred in the Second Type storage hard disk and stored.
It is preferred that, the processor, the Second Type data for obtaining the Second Type storage hard disk storage work as institute
State the Second Type data of Second Type storage hard disk storage use temperature be decreased to less than second it is default use temperature, will be described
It is decreased to less than the second default Second Type data using temperature and is defined as the 3rd categorical data, and the 3rd by determined by
Categorical data is transferred in the 3rd type storage hard disk and stored.
It is preferred that, the processor, for polymerizeing to the Second Type data, obtains data granularity higher than described
The aggregated data of the data granularity of Second Type data, and the aggregated data is defined as the first kind data, by institute
State aggregated data and be transferred to storage in the first kind storage hard disk.
It is preferred that, the processor, the storage information for recording the 3rd type storage hard disk.
It is preferred that, the processor, for obtaining data query information, according to the data query information inquiry
The data whether being stored with one type storage hard disk with the data query information match, if not being stored with and the data
The data that Query Information matches, then inquire about at least one in the Second Type storage hard disk and the 3rd type storage hard disk
The data whether being stored with type storage hard disk with the data query information match, looked into the data if being stored with
The data of information match are ask, then the data with the data query information match are transferred into the first kind stores hard
In disk.
It is preferred that, the processor, in the 3rd type storage hard disk when reaching pre-set space with space,
Prompt message is exported, the prompt message is used to point out to change the 3rd type storage hard disk.
The present invention also provides a kind of date storage method, and methods described includes：
Obtain the use temperature of data；
When the use temperature of the data is located in the corresponding use heating range of first kind storage hard disk, institute is determined
Data are stated for first kind data, and by the data storage into the first kind storage hard disk；
When the use temperature of the data is located in the corresponding use heating range of Second Type storage hard disk, institute is determined
Data are stated for Second Type data, and by the data storage into the Second Type storage hard disk；
When the use temperature of the data is located in the corresponding use heating range of the 3rd type storage hard disk, institute is determined
Data are stated for the 3rd categorical data, and by the data storage into the 3rd type storage hard disk；
Wherein, the use temperature of the first kind data is more than the use temperature of the Second Type data, described the
The use temperature of two categorical datas is more than the use temperature of the 3rd categorical data.
It is preferred that, methods described also includes：Obtain the use temperature of the data stored in the first kind storage hard disk；
Default temperature is used when the use temperature of the data stored in the first kind storage hard disk is decreased to less than first
When, the first default data using temperature that are decreased to less than are defined as the Second Type data, and will identified the
Two categorical datas are transferred in the Second Type storage hard disk and stored；
And/or
Methods described also includes：Obtain the use temperature of the data stored in the Second Type storage hard disk；
Default temperature is used when the use temperature of the data stored in the Second Type storage hard disk is decreased to less than second
When, the second default data using temperature that are decreased to less than are defined as the 3rd categorical data, and will identified the
Three categorical datas are transferred in the 3rd type storage hard disk and stored；
And/or
Methods described also includes：The data stored in the Second Type storage hard disk are polymerize, data grain is obtained
Degree is higher than the aggregated data of the data granularity of the Second Type data, and the aggregated data is defined as into the first kind
Data, the aggregated data is transferred in the first kind storage hard disk and stored.
Compared with prior art, the above-mentioned technical proposal that the present invention is provided has the following advantages that：
By above-mentioned technical proposal, data-storage system includes：Processor, at least one first kind storage hard disk, extremely
A few Second Type storage hard disk and at least one the 3rd type storage hard disk, such processor can be according to the uses of data
Temperature determines the type of data, such as when the use temperature of data is located in the corresponding use heating range of first kind storage hard disk
When, it is first kind data to determine data, and stores by the first kind storage hard disk first kind data；When the use of data
When temperature is located in the corresponding use heating range of Second Type storage hard disk, it is Second Type data to determine data, and by the
Two type storage hard disks store Second Type data；When the use temperature of data is located at, the 3rd type storage hard disk is corresponding to be made
During with heating range, it is the 3rd categorical data to determine data, and stores the 3rd categorical data by the 3rd type storage hard disk,
Realize that the classification according to the use temperature of data to data is stored.And in actual applications, the data volume of the 3rd categorical data
It can gradually increase, be that this can increase the 3rd type storage hard disk of the 3rd categorical data of storage or replace the 3rd type at any time
Storage hard disk stores more data, can so improve the amount of storage of data in the case where not reducing data granularity, drops
The losing probability of low data.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
The accompanying drawing to be used needed for having technology description is briefly described, it should be apparent that, drawings in the following description are the present invention
Some embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, can also basis
These accompanying drawings obtain other accompanying drawings.
Fig. 1 is the schematic diagram of data-storage system provided in an embodiment of the present invention；
Fig. 2 is the flow chart of date storage method provided in an embodiment of the present invention.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
A part of embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art
The every other embodiment obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.
Referring to Fig. 1, it illustrates the schematic diagram of data-storage system provided in an embodiment of the present invention, for realizing basis
The use temperature of data improves data come data storage of classifying, and in the case where not reducing the data granularity of data storage
Amount of storage, to reduce the losing probability of data.The data-storage system includes：Processor 11, at least one first kind
Storage hard disk 12, at least one Second Type storage hard disk 13 and at least one the 3rd type storage hard disk 14, in Fig. 1 with bag
Include and said exemplified by a first kind storage hard disk 12, a Second Type storage hard disk and a 3rd type storage hard disk
It is bright.
Processor 11, the use temperature for obtaining data, when the use temperature of data is located at first kind storage hard disk
When in 12 corresponding use heating ranges, it is first kind data to determine data；When the use temperature of data is located at Second Type
When in the corresponding use heating range of storage hard disk 13, it is Second Type data to determine data；When the use temperature of data is located at
When in the corresponding use heating range of the 3rd type storage hard disk 14, it is the 3rd categorical data to determine data.The first kind is stored
Hard disk 12 is used to store first kind data；Second Type storage hard disk 13 is used to store Second Type data；3rd type is deposited
Storing up hard disk 14 is used to store the 3rd categorical data
Wherein at least it is used for the frequency of use for indicating data using temperature, the use of other data is higher than for frequency of use
For the data of frequency, it is higher than the use temperature of other data using temperature.In embodiments of the present invention, first kind data
Use temperature be more than the use temperatures of Second Type data, the use temperatures of Second Type data is more than the 3rd categorical data
It is higher than the frequency of use of Second Type data using the frequency of use of temperature, therefore first kind data, Second Type data
Frequency of use is higher than the frequency of use of the 3rd type.
Such as in field of data storage, data to be stored can be persistently got, it is each that such as sensor is collected in real time
Item data, these each item datas are the newest data to be stored that sensor is collected, and newest data to be stored
Frequency of use can be higher than the frequency of use of other data got, therefore these newest data to be stored can be more than it
The use temperature for the data that he has got, and then processor 11 directly assert that the use temperature of these data can be located at the first kind
In the corresponding use heating range of type storage hard disk 12, it is defined as first kind data.
For the data that other have been obtained, processor 11 can uninterruptedly or periodically obtain the use of these data
Temperature, then can be by when the use temperature of these data is located in the corresponding use heating range of Second Type storage hard disk 13
It is defined as Second Type data, can be by it if be located in the corresponding use heating range of the 3rd type storage hard disk 14
It is defined as the 3rd categorical data.
In embodiments of the present invention, the corresponding use heating range of first kind storage hard disk 12, Second Type storage are hard
The use heating range of the corresponding use heating range of disk 13 and the 3rd type storage hard disk 14 is to determine the affiliated class of data
The criterion of type, can set these three storage hard disks each self-corresponding according to the use demand of data in actual applications
Use heating range.
The corresponding use heating range of such as first kind storage hard disk 12 is [A, B], 13 pairs of Second Type storage hard disk
The use heating range answered is [C, D], and the corresponding use heating range of the 3rd type storage hard disk 14 is [E, F], wherein in []
First numerical value use temperature for minimum, second numerical value uses temperature for maximum, for make first kind data using heat
Degree is more than the use temperature of Second Type data, and the use temperature of Second Type data uses heat more than the 3rd categorical data
Degree is then minimum hard more than Second Type storage using temperature A in the corresponding use heating range of first kind storage hard disk 12
Maximum in the corresponding use heating range of disk 13 uses temperature D, the corresponding use heating range of Second Type storage hard disk 13
In it is minimum be more than using temperature C it is maximum using temperature F in the corresponding use heating range of the 3rd type storage hard disk 14.
But the set-up mode of this use heating range can not cover all use temperatures, and set-up mode is excessively multiple
It is miscellaneous, it is that this embodiment of the present invention can also provide a kind of set-up mode of use heating range, such as sets two to be used to divide
The default use temperature of the use heating range of three type storage hard disks is stated, the such as first default preset using temperature and second is made
With temperature, then the corresponding use heating range of first kind storage hard disk 12 is default more than or equal to first uses temperature, second
The corresponding use heating range of type storage hard disk 13 for (first it is default use temperature, second default uses temperature], then the 3rd
The corresponding use heating range of type storage hard disk 14 is to preset to use temperature less than second.For first it is default using temperature and
Depending on the second default value using temperature can be according to practical application, if first kind storage hard disk 12 and Second Type are deposited
The memory space for storing up hard disk 13 is larger, then can be preset so that corresponding raising first is default using temperature and second using temperature
Value, and it is default default poor using the value between temperature using temperature and second to increase first.
And in field of data storage, have mass data and continue to flow into data-storage system, this requires data
Storage system possesses the function of high-throughput, is that the read or write speed of first kind storage hard disk 12 is excellent in this embodiment of the present invention
In the read or write speed of the type storage hard disk 14 of Second Type storage hard disk 13 and the 3rd, to bear continual mass data
Flow into.
For example first kind storage hard disk 12 can use SSD (Solid-State Disk, solid state hard disc), to pass through
SDD read or write speed fast performance meets the requirement of high-throughput, and Second Type storage hard disk 13 can use HDD (Hard
Disk Drive, hard disk drive), the 3rd type storage hard disk 14 can use HDD, or the 3rd type storage hard disk can be with
It is big less than SSD but memory space or possess the hard disk of warm connection function using other read or write speeds.
And the 3rd type storage hard disk 14 why choose possess warm connection function hard disk be because：With holding for data
Continuous to obtain and flow into, the use temperature of partial data can gradually lower in data-storage system, so as to cause the 3rd categorical data
Data volume also gradually increase, be accomplished by substantial amounts of memory space to not reduce the data granularity of data is constantly reduced to store
The data of 3rd categorical data, this is accomplished by the 3rd more type storage hard disk to store the 3rd categorical data, so needing
3rd type storage hard disk 14 possesses warm connection function, in the situation of the memory space inadequate of any 3rd type storage hard disk 14
Under, it can be replaced by way of hot plug, the 3rd new type storage hard disk is added in data-storage system.
Corresponding processor 11 can be used in the 3rd type storage hard disk 14 when reaching pre-set space with space,
Prompt message is exported, the prompt message is used to point out to change the 3rd type storage hard disk 14.Wherein pre-set space can basis
Depending on practical application, prompting is such as exported when reaching the 95% of whole memory spaces with space in the 3rd type storage hard disk 14
Information.
In the case where the 3rd type storage hard disk 14 possesses warm connection function, processor 11 needs the 3rd type of record to deposit
The storage information of hard disk is stored up, the numbering of the 3rd type storage hard disk 14 as belonging to the 3rd categorical data of record (records the 3rd
Which the 3rd type storage hard disk categorical data is stored in), storage the 3rd affiliated filename of categorical data or affiliated table
Name, beginning and ending time stamp of the 3rd categorical data of storage etc., in order to know that each the 3rd type is stored by storage information
The information of the data stored in hard disk.When needing to inquire about data from the 3rd type storage hard disk 14, then need according to storage
Information determines which the 3rd type storage hard disk 14 is inquired about data be located in, then will identified 3rd type storage
Hard disk 14 is linked into data-storage system, and the data of inquiry are obtained from it.And for first kind storage hard disk 12 and
For two type storage hard disks 13, data can be inquired about directly from both types storage hard disk and be analyzed.
In an application scenarios of the embodiment of the present invention, above-mentioned first kind storage hard disk 12 and Second Type storage is hard
Disk 13 can be located in server cluster, and such as data-storage system includes first server cluster and closes second server cluster, often
Individual first kind storage hard disk 12 is arranged at least one server in first server cluster, each Second Type storage
Hard disk 13 is arranged at least one server in the 3rd server cluster, and for the 3rd type storage hard disk 14,
It may be mounted in the backup server of data-storage system, to be changed by way of hot plug.
By above-mentioned technical proposal, data-storage system include processor 11, at least one first kind storage hard disk 12,
At least one Second Type storage hard disk 13 and at least one the 3rd type storage hard disk 14, such processor 11 can be according to number
According to use temperature determine the types of data, such as when the use temperature of data is located at, first kind storage hard disk 12 is corresponding to be used
When in heating range, it is first kind data to determine data, and stores by first kind storage hard disk 12 first kind data；
When the use temperature of data is located in the corresponding use heating range of Second Type storage hard disk 13, it is Equations of The Second Kind to determine data
Type data, and store by Second Type storage hard disk 13 Second Type data；When the use temperature of data is located at the 3rd type
When in the corresponding use heating range of storage hard disk 14, it is the 3rd categorical data to determine data, and by the 3rd type storage hard disk
14 store the 3rd categorical data, realize that the classification according to the use temperature of data to data is stored.And in actual applications,
The data volume of 3rd categorical data can gradually increase, and be that this can increase the 3rd type storage hard disk of the 3rd categorical data of storage
14 or the 3rd type storage hard disk 14 is replaced at any time store more data, so in the case where not reducing data granularity
The amount of storage of data can be improved, the losing probability of data is reduced.
In embodiments of the present invention, processor 11 is also needed to first kind storage hard disk 12 and Second Type storage hard disk
The data stored in 13 are managed, and such as periodically or aperiodically obtain first kind storage hard disk 12 and Second Type storage
Data are handled by the use temperature of the data stored in hard disk 13 according to using temperature.Wherein 11 pairs of processor is stored
The mode that data are managed including but not limited to following manner：
A kind of mode：Processor 11 obtains the first kind data stored in first kind storage hard disk 12, works as the first kind
The use temperature of the first kind data stored in type storage hard disk 12 be decreased to less than first it is default use temperature, will drop to and be less than
The first default first kind data using temperature are defined as Second Type data, and identified Second Type data are shifted
Stored into Second Type storage hard disk 13.
Another way：Processor 11 obtains the Second Type data of the storage of Second Type storage hard disk 13, works as Equations of The Second Kind
The use temperature for the Second Type data that type storage hard disk 13 is stored be decreased to less than second it is default use temperature, will drop to less than the
The two default Second Type data for using temperature are defined as the 3rd categorical data, and identified 3rd categorical data is transferred to
Stored in 3rd type storage hard disk 14.
By above two mode, realize to storing number in first kind storage hard disk 12 and Second Type storage hard disk 13
According to renewal, and can provide memory space to flow again into the data of data-storage system in this way.
Yet another approach：Processor polymerize to Second Type data, obtains data granularity higher than Second Type data
Data granularity aggregated data, and aggregated data is defined as first kind data, aggregated data is transferred to the first kind
Stored in storage hard disk 12.As processor 11 can be to the of the same destination object stored in Second Type storage hard disk 12
Two categorical datas are polymerize, so that Second Type data are weather data as an example, and processor 11 can be to same city (such as north
Capital) weather data polymerize, the weather data collected per hour is polymerized to daily weather data, can so be saved
The data volume of storage is saved, and can be improved after aggregated data to be transferred to first kind storage hard disk 12 aggregated data is looked into
Ask speed.
Certain processor 11 can also polymerize to the Second Type data of different target object, be deposited in such as processor 11
Contain all kinds data of indicative for environments situation, such as temperature data, humidity data, pollution index data and air speed data
Deng these data can be polymerize by processor 11, obtain the data for showing ambient conditions, such as by these data
Polymerization obtains the data that environment is excellent or environment is poor (such as aggregated data can be that environment is excellent or environment is poor).
In addition, processor 11 can also provide data query function, data storage so can be inquired about by processor 11
The data of system storage, such as processor 11 obtain data query information, store hard according to the data query information inquiry first kind
The data whether being stored with data query information match in disk 12, if not being stored with the number with data query information match
According to, then inquire about at least one of Second Type storage hard disk 13 and the 3rd type storage hard disk 14 storage hard disk in whether be stored with
With the data of data query information match, will be with data query if being stored with the data with data query information match
The data of information match are transferred in first kind storage hard disk 12.
Specifically, processor 11 according to whether be stored with data query information inquiry first kind storage hard disk 12 with number
It is investigated that asking the data of information match, if not being stored with the data with data query information match, inquiry Second Type is deposited
The data whether storage hard disk 13 is stored with data query information match, stop data query process if being stored with, and will
It is transferred to the data of data query information match in first kind storage hard disk 12, if in Second Type storage hard disk 13
The data not being stored with data query information match, then whether the 3rd type storage hard disk 14 of inquiry, which is stored with, looked into data
Ask the data of information match.
When whether the 3rd type storage hard disk 14 of inquiry is stored with the data with data query information match, according to number
In the storage information of the 3rd type storage hard disk 14 recorded according to Query Information from processor 11, it is determined that being stored with and data query
3rd type storage hard disk 14 of the data of information match, then obtains from the 3rd type storage hard disk 14 and is looked into data
The data of information match are ask, and are transferred in first kind storage hard disk 11.
Corresponding with said system embodiment, the embodiment of the present invention also provides a kind of date storage method, and its flow chart is such as
Shown in Fig. 2, it may comprise steps of：
101：Obtain the use temperature of data.
102：When the use temperature of data is located in the corresponding use heating range of first kind storage hard disk, number is determined
According to for first kind data, and by data storage into first kind storage hard disk.
103：When the use temperature of data is located in the corresponding use heating range of Second Type storage hard disk, number is determined
According to for Second Type data, and by data storage into Second Type storage hard disk.
104：When the use temperature of data is located in the corresponding use heating range of the 3rd type storage hard disk, number is determined
According to for the 3rd categorical data, and by data storage into the 3rd type storage hard disk.
Wherein the use temperatures of first kind data is more than the use temperature of Second Type data, and Second Type data make
It is more than the use temperature of the 3rd categorical data with temperature, realizes that the classification according to the use temperature of data to data is stored.And
In actual applications, the data volume of the 3rd categorical data can gradually increase, and be that this can increase the of the 3rd categorical data of storage
Three type storage hard disks replace the 3rd type storage hard disk to store more data at any time, are not so reducing data grain
The amount of storage of data can be improved in the case of degree, the losing probability of data is reduced.
In addition date storage method provided in an embodiment of the present invention can also be managed to data, and its mode is included but not
It is limited to following manner：
A kind of mode：Obtain the use temperature of the data stored in first kind storage hard disk；When first kind storage is hard
The use temperature of the data stored in disk be decreased to less than first it is default using temperature when, will drop to and default less than first use temperature
Data be defined as Second Type data, and identified Second Type data be transferred in Second Type storage hard disk deposited
Storage.
Another way：Obtain the use temperature of the data stored in Second Type storage hard disk；When Second Type storage
The use temperature of the data stored in hard disk be decreased to less than second it is default using temperature when, will drop to default less than second using heat
The data of degree are defined as the 3rd categorical data, and identified 3rd categorical data is transferred in the 3rd type storage hard disk deposited
Storage.
Yet another approach：The data stored in Second Type storage hard disk are polymerize, data granularity are obtained higher than the
The aggregated data of the data granularity of two categorical datas, and aggregated data is defined as first kind data, aggregated data is shifted
Stored into first kind storage hard disk.
It should be noted that each embodiment in this specification is described by the way of progressive, each embodiment weight
Point explanation be all between difference with other embodiment, each embodiment identical similar part mutually referring to.
For method class embodiment, because it is substantially similar to system embodiment, so description is fairly simple, related part is joined
See the part explanation of embodiment of the method.
Finally, in addition it is also necessary to explanation, herein, such as first and second or the like relational terms be used merely to by
One entity or operation make a distinction with another entity or operation, and not necessarily require or imply these entities or operation
Between there is any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant meaning
Covering including for nonexcludability, so that process, method, article or equipment including a series of key elements not only include that
A little key elements, but also other key elements including being not expressly set out, or also include be this process, method, article or
The intrinsic key element of equipment.In the absence of more restrictions, the key element limited by sentence "including a ...", is not arranged
Except also there is other identical element in the process including the key element, method, article or equipment.
The foregoing description of the disclosed embodiments, enables those skilled in the art to realize or using the present invention.To this
A variety of modifications of a little embodiments will be apparent for a person skilled in the art, and generic principles defined herein can
Without departing from the spirit or scope of the present invention, to realize in other embodiments.Therefore, the present invention will not be limited
It is formed on the embodiments shown herein, and is to fit to consistent with features of novelty with principles disclosed herein most wide
Scope.
The above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For member, under the premise without departing from the principles of the invention, some improvements and modifications can also be made, these improvements and modifications also should
It is considered as protection scope of the present invention.
Claims (10)
1. a kind of data-storage system, it is characterised in that the system includes：Processor, the storage of at least one first kind are hard
Disk, at least one Second Type storage hard disk and at least one the 3rd type storage hard disk；
The processor, the use temperature for obtaining data, when the use temperature of the data is located at first kind storage firmly
When in the corresponding use heating range of disk, it is first kind data to determine the data；When the use temperature of the data is located at
When in the corresponding use heating range of Second Type storage hard disk, it is Second Type data to determine the data；When the data
Use temperature be located at the corresponding use heating range of the 3rd type storage hard disk in when, determine the data be the 3rd number of types
According to；
The first kind storage hard disk is used to store first kind data；The Second Type storage hard disk is used to store second
Categorical data, the 3rd type storage hard disk is used to store the 3rd categorical data；
Wherein, the use temperature of the first kind data is more than the use temperature of the Second Type data, the Equations of The Second Kind
The use temperature of type data is more than the use temperature of the 3rd categorical data.
2. system according to claim 1, it is characterised in that the read or write speed of the first kind storage hard disk is better than institute
State the read or write speed of Second Type storage hard disk and the 3rd type storage hard disk.
3. system according to claim 1, it is characterised in that the processor, for obtaining the first kind storage
The first kind data stored in hard disk, when the use temperature of the first kind data stored in the first kind storage hard disk
Be decreased to less than first it is default use temperature, be decreased to less than first by described and default using the first kind data of temperature be defined as institute
Second Type data are stated, and identified Second Type data are transferred to storage in the Second Type storage hard disk.
4. system according to claim 1, it is characterised in that the processor, for obtaining the Second Type storage
The Second Type data of hard-disc storage, when the use temperature for the Second Type data that the Second Type storage hard disk is stored is down to
It is default less than second to use temperature, the second default Second Type data using temperature that are decreased to less than are defined as described the
Three categorical datas, and identified 3rd categorical data is transferred to storage in the 3rd type storage hard disk.
5. system according to claim 1, it is characterised in that the processor, for entering to the Second Type data
Row polymerization, obtains aggregated data of the data granularity higher than the data granularity of the Second Type data, and by the aggregated data
It is defined as the first kind data, the aggregated data is transferred in the first kind storage hard disk and stored.
6. system according to claim 1, it is characterised in that the processor, for recording the 3rd type storage
The storage information of hard disk.
7. system according to claim 6, it is characterised in that the processor, for obtaining data query information, according to
Whether it is stored with first kind storage hard disk described in the data query information inquiry and the data query information match
Data, if not being stored with the data with the data query information match, inquire about the Second Type storage hard disk and
Whether it is stored with least one of 3rd type storage hard disk type storage hard disk and the data query information phase
The data matched somebody with somebody, will be with the data query information match if being stored with the data with the data query information match
Data be transferred in the first kind storage hard disk.
8. system according to claim 6, it is characterised in that the processor, for hard in the 3rd type storage
When reaching pre-set space with space of disk, exports prompt message, and the prompt message is used to point out to change the 3rd type
Storage hard disk.
9. a kind of date storage method, it is characterised in that methods described includes：
Obtain the use temperature of data；
When the use temperature of the data is located in the corresponding use heating range of first kind storage hard disk, the number is determined
According to for first kind data, and by the data storage into the first kind storage hard disk；
When the use temperature of the data is located in the corresponding use heating range of Second Type storage hard disk, the number is determined
According to for Second Type data, and by the data storage into the Second Type storage hard disk；
When the use temperature of the data is located in the corresponding use heating range of the 3rd type storage hard disk, the number is determined
According to for the 3rd categorical data, and by the data storage into the 3rd type storage hard disk；
Wherein, the use temperature of the first kind data is more than the use temperature of the Second Type data, the Equations of The Second Kind
The use temperature of type data is more than the use temperature of the 3rd categorical data.
10. method according to claim 9, it is characterised in that methods described also includes：Obtain the first kind storage
The use temperature of the data stored in hard disk；
, will when the use temperature of the data stored in the first kind storage hard disk, which is decreased to less than first, to be preset using temperature
The first default data using temperature that are decreased to less than are defined as the Second Type data, and by identified Second Type
Data are transferred in the Second Type storage hard disk and stored；
And/or
Methods described also includes：Obtain the use temperature of the data stored in the Second Type storage hard disk；
, will when the use temperature of the data stored in the Second Type storage hard disk, which is decreased to less than second, to be preset using temperature
The second default data using temperature that are decreased to less than are defined as the 3rd categorical data, and will identified 3rd type
Data are transferred in the 3rd type storage hard disk and stored；
And/or
Methods described also includes：The data stored in the Second Type storage hard disk are polymerize, data granularity are obtained high
It is defined as the first kind number in the aggregated data of the data granularity of the Second Type data, and by the aggregated data
According to, by the aggregated data be transferred in the first kind storage hard disk store.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710192800.1A CN106959826A (en) | 2017-03-28 | 2017-03-28 | A kind of data-storage system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710192800.1A CN106959826A (en) | 2017-03-28 | 2017-03-28 | A kind of data-storage system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106959826A true CN106959826A (en) | 2017-07-18 |
Family
ID=59471058
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710192800.1A Pending CN106959826A (en) | 2017-03-28 | 2017-03-28 | A kind of data-storage system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106959826A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107506146A (en) * | 2017-08-29 | 2017-12-22 | 郑州云海信息技术有限公司 | A kind of data-storage system |
| CN107688443A (en) * | 2017-09-18 | 2018-02-13 | 郑州云海信息技术有限公司 | A kind of method of data storage, system and relevant apparatus |
| CN109739340A (en) * | 2017-08-15 | 2019-05-10 | 金钱猫科技股份有限公司 | A kind of data processing method and terminal of energy saving |
| TWI694700B (en) * | 2018-08-01 | 2020-05-21 | 香港商阿里巴巴集團服務有限公司 | Data processing method and device, user terminal |
| TWI697223B (en) * | 2018-08-01 | 2020-06-21 | 香港商阿里巴巴集團服務有限公司 | Data processing method |
| CN112882646A (en) * | 2019-11-29 | 2021-06-01 | 北京金山云网络技术有限公司 | Resource caching method and device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102156738A (en) * | 2011-04-13 | 2011-08-17 | 成都市华为赛门铁克科技有限公司 | Method for processing data blocks, and data block storage equipment and system |
| CN103914516A (en) * | 2014-02-25 | 2014-07-09 | 深圳市中博科创信息技术有限公司 | Method and system for layer-management of storage system |
| CN105138476A (en) * | 2015-08-26 | 2015-12-09 | 广东创我科技发展有限公司 | Data storage method and system based on hadoop heterogeneous storage |
| CN106156331A (en) * | 2016-07-06 | 2016-11-23 | 益佳科技（北京）有限责任公司 | Cold and hot temperature data server system and processing method thereof |
| US20170024147A1 (en) * | 2015-07-21 | 2017-01-26 | Fujitsu Limited | Storage control device and hierarchized storage control method |
| CN106406766A (en) * | 2016-09-23 | 2017-02-15 | 郑州云海信息技术有限公司 | A data storage method and device |
-
2017
- 2017-03-28 CN CN201710192800.1A patent/CN106959826A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102156738A (en) * | 2011-04-13 | 2011-08-17 | 成都市华为赛门铁克科技有限公司 | Method for processing data blocks, and data block storage equipment and system |
| CN103914516A (en) * | 2014-02-25 | 2014-07-09 | 深圳市中博科创信息技术有限公司 | Method and system for layer-management of storage system |
| US20170024147A1 (en) * | 2015-07-21 | 2017-01-26 | Fujitsu Limited | Storage control device and hierarchized storage control method |
| CN105138476A (en) * | 2015-08-26 | 2015-12-09 | 广东创我科技发展有限公司 | Data storage method and system based on hadoop heterogeneous storage |
| CN106156331A (en) * | 2016-07-06 | 2016-11-23 | 益佳科技（北京）有限责任公司 | Cold and hot temperature data server system and processing method thereof |
| CN106406766A (en) * | 2016-09-23 | 2017-02-15 | 郑州云海信息技术有限公司 | A data storage method and device |
Non-Patent Citations (1)
| Title |
|---|
| 俞朝晖等: "《计算机网络技术实用宝典 第2版》", 31 July 2014, 中国铁道出版社 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109739340A (en) * | 2017-08-15 | 2019-05-10 | 金钱猫科技股份有限公司 | A kind of data processing method and terminal of energy saving |
| CN107506146A (en) * | 2017-08-29 | 2017-12-22 | 郑州云海信息技术有限公司 | A kind of data-storage system |
| CN107688443A (en) * | 2017-09-18 | 2018-02-13 | 郑州云海信息技术有限公司 | A kind of method of data storage, system and relevant apparatus |
| TWI694700B (en) * | 2018-08-01 | 2020-05-21 | 香港商阿里巴巴集團服務有限公司 | Data processing method and device, user terminal |
| TWI697223B (en) * | 2018-08-01 | 2020-06-21 | 香港商阿里巴巴集團服務有限公司 | Data processing method |
| US11233878B2 (en) | 2018-08-01 | 2022-01-25 | Advanced New Technologies Co., Ltd. | Data processing method, apparatus, and client device |
| CN112882646A (en) * | 2019-11-29 | 2021-06-01 | 北京金山云网络技术有限公司 | Resource caching method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106959826A (en) | A kind of data-storage system and method | |
| CN104346357B (en) | The file access method and system of a kind of built-in terminal | |
| CN105138476B (en) | A kind of date storage method and system based on the storage of hadoop isomeries | |
| CN102663090B (en) | Method and device for inquiry metadata | |
| CN101459557B (en) | Secure logging centralized storage method and device | |
| CN102364474B (en) | Metadata storage system for cluster file system and metadata management method | |
| CN102930060B (en) | A kind of method of database quick indexing and device | |
| CN103049514B (en) | A kind of equilibrium image clustering method based on hierarchical cluster | |
| CN101667205B (en) | Method for memorizing real time measure point data for quick review | |
| CN111367469B (en) | Method and system for migrating layered storage data | |
| CN102129472B (en) | Construction method for high-efficiency hybrid storage structure of semantic-orient search engine | |
| CN106648446A (en) | Time series data storage method and apparatus, and electronic device | |
| CN102184211A (en) | File system, and method and device for retrieving, writing, modifying or deleting file | |
| CN103402067B (en) | A kind of video recording covering method being worth grading based on file | |
| CN103488709A (en) | Method and system for building indexes and method and system for retrieving indexes | |
| Ma et al. | KSQ: Top-k similarity query on uncertain trajectories | |
| CN101963982A (en) | Method for managing metadata of redundancy deletion and storage system based on location sensitive Hash | |
| CN110858210B (en) | Data query method and device | |
| CN103186668A (en) | Method and device for processing data as well as data storage system based on key value data base | |
| CN103198150A (en) | Big data indexing method and system | |
| CN106933511A (en) | Consider the GML data storage method for organizing and system of load balancing and disk efficiency | |
| CN108205562A (en) | Location data storage, search method and its device of GIS-Geographic Information System | |
| CN102024019A (en) | Suffix tree based catalog organizing method in distributed file system | |
| CN102253985A (en) | File system data management method and system | |
| CN107301249A (en) | A kind of file access information recording method, system and distributed cluster system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170718 |
|
| RJ01 | Rejection of invention patent application after publication |