CN109857737A - A kind of cold and hot date storage method and device, electronic equipment - Google Patents
A kind of cold and hot date storage method and device, electronic equipment Download PDFInfo
- Publication number
- CN109857737A CN109857737A CN201910004424.8A CN201910004424A CN109857737A CN 109857737 A CN109857737 A CN 109857737A CN 201910004424 A CN201910004424 A CN 201910004424A CN 109857737 A CN109857737 A CN 109857737A
- Authority
- CN
- China
- Prior art keywords
- data
- cold
- dsc
- library
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003860 storage Methods 0.000 title claims abstract description 53
- 238000000034 method Methods 0.000 title claims abstract description 52
- 230000004044 response Effects 0.000 claims description 22
- 241001269238 Data Species 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 7
- 238000013500 data storage Methods 0.000 claims description 7
- 238000004891 communication Methods 0.000 description 11
- 230000000737 periodic effect Effects 0.000 description 11
- 238000012545 processing Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000010438 heat treatment Methods 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 238000012546 transfer Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000012217 deletion Methods 0.000 description 3
- 230000037430 deletion Effects 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 230000000712 assembly Effects 0.000 description 2
- 238000000151 deposition Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000005401 electroluminescence Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to data update method field, a kind of cold and hot date storage method and device, electronic equipment are disclosed.The described method includes: the dsc data in dsc data library is backed up to cold data library；Wherein, dsc data library is for storing dsc data, and cold data library is for storing cold data；Dsc data is the data that data access frequency is greater than or equal to default access frequency in target duration, and cold data is the data that data access frequency is less than default access frequency in target duration；Judge in dsc data library with the presence or absence of the target dsc data for being changed into cold data；Target dsc data if it exists deletes the target dsc data from dsc data library.In the embodiment of the present invention, it enables to high real-time and high-cost dsc data library stores the dsc data frequently accessed by node, the cold data that the storage of the cold data library of low real-time and low cost is infrequently accessed, to greatly save carrying cost, and farthest guarantee the access utilization rate of data.
Description
Technical field
The present invention relates to data update method field, in particular to a kind of cold and hot date storage method and device, electronics are set
It is standby.
Background technique
Development and continuous service with business, the operation system of enterprise often generate a large amount of data, these data
It is stored in database, so that user accesses according to different business demands.Currently, being visited to cope with high-frequency data
It asks, most enterprises use the higher large-scale storage cluster of real-time performance (such as MySQL, Cassandra and MongoDB)
Data are stored.However, crossing conference due to data volume the access performance of database is declined, if in order to match constantly
Increased data scale and build more databases, then will lead to carrying cost and increase significantly.
Summary of the invention
In order to solve the problems, such as that data carrying cost present in the relevant technologies is higher, the present invention provides a kind of cold and hot numbers
According to storage method and device, electronic equipment.
First aspect of the embodiment of the present invention discloses a kind of cold and hot date storage method, which comprises
Dsc data in dsc data library is backed up into cold data library；Wherein, the dsc data library is for storing the hot number
According to the cold data library is for storing cold data；The dsc data is that data access frequency is greater than or equal in advance in target duration
If the data of access frequency, the cold data is that data access frequency is less than the default access frequency in the target duration
Data；
Judge in the dsc data library with the presence or absence of the target dsc data for being changed into the cold data；
The target dsc data if it exists deletes the target dsc data from the dsc data library.
As an alternative embodiment, in first aspect of the embodiment of the present invention, it is described will be in dsc data library
Dsc data backs up to before cold data library, the method also includes:
Judge whether there is data to be stored；
The data to be stored if it exists obtains the data type of the data to be stored；
Judge in the data type for the dsc data that the dsc data library is stored whether include the data to be stored number
According to type；
If so, the data to be stored is loaded onto the dsc data library；
If it is not, the data to be stored is loaded onto the cold data library.
As an alternative embodiment, in first aspect of the embodiment of the present invention, it is described will be in dsc data library
Dsc data backs up to before cold data library, the method also includes:
Judge to repeat cold data with the presence or absence of identical with dsc data any in the dsc data library in the cold data library；
It is described if it does not exist to repeat cold data, execute the step that the dsc data by dsc data library backs up to cold data library
Suddenly；
It is described if it exists to repeat cold data, repetition heat identical with the repetition cold data is deleted from the dsc data library
Data, and by delete it is described repeat dsc data after dsc data library in remaining dsc data back up to the cold data library.
As an alternative embodiment, in first aspect of the embodiment of the present invention, the heat by dsc data library
Data backup is to cold data library, comprising:
When detecting that the dsc data library is in close state, the dsc data in the dsc data library is backed up to described
Cold data library；Wherein, the dsc data includes in data file, control file, on-line file, Parameter File and password file
At least one；
After the dsc data by dsc data library backs up to cold data library, the method also includes:
When detecting that the dsc data library is in operating status, by archive mode to the hot number in the dsc data library
According to progress warm back-up.
As an alternative embodiment, in first aspect of the embodiment of the present invention, the method also includes:
Judge in the cold data library with the presence or absence of the target cold data for being changed into the dsc data；
The target cold data is loaded onto the dsc data library by the target cold data if it exists.
As an alternative embodiment, in first aspect of the embodiment of the present invention, the judgement cold data library
In with the presence or absence of being changed into the target cold data of the dsc data, comprising:
Judge whether to detect the access request to any cold data in the cold data library；
If detecting the access request, the interim cold data that the access request is accessed is loaded onto warm database,
And the accumulative access times to the interim cold data in the temperature database；Wherein, the response speed in the dsc data library
Greater than the response speed of the temperature database, the response speed of the temperature database is greater than the response speed in the cold data library；
Judge whether the access times of the interim cold data are greater than or equal to default access times；
If the access times of the interim cold data are greater than or equal to the default access times, it is determined that exist and be changed into
The target cold data of the dsc data, using the interim cold data in the temperature database as the target cold data；
If the access times of the interim cold data are less than the default access times, it is determined that described there is no being changed into
The target cold data of dsc data；
The target cold data described if it exists, is loaded onto the dsc data library for the target cold data, comprising:
The target cold data is loaded onto the dsc data from the temperature database by the target cold data if it exists
Library.
As an alternative embodiment, in first aspect of the embodiment of the present invention, the method also includes:
The target cold data if it exists, obtains the target data type of the target cold data, and by the cold data
The other cold datas removed except the target cold data corresponding with the target data type are loaded onto the hot number in library
According to library.
Second aspect of the embodiment of the present invention discloses a kind of cold and hot data storage device, and described device includes:
Backup units, for the dsc data in dsc data library to be backed up to cold data library；Wherein, the dsc data library is used for
The dsc data is stored, the cold data library is for storing cold data；The dsc data is data access frequency in target duration
More than or equal to the data of default access frequency, the cold data is less than described pre- for data access frequency in the target duration
If the data of access frequency；
Judging unit, for judging in the dsc data library with the presence or absence of the target dsc data for being changed into the cold data；
Unit is deleted, for determining in the judging unit there are when the target dsc data, by the target dsc data
It is deleted from the dsc data library.
The third aspect of the embodiment of the present invention discloses a kind of electronic equipment, and the electronic equipment includes:
Processor；
Memory is stored with computer-readable instruction on the memory, and the computer-readable instruction is by the processing
When device executes, cold and hot date storage method disclosed in first aspect of the embodiment of the present invention is realized.
Fourth aspect of the embodiment of the present invention discloses a kind of computer readable storage medium, stores computer program, institute
Stating computer program makes computer execute cold and hot date storage method disclosed in first aspect of the embodiment of the present invention.
The technical solution that the embodiment of the present invention provides can include the following benefits:
Cold and hot date storage method provided by the present invention includes the following steps:
Dsc data in dsc data library is backed up into cold data library, wherein dsc data library is for storing dsc data, cold data
Library is for storing cold data；Dsc data is the data that data access frequency is greater than or equal to default access frequency in target duration,
Cold data is the data that data access frequency is less than default access frequency in target duration；Judging, which whether there is in dsc data library, turns
Become the target dsc data of cold data, if it exists target dsc data, target dsc data is deleted from dsc data library.
Under the method, by the way that the dsc data in dsc data library is periodically backuped to cold data library, and high frequency spy will be lost
Property target dsc data deleted from dsc data library, can access frequency characteristic for data so that high real-time and it is high at
This dsc data library stores the dsc data frequently accessed by node, the cold data library storage of low real-time and low cost infrequently by
The cold data of access to greatly save carrying cost, and farthest guarantees the access utilization rate of data.
It should be understood that the above general description and the following detailed description are merely exemplary, this can not be limited
Invention.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows and meets implementation of the invention
Example, and in specification together principle for explaining the present invention.
Fig. 1 is a kind of structural schematic diagram of device disclosed by the embodiments of the present invention；
Fig. 2 is a kind of flow chart of cold and hot date storage method disclosed by the embodiments of the present invention；
Fig. 3 is the flow chart of the cold and hot date storage method of another kind disclosed by the embodiments of the present invention；
Fig. 4 is a kind of structural schematic diagram of cold and hot data storage device disclosed by the embodiments of the present invention.
Specific embodiment
Here will the description is performed on the exemplary embodiment in detail, the example is illustrated in the accompanying drawings.Following description is related to
When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistented with the present invention.On the contrary, they be only with it is such as appended
The example of device and method being described in detail in claims, some aspects of the invention are consistent.
Embodiment one
Implementation environment of the invention can be electronic equipment, such as smart phone, tablet computer, desktop computer.
Fig. 1 is a kind of structural schematic diagram of device disclosed by the embodiments of the present invention.Device 100 can be above-mentioned electronics and set
It is standby.As shown in Figure 1, device 100 may include following one or more components: processing component 102, memory 104, power supply module
106, multimedia component 108, audio component 110, sensor module 114 and communication component 116.
The integrated operation of the usual control device 100 of processing component 102, such as with display, telephone call, data communication, phase
Machine operation and the associated operation of record operation etc..Processing component 102 may include one or more processors 118 to execute
Instruction, to complete all or part of the steps of following methods.In addition, processing component 102 may include one or more modules,
For convenient for the interaction between processing component 102 and other assemblies.For example, processing component 102 may include multi-media module, use
In to facilitate the interaction between multimedia component 108 and processing component 102.
Memory 104 is configured as storing various types of data to support the operation in device 100.These data are shown
Example includes the instruction of any application or method for operating on the device 100.Memory 104 can be by any kind of
Volatibility or non-volatile memory device or their combination are realized, such as static random access memory (Static
RandomAccess Memory, abbreviation SRAM), electrically erasable programmable read-only memory (Electrically Erasable
Programmable Read-Only Memory, abbreviation EEPROM), Erasable Programmable Read Only Memory EPROM (Erasable
Programmable Read Only Memory, abbreviation EPROM), programmable read only memory (Programmable Red-
Only Memory, abbreviation PROM), read-only memory (Read-Only Memory, abbreviation ROM), magnetic memory, flash
Device, disk or CD.It is also stored with one or more modules in memory 104, is configured to for the one or more module
It is executed by the one or more processors 118, to complete all or part of step in method as follows.
Power supply module 106 provides electric power for the various assemblies of device 100.Power supply module 106 may include power management system
System, one or more power supplys and other with for device 100 generate, manage, and distribute the associated component of electric power.
Multimedia component 108 includes the screen of one output interface of offer between device 100 and user.In some realities
It applies in example, screen may include liquid crystal display (Liquid Crystal Display, abbreviation LCD) and touch panel.If
Screen includes touch panel, and screen may be implemented as touch screen, to receive input signal from the user.Touch panel includes
One or more touch sensors are to sense the gesture on touch, slide, and touch panel.Touch sensor can be sensed not only
The boundary of a touch or slide action, but also detect duration and pressure relevant to touch or slide.Screen may be used also
To include display of organic electroluminescence (Organic Light Emitting Display, abbreviation OLED).
Audio component 110 is configured as output and/or input audio signal.For example, audio component 110 includes a Mike
Wind (Microphone, abbreviation MIC), when device 100 is in operation mode, such as call model, logging mode and speech recognition mould
When formula, microphone is configured as receiving external audio signal.The received audio signal can be further stored in memory
104 or via communication component 116 send.In some embodiments, audio component 110 further includes a loudspeaker, for exporting
Audio signal.
Sensor module 114 includes one or more sensors, and the state for providing various aspects for device 100 is commented
Estimate.For example, sensor module 114 can detecte the state that opens/closes of device 100, the relative positioning of component, sensor group
Part 114 can be with the position change of 100 1 components of detection device 100 or device and the temperature change of device 100.Some
In embodiment, which can also include Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 116 is configured to facilitate the communication of wired or wireless way between device 100 and other equipment.Device
100 can access the wireless network based on communication standard, such as WiFi (Wireless-Fidelity, Wireless Fidelity).In the present invention
In embodiment, communication component 116 receives broadcast singal or broadcast correlation from external broadcasting management system via broadcast channel
Information.In embodiments of the present invention, communication component 116 further includes near-field communication (Near Field Communication, abbreviation
NFC) module, for promote short range communication.For example, radio frequency identification (Radio Frequency can be based in NFC module
Identification, abbreviation RFID) technology, Infrared Data Association (Infrared DataAssociation, abbreviation IrDA)
Technology, ultra wide band (UltraWideband, abbreviation UWB) technology, Bluetooth technology and other technologies are realized.
In the exemplary embodiment, device 100 can be by one or more application specific integrated circuit (Application
Specific Integrated Circuit, abbreviation ASIC), it is digital signal processor, digital signal processing appts, programmable
Logical device, field programmable gate array, controller, microcontroller, microprocessor or other electronic components are realized, for executing
Following methods.
Embodiment two
Referring to Fig. 2, Fig. 2 is a kind of flow diagram of cold and hot date storage method disclosed by the embodiments of the present invention.Such as
The cold and hot date storage method shown in Fig. 2 may comprise steps of:
201, the dsc data in dsc data library is backed up into cold data library；Wherein, dsc data library is cold for storing dsc data
Database is for storing cold data；Dsc data is the number that data access frequency is greater than or equal to default access frequency in target duration
According to cold data is the data that data access frequency is less than default access frequency in target duration.
In the embodiment of the present invention, dsc data library can be used for storing the higher dsc data of access frequency (such as online class number
According to), need to cope with complicated inquiry, insertion, update and delete operation, also, in order to preferentially ensure the efficient of readwrite performance
Property and timeliness, usually require that inquiry velocity to be accurate to the several seconds even Millisecond.It is, therefore, to be understood that dsc data library can be with
Select input cost high, database, such as MySQL, Cassandra and MongoDB of excellent performance etc..It necessarily, can be with
Using large scale database cluster storage system, by the memory node in increase system come parallel data processing request, to fill
The performance advantage and effective rate of utilization of database are waved in distribution, obtain higher concurrent access performance.Cold data library can be used for depositing
The storage lower cold data of access frequency (such as enterprise's Backup Data, business and operation log data and ticket and statistical data
Deng), wherein cold data usually requires that the longer holding time, therefore the data volume of cold data can achieve ten times of dsc data
Even hundred times, also, cold data generally need to only handle simple inquiry operation, and it is high to the tolerance of inquiry velocity, or even can
Allow asynchronous process.It is, therefore, to be understood that cold data library can be using the cloud storage mode of low cost, such as the iobs of safety
With the S3 of Amazon etc..The embodiment of the present invention is not construed as limiting.
As an alternative embodiment, before step 201, can with the following steps are included:
Judge whether there is data to be stored；
Data to be stored if it exists obtains the data type of the data to be stored；
Judge in the data type for the dsc data that dsc data library is stored whether include the data to be stored data type；
If so, the data to be stored is loaded onto dsc data library；If it is not, the data to be stored is loaded onto cold data library.
As it can be seen that implementing optional embodiment, the data based on data type of the same race have the spy of similar access frequency
Point can be confirmed whether exist and the number respectively according to the data type of data to be stored from cold data library and dsc data library
According to the data of type matching, to determine the storage location of data to be stored, to improve the efficiency of data backup.
It is appreciated that may be all not present and data to be stored identical data class in cold data library and dsc data library in this way
The data of type since the creation time of the data type is shorter, have stronger timeliness in this case, can should
Data to be stored is as dsc data.Therefore, as an alternative embodiment, if judging in dsc data library and cold data library
Data corresponding with the data type are all not present, the data to be stored is preferably loaded onto dsc data library.
202, judge in dsc data library with the presence or absence of the target dsc data for being changed into cold data, wherein target heat if it exists
When data, step 203 is executed；If it does not exist when target dsc data, terminate this process.
In the embodiment of the present invention, optionally, judge in dsc data library with the presence or absence of the target dsc data for being changed into cold data
Mode can be with are as follows:
Detect the target dsc data for being lower than preset minimum heat degree threshold in dsc data library with the presence or absence of hot value；Wherein,
Hot value is for the accumulative specified unit time interior access frequency to dsc data.Therefore, if the access frequency of any dsc data is low
In the minimum access frequency of minimum heat degree threshold defined, then it can be determined that the dsc data is target dsc data.For example, record pair
The access time started of certain data is S, accesses the data each time, and amount of access is added up one, is obtained when specifying unit in the E moment
In (such as every 30 minutes) amount of access Q, then the hot value of the data are as follows: P=Q* (E-S)/T.If set specified unit
Interior minimum heat degree threshold is P0, P < P is judged whether there is by hot value calculated result0, come in Test database whether
There are the target dsc datas that hot value is lower than preset minimum heat degree threshold.
It is further appreciated that dsc data longer for creation time, such as the year before or even before the longer time
Browsing record information, can usually lose reference value, and can seldom be accessed, therefore, can by creation time and
Access frequency is paid the utmost attention to the dsc data that creation time is longer and access frequency is not high and is turned collectively as the criterion of hot value
A possibility that becoming cold data.
203, the target dsc data is deleted from dsc data library.
As an alternative embodiment, before being deleted in dsc data library, can also be wrapped by the target dsc data
Include following steps:
Judge whether the target dsc data has periodic regularity；
If the periodic regularity of the target dsc data can be determined, the target dsc data is first loaded onto periodical number
According to library, then executes and delete the target dsc data from dsc data library；Wherein, periodic data library is for storing according to specified week
Phase is loaded on the data in dsc data library；
Further, after the target dsc data is loaded onto periodic data library, can with the following steps are included:
According to the periodic regularity of the target dsc data, according to the specified period automatically by the target dsc data from the period
Property database is loaded onto dsc data library.
For example, a transaction information in every month No. 2 to No. 5 can be inquired frequently, and only can in other times
It will not even be queried by inquiry once in a while, therefore, this kind of transaction data was stored in the period within one month most of the time
In property database, No. 2 to No. 5 in every month are just loaded on dsc data library.As it can be seen that according to service conditions and data rule come
Data are periodically loaded onto dsc data library, not only saved unnecessary memory space in most of time, but also can be in time
Cope with the query demand of specific period.It is appreciated that the real-time performance in periodic data library can be lower than dsc data library.
As it can be seen that implement method described in Fig. 2, it can be by the way that the dsc data in dsc data library be periodically backuped to cold data
Library, and the target dsc data for losing high frequency characteristics is deleted from dsc data library, access frequency characteristic for data, so that
High real-time and high-cost dsc data library store the dsc data frequently accessed by node, the cold data of low real-time and low cost
The cold data that library storage is infrequently accessed to greatly save carrying cost, and farthest guarantees the access of data
Utilization rate；And it can be confirmed whether to deposit from cold data library and dsc data library respectively according to the data type of data to be stored
With the matched data of the data type, to determine the storage location of data to be stored, to improve the efficiency of data backup.
Embodiment three
Referring to Fig. 3, Fig. 3 is the flow diagram of the cold and hot date storage method of another kind disclosed by the embodiments of the present invention.
As shown in figure 3, the cold and hot date storage method may comprise steps of:
301, judge to repeat cold data with the presence or absence of identical with dsc data any in dsc data library in cold data library, if depositing
Cold data is being repeated, step 302 is executed；Cold data is repeated if it does not exist, executes step 303.
302, repetition dsc data identical with the repetition cold data is deleted from dsc data library, and will delete the hot number of the repetition
Remaining dsc data in dsc data library after backs up to cold data library, directly execution step 304.
In the embodiment of the present invention, if judging to have cold number identical with dsc data any in dsc data library in cold data library
It is to repeat cold data, and dsc data identical with cold data is repeated is attached most importance to re-heat in dsc data library according to, it is determined that the cold data
Data.
As it can be seen that implement 301~step 302 of above-mentioned steps, it can be before the dsc data in backup dsc data library, to cold number
Detected according to the cold data in library, thus by dsc data library from the different dsc data of storing data backs up in cold data library
To cold data library, the Data duplication rate in cold data library is reduced, avoids occupying excessive space because of the storage repeatedly of identical data.
303, when detecting that dsc data library is in close state, the dsc data in dsc data library is backed up into cold data
Library.
In the embodiment of the present invention, dsc data library is for storing dsc data, and cold data library is for storing cold data；Dsc data is
Data access frequency is greater than or equal to the data of default access frequency in target duration, and cold data is data access in target duration
Frequency is less than the data of default access frequency；Dsc data include data file, control file, on-line file, Parameter File and
At least one of password file.
As it can be seen that implement above-mentioned steps 303, it can be when dsc data library be in close state, by will be in dsc data library
Dsc data cold standby is to cold data library, to reduce the losing probability of data in dsc data library.In addition, cold standby also has backup
Fast speed, filing difficulty are lower, be easy to restore data to specific timing node, maintenance cost is lower and safe coefficient
Higher advantage.
In the embodiment of the present invention, optionally, when detecting that dsc data library is in operating status, by archive mode to heat
Dsc data in database carries out warm back-up.Specifically, also hot standby using what is specified when dsc data library is in operating status
Part storage equipment, stores equipment for the data backup in dsc data library to warm back-up every specified time, and sequentially in time
Record log sequence number.It bursts, warm back-up is stored corresponding with newest log serial number hot standby in equipment if dsc data library is run quickly
Part data file is loaded onto the dsc data library after restarting, the real-time hot backup data before can restoring collapse.
It further, can be with by the mode of the data backup in dsc data library to warm back-up storage equipment are as follows: by dsc data
In data backed up in a manner of removing repeated data warm back-up storage equipment, to reduce the occupied storage of repeated data
Space.And be loaded onto weight in the hot backup data file corresponding with newest log serial number warm back-up stored in equipment
It before dsc data library after opening, can also judge whether the dsc data library after restarting can operate normally, run, then hold if normal
The hot backup data file corresponding with newest log serial number being about in warm back-up storage equipment is loaded onto the hot number after restarting
According to library；If being unable to operate normally, it is necessary to issue the warning information in maintenance dsc data library.
As it can be seen that implement optional embodiment, it can be when there is loss of data or other abnormal conditions, according to fortune
Back up in realtime data and the history cold standby data in the dsc data library of row state, recover data as much as possible, to drop
It is low because accessing probability of failure caused by corrupted data or loss.
304, judge in dsc data library with the presence or absence of the target dsc data for being changed into cold data, wherein target heat if it exists
When data, step 305 is executed；If it does not exist when target dsc data, terminate this process.
305, the target dsc data is deleted from dsc data library.
As an alternative embodiment, the embodiment of the present invention can with the following steps are included:
Judge in cold data library with the presence or absence of the target cold data for being changed into dsc data；
The target cold data is loaded onto dsc data library by target cold data if it exists.
As it can be seen that according to the access frequency to cold data in cold data library, will can repeatedly be accessed in cold data library and
The data for restoring high frequency characteristics are reloaded to dsc data library, to improve the access efficiency to data.
Further, as an alternative embodiment, it is if cold in the presence of the target for being changed into dsc data in cold data library
Data, obtain the target data type of the target cold data, and by removing corresponding with the target data type in cold data library
Other cold datas except target cold data are loaded onto dsc data library.For example, before achievement reports meeting, in order to count
The order situation of enterprise needs frequently to access the sales order data of storage in the database.If to the pin in a certain department's April
It sells order data to carry out after frequently accessing, the sales order data in department April is loaded onto dsc data from cold data library
It library correspondingly can be by the department in other sales order data of the same quarter and the sales order of other relevant departments
Data are loaded onto warm database from cold data library, pre- in advance to carry out to the data for belonging to sales order type in cold data library
Heat.
As it can be seen that if there is the target cold data for being changed into dsc data in cold data library, it will be understood that with target cold data category
In other cold datas of data type of the same race, there is also accessed Potential feasibilities, therefore, implement optional embodiment, energy
Enough by carrying out intelligent screening to the cold data in cold data library, by other cold datas with target cold data data type of the same race
It is loaded onto dsc data library jointly, to improve the efficiency of data call.
As another optional embodiment, there is the cold number of target for being changed into dsc data in judging cold data library
According to later, and before the target cold data is loaded onto dsc data library, following steps can also be performed:
Determine the corresponding data label of target cold data；Wherein it is possible to be believed according to industry type and type of service etc.
Breath type classifies to data label；Optionally, since industry type may include production, logistics, medical treatment and bank etc., because
It further includes further each for any specific industry that this, which can distribute level one data label for the data of different industries type,
The secondary data of different service types in corresponding the sector type can be then arranged in the type of service of class under level one data label
Label can be that a level-one label is arranged is bank to the transfer data for example, for a bank transfer data, and two
Grade label is the data label of transferred account service.
Correspondingly, the mode that the target cold data is loaded onto dsc data library is specifically as follows:
According to the corresponding data label of target cold data, heat is loaded into using the target cold data as newly-increased dsc data
The position of the data label is corresponded in database.
As it can be seen that carrying out classification storage by the data to different types of data, it can be improved and homogeneous data is inserted into
And the treatment effeciency of the operations such as deletion.
Preferably, judge in cold data library with the presence or absence of the mode for the target cold data for being changed into dsc data specifically:
Judge whether to detect the access request to any cold data in cold data library；
If detecting access request, the interim cold data which is accessed is loaded onto warm database, and adds up
To the access times of the interim cold data in warm database；Wherein, the response speed in dsc data library is greater than the sound of warm database
Speed is answered, the response speed of warm database is greater than the response speed in cold data library；
Judge whether the access times of the interim cold data are greater than or equal to default access times, if the interim cold data
Access times are greater than or equal to default access times, it is determined that there is the target cold data for being changed into dsc data；If this is interim cold
The access times of data are less than default access times, it is determined that there is no the target cold datas for being changed into the dsc data；
Correspondingly, the target cold data, is loaded onto the mode in dsc data library by target cold data if it exists specifically:
The target cold data is loaded onto dsc data library from warm database by target cold data if it exists.
In the embodiment of the present invention, if being more than default access times to the access times of any cold data, it can be confirmed that this is cold
Data are target cold data, for example, if default access times are set as 10 times, then the cold data needs to be interviewed in cold data library
Asking 10 times can just be determined being changed into dsc data, further, due to waiting the access times of the cold data to be accumulate to 10 times
During, access efficiency of the cold data in cold data library is lower, therefore, can use response speed and is slightly better than cold data
The warm database in library plays the role of carrying out the pre-heat treatment to data, to improve data access efficiency.
It is furthermore preferred that after the interim cold data for being accessed the access request is loaded onto warm database, and tired
Before meter is to the access times of the interim cold data in warm database, following steps can also be performed:
The timing since the interim cold data for being accessed the access request is loaded onto warm database is detected in timing duration
Before reaching default response time, if be able to detect that the access request to the interim cold data in warm database；
If detecting access request within default response time, accumulative interim cold number in warm database is executed
According to access times；If access request is not detected, which is loaded onto cold data library from warm database.
As it can be seen that by setting to the access interval duration of interim cold data, can save long-term not accessed interim cold
Data occupied memory space in warm database, to preferably play the performance of warm database.
As it can be seen that method described in implementing Fig. 3, it can be by the way that the dsc data in dsc data library be periodically backuped to cold data
Library, and the target dsc data for losing high frequency characteristics is deleted from dsc data library, access frequency characteristic for data, so that
High real-time and high-cost dsc data library store the dsc data frequently accessed by node, the cold data of low real-time and low cost
The cold data that library storage is infrequently accessed to greatly save carrying cost, and farthest guarantees the access of data
Utilization rate；And the cold data in cold data library can be detected before the dsc data in backup dsc data library, from
And by dsc data library from the different dsc data of storing data backs up to cold data library in cold data library, reduce in cold data library
Data duplication rate, avoid occupying excessive space because of the storage repeatedly of identical data；And it can be in and close in dsc data library
When closed state, by by the dsc data cold standby in dsc data library to cold data library, to reduce losing for data in dsc data library
Lose probability；And it according to the access frequency to cold data in cold data library, will can repeatedly be accessed in cold data library and extensive
The data of multiple high frequency characteristics are reloaded to dsc data library, to improve the access efficiency to data；And it can be according to wait deposit
The data type for storing up data is confirmed whether exist and the matched number of the data type respectively from cold data library and dsc data library
According to determine the storage location of data to be stored, to improve the efficiency of data backup；And it can use response speed summary
Better than the warm database in cold data library, play the role of carrying out the pre-heat treatment to data, to improve data access efficiency.
Example IV
Referring to Fig. 4, Fig. 4 is a kind of structural schematic diagram of cold and hot data storage device disclosed by the embodiments of the present invention.Such as
Shown in Fig. 4, the cold and hot data storage device may include: backup units 401, judging unit 402 and delete unit 403,
In,
Backup units 401, for the dsc data in dsc data library to be backed up to cold data library；Wherein, dsc data library is used for
Dsc data is stored, cold data library is for storing cold data；Dsc data is that data access frequency is greater than or equal in advance in target duration
If the data of access frequency, cold data is the data that data access frequency is less than default access frequency in target duration.
Judging unit 402, for judging in dsc data library with the presence or absence of the target dsc data for being changed into cold data.
In the embodiment of the present invention, optionally, judging unit 402, which judges to whether there is in dsc data library, is changed into cold data
The mode of target dsc data can be with are as follows:
Detect the target dsc data for being lower than preset minimum heat degree threshold in dsc data library with the presence or absence of hot value；Wherein,
Hot value is for the accumulative specified unit time interior access frequency to dsc data.Therefore, if the access frequency of any dsc data is low
In the minimum access frequency of minimum heat degree threshold defined, then it can be determined that the dsc data is target dsc data.For example, record pair
The access time started of certain data is S, accesses the data each time, and amount of access is added up one, is obtained when specifying unit in the E moment
In (such as every 30 minutes) amount of access Q, then the hot value of the data are as follows: P=Q* (E-S)/T.If set specified unit
Interior minimum heat degree threshold is P0, P < P is judged whether there is by hot value calculated result0, come in Test database whether
There are the target dsc datas that hot value is lower than preset minimum heat degree threshold.
It is further appreciated that dsc data longer for creation time, such as the year before or even before the longer time
Browsing record information, can usually lose reference value, and can seldom be accessed, therefore, can by creation time and
Access frequency is paid the utmost attention to the dsc data that creation time is longer and access frequency is not high and is turned collectively as the criterion of hot value
A possibility that becoming cold data.
Judging unit 402, is also used to:
Before the dsc data in dsc data library is backed up to cold data library by backup units 401, judge whether there is wait deposit
Store up data；
Data to be stored if it exists obtains the data type of the data to be stored；
Judge in the data type for the dsc data that dsc data library is stored whether include the data to be stored data type；
If so, the data to be stored is loaded onto dsc data library；If it is not, the data to be stored is loaded onto cold data library.
As it can be seen that implementing optional embodiment, the data based on data type of the same race have the spy of similar access frequency
Point can be confirmed whether exist and the number respectively according to the data type of data to be stored from cold data library and dsc data library
According to the data of type matching, to determine the storage location of data to be stored, to improve the efficiency of data backup.
It is appreciated that may be all not present and data to be stored identical data class in cold data library and dsc data library in this way
The data of type since the creation time of the data type is shorter, have stronger timeliness in this case, can should
Data to be stored is as dsc data.Therefore, as an alternative embodiment, if judging in dsc data library and cold data library
Data corresponding with the data type are all not present, the data to be stored is preferably loaded onto dsc data library.
Unit 403 is deleted, for determining in judging unit 402 there are when target dsc data, by the target dsc data from heat
It is deleted in database.
As an alternative embodiment, judging unit 402 is also used to:
The target dsc data before deleting in dsc data library, is being judged whether the target dsc data has periodical rule
Rule；
If the periodic regularity of the target dsc data can be determined, the target dsc data is first loaded onto periodical number
According to library, then executes and delete the target dsc data from dsc data library；Wherein, periodic data library is for storing according to specified week
Phase is loaded on the data in dsc data library；
Further, after the target dsc data is loaded onto periodic data library, can with the following steps are included:
According to the periodic regularity of the target dsc data, according to the specified period automatically by the target dsc data from the period
Dsc data library is loaded onto property database.
For example, a transaction information in every month No. 2 to No. 5 can be inquired frequently, and only can in other times
It will not even be queried by inquiry once in a while, therefore, this kind of transaction data was stored in the period within one month most of the time
In property database, No. 2 to No. 5 in every month are just loaded on dsc data library.As it can be seen that according to service conditions and data rule come
Data are periodically loaded onto dsc data library, not only saved unnecessary memory space in most of time, but also can be in time
Cope with the query demand of specific period.It is appreciated that the real-time performance in periodic data library can be lower than dsc data library.
As it can be seen that implement device described in Fig. 4, it can be by the way that the dsc data in dsc data library be periodically backuped to cold data
Library, and the target dsc data for losing high frequency characteristics is deleted from dsc data library, access frequency characteristic for data, so that
High real-time and high-cost dsc data library store the dsc data frequently accessed by node, the cold data of low real-time and low cost
The cold data that library storage is infrequently accessed to greatly save carrying cost, and farthest guarantees the access of data
Utilization rate；And it can be confirmed whether to deposit from cold data library and dsc data library respectively according to the data type of data to be stored
With the matched data of the data type, to determine the storage location of data to be stored, to improve the efficiency of data backup.
Embodiment five
Referring to Fig. 4, Fig. 4 is a kind of structural schematic diagram of cold and hot data storage device disclosed by the embodiments of the present invention.Such as
Shown in Fig. 4, in the cold and hot data storage device:
Judging unit 402, be also used to backup units 401 by the dsc data in dsc data library back up to cold data library it
Before, judge to repeat cold data with the presence or absence of identical with dsc data any in dsc data library in cold data library.
Unit 403 is deleted, is also used to delete from dsc data library when judging unit 402 determines and there is repetition cold data
It is identical with the repetition cold data to repeat dsc data.
Backup units 401 are used to back up to the dsc data in dsc data library the mode in cold data library specifically:
Backup units 401, it is for when detecting that dsc data library is in close state, the dsc data in dsc data library is standby
Part to cold data library；Wherein, dsc data includes in data file, control file, on-line file, Parameter File and password file
At least one.
In the embodiment of the present invention, optionally, backup units 401 are also used to:
When detecting that dsc data library is in operating status, heat is carried out to the dsc data in dsc data library by archive mode
Backup.Specifically, when dsc data library is in operating status, equipment is also stored using specified warm back-up, when specified
Between the data backup in dsc data library to warm back-up stored into equipment, and record log sequence number sequentially in time.If hot number
It runs quickly and bursts according to library, be then loaded onto hot backup data file corresponding with newest log serial number in warm back-up storage equipment after restarting
Dsc data library, can restore collapse before real-time hot backup data.
Further, backup units 401 can be with by the mode of the data backup in dsc data library to warm back-up storage equipment
Are as follows: the data in dsc data are backed up into warm back-up storage equipment in a manner of removing repeated data, to reduce repeated data
Occupied memory space.And warm back-up is being stored into hot backup data text corresponding with newest log serial number in equipment
Part is loaded onto before the dsc data library after restarting, and can also judge whether the dsc data library after restarting can operate normally, if just
Often operation then executes that warm back-up is stored hot backup data file corresponding with newest log serial number in equipment and is loaded onto and restarts
Dsc data library afterwards；If being unable to operate normally, it is necessary to issue the warning information in maintenance dsc data library.
As it can be seen that implement optional embodiment, it can be when there is loss of data or other abnormal conditions, according to fortune
Back up in realtime data and the history cold standby data in the dsc data library of row state, recover data as much as possible, to drop
It is low because accessing probability of failure caused by corrupted data or loss.
Backup units 401 are also used to delete from dsc data library in deletion unit 403 identical heavy with the repetition cold data
After re-heat data, remaining dsc data deleted in the dsc data library after the repetition dsc data is backed up into cold data library.
Judging unit 402, is also used to:
Judge in cold data library with the presence or absence of the target cold data for being changed into dsc data；
The target cold data is loaded onto dsc data library by target cold data if it exists.
As it can be seen that according to the access frequency to cold data in cold data library, will can repeatedly be accessed in cold data library and
The data for restoring high frequency characteristics are reloaded to dsc data library, to improve the access efficiency to data.
Further, as an alternative embodiment, being changed into if judging unit 402 determines to exist in cold data library
The target cold data of dsc data, obtains the target data type of the target cold data, and by cold data library with the target data
The corresponding other cold datas removed except target cold data of type are loaded onto dsc data library.For example, in achievement report-back meeting
Before view, in order to count the order situation of enterprise, need frequently to access the sales order data of storage in the database.If to certain
The sales order data in one department April carry out after frequently accessing, by the sales order data in department April from cold data library
In be loaded onto dsc data library, correspondingly, can be by the department is in other sales order data of the same quarter and other are related
The sales order data of department are loaded onto warm database from cold data library, with to belonging to sales order type in cold data library
Data are preheated in advance.
As it can be seen that if there is the target cold data for being changed into dsc data in cold data library, it will be understood that with target cold data category
In other cold datas of data type of the same race, there is also accessed Potential feasibilities, therefore, implement optional embodiment, energy
Enough by carrying out intelligent screening to the cold data in cold data library, by other cold datas with target cold data data type of the same race
It is loaded onto dsc data library jointly, to improve the efficiency of data call.
As another optional embodiment, judge to exist in cold data library in judging unit 402 and be changed into hot number
According to target cold data after, and before the target cold data is loaded onto dsc data library, following steps can also be performed:
Determine the corresponding data label of target cold data；Wherein it is possible to be believed according to industry type and type of service etc.
Breath type classifies to data label；Optionally, since industry type may include production, logistics, medical treatment and bank etc., because
It further includes further each for any specific industry that this, which can distribute level one data label for the data of different industries type,
The secondary data of different service types in corresponding the sector type can be then arranged in the type of service of class under level one data label
Label can be that a level-one label is arranged is bank to the transfer data for example, for a bank transfer data, and two
Grade label is the data label of transferred account service.
Correspondingly, the mode that the target cold data is loaded onto dsc data library is specifically as follows:
According to the corresponding data label of target cold data, heat is loaded into using the target cold data as newly-increased dsc data
The position of the data label is corresponded in database.
As it can be seen that carrying out classification storage by the data to different types of data, it can be improved and homogeneous data is inserted into
And the treatment effeciency of the operations such as deletion.
Preferably, judging unit 402 judges in cold data library with the presence or absence of the side for the target cold data for being changed into dsc data
Formula specifically:
Judge whether to detect the access request to any cold data in cold data library；
If detecting access request, the interim cold data which is accessed is loaded onto warm database, and adds up
To the access times of the interim cold data in warm database；Wherein, the response speed in dsc data library is greater than the sound of warm database
Speed is answered, the response speed of warm database is greater than the response speed in cold data library；
Judge whether the access times of the interim cold data are greater than or equal to default access times, if the interim cold data
Access times are greater than or equal to default access times, it is determined that there is the target cold data for being changed into dsc data；If this is interim cold
The access times of data are less than default access times, it is determined that there is no the target cold datas for being changed into the dsc data.
Correspondingly, if judging unit 402 determines that there are target cold datas, are loaded onto dsc data library for the target cold data
Mode specifically:
If judging unit 402 determines that there are target cold datas, are loaded onto dsc data from warm database for the target cold data
Library.
In the embodiment of the present invention, if being more than default access times to the access times of any cold data, it can be confirmed that this is cold
Data are target cold data, for example, if default access times are set as 10 times, then the cold data needs to be interviewed in cold data library
Asking 10 times can just be determined being changed into dsc data, further, due to waiting the access times of the cold data to be accumulate to 10 times
During, access efficiency of the cold data in cold data library is lower, therefore, can use response speed and is slightly better than cold data
The warm database in library plays the role of carrying out the pre-heat treatment to data, to improve data access efficiency.
It is furthermore preferred that after the interim cold data for being accessed the access request is loaded onto warm database, and tired
Before meter is to the access times of the interim cold data in warm database, following steps can also be performed:
The timing since the interim cold data for being accessed the access request is loaded onto warm database is detected in timing duration
Before reaching default response time, if be able to detect that the access request to the interim cold data in warm database；
If detecting access request within default response time, accumulative interim cold number in warm database is executed
According to access times；If access request is not detected, which is loaded onto cold data library from warm database.
As it can be seen that by setting to the access interval duration of interim cold data, can save long-term not accessed interim cold
Data occupied memory space in warm database, to preferably play the performance of warm database.
As it can be seen that implement device described in Fig. 4, it can be by the way that the dsc data in dsc data library be periodically backuped to cold data
Library, and the target dsc data for losing high frequency characteristics is deleted from dsc data library, access frequency characteristic for data, so that
High real-time and high-cost dsc data library store the dsc data frequently accessed by node, the cold data of low real-time and low cost
The cold data that library storage is infrequently accessed to greatly save carrying cost, and farthest guarantees the access of data
Utilization rate；And the cold data in cold data library can be detected before the dsc data in backup dsc data library, from
And by dsc data library from the different dsc data of storing data backs up to cold data library in cold data library, reduce in cold data library
Data duplication rate, avoid occupying excessive space because of the storage repeatedly of identical data；And it can be in and close in dsc data library
When closed state, by by the dsc data cold standby in dsc data library to cold data library, to reduce losing for data in dsc data library
Lose probability；And it according to the access frequency to cold data in cold data library, will can repeatedly be accessed in cold data library and extensive
The data of multiple high frequency characteristics are reloaded to dsc data library, to improve the access efficiency to data；And it can be according to wait deposit
The data type for storing up data is confirmed whether exist and the matched number of the data type respectively from cold data library and dsc data library
According to determine the storage location of data to be stored, to improve the efficiency of data backup；And it can use response speed summary
Better than the warm database in cold data library, play the role of carrying out the pre-heat treatment to data, to improve data access efficiency.
The present invention also provides a kind of electronic equipment, which includes:
Processor；
Memory is stored with computer-readable instruction on the memory, when which is executed by processor,
Realize cold and hot date storage method as previously shown.
The electronic equipment can be Fig. 1 shown device 100.
In one exemplary embodiment, the present invention also provides a kind of computer readable storage mediums, are stored thereon with calculating
Machine program when the computer program is executed by processor, realizes cold and hot date storage method as previously shown.
It should be understood that the present invention is not limited to the precise structure already described above and shown in the accompanying drawings, and
And various modifications and change can executed without departing from the scope.The scope of the present invention is limited only by the attached claims.
Claims (10)
1. a kind of cold and hot date storage method, which is characterized in that the described method includes:
Dsc data in dsc data library is backed up into cold data library；Wherein, the dsc data library is for storing the dsc data, institute
Cold data library is stated for storing cold data；The dsc data is that data access frequency is greater than or equal to default access in target duration
The data of frequency, the cold data are the data that data access frequency is less than the default access frequency in the target duration；
Judge in the dsc data library with the presence or absence of the target dsc data for being changed into the cold data；
The target dsc data if it exists deletes the target dsc data from the dsc data library.
2. the method according to claim 1, wherein backing up to cold number in the dsc data by dsc data library
Before library, the method also includes:
Judge whether there is data to be stored；
The data to be stored if it exists obtains the data type of the data to be stored；
Judge in the data type for the dsc data that the dsc data library is stored whether include the data to be stored data class
Type；
If so, the data to be stored is loaded onto the dsc data library；
If it is not, the data to be stored is loaded onto the cold data library.
3. the method according to claim 1, wherein backing up to cold number in the dsc data by dsc data library
Before library, the method also includes:
Judge to repeat cold data with the presence or absence of identical with dsc data any in the dsc data library in the cold data library；
It is described if it does not exist to repeat cold data, execute the step of dsc data by dsc data library backs up to cold data library；
It is described if it exists to repeat cold data, the hot number of repetition identical with the repetition cold data is deleted from the dsc data library
According to, and by delete it is described repeat dsc data after dsc data library in remaining dsc data back up to the cold data library.
4. described in any item methods according to claim 1~3, which is characterized in that described that dsc data in dsc data library is standby
Part to cold data library, comprising:
When detecting that the dsc data library is in close state, the dsc data in the dsc data library is backed up into the cold number
According to library；Wherein, the dsc data includes data file, controls in file, on-line file, Parameter File and password file extremely
Few one kind；
After the dsc data by dsc data library backs up to cold data library, the method also includes:
When detecting that the dsc data library is in operating status, by archive mode to the dsc data in the dsc data library into
Row warm back-up.
5. method according to any one of claims 1 to 4, which is characterized in that the method also includes:
Judge in the cold data library with the presence or absence of the target cold data for being changed into the dsc data；
The target cold data is loaded onto the dsc data library by the target cold data if it exists.
6. according to the method described in claim 5, being changed into it is characterized in that, whether there is in the judgement cold data library
The target cold data of the dsc data, comprising:
Judge whether to detect the access request to any cold data in the cold data library；
If detecting the access request, the interim cold data that the access request is accessed is loaded onto warm database, and tires out
Count the access times to the interim cold data in the temperature database；Wherein, the response speed in the dsc data library is greater than
The response speed of the temperature database, the response speed of the temperature database are greater than the response speed in the cold data library；
Judge whether the access times of the interim cold data are greater than or equal to default access times；
If the access times of the interim cold data are greater than or equal to the default access times, it is determined that exist described in being changed into
The target cold data of dsc data, using the interim cold data in the temperature database as the target cold data；
If the access times of the interim cold data are less than the default access times, it is determined that there is no be changed into the hot number
According to target cold data；
The target cold data described if it exists, is loaded onto the dsc data library for the target cold data, comprising:
The target cold data is loaded onto the dsc data library from the temperature database by the target cold data if it exists.
7. method according to claim 5 or 6, which is characterized in that the method also includes:
The target cold data if it exists obtains the target data type of the target cold data, and will be in the cold data library
The other cold datas removed except the target cold data corresponding with the target data type are loaded onto the dsc data library.
8. a kind of cold and hot data storage device, which is characterized in that described device includes:
Backup units, for the dsc data in dsc data library to be backed up to cold data library；Wherein, the dsc data library is for storing
The dsc data, the cold data library is for storing cold data；The dsc data is that data access frequency is greater than in target duration
Or the data equal to default access frequency, the cold data are that data access frequency is less than the default visit in the target duration
Ask the data of frequency；
Judging unit, for judging in the dsc data library with the presence or absence of the target dsc data for being changed into the cold data；
Unit is deleted, for determining in the judging unit there are when the target dsc data, by the target dsc data from institute
It states and is deleted in dsc data library.
9. a kind of electronic equipment, including memory and processor, the memory are stored with computer program, which is characterized in that
The step of processor realizes method according to any one of claims 1 to 7 when executing the computer program.
10. a kind of computer readable storage medium, which is characterized in that it stores computer program, and the computer program makes
Computer perform claim requires 1~7 described in any item cold and hot date storage methods.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910004424.8A CN109857737B (en) | 2019-01-03 | 2019-01-03 | Cold and hot data storage method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910004424.8A CN109857737B (en) | 2019-01-03 | 2019-01-03 | Cold and hot data storage method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109857737A true CN109857737A (en) | 2019-06-07 |
| CN109857737B CN109857737B (en) | 2024-04-16 |
Family
ID=66893830
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910004424.8A Active CN109857737B (en) | 2019-01-03 | 2019-01-03 | Cold and hot data storage method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109857737B (en) |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110430098A (en) * | 2019-08-12 | 2019-11-08 | 中国南方电网有限责任公司 | Data processing system |
| CN110532234A (en) * | 2019-08-30 | 2019-12-03 | 杭州迪普科技股份有限公司 | A kind of storage method and device of vulnerability scanning data |
| CN110865992A (en) * | 2019-10-30 | 2020-03-06 | 腾讯云计算（北京）有限责任公司 | Retrieval library management method, retrieval device and retrieval medium |
| CN111339105A (en) * | 2020-03-27 | 2020-06-26 | 泰康保险集团股份有限公司 | Data storage method and device and server |
| CN111614730A (en) * | 2020-04-28 | 2020-09-01 | 北京金山云网络技术有限公司 | File processing method and device of cloud storage system and electronic equipment |
| CN111858498A (en) * | 2020-07-31 | 2020-10-30 | 北京金山云网络技术有限公司 | Storage type conversion method, system, device and equipment |
| CN111858657A (en) * | 2020-07-21 | 2020-10-30 | 威讯柏睿数据科技(北京)有限公司 | Method and equipment for accelerating data parallel query based on high-frequency data processing |
| CN111858520A (en) * | 2020-07-21 | 2020-10-30 | 杭州溪塔科技有限公司 | Method and device for separately storing block link point data |
| CN111930555A (en) * | 2020-09-02 | 2020-11-13 | 平安国际智慧城市科技股份有限公司 | Erasure code based file processing method and device and computer equipment |
| CN112699142A (en) * | 2020-12-29 | 2021-04-23 | 平安普惠企业管理有限公司 | Cold and hot data processing method and device, electronic equipment and storage medium |
| CN112700021A (en) * | 2021-01-14 | 2021-04-23 | 树根互联技术有限公司 | Maintenance method and device for remote equipment, storage medium and electronic equipment |
| CN113051271A (en) * | 2021-03-26 | 2021-06-29 | 郑州阿帕斯数云信息科技有限公司 | Cold and hot data separation method, device and equipment |
| CN113177216A (en) * | 2021-04-30 | 2021-07-27 | 北京市商汤科技开发有限公司 | Data transmission method and device, computer equipment and storage medium |
| CN113254477A (en) * | 2021-06-04 | 2021-08-13 | 威讯柏睿数据科技(北京)有限公司 | Data acquisition method and equipment based on memory |
| CN113420021A (en) * | 2021-07-14 | 2021-09-21 | 苏州峰之鼎信息科技有限公司 | Data storage method, device, equipment and medium |
| CN113452726A (en) * | 2020-03-24 | 2021-09-28 | 中兴通讯股份有限公司 | Data transmission method, terminal and computer readable storage medium |
| CN113515497A (en) * | 2020-04-09 | 2021-10-19 | 奇安信安全技术(珠海)有限公司 | Database data processing method, device and system |
| CN113687766A (en) * | 2020-05-19 | 2021-11-23 | 中移动信息技术有限公司 | Data storage method, device, equipment and storage medium |
| CN113779426A (en) * | 2020-06-10 | 2021-12-10 | 深圳云天励飞技术有限公司 | Data storage method and device, terminal equipment and storage medium |
| CN113900597A (en) * | 2021-11-30 | 2022-01-07 | 深圳市安信达存储技术有限公司 | Data storage method, system, equipment and storage medium |
| CN113963695A (en) * | 2021-10-13 | 2022-01-21 | 深圳市欧瑞博科技股份有限公司 | Awakening method, awakening device, equipment and storage medium of intelligent equipment |
| CN114004979A (en) * | 2021-11-05 | 2022-02-01 | 江苏赞奇科技股份有限公司 | High-cost-performance data storage method and system in cloud rendering |
| CN114510481A (en) * | 2022-02-15 | 2022-05-17 | 中国农业银行股份有限公司 | User credit data information storage method, device and equipment |
| CN114860726A (en) * | 2022-04-29 | 2022-08-05 | 北京永信至诚科技股份有限公司 | Database storage cold-hot separation method, device, equipment and readable storage medium |
| CN117472967A (en) * | 2023-12-28 | 2024-01-30 | 江西铜锐信息技术有限公司 | Data life cycle management method and system based on data use heat |
| CN117931530A (en) * | 2024-03-22 | 2024-04-26 | 山东昌禹知商信息技术服务有限公司 | Database physical backup recovery processing method and system |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6137644A (en) * | 1998-05-19 | 2000-10-24 | International Business Machines Corporation | Method for adaptive formatting and track traversal in data storage devices |
| US6324620B1 (en) * | 1998-07-23 | 2001-11-27 | International Business Machines Corporation | Dynamic DASD data management and partitioning based on access frequency utilization and capacity |
| US20080133456A1 (en) * | 2006-12-01 | 2008-06-05 | Anita Richards | Managing access to data in a multi-temperature database |
| CN104462194A (en) * | 2014-10-28 | 2015-03-25 | 北京国双科技有限公司 | Service data processing method, device and server |
| CN104516471A (en) * | 2013-09-27 | 2015-04-15 | 国际商业机器公司 | Method and device for managing power supply of storage system |
| KR101533340B1 (en) * | 2014-04-09 | 2015-07-06 | 인하대학교 산학협력단 | A method of data replication using data access frequency and erasure codes in cloud storage system |
| CN106156331A (en) * | 2016-07-06 | 2016-11-23 | 益佳科技（北京）有限责任公司 | Cold and hot temperature data server system and processing method thereof |
| US20180046381A1 (en) * | 2016-08-09 | 2018-02-15 | International Business Machines Corporation | Hybrid compressed media in a tiered storage environment |
| CN107979636A (en) * | 2017-11-10 | 2018-05-01 | 上海华讯网络系统有限公司 | Cold and hot data divide media storage Platform Designing system and method |
| US20180157655A1 (en) * | 2016-12-02 | 2018-06-07 | International Business Machines Corporation | Data migration using a migration data placement tool between storage systems based on data access |
| CN108829341A (en) * | 2018-05-03 | 2018-11-16 | 上海科技大学 | A kind of data managing method based on mixing storage system |
| CN109299085A (en) * | 2018-11-07 | 2019-02-01 | 平安医疗健康管理股份有限公司 | A kind of data processing method, electronic equipment and storage medium |
| CN109491618A (en) * | 2018-11-20 | 2019-03-19 | 上海科技大学 | Data management system, method, terminal and medium based on mixing storage |
-
2019
- 2019-01-03 CN CN201910004424.8A patent/CN109857737B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6137644A (en) * | 1998-05-19 | 2000-10-24 | International Business Machines Corporation | Method for adaptive formatting and track traversal in data storage devices |
| US6324620B1 (en) * | 1998-07-23 | 2001-11-27 | International Business Machines Corporation | Dynamic DASD data management and partitioning based on access frequency utilization and capacity |
| US20080133456A1 (en) * | 2006-12-01 | 2008-06-05 | Anita Richards | Managing access to data in a multi-temperature database |
| CN104516471A (en) * | 2013-09-27 | 2015-04-15 | 国际商业机器公司 | Method and device for managing power supply of storage system |
| KR101533340B1 (en) * | 2014-04-09 | 2015-07-06 | 인하대학교 산학협력단 | A method of data replication using data access frequency and erasure codes in cloud storage system |
| CN104462194A (en) * | 2014-10-28 | 2015-03-25 | 北京国双科技有限公司 | Service data processing method, device and server |
| CN106156331A (en) * | 2016-07-06 | 2016-11-23 | 益佳科技（北京）有限责任公司 | Cold and hot temperature data server system and processing method thereof |
| US20180046381A1 (en) * | 2016-08-09 | 2018-02-15 | International Business Machines Corporation | Hybrid compressed media in a tiered storage environment |
| US20180157655A1 (en) * | 2016-12-02 | 2018-06-07 | International Business Machines Corporation | Data migration using a migration data placement tool between storage systems based on data access |
| CN107979636A (en) * | 2017-11-10 | 2018-05-01 | 上海华讯网络系统有限公司 | Cold and hot data divide media storage Platform Designing system and method |
| CN108829341A (en) * | 2018-05-03 | 2018-11-16 | 上海科技大学 | A kind of data managing method based on mixing storage system |
| CN109299085A (en) * | 2018-11-07 | 2019-02-01 | 平安医疗健康管理股份有限公司 | A kind of data processing method, electronic equipment and storage medium |
| CN109491618A (en) * | 2018-11-20 | 2019-03-19 | 上海科技大学 | Data management system, method, terminal and medium based on mixing storage |
Non-Patent Citations (1)
| Title |
|---|
| 魏学才 等: ""适应冷热数据存储的多编码架构的设计与实证"", 计算机应用与软件, vol. 34, no. 02, 15 February 2017 (2017-02-15), pages 35 - 41 * |
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110430098A (en) * | 2019-08-12 | 2019-11-08 | 中国南方电网有限责任公司 | Data processing system |
| CN110532234A (en) * | 2019-08-30 | 2019-12-03 | 杭州迪普科技股份有限公司 | A kind of storage method and device of vulnerability scanning data |
| CN110865992A (en) * | 2019-10-30 | 2020-03-06 | 腾讯云计算（北京）有限责任公司 | Retrieval library management method, retrieval device and retrieval medium |
| CN113452726A (en) * | 2020-03-24 | 2021-09-28 | 中兴通讯股份有限公司 | Data transmission method, terminal and computer readable storage medium |
| CN113452726B (en) * | 2020-03-24 | 2024-02-20 | 中兴通讯股份有限公司 | Data transmission method, terminal and computer readable storage medium |
| EP4084437A4 (en) * | 2020-03-24 | 2023-06-14 | ZTE Corporation | Data transmission method, terminal, and computer-readable storage medium |
| CN111339105A (en) * | 2020-03-27 | 2020-06-26 | 泰康保险集团股份有限公司 | Data storage method and device and server |
| CN111339105B (en) * | 2020-03-27 | 2023-08-15 | 泰康保险集团股份有限公司 | Data storage method, device and server |
| CN113515497A (en) * | 2020-04-09 | 2021-10-19 | 奇安信安全技术(珠海)有限公司 | Database data processing method, device and system |
| CN111614730A (en) * | 2020-04-28 | 2020-09-01 | 北京金山云网络技术有限公司 | File processing method and device of cloud storage system and electronic equipment |
| CN113687766A (en) * | 2020-05-19 | 2021-11-23 | 中移动信息技术有限公司 | Data storage method, device, equipment and storage medium |
| CN113779426A (en) * | 2020-06-10 | 2021-12-10 | 深圳云天励飞技术有限公司 | Data storage method and device, terminal equipment and storage medium |
| CN111858657B (en) * | 2020-07-21 | 2022-02-22 | 威讯柏睿数据科技(北京)有限公司 | Method and equipment for accelerating data parallel query based on high-frequency data processing |
| CN111858520B (en) * | 2020-07-21 | 2024-03-22 | 杭州溪塔科技有限公司 | Method and device for separately storing block chain node data |
| CN111858657A (en) * | 2020-07-21 | 2020-10-30 | 威讯柏睿数据科技(北京)有限公司 | Method and equipment for accelerating data parallel query based on high-frequency data processing |
| CN111858520A (en) * | 2020-07-21 | 2020-10-30 | 杭州溪塔科技有限公司 | Method and device for separately storing block link point data |
| CN111858498A (en) * | 2020-07-31 | 2020-10-30 | 北京金山云网络技术有限公司 | Storage type conversion method, system, device and equipment |
| CN111930555A (en) * | 2020-09-02 | 2020-11-13 | 平安国际智慧城市科技股份有限公司 | Erasure code based file processing method and device and computer equipment |
| CN112699142A (en) * | 2020-12-29 | 2021-04-23 | 平安普惠企业管理有限公司 | Cold and hot data processing method and device, electronic equipment and storage medium |
| CN112700021A (en) * | 2021-01-14 | 2021-04-23 | 树根互联技术有限公司 | Maintenance method and device for remote equipment, storage medium and electronic equipment |
| CN113051271B (en) * | 2021-03-26 | 2024-01-19 | 郑州阿帕斯数云信息科技有限公司 | Cold and hot data separation method, device and equipment thereof |
| CN113051271A (en) * | 2021-03-26 | 2021-06-29 | 郑州阿帕斯数云信息科技有限公司 | Cold and hot data separation method, device and equipment |
| CN113177216A (en) * | 2021-04-30 | 2021-07-27 | 北京市商汤科技开发有限公司 | Data transmission method and device, computer equipment and storage medium |
| CN113177216B (en) * | 2021-04-30 | 2023-03-14 | 北京市商汤科技开发有限公司 | Data transmission method and device, computer equipment and storage medium |
| CN113254477A (en) * | 2021-06-04 | 2021-08-13 | 威讯柏睿数据科技(北京)有限公司 | Data acquisition method and equipment based on memory |
| CN113420021A (en) * | 2021-07-14 | 2021-09-21 | 苏州峰之鼎信息科技有限公司 | Data storage method, device, equipment and medium |
| CN113963695A (en) * | 2021-10-13 | 2022-01-21 | 深圳市欧瑞博科技股份有限公司 | Awakening method, awakening device, equipment and storage medium of intelligent equipment |
| CN114004979A (en) * | 2021-11-05 | 2022-02-01 | 江苏赞奇科技股份有限公司 | High-cost-performance data storage method and system in cloud rendering |
| CN114004979B (en) * | 2021-11-05 | 2023-09-01 | 江苏赞奇科技股份有限公司 | High-cost performance data storage method and system in cloud rendering |
| CN113900597A (en) * | 2021-11-30 | 2022-01-07 | 深圳市安信达存储技术有限公司 | Data storage method, system, equipment and storage medium |
| CN114510481A (en) * | 2022-02-15 | 2022-05-17 | 中国农业银行股份有限公司 | User credit data information storage method, device and equipment |
| CN114860726A (en) * | 2022-04-29 | 2022-08-05 | 北京永信至诚科技股份有限公司 | Database storage cold-hot separation method, device, equipment and readable storage medium |
| CN117472967A (en) * | 2023-12-28 | 2024-01-30 | 江西铜锐信息技术有限公司 | Data life cycle management method and system based on data use heat |
| CN117472967B (en) * | 2023-12-28 | 2024-05-03 | 江西铜锐信息技术有限公司 | Data life cycle management method and system based on data use heat |
| CN117931530A (en) * | 2024-03-22 | 2024-04-26 | 山东昌禹知商信息技术服务有限公司 | Database physical backup recovery processing method and system |
| CN117931530B (en) * | 2024-03-22 | 2024-06-07 | 山东昌禹知商信息技术服务有限公司 | Database physical backup recovery processing method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109857737B (en) | 2024-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109857737A (en) | A kind of cold and hot date storage method and device, electronic equipment | |
| US10318391B2 (en) | Non-blocking listener registration in the presence of data grid nodes joining the cluster | |
| US10824608B2 (en) | Feature generation and storage in a multi-tenant environment | |
| CN101097556B (en) | Method and system for updating metadata in a logical volume | |
| CN103544153A (en) | Data updating method and system based on database | |
| US20180107393A1 (en) | Placement and movement of sub-units of a storage unit in a tiered storage environment | |
| US11301483B2 (en) | Data object aggregation to manage an order summary | |
| US20180260465A1 (en) | Synchronizing data stores for different size data objects | |
| CN101673192A (en) | Method for time-sequence data processing, device and system therefor | |
| WO2022161325A1 (en) | Prompting method and electronic device | |
| CN109241067A (en) | transaction data management method and device | |
| US11188854B2 (en) | Systems and methods for assignment of equipment to an officer | |
| US10499265B2 (en) | System and method for “always on” offline transaction collection | |
| US20180329900A1 (en) | Prediction models for concurrency control types | |
| US10733148B2 (en) | Predicate based data deletion | |
| CN109491700A (en) | Multiple version application issued method, apparatus and relevant device | |
| US8595251B2 (en) | Flexible interface module | |
| US20220269801A1 (en) | Real-time feature activation in distributed environment | |
| EP2909773A1 (en) | Application modes determined from previous and current states of a license | |
| US11467971B2 (en) | Systems and methods for accelerating data computation | |
| CN112116427A (en) | Commodity recommendation method and device, electronic equipment and storage medium | |
| CN109783313A (en) | A kind of system exception processing method and system | |
| CN116578571A (en) | Method, device, computer equipment and storage medium for updating guest group data | |
| US11893633B2 (en) | Adjustment of card configurations for flight interruptions | |
| US20110131215A1 (en) | Process apparatus, data scheduling method, and computer readable medium thereof for a data schedule |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |