CN107665219A - A kind of blog management method and device - Google Patents
A kind of blog management method and device Download PDFInfo
- Publication number
- CN107665219A CN107665219A CN201610617168.6A CN201610617168A CN107665219A CN 107665219 A CN107665219 A CN 107665219A CN 201610617168 A CN201610617168 A CN 201610617168A CN 107665219 A CN107665219 A CN 107665219A
- Authority
- CN
- China
- Prior art keywords
- write
- data
- sequence identification
- operation order
- write operation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2358—Change logging, detection, and notification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/1734—Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application is related to database technical field, discloses a kind of blog management method and device, for lifting performance of the data base management system in journal recovery.This method includes：The sequence identification and the sequence identification for being write data object carrying carried according at least one data being read object, determine the operation order of the first pending write operation；According to the data read from least one data being read object, first write operation is performed to the data object of being write；First write operation and the fixed operation order are write into the transaction journal, and the sequence identification for being write data object carrying is replaced with into sequence identification corresponding to the fixed operation order.
Description
Technical field
The application is related to database technical field, more particularly to a kind of blog management method and device.
Background technology
In database technical field, affairs are the base units that database performs data processing.When performing an affairs,
If using the issued transaction from start to end the involved operation information data item special as one with binary side
Formula is recorded, and here it is transaction journal.Transaction journal is recorded in units of affairs, and each journal entry is remembered in detail
The information of issued transaction has been recorded, to ensure system when being necessary, such as when database failure recovery, this can have been recurred
Affairs.
Ahead daily record is a kind of implementation method of transaction journal of database generally use, and ahead daily record ensures logarithm
Occur according to the modification of file after transaction journal writes permanent memory, i.e., can be by record data text when affairs are submitted
The transaction journal of part modification all writes disk, and the database page that affairs were changed does not have to write disk immediately, if number
Broken down according to storehouse, database can be recovered with the transaction journal of persistent storage.
When large-scale database is managed and safeguarded, easily occur the speed of service slowly, data recovery unsuccessfully etc.
Problem.Under modern multicore architecture, the lifting of database performance is suitable to realize using the concurrency of higher degree.High degree of parallelism
Transaction journal management method while data Trusted recovery is ensured, can be greatly enhanced database data processing speed
Degree, lift the performance of database.
The content of the invention
The embodiment of the present application provides a kind of blog management method and device, to improve database carry out data recovery and
Row degree.
The concrete technical scheme that the embodiment of the present application provides is as follows：
First aspect, there is provided a kind of blog management method, this method are applied to database, and the database includes affairs day
Will and data acquisition system, the data acquisition system include at least two data objects, and the data object carries sequence identification, described suitable
Sequence identifies the operation order for characterizing the write operation when data object last time is performed write operation, the affairs
Daily record is used for the operation order for recording the write operation and the write operation, and the data object includes at least one by reading
Data object is write according to object and one, methods described includes implementations below：According at least one data being read pair
Sequence identification and the sequence identification for being write data object carrying as carrying, determine the operation of the first pending write operation
Sequentially；According to the data read from least one data being read object, described first is performed to the data object of being write
Write operation；First write operation and the fixed operation order are write into the transaction journal, and write described
The sequence identification that data object carries replaces with sequence identification corresponding to the fixed operation order.
The present embodiment has the beneficial effect that：By being identified to data object allocation order, according to what is carried for data object
Sequence identification determines the operation order mark of write operation, and writes into transaction journal, in such manner, it is possible to by transaction journal affix one
The operation order mark of individual local order, in fault recovery, it can be identified by the operation order carried in transaction journal, really
The partial ordering relation of fixed each transaction journal, so as to improve the degree of parallelism for recovering data by transaction journal, and ensure to pass through affairs
The validity and correctness of journal recovery data, the processing speed of database is improved, lift database performance.
In a possible design, the sequence identification carried according at least one data being read object and institute
The sequence identification for being write data object carrying is stated, determines the operation order of the first pending write operation, it is real in the following manner
It is existing：Travel through the sequence identification that at least one data being read object carries and described write described in data object carries
Sequence identification, in the operation order characterized from the sequence identification being traversed, select the operation order finally performed；It is determined that
Next operation order of the operation order finally performed is the operation order of first write operation.
The present embodiment has the beneficial effect that：The accuracy of the logical order between transaction journal can be ensured, passed through in realization
Transaction journal recovers the correctness of partial ordering relation between guarantee transaction journal during data.
In a possible design, the operation order finally performed is N, and the N is random natural number, described true
Next operation order of the fixed operation order finally performed is the operation order of first write operation, i.e., described in determination
The operation order of first write operation is N+1.
In a possible design, the transaction journal includes at least two subtransaction daily records, son described in any two
The operation order of transaction log record is separate；It is described by first write operation and the fixed operation order
The transaction journal is write, is accomplished by the following way：By first write operation and the fixed operation order write-in
For recording the subtransaction daily record for the write operation for being dependent of first write operation.
The present embodiment has the beneficial effect that：Eliminate the critical zone of log management so that transaction journal need not be global again
In order, be advantageous to be lifted the realization of database processing degree of parallelism.
In a possible design, the data object includes primitive or primitive set,
The primitive set includes at least two primitives；It is corresponding, the data object carrying order
Mark, the sequence identification are suitable for characterizing the operation that the data object last time is performed write operation during write operation
Sequence, including：The primitive carries the sequence identification, and the sequence identification is used to characterize the primitive
Last time is performed the operation order of write operation during write operation, or, described in the primitive set carrying
Sequence identification, any primitive last time that the sequence identification is used to characterize in the primitive set
It is performed the operation order of write operation during write operation.
The present embodiment has the beneficial effect that：When data object includes primitive set, each master data
Unit set carries a sequence identification, can reduce the waste of internal memory.
In a possible design, when the data object includes the primitive set, the basis
The sequence identification and the sequence identification for being write data object carrying that at least one data being read object carries, it is determined that treating
Before the operation order of the first write operation performed, the data acquisition system is split as the primitive set.
In a possible design, the data acquisition system includes the table or subregion of the database, the basic number
Include the bucket of the database according to unit set, it is described that the data acquisition system is split as the primitive set, lead to
Cross in the following manner realization：Bucket operation is carried out to the primitive in the table or the subregion, is grouped at least
Two buckets.
The present embodiment has the beneficial effect that：The grouping mechanism of primitive, Ke Yibao are realized based on table or subregion
Demonstrate,prove versatility and convenience that transaction journal partial ordering relation is realized.
In a possible design, the sequence identification carried according at least one data being read object and institute
State the sequence identification for being write data object carrying, before the operation order for determining the first pending write operation, to it is described at least
One data being read object and described write the bucket read lock corresponding to data object.
The present embodiment has the beneficial effect that：Ensure that Current transaction can read accurate data object.
In a possible design, it is described to it is described to it is described write data object perform first write operation it
Before, to it is described write the bucket corresponding to data object and added write lock.
The present embodiment has the beneficial effect that：Ensure that Current transaction can be smoothly and accurately to being write bucket corresponding to data object
Carry out write operation.
In a possible design, the logged sequence is identified as Log Sequence Number LSN or timestamp.
In a possible design, the data being read object is used to write behaviour described in data object progress to described write
Make, realized especially by the following manner, affairs to data being read object to before being write data object execution write operation, performing
Read operation.
In a possible design, the sequence identification carried according at least one data being read object
With the sequence identification for being write data object carrying, it is determined that being write data object to described to carry out the write operation corresponding
The operation order mark, be accomplished by the following way：When reading first data being read object after affairs generation, by institute
The nonce that the sequence identification that first data being read object carries is recorded as the operation order mark is stated, subsequently in the thing
When business often reads a data being read object or write data object, the operation order of current record is identified interim
Value is compared with the sequence identification that the data object currently read carries, in the order mark that the data object currently read carries
When knowing the nonce more than the operation order mark of current record, the operation order of current record is identified interim
Value replaces with the sequence identification that the data object currently read carries；Face what the operation order of final updated record identified
Next sequence identification of duration is defined as the operation order mark.
The present embodiment has the beneficial effect that：The partial ordering relation between transaction journal can be ensured, in fault recovery, it is ensured that
Correct transaction journal recovery order.
Second aspect, there is provided a kind of log management apparatus, the log management apparatus have realize above-mentioned first aspect and
The function of any of possible design method method.The function can be realized by hardware, can also be held by hardware
The corresponding software of row is realized.The hardware or software include one or more modules corresponding with above-mentioned function phase.The daily record pipe
The operation order of one local order of transaction journal affix can be identified by managing device, in fault recovery, can pass through thing
The operation order mark carried in business daily record, determines the partial ordering relation of each transaction journal, extensive by transaction journal so as to improve
The degree of parallelism of complex data, and ensure to recover the validity and correctness of data by transaction journal, improve the processing speed of database
Degree, lift database performance.
The third aspect, there is provided a kind of log management apparatus, the log management apparatus include memory and processor, wherein,
The memory is used to store batch processing, and the processor is used to call the program of the memory storage to perform as described above
Method described in any of first aspect and possible design.
In a possible design, the log management apparatus is applied to database, and the database includes transaction journal
And data acquisition system, the data acquisition system include at least two data objects, the data object carries sequence identification, the order
Identify the operation order for characterizing the write operation when data object last time is performed write operation, the affairs day
Will is used for the operation order for recording the write operation and the write operation, and the data object includes at least one data being read
Object and one are write data object, and the processor is used for：The order carried according at least one data being read object
Mark and the sequence identification for being write data object carrying, determine the operation order of the first pending write operation；According to from
The data that at least one data being read object is read, first write operation is performed to the data object of being write；By institute
State the first write operation and the fixed operation order writes the transaction journal, and the data object of being write is carried
Sequence identification replace with sequence identification corresponding to the fixed operation order.
The present embodiment has the beneficial effect that：Can by the sequence identification of one local order of transaction journal affix, therefore
When barrier recovers, the partial ordering relation of each transaction journal by the sequence identification carried in transaction journal, can be determined, so as to improve
Recover the degree of parallelism of data by transaction journal, and ensure to recover the validity and correctness of data by transaction journal, improve
The processing speed of database, lift database performance.
In a possible design, the processor is used for：Travel through what at least one data being read object carried
The sequence identification and the sequence identification for being write data object carrying, are characterized from the sequence identification being traversed
Operation order in, select the operation order that finally performs；Determine that next operation of the operation order finally performed is suitable
Sequence is the operation order of first write operation.
The present embodiment has the beneficial effect that：The accuracy of the logical order between transaction journal can be ensured, passed through in realization
Transaction journal recovers the correctness of partial ordering relation between guarantee transaction journal during data.
In a possible design, the operation order finally performed is N, and the N is random natural number, the place
Reason device is used for：The operation order for determining first write operation is N+1.
In a possible design, the transaction journal includes at least two subtransaction daily records, son described in any two
The operation order of transaction log record is separate；The processor is additionally operable to：By first write operation and have determined that
The operation order write for record be dependent of first write operation write operation the subtransaction daily record.
The present embodiment has the beneficial effect that：Eliminate the critical zone of log management so that transaction journal need not be global again
In order, be advantageous to be lifted the realization of database processing degree of parallelism.
In a possible design, the data object includes primitive or primitive set,
The primitive set includes at least two primitives；It is corresponding, the data object carrying order
Mark, the sequence identification are suitable for characterizing the operation that the data object last time is performed write operation during write operation
Sequence, including：The primitive carries the sequence identification, and the sequence identification is used to characterize the primitive
Last time is performed the operation order of write operation during write operation, or, described in the primitive set carrying
Sequence identification, any primitive last time that the sequence identification is used to characterize in the primitive set
It is performed the operation order of write operation during write operation.
The present embodiment has the beneficial effect that：When data object includes primitive set, each master data
Unit set carries a sequence identification, can reduce the waste of internal memory.
In a possible design, the processor is additionally operable to：When the data object includes the master data list
During member set, the sequence identification carried according at least one data being read object and the data object of being write carry
Sequence identification, before the operation order for determining the first pending write operation, the data acquisition system is split as described basic
Data cell set.
In a possible design, the data acquisition system includes the table or subregion of the database, the basic number
Include the bucket of the database according to unit set, the processor is additionally operable to：To the base in the table or the subregion
Notebook data unit carries out bucket operation, is grouped at least two buckets.
The present embodiment has the beneficial effect that：The grouping mechanism of primitive, Ke Yibao are realized based on table or subregion
Demonstrate,prove versatility and convenience that transaction journal partial ordering relation is realized.
In a possible design, the processor is additionally operable to：It is described according at least one data being read object
The sequence identification of carrying and the sequence identification for being write data object carrying, determine that the operation of the first pending write operation is suitable
Before sequence, at least one data being read object and described the bucket read lock corresponding to data object is write.
The present embodiment has the beneficial effect that：Ensure that Current transaction can read accurate data object.
In a possible design, the processor is additionally operable to：It is described that described the is performed to the data object of being write
Described to be write to described before data object carries out the write operation before one write operation, to be write data object corresponding to described
The bucket add and write lock.
The present embodiment has the beneficial effect that：Ensure that Current transaction can be smoothly and accurately to being write bucket corresponding to data object
Carry out write operation.
In a possible design, the operation order mark or the sequence identification include：Log Sequence Number
Or timestamp (LSN).
The blog management method and device that the embodiment of the present application proposes, by the data object additional sequence in database
Mark, ensure that the partial order relation of transaction journal, improve the degree of parallelism of database failure recovery, while ensure that daily record
Correctness during recovery.
Brief description of the drawings
Fig. 1 is Database Systems schematic diagram in the embodiment of the present application；
Fig. 2 is Database Systems Organization Chart in the embodiment of the present application；
Fig. 3 is a kind of flow chart of exemplary blog management method in the embodiment of the present application；
Fig. 4 is a kind of example data packet schematic diagram in the embodiment of the present application；
Fig. 5 is the flow chart of another exemplary blog management method in the embodiment of the present application；
Fig. 6 is a kind of exemplary transaction log management Organization Chart in the embodiment of the present application；
Fig. 7 is a kind of example log managing device structure chart in the embodiment of the present application；
Fig. 8 is another example log managing device structure chart in the embodiment of the present application.
Embodiment
In order that the purpose, technical scheme and advantage of the application are clearer, the application is made below in conjunction with accompanying drawing into
One step it is described in detail, it is clear that described embodiment is only some embodiments of the present application, rather than whole implementation
Example.Based on the embodiment in the application, what those of ordinary skill in the art were obtained under the premise of creative work is not made
All other embodiment, belong to the scope of the application protection.
In view of in the prior art, when realizing that database failure recovers according to transaction journal, it is difficult to lifted degree of parallelism so as to
The problem of hindering the raising of database processing speed, the embodiment of the present application proposes a kind of blog management method and device, passes through
The sequence identification of a local order is added to the data object in database, realizes the sequence of the non-ordering relation of transaction journal
Function (non-ordering relation is alternatively referred to as partial ordering relation).The embodiment of the present invention realizes data based on the partial ordering relation of transaction journal
The lifting of the degree of parallelism of storehouse fault recovery, while correctness when ensure that journal recovery.
The method that the embodiment of the present application provides is applied to typical Database Systems, it may include unit and distributed data base
System.
As shown in figure 1, a kind of possible Database Systems framework includes client 101, database in the embodiment of the present application
102 and disk 103.It should be understood that client 101 can have diversified forms, such as desktop computer, notebook computer, man-machine interaction circle
Face etc., it can be accessed, be not construed as limiting with remote controlled manner or local control mode.In one implementation, client
101 and database 102 be in same hardware unit, in another implementation, database 102 and disk 103 are in same
In one hardware unit, in another implementation, client 101, database 102 and disk 103 fill all in same hardware
In putting, it is not construed as limiting.Specifically, by taking unit Database Systems as an example, as shown in Fig. 2 the database 102 in the embodiment of the present application
Possess and realize the achievable function of data base management system, database 102 includes actuator 104, lock table module 105, data
Cache module 106, log buffer module 107 and other management modules 108, disk 103 represent a kind of permanent memory, including number
According to storage region 109 and daily record storage region 110.
Client 101 carries out data interaction with database 102, such as the data in database 102 are searched, repaiied
The operation such as change, insert or delete；Actuator 104 is used to perform the operation corresponding to the function of database 102；Lock table module 105
For realizing the lock management mechanism of database page；Data cache module 106 is used for data cached, log buffer module 107
For caching transaction journal；Data storage areas 109 is used to store the data cached from data cache module 106, and daily record is deposited
Storage area domain 110 is used to store the transaction journal cached from log buffer module 107.
Based on the system architecture shown in Fig. 2, a kind of possible database work process is：Database 102 upon execution, meeting
Data cached and transaction journal is distinguished in data cache module 106 and log buffer module 107, can be by thing when event is submitted
The daily record storage region 110 being engaged in daily record write-in disk 103, the data storage areas that also can periodically write data into disk
109.But in order to ensure the performance of database 102, the write-in of data is delayed, because writing disk ratio in the continuum of transaction journal
The scatter write disk of data is much faster.If database 102 is abnormal delay it is disconnected, when waiting next time and starting, in order to keep the consistent of data
Property, it is necessary to carry out fault recovery, that is, need to be recovered the data for not yet writing disk according to daily record.
Recover the efficiency of data during in order to ensure database failure according to transaction journal, used in the embodiment of the present application parallel
Mode carry out journal recovery, the application preferred embodiment is described in detail below in conjunction with accompanying drawing.
The blog management method that the embodiment of the present application provides is applied to database 102, and database 102 includes transaction journal
And data acquisition system, it is cached in respectively in data cache module 106 and log buffer module 107.
Data acquisition system is from the next data of the loading of data storage areas 109, including at least two data objects.This at least two
Individual data object includes at least one data being read object and one and is write data object, wherein, data being read object and write
Data object determines according to affairs to the operational attribute of data object, for example, the data object that affairs perform read operation claims
For data being read object, the data object that affairs perform write operation is referred to as being write data object.Data being read object be used for pair
Write data object and carry out write operation, for example, affairs have read data being read to being write before data object carries out write operation
Object, the write operation to being write data object is performed according to the content of the data being read object of reading.It should be understood that arbitrarily once
The data object that data being read object in affairs is referred to is likely to become the data object of being write in another secondary affairs, any one
Being write the data object that data object referred to and may also turn into data being read object in another secondary affairs in secondary affairs.
Data object carries sequence identification, when sequence identification is performed write operation for characterize data object last time,
The operation order of the write operation.
Transaction journal is used to record operation order corresponding to the write operation and write operation for carrying out above-mentioned data object.Should
Understand, perform the operation order of write operation each time, and when the write operation performs, what is be performed is write entrained by data object
Sequence identification corresponding relation be present；In embodiments of the present invention, it can be identified to characterize with operation order and data object is carried out
Write operation corresponding to sequence identification.The operation order may be used to determine the opposite logical order of all write operations, with lower section
Can specifically it be introduced in method flow.Said sequence mark includes：Log Sequence Number (English：Log Sequence Number, abbreviation：
) or timestamp LSN.LSN marks aim at the position in transaction log file particular transaction day.Either LSN or timestamp,
The recovery order of transaction journal can be determined when recovering data according to transaction journal.
As shown in figure 3, the flow for the blog management method that the embodiment of the present application provides is as described below.
Step 201：The sequence identification that is carried according at least one data being read object and described write data object
The sequence identification of carrying, determine the operation order of the first pending write operation；
Step 202：According to the data read from least one data being read object, write data object to described and held
Row first write operation；
Step 203：First write operation and the fixed operation order are write into the transaction journal, and will
The sequence identification for being write data object carrying replaces with sequence identification corresponding to the fixed operation order.
In step 201, above-mentioned data being read object can be traveled through and write the sequence identification of data object carrying, from quilt
In the operation order that the sequence identification of traversal is characterized, the operation order finally performed is selected；It is suitable to distribute the operation finally performed
Operation order of the next operation order of sequence as the first write operation.
For example, the above-mentioned operation order finally performed is N, N is random natural number, then the operation order of the first write operation is
For N+1.
Specifically, when selecting data being read object for the first time, it is determined that the order mark that selected data being read object carries
Know and be recorded as the nonce of operation order mark, a data being read object is subsequently often selected, by the data being read pair of selection
As carrying sequence identification with record operation order identify nonce compared with, if the data being read object currently selected
The nonce for the operation order mark that the sequence identification of carrying is recorded, then replace the nonce of recorded operation order mark
The sequence identification carried for the data being read object currently selected, the nonce that the operation order of more new record is identified is with being write
The sequence identification that data object carries is compared, and next sequence identification of higher value between the two is recorded as operating suitable
Sequence identifies.
For example illustrate, it is assumed that affairs T to write data object G1 perform write operation before, to several by reading
The read operation performed respectively according to object G2, G3 ... Gn, each data object carry a sequence identification, it is assumed that G1,
The sequence identification that G2, G3 ... Gn are carried represents that Gs1 will after G1 is performed write operation with Gs1, Gs2, Gs3 ... Gsn respectively
It is updated, the Gs1 after renewal is identical to being write operation order mark corresponding to the write operation of data object G1 execution with affairs T,
Operation order mark=max { Gs1, Gs2, Gs3 ... Gsn }+△ s, max are the computing for taking maximum, and △ s are often to update one
The increment that logged sequence caused by affairs corresponding to individual data combination identifies.Such as Gs1, Gs2, Gs3 ... Gsn are natural number
When, △ s=1.Affairs T is when submitting, by affairs T to being write behaviour corresponding to the write operation and write operation of data object G1 execution
Make sequence identification write-in transaction journal, identified according to operation order corresponding to this write operation, it may be determined that affairs T is to being write number
According to the opposite logical order between the transaction journal and other transaction journals of the object G1 write operations performed.
Optionally, data object includes primitive or primitive set, wherein, primitive
Set includes at least two primitives；Corresponding, data object carries sequence identification, and sequence identification is used to characterize the number
The operation order of write operation when being performed write operation according to object last time, including：Primitive carries sequence identification,
Sequence identification is used for the operation order for characterizing write operation when primitive last time is performed write operation, or,
Primitive set carries sequence identification, and sequence identification is used to characterize any basic number in the primitive set
The operation order of write operation when being performed write operation according to unit last time.
Concretely, above-mentioned data object can be a primitive, such as a data item, then each
Primitive can carry a sequence identification, and sequence identification is to perform last time to this primitive to write behaviour
Order corresponding to making.But a primitive carries a sequence identification and understands some waste memory spaces unavoidably, because
This, in order to save memory space, above-mentioned data object can also be primitive set, for example, a master data list
Member set includes several data item, and a primitive set carries a sequence identification, this primitive
All corresponding this primitive set can be updated when any one primitive in set is performed write operation
Sequence identification.
When data object is primitive set such case, according to above-mentioned at least one data being read object
The sequence identification of carrying and by write data object carrying sequence identification, determine the first pending write operation operation order it
Before, data acquisition system is split as primitive set.It is, data acquisition system is split as according to certain principle some
Individual primitive set.It is a kind of it is possible be achieved in that using the table mechanism in existing database or zoning schemes come
Realize.
Specifically, data acquisition system includes the table (i.e. table) or subregion (i.e. partition) of database, master data
Unit set includes the bucket (i.e. bucket) of database, and bucket operation is carried out (i.e. to the primitive in table or subregion
Hive), at least two barrels are grouped into, a bucket represents a primitive set, including several primitives.
First primitive set is properly termed as first barrel, and the second primitive set is properly termed as second barrel.For example, such as
Shown in Fig. 4, in existing data base management system, data are grouped by table 301, and each bucket 302 represents one
Primitive set.
Optionally, in this case, in above-mentioned steps 201, carried according to above-mentioned at least one data being read object
Sequence identification and write the sequence identification of data object carrying, before the operation order for determining the first pending write operation,
To above-mentioned at least one data being read object and bucket read lock corresponding to data object is write, i.e., to first barrel and second barrel plus is read
Lock, so that affairs read the data in first barrel and second barrel；
Optionally, in this case, in above-mentioned steps 202, read according to from above-mentioned at least one data being read object
Data, to being write before data object performs the first write operation, add to being write bucket corresponding to data object and write lock, i.e., second barrel
Add and write lock, so that affairs perform write operation to the data in second barrel.
The bucket of table, primitive set including database for including database with reference to data acquisition system is this specific
The blog management method that provides the embodiment of the present application of application scenarios be described in further detail.
As shown in fig.5, the flow of blog management method is as described below.
Step 401：Judge whether affairs are submitted, if so, then performing step 408；Otherwise step 402 is performed.
Step 402：Judge whether affairs read the data in first barrel, if so, then performing step 403, otherwise perform step
Rapid 406.
Step 403：The sequence identification for first barrel of carrying that record is read.
Step 404：Whether compare the sequence identification of this first barrel carrying than the operation order that is recorded for Current transaction
The nonce of mark is big, if so, then performing step 405；Otherwise, return and perform step 402.
Step 405：The nonce that the operation order that Current transaction is recorded identifies is replaced with to the order of first barrel of carrying
Mark.
Step 406：Judge that affairs whether to second barrel of execution write operation, if so, then performing step 407, otherwise return
Step 401.
Here write operation includes the operation of change, deletion etc..
Step 407：Compare the nonce of operation order mark and the order mark of second barrel of carrying that Current transaction is recorded
The size of knowledge, next sequence identification of the greater in both is replaced with into the operation order that Current transaction recorded and identified, after
Continuous return performs 401.
Step 408：Affairs are performed to the operation order mark write-in transaction journal of write operation and record to second barrel, and
When affairs are submitted, transaction journal is write into daily record storage region corresponding to disk.Wherein, the operation order mark of record is added
It is added in the head of transaction journal.
Optionally, the transaction journal described in above-mentioned steps 202 includes at least two subtransaction daily records, the sub- thing of any two
The operation order mark of business log recording is separate；When carrying out write operation to being write data object, by write operation and write
Subtransaction daily record corresponding to operation order mark write-in corresponding to operation.It should be understood that the corresponding subtransaction daily record only record with
There is dependence in above-mentioned write operation, that is, be dependent of other write operations of above-mentioned write operation.Eliminate the critical of log management
Area so that transaction journal need not global orderly again, be advantageous to be lifted the realization of database processing degree of parallelism.
As shown in fig.6, three different users carry out data interaction by different clients 101 and database 102,
Assuming that respectively client 1, client 2 and client 3 represent, affairs 1, affairs 2, affairs 3 are produced respectively, each affairs are in day
Possess independent log recording space in will storage region 110, it is assumed that respectively with daily record storage region 1, the and of daily record storage region 2
Daily record storage region 3 represents that each affairs write the transaction journal of processing in corresponding daily record storage region 110 respectively, that
This does not conflict, and can accomplish the fully parallelized of journalizing, farthest ensure that the concurrent extended capability of log buffer.
When recovering data according to transaction journal, the transaction journal that is read from different daily record storage regions carries according in them
Operation order mark determine log replay precedence.
Based on same inventive concept, the embodiment of the present application additionally provides a kind of log management apparatus, the log management apparatus
With the function of realizing above-mentioned blog management method, the function can be realized by hardware, can also be performed by hardware corresponding
Software realize.The hardware or software include one or more modules corresponding with above-mentioned function phase.
As shown in fig.7, a kind of possible implementation is, the log management apparatus 600 includes：The He of writing unit 601
Identify allocation unit 602.
Writing unit 601, for according to the data read from least one data being read object, being held to being write data object
The write operation of row first；
Allocation unit 602 is identified, for the sequence identification that is carried according to above-mentioned at least one data being read object and above-mentioned
The sequence identification of data object carrying is write, determines the operation order of the first pending write operation；
Writing unit 601, it is additionally operable to above-mentioned first write operation and the write-in transaction journal of fixed operation order；
Identify allocation unit 602, be additionally operable to by it is above-mentioned by write data object carrying sequence identification replace with it is fixed
Sequence identification corresponding to operation order.
Optionally, mark allocation unit 602 is used for：
Travel through sequence identification that above-mentioned at least one data being read object carries and above-mentioned write the suitable of data object carrying
Sequence identifies, and in the operation order characterized from the sequence identification being traversed, selects the operation order finally performed；
The next operation order for determining the above-mentioned operation order finally performed is the operation order of the first write operation.
Optionally, if the operation order finally performed is N, N is random natural number, and mark allocation unit 602 is used for：It is determined that
The operation order of first write operation is N+1.
Optionally, transaction journal includes at least two subtransaction daily records, and the operation of any two subtransaction log recording is suitable
Sequence is separate；Writing unit 601 is used for：First write operation and fixed operation order are write and be dependent of for record
The subtransaction daily record of the write operation of first write operation.
Optionally, data object includes primitive or primitive set, wherein, primitive
Set includes at least two primitives；
Corresponding, data object carries sequence identification, and sequence identification is performed for characterize data object last time and write
The operation order of write operation during operation, including：Primitive carries sequence identification, and sequence identification is used to characterize basic number
The operation order of write operation when being performed write operation according to unit last time, or, primitive set carrying order
Mark, any primitive last time that sequence identification is used to characterize in primitive set are performed write operation
When the write operation operation order.
Optionally, when data object includes primitive set, device 600 also includes grouped element 603；
Grouped element 603, for identifying allocation unit 602 according to the suitable of above-mentioned at least one data being read object carrying
Sequence identifies and the above-mentioned sequence identification for being write data object carrying, before the operation order for determining the first pending write operation,
Data acquisition system is split as primitive set.
Optionally, data acquisition system includes the table or subregion of database, and primitive set includes the bucket of database,
Grouped element 603 is used for：Bucket operation is carried out to the primitive in table or subregion, is grouped at least two barrels.
Optionally, described device 600 also includes lock cell 604；
Lock cell 604, for identifying allocation unit 602 according to the suitable of above-mentioned at least one data being read object carrying
Sequence identifies and the above-mentioned sequence identification for being write data object carrying, before the operation order for determining the first pending write operation,
To above-mentioned at least one data being read object and above-mentioned write bucket read lock corresponding to data object.
Optionally, lock cell 604, be additionally operable to writing unit 601 to it is above-mentioned write data object and performed first write behaviour
Before work, to it is above-mentioned write bucket corresponding to data object and added write lock.
Optionally, operation order mark or sequence identification include：Log Sequence Number or timestamp.
Based on same inventive concept, as shown in fig.8, the embodiment of the present application also provides a kind of log management apparatus 700, should
Log management apparatus 700 is applied to database, and database includes transaction journal and data acquisition system, and data acquisition system includes at least two
Data object, data object carries sequence identification, when sequence identification is performed write operation for characterize data object last time
The operation order of the write operation, transaction journal include for recording write operation and the operation order of the write operation, data object
At least one data being read object and one are write data object, and the log management apparatus 700 includes memory 701 and processor
702, wherein, memory 701 is used to store batch processing, and the program that processor 702 is used to call memory 701 to store is to perform
Such as above-mentioned blog management method.Processor 702 is used for：The sequence identification that is carried according to above-mentioned at least one data being read object and
The above-mentioned sequence identification for being write data object carrying, determine the operation order of the first pending write operation；According to from least one
The data that individual data being read object is read, the first write operation is performed to being write data object；By the first write operation and fixed
Operation order writes transaction journal, and the sequence identification for being write data object carrying is replaced with into fixed operation order pair
The sequence identification answered.In such manner, it is possible to the operation order of one local order of transaction journal affix is identified, in fault recovery
When, it can be identified by the operation order carried in transaction journal, determine the partial ordering relation of each transaction journal, it is logical so as to improve
The degree of parallelism that transaction journal recovers data is crossed, and ensures to recover the validity and correctness of data by transaction journal, improves number
According to the processing speed in storehouse, database performance is lifted.
Optionally, processor 702 is used for：Travel through sequence identification that above-mentioned at least one data being read object carries and above-mentioned
The sequence identification of data object carrying is write, in the operation order characterized from the sequence identification being traversed, selects last perform
Operation order；It is determined that next operation order of the operation order finally performed is the operation order of the first write operation.So,
The accuracy of the logical order between transaction journal can be ensured, ensure transaction journal when realizing and recovering data by transaction journal
Between partial ordering relation correctness.
Optionally, the operation order finally performed is N, and N is random natural number, and processor 702 is used for：Determine that first writes behaviour
The operation order of work is N+1.
Optionally, transaction journal includes at least two subtransaction daily records, and the operation of any two subtransaction log recording is suitable
Sequence is separate；Processor 702 is additionally operable to：First write operation and fixed operation order are write and be dependent of for record
The subtransaction daily record of the write operation of first write operation.So, the critical zone of log management is eliminated so that transaction journal need not
Global orderly again, be advantageous to be lifted the realization of database processing degree of parallelism.
Optionally, data object includes primitive or primitive set, primitive set
Including at least two primitives；Corresponding, data object carries sequence identification, and sequence identification is used for characterize data object
The operation order of write operation when last time is performed write operation, including：Primitive carries sequence identification, and order is marked
Know the operation order for characterizing write operation when primitive last time is performed write operation, or, master data
Unit set carries sequence identification, and any primitive that sequence identification is used to characterize in primitive set is last
The operation order of write operation when being once performed write operation.When data object includes primitive set, each
Primitive set carries a sequence identification, can reduce the waste of internal memory.
Optionally, processor 702 is additionally operable to：When data object includes primitive set, according to it is above-mentioned at least
The sequence identification and the above-mentioned sequence identification for being write data object carrying that one data being read object carries, determine pending the
Before the operation order of one write operation, data acquisition system is split as primitive set.
Optionally, data acquisition system includes the table or subregion of database, and primitive set includes the bucket of database,
Processor 702 is additionally operable to：Bucket operation is carried out to the primitive in table or subregion, is grouped at least two barrels.So,
The grouping mechanism of primitive is realized based on table or subregion, it is ensured that the versatility that transaction journal partial ordering relation is realized
And convenience.
Optionally, processor 702 is additionally operable to：The sequence identification that is carried according to above-mentioned at least one data being read object and upper
The sequence identification for being write data object carrying is stated, before the operation order for determining the first pending write operation, at least one
Data being read object and write bucket read lock corresponding to data object.Ensure that Current transaction can smoothly and accurately read data pair
As.
Optionally, processor 702 is additionally operable to：To it is above-mentioned write data object perform the first write operation before, to being write number
Add according to bucket corresponding to object and write lock.Ensure that Current transaction smoothly and accurately can enter row write behaviour to being write bucket corresponding to data object
Make.
Optionally, operation order mark or sequence identification include：Log Sequence Number (LSN) or timestamp.
Processor 702 can be central processing unit (English：Central processing unit, abbreviation：CPU), network
Processor (English：Network processor, abbreviation：NP) or CPU and NP combination.
Processor 702 can further include hardware chip.Above-mentioned hardware chip can be application specific integrated circuit (English
Text：Application-specific integrated circuit, abbreviation：ASIC), PLD (English：
Programmable logic device, abbreviation：PLD) or it is combined.Above-mentioned PLD can be CPLD
(English：Complex programmable logic device, abbreviation：CPLD), field programmable gate array (English：
Field-programmable gate array, abbreviation：FPGA), GAL (English：generic array
Logic, abbreviation：GAL) or it is combined.
Memory 701 can include volatile memory (English：Volatile memory), such as random access memory
Device (English：Random-access memory, abbreviation：RAM)；Memory 701 can also include nonvolatile memory (English
Text：Non-volatile memory), such as flash memory (English：Flash memory), hard disk (English：hard disk
Drive, abbreviation：HDD) or solid state hard disc is (English：Solid-state drive, abbreviation：SSD)；Memory 701 can also wrap
Include the combination of the memory of mentioned kind.
It should be understood by those skilled in the art that, embodiments herein can be provided as method, system or computer program
Product.Therefore, the application can use the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Apply the form of example.Moreover, the application can use the computer for wherein including computer usable program code in one or more
The computer program production that usable storage medium is implemented on (including but is not limited to magnetic disk storage, CD-ROM, optical memory etc.)
The form of product.
The application is with reference to the flow according to the method for the embodiment of the present application, equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that can be by every first-class in computer program instructions implementation process figure and/or block diagram
Journey and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided
The processors of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that produced by the instruction of computer or the computing device of other programmable data processing devices for real
The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to
Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or
The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, so as in computer or
The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in individual square frame or multiple square frames.
Although having been described for the preferred embodiment of the application, those skilled in the art once know basic creation
Property concept, then can make other change and modification to these embodiments.So appended claims be intended to be construed to include it is excellent
Select embodiment and fall into having altered and changing for the application scope.
Obviously, those skilled in the art can carry out various changes and modification without departing from this Shen to the embodiment of the present application
Please embodiment spirit and scope.So, if these modifications and variations of the embodiment of the present application belong to the application claim
And its within the scope of equivalent technologies, then the application is also intended to comprising including these changes and modification.
Claims (20)
1. a kind of blog management method, applied to database, it is characterised in that the database includes transaction journal and data set
Close, the data acquisition system includes at least two data objects, and the data object carries sequence identification, and the sequence identification is used for
The operation order that the data object last time is performed write operation during write operation is characterized, the transaction journal is used to remember
The operation order of the write operation and the write operation is recorded, the data object includes at least one data being read object and one
Individual to be write data object, methods described includes：
The sequence identification and the order mark for being write data object carrying carried according at least one data being read object
Know, determine the operation order of the first pending write operation；
According to the data read from least one data being read object, to it is described write data object and perform described first write
Operation；
First write operation and the fixed operation order are write into the transaction journal, and data are write by described
The sequence identification that object carries replaces with sequence identification corresponding to the fixed operation order.
2. according to the method for claim 1, it is characterised in that described to be carried according at least one data being read object
Sequence identification and the sequence identification for being write data object carrying, determine the operation order of the first pending write operation,
Including：
Travel through the sequence identification and the institute for being write data object carrying that at least one data being read object carries
Sequence identification is stated, in the operation order characterized from the sequence identification being traversed, selects the operation order finally performed；
The next operation order for determining the operation order finally performed is the operation order of first write operation.
3. according to the method for claim 2, it is characterised in that the operation order finally performed is N, and the N is to appoint
Meaning natural number, next operation order of the determination operation order finally performed is the operation of first write operation
Sequentially, including：
The operation order for determining first write operation is N+1.
4. according to the method described in any one of claims 1 to 3, it is characterised in that the transaction journal includes at least two sons
Transaction journal, the operation order of subtransaction log recording described in any two are separate；
It is described by first write operation and the fixed operation order writes the transaction journal, including：
First write operation and the fixed operation order are write and are dependent of first write operation for record
Write operation the subtransaction daily record.
5. according to the method described in any one of Claims 1-4, it is characterised in that the data object includes master data list
Member or primitive set, the primitive set include at least two primitives；
Corresponding, the data object carries sequence identification, and the sequence identification is used to characterize the data object last time
The operation order of write operation during write operation is performed, including：The primitive carries the sequence identification, described
Sequence identification is used to characterize the operation order that the primitive last time is performed write operation during write operation, or
Person, the primitive set carry the sequence identification, and the sequence identification is used to characterize the primitive
Any primitive last time in set is performed the operation order of write operation during write operation.
6. according to the method for claim 5, it is characterised in that when the data object includes the primitive collection
During conjunction, the sequence identification carried according at least one data being read object and described the suitable of data object carrying is write
Sequence identifies, and before the operation order for determining the first pending write operation, methods described also includes：
The data acquisition system is split as the primitive set.
7. according to the method for claim 6, it is characterised in that the data acquisition system includes the table of the database or divided
Area, the primitive set includes the bucket of the database, described that the data acquisition system is split as into the basic number
According to unit set, including：
Bucket operation is carried out to the primitive in the table or the subregion, is grouped at least two buckets.
8. according to the method for claim 7, it is characterised in that described to be carried according at least one data being read object
Sequence identification and it is described by write data object carrying sequence identification, determine the first pending write operation operation order it
Before, methods described also includes：
To at least one data being read object and described write the bucket read lock corresponding to data object.
9. according to the methods described of claim 7 or 8, it is characterised in that described to perform described first to the data object of being write
Before write operation, methods described also includes：
To it is described write the bucket corresponding to data object and added write lock.
10. according to the method described in any one of claim 1 to 9, it is characterised in that the sequence identification includes：Log Sequence
Number or timestamp.
11. a kind of log management apparatus, applied to database, it is characterised in that the database includes transaction journal and data
Set, the data acquisition system include at least two data objects, and the data object carries sequence identification, and the sequence identification is used
The operation order of the write operation, the transaction journal are used for when characterizing the data object last time and being performed write operation
Record the operation order of the write operation and the write operation, the data object include at least one data being read object and
One is write data object, and described device includes：
Allocation unit is identified, for the sequence identification that is carried according at least one data being read object and described is write data
The sequence identification that object carries, determine the operation order of the first pending write operation；
Writing unit, for according to the data read from least one data being read object, data object to be write to described
Perform first write operation；
Said write unit, it is additionally operable to first write operation and the fixed operation order writing the affairs day
Will；
The mark allocation unit, be additionally operable to by it is described by write data object carrying sequence identification replace with it is described fixed
Sequence identification corresponding to operation order.
12. device according to claim 11, it is characterised in that the mark allocation unit is specifically used for：
Travel through the sequence identification and the institute for being write data object carrying that at least one data being read object carries
Sequence identification is stated, in the operation order characterized from the sequence identification being traversed, selects the operation order finally performed；
The next operation order for determining the operation order finally performed is the operation order of first write operation.
13. device according to claim 12, it is characterised in that the operation order finally performed is N, and the N is
Random natural number, the mark allocation unit are specifically used for：
The operation order for determining first write operation is N+1.
14. according to the device described in any one of claim 11 to 13, it is characterised in that the transaction journal includes at least two
Subtransaction daily record, the operation order of subtransaction log recording described in any two are separate；
Said write unit is specifically used for：
First write operation and the fixed operation order are write and are dependent of first write operation for record
Write operation the subtransaction daily record.
15. according to the device described in any one of claim 11 to 14, it is characterised in that the data object includes master data
Unit or primitive set, the primitive set include at least two primitives；
Corresponding, the data object carries sequence identification, and the sequence identification is used to characterize the data object last time
The operation order of write operation during write operation is performed, including：The primitive carries the sequence identification, described
Sequence identification is used to characterize the operation order that the primitive last time is performed write operation during write operation, or
Person, the primitive set carry the sequence identification, and the sequence identification is used to characterize the primitive
Any primitive last time in set is performed the operation order of write operation during write operation.
16. device according to claim 15, it is characterised in that when the data object includes the primitive
During set, described device also includes grouped element；
The grouped element, for the order carried in the mark allocation unit according at least one data being read object
Mark, will before the operation order for determining the first pending write operation with the sequence identification for being write data object carrying
The data acquisition system is split as the primitive set.
17. device according to claim 16, it is characterised in that the table of the data acquisition system including the database or
Subregion, the primitive set include the bucket of the database, and the grouped element is specifically used for：
Bucket operation is carried out to the primitive in the table or the subregion, is grouped at least two buckets.
18. device according to claim 17, it is characterised in that described device also includes lock cell；
The lock cell, for the order carried in the mark allocation unit according at least one data being read object
Mark is right before the operation order for determining the first pending write operation with the sequence identification for being write data object carrying
At least one data being read object and described write the bucket read lock corresponding to data object.
19. according to claim 18 described device, it is characterised in that the lock cell, be additionally operable in said write unit pair
It is described to be write before data object performs first write operation, to it is described write the bucket corresponding to data object and added write lock.
20. according to the device described in any one of claim 11 to 19, it is characterised in that the operation order mark or described
Sequence identification includes：Log Sequence Number or timestamp.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610617168.6A CN107665219B (en) | 2016-07-28 | 2016-07-28 | Log management method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610617168.6A CN107665219B (en) | 2016-07-28 | 2016-07-28 | Log management method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107665219A true CN107665219A (en) | 2018-02-06 |
| CN107665219B CN107665219B (en) | 2021-01-29 |
Family
ID=61121978
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610617168.6A Active CN107665219B (en) | 2016-07-28 | 2016-07-28 | Log management method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107665219B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110377612A (en) * | 2019-07-17 | 2019-10-25 | 武汉达梦数据库有限公司 | A kind of pair of data, which update, operates the method for being ranked up recombination and corresponding device |
| CN110457898A (en) * | 2019-07-29 | 2019-11-15 | 阿里巴巴集团控股有限公司 | Operation note storage method, device and equipment based on credible performing environment |
| CN110795318A (en) * | 2018-08-01 | 2020-02-14 | 阿里巴巴集团控股有限公司 | Data processing method and device and electronic equipment |
| US10783054B2 (en) | 2019-07-29 | 2020-09-22 | Alibaba Group Holding Limited | Method, apparatus, and device for storing operation record based on trusted execution environment |
| CN112347065A (en) * | 2019-08-07 | 2021-02-09 | 中国船舶工业系统工程研究院 | Record replay method and system for police preplan making process |
| CN112527759A (en) * | 2021-02-09 | 2021-03-19 | 腾讯科技（深圳）有限公司 | Log execution method and device, computer equipment and storage medium |
| CN113254460A (en) * | 2021-07-07 | 2021-08-13 | 阿里云计算有限公司 | Data processing method, system, electronic device and computer program product |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101089857A (en) * | 2007-07-24 | 2007-12-19 | 中兴通讯股份有限公司 | Internal store data base transaction method and system |
| CN101119414A (en) * | 2007-09-19 | 2008-02-06 | 华为技术有限公司 | Method and system to access database |
| CN101118509A (en) * | 2007-09-12 | 2008-02-06 | 华为技术有限公司 | Process, device and system for EMS memory data-base remote disaster tolerance |
| CN101122924A (en) * | 2007-09-30 | 2008-02-13 | 华为技术有限公司 | Logic log generation method, database backup/ restoration method and system |
| CN101183377A (en) * | 2007-12-10 | 2008-05-21 | 华中科技大学 | High availability data-base cluster based on message middleware |
| CN101187948A (en) * | 2007-12-20 | 2008-05-28 | 中国科学院计算技术研究所 | A continuous data protection system and its realization method |
| CN101262493A (en) * | 2008-01-14 | 2008-09-10 | 深圳市深信服电子科技有限公司 | Method for accelerating inter-network data transmission via stream buffer |
| US20080228834A1 (en) * | 2007-03-14 | 2008-09-18 | Microsoft Corporation | Delaying Database Writes For Database Consistency |
| CN101286127A (en) * | 2008-05-08 | 2008-10-15 | 华中科技大学 | Multi-fork diary memory continuous data protecting and restoration method |
| CN101329642A (en) * | 2008-06-11 | 2008-12-24 | 华中科技大学 | Method for protecting and recovering continuous data based on time stick diary memory |
| CN101488012A (en) * | 2009-02-13 | 2009-07-22 | 国网电力科学研究院 | Method for implementing sequential control by flow diagram |
| CN101699439A (en) * | 2009-11-16 | 2010-04-28 | 中兴通讯股份有限公司 | Database transaction submitting method and device |
| CN102222071A (en) * | 2010-04-16 | 2011-10-19 | 华为技术有限公司 | Method, device and system for data synchronous processing |
| CN102611924A (en) * | 2012-03-02 | 2012-07-25 | 何震宇 | Flow control method and system of video cloud platform |
| CN103092903A (en) * | 2011-11-07 | 2013-05-08 | Sap股份公司 | Database Log Parallelization |
| CN103729442A (en) * | 2013-12-30 | 2014-04-16 | 华为技术有限公司 | Method for recording event logs and database engine |
-
2016
- 2016-07-28 CN CN201610617168.6A patent/CN107665219B/en active Active
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080228834A1 (en) * | 2007-03-14 | 2008-09-18 | Microsoft Corporation | Delaying Database Writes For Database Consistency |
| CN101089857A (en) * | 2007-07-24 | 2007-12-19 | 中兴通讯股份有限公司 | Internal store data base transaction method and system |
| CN101118509A (en) * | 2007-09-12 | 2008-02-06 | 华为技术有限公司 | Process, device and system for EMS memory data-base remote disaster tolerance |
| CN101119414A (en) * | 2007-09-19 | 2008-02-06 | 华为技术有限公司 | Method and system to access database |
| CN101122924A (en) * | 2007-09-30 | 2008-02-13 | 华为技术有限公司 | Logic log generation method, database backup/ restoration method and system |
| CN101183377A (en) * | 2007-12-10 | 2008-05-21 | 华中科技大学 | High availability data-base cluster based on message middleware |
| CN101187948A (en) * | 2007-12-20 | 2008-05-28 | 中国科学院计算技术研究所 | A continuous data protection system and its realization method |
| CN101262493A (en) * | 2008-01-14 | 2008-09-10 | 深圳市深信服电子科技有限公司 | Method for accelerating inter-network data transmission via stream buffer |
| CN101286127A (en) * | 2008-05-08 | 2008-10-15 | 华中科技大学 | Multi-fork diary memory continuous data protecting and restoration method |
| CN101329642A (en) * | 2008-06-11 | 2008-12-24 | 华中科技大学 | Method for protecting and recovering continuous data based on time stick diary memory |
| CN101488012A (en) * | 2009-02-13 | 2009-07-22 | 国网电力科学研究院 | Method for implementing sequential control by flow diagram |
| CN101699439A (en) * | 2009-11-16 | 2010-04-28 | 中兴通讯股份有限公司 | Database transaction submitting method and device |
| CN102222071A (en) * | 2010-04-16 | 2011-10-19 | 华为技术有限公司 | Method, device and system for data synchronous processing |
| CN103092903A (en) * | 2011-11-07 | 2013-05-08 | Sap股份公司 | Database Log Parallelization |
| CN102611924A (en) * | 2012-03-02 | 2012-07-25 | 何震宇 | Flow control method and system of video cloud platform |
| CN103729442A (en) * | 2013-12-30 | 2014-04-16 | 华为技术有限公司 | Method for recording event logs and database engine |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110795318A (en) * | 2018-08-01 | 2020-02-14 | 阿里巴巴集团控股有限公司 | Data processing method and device and electronic equipment |
| CN110795318B (en) * | 2018-08-01 | 2023-05-02 | 阿里云计算有限公司 | Data processing method and device and electronic equipment |
| CN110377612A (en) * | 2019-07-17 | 2019-10-25 | 武汉达梦数据库有限公司 | A kind of pair of data, which update, operates the method for being ranked up recombination and corresponding device |
| CN110457898A (en) * | 2019-07-29 | 2019-11-15 | 阿里巴巴集团控股有限公司 | Operation note storage method, device and equipment based on credible performing environment |
| US10783054B2 (en) | 2019-07-29 | 2020-09-22 | Alibaba Group Holding Limited | Method, apparatus, and device for storing operation record based on trusted execution environment |
| TWI740388B (en) * | 2019-07-29 | 2021-09-21 | 開曼群島商創新先進技術有限公司 | Operation record storage method, device and equipment based on trusted execution environment |
| CN112347065A (en) * | 2019-08-07 | 2021-02-09 | 中国船舶工业系统工程研究院 | Record replay method and system for police preplan making process |
| CN112347065B (en) * | 2019-08-07 | 2023-08-18 | 中国船舶工业系统工程研究院 | Recording and replay method and system for police plan making process |
| CN112527759A (en) * | 2021-02-09 | 2021-03-19 | 腾讯科技（深圳）有限公司 | Log execution method and device, computer equipment and storage medium |
| CN112527759B (en) * | 2021-02-09 | 2021-06-11 | 腾讯科技（深圳）有限公司 | Log execution method and device, computer equipment and storage medium |
| CN113254460A (en) * | 2021-07-07 | 2021-08-13 | 阿里云计算有限公司 | Data processing method, system, electronic device and computer program product |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107665219B (en) | 2021-01-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107665219A (en) | A kind of blog management method and device | |
| US20190278783A1 (en) | Compaction policy | |
| CN103729442B (en) | Record the method and database engine of transaction journal | |
| CN106548789B (en) | Method and apparatus for operating stacked tile type magnetic recording equipment | |
| CN104115133B (en) | For method, system and the equipment of the Data Migration for being combined non-volatile memory device | |
| US10970173B2 (en) | Logging process in a data storage system | |
| CN105468473A (en) | Data migration method and data migration apparatus | |
| US10169391B2 (en) | Index management | |
| CN109271343A (en) | A kind of data merging method and device applied in key assignments storage system | |
| CN110058958A (en) | For managing the method, equipment and computer program product of data backup | |
| CN110597663A (en) | Transaction processing method and device | |
| CN110309233A (en) | Method, apparatus, server and the storage medium of data storage | |
| CN104050057B (en) | Historical sensed data duplicate removal fragment eliminating method and system | |
| CN104461384B (en) | A kind of method for writing data and storage device | |
| US20170228449A1 (en) | Frequency Dependent Partial Index | |
| US11010091B2 (en) | Multi-tier storage | |
| CN107346342A (en) | A kind of file call method calculated based on storage and system | |
| CN112035428A (en) | Distributed storage system, method, apparatus, electronic device, and storage medium | |
| CN116186085A (en) | Key value storage system and method based on cache gradient cold and hot data layering mechanism | |
| CN109359100A (en) | The visual modeling method of PB grades of historical datas and online data calculated in real time | |
| US20220300513A1 (en) | Asynchronous query optimization using spare hosts | |
| CN117472873A (en) | Data migration method, device, computing device cluster and storage medium | |
| CN108140047B (en) | Data processing apparatus and method, and data container structure | |
| CN107846327A (en) | A kind of processing method and processing device of network management performance data | |
| CN107330002A (en) | Distributed data base implementation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |