CN110059072A - Data Migration monitoring method, system, equipment and medium based on storing process - Google Patents
Data Migration monitoring method, system, equipment and medium based on storing process Download PDFInfo
- Publication number
- CN110059072A CN110059072A CN201910190654.8A CN201910190654A CN110059072A CN 110059072 A CN110059072 A CN 110059072A CN 201910190654 A CN201910190654 A CN 201910190654A CN 110059072 A CN110059072 A CN 110059072A
- Authority
- CN
- China
- Prior art keywords
- data
- migration
- migrated
- tables
- item number
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005012 migration Effects 0.000 title claims abstract description 207
- 238000013508 migration Methods 0.000 title claims abstract description 207
- 238000000034 method Methods 0.000 title claims abstract description 123
- 238000012544 monitoring process Methods 0.000 title claims abstract description 104
- 230000008569 process Effects 0.000 title claims abstract description 84
- 230000001960 triggered effect Effects 0.000 claims abstract description 18
- 238000012512 characterization method Methods 0.000 claims description 14
- 230000007704 transition Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 9
- 230000006399 behavior Effects 0.000 claims 1
- 230000006870 function Effects 0.000 claims 1
- 241001269238 Data Species 0.000 description 7
- 230000007246 mechanism Effects 0.000 description 6
- 230000007547 defect Effects 0.000 description 5
- 230000004060 metabolic process Effects 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 238000002360 preparation method Methods 0.000 description 3
- JASONGFGOLHLGB-UHFFFAOYSA-N Atranol Chemical compound CC1=CC(O)=C(C=O)C(O)=C1 JASONGFGOLHLGB-UHFFFAOYSA-N 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2379—Updates performed during online database operations; commit processing
Abstract
This disclosure relates to a kind of Data Migration monitoring method based on storing process characterized by comprising monitor the migration switch during knowing primary storage and be triggered, the target base data table that this migration relies on is determined from an at least base data table；The table name of target base data table is stored into monitoring record table；Trigger corresponding secondary storing process, obtain the associated at least tables of data to be migrated of target base data table, and it will at least a tables of data to be migrated migrate, wherein, for storing the basic data with the data correlation to be migrated in every tables of data to be migrated of at least one tables of data to be migrated in target base data table；Determine the migration results of at least one tables of data to be migrated；And migration results are recorded in monitoring record table and the associated position of table name.The disclosure additionally provides a kind of Data Migration monitoring system based on storing process, a kind of computer equipment and a kind of computer readable storage medium.
Description
Technical field
The present invention relates to field of computer technology, and in particular to Data Migration monitoring method, system based on storing process,
Computer equipment and computer readable storage medium.
Background technique
In the use process of database, it is often necessary to carry out Data Migration, reason may be because of server resource
Deficiency, Network Isolation, data disaster tolerance etc..So-called Data Migration is exactly substantially by an existing already existing data
Library example is exported to tables of data therein in file by certain mode, then by realizing a new number based on this document
According to library example.
But during realizing present inventive concept, inventor's discovery at least has following defects that existing in the related technology
Monitoring mechanism is not present in some database migrations, is unfavorable for observing the state of Data Migration.
Summary of the invention
Disclosure purpose be to provide a kind of Data Migration monitoring method based on storing process, system, computer equipment and
Computer readable storage medium, at least to solve database migration in the prior art, there is no monitoring mechanisms, are unfavorable for observing
The defect of Data Migration state.
An aspect of this disclosure provides a kind of Data Migration monitoring method based on storing process, which is characterized in that
Include: that the migration switch monitored during knowing primary storage is triggered, determines that this is moved from an at least base data table
Move the target base data table relied on；The table name of above-mentioned target base data table is stored into monitoring record table；Triggering pair
The secondary storing process answered, obtains the associated at least tables of data to be migrated of above-mentioned target base data table, and by it is above-mentioned at least
One tables of data to be migrated is migrated, wherein for storing with above-mentioned at least one wait move in above-mentioned target base data table
Move the basic data of the data correlation to be migrated in every tables of data to be migrated of tables of data；Determine above-mentioned at least one it is to be migrated
The migration results of tables of data；And above-mentioned migration results are recorded in above-mentioned monitoring record table and the associated position of above-mentioned table name
It sets.
In accordance with an embodiment of the present disclosure, the migration results of above-mentioned at least one tables of data to be migrated of above-mentioned determination, comprising: really
The migration item number of successful data is migrated in a fixed above-mentioned at least tables of data to be migrated；It determines to belong to from above-mentioned migration item number
In the update item number of more new data；And the newly-increased item number for belonging to newly-increased data is determined from above-mentioned migration item number.
In accordance with an embodiment of the present disclosure, the above-mentioned update item number for determining to belong to more new data from above-mentioned migration item number,
It include: that data is called to update library；Library is updated based on above-mentioned data, determines above-mentioned update item number.
In accordance with an embodiment of the present disclosure, the above-mentioned newly-increased item number for determining to belong to newly-increased data from above-mentioned migration item number,
It include: that above-mentioned newly-increased item number is determined based on above-mentioned migration item number and above-mentioned update item number.
In accordance with an embodiment of the present disclosure, it stores in the above-mentioned table name by above-mentioned target base data table to monitoring record table
In after, the above method further include: by the state of above-mentioned monitoring record table be provided for characterization relying on above-mentioned target base
The first state of plinth tables of data execution migration operation.
In accordance with an embodiment of the present disclosure, the above method further include: judge the migration of above-mentioned at least one tables of data to be migrated
Whether process there is exception；And if so, the state of above-mentioned monitoring record table is provided for characterize above-mentioned at least one
Second state of tables of data migration failure to be migrated；Or if it is not, the state of above-mentioned monitoring record table is then provided for table
It levies an above-mentioned at least tables of data to be migrated and migrates the successful third state.
In accordance with an embodiment of the present disclosure, an above-mentioned at least base data table includes multiple base data table, the above method
Further include: judge whether the migration operation for relying on multiple above-mentioned base data table has been fully completed；And if it is not, then from above-mentioned
The base data table that next migration operation relies on is determined in multiple base data table.
Another aspect of the disclosure provides a kind of Data Migration monitoring system based on storing process, and feature exists
In, comprising: the first determining module is triggered, from an at least basis for monitoring the migration switch during knowing primary storage
The target base data table that this migration relies on is determined in tables of data；Memory module is used for above-mentioned target base data table
Table name store into monitoring record table；Processing module obtains above-mentioned target basis for triggering corresponding secondary storing process
The associated at least tables of data to be migrated of tables of data, and an above-mentioned at least tables of data to be migrated is migrated, wherein on
State in target base data table for store and every tables of data to be migrated of above-mentioned at least one tables of data to be migrated in
The associated basic data of migrating data；Second determining module, for determining the migration knot of above-mentioned at least one tables of data to be migrated
Fruit；And logging modle, for above-mentioned migration results to be recorded in above-mentioned monitoring record table and the associated position of above-mentioned table name
It sets.
In accordance with an embodiment of the present disclosure, above-mentioned second determining module includes: the first determination unit, for determine it is above-mentioned at least
The migration item number of successful data is migrated in one tables of data to be migrated；Second determination unit, for from above-mentioned migration item number
Determine to belong to the update item number of more new data；And third determination unit, for determining to belong to from above-mentioned migration item number
The newly-increased item number of newly-increased data.
In accordance with an embodiment of the present disclosure, above-mentioned second determination unit is also used to: data being called to update library；Based on above-mentioned data
Library is updated, determines above-mentioned update item number.
In accordance with an embodiment of the present disclosure, above-mentioned third determination unit is also used to: being based on above-mentioned migration item number and above-mentioned update
Item number determines above-mentioned newly-increased item number.
In accordance with an embodiment of the present disclosure, above system further include: the first setup module is used for above-mentioned target base above-mentioned
After the table name of plinth tables of data is stored into monitoring record table, the state of above-mentioned monitoring record table is being provided for characterization just
In the first state for relying on above-mentioned target base data table execution migration operation.
In accordance with an embodiment of the present disclosure, above system further include: first judgment module, for judge above-mentioned at least one to
Whether the transition process of migrating data table there is exception；And second setup module, for judge above-mentioned at least one to
In the case that exception occurs in the transition process of migrating data table, the state of above-mentioned monitoring record table is provided for characterizing above-mentioned
Second state of at least one tables of data migration failure to be migrated；Or third setup module, for judge it is above-mentioned at least
In the case that the transition process of one tables of data to be migrated exception does not occur, the state of above-mentioned monitoring record table is set as using
The successful third state is migrated in characterizing an above-mentioned at least tables of data to be migrated.
In accordance with an embodiment of the present disclosure, an above-mentioned at least base data table includes multiple base data table, above system
Further include: the second judgment module, for judging whether the migration operation for relying on multiple above-mentioned base data table has been fully completed；
And third determining module, in the feelings judging to rely on the migration operation of multiple above-mentioned base data table and being not fully completed
Under condition, the base data table that next migration operation relies on is determined from multiple above-mentioned base data table.
Another aspect of the disclosure provides a kind of computer equipment, including memory, processor and is stored in
On reservoir and the computer program that can run on a processor, which is characterized in that above-mentioned processor executes above-mentioned computer program
When for realizing described in any item methods as above the step of.
The another aspect of the disclosure provides a kind of computer readable storage medium, is stored thereon with computer program,
It is characterized in that, when above-mentioned computer program is executed by processor for realizing described in any item methods as above the step of.
The Data Migration monitoring method based on storing process that the disclosure provides, migration during primary storage switch quilt
When triggering, relied on target basis number is migrated from this is found at least one base data table for storing basic data
It is stored in monitoring record table according to table, and by the table name of the target base data table, is to monitor the data of this migration
Which executed based on base data table.Further, corresponding secondary storing process is triggered, it will be associated with target base data table
And at least tables of data to be migrated for storing data to be migrated is migrated, and by least tables of data to be migrated
Migration results are recorded in the associated position of table name with target base data table in monitoring record table.Embodiment of the disclosure
By being added monitoring record to data migration process, Data Migration situation can be grasped in time, by data migration process
Relevant information carries out unified conclusion, facilitates subsequent analysis, overcomes database migration in the prior art and monitoring mechanism is not present,
It is unfavorable for observing the defect of data transition state.
Detailed description of the invention
Fig. 1 diagrammatically illustrates the process of the Data Migration monitoring method based on storing process according to the embodiment of the present disclosure
Figure；
Fig. 2 is diagrammatically illustrated according to the Data Migration monitoring method based on storing process of another embodiment of the disclosure
Flow chart；
Fig. 3 diagrammatically illustrates the frame of the Data Migration monitoring system based on storing process according to the embodiment of the present disclosure
Figure；And
Fig. 4 diagrammatically illustrates the Data Migration monitoring side being adapted for carrying out based on storing process according to the embodiment of the present disclosure
The hardware structure schematic diagram of the computer equipment of method.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the disclosure are more clearly understood
The disclosure is further elaborated.It should be appreciated that specific embodiment described herein is only to explain the disclosure, not
For limiting the disclosure.Based on the embodiment in the disclosure, those of ordinary skill in the art are not before making creative work
Every other embodiment obtained is put, the range of disclosure protection is belonged to.
In view of monitoring mechanism is not present in database migration in the prior art, it is unfavorable for observing lacking for data transition state
It falls into.The Data Migration monitoring method based on storing process that the disclosure provides, migration switch during primary storage are triggered
When, relied on target basic data is migrated from this is found at least one base data table for storing basic data
Table, and the table name of the target base data table is stored in monitoring record table, it is base to monitor the data of this migration
Which executed in base data table.Further, trigger corresponding secondary storing process, will it is associated with target base data table and
An at least tables of data to be migrated for storing data to be migrated is migrated, and moving at least tables of data to be migrated
It moves result and is recorded in the associated position of table name with target base data table in monitoring record table.Embodiment of the disclosure is logical
It crosses and monitoring record is added to data migration process, Data Migration situation can be grasped in time, by the phase of data migration process
It closes information and carries out unified conclusion, facilitate subsequent analysis.
Fig. 1 diagrammatically illustrates the process of the Data Migration monitoring method based on storing process according to the embodiment of the present disclosure
Figure.
As shown in Figure 1, being somebody's turn to do the Data Migration monitoring method based on storing process may include step S101~step S105,
Wherein:
Step S101 monitors the migration switch during knowing primary storage and is triggered, from an at least base data table
Determine the target base data table that this migration relies on.
It should be noted that embodiment of the disclosure before being migrated, needs to carry out the work of basic data preparation.
Specifically, by the corresponding basic data of data to be migrated (also known as specific data) (such as customer name, identification card number, client
Number) store into an at least base data table, wherein each base data table is with corresponding for storing number to be migrated
According to (such as the application information of client, the credit information of client, client certificate address information) tables of data to be migrated it is associated.It is preferred that
Ground, embodiment of the disclosure reduce the data volume of individual table, improve the efficiency of data migration process to disperse data, can be with
By the storage of above-mentioned basic data into multiple base data table.
For example, there is the identical base data table of 10 table structures, be respectively: the 1st base data table is cis_merge_
Deamon_base1, the 2nd base data table is cis_merge_deamon_base2 ..., and the 10th base data table is
Cis_merge_deamon_base10 these basic datas can averagely disperse customer name, identification card number, customer ID etc.
Into this 10 base data table.Such as, the basic data stored in cis_merge_deamon_base1 is that customer name is Zhao
One, identification card number 110110196210102563, customer ID 1, and cis_merge_deamon_base1 can be with storage
The tables of data 1-1 to be migrated of the application information of the client, store the client credit information tables of data 1-2 to be migrated, storage
The tables of data 1-3 to be migrated of the certificate address information of the client is associated；The basis stored in cis_merge_deamon_base2
Data are that customer name is money two, identification card number 110110198501265234, customer ID 2, and cis_merge_
Deamon_base2 can with the tables of data 2-1 to be migrated of the application information for storing the client, store the credit information of the client
Tables of data 2-2 to be migrated, the certificate address information for storing the client tables of data 2-3 to be migrated be associated；..., etc..
It in accordance with an embodiment of the present disclosure, can be by the state of each base data table before carrying out Data Migration
It is disposed as the preset state for being required to be migrated for characterizing every data, such as state U.
After the completion of above-mentioned basic data preparation, data migration operation can be executed, embodiment of the disclosure can
To be monitored to data migration process.
Specifically, it when carrying out Data Migration, can be executed based on storing process, embodiment of the disclosure includes primary storage
Process and secondary storing process.During primary storage, know that the migration switch of the primary storage process is triggered once monitoring,
To determine that this migrates relied on target base data table from an at least base data table.For example, triggering circulator
System, determines that first base data table carries out circulate operation from an at least base data table, then triggers secondary storing process,
The tables of data to be migrated being associated with first base data table is migrated, and this transition process is monitored；So
The operation similar with above-mentioned circulation is being executed again afterwards, until circulation terminates, wherein circulation terminates to can be based on last
The migration of base data table is completed.
Below with a specific example elaborate on how to determine from an at least base data table this migration according to
Bad target base data table.
For example, the migration switch monitored during knowing primary storage is triggered, start the circulative metabolism for executing Data Migration,
If first entering the circulative metabolism, then the 1st base data table cis_ can be selected from 10 base data table
The target base data table that merge_deamon_base1 is relied on as this migration.If being based on the 1st base data table
The data migration operation of cis_merge_deamon_base1 is completed, then can select the 2nd from 10 base data table
Base data table cis_merge_deamon_base2 is opened, and is relied on cis_merge_deamon_base2 as this migration
If target base data table ..., Data Migration based on the 9th base data table cis_merge_deamon_base9
Operation is completed, then the 10th base data table cis_merge_deamon_ can be selected from 10 base data table
Base10, and the target base data table that cis_merge_deamon_base10 is relied on as this migration.
Step S102 stores the table name of target base data table into monitoring record table.
In accordance with an embodiment of the present disclosure, in primary storage process stage, after determining target base data table, in order to just
It in the data for monitoring this migration is executed based on which base data table, embodiment of the disclosure can also be by target basis
The table name of tables of data is stored into monitoring record table, such as is stored into cis_merge_deamon_summary.More into one
Which kind of data step, be to get information about in monitoring record table storing now, can be by monitoring record
The characterization that is provided for of the state of table is relying on the first state that target base data table executes migration operation, such as state
CR。
For example, user has found the first shape of monitoring record table during the scheme based on the disclosure executes Data Migration
State is MR, can know that store in monitoring record table at this time is data related with data migration process, rather than with number
According to the related data of comparison process.
It is described in detail how that the table name by target base data table is stored to monitoring record below with a specific example
In table.
For example, if target base data table is cis_merge_deamon_base1, it can be by table name " cis_
Merge_deamon_base1 " is stored into cis_merge_deamon_summary, and can also be by cis_merge_
The state of deamon_summary is changed to MR.
Step S103, triggers corresponding secondary storing process, and acquisition target base data table associated at least one is to be migrated
Tables of data, and will at least a tables of data to be migrated migrate, wherein for storing and at least one in target base data table
Open the basic data of the data correlation to be migrated in every tables of data to be migrated of tables of data to be migrated.
In embodiment of the disclosure, after storing the table name of target base data table into monitoring record table,
Corresponding secondary storing process can be triggered.After triggering corresponding secondary storing process, first have to obtain from preset configuration table
Preset table type (such as application form, loan table, customer households information table, customer bank card table), then recycles these preset tables
Type, the corresponding Data Migration storing process of triggering preset table type, and found according to preset table type and incidence relation and mesh
Mark the associated at least tables of data to be migrated of base data table, wherein these tables of data to be migrated for example can be storage Shen
Please information table, store credit information table, store customer households information table, store customer bank card information table.
It is described in detail how that acquisition target base data table associated at least one is to be migrated below with a specific example
Tables of data and at least a tables of data to be migrated migrates by this.
For example, if target base data table is cis_merge_deamon_base1, it first can be from preset configuration table
Pre-configured preset table type, respectively application form, loan table, customer households information are obtained in cis_parameters
Table, customer bank card table.Secondly these preset table types can be recycled, if circulation is application form for the first time, Shen can be triggered
Please table Data Migration storing process, find from legacy system and be associated with cis_merge_deamon_base1 according to incidence relation
Application form (tables of data also known as to be migrated) in request for data, and these request for data are moved to the application in new system
In table；If second circulation is loan table, the Data Migration storing process of loan table can be triggered, according to incidence relation from old
It is found in system and the loan number in the associated loan table of cis_merge_deamon_base1 (tables of data also known as to be migrated)
According to, and these loan datas are moved in the loan table in new system；..., it is completed until all default table names recycle, table
Show that the Data Migration for relying on cis_merge_deamon_base1 has been completed.Target base data table may further be determined
For cis_merge_deamon_base2, then the operation ... similar with cis_merge_deamon_base1 is executed, until relying on
The Data Migration of cis_merge_deamon_base10, which works, to be completed.
It should be noted that in secondary storing process, every migration operation for completing a target tables of data to be migrated can be with
M_count value in monitoring record table is added 1, several datas have been migrated altogether with record.For example, if with the 1st basic data
Table is associated 4 tables of data to be migrated, then after the circulative metabolism for completing the first Data Migration, with the 1st base data table pair
The m_count answered should be 4.If completing the second data with the 2nd base data table is associated 6 tables of data to be migrated
After the circulative metabolism of migration, m_count corresponding with the 2nd base data table should be 6, etc..
Step S104 determines the migration results of at least one tables of data to be migrated.
Wherein, migration results include: to have migrated successfully several datas (i.e. successful number of migration in this migration operation altogether
According to migration item number), to have several datas be to belong to more new data (the update item number for belonging to more new data), have several datas
It is to belong to newly-increased data (the newly-increased item number for belonging to newly-increased data).
In accordance with an embodiment of the present disclosure, determine that the migration results of at least one tables of data to be migrated comprise determining that at least one
Open the migration item number that successful data are migrated in tables of data to be migrated；Determine to belong to the update of more new data from migration item number
Item number；And the newly-increased item number for belonging to newly-increased data is determined from migration item number.
Wherein it is determined that the migration item number for migrating successful data in an at least tables of data to be migrated can be and be based on
What the characteristic of orcal database was determined, i.e., every time after the completion of migration, the characteristic based on orcal database can be counted
Migrate the migration item number of successful data, such as 20.
The update item number for determining to belong to more new data from migration item number, which may is that, calls data to update library；Based on number
According to library is updated, the update item number for belonging to more new data is determined.Wherein, data, which update in library, can store this number having updated
According to item number.For embodiment of the disclosure by calling data to update library, what is stored in available data update library belongs to update
The update item number of data.For example, storing this in data update library has updated 6 datas, then belong to the update for more counting evidence accurately
Item number is 6.
Further, from migration item number in determine the newly-increased item number for belonging to newly-increased data may is that based on migration item number and
Item number is updated, determines newly-increased item number.Specifically, it can be computation migration item number and update the difference of item number, and take the difference as
Newly-increased item number.For example, increasing item number newly is 20-6=14 item in conjunction with above-mentioned example.
Migration results are recorded in monitoring record table and the associated position of table name by step S105.
In embodiment of the disclosure, it after the migration results for determining at least one tables of data to be migrated, can incite somebody to action
Migration results are recorded in monitoring record table, especially close migration results and the table name of target base data table
Connection.
It is described in detail how to be recorded in migration results in monitoring record table with a specific example below and be closed with table name
The position of connection.
For example, when migration results are recorded in monitoring record table, it can be first by " migration item number is 20, updates
Item number is 6, newly-increased item number is 14 " it is associated with " cis_merge_deamon_base1 ", and then by " migrating item number is
20, update that item number is 6, newly-increased item number is 14 " be also recorded in monitoring record table.More specifically, can be " migration
Item number is 20, update item number is 6, newly-increased item number is 14 " it is recorded in monitoring record table and " cis_merge_
Position of the deamon_base1 " with a line.
In accordance with an embodiment of the present disclosure, when carrying out Data Migration, it can also judge whether data migrate success.With
For at least a tables of data to be migrated migrates, embodiment of the disclosure may determine that an at least tables of data to be migrated
Transition process whether there is exception；And if so, by the state of monitoring record table be provided for characterization at least one to
Second state of migrating data table migration failure；Or if it is not, the state of monitoring record table is then provided for characterization at least
One tables of data to be migrated migrates the successful third state.
Specifically, judge whether the transition process of at least one tables of data to be migrated exception occurs and can be, counted
According in transition process, if the failure of abnormal namely Data Migration occurs in Data Migration, system can be returned to be lost for characterizing migration
The mark lost loses at this point it is possible to which the state of monitoring record table is provided for a characterization at least tables of data migration to be migrated
The second state lost, such as MF.If exception namely Data Migration success, system, which does not occur, in Data Migration can return to use
Successfully mark is migrated in characterization, at this point it is possible to which it is to be migrated that the state of monitoring record table is provided for characterization at least one
Tables of data migrates the successful third state, such as MS.
For example, mark 1 indicates that migration failure, mark 2 expression migrates successfully, it, can be by if what is received is mark 1
The state of cis_merge_deamon_summary is changed to MF, can be by cis_merge_ if what is received is mark 2
The state of deamon_summary is changed to MS.
In accordance with an embodiment of the present disclosure, it if this migration needs to be migrated based on multiple base data table, is being based on
After the circulative metabolism that current base data table (such as target base data table) carries out Data Migration is completed, it is also necessary to judge
Whether the migration operation for relying on multiple base data table has been fully completed；And if it is not, then from multiple base data table really
Make the base data table that next migration operation relies on.
For example, in conjunction with above-mentioned example, after the migration operation based on cis_merge_deamon_base1 is completed, due to
One shares 10 base data table, and is currently to be migrated based on the 1st base data table, therefore may determine that also
The corresponding migration of 9 base data table does not complete.At this point it is possible to using the 2nd underlying table as the basic number that next time, migration relied on
According to table.But if target base data table is cis_merge_deamon_base10, it is known that being currently base
It is migrated in the 10th plinth tables of data, it may be considered that the migration operation based on this 10 base data table is completed.
The Data Migration monitoring method based on storing process that the disclosure provides, migration during primary storage switch quilt
When triggering, relied on target basis number is migrated from this is found at least one base data table for storing basic data
It is stored in monitoring record table according to table, and by the table name of the target base data table, is to monitor the data of this migration
Which executed based on base data table.Further, corresponding secondary storing process is triggered, it will be associated with target base data table
And at least tables of data to be migrated for storing data to be migrated is migrated, and by least tables of data to be migrated
Migration results are recorded in the associated position of table name with target base data table in monitoring record table.Embodiment of the disclosure
By being added monitoring record to data migration process, Data Migration situation can be grasped in time, by data migration process
Relevant information carries out unified conclusion, facilitates subsequent analysis, overcomes database migration in the prior art and monitoring mechanism is not present,
It is unfavorable for observing the defect of data transition state.
Fig. 2 is diagrammatically illustrated according to the Data Migration monitoring method based on storing process of another embodiment of the disclosure
Flow chart.
As shown in Fig. 2, being somebody's turn to do the Data Migration monitoring method based on storing process may include step S201~step S216,
Wherein:
In step S201, basic data prepares；
In step S202, basic data distribution；
Become U in the state of step S203, base data table；
In step S204, trigger data migrates primary storage process；
In step S205, judge whether the switch of Data Migration is opened, if it is not, step S216 is executed, if so, executing step
S206；
In step S206, MR is set by the state of monitoring record table；
In step S207, trigger data migrates secondary storing process；
In step S208, tables of data to be migrated is obtained；
In step S209, trigger recording data update；
In step S210, the Data Migration storing process of specific every tables of data to be migrated is triggered；
In step S211, start to migrate the data in tables of data to be migrated；
In step S212, migration results are recorded；
In step S213, judge whether migration operation exception occurs, if executing step S214, executes step if not
S215；
In step S214, MF is set by the state of monitoring record table；
In step S215, MS is set by the state of monitoring record table；
In step S216, terminate.
In embodiment of the disclosure, before carrying out Data Migration, basic data preparation can be first carried out, by base
Plinth data are assigned in an at least base data table, and the state of every data in each base data table are respectively provided with
For U.The primary storage process of trigger data migration, judges whether the switch in preset configuration table is opened, if not having, stops this
Migration operation；If opening, MR is set by the state of monitoring record table.Trigger data migrates secondary storing process, from pre- establishing
Acquisition preset table type in table is set, these table types are recycled, to the data in the corresponding tables of data to be migrated of each table type
Data migration operation is executed, migration results are then recorded.Judge whether this migration operation exception occurs, if so, will monitoring
State in record sheet is set as MF；If it is not, setting MS for the state in monitoring record table.
Fig. 3 diagrammatically illustrates the frame of the Data Migration monitoring system based on storing process according to the embodiment of the present disclosure
Figure.
As shown in figure 3, should Data Migration monitoring system 300 based on storing process may include the first determining module 310,
Memory module 320, processing module 330, the second determining module 340 and logging modle 350, in which:
First determining module 310 is used to monitor the migration switch during knowing primary storage and is triggered, from an at least Zhang Ji
The target base data table that this migration relies on is determined in plinth tables of data；
Memory module 320 is for storing the table name of target base data table into monitoring record table；
Processing module 330 obtains target base data table associated at least one for triggering corresponding secondary storing process
Tables of data to be migrated, and at least a tables of data to be migrated migrating, wherein in target base data table for store with
The basic data of data correlation to be migrated in the tables of data to be migrated of every of at least one tables of data to be migrated；
Second determining module 340 is used to determine the migration results of at least one tables of data to be migrated；And
Migration results for being recorded in monitoring record table and the associated position of table name by logging modle 350.
The Data Migration monitoring scheme based on storing process that the disclosure provides, migration during primary storage switch quilt
When triggering, relied on target basis number is migrated from this is found at least one base data table for storing basic data
It is stored in monitoring record table according to table, and by the table name of the target base data table, is to monitor the data of this migration
Which executed based on base data table.Further, corresponding secondary storing process is triggered, it will be associated with target base data table
And at least tables of data to be migrated for storing data to be migrated is migrated, and by least tables of data to be migrated
Migration results are recorded in the associated position of table name with target base data table in monitoring record table.Embodiment of the disclosure
By being added monitoring record to data migration process, Data Migration situation can be grasped in time, by data migration process
Relevant information carries out unified conclusion, facilitates subsequent analysis, overcomes database migration in the prior art and monitoring mechanism is not present,
It is unfavorable for observing the defect of data transition state.
As a kind of optional embodiment, the second determining module includes: the first determination unit, for determine at least one to
The migration item number of successful data is migrated in migrating data table；Second determination unit, for determining to belong to from migration item number
The update item number of more new data；And third determination unit, belong to the newly-increased of newly-increased data for determining from migration item number
Item number.
As a kind of optional embodiment, the second determination unit is also used to: data being called to update library；It is updated based on data
Library determines and updates item number.
As a kind of optional embodiment, third determination unit is also used to: based on migration item number and being updated item number, is determined new
Increase item number.
As a kind of optional embodiment, system further include: the first setup module, for by target base data table
After table name is stored into monitoring record table, the state of monitoring record table is provided for characterization and is relying on target basis
The first state of tables of data execution migration operation.
As a kind of optional embodiment, system further include: first judgment module, for judging an at least number to be migrated
Whether there is exception according to the transition process of table；And second setup module, for judging an at least tables of data to be migrated
Transition process there is exception in the case where, by the state of monitoring record table be provided for characterization an at least data to be migrated
Second state of table migration failure；Or third setup module, in the migration for judging at least one tables of data to be migrated
In the case that process exception does not occur, the state of monitoring record table is provided for a characterization at least tables of data to be migrated
Migrate the successful third state.
As a kind of optional embodiment, an at least base data table includes multiple base data table, system further include:
Second judgment module, for judging whether the migration operation for relying on multiple base data table has been fully completed；And third is true
Cover half block, in the case where judging that the migration operation for relying on multiple base data table is not fully completed, from multiple bases
The base data table that next migration operation relies on is determined in plinth tables of data.
Fig. 4 diagrammatically illustrates the Data Migration monitoring side being adapted for carrying out based on storing process according to the embodiment of the present disclosure
The hardware structure schematic diagram of the computer equipment of method.In the present embodiment, computer equipment 400 is that one kind can be according to being previously set
Or the instruction of storage, the automatic equipment for carrying out numerical value calculating and/or information processing.For example, it may be smart phone, plate are electric
Brain, laptop, desktop computer, rack-mount server, blade server, tower server or Cabinet-type server
(including server cluster composed by independent server or multiple servers) etc..As shown, computer equipment 400
It includes, but is not limited to: that connection memory 410, processor 420, network interface 430 can be in communication with each other by system bus.Its
In:
Memory 410 includes at least a type of computer readable storage medium, and readable storage medium storing program for executing includes flash memory, hard
Disk, multimedia card, card-type memory (for example, SD or DX memory etc.), random access storage device (RAM), static random-access
Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), may be programmed read-only storage at read-only memory (ROM)
Device (PROM), magnetic storage, disk, CD etc..In some embodiments, memory 410 can be computer equipment 400
Storage inside module, such as the hard disk or memory of the computer equipment 400.In further embodiments, memory 410 can also be with
It is the External memory equipment of computer equipment 400, such as the plug-in type hard disk being equipped in the computer equipment 400, intelligent storage
Block (Smart Media Card, referred to as SMC), secure digital (Secure Digital, referred to as SD) card, flash card
(Flash Card) etc..Certainly, memory 410 can also both including computer equipment 400 storage inside module and also including it
External memory equipment.In the present embodiment, memory 410 commonly used in storage be installed on computer equipment 400 operating system and
Types of applications software, such as the program code etc. of the Data Migration monitoring method based on storing process.In addition, memory 410 is also
It can be used for temporarily storing the Various types of data that has exported or will export.
Processor 420 can be central processing unit (Central Processing Unit, abbreviation in some embodiments
For CPU), controller, microcontroller, microprocessor or other data processing chips.The processor 420 is commonly used in control meter
Calculate machine equipment 400 overall operation, such as execute with computer equipment 400 carry out data interaction or communication it is relevant control and
Processing etc..In the present embodiment, program code or processing data of the processor 420 for being stored in run memory 410.
Network interface 430 may include radio network interface or wired network interface, which is commonly used in counting
It calculates to establish between machine equipment 400 and other computer equipments and communicate to connect.For example, network interface 430 is by passing through network by based on
Calculate machine equipment 400 be connected with exterior terminal, between computer equipment 400 and exterior terminal establish data transmission channel and lead to
Letter connection etc..Network can be intranet (Intranet), internet (Internet), global system for mobile communications
(Global System of Mobile communication, referred to as GSM), wideband code division multiple access (Wideband Code
Division Multiple Access, referred to as WCDMA), 4G network, 5G network, bluetooth (Bluetooth), the nothings such as Wi-Fi
Line or cable network.
It should be pointed out that Fig. 4 illustrates only the computer equipment with component 410-430, it should be understood that simultaneously
All components shown realistic are not applied, the implementation that can be substituted is more or less component.
In the present embodiment, being stored in the Data Migration monitoring method based on storing process in memory 410 can be with
It is divided into one or more program module, and performed by one or more processors (the present embodiment is processor 420),
To complete the present invention.
The present embodiment also provides a kind of computer readable storage medium, and computer readable storage medium is stored thereon with calculating
Machine program realizes the Data Migration monitoring method based on storing process in embodiment when computer program is executed by processor
Step.
In the present embodiment, computer readable storage medium include flash memory, hard disk, multimedia card, card-type memory (for example,
SD or DX memory etc.), random access storage device (RAM), static random-access memory (SRAM), read-only memory (ROM),
Electrically erasable programmable read-only memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD
Deng.In some embodiments, computer readable storage medium can be the internal storage unit of computer equipment, such as the calculating
The hard disk or memory of machine equipment.In further embodiments, computer readable storage medium is also possible to the outer of computer equipment
The plug-in type hard disk being equipped in portion's storage equipment, such as the computer equipment, intelligent memory card (Smart Media Card, letter
Referred to as SMC), secure digital (Secure Digital, referred to as SD) card, flash card (Flash Card) etc..Certainly, computer
Readable storage medium storing program for executing can also both including computer equipment internal storage unit and also including its External memory equipment.The present embodiment
In, computer readable storage medium is installed on the operating system and types of applications software of computer equipment, example commonly used in storage
The program code of the Data Migration monitoring method based on storing process in such as embodiment.In addition, computer-readable storage medium
Matter can be also used for temporarily storing the Various types of data that has exported or will export.
Obviously, those skilled in the art should be understood that each module of the above-mentioned embodiment of the present invention or each step can be with
It is realized with general computing device, they can be concentrated on a single computing device, or be distributed in multiple computing devices
On composed network, optionally, they can be realized with the program code that computing device can perform, it is thus possible to by it
Store and be performed by computing device in the storage device, and in some cases, can be held with the sequence for being different from herein
The shown or described step of row, perhaps they are fabricated to each integrated circuit modules or will be multiple in them
Module or step are fabricated to single integrated circuit module to realize.In this way, the embodiment of the present invention be not limited to it is any specific hard
Part and software combine.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of Data Migration monitoring method based on storing process characterized by comprising
It monitors the migration switch during knowing primary storage to be triggered, determines this migration from an at least base data table
The target base data table of dependence；
The table name of the target base data table is stored into monitoring record table；
Corresponding secondary storing process is triggered, the associated at least tables of data to be migrated of the target base data table is obtained, and
An at least tables of data to be migrated is migrated, wherein in the target base data table for store with it is described extremely
The basic data of data correlation to be migrated in every tables of data to be migrated of a few tables of data to be migrated；
Determine the migration results of at least one tables of data to be migrated；And
The migration results are recorded in the monitoring record table and the associated position of the table name.
2. the method according to claim 1, wherein at least tables of data to be migrated described in the determination is moved
Move result, comprising:
Determine the migration item number that successful data are migrated in an at least tables of data to be migrated；
Determine to belong to the update item number of more new data from the migration item number；And
The newly-increased item number for belonging to newly-increased data is determined from the migration item number.
3. according to the method described in claim 2, it is characterized in that, described determine to belong to update number from the migration item number
According to update item number, comprising:
Data are called to update library；
Library is updated based on the data, determines the update item number.
4. according to the method described in claim 3, it is characterized in that, described determine to belong to newly-increased number from the migration item number
According to newly-increased item number, comprising:
Based on the migration item number and the update item number, the newly-increased item number is determined.
5. the method according to claim 1, wherein being deposited in the table name by the target base data table
After storage is into monitoring record table, the method also includes:
The state of the monitoring record table is provided for characterization and is relying on the target base data table execution migration behaviour
The first state of work.
6. the method according to claim 1, wherein the method also includes:
Judge whether the transition process of at least one tables of data to be migrated exception occurs；And
It is lost if so, the state of the monitoring record table is provided for a characterization at least tables of data migration to be migrated
The second state lost；Or
If it is not, then by the state of the monitoring record table be provided for a characterization at least tables of data migration to be migrated at
The third state of function.
7. the method according to claim 1, wherein an at least base data table includes multiple basic numbers
According to table, the method also includes:
Judge whether the migration operation for relying on multiple base data table has been fully completed；And
If it is not, then determining the base data table that next migration operation relies on from multiple described base data table.
8. a kind of Data Migration monitoring system based on storing process characterized by comprising
First determining module is triggered, from an at least basic data for monitoring the migration switch during knowing primary storage
The target base data table that this migration relies on is determined in table；
Memory module, for storing the table name of the target base data table into monitoring record table；
Processing module, for triggering corresponding secondary storing process, obtain associated at least one of the target base data table to
Migrating data table, and an at least tables of data to be migrated is migrated, wherein it is used in the target base data table
The basic data of storage and the data correlation to be migrated in every tables of data to be migrated of at least one tables of data to be migrated；
Second determining module, for determining the migration results of at least one tables of data to be migrated；And
Logging modle, for being recorded in the migration results in the monitoring record table and the associated position of the table name.
9. a kind of computer equipment, can run on a memory and on a processor including memory, processor and storage
Computer program, which is characterized in that the processor executes any for realizing claim 1 to 7 when the computer program
The step of item the method.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of when being executed by processor for realizing any one of claim 1 to 7 the method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910190654.8A CN110059072A (en) | 2019-03-13 | 2019-03-13 | Data Migration monitoring method, system, equipment and medium based on storing process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910190654.8A CN110059072A (en) | 2019-03-13 | 2019-03-13 | Data Migration monitoring method, system, equipment and medium based on storing process |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110059072A true CN110059072A (en) | 2019-07-26 |
Family
ID=67317015
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910190654.8A Pending CN110059072A (en) | 2019-03-13 | 2019-03-13 | Data Migration monitoring method, system, equipment and medium based on storing process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110059072A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110909062A (en) * | 2019-11-29 | 2020-03-24 | 迈普通信技术股份有限公司 | Data processing method and device, electronic equipment and readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150331857A1 (en) * | 2014-05-15 | 2015-11-19 | Microsoft Corporation | Database migration |
| CN107729570A (en) * | 2017-11-20 | 2018-02-23 | 北京百度网讯科技有限公司 | Data migration method and device for server |
| US20180137113A1 (en) * | 2016-11-16 | 2018-05-17 | Sap Se | Minimizing downtime in migrating content of databases systems |
| CN108388599A (en) * | 2018-02-01 | 2018-08-10 | 平安科技（深圳）有限公司 | Electronic device, Data Migration and call method and storage medium |
| CN108446315A (en) * | 2018-02-07 | 2018-08-24 | 中国平安人寿保险股份有限公司 | Big data moving method, device, equipment and storage medium |
| CN109408493A (en) * | 2018-10-17 | 2019-03-01 | 成都四方伟业软件股份有限公司 | A kind of moving method and system of data source |
-
2019
- 2019-03-13 CN CN201910190654.8A patent/CN110059072A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150331857A1 (en) * | 2014-05-15 | 2015-11-19 | Microsoft Corporation | Database migration |
| US20180137113A1 (en) * | 2016-11-16 | 2018-05-17 | Sap Se | Minimizing downtime in migrating content of databases systems |
| CN107729570A (en) * | 2017-11-20 | 2018-02-23 | 北京百度网讯科技有限公司 | Data migration method and device for server |
| CN108388599A (en) * | 2018-02-01 | 2018-08-10 | 平安科技（深圳）有限公司 | Electronic device, Data Migration and call method and storage medium |
| CN108446315A (en) * | 2018-02-07 | 2018-08-24 | 中国平安人寿保险股份有限公司 | Big data moving method, device, equipment and storage medium |
| CN109408493A (en) * | 2018-10-17 | 2019-03-01 | 成都四方伟业软件股份有限公司 | A kind of moving method and system of data source |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110909062A (en) * | 2019-11-29 | 2020-03-24 | 迈普通信技术股份有限公司 | Data processing method and device, electronic equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110782240B (en) | Business data processing method and device, computer equipment and storage medium | |
| CN108845950A (en) | Test device, the method for test and storage medium | |
| CN109918194A (en) | Intelligent dilatation capacity reduction method, device, computer equipment and storage medium | |
| CN108280148A (en) | A kind of data migration method and data migration server | |
| CN108615096A (en) | Server, the processing method of Financial Time Series and storage medium | |
| CN109614206A (en) | Device, method and the storage medium of block chain issued transaction | |
| CN108681504A (en) | Automated testing method, test server and computer readable storage medium | |
| CN109445690B (en) | RAID card performance optimization method, device, terminal and storage medium | |
| WO2020151320A1 (en) | Data storage method, apparatus, computer device, and storage medium | |
| CN108510287A (en) | Judgment method, electronic device and the computer readable storage medium that client pays a return visit | |
| CN115033340A (en) | Host selection method and related device | |
| CN107844711B (en) | Data manipulation permission partition method, application server and computer readable storage medium | |
| CN107357721B (en) | Method and device for testing system | |
| CN108427635A (en) | Quickly method, server and the computer readable storage medium of test web page | |
| CN112835808A (en) | Interface testing method and device, computer equipment and storage medium | |
| CN110059072A (en) | Data Migration monitoring method, system, equipment and medium based on storing process | |
| CN108255735A (en) | Associated environment test method, electronic device and computer readable storage medium | |
| US11412063B2 (en) | Method and apparatus for setting mobile device identifier | |
| CN114490089A (en) | Cloud computing resource automatic adjusting method and device, computer equipment and storage medium | |
| CN110059071A (en) | Data comparison monitoring method, system, equipment and medium based on storing process | |
| CN109241103A (en) | Data expansion querying method, electronic device and computer readable storage medium | |
| CN109815070A (en) | A kind of HOST-BOX server stability test method, apparatus, terminal and storage medium | |
| CN108664343A (en) | A kind of stateful call method and device of micro services | |
| CN110084476B (en) | Case adjustment method, device, computer equipment and storage medium | |
| CN109995571B (en) | Method and device for matching server configuration and VNF application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |