CN109840160A - It is a kind of abnormal for several detection methods, device and terminal device based on Data Migration - Google Patents
It is a kind of abnormal for several detection methods, device and terminal device based on Data Migration Download PDFInfo
- Publication number
- CN109840160A CN109840160A CN201910003213.2A CN201910003213A CN109840160A CN 109840160 A CN109840160 A CN 109840160A CN 201910003213 A CN201910003213 A CN 201910003213A CN 109840160 A CN109840160 A CN 109840160A
- Authority
- CN
- China
- Prior art keywords
- modification
- synchronized
- list
- several processes
- target account
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 60
- 230000002159 abnormal effect Effects 0.000 title claims abstract description 44
- 230000005012 migration Effects 0.000 title claims abstract description 20
- 238000013508 migration Methods 0.000 title claims abstract description 20
- 238000000034 method Methods 0.000 claims abstract description 160
- 230000004048 modification Effects 0.000 claims abstract description 112
- 238000012986 modification Methods 0.000 claims abstract description 112
- 230000001360 synchronised effect Effects 0.000 claims abstract description 93
- 230000008569 process Effects 0.000 claims abstract description 87
- 230000005540 biological transmission Effects 0.000 claims description 23
- 238000004590 computer program Methods 0.000 claims description 3
- 230000006399 behavior Effects 0.000 claims 1
- 238000004364 calculation method Methods 0.000 claims 1
- 230000008859 change Effects 0.000 description 12
- 238000004891 communication Methods 0.000 description 10
- 238000012545 processing Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000005236 sound signal Effects 0.000 description 4
- 230000000712 assembly Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 238000013523 data management Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000005401 electroluminescence Methods 0.000 description 1
- 238000012384 transportation and delivery Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Abstract
The present invention relates to cloud storage technical fields, disclose a kind of abnormal for several detection methods, device and terminal device based on Data Migration.The described method includes: being judged in the table of source by scanning source table and the corresponding hive table of each source table with the presence or absence of list of modification；And when there are list of modification, using the corresponding object table of list of modification as object table to be synchronized, using object table to be synchronized it is associated for several processes as abnormal for several processes, and pending operation is executed for several processes to exception, and the prompt information for being used to indicate the target account owner and updating object table to be synchronized is sent to target account.Implementing this method can achieve the purpose guaranteed for several accuracys.
Description
Technical field
The present invention relates to cloud storage technical field, in particular to it is a kind of based on Data Migration it is abnormal for several detection methods,
Device and terminal device.
Background technique
Currently, the business datum delivery of company is generallyd include in the process of third-party platform: data management system receives
The data requirements of third-party platform, and extracted according to business datum of the data requirements to company, and the industry that will be extracted
Business data are supplied to third-party platform.In practice, it has been found that when the change of certain source tables (as increased and/or deleting literary name section),
If notice often makes data pick-up still according to source table structure before to related total business data person not in time, thus
Directly affect the accuracy of the business datum of third-party platform acquisition.
Summary of the invention
In order to solve for the technical problem of number inaccuracy in available data management system, the present invention provides one kind based on number
According to the abnormal for several detection methods, device and terminal device of migration.
It is a kind of abnormal for several detection methods based on Data Migration, which comprises
By scanning source table and the corresponding hive table of each source table, judge in the source table with the presence or absence of list of modification；
Wherein, table structure indicated by the table structure of the list of modification and the corresponding hive table of the list of modification is inconsistent；
When there are the list of modification, using the corresponding object table of the list of modification as object table to be synchronized；
Using the object table to be synchronized it is associated for several processes as abnormal for several processes；
Pending operation is executed for several processes to the exception；
It is sent to target account and is used to indicate the prompt letter that the target account owner updates the object table to be synchronized
Breath.
A kind of exception is for several detection devices, comprising:
Scanning element is in the source table for judging by scanning source table and the corresponding hive table of each source table
It is no that there are list of modification；Wherein, table knot indicated by the table structure of the list of modification and the corresponding hive table of the list of modification
Structure is inconsistent；
Determination unit, for when there are the list of modification, using the corresponding object table of the list of modification as mesh to be synchronized
Mark table；And using the object table to be synchronized it is associated for several processes as abnormal for several processes；
Control unit, for executing pending operation for several processes to the exception；
Transmission unit updates the mesh to be synchronized for being used to indicate the target account owner to the transmission of target account
Mark the prompt information of table.
A kind of terminal device, the terminal device include:
Processor；
Memory is stored with computer-readable instruction on the memory, and the computer-readable instruction is by the processing
When device executes, foregoing method is realized.
The technical solution that the embodiment of the present invention provides can include the following benefits:
Exception provided by the present invention based on Data Migration includes the following steps for several detection methods, by scanning source table
Hive table corresponding with each source table judges with the presence or absence of list of modification in the table of source, and when there are list of modification, by list of modification pair
The object table answered as object table to be synchronized, and using object table to be synchronized it is associated for several processes as abnormal for several processes,
And to exception for several processes execute pending operation, and to target account transmission be used to indicate the target account owner update to
The prompt information of synchronous object table.
Under the method, the change of source table is monitored by scanning source table and each source table corresponding hive table, and
In the case that in source, table is changed, pause is related for several processes in time, it is ensured that for the accuracy of data in several processes.
It should be understood that the above general description and the following detailed description are merely exemplary, this can not be limited
Invention.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows and meets implementation of the invention
Example, and in specification together principle for explaining the present invention.
Fig. 1 is a kind of schematic diagram of the exception shown according to an exemplary embodiment for several detection devices；
Fig. 2 is a kind of abnormal process for several detection methods based on Data Migration shown according to an exemplary embodiment
Figure；
Fig. 3 is a kind of abnormal stream for several detection methods based on Data Migration shown according to another exemplary embodiment
Cheng Tu；
Fig. 4 is a kind of block diagram of the exception shown according to an exemplary embodiment for several detection devices；
Fig. 5 is a kind of block diagram of exception for showing according to another exemplary embodiment for several detection devices.
Specific embodiment
Here will the description is performed on the exemplary embodiment in detail, the example is illustrated in the accompanying drawings.Following description is related to
When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistented with the present invention.On the contrary, they be only with it is such as appended
The example of device and method being described in detail in claims, some aspects of the invention are consistent.
Implementation environment of the invention can be portable terminal device, such as smart phone, tablet computer, desktop computer.Fig. 1
It is a kind of schematic diagram of the exception shown according to an exemplary embodiment for several detection devices.Exception can for several detection devices 100
To be above-mentioned portable terminal device.As shown in Figure 1, exception may include following one or more components for several detection devices 100:
Processing component 102, memory 104, power supply module 106, multimedia component 108, audio component 110, sensor module 114 and
Communication component 116.
The abnormal integrated operation for several detection devices 100 of the usually control of processing component 102, such as with display, call,
Data communication, camera operation and the associated operation of record operation etc..Processing component 102 may include one or more processing
Device 118 executes instruction, to complete all or part of the steps of following methods.In addition, processing component 102 may include one
Or multiple modules, for convenient for the interaction between processing component 102 and other assemblies.For example, processing component 102 may include more
Media module, for facilitate the interaction between multimedia component 108 and processing component 102.
Memory 104 is configured as storing various types of data to support the operation in exception for several detection devices 100.
The example of these data include in exception for the instruction of any application or method operated in several detection devices 100.
Memory 104 can realize by any kind of volatibility or non-volatile memory device or their combination, it is such as static with
Machine accesses memory (Static Random Access Memory, abbreviation SRAM), electrically erasable programmable read-only memory
(Electrically Erasable Programmable Read-Only Memory, abbreviation EEPROM), erasable programmable
Read-only memory (Erasable Programmable Read Only Memory, abbreviation EPROM), programmable read only memory
(Programmable Red-Only Memory, abbreviation PROM), read-only memory (Read-Only Memory, abbreviation ROM),
Magnetic memory, flash memory, disk or CD.One or more modules are also stored in memory 104, for this or
Multiple modules are configured to be executed by the one or more processors 118, to complete the whole or portion in method as follows
Step by step.
Power supply module 106 provides electric power for the abnormal various assemblies for several detection devices 100.Power supply module 106 can wrap
Include power-supply management system, one or more power supplys and other with to be abnormal generate, manage, and distribute electricity for several detection devices 100
The associated component of power.
Multimedia component 108 includes in exception for one output interface of offer between several detection devices 100 and user
Screen.In some embodiments, screen may include liquid crystal display (Liquid Crystal Display, abbreviation LCD) and
Touch panel.If screen includes touch panel, screen may be implemented as touch screen, to receive input letter from the user
Number.Touch panel includes one or more touch sensors to sense the gesture on touch, slide, and touch panel.Touch sensing
Device can not only sense the boundary of a touch or slide action, but also detect the duration relevant with touch or slide and
Pressure.Screen can also include display of organic electroluminescence (Organic Light Emitting Display, abbreviation
OLED)。
Audio component 110 is configured as output and/or input audio signal.For example, audio component 110 includes a Mike
Wind (Microphone, abbreviation MIC), when exception is in operation mode for several detection devices 100, such as call model, logging mode
When with speech recognition mode, microphone is configured as receiving external audio signal.The received audio signal can be further
It is stored in memory 104 or is sent via communication component 116.In some embodiments, audio component 110 further includes a loudspeaking
Device is used for output audio signal.
Sensor module 114 includes one or more sensors, for providing each side for several detection devices 100 to be abnormal
The status assessment in face.For example, sensor module 114, which can detecte exception, opens/closes state for several detection devices 100,
The relative positioning of component, sensor module 114 can also detect abnormal for several detection devices 100 or abnormal for several detection devices
The position change and the abnormal temperature change for several detection devices 100 of 100 1 components.In some embodiments, the sensing
Device assembly 114 can also include Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 116 is configured to facilitate abnormal for wired or wireless side between several detection devices 100 and other equipment
The communication of formula.It is abnormal to access the wireless network based on communication standard for several detection devices 100, such as WiFi (Wireless-
Fidelity, Wireless Fidelity).In one exemplary embodiment, communication component 116 is received via broadcast channel from external wide
The broadcast singal or broadcast related information of broadcast management system.In one exemplary embodiment, communication component 116 further includes near field
(Near Field Communication, abbreviation NFC) module is communicated, for promote short range communication.For example, in NFC module
It can be based on radio frequency identification (Radio Frequency Identification, abbreviation RFID) technology, Infrared Data Association
(Infrared Data Association, abbreviation IrDA) technology, ultra wide band (Ultra Wideband, abbreviation UWB) technology,
Bluetooth technology and other technologies are realized.
In the exemplary embodiment, exception can be by one or more application specific integrated circuit for several detection devices 100
At (Application Specific Integrated Circuit, abbreviation ASIC), digital signal processor, digital signal
Manage equipment, programmable logic device, field programmable gate array, controller, microcontroller, microprocessor or other electronic components
It realizes, for executing following methods.
Fig. 2 is a kind of abnormal process for several detection methods based on Data Migration shown according to an exemplary embodiment
Figure.As shown in Fig. 2, the method includes the following steps.
Step 201, by scanning source table and the corresponding hive table of each source table, judge to whether there is list of modification in the table of source,
If so, executing step 202~step 205；If not, terminating this process.
In embodiments of the present invention, table structure indicated by the table structure of list of modification and the corresponding hive table of list of modification is different
It causes.Be described in detail below: stored in the corresponding hive table of each source table active table table structure (table name, field information, record with
And index etc.), it may determine that in the table of source by scanning source table and the corresponding hive table of source table with the presence or absence of list of modification.Wherein,
Judge that the specific implementation in the table of source with the presence or absence of list of modification can be by scanning source table and the corresponding hive table of source table, when
When the inconsistent source table of the table structure stored in the table of source there are the corresponding hive table of table structure, using the source table as change
The inconsistent source table of the table structure that the corresponding hive table of table, i.e. table structure is stored, continues to execute step 202~step
205；And it when the table structure that table corresponding hive table in source each in the table of source is stored is consistent, determines and is not present in the table of source
List of modification then terminates this process.
Step 202, using the corresponding object table of above-mentioned list of modification as object table to be synchronized.
It should be noted that the embodiment of the present invention be based on kettle realize data pick-up, carry out data pick-up it
Before, it usually needs create the corresponding object table of each source table, wherein the corresponding relationship of source table and object table can be one-to-one
Relationship is also possible to many-to-one relationship, i.e. a source table can correspond to an object table, is also possible to multiple source tables corresponding one
A object table.The some or all of field information of its corresponding source table is stored in object table, kettle can be by automatic
The migration of the field information of matching source table and object table realization source table data.
Step 203, using object table to be synchronized it is associated for several processes as abnormal for several processes.
Optionally, in one exemplary embodiment, it before executing step 203, can also determine whether to receive third
What Fang Pingtai was sent requests for number；When receiving this for number request, open corresponding for several processes for number request with this.
Wherein, using above-mentioned object table to be synchronized it is associated for several processes as abnormal for several processes, may include: with this
It is corresponding associated for several processes with above-mentioned object table to be synchronized for being searched in several processes for number request；To find out with it is above-mentioned
Object table to be synchronized is associated to be used as exception for several processes for several processes.The exemplary embodiment is flat based on the third party received
Requesting for number for platform, exception is searched for several processes, and the abnormal search efficiency for several processes can be improved.
Step 204, pending operation is executed for several processes to exception.
Step 205, it is sent to target account and is used to indicate the prompt letter that the target account owner updates object table to be synchronized
Breath.
By executing step 201~step 205, there are in the case where list of modification in the table of source, by the corresponding mesh of list of modification
It is associated for several processes as object table to be synchronized, and pause object table to be synchronized to mark table, and sends and uses to target account
The prompt information of object table to be synchronized is updated in the instruction target account owner.It can be guaranteed by implementing this method for several processes
The accuracy of middle data.
It should be noted that step 201 can be periodical execution, it is also possible to execute in real time, the embodiment of the present invention is not
It limits.Optionally, periodicity or real time scan source table and the corresponding hive table of each source table judge to whether there is in the table of source
List of modification, and when judging that the corresponding object table of list of modification is marked, and is receiving there are when list of modification in the table of source
When requesting to third-party platform for number, whether judgement has label for the corresponding object table of number request with this, and work as and this
When requesting corresponding object table with label for number, this will be used to indicate for the corresponding letter for opening failure for several processes of number request
Breath output；And when not having label for the corresponding object table of number requests with this, this will be used to indicate for number request correspondences
Open successful information for several processes and export.Based on the optional exemplary embodiment, there are when list of modification in the table of source, go back
Scanning result can be obtained by comparing list of modification hive table corresponding with its.Wherein, it is corresponding for number request to be used to indicate this
Opening in successful information for several processes may include the scanning result.It can be by preparatory by implementing the exemplary embodiment
The corresponding object table of list of modification is marked, quickly determines whether that response received requests for number, prevents abnormal to run for several processes.
It is further alternative, in a further exemplary embodiment, can also receive third-party platform transmission for number
When request, associated object tables will be requested to be used as several tables for number with this, and will with for the corresponding source table of several tables and hive table
Respectively as source table to be scanned and hive table to be scanned, and by being scanned to source table to be scanned and hive table to be scanned,
Judge in source table to be scanned with the presence or absence of list of modification, and there are when list of modification in source table to be scanned, it is to be scanned by comparing
Source table and hive table to be scanned generate the modification information for being directed to list of modification, and the modification information is exported, so that total business number
The corresponding object table of list of modification in source table to be scanned can be updated according to modification information according to member.It is exemplary by implementing this
Embodiment, the instructions for number request that can be sent according to third-party platform are targetedly to source table to be scanned and to be scanned
Hive table is scanned, and scanning speed not only can be improved, and can also mitigate system burden.
Fig. 3 is a kind of abnormal stream for several detection methods based on Data Migration shown according to another exemplary embodiment
Cheng Tu.As shown in figure 3, in addition to the step shown in Fig. 2, after step 204 and before step 205, based on number in this embodiment
According to the abnormal further comprising the steps of for several detection methods of migration:
Step 305, target work number is determined from total business data person's registration form according to current point in time；Wherein, total business
Record has working hour and the work number of each total business data person in data person's registration form.
Step 306, the register information of the corresponding total business data person of target work number is obtained, which includes at least mesh
Mark the contact method of the corresponding total business data person of work number.
Step 307, target account is determined according to above-mentioned contact method.
Wherein, for step 301~step 304 and the detailed description of step 308, referring to figure 2. shown in based on number
According to the abnormal description for step 201~step 204 and step 205 in several detection methods of migration, the embodiment of the present invention is no longer
It repeats.
In the embodiment of the present invention, the corresponding above-mentioned contact method of target work number can be one kind and be also possible to a variety of, this hair
Bright embodiment is without limitation.If the corresponding contact method of target work number is a variety of, and the priority level of each contact method
Difference optionally in one exemplary embodiment, determines target account according to above-mentioned contact method, may include: that acquisition is above-mentioned
The priority level of every kind of contact method in contact method；By the highest contact method pair of priority level in above-mentioned contact method
The account answered is determined as target account.It is further alternative based on the exemplary embodiment, it is used to indicate to the transmission of target account
After the target account owner updates the prompt information of object table to be synchronized, it can also judge whether detect in preset duration
The target account owner operates for the update of object table to be synchronized, and works as and judge that target account owner's needle is not detected
When being operated to the update of object table to be synchronized, target account is updated according to preset rules.In embodiments of the present invention, it presses
The specific implementation being updated according to preset rules to target account is as follows: priority level in above-mentioned contact method is only secondary
It is corresponding as first object contact method, and using first object contact method in the contact method of highest priority level
Account more fresh target account, and terminate when this target account updates, and target account institute is not detected in preset duration
When the person of having operates for the update of object table to be synchronized, priority level in above-mentioned contact method is only second to first object connection
The contact method of mode is as the second target contact address, and utilizes the corresponding account more fresh target of the second target contact address
Account, and so on until having traversed all contact methods in above-mentioned contact method.By implementing the exemplary embodiment, when
When update operation of the target account owner for object table to be synchronized being not detected in preset duration, it can be based on above-mentioned
It is that the grade of the priority of mode traverses all contact methods for including in above-mentioned contact method, it can be maximum
Guarantee that the target account owner timely updates to object table to be synchronized.
It should be noted that above-mentioned contact method can be mail, QQ, wechat or short message etc., then, above-mentioned connection
The corresponding account of mode can be Email Accounts, QQ account, wechat account or phone number etc..
Step 309, it is generated according to above-mentioned list of modification and the corresponding hive table of above-mentioned list of modification for object table to be synchronized
More table information.
In embodiments of the present invention, it is directed to according to what above-mentioned list of modification and the corresponding hive table of above-mentioned list of modification generated to same
The more table information of step object table is used to state the change of table structure indicated by list of modification hive table corresponding compared to its.Citing
For, if table structure indicated by above-mentioned list of modification hive table corresponding compared to its increases field, then, more table information can
Think increased field information, if table structure indicated by above-mentioned list of modification hive table corresponding compared to its deletes field,
So, more table information can be the field information of deletion.
Step 310, according to above-mentioned more table information, the corresponding hive table of above-mentioned list of modification is updated.
Step 311, Xiang Shangshu target account sends the above-mentioned more table information generated.
In one exemplary embodiment, step 311 has been after having executed, can also in object table to be synchronized with above-mentioned change
The matched field of more table is marked, and is obtained according to the field in above-mentioned modification information and the object table to be synchronized marked
Target modification information.Wherein, which may include the change field information of object table to be synchronized.Implement the example
Property the above-mentioned target account of embodiment the owner can be realized based on target modification information to the quick more table of object table to be synchronized
Operation, further increases the efficiency and accuracy rate for several processes.
Step 309~step 311 is executed, can be automatically updated according to the more table information for object table to be synchronized of generation
The corresponding hive table of above-mentioned list of modification can also send the above-mentioned more table information generated to above-mentioned target account, to be used for target
The account owner to object table to be synchronized execute update operation when refer to, can be improved object table to be synchronized update efficiency and
Accuracy.
Optionally, in one exemplary embodiment, it after step 311 has executed, can also detect whether to receive above-mentioned
The termination more new command that the target account owner sends, and when detection receives the termination more new command, control above-mentioned different
Execution state is often changed by suspended state for several processes.It is further alternative, when detection receives the termination more new command,
It controls above-mentioned exception and execution state is changed by suspended state for several processes, may include: to refer to when detection receives termination and updates
When enabling, the table structure of updated object table to be synchronized is obtained；Judge updated object table to be synchronized table structure whether with
The table structure of list of modification matches；When the table structure of updated object table to be synchronized is matched with the table structure of list of modification, control
Above-mentioned exception is changed into execution state by suspended state for several processes.Specifically, judging the table of updated object table to be synchronized
Whether structure can be with the matched implementation of table structure of list of modification, judge the table structure of updated object table to be synchronized
Whether field corresponding to middle list of modification coincide with the field in list of modification, if coincideing, updated object table to be synchronized
Table structure is matched with the table structure of list of modification, if misfitting, the table structure of updated object table to be synchronized and list of modification
Table structure mismatches.It, can be in the termination for receiving above-mentioned target account owner transmission by implementing the exemplary embodiment
When more new command, the table structure of table structure and list of modification to updated object table to be synchronized is compared, can be further
Guarantee the accuracy for data in several processes.
It is exception disclosed by the invention below for several detection device embodiments.
Fig. 4 is a kind of block diagram of the exception shown according to an exemplary embodiment for several detection devices.As shown in figure 4, should
It is abnormal to may include: for several detection devices
Scanning element 401, for judging to whether there is in the table of source by scanning source table and the corresponding hive table of each source table
List of modification.
In embodiments of the present invention, table structure indicated by the table structure of list of modification and the corresponding hive table of list of modification is different
It causes.Be described in detail below: stored in the corresponding hive table of each source table active table table structure (table name, field information, record with
And index etc.), scanning element 401 may determine that in the table of source by scanning source table and the corresponding hive table of source table with the presence or absence of change
More table.Judge that the table structure stored in the table of source there are the corresponding hive table of table structure is inconsistent in scanning element 401
Source table when, using the source table as list of modification, i.e. the inconsistent source of the table structure that is stored of the corresponding hive table of table structure
Table is determined when the table structure that scanning element 401 judges that the hive table that each source table is corresponding in the table of source is stored is consistent
List of modification is not present in the table of source.
Determination unit 402, for when there are above-mentioned list of modification, using the corresponding object table of above-mentioned list of modification as to be synchronized
Object table；And using object table to be synchronized it is associated for several processes as abnormal for several processes.
Optionally, in one exemplary embodiment, determination unit 402 can be also used for being associated with by object table to be synchronized
For several processes as it is abnormal for several processes before, judge whether to receive requesting for number for third-party platform transmission, and work as
When receiving this for number request, open corresponding for several processes for number request with this.
Wherein it is determined that unit 402 be used for will above-mentioned object table to be synchronized it is associated for several processes as extremely for several processes
Mode be specifically as follows: above-mentioned determination unit 402, for this for number requests it is corresponding in several processes lookup with it is above-mentioned
Object table to be synchronized is associated for several processes, and will find out with above-mentioned object table to be synchronized it is associated for several processes as
Exception is for several processes.The exemplary embodiment is requested based on the third-party platform received for number, to exception for several processes into
Row is searched, and the abnormal search efficiency for several processes can be improved.
Control unit 403, for executing pending operation for several processes to exception.
Transmission unit 404 updates above-mentioned mesh to be synchronized for being used to indicate the target account owner to the transmission of target account
Mark the prompt information of table.
By implementing above-mentioned exception for several detection devices, in source, table is corresponding by list of modification there are in the case where list of modification
Object table is associated for several processes as object table to be synchronized, and pause object table to be synchronized, and sends to target account
Be used to indicate the prompt information that the target account owner updates object table to be synchronized, it is ensured that in several processes data it is accurate
Property.
It should be noted that scanning element 401 is judged in the table of source by scanning source table and the corresponding hive table of each source table
It can be period execution with the presence or absence of list of modification, be also possible to execute in real time, the embodiment of the present invention is without limitation.
401 periodicity of scanning element or real time scan source table and the corresponding hive table of each source table judge in the table of source whether
There are list of modification, and when judging the corresponding object table of list of modification to be marked, Yi Ji in the table of source there are when list of modification
When requesting for number of third-party platform is received, whether judgement has label for the corresponding object table of number requests with this, and works as
With this for the corresponding object table of number request with label when, this will be used to indicate for number request is corresponding and open failure for several processes
Information output；And when not having label for the corresponding object table of number requests with this, this will be used to indicate for number requests
It is corresponding to open successful information output for several processes.Based on the optional exemplary embodiment, there are list of modification in the table of source
When, scanning result can also be obtained by comparing list of modification hive table corresponding with its.Wherein, this is used to indicate for number request pair
Opening in successful information for several processes for answering may include the scanning result.It can be passed through by implementing the exemplary embodiment
The corresponding object table of label list of modification in advance quickly determines whether that response received requests for number, prevents abnormal for several processes
Operation.
Optionally, in one exemplary embodiment, scanning element 401 can receive third-party platform transmission for number
When request, associated object tables will be requested to be used as several tables for number with this, and will with for the corresponding source table of several tables and hive table
Respectively as source table to be scanned and hive table to be scanned, and by being scanned to source table to be scanned and hive table to be scanned,
Judge in source table to be scanned with the presence or absence of list of modification, and there are when list of modification in source table to be scanned, it is to be scanned by comparing
Source table and hive table to be scanned generate the modification information for being directed to list of modification, and the modification information is exported, so that total business number
The corresponding object table of list of modification in source table to be scanned can be updated according to modification information according to member.It is exemplary by implementing this
Embodiment, the instructions for number request that can be sent according to third-party platform are targetedly to source table to be scanned and to be scanned
Hive table is scanned, and scanning speed not only can be improved, and can also mitigate system burden.
Fig. 5 is a kind of block diagram of exception for showing according to another exemplary embodiment for several detection devices.As shown in Figure 5
Abnormal for several detection devices is that as shown in Figure 4 abnormal optimizes to obtain for several detection devices, above-mentioned control unit 403, can be with
For to exception for several processes execute pending operation after and above-mentioned transmission unit 405 to target account transmission be used to indicate
Before the target account owner updates the prompt information of object table to be synchronized, registered according to current point in time from total business data person
Target work number is determined in table；Wherein, in total business data person registration form record have each total business data person working hour and
Work number；And the register information of the corresponding total business data person of target work number is obtained, which includes at least target work number
The contact method of corresponding total business data person；And target account is determined according to the contact method.
In the embodiment of the present invention, the corresponding above-mentioned contact method of target work number can be one kind and be also possible to a variety of, this hair
Bright embodiment is without limitation.If the corresponding contact method of target work number be it is a variety of, the priority level of each contact method is not
Together, optionally, in one exemplary embodiment, above-mentioned control unit 403 is used to determine target account according to above-mentioned contact method
Mode be specifically as follows: above-mentioned control unit 403, for obtaining the priority etc. of every kind of contact method in above-mentioned contact method
Grade；And the corresponding account of the highest contact method of priority level in above-mentioned contact method is determined as target account.
Further alternative, above-mentioned transmission unit 404 is being used to indicate the target account owner more to the transmission of target account
After the prompt information of new object table to be synchronized, it can also judge target account owner's needle whether is detected in preset duration
Update operation to object table to be synchronized, and work as and judge to be not detected the target account owner for object table to be synchronized
When updating operation, target account is updated according to preset rules.In embodiments of the present invention, transmission unit 404 is according to pre-
If the specific implementation that rule is updated target account is as follows: transmission unit 404 is by priority in above-mentioned contact method
Grade is only second to the contact method of highest priority level as first object contact method, and utilizes first object correspondent party
The corresponding account of formula more fresh target account, and terminate when this target account updates, and mesh is not detected in preset duration
When marking update operation of the account owner for object table to be synchronized, priority level in above-mentioned contact method is only second to first
The contact method of target contact address is as the second target contact address, and utilizes the corresponding account of the second target contact address
More fresh target account, and so on until having traversed all contact methods in above-mentioned contact method.It is exemplary by implementing this
Embodiment can be with when update operation of the target account owner for object table to be synchronized is not detected in preset duration
The grade of priority based on above-mentioned contact method traverses all contact methods for including in above-mentioned contact method, can
Guarantee that the target account owner timely updates to object table to be synchronized to greatest extent.
It should be noted that above-mentioned contact method can be mail, QQ, wechat or short message etc., then, above-mentioned connection
The corresponding account of mode can be Email Accounts, QQ account, wechat account or phone number etc..
Exception shown in fig. 5 can also include: for several detection devices
Updating unit 405, for being generated according to above-mentioned list of modification and the corresponding hive table of above-mentioned list of modification for be synchronized
The more table information of object table, and according to more table information, updates the corresponding hive table of above-mentioned list of modification, and to above-mentioned target account
Number send the more table information.
In embodiments of the present invention, based on Data Migration shown in the description referring to figure 3. for above-mentioned more table information
For the description below step 309 in several detection methods, the embodiment of the present invention repeats no more exception.
Updating unit 405 can automatically update above-mentioned list of modification according to the more table information for object table to be synchronized of generation
Corresponding hive table can also send the above-mentioned more table information generated to above-mentioned target account, so that the target account owner exists
It is referred to when executing to object table to be synchronized and update operation, the update efficiency and accuracy of object table to be synchronized can be improved.
In one exemplary embodiment, updating unit 405 can also be matched in object table to be synchronized with above-mentioned list of modification
Field be marked, and target change is obtained according to the field in above-mentioned modification information and the object table to be synchronized that is marked
Information.Wherein, which may include the change field information of object table to be synchronized.Implement the exemplary embodiment
The above-mentioned target account owner can realize the quick more table handling to object table to be synchronized based on target modification information, further
Improve the efficiency and accuracy rate for several processes.
Optionally, above-mentioned control unit 403 can be also used for detecting whether to receive above-mentioned target account owner transmission
Termination more new command, and when detection receives the termination more new command, control above-mentioned exception for several processes by hang-up shape
State is changed into execution state.
It should be noted that in embodiments of the present invention, updating unit 405 can be also used for sending to above-mentioned target account
After the more table information, Xiang Shangshu control unit 403 sends enabled instruction, to start above-mentioned control unit 403.
Further alternative, above-mentioned control unit 403 is used for when detection receives the termination more new command, is controlled above-mentioned
It is abnormal to be specifically as follows for several processes by the mode that suspended state is changed into execution state: above-mentioned control unit, for when detection
When receiving termination more new command, the table structure of updated object table to be synchronized is obtained；Judge updated target to be synchronized
Whether the table structure of table matches with the table structure of list of modification；When the table structure of updated object table to be synchronized and the table of list of modification
When structure matching, above-mentioned exception is controlled for several processes, execution state is changed by suspended state.Specifically, judge it is updated to
Whether the table structure of synchronous object table can be with the matched implementation of table structure of list of modification, judge updated to be synchronized
Whether field corresponding to list of modification coincide with the field in list of modification in the table structure of object table, updated if coincideing
The table structure of object table to be synchronized is matched with the table structure of list of modification, if misfitting, the table of updated object table to be synchronized
Structure and the table structure of list of modification mismatch.By implementing the exemplary embodiment, above-mentioned control unit 403 can received
When the termination more new command that the above-mentioned target account owner sends, to the table structure and list of modification of updated object table to be synchronized
Table structure be compared, may further ensure that the accuracy for data in several processes.
The present invention also provides a kind of terminal device, which includes:
Processor；
Memory is stored with computer-readable instruction on the memory, when which is executed by processor,
Realize the exception based on Data Migration as previously shown for several detection methods.
The terminal device can be exception shown in FIG. 1 for several detection devices 100.
In one exemplary embodiment, the present invention also provides a kind of computer readable storage mediums, are stored thereon with calculating
Machine program when the computer program is executed by processor, is realized as previously shown abnormal for number detection side based on Data Migration
Method.
It should be understood that the present invention is not limited to the precise structure already described above and shown in the accompanying drawings, and
And various modifications and change can executed without departing from the scope.The scope of the present invention is limited only by the attached claims.
Claims (10)
1. a kind of abnormal for several detection methods based on Data Migration, which is characterized in that the described method includes:
By scanning source table and the corresponding hive table of each source table, judge in the source table with the presence or absence of list of modification；Wherein,
Table structure indicated by the table structure of the list of modification and the corresponding hive table of the list of modification is inconsistent；
When there are the list of modification, using the corresponding object table of the list of modification as object table to be synchronized；
Using the object table to be synchronized it is associated for several processes as abnormal for several processes；
Pending operation is executed for several processes to the exception；
The prompt information for being used to indicate the target account owner and updating the object table to be synchronized is sent to target account.
2. the method according to claim 1, wherein described be used to indicate the target account to the transmission of target account
After number owner updates the prompt information of the object table to be synchronized, the method also includes:
The more table for being directed to the object table to be synchronized is generated according to the corresponding hive table of the list of modification and the list of modification
Information；
According to the more table information, the corresponding hive table of the list of modification is updated；
The more table information is sent to the target account.
3. method according to claim 1 or 2, which is characterized in that described execute to the exception for several processes hangs up behaviour
After work and described it be used to indicate the target account owner to the transmission of target account and update the object table to be synchronized
Before prompt information, the method also includes:
Target work number is determined from total business data person's registration form according to current point in time；Wherein, the total business data person steps on
Record has working hour and the work number of each total business data person in note table；
The register information of the corresponding total business data person of the target work number is obtained, the register information includes at least the target
The contact method of the corresponding total business data person of work number；
Target account is determined according to the contact method.
4. according to the method described in claim 3, it is characterized in that, described determine target account according to the contact method, packet
It includes:
Obtain the priority level of every kind of contact method in the contact method；
The corresponding account of the highest contact method of priority level in the contact method is determined as target account.
5. the method according to claim 1, wherein described be used to indicate the target account to the transmission of target account
After number owner updates the prompt information of the object table to be synchronized, the method also includes:
It detects whether to receive the termination more new command that the target account owner sends；
When detection receives the termination more new command, the exception is controlled for several processes, execution shape is changed by suspended state
State.
6. according to the method described in claim 5, it is characterized in that, described when detection receives the termination more new command,
It controls the exception and execution state is changed by suspended state for several processes, comprising:
When detection receives the termination more new command, the table structure of updated object table to be synchronized is obtained；
Judge whether the table structure of the updated object table to be synchronized matches with the table structure of the list of modification；
When the table structure of the updated object table to be synchronized is matched with the table structure of the list of modification, the exception is controlled
Execution state is changed by suspended state for several processes.
7. the method according to claim 1, wherein described that the object table to be synchronized is associated for several processes
As exception for several processes before, the method also includes:
Judge whether to receive requesting for number for third-party platform transmission；
When receive it is described requested for number when, open with it is described corresponding for several processes for several requests；
It is described the object table to be synchronized is associated to include: for several processes as abnormal for several processes
With it is described for number requests it is corresponding associated for several processes for searching the object table to be synchronized in several processes；
Using the object table to be synchronized found it is associated for several processes as abnormal for several processes.
8. a kind of exception is for several detection devices characterized by comprising
Scanning element, for judging whether deposit in the source table by scanning source table and the corresponding hive table of each source table
In list of modification；Wherein, table structure indicated by the table structure of the list of modification and the corresponding hive table of the list of modification is not
Unanimously；
Determination unit, for when there are the list of modification, using the corresponding object table of the list of modification as object table to be synchronized；
And using the object table to be synchronized it is associated for several processes as abnormal for several processes；
Control unit, for executing pending operation for several processes to the exception；
Transmission unit updates the object table to be synchronized for being used to indicate the target account owner to the transmission of target account
Prompt information.
9. a kind of computer readable storage medium, which is characterized in that it stores computer program, and the computer program makes to succeed in one's scheme
Calculation machine perform claim requires 1~7 described in any item exceptions based on Data Migration for several detection methods.
10. a kind of terminal device, which is characterized in that the terminal device includes:
Processor；
Memory is stored with computer-readable instruction on the memory, and the computer-readable instruction is held by the processor
When row, realize as described in any one of claims 1 to 7 abnormal for several detection methods based on Data Migration.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910003213.2A CN109840160A (en) | 2019-01-03 | 2019-01-03 | It is a kind of abnormal for several detection methods, device and terminal device based on Data Migration |
| PCT/CN2019/120598 WO2020140645A1 (en) | 2019-01-03 | 2019-11-25 | Abnormal data provision detection method and apparatus based on data migration, and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910003213.2A CN109840160A (en) | 2019-01-03 | 2019-01-03 | It is a kind of abnormal for several detection methods, device and terminal device based on Data Migration |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109840160A true CN109840160A (en) | 2019-06-04 |
Family
ID=66883637
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910003213.2A Pending CN109840160A (en) | 2019-01-03 | 2019-01-03 | It is a kind of abnormal for several detection methods, device and terminal device based on Data Migration |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109840160A (en) |
| WO (1) | WO2020140645A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020140645A1 (en) * | 2019-01-03 | 2020-07-09 | 深圳壹账通智能科技有限公司 | Abnormal data provision detection method and apparatus based on data migration, and terminal device |
| CN112231181A (en) * | 2020-12-08 | 2021-01-15 | 平安科技（深圳）有限公司 | Data abnormal update detection method and device, computer equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130173547A1 (en) * | 2011-12-30 | 2013-07-04 | Bmc Software, Inc. | Systems and methods for migrating database data |
| CN104954469A (en) * | 2015-06-19 | 2015-09-30 | 长沙廖氏软件科技有限公司 | Information exchange method for heterogeneous system |
| CN106326376A (en) * | 2016-08-15 | 2017-01-11 | 东软集团股份有限公司 | Method and device for copying information after table structure modification |
| CN108121774A (en) * | 2017-12-08 | 2018-06-05 | 平安科技（深圳）有限公司 | A kind of tables of data backup method and terminal device |
| CN108959564A (en) * | 2018-07-04 | 2018-12-07 | 玖富金科控股集团有限责任公司 | Data warehouse metadata management method, readable storage medium storing program for executing and computer equipment |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015157904A1 (en) * | 2014-04-15 | 2015-10-22 | 华为技术有限公司 | File synchronization method, server, and terminal |
| CN105069128B (en) * | 2015-08-14 | 2018-11-09 | 北京京东尚科信息技术有限公司 | Method of data synchronization and device |
| CN105447172A (en) * | 2015-12-07 | 2016-03-30 | 北京先进数通信息技术股份公司 | Data processing method and system under Hadoop platform |
| CN108595541A (en) * | 2018-04-08 | 2018-09-28 | 上海康斐信息技术有限公司 | A kind of test method and system of data pick-up quality |
| CN108920698B (en) * | 2018-07-16 | 2020-11-03 | 京东数字科技控股有限公司 | Data synchronization method, device, system, medium and electronic equipment |
| CN109840160A (en) * | 2019-01-03 | 2019-06-04 | 深圳壹账通智能科技有限公司 | It is a kind of abnormal for several detection methods, device and terminal device based on Data Migration |
-
2019
- 2019-01-03 CN CN201910003213.2A patent/CN109840160A/en active Pending
- 2019-11-25 WO PCT/CN2019/120598 patent/WO2020140645A1/en unknown
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130173547A1 (en) * | 2011-12-30 | 2013-07-04 | Bmc Software, Inc. | Systems and methods for migrating database data |
| CN104954469A (en) * | 2015-06-19 | 2015-09-30 | 长沙廖氏软件科技有限公司 | Information exchange method for heterogeneous system |
| CN106326376A (en) * | 2016-08-15 | 2017-01-11 | 东软集团股份有限公司 | Method and device for copying information after table structure modification |
| CN108121774A (en) * | 2017-12-08 | 2018-06-05 | 平安科技（深圳）有限公司 | A kind of tables of data backup method and terminal device |
| CN108959564A (en) * | 2018-07-04 | 2018-12-07 | 玖富金科控股集团有限责任公司 | Data warehouse metadata management method, readable storage medium storing program for executing and computer equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020140645A1 (en) * | 2019-01-03 | 2020-07-09 | 深圳壹账通智能科技有限公司 | Abnormal data provision detection method and apparatus based on data migration, and terminal device |
| CN112231181A (en) * | 2020-12-08 | 2021-01-15 | 平安科技（深圳）有限公司 | Data abnormal update detection method and device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020140645A1 (en) | 2020-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104427074B (en) | A kind of methods, devices and systems for showing incoming information | |
| CN106778117B (en) | Permission open method, apparatus and system | |
| CN104991137B (en) | Apparatus testing method and device | |
| CN110162442B (en) | System performance bottleneck positioning method and system | |
| US20170353593A1 (en) | Communication event processing method and apparatus | |
| CN109684524A (en) | Using recommended method, device, storage medium and electronic equipment | |
| CN106063364B (en) | For using the electronic equipment and its method of digital control external equipment | |
| CN104735657B (en) | Security terminal verification method, wireless access point binding method, apparatus and system | |
| CN108369528A (en) | Service is called back for productivity application | |
| CN105740145B (en) | The method and device of element in orient control | |
| CN106126685A (en) | Page loading method and device | |
| CN110347672A (en) | Verification method and device, the electronic equipment and storage medium of tables of data related update | |
| CN109840160A (en) | It is a kind of abnormal for several detection methods, device and terminal device based on Data Migration | |
| CN104219378A (en) | Information processing method and device | |
| CN110119354A (en) | Method for testing software, device and electronic equipment based on Test cases technology | |
| CN106713608A (en) | Application function state modifying method and apparatus, and terminal | |
| CN109639370A (en) | Near-field communication aerial detection method, device, mobile terminal and storage medium | |
| CN109802994A (en) | A kind of information push method and system based on content distributing network | |
| EP3001652B1 (en) | Method for providing information and an electronic device thereof | |
| CN105094510A (en) | Text processing method, device and system | |
| CN107247735A (en) | Document transmission method and device | |
| CN109684006B (en) | Terminal control method and device | |
| CN108255282A (en) | A kind of terminal processes management method and terminal | |
| CN105893128A (en) | Application program calling management method and device | |
| CN106911497A (en) | Identification, the method and apparatus of adaption system more new equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 201, room 518000, building A, No. 1, front Bay Road, Qianhai Shenzhen Guangdong Shenzhen Hong Kong cooperation zone (Qianhai business secretary) Applicant after: ONECONNECT FINANCIAL TECHNOLOGY Co.,Ltd. (SHANGHAI) Address before: 518000 Guangdong city of Shenzhen province Qianhai Shenzhen Hong Kong cooperation zone before Bay Road No. 1 building 201 room A Applicant before: ONECONNECT FINANCIAL TECHNOLOGY Co.,Ltd. (SHANGHAI) |
|
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| AD01 | Patent right deemed abandoned | ||
| AD01 | Patent right deemed abandoned |
Effective date of abandoning: 20231215 |