CN104090948A - Method, device and system for processing mass data of nuclear power station - Google Patents
Method, device and system for processing mass data of nuclear power station Download PDFInfo
- Publication number
- CN104090948A CN104090948A CN201410313066.6A CN201410313066A CN104090948A CN 104090948 A CN104090948 A CN 104090948A CN 201410313066 A CN201410313066 A CN 201410313066A CN 104090948 A CN104090948 A CN 104090948A
- Authority
- CN
- China
- Prior art keywords
- data
- change process
- data item
- change
- shadow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2358—Change logging, detection, and notification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2255—Hash tables
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/06—Electricity, gas or water supply
Abstract
The invention discloses a method, device and system for processing mass data of a nuclear power station. The method comprises the steps of building a shadow table of a source data table, adding a hash value field to the shadow table, building a change process recording table capable of expanding an xml format according to the hash value field and issuing change process data files in the change process recording table of the xml format through a website. In the building process of the nuclear power station, transmission availability and reliability of the mass data are achieved. In addition, the invention discloses a device and system for processing the mass data of the nuclear power station.
Description
Technical field
The invention belongs to nuclear power technology field, be specifically related to a kind of nuclear power station mass data processing method, Apparatus and system.
Background technology
In nuclear power station design process, will produce massive relation type data, be kept in large database.The relational data of single special project wherein, its data item just may be more than hundreds thousand of, and data field reaches more than 30, and these data and renewal thereof need periodic transmission to each link utilizations such as downstream buying, construction, debugging, operations.And participate in the infosystem that nuclear power each side is used, and owing to building in different times, and designed separately by different departments, cause system platform to occur isomerism; Simultaneously, because of factor constraints such as work division and information securities, can not design database opening directly be read shared to each side, so, by Data Control and transmission mechanism, a plurality of copies of same data object being placed on to disparate databases node as required, and automatically safeguarding its conforming method, is an important technology that guarantees availability of data and reliability in construction of nuclear power station process.
For solving data consistency, usual manner is local by the data Replica in remote data base is arrived, and can make application system visit data nearby, has avoided long-range reading out data, thereby has reduced Internet Transmission load, raises the efficiency; When change occurs the data in source database, by Internet Transmission, arrive target database.But this mode can only be for isomorphism database, meanwhile, when network node and communication link break down, data are synchronously prone to problem, cannot ensure the correct usage data of downstream application system.
For this reason, propose at present a kind ofly based on shadow table method, carry out Heterogeneous Database Replication.Specifically data providing is ignored change data capture link, source data table is mapped as to shadow table, regularly synchronous two class table data, data providing issue shadow table query interface, data receiver, by interface data query, then, by data-switching, is organized as target data by Query Result; Data receiver regularly inquires about shadow table data, contrasts the difference of itself and existing target data, carries out data correction.This scheme can realize Data Update in time and be accurate, but too relies on data receiver's configuration, and external web environment etc., be not suitable for big data quantity or upgrade situation frequently, and, Data Update inspection, higher to the requirement of network.
Another kind of scheme is based on trigger method, carries out Heterogeneous Database Replication.Be that data providing creates the operation trigger that additions and deletions change in source database, when copy data item is modified, when insertion and deletion action, trigger extracts the data sequence of variation, data providing is issued Data Update sequence by interface, data receiver inquires about change data by interface, then by data-switching, inciting somebody to action more new data merges in target data, and data receiver needn't consider data correction problem, data receiver regularly inquires about shadow table data, the difference of contrast and target data, realizes and carries out data correction.By trigger, catch in real time the delta data of data source, efficiency is very high.But while using trigger to catch change data, the system resource taking is more, and complicated replication task is needed to very complicated configuration and enforcement, manage very inconveniently, and can only in having the Database Systems of trigger mechanism, use.
Summary of the invention
The object of the invention is to: in the mass data processing of nuclear power station, provide a kind of and can realize data transmission and processing technology accurately and fast.
In order to realize foregoing invention object, the invention provides a kind of nuclear power station mass data processing method, described method comprises:
Set up the shadow table of source data table, in described shadow table, increase hash value field;
According to described hash value field, set up the change process data file in the change process record table of extend markup language xml form;
Change process data file in the change process record table of described xml form is issued by website.
As a kind of improvement of nuclear power station mass data processing method of the present invention, described hash value field is carried out initialization according to the change data field of monitoring and is calculated gained.
As a kind of improvement of nuclear power station mass data processing method of the present invention, described change process data file at least comprises in change time, alter mode, change field and change value.
As a kind of improvement of nuclear power station mass data processing method of the present invention, described method also comprises:
According to data receiver's request, create change xml formatted data file.
As a kind of improvement of nuclear power station mass data processing method of the present invention, described method also comprises:
Judge the data item in shadow table compares whether there is renewal with the data item in source data table.
As a kind of improvement of nuclear power station mass data processing method of the present invention, describedly judge that the data item in shadow table compares whether there is renewal with the data item in source data table, comprising:
Primary key in primary key and shadow table in source data table is compared, and screening obtains new added data item and/or deleted data item.
As a kind of improvement of nuclear power station mass data processing method of the present invention, describedly judge that the data item in shadow table compares whether there is renewal with the data item in source data table, also comprises:
If in data item hash value and source data table, data item hash value is inconsistent in shadow table, the data item in source data table has modification.
As a kind of improvement of nuclear power station mass data processing method of the present invention, described method also comprises:
The new added data item obtaining according to described screening and/or deleted data item are carried out the operation of corresponding newly-increased and/or deleted data item in described shadow table.
As a kind of improvement of nuclear power station mass data processing method of the present invention, described method also comprises:
According to the data item that has modification in described source data table, revise corresponding data item and hash value thereof in described shadow table.
As a kind of improvement of nuclear power station mass data processing method of the present invention, described method also comprises:
The operation of described renewal is write in the change process data file in the change process record table of described xml form to the change process data file of the xml form after being upgraded.
As a kind of improvement of nuclear power station mass data processing method of the present invention, described method also comprises:
The change process data file of the xml form after upgrading was issued according to the time of setting.
In order to realize foregoing invention object, the present invention also provides a kind of nuclear power station mass data processing method, comprising:
Change process data file in the change process record table of the xml form of timing acquisition website issue, the change process data file in the change process record table of described xml form is to set up according to the hash value field in the corresponding shadow table of source data table;
Change process data file in the change process record table of described xml form is resolved to the corresponding data item information that obtains;
Described data item information is write to target database.
As a kind of improvement of nuclear power station mass data processing method of the present invention, described hash value field is carried out initialization according to the change data field of monitoring and is calculated gained.
As a kind of improvement of nuclear power station mass data processing method of the present invention, described change process data file at least comprises in change time, alter mode, change field and change value.
As a kind of improvement of nuclear power station mass data processing method of the present invention, described method also comprises: judge the data item in shadow table compares whether there is renewal with the data item in source data table.
A kind of improvement as nuclear power station mass data processing method of the present invention, described method also comprises: the operation of described renewal is write in the change process data file in the change process record table of described xml form to the change process data file of the xml form after being upgraded.
As a kind of improvement of nuclear power station mass data processing method of the present invention, described method also comprises: to data receiver, send request, so that data receiver creates change xml formatted data file according to described request.
As a kind of improvement of nuclear power station mass data processing method of the present invention, described method also comprises: according to described change xml formatted data file modification target database.
In order to realize foregoing invention object, the present invention also provides a kind of nuclear power station mass data processing device, and this device comprises:
First sets up module, for setting up the shadow table of source data table, increases hash value field in described shadow table;
Second sets up module, for set up the change process data file of the change process record table of extend markup language xml form according to described hash value field;
Release module, for issuing the change process data file of the change process record table of described xml form by website.
As a kind of improvement of nuclear power station mass data processing device of the present invention, described device also comprises: creation module, and for create change xml formatted data file according to data receiver's request.
As a kind of improvement of nuclear power station mass data processing device of the present invention, described device also comprises: judge module, and for judging the data item of shadow table compares whether there is renewal with the data item in source data table.
As a kind of improvement of nuclear power station mass data processing device of the present invention, described judge module judges that the data item in shadow table compares whether there is renewal with the data item in source data table, comprising:
Primary key in primary key and shadow table in source data table is compared, and screening obtains new added data item and/or deleted data item.
As a kind of improvement of nuclear power station mass data processing device of the present invention, described judge module judges that the data item in shadow table compares whether there is renewal with the data item in source data table, comprising:
If in data item hash value and source data table, data item hash value is inconsistent in shadow table, the data item in source data table has modification.
As a kind of improvement of nuclear power station mass data processing device of the present invention, described device also comprises:
The first execution module for new added data item and/or the deleted data item obtaining according to described screening, is carried out the operation of corresponding newly-increased and/or deleted data item in described shadow table.
As a kind of improvement of nuclear power station mass data processing device of the present invention, described device also comprises:
The second execution module, for there being the data item of modification to revise corresponding data item and hash value thereof in described shadow table according to described source data table.
As a kind of improvement of nuclear power station mass data processing device of the present invention, described device also comprises:
Update module, for the operation of described renewal being write in the change process data file of change process record table of described xml form, the change process data file of the xml form after being upgraded.
As a kind of improvement of nuclear power station mass data processing device of the present invention, described release module also for:
The change process data file of the xml form after upgrading was issued according to the time of setting.
In order to realize foregoing invention object, the present invention also provides a kind of nuclear power station mass data processing equipment, and this equipment comprises:
Acquisition module, the change process data file of the change process record table of the xml form of issuing for timing acquisition website, the change process data file in the change process record table of described xml form is to set up according to the hash value field in the corresponding shadow table of source data table;
Parsing module, for resolving the change process data file of the change process record table of described xml form the corresponding data item information that obtains;
Memory module, for writing target database by described data item information.
As a kind of improvement of nuclear power station mass data processing equipment of the present invention, described equipment also comprises:
Sending module, for sending request to data receiver, so that data receiver creates change xml formatted data file according to described request.
As a kind of improvement of nuclear power station mass data processing equipment of the present invention, described memory module also for:
According to described change xml formatted data file modification target database.
In order to realize foregoing invention object, the present invention also provides a kind of nuclear power station mass data processing system, and system comprises:
Data receiver, for setting up the shadow table of source data table, in described shadow table, increase hash value field, according to described hash value field, set up the change process data file in the change process record table of extend markup language xml form, the change process data file in the change process record table of described xml form is issued by website;
Data receiver, change process data file for the change process record table of the xml form of website issue described in timing acquisition, change process data file in the change process record table of described xml form is resolved and is obtained corresponding data item information, and described data item information is write to target database.
As a kind of improvement of nuclear power station mass data processing system of the present invention, described data receiver also for:
According to described data receiver's request, create change xml formatted data file.
As a kind of improvement of nuclear power station mass data processing system of the present invention, described data receiver also for:
Judge the data item in shadow table compares whether there is renewal with the data item in source data table.
As a kind of improvement of nuclear power station mass data processing system of the present invention, described data receiver judges that the data item in shadow table compares whether there is renewal with the data item in source data table, comprising:
Primary key in primary key and shadow table in source data table is compared, and screening obtains new added data item and/or deleted data item.
As a kind of improvement of nuclear power station mass data processing system of the present invention, described data receiver judges that the data item in shadow table compares whether there is renewal with the data item in source data table, comprising:
If data item hash value is inconsistent in data item hash value and source data table in shadow table, judge that the data item in source data table has modification.
As a kind of improvement of nuclear power station mass data processing system of the present invention, described data receiver also for:
The new added data item obtaining according to described screening and/or deleted data item are carried out the operation of corresponding newly-increased and/or deleted data item in described shadow table.
As a kind of improvement of nuclear power station mass data processing system of the present invention, described data receiver also for:
According to the data item that has modification in described source data table, revise corresponding data item and hash value thereof in described shadow table.
As a kind of improvement of nuclear power station mass data processing system of the present invention, described data receiver also for:
The operation of described renewal is write in the change process data file in the change process record table of described xml form to the change process data file of the xml form after being upgraded.
As a kind of improvement of nuclear power station mass data processing system of the present invention, described data receiver also for:
The change process data file of the xml form after upgrading was issued according to the time of setting.
As a kind of improvement of nuclear power station mass data processing system of the present invention, described data receiver also for:
According to described change xml formatted data file modification target database.
Compared with prior art, nuclear power station mass data processing method of the present invention, Apparatus and system have following useful technique effect: the change process data file in the change process record table of the xml form that data receiver is set up by hash value in source data table and shadow table, and issue by website.Realized database quick copy and the consistency desired result in data transmission.On the one hand, because the field of data receiver by source data table and shadow table changes, replace with the variation of comparison hash value, thereby can effectively improve the vicissitudinous data item of identification; On the other hand, because data receiver can obtain change data XML file in the mode of robotization by the web services of website, can realize the correctness of monitoring data transmission fast and accurately.In addition, implementation method of the present invention is simple, obtains good technique effect.
Accompanying drawing explanation
Below in conjunction with the drawings and specific embodiments, nuclear power station mass data processing method of the present invention, Apparatus and system are elaborated, wherein:
Fig. 1 provides an a kind of example flow chart of nuclear power station mass data processing method.
Fig. 2 provides an a kind of example flow chart of nuclear power station mass data processing method.
Fig. 3 provides an a kind of example schematic of nuclear power station mass data processing device.
Fig. 4 provides another example schematic of a kind of nuclear power station mass data processing device.
Fig. 5 provides an a kind of example schematic of nuclear power station mass data processing equipment.
Fig. 6 provides an a kind of example schematic of nuclear power station mass data processing system.
Embodiment
In order to make goal of the invention of the present invention, technical scheme and useful technique effect thereof more clear, below in conjunction with the drawings and specific embodiments, the present invention is further elaborated.It should be emphasized that, the embodiment of describing in this instructions is only used to explain the present invention, is not intended to limit use occasion of the present invention.
Incorporated by reference to referring to Fig. 1, Fig. 1 provides a kind of nuclear power station mass data processing method.
Hash value, i.e. cryptographic hash, the input of random length, (be called again pre-mapping, pre-image), by hashing algorithm, be transformed into the output of regular length, this output is exactly hashed value exactly.
Data providing is born the task of obtaining data change; shadow table method is improved; by changing data with extend markup language (Extensible Markup Language; xml) document form provides; be published to website; with web services mode or page download mode, offer data receiver, can adapt to the multi-form database of different pieces of information take over party.Concrete,
Step 101, sets up the shadow table of source data table, increases hash value field in described shadow table.
Optionally, hash value field is carried out initialization calculating gained according to the change data field of monitoring.
Step 103, sets up the change process data file in the change process record table of extend markup language xml form according to described hash value field.
Further, this change process data file at least comprises in change time, alter mode, change field and change value.
Further, data receiver judges the data item in shadow table compares whether there is renewal with the data item in source data table.
Concrete, data receiver compares primary key in primary key and shadow table in source data table, and screening obtains new added data item and/or deleted data item; Further, the new added data item that data receiver obtains according to described screening and/or deleted data item are carried out the operation of corresponding newly-increased and/or deleted data item in described shadow table.
Or, if in shadow table in data item hash value and source data table data item hash value inconsistent, the data item in data receiver judgement source data table has modification; Further, data receiver is revised corresponding data item and hash value thereof in described shadow table according to the data item that has modification in described source data table.
As previously mentioned, data receiver is by the operation of above-mentioned renewal, as deletion action, increase operation and retouching operation write as described in change process data file in the change process record table of xml form, the change process data file of the xml form after being upgraded.
Step 105, issues the change process data file in the change process record table of described xml form by website.
Further, data receiver is issued the change process data file of the xml form after upgrading according to the time of setting.
Change process data file in the change process record table of the xml form that the embodiment of the present invention is set up by hash value in source data table and shadow table by data receiver, and issue by website.Realized database quick copy and the consistency desired result in data transmission; Meanwhile, because the field of data receiver by source data table and shadow table changes, replace with the variation of comparison hash value, thereby can effectively improve the vicissitudinous data item of identification.
Incorporated by reference to Fig. 2, Fig. 2 provides an a kind of embodiment of nuclear power station mass data processing method.The method comprises:
Step 201, change process data file in the change process record table of the xml form of timing acquisition website issue, the change process data file in the change process record table of described xml form is to set up according to the hash value field in the corresponding shadow table of source data table.
As previously mentioned, described hash value field is carried out initialization calculating gained according to the change data field of monitoring.
Step 203, resolves by the change process data file in the change process record table of described xml form the corresponding data item information that obtains.
Have aforementioned knownly, change process data file at least comprises in change time, alter mode, change field and change value.
Further, to data receiver, send request, so that data receiver creates change xml formatted data file according to described request.
Further, data receiver judges the data item in shadow table compares whether there is renewal with the data item in source data table.
Concrete, data receiver compares primary key in primary key and shadow table in source data table, and screening obtains new added data item and/or deleted data item; Further, the new added data item that data receiver obtains according to described screening and/or deleted data item are carried out the operation of corresponding newly-increased and/or deleted data item in described shadow table.
Or, if in shadow table in data item hash value and source data table data item hash value inconsistent, the data item in data receiver judgement source data table has modification; Further, data receiver is revised corresponding data item and hash value thereof in described shadow table according to the data item that has modification in described source data table.
Data receiver is the operation of above-mentioned renewal, as deletion action, increase operation and retouching operation write as described in change process data file in the change process record table of xml form, the change process data file of the xml form after being upgraded.
Step 205, writes target database by described data item information.
Optionally, data receiver is according to described change xml formatted data file modification target database.
The embodiment of the present invention, owing to can obtain by the web services of website change data XML file by data receiver, can realize the correctness of monitoring data transmission fast and accurately.Meanwhile, due to the data item of timing acquisition change, can realize the promptness of Data Update, reduce again resource occupation.Implementation method of the present invention is simple, obtains good technique effect.
Incorporated by reference to Fig. 3, Fig. 3 provides an a kind of embodiment of nuclear power station mass data processing device.This device comprises: first sets up module 301, second sets up module 303 and release module 305.Concrete,
First sets up module 301, for setting up the shadow table of source data table, increases hash value field in described shadow table;
Second sets up module 303, for set up the change process data file of the change process record table of extend markup language xml form according to described hash value field;
Release module 305, for issuing the change process data file of the change process record table of described xml form by website.
Change process data file in the change process record table of the xml form that embodiment of the present invention data receiver is set up by hash value in source data table and shadow table, and issue by website.Realized database quick copy and the consistency desired result in data transmission.
Incorporated by reference to Fig. 4, Fig. 4 provides an a kind of embodiment of nuclear power station mass data processing device.Specifically comprise: first sets up module 401, second sets up module 403, release module 405, judge module 407, the first execution module 409, the second execution module 411 and update module 413.Wherein,
First sets up module 401, for setting up the shadow table of source data table, increases hash value field in described shadow table.
Second sets up module 403, for set up the change process data file of the change process record table of extend markup language xml form according to described hash value field.
Release module 405, for issuing the change process data file of the change process record table of described xml form by website.
Judge module 407, for judging the data item of shadow table compares whether there is renewal with the data item in source data table.
Concrete, judge module 407 compares primary key in primary key and shadow table in source data table, and screening obtains new added data item and/or deleted data item; Or, if in shadow table in data item hash value and source data table data item hash value inconsistent, the data item in judge module 407 judgement source data tables has modification.
The first execution module 409 for new added data item and/or the deleted data item obtaining according to described screening, is carried out the operation of corresponding newly-increased and/or deleted data item in described shadow table.
The second execution module 411, for there being the data item of modification to revise corresponding data item and hash value thereof in described shadow table according to described source data table.
Update module 413, for the operation of described renewal being write in the change process data file of change process record table of described xml form, the change process data file of the xml form after being upgraded.
Optionally, release module 405 is also for issuing the change process data file of the xml form after upgrading according to the time of setting.
Optionally, this device can also comprise creation module, for create change xml formatted data file according to data receiver's request.
Change process data file in the change process record table of the xml form that the embodiment of the present invention is set up by hash value in source data table and shadow table by data receiver, and issue by website.Realized database quick copy and the consistency desired result in data transmission; Meanwhile, because the field of data receiver by source data table and shadow table changes, replace with the variation of comparison hash value, thereby can effectively improve the vicissitudinous data item of identification.
Incorporated by reference to referring to Fig. 5, Fig. 5 provides the schematic diagram of an a kind of embodiment of nuclear power station mass data processing equipment.Comprise: acquisition module 501, parsing module 503 and memory module 505.Wherein,
Acquisition module 501, the change process data file of the change process record table of the xml form of issuing for timing acquisition website, the change process data file in the change process record table of described xml form is to set up according to the hash value field in the corresponding shadow table of source data table;
Parsing module 503, for resolving the change process data file of the change process record table of described xml form the corresponding data item information that obtains;
Memory module 505, for writing target database by described data item information.
Optionally, this equipment can also comprise sending module, for sending request to data receiver, so that data receiver creates change xml formatted data file according to described request.
Further, memory module 505 is also for according to described change xml formatted data file modification target database.
The embodiment of the present invention, owing to can obtain by the web services of website change data XML file by data receiver, can realize the correctness of monitoring data transmission fast and accurately.Meanwhile, due to the data item of timing acquisition change, can realize the promptness of Data Update, reduce again resource occupation.
Incorporated by reference to referring to Fig. 6, Fig. 6 provides the schematic diagram of an a kind of embodiment of nuclear power station mass data processing system.Comprise: data receiver 601 and data receiver 603.Wherein,
Data receiver 601, for setting up the shadow table of source data table, in described shadow table, increase hash value field, according to described hash value field, set up the change process data file in the change process record table of extend markup language xml form, the change process data file in the change process record table of described xml form is issued by website;
Data receiver 603, change process data file for the change process record table of the xml form of website issue described in timing acquisition, change process data file in the change process record table of described xml form is resolved and is obtained corresponding data item information, and described data item information is write to target database.
Further, data receiver 601 is also for creating change xml formatted data file according to described data receiver's request.
Further, data receiver 601 is also for judging the data item of shadow table compares whether there is renewal with the data item in source data table.Specifically data receiver 601 compares primary key in primary key and shadow table in source data table, and screening obtains new added data item and/or deleted data item; Or, if in shadow table in data item hash value and source data table data item hash value inconsistent, the data item in 601 judgement source data tables of data receiver has modification.
Corresponding, the new added data item that data receiver 601 obtains according to described screening and/or deleted data item are carried out the operation of corresponding newly-increased and/or deleted data item in described shadow table; Or data receiver 601 is revised corresponding data item and hash value thereof in described shadow table according to the data item that has modification in described source data table.
Further, data receiver 601 writes the operation of described renewal in the change process data file in the change process record table of described xml form, the change process data file of the xml form after being upgraded.Data receiver 601 is issued the change process data file of the xml form after upgrading according to the time of setting.
Accordingly, 603 of data receivers are according to described change xml formatted data file modification target database.
The implementation method of system and flow process can, referring to the embodiment of the method for introducing in previous embodiment, repeat no more herein.
In conjunction with above detailed description of the present invention, can find out, with respect to prior art, the present invention at least has following useful technique effect: the change process data file in the change process record table of the xml form that data receiver is set up by hash value in source data table and shadow table, and issue by website.Realized database quick copy and the consistency desired result in data transmission.On the one hand, because the field of data receiver by source data table and shadow table changes, replace with the variation of comparison hash value, thereby can effectively improve the vicissitudinous data item of identification; On the other hand, because data receiver can obtain by the web services of website change data XML file, can realize the correctness of monitoring data transmission fast and accurately.In addition, implementation method of the present invention is simple, obtains good technique effect.
According to above-mentioned principle, the present invention can also carry out suitable change and modification to above-mentioned embodiment.Therefore, the present invention is not limited to embodiment disclosed and described above, to modifications and changes more of the present invention, also should fall in the protection domain of claim of the present invention.In addition,, although used some specific terms in this instructions, these terms just for convenience of description, do not form any restriction to the present invention.
Claims (40)
1. a nuclear power station mass data processing method, is characterized in that, described method comprises:
Set up the shadow table of source data table, in described shadow table, increase Hash hash value field;
According to described hash value field, set up the change process record table of extend markup language xml form;
Change process data file in the change process record table of described xml form is issued by website.
2. the method for claim 1, is characterized in that, described hash value field is carried out initialization according to the change data field of monitoring and calculated gained.
3. method as claimed in claim 2, is characterized in that, described change process data file at least comprises in change time, alter mode, change field and change value.
4. method as claimed in claim 3, is characterized in that, described method also comprises:
According to data receiver's request, create change xml formatted data file.
5. method as claimed in claim 3, is characterized in that, described method also comprises:
Judge the data item in shadow table compares whether there is renewal with the data item in source data table.
6. method as claimed in claim 5, is characterized in that, describedly judges that the data item in shadow table compares whether there is renewal with the data item in source data table, comprising:
Primary key in primary key and shadow table in source data table is compared, and screening obtains new added data item and/or deleted data item.
7. method as claimed in claim 5, is characterized in that, describedly judges that the data item in shadow table compares whether there is renewal with the data item in source data table, also comprises:
If in data item hash value and source data table, data item hash value is inconsistent in shadow table, the data item in source data table has modification.
8. method as claimed in claim 6, is characterized in that, described method also comprises:
The new added data item obtaining according to described screening and/or deleted data item are carried out the operation of corresponding newly-increased and/or deleted data item in described shadow table.
9. method as claimed in claim 7, is characterized in that, described method also comprises:
According to the data item that has modification in described source data table, revise corresponding data item and hash value thereof in described shadow table.
10. the either method as described in claim 5-9, is characterized in that, described method also comprises:
The operation of described renewal is write in the change process data file in the change process record table of described xml form to the change process data file of the xml form after being upgraded.
11. methods as claimed in claim 10, is characterized in that, described method also comprises:
The change process data file of the xml form after upgrading was issued according to the time of setting.
12. 1 kinds of nuclear power station mass data processing methods, is characterized in that, described method comprises:
Change process data file in the change process record table of the xml form of timing acquisition website issue, the change process data file in the change process record table of described xml form is to set up according to the hash value field in the corresponding shadow table of source data table;
Change process data file in the change process record table of described xml form is resolved to the corresponding data item information that obtains;
Described data item information is write to target database.
13. methods as claimed in claim 12, is characterized in that, described hash value field is carried out initialization according to the change data field of monitoring and calculated gained.
14. methods as claimed in claim 13, is characterized in that, described change process data file at least comprises in change time, alter mode, change field and change value.
15. methods as claimed in claim 14, is characterized in that, described method also comprises:
Judge the data item in shadow table compares whether there is renewal with the data item in source data table.
16. methods as claimed in claim 15, is characterized in that, described method also comprises:
The operation of described renewal is write in the change process data file in the change process record table of described xml form to the change process data file of the xml form after being upgraded.
17. methods as claimed in claim 16, is characterized in that, described method also comprises:
To data receiver, send request, so that data receiver creates change xml formatted data file according to described request.
18. methods as claimed in claim 17, is characterized in that, described method also comprises:
According to described change xml formatted data file modification target database.
19. 1 kinds of nuclear power station mass data processing devices, is characterized in that, described device comprises:
First sets up module, for setting up the shadow table of source data table, increases hash value field in described shadow table;
Second sets up module, for set up the change process data file of the change process record table of extend markup language xml form according to described hash value field;
Release module, for issuing the change process data file of the change process record table of described xml form by website.
20. devices as claimed in claim 19, is characterized in that, described device also comprises:
Creation module, for creating change xml formatted data file according to data receiver's request.
21. devices as claimed in claim 19, is characterized in that, described device also comprises:
Judge module, for judging the data item of shadow table compares whether there is renewal with the data item in source data table.
22. devices as claimed in claim 21, is characterized in that, described judge module judges that the data item in shadow table compares whether there is renewal with the data item in source data table, comprising:
Primary key in primary key and shadow table in source data table is compared, and screening obtains new added data item and/or deleted data item.
23. devices as claimed in claim 21, is characterized in that, described judge module judges that the data item in shadow table compares whether there is renewal with the data item in source data table, comprising:
If in data item hash value and source data table, data item hash value is inconsistent in shadow table, the data item in source data table has modification.
24. devices as claimed in claim 22, is characterized in that, described device also comprises:
The first execution module for new added data item and/or the deleted data item obtaining according to described screening, is carried out the operation of corresponding newly-increased and/or deleted data item in described shadow table.
25. devices as claimed in claim 23, is characterized in that, described device also comprises:
The second execution module, for there being the data item of modification to revise corresponding data item and hash value thereof in described shadow table according to described source data table.
26. arbitrary devices as described in claim 22-25, is characterized in that, described device also comprises:
Update module, for the operation of described renewal being write in the change process data file of change process record table of described xml form, the change process data file of the xml form after being upgraded.
27. devices as claimed in claim 26, is characterized in that, described release module also for:
The change process data file of the xml form after upgrading was issued according to the time of setting.
28. 1 kinds of nuclear power station mass data processing equipment, is characterized in that, described equipment comprises:
Acquisition module, the change process data file of the change process record table of the xml form of issuing for timing acquisition website, the change process data file in the change process record table of described xml form is to set up according to the hash value field in the corresponding shadow table of source data table;
Parsing module, for resolving the change process data file of the change process record table of described xml form the corresponding data item information that obtains;
Memory module, for writing target database by described data item information.
29. equipment as claimed in claim 28, is characterized in that, described equipment also comprises:
Sending module, for sending request to data receiver, so that data receiver creates change xml formatted data file according to described request.
30. equipment as claimed in claim 29, is characterized in that, described memory module also for:
According to described change xml formatted data file modification target database.
31. 1 kinds of nuclear power station mass data processing systems, is characterized in that, described system comprises:
Data receiver, for setting up the shadow table of source data table, in described shadow table, increase hash value field, according to described hash value field, set up the change process data file in the change process record table of extend markup language xml form, the change process data file in the change process record table of described xml form is issued by website;
Data receiver, change process data file for the change process record table of the xml form of website issue described in timing acquisition, change process data file in the change process record table of described xml form is resolved and is obtained corresponding data item information, and described data item information is write to target database.
32. systems as claimed in claim 31, is characterized in that, described data receiver also for:
According to described data receiver's request, create change xml formatted data file.
33. systems as claimed in claim 31, is characterized in that, described data receiver also for:
Judge the data item in shadow table compares whether there is renewal with the data item in source data table.
34. systems as claimed in claim 33, is characterized in that, described data receiver judges that the data item in shadow table compares whether there is renewal with the data item in source data table, comprising:
Primary key in primary key and shadow table in source data table is compared, and screening obtains new added data item and/or deleted data item.
35. systems as claimed in claim 33, is characterized in that, described data receiver judges that the data item in shadow table compares whether there is renewal with the data item in source data table, comprising:
If data item hash value is inconsistent in data item hash value and source data table in shadow table, judge that the data item in source data table has modification.
36. systems as claimed in claim 34, is characterized in that, described data receiver also for:
The new added data item obtaining according to described screening and/or deleted data item are carried out the operation of corresponding newly-increased and/or deleted data item in described shadow table.
37. systems as claimed in claim 35, is characterized in that, described data receiver also for:
According to the data item that has modification in described source data table, revise corresponding data item and hash value thereof in described shadow table.
38. arbitrary systems as described in claim 33-37, is characterized in that, described data receiver also for:
The operation of described renewal is write in the change process data file in the change process record table of described xml form to the change process data file of the xml form after being upgraded.
39. systems as claimed in claim 38, is characterized in that, described data receiver also for:
The change process data file of the xml form after upgrading was issued according to the time of setting.
40. systems as claimed in claim 32, is characterized in that, described data receiver also for:
According to described change xml formatted data file modification target database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410313066.6A CN104090948A (en) | 2014-07-02 | 2014-07-02 | Method, device and system for processing mass data of nuclear power station |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410313066.6A CN104090948A (en) | 2014-07-02 | 2014-07-02 | Method, device and system for processing mass data of nuclear power station |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104090948A true CN104090948A (en) | 2014-10-08 |
Family
ID=51638664
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410313066.6A Pending CN104090948A (en) | 2014-07-02 | 2014-07-02 | Method, device and system for processing mass data of nuclear power station |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104090948A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104899312A (en) * | 2015-06-15 | 2015-09-09 | 国家电网公司 | Data updating method for multi-layer classification data system |
| CN106250436A (en) * | 2016-07-26 | 2016-12-21 | 东软集团股份有限公司 | The method and device of management form data |
| CN107506261A (en) * | 2017-08-01 | 2017-12-22 | 北京丁牛科技有限公司 | Adapt to the cascade fault-tolerance processing method of CPU, GPU isomeric group |
| CN108491218A (en) * | 2018-03-12 | 2018-09-04 | 浙江中控技术股份有限公司 | A kind of method and apparatus of databases comparison file generated |
| CN110851440A (en) * | 2019-09-29 | 2020-02-28 | 深圳市华力特电气有限公司 | Data synchronization method and device |
| CN112506900A (en) * | 2020-11-27 | 2021-03-16 | 中广核工程有限公司 | Method, device and equipment for checking three-dimensional data of ventilation pipe of nuclear power plant and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070112880A1 (en) * | 2005-11-14 | 2007-05-17 | Lie Yang | Data synchronization and device handling |
| CN102402586A (en) * | 2011-10-24 | 2012-04-04 | 深圳华强电子交易网络有限公司 | Distributed data storage method |
| CN102567338A (en) * | 2010-12-16 | 2012-07-11 | 凌群电脑股份有限公司 | Data synchronization system capable of simulating system logs |
-
2014
- 2014-07-02 CN CN201410313066.6A patent/CN104090948A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070112880A1 (en) * | 2005-11-14 | 2007-05-17 | Lie Yang | Data synchronization and device handling |
| CN102567338A (en) * | 2010-12-16 | 2012-07-11 | 凌群电脑股份有限公司 | Data synchronization system capable of simulating system logs |
| CN102402586A (en) * | 2011-10-24 | 2012-04-04 | 深圳华强电子交易网络有限公司 | Distributed data storage method |
Non-Patent Citations (1)
| Title |
|---|
| 郑煜: "结构化数据异构同步技术的研究", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104899312A (en) * | 2015-06-15 | 2015-09-09 | 国家电网公司 | Data updating method for multi-layer classification data system |
| CN104899312B (en) * | 2015-06-15 | 2018-07-31 | 国家电网公司 | A kind of data-updating method of multistratum classification data system |
| CN106250436A (en) * | 2016-07-26 | 2016-12-21 | 东软集团股份有限公司 | The method and device of management form data |
| CN107506261A (en) * | 2017-08-01 | 2017-12-22 | 北京丁牛科技有限公司 | Adapt to the cascade fault-tolerance processing method of CPU, GPU isomeric group |
| CN107506261B (en) * | 2017-08-01 | 2020-05-15 | 北京丁牛科技有限公司 | Cascade fault-tolerant processing method suitable for CPU and GPU heterogeneous clusters |
| CN108491218A (en) * | 2018-03-12 | 2018-09-04 | 浙江中控技术股份有限公司 | A kind of method and apparatus of databases comparison file generated |
| CN108491218B (en) * | 2018-03-12 | 2021-09-14 | 浙江中控技术股份有限公司 | Method and device for generating database change file |
| CN110851440A (en) * | 2019-09-29 | 2020-02-28 | 深圳市华力特电气有限公司 | Data synchronization method and device |
| CN110851440B (en) * | 2019-09-29 | 2023-10-13 | 深圳市华力特电气有限公司 | Data synchronization method and device |
| CN112506900A (en) * | 2020-11-27 | 2021-03-16 | 中广核工程有限公司 | Method, device and equipment for checking three-dimensional data of ventilation pipe of nuclear power plant and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111566633B (en) | Commit protocol for synchronizing content items | |
| CN104090948A (en) | Method, device and system for processing mass data of nuclear power station | |
| CN108228814B (en) | Data synchronization method and device | |
| US20190197130A1 (en) | Ensuring consistency in distributed incremental content publishing | |
| CN103514223A (en) | Data synchronism method and system of database | |
| CN105472045A (en) | Database migration method and database migration device | |
| CN107038519B (en) | Method and system for bidirectional data synchronization between systems | |
| CN110825420A (en) | Configuration parameter updating method, device, equipment and storage medium for distributed cluster | |
| CN105808273B (en) | Method for upgrading software and software updating apparatus | |
| US20150142813A1 (en) | Language tag management on international data storage | |
| CN110515927B (en) | Data processing method and system, electronic device and medium | |
| CN105183860A (en) | Data synchronization method and system | |
| CN103795754A (en) | Method and system for data synchronization among multiple systems | |
| CN107025108B (en) | Exporting hierarchical data from a Source Code Management (SCM) system to a Product Lifecycle Management (PLM) system | |
| CN102857949B (en) | A kind of method and apparatus that layout data consistency guarantees | |
| TW201520813A (en) | Anti-malware mobile content data management apparatus and method | |
| CN113051347B (en) | Method, system, equipment and storage medium for synchronizing data between heterogeneous databases | |
| CN111259643A (en) | Method and equipment for generating graphical report | |
| CN110555015A (en) | Database entity management method and device, electronic equipment and storage medium | |
| CN105446909A (en) | Caching management method and system | |
| WO2015034765A1 (en) | Automatically generating certification documents | |
| CN104079623A (en) | Method and system for controlling multilevel cloud storage synchrony | |
| CN107316176A (en) | The control method and device of declaration form processing | |
| CN110716804A (en) | Method and device for automatically deleting useless resources, storage medium and electronic equipment | |
| US20210342378A1 (en) | External storage of unstructured database objects |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20141008 |