CN110413702A - Heterogeneous database intranet and extranet synchronous method, apparatus and system - Google Patents
Heterogeneous database intranet and extranet synchronous method, apparatus and system Download PDFInfo
- Publication number
- CN110413702A CN110413702A CN201910525344.7A CN201910525344A CN110413702A CN 110413702 A CN110413702 A CN 110413702A CN 201910525344 A CN201910525344 A CN 201910525344A CN 110413702 A CN110413702 A CN 110413702A
- Authority
- CN
- China
- Prior art keywords
- data
- intranet
- extranet
- synchronization
- heterogeneous database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000001360 synchronised effect Effects 0.000 title claims abstract description 23
- 238000000034 method Methods 0.000 title claims abstract description 17
- 230000008676 import Effects 0.000 claims abstract description 18
- 238000013500 data storage Methods 0.000 claims abstract description 15
- 238000006243 chemical reaction Methods 0.000 claims abstract description 8
- 230000008901 benefit Effects 0.000 claims description 2
- 238000012545 processing Methods 0.000 abstract description 2
- 238000011161 development Methods 0.000 description 4
- 238000012423 maintenance Methods 0.000 description 4
- 230000005012 migration Effects 0.000 description 4
- 238000013508 migration Methods 0.000 description 4
- 238000013497 data interchange Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 1
- 239000010931 gold Substances 0.000 description 1
- 229910052737 gold Inorganic materials 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/273—Asynchronous replication or reconciliation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention discloses a kind of heterogeneous database intranet and extranet synchronous method, it include: configuration data input terminal data source and data synchronization strategy, data pick-up, data encryption and file conversion are carried out from data input pin data source according to synchronization policy timing, data file encryption is generated, and is stored under the config directory of Intranet;Data file encryption is ferried from Intranet under the config directory of outer net by general data storage format;The data output end data source and data for configuring outer net import strategy, data pick-up, data deciphering and processing are carried out under the config directory of outer net according to strategy timing is imported, data after generating decryption, setting master, external key importing sequence, import the data after decryption in data output end data source according to importing sequence.Invention additionally discloses a kind of heterogeneous database intranet and extranet synchronizing device and a kind of heterogeneous database intranet and extranet synchronization systems.The timely precision that the inside and outside network data of heterogeneous database can be achieved in the present invention is synchronous.
Description
Technical field
The present invention relates to government system technical field of data storage, in particular to heterogeneous database intranet and extranet synchronous method,
Apparatus and system.
Background technique
With the fast development of science and technology, the combination of Internet technology and daily life, business activity is increasingly close.7*24 clothes
Business system Fast Growth as emerging rapidly in large numbersBamboo shoots after a spring rain, thus it is also higher and higher to the needs and requirement of data storage, especially in gold
Melt, the fields such as government affairs, electric business, database is provided out data access service as a ring important in its business.
For government system, data interchange, immediate updating of the government affairs intranet and extranet not between homologous ray, tradition are often needed to
Database level method for distinguishing be difficult break through Intranet isolation network barrier, occur updating often not in time, fining information sieve
Choosing can not operate, while even more extremely difficult for the intranet and extranet data interchange problem of heterogeneous database.
Therefore, it realizes that the precision of inside and outside network data is synchronous, is those skilled in the art's technical problem urgently to be solved.
Summary of the invention
The present invention can not carry out the synchronous problem of precision for the inside and outside network data of government system heterogeneous database in time,
It is proposed a kind of heterogeneous database intranet and extranet synchronous method, apparatus and system.
To achieve the goals above, the invention adopts the following technical scheme:
A kind of heterogeneous database intranet and extranet synchronous method, comprising:
Step 1: configuration data input terminal data source and data synchronization strategy, it is defeated from the data according to the synchronization policy timing
Enter to carry out data pick-up, data encryption and file conversion in end data source, generates data file encryption, and be stored in matching for Intranet
It sets under catalogue;
Step 2: the data file encryption being ferried from Intranet under the config directory of outer net by general data storage format;
Step 3: the data output end data source and data for configuring outer net import strategy, according to the importing strategy periodically from outer net
Config directory under carry out data pick-up and data deciphering, the data after generating decryption, setting is main, external key importing sequence, according to
The importing sequence imports the data after decryption in the data output end data source.
Further, the data input pin data source and data output end data source heterogeneous database each other.
Further, the data synchronization strategy includes:
Correspondence database table is obtained by the input terminal data source, is defined based on the database table, foreign-key table, a plurality of data
It is packaged using row element, corresponding field value is stored by the way of key, value;Set T synchronizing cycle.
Further, the general data storage format is XML file format, the increase data storage of a database table
In an XML file.
Further, the data importing strategy includes:
According to T synchronizing cycle, sequence is named to data file encryption according to the sequence of master, external key, makes data receiver
End first carries out the write-in of major-key table data, then carries out foreign-key table data and synchronize.
A kind of heterogeneous database intranet and extranet synchronizing device, comprising: the first synchronization module, data ferry-boat module and second are synchronous
Module;
First synchronization module is used for configuration data input terminal data source and data synchronization strategy, fixed according to the synchronization policy
When from the data input pin data source carry out data pick-up, data encryption and file conversion, generate data file encryption, and
It is stored under the config directory of Intranet;
The data ferry-boat module is used to that the data file encryption to be ferried from Intranet to outer by general data storage format
Under the config directory of net;
Second synchronization module is used to configure the data output end data source of outer net and data import strategy, according to the importing
Tactful that data pick-up and data deciphering are periodically carried out under the config directory of outer net, after generating decryption data, setting master, external key
Importing sequence imports the data after decryption in the data output end data source according to the importing sequence.
A kind of heterogeneous database intranet and extranet synchronization system, comprising: data input pin, data output end and a kind of above-mentioned isomery
Database intranet and extranet synchronizing device.
Compared with prior art, the invention has the benefit that
1) present invention solves the problems, such as intranet and extranet Data Migration, reduces exploitation and maintenance workload, reduces development cost;
2) present invention solves between heterogeneous database, data between difference table structure by using general data storage format
The problem of migration ensure that data integrity, the accuracy of increment reduce development cost, reduce maintenance cost to greatest extent;
3) present invention is guaranteed that the synchronous frequency of data is carried out according to set synchronizing cycle, is thoroughly solved by setting synchronizing cycle
Synchronous imeliness problem.
Detailed description of the invention
Fig. 1 is a kind of basic flow chart of heterogeneous database intranet and extranet synchronous method of the embodiment of the present invention;
Fig. 2 is a kind of structural schematic diagram of heterogeneous database intranet and extranet synchronizing device of the embodiment of the present invention;
Fig. 3 is a kind of configuration diagram of heterogeneous database intranet and extranet synchronization system of the embodiment of the present invention.
Specific embodiment
With reference to the accompanying drawing with specific embodiment the present invention will be further explained explanation:
Embodiment one:
As shown in Figure 1, a kind of heterogeneous database intranet and extranet synchronous method, comprising:
Step S101: configuration data input terminal data source and data synchronization strategy, according to the synchronization policy periodically from the number
According to data pick-up, data encryption and file conversion is carried out in input terminal data source, data file encryption is generated, and be stored in Intranet
Config directory under;Specifically, data synchronization strategy includes: to obtain correspondence database table by the input terminal data source, fixed
Based on the justice database table, foreign-key table, a plurality of data are packaged using row element, corresponding field value using key,
The mode of value is stored;Set T synchronizing cycle.
Step S102: the data file encryption is ferried from Intranet to the configuration of outer net by general data storage format
Under catalogue;Specifically, general data storage format is XML file format, and the increase data of a database table are stored in one
In XML file.
Step S103: the data output end data source and data for configuring outer net import strategy, fixed according to the importing strategy
When data pick-up and data deciphering are carried out under the config directory of outer net, the data after generating decryption, setting is main, external key import it is suitable
Sequence imports the data after decryption in the data output end data source according to the importing sequence.Specifically, data import plan
It slightly include: that sequence is named to data file encryption according to the sequence of master, external key, connects data according to T synchronizing cycle
Receiving end first carries out major-key table data write-in, then carries out foreign-key table data and synchronize.
Specifically, the data input pin data source and data output end data source heterogeneous database each other.
Specifically, data pick-up is that data synchronization strategy or data are imported strategy to be converted into sql script, carries out data sieve
Choosing, obtains corresponding data.
1) present invention solves the problems, such as intranet and extranet Data Migration, reduces exploitation and maintenance workload, reduce exploitation at
This;
2) present invention solves between heterogeneous database, data between difference table structure by using general data storage format
The problem of migration ensure that data integrity, the accuracy of increment reduce development cost, reduce maintenance cost to greatest extent;
3) present invention is guaranteed that the synchronous frequency of data is carried out according to set synchronizing cycle, is thoroughly solved by setting synchronizing cycle
Synchronous imeliness problem.
Embodiment two:
As shown in Fig. 2, a kind of heterogeneous database intranet and extranet synchronizing device, comprising: the first synchronization module, data ferry-boat module and the
Two synchronization modules;
First synchronization module is used for configuration data input terminal data source and data synchronization strategy, fixed according to the synchronization policy
When from the data input pin data source carry out data pick-up, data encryption and file conversion, generate data file encryption, and
It is stored under the config directory of Intranet;
The data ferry-boat module is used to that the data file encryption to be ferried from Intranet to outer by general data storage format
Under the config directory of net;As an embodiment, data ferry-boat module is gateway;
Second synchronization module is used to configure the data output end data source of outer net and data import strategy, according to the importing
Tactful that data pick-up and data deciphering are periodically carried out under the config directory of outer net, after generating decryption data, setting master, external key
Importing sequence imports the data after decryption in the data output end data source according to the importing sequence.
It is worth noting that first synchronization module is located in government intranet, the second synchronization module is located at government affairs outer net
In;First synchronization module, the second synchronization module can be equipped on server, constitute the first data synchronization server and the
Two data synchronization servers.
Embodiment three:
As shown in figure 3, a kind of heterogeneous database intranet and extranet synchronization system, comprising: data input pin, data output end and embodiment
A kind of two heterogeneous database intranet and extranet synchronizing devices.As an embodiment, data input pin and data output end
It is service database server, as shown in figure 3, data input pin is Intranet service database server A, data output end is
Outer net service database server B;First data synchronization server is data synchronization server A1, the second data synchronization server
For data synchronization server B1.Intranet service database server A and data synchronization server A1 are located at government intranet, outer net industry
Business database server B and data synchronization server B1 is located at government affairs outer net.
Application Example:
A kind of heterogeneous database intranet and extranet synchronous method, apparatus and system based on embodiment one to embodiment three need at present
The partial data of government intranet A system is synchronized in government affairs outer net B system, process is as follows:
Firstly, government intranet needs to dispose the first synchronization module in constituting data synchronization server A1 on server, Intranet is set
Service database server A is data input pin, and keeps Intranet service database server A and data synchronization server A1 mutual
It is logical;Government affairs outer net needs to dispose the second synchronization module in constituting data synchronization server B1 on server, and outer network service number is arranged
It is data output end according to library server B, and makes outer net service database server B and data synchronization server B1 intercommunication;Government affairs
Intranet A system pass through between data synchronization server A1 and the data synchronization server B1 of government affairs outer net B system by gateway into
The ferry-boat of row data.
Then Intranet service database server A data source and data synchronization strategy are configured, according to same in synchronization policy
Step period T timing carries out data pick-up, data encryption and file conversion from data input pin data source, generates encryption data text
Part, and be stored under the config directory AF of Intranet.
Ferried under the config directory AF of Intranet by gateway to the data file encryption stored by XML file format to
Under the config directory BF of outer net.
Configuration outer net service database server B data source and data import strategy, tactful periodically from outer net according to importing
Config directory BF under carry out data pick-up, data deciphering and processing, the data after generating decryption first carry out major-key table data and write
Enter, then carry out foreign-key table data and synchronize, the data after decryption are imported in outer net service database server B data source.
Illustrated above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered
It is considered as protection scope of the present invention.
Claims (7)
1. a kind of heterogeneous database intranet and extranet synchronous method characterized by comprising
Step 1: configuration data input terminal data source and data synchronization strategy, it is defeated from the data according to the synchronization policy timing
Enter to carry out data pick-up, data encryption and file conversion in end data source, generates data file encryption, and be stored in matching for Intranet
It sets under catalogue;
Step 2: the data file encryption being ferried from Intranet under the config directory of outer net by general data storage format;
Step 3: the data output end data source and data for configuring outer net import strategy, according to the importing strategy periodically from outer net
Config directory under carry out data pick-up and data deciphering, the data after generating decryption, setting is main, external key importing sequence, according to
The importing sequence imports the data after decryption in the data output end data source.
2. heterogeneous database intranet and extranet synchronous method according to claim 1, which is characterized in that the data input pin number
According to source and data output end data source heterogeneous database each other.
3. heterogeneous database intranet and extranet synchronous method according to claim 2, which is characterized in that the data synchronization strategy
Include:
Correspondence database table is obtained by the input terminal data source, is defined based on the database table, foreign-key table, a plurality of data
It is packaged using row element, corresponding field value is stored by the way of key, value;Set T synchronizing cycle.
4. heterogeneous database intranet and extranet synchronous method according to claim 3, which is characterized in that the general data storage
Format is XML file format, and the increase data of a database table are stored in an XML file.
5. heterogeneous database intranet and extranet synchronous method according to claim 3, which is characterized in that the data import strategy
Include:
According to T synchronizing cycle, sequence is named to data file encryption according to the sequence of master, external key, makes data receiver
End first carries out the write-in of major-key table data, then carries out foreign-key table data and synchronize.
6. a kind of heterogeneous database intranet and extranet synchronizing device characterized by comprising the first synchronization module, data ferry-boat module
And second synchronization module;
First synchronization module is used for configuration data input terminal data source and data synchronization strategy, fixed according to the synchronization policy
When from the data input pin data source carry out data pick-up, data encryption and file conversion, generate data file encryption, and
It is stored under the config directory of Intranet;
The data ferry-boat module is used to that the data file encryption to be ferried from Intranet to outer by general data storage format
Under the config directory of net;
Second synchronization module is used to configure the data output end data source of outer net and data import strategy, according to the importing
Tactful that data pick-up and data deciphering are periodically carried out under the config directory of outer net, after generating decryption data, setting master, external key
Importing sequence imports the data after decryption in the data output end data source according to the importing sequence.
7. a kind of heterogeneous database intranet and extranet synchronization system characterized by comprising data input pin, data output end and power
Benefit requires a kind of 6 heterogeneous database intranet and extranet synchronizing devices.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910525344.7A CN110413702A (en) | 2019-06-18 | 2019-06-18 | Heterogeneous database intranet and extranet synchronous method, apparatus and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910525344.7A CN110413702A (en) | 2019-06-18 | 2019-06-18 | Heterogeneous database intranet and extranet synchronous method, apparatus and system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110413702A true CN110413702A (en) | 2019-11-05 |
Family
ID=68359188
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910525344.7A Pending CN110413702A (en) | 2019-06-18 | 2019-06-18 | Heterogeneous database intranet and extranet synchronous method, apparatus and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110413702A (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111078768A (en) * | 2019-11-25 | 2020-04-28 | 深圳壹账通智能科技有限公司 | Data import method and system based on graphic database and readable storage medium |
CN111917584A (en) * | 2020-08-04 | 2020-11-10 | 中科信安(深圳)信息技术有限公司 | Data security exchange system and heterogeneous data conversion method |
CN113114622A (en) * | 2021-03-08 | 2021-07-13 | 北京世纪安图数码科技发展有限责任公司 | Real estate registration multi-source heterogeneous data exchange method |
CN114039967A (en) * | 2021-10-29 | 2022-02-11 | 广州中爆数字信息科技股份有限公司 | File transmission method, device, equipment and storage medium |
CN116303623A (en) * | 2023-05-12 | 2023-06-23 | 国网信息通信产业集团有限公司 | System and method for converging cross-network heterogeneous service data to mobile portal |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102916960A (en) * | 2012-10-18 | 2013-02-06 | 中国电力科学研究院 | Strategy synchronization method and system applied to physical isolation gap |
CN103685543A (en) * | 2013-12-23 | 2014-03-26 | 中国电子科技集团公司第三十研究所 | Method and system for data synchronism between heterogeneous databases |
EP2891994A1 (en) * | 2013-11-04 | 2015-07-08 | Guangdong Electronics Industry Institute Ltd. | Method for achieving automatic synchronization of multisource heterogeneous data resources |
CN105005618A (en) * | 2015-07-21 | 2015-10-28 | 杭州合众数据技术有限公司 | Data synchronization method and system among heterogeneous databases |
CN105117654A (en) * | 2015-07-24 | 2015-12-02 | 中国电力科学研究院 | Data synchronization method between same systems under the circumstance of network physical isolation |
-
2019
- 2019-06-18 CN CN201910525344.7A patent/CN110413702A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102916960A (en) * | 2012-10-18 | 2013-02-06 | 中国电力科学研究院 | Strategy synchronization method and system applied to physical isolation gap |
EP2891994A1 (en) * | 2013-11-04 | 2015-07-08 | Guangdong Electronics Industry Institute Ltd. | Method for achieving automatic synchronization of multisource heterogeneous data resources |
CN103685543A (en) * | 2013-12-23 | 2014-03-26 | 中国电子科技集团公司第三十研究所 | Method and system for data synchronism between heterogeneous databases |
CN105005618A (en) * | 2015-07-21 | 2015-10-28 | 杭州合众数据技术有限公司 | Data synchronization method and system among heterogeneous databases |
CN105117654A (en) * | 2015-07-24 | 2015-12-02 | 中国电力科学研究院 | Data synchronization method between same systems under the circumstance of network physical isolation |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111078768A (en) * | 2019-11-25 | 2020-04-28 | 深圳壹账通智能科技有限公司 | Data import method and system based on graphic database and readable storage medium |
CN111917584A (en) * | 2020-08-04 | 2020-11-10 | 中科信安(深圳)信息技术有限公司 | Data security exchange system and heterogeneous data conversion method |
CN111917584B (en) * | 2020-08-04 | 2023-04-21 | 中科信安(深圳)信息技术有限公司 | Data security exchange system and heterogeneous data conversion method |
CN113114622A (en) * | 2021-03-08 | 2021-07-13 | 北京世纪安图数码科技发展有限责任公司 | Real estate registration multi-source heterogeneous data exchange method |
CN114039967A (en) * | 2021-10-29 | 2022-02-11 | 广州中爆数字信息科技股份有限公司 | File transmission method, device, equipment and storage medium |
CN116303623A (en) * | 2023-05-12 | 2023-06-23 | 国网信息通信产业集团有限公司 | System and method for converging cross-network heterogeneous service data to mobile portal |
CN116303623B (en) * | 2023-05-12 | 2023-10-13 | 国网信息通信产业集团有限公司 | System and method for converging cross-network heterogeneous service data to mobile portal |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110413702A (en) | Heterogeneous database intranet and extranet synchronous method, apparatus and system | |
US8792385B2 (en) | Method and device for auto-generating goose signal connection topology from substation level | |
CN109542865A (en) | Distributed cluster system configuration file synchronous method, device, system and medium | |
CN110601931B (en) | Batch configuration method and system of intelligent home system | |
CN110009201B (en) | Electric power data link system and method based on block chain technology | |
CN101951319B (en) | Unified identity authentication method supporting data integration of heterogeneous application module | |
CN107515878A (en) | The management method and device of a kind of data directory | |
CN105574109A (en) | Database synchronizing method and equipment and system | |
CN106777387B (en) | HBase-based Internet of things big data access method | |
CN102110064A (en) | Low latency serial memory interface | |
CN102904977A (en) | Network address allocation method, server and node | |
US8244670B2 (en) | System and method for reliable symmetric data synchronization | |
CN105978948A (en) | Cloud service method and system thereof | |
CN103098527A (en) | Wireless communication apparatus, wireless communication system and wireless communication method | |
CN103856354A (en) | Method for achieving unified management of logs of cluster storage system | |
CN109857808B (en) | Vertical data synchronization system and method based on neutral data structure | |
CN105338107A (en) | Stronghold operation synchronous management system and stronghold operation synchronous management method | |
CN106301972A (en) | A kind of monitoring data push away method and system in real time | |
CN113727429A (en) | Cross-network-group clock synchronization method and device, storage medium and terminal | |
CN113256470A (en) | Weapon equipment management system and method based on block chain | |
CN106454767A (en) | Business data synchronization method, device and system | |
CN103763325A (en) | Method for building IP security product development environment | |
CN106131186A (en) | A kind of power information acquisition interface adjustment method based on Redis distributed caching | |
CN113630365B (en) | Parallel transmission method, device and equipment for mass heterogeneous data and storage medium | |
CN104578418A (en) | Configuration method and system of automatic power distribution equipment based on 101 protocols, and equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191105 |