CN110413702A - Heterogeneous database intranet and extranet synchronous method, apparatus and system - Google Patents

Heterogeneous database intranet and extranet synchronous method, apparatus and system Download PDF

Info

Publication number
CN110413702A
CN110413702A CN201910525344.7A CN201910525344A CN110413702A CN 110413702 A CN110413702 A CN 110413702A CN 201910525344 A CN201910525344 A CN 201910525344A CN 110413702 A CN110413702 A CN 110413702A
Authority
CN
China
Prior art keywords
data
intranet
extranet
synchronization
heterogeneous database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910525344.7A
Other languages
Chinese (zh)
Inventor
张骜宇
谷晶中
姚金龙
张阳光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Valley Network Polytron Technologies Inc
Original Assignee
Valley Network Polytron Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Valley Network Polytron Technologies Inc filed Critical Valley Network Polytron Technologies Inc
Priority to CN201910525344.7A priority Critical patent/CN110413702A/en
Publication of CN110413702A publication Critical patent/CN110413702A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/258Data format conversion from or to a database
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/273Asynchronous replication or reconciliation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention discloses a kind of heterogeneous database intranet and extranet synchronous method, it include: configuration data input terminal data source and data synchronization strategy, data pick-up, data encryption and file conversion are carried out from data input pin data source according to synchronization policy timing, data file encryption is generated, and is stored under the config directory of Intranet;Data file encryption is ferried from Intranet under the config directory of outer net by general data storage format;The data output end data source and data for configuring outer net import strategy, data pick-up, data deciphering and processing are carried out under the config directory of outer net according to strategy timing is imported, data after generating decryption, setting master, external key importing sequence, import the data after decryption in data output end data source according to importing sequence.Invention additionally discloses a kind of heterogeneous database intranet and extranet synchronizing device and a kind of heterogeneous database intranet and extranet synchronization systems.The timely precision that the inside and outside network data of heterogeneous database can be achieved in the present invention is synchronous.

Description

Heterogeneous database intranet and extranet synchronous method, apparatus and system
Technical field
The present invention relates to government system technical field of data storage, in particular to heterogeneous database intranet and extranet synchronous method, Apparatus and system.
Background technique
With the fast development of science and technology, the combination of Internet technology and daily life, business activity is increasingly close.7*24 clothes Business system Fast Growth as emerging rapidly in large numbersBamboo shoots after a spring rain, thus it is also higher and higher to the needs and requirement of data storage, especially in gold Melt, the fields such as government affairs, electric business, database is provided out data access service as a ring important in its business.
For government system, data interchange, immediate updating of the government affairs intranet and extranet not between homologous ray, tradition are often needed to Database level method for distinguishing be difficult break through Intranet isolation network barrier, occur updating often not in time, fining information sieve Choosing can not operate, while even more extremely difficult for the intranet and extranet data interchange problem of heterogeneous database.
Therefore, it realizes that the precision of inside and outside network data is synchronous, is those skilled in the art's technical problem urgently to be solved.
Summary of the invention
The present invention can not carry out the synchronous problem of precision for the inside and outside network data of government system heterogeneous database in time, It is proposed a kind of heterogeneous database intranet and extranet synchronous method, apparatus and system.
To achieve the goals above, the invention adopts the following technical scheme:
A kind of heterogeneous database intranet and extranet synchronous method, comprising:
Step 1: configuration data input terminal data source and data synchronization strategy, it is defeated from the data according to the synchronization policy timing Enter to carry out data pick-up, data encryption and file conversion in end data source, generates data file encryption, and be stored in matching for Intranet It sets under catalogue;
Step 2: the data file encryption being ferried from Intranet under the config directory of outer net by general data storage format;
Step 3: the data output end data source and data for configuring outer net import strategy, according to the importing strategy periodically from outer net Config directory under carry out data pick-up and data deciphering, the data after generating decryption, setting is main, external key importing sequence, according to The importing sequence imports the data after decryption in the data output end data source.
Further, the data input pin data source and data output end data source heterogeneous database each other.
Further, the data synchronization strategy includes:
Correspondence database table is obtained by the input terminal data source, is defined based on the database table, foreign-key table, a plurality of data It is packaged using row element, corresponding field value is stored by the way of key, value;Set T synchronizing cycle.
Further, the general data storage format is XML file format, the increase data storage of a database table In an XML file.
Further, the data importing strategy includes:
According to T synchronizing cycle, sequence is named to data file encryption according to the sequence of master, external key, makes data receiver End first carries out the write-in of major-key table data, then carries out foreign-key table data and synchronize.
A kind of heterogeneous database intranet and extranet synchronizing device, comprising: the first synchronization module, data ferry-boat module and second are synchronous Module;
First synchronization module is used for configuration data input terminal data source and data synchronization strategy, fixed according to the synchronization policy When from the data input pin data source carry out data pick-up, data encryption and file conversion, generate data file encryption, and It is stored under the config directory of Intranet;
The data ferry-boat module is used to that the data file encryption to be ferried from Intranet to outer by general data storage format Under the config directory of net;
Second synchronization module is used to configure the data output end data source of outer net and data import strategy, according to the importing Tactful that data pick-up and data deciphering are periodically carried out under the config directory of outer net, after generating decryption data, setting master, external key Importing sequence imports the data after decryption in the data output end data source according to the importing sequence.
A kind of heterogeneous database intranet and extranet synchronization system, comprising: data input pin, data output end and a kind of above-mentioned isomery Database intranet and extranet synchronizing device.
Compared with prior art, the invention has the benefit that
1) present invention solves the problems, such as intranet and extranet Data Migration, reduces exploitation and maintenance workload, reduces development cost;
2) present invention solves between heterogeneous database, data between difference table structure by using general data storage format The problem of migration ensure that data integrity, the accuracy of increment reduce development cost, reduce maintenance cost to greatest extent;
3) present invention is guaranteed that the synchronous frequency of data is carried out according to set synchronizing cycle, is thoroughly solved by setting synchronizing cycle Synchronous imeliness problem.
Detailed description of the invention
Fig. 1 is a kind of basic flow chart of heterogeneous database intranet and extranet synchronous method of the embodiment of the present invention;
Fig. 2 is a kind of structural schematic diagram of heterogeneous database intranet and extranet synchronizing device of the embodiment of the present invention;
Fig. 3 is a kind of configuration diagram of heterogeneous database intranet and extranet synchronization system of the embodiment of the present invention.
Specific embodiment
With reference to the accompanying drawing with specific embodiment the present invention will be further explained explanation:
Embodiment one:
As shown in Figure 1, a kind of heterogeneous database intranet and extranet synchronous method, comprising:
Step S101: configuration data input terminal data source and data synchronization strategy, according to the synchronization policy periodically from the number According to data pick-up, data encryption and file conversion is carried out in input terminal data source, data file encryption is generated, and be stored in Intranet Config directory under;Specifically, data synchronization strategy includes: to obtain correspondence database table by the input terminal data source, fixed Based on the justice database table, foreign-key table, a plurality of data are packaged using row element, corresponding field value using key, The mode of value is stored;Set T synchronizing cycle.
Step S102: the data file encryption is ferried from Intranet to the configuration of outer net by general data storage format Under catalogue;Specifically, general data storage format is XML file format, and the increase data of a database table are stored in one In XML file.
Step S103: the data output end data source and data for configuring outer net import strategy, fixed according to the importing strategy When data pick-up and data deciphering are carried out under the config directory of outer net, the data after generating decryption, setting is main, external key import it is suitable Sequence imports the data after decryption in the data output end data source according to the importing sequence.Specifically, data import plan It slightly include: that sequence is named to data file encryption according to the sequence of master, external key, connects data according to T synchronizing cycle Receiving end first carries out major-key table data write-in, then carries out foreign-key table data and synchronize.
Specifically, the data input pin data source and data output end data source heterogeneous database each other.
Specifically, data pick-up is that data synchronization strategy or data are imported strategy to be converted into sql script, carries out data sieve Choosing, obtains corresponding data.
1) present invention solves the problems, such as intranet and extranet Data Migration, reduces exploitation and maintenance workload, reduce exploitation at This;
2) present invention solves between heterogeneous database, data between difference table structure by using general data storage format The problem of migration ensure that data integrity, the accuracy of increment reduce development cost, reduce maintenance cost to greatest extent;
3) present invention is guaranteed that the synchronous frequency of data is carried out according to set synchronizing cycle, is thoroughly solved by setting synchronizing cycle Synchronous imeliness problem.
Embodiment two:
As shown in Fig. 2, a kind of heterogeneous database intranet and extranet synchronizing device, comprising: the first synchronization module, data ferry-boat module and the Two synchronization modules;
First synchronization module is used for configuration data input terminal data source and data synchronization strategy, fixed according to the synchronization policy When from the data input pin data source carry out data pick-up, data encryption and file conversion, generate data file encryption, and It is stored under the config directory of Intranet;
The data ferry-boat module is used to that the data file encryption to be ferried from Intranet to outer by general data storage format Under the config directory of net;As an embodiment, data ferry-boat module is gateway;
Second synchronization module is used to configure the data output end data source of outer net and data import strategy, according to the importing Tactful that data pick-up and data deciphering are periodically carried out under the config directory of outer net, after generating decryption data, setting master, external key Importing sequence imports the data after decryption in the data output end data source according to the importing sequence.
It is worth noting that first synchronization module is located in government intranet, the second synchronization module is located at government affairs outer net In;First synchronization module, the second synchronization module can be equipped on server, constitute the first data synchronization server and the Two data synchronization servers.
Embodiment three:
As shown in figure 3, a kind of heterogeneous database intranet and extranet synchronization system, comprising: data input pin, data output end and embodiment A kind of two heterogeneous database intranet and extranet synchronizing devices.As an embodiment, data input pin and data output end It is service database server, as shown in figure 3, data input pin is Intranet service database server A, data output end is Outer net service database server B;First data synchronization server is data synchronization server A1, the second data synchronization server For data synchronization server B1.Intranet service database server A and data synchronization server A1 are located at government intranet, outer net industry Business database server B and data synchronization server B1 is located at government affairs outer net.
Application Example:
A kind of heterogeneous database intranet and extranet synchronous method, apparatus and system based on embodiment one to embodiment three need at present The partial data of government intranet A system is synchronized in government affairs outer net B system, process is as follows:
Firstly, government intranet needs to dispose the first synchronization module in constituting data synchronization server A1 on server, Intranet is set Service database server A is data input pin, and keeps Intranet service database server A and data synchronization server A1 mutual It is logical;Government affairs outer net needs to dispose the second synchronization module in constituting data synchronization server B1 on server, and outer network service number is arranged It is data output end according to library server B, and makes outer net service database server B and data synchronization server B1 intercommunication;Government affairs Intranet A system pass through between data synchronization server A1 and the data synchronization server B1 of government affairs outer net B system by gateway into The ferry-boat of row data.
Then Intranet service database server A data source and data synchronization strategy are configured, according to same in synchronization policy Step period T timing carries out data pick-up, data encryption and file conversion from data input pin data source, generates encryption data text Part, and be stored under the config directory AF of Intranet.
Ferried under the config directory AF of Intranet by gateway to the data file encryption stored by XML file format to Under the config directory BF of outer net.
Configuration outer net service database server B data source and data import strategy, tactful periodically from outer net according to importing Config directory BF under carry out data pick-up, data deciphering and processing, the data after generating decryption first carry out major-key table data and write Enter, then carry out foreign-key table data and synchronize, the data after decryption are imported in outer net service database server B data source.
Illustrated above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered It is considered as protection scope of the present invention.

Claims (7)

1. a kind of heterogeneous database intranet and extranet synchronous method characterized by comprising
Step 1: configuration data input terminal data source and data synchronization strategy, it is defeated from the data according to the synchronization policy timing Enter to carry out data pick-up, data encryption and file conversion in end data source, generates data file encryption, and be stored in matching for Intranet It sets under catalogue;
Step 2: the data file encryption being ferried from Intranet under the config directory of outer net by general data storage format;
Step 3: the data output end data source and data for configuring outer net import strategy, according to the importing strategy periodically from outer net Config directory under carry out data pick-up and data deciphering, the data after generating decryption, setting is main, external key importing sequence, according to The importing sequence imports the data after decryption in the data output end data source.
2. heterogeneous database intranet and extranet synchronous method according to claim 1, which is characterized in that the data input pin number According to source and data output end data source heterogeneous database each other.
3. heterogeneous database intranet and extranet synchronous method according to claim 2, which is characterized in that the data synchronization strategy Include:
Correspondence database table is obtained by the input terminal data source, is defined based on the database table, foreign-key table, a plurality of data It is packaged using row element, corresponding field value is stored by the way of key, value;Set T synchronizing cycle.
4. heterogeneous database intranet and extranet synchronous method according to claim 3, which is characterized in that the general data storage Format is XML file format, and the increase data of a database table are stored in an XML file.
5. heterogeneous database intranet and extranet synchronous method according to claim 3, which is characterized in that the data import strategy Include:
According to T synchronizing cycle, sequence is named to data file encryption according to the sequence of master, external key, makes data receiver End first carries out the write-in of major-key table data, then carries out foreign-key table data and synchronize.
6. a kind of heterogeneous database intranet and extranet synchronizing device characterized by comprising the first synchronization module, data ferry-boat module And second synchronization module;
First synchronization module is used for configuration data input terminal data source and data synchronization strategy, fixed according to the synchronization policy When from the data input pin data source carry out data pick-up, data encryption and file conversion, generate data file encryption, and It is stored under the config directory of Intranet;
The data ferry-boat module is used to that the data file encryption to be ferried from Intranet to outer by general data storage format Under the config directory of net;
Second synchronization module is used to configure the data output end data source of outer net and data import strategy, according to the importing Tactful that data pick-up and data deciphering are periodically carried out under the config directory of outer net, after generating decryption data, setting master, external key Importing sequence imports the data after decryption in the data output end data source according to the importing sequence.
7. a kind of heterogeneous database intranet and extranet synchronization system characterized by comprising data input pin, data output end and power Benefit requires a kind of 6 heterogeneous database intranet and extranet synchronizing devices.
CN201910525344.7A 2019-06-18 2019-06-18 Heterogeneous database intranet and extranet synchronous method, apparatus and system Pending CN110413702A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910525344.7A CN110413702A (en) 2019-06-18 2019-06-18 Heterogeneous database intranet and extranet synchronous method, apparatus and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910525344.7A CN110413702A (en) 2019-06-18 2019-06-18 Heterogeneous database intranet and extranet synchronous method, apparatus and system

Publications (1)

Publication Number Publication Date
CN110413702A true CN110413702A (en) 2019-11-05

Family

ID=68359188

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910525344.7A Pending CN110413702A (en) 2019-06-18 2019-06-18 Heterogeneous database intranet and extranet synchronous method, apparatus and system

Country Status (1)

Country Link
CN (1) CN110413702A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111078768A (en) * 2019-11-25 2020-04-28 深圳壹账通智能科技有限公司 Data import method and system based on graphic database and readable storage medium
CN111917584A (en) * 2020-08-04 2020-11-10 中科信安(深圳)信息技术有限公司 Data security exchange system and heterogeneous data conversion method
CN113114622A (en) * 2021-03-08 2021-07-13 北京世纪安图数码科技发展有限责任公司 Real estate registration multi-source heterogeneous data exchange method
CN114039967A (en) * 2021-10-29 2022-02-11 广州中爆数字信息科技股份有限公司 File transmission method, device, equipment and storage medium
CN116303623A (en) * 2023-05-12 2023-06-23 国网信息通信产业集团有限公司 System and method for converging cross-network heterogeneous service data to mobile portal

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102916960A (en) * 2012-10-18 2013-02-06 中国电力科学研究院 Strategy synchronization method and system applied to physical isolation gap
CN103685543A (en) * 2013-12-23 2014-03-26 中国电子科技集团公司第三十研究所 Method and system for data synchronism between heterogeneous databases
EP2891994A1 (en) * 2013-11-04 2015-07-08 Guangdong Electronics Industry Institute Ltd. Method for achieving automatic synchronization of multisource heterogeneous data resources
CN105005618A (en) * 2015-07-21 2015-10-28 杭州合众数据技术有限公司 Data synchronization method and system among heterogeneous databases
CN105117654A (en) * 2015-07-24 2015-12-02 中国电力科学研究院 Data synchronization method between same systems under the circumstance of network physical isolation

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102916960A (en) * 2012-10-18 2013-02-06 中国电力科学研究院 Strategy synchronization method and system applied to physical isolation gap
EP2891994A1 (en) * 2013-11-04 2015-07-08 Guangdong Electronics Industry Institute Ltd. Method for achieving automatic synchronization of multisource heterogeneous data resources
CN103685543A (en) * 2013-12-23 2014-03-26 中国电子科技集团公司第三十研究所 Method and system for data synchronism between heterogeneous databases
CN105005618A (en) * 2015-07-21 2015-10-28 杭州合众数据技术有限公司 Data synchronization method and system among heterogeneous databases
CN105117654A (en) * 2015-07-24 2015-12-02 中国电力科学研究院 Data synchronization method between same systems under the circumstance of network physical isolation

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111078768A (en) * 2019-11-25 2020-04-28 深圳壹账通智能科技有限公司 Data import method and system based on graphic database and readable storage medium
CN111917584A (en) * 2020-08-04 2020-11-10 中科信安(深圳)信息技术有限公司 Data security exchange system and heterogeneous data conversion method
CN111917584B (en) * 2020-08-04 2023-04-21 中科信安(深圳)信息技术有限公司 Data security exchange system and heterogeneous data conversion method
CN113114622A (en) * 2021-03-08 2021-07-13 北京世纪安图数码科技发展有限责任公司 Real estate registration multi-source heterogeneous data exchange method
CN114039967A (en) * 2021-10-29 2022-02-11 广州中爆数字信息科技股份有限公司 File transmission method, device, equipment and storage medium
CN116303623A (en) * 2023-05-12 2023-06-23 国网信息通信产业集团有限公司 System and method for converging cross-network heterogeneous service data to mobile portal
CN116303623B (en) * 2023-05-12 2023-10-13 国网信息通信产业集团有限公司 System and method for converging cross-network heterogeneous service data to mobile portal

Similar Documents

Publication Publication Date Title
CN110413702A (en) Heterogeneous database intranet and extranet synchronous method, apparatus and system
US8792385B2 (en) Method and device for auto-generating goose signal connection topology from substation level
CN109542865A (en) Distributed cluster system configuration file synchronous method, device, system and medium
CN110601931B (en) Batch configuration method and system of intelligent home system
CN110009201B (en) Electric power data link system and method based on block chain technology
CN101951319B (en) Unified identity authentication method supporting data integration of heterogeneous application module
CN107515878A (en) The management method and device of a kind of data directory
CN105574109A (en) Database synchronizing method and equipment and system
CN106777387B (en) HBase-based Internet of things big data access method
CN102110064A (en) Low latency serial memory interface
CN102904977A (en) Network address allocation method, server and node
US8244670B2 (en) System and method for reliable symmetric data synchronization
CN105978948A (en) Cloud service method and system thereof
CN103098527A (en) Wireless communication apparatus, wireless communication system and wireless communication method
CN103856354A (en) Method for achieving unified management of logs of cluster storage system
CN109857808B (en) Vertical data synchronization system and method based on neutral data structure
CN105338107A (en) Stronghold operation synchronous management system and stronghold operation synchronous management method
CN106301972A (en) A kind of monitoring data push away method and system in real time
CN113727429A (en) Cross-network-group clock synchronization method and device, storage medium and terminal
CN113256470A (en) Weapon equipment management system and method based on block chain
CN106454767A (en) Business data synchronization method, device and system
CN103763325A (en) Method for building IP security product development environment
CN106131186A (en) A kind of power information acquisition interface adjustment method based on Redis distributed caching
CN113630365B (en) Parallel transmission method, device and equipment for mass heterogeneous data and storage medium
CN104578418A (en) Configuration method and system of automatic power distribution equipment based on 101 protocols, and equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20191105