CN105787057B - Method for realizing automatic synchronization of service data between heterogeneous systems - Google Patents

Method for realizing automatic synchronization of service data between heterogeneous systems Download PDF

Info

Publication number
CN105787057B
CN105787057B CN201610110464.7A CN201610110464A CN105787057B CN 105787057 B CN105787057 B CN 105787057B CN 201610110464 A CN201610110464 A CN 201610110464A CN 105787057 B CN105787057 B CN 105787057B
Authority
CN
China
Prior art keywords
data
business datum
table structure
service data
mapping
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610110464.7A
Other languages
Chinese (zh)
Other versions
CN105787057A (en
Inventor
黄金港
王健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur General Software Co Ltd
Original Assignee
Inspur General Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur General Software Co Ltd filed Critical Inspur General Software Co Ltd
Priority to CN201610110464.7A priority Critical patent/CN105787057B/en
Publication of CN105787057A publication Critical patent/CN105787057A/en
Application granted granted Critical
Publication of CN105787057B publication Critical patent/CN105787057B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/80Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
    • G06F16/83Querying
    • G06F16/835Query processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/80Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
    • G06F16/84Mapping; Conversion
    • G06F16/86Mapping to a database
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2221/00Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/21Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/2141Access rights, e.g. capability lists, access control lists, access tables, access matrices

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Bioethics (AREA)
  • Software Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a method for realizing automatic synchronization of service data among heterogeneous systems, which is used for finishing mapping of basic data, wherein the basic data comprises source data and received data which are sent and received by a data sender and a data receiver; synchronous service data scheduling, wherein both parties of data interaction agree on an integrated service data table structure, and table structure fields of source data and received data need to be in one-to-one correspondence; and analyzing the interface message, after the receiver receives the data, analyzing the data, inserting the data into a specified service data table structure through a service data mapping relation, completing data transmission and returning to a state field. Compared with the prior art, the method for realizing the automatic synchronization of the service data between the heterogeneous systems realizes data mapping by adopting a data source and a receiver in a configuration mode, and has the characteristics of simple operation, quick implementation and the like; the RSA asymmetric encryption algorithm is adopted in the data publishing and subscribing transmission process, the data security and accuracy are guaranteed, the practicability is high, and the popularization is easy.

Description

The autosynchronous implementation method of business datum between a kind of heterogeneous system
Technical field
The present invention relates to communication information technical field, business datum is autosynchronous between specifically a kind of heterogeneous system Implementation method.
Background technique
In today that Internet application is grown rapidly, the service management data of enterprise itself are uniformly particularly important.It For the decision of enterprise's comprehensive and systematic prediction and leader's readjustment and reform, the most basic analysis and reference data are provided.Due to There are many drawbacks for operation system isolation, are in particular in following several respects:
One, cumbersome, working efficiency is low.Due to the report that each subservice system of enterprise is provided, need to concentrate by Unified dimensional summarizes or integrates, and can not quickly finish, and it is more complicated to arrange process.
Two, Information Security and accuracy are low.Specific data are processed due to needing artificial craft, number certainly will be will cause According to accuracy substantially reduce, and biggish guarantee is also unable to get in terms of data confidentiality.
Three, master data management software cost is higher.In terms of solving data unification, using profession master data software be compared with Good selection, but since the implementation cycle is long, business datum complexity is high and software price cost is very high.To enterprise itself For, need to weigh specific practical factor.
Based on this, the autosynchronous implementation method of business datum between a kind of heterogeneous system is now provided, is related in the present invention In the related technology, scheduling synchronization mechanism uses thread closed loop implementation strategy, when big data is concurrent, it is ensured that every number Threading operation is completed according to can independently execute, and after receiving end-state mark.And in terms of Information Security, it uses RSA rivest, shamir, adelman.It is current most influential public key encryption algorithm, can be resisted up to the present known exhausted Most of cryptographic attacks are recommended as public key data encryption standard by ISO.
Summary of the invention
Technical assignment of the invention is place against the above deficiency, provides business datum automatic synchronization between a kind of heterogeneous system Implementation method.
The autosynchronous implementation method of business datum between a kind of heterogeneous system realizes process are as follows:
Basic data mapping is completed, basic data here includes the source that data sender and data receiver transmit and receive Head data, receive two kinds of data, wherein source data be in heterogeneous system, other systems using this data be used as between system uniquely The data of mark;Data are received, are referred to from being received in other systems in own system and legacy data does mapping processing, from And ensure the data identified using data uniqueness;
Synchronous service data dispatch, the integrated business datum table structure of both sides' agreement of data interaction, source data with connect The table structure field for receiving data is required to correspond;The field mapping relations of two kinds of data are set simultaneously, so as to follow-up data Assignment when transmission;By timestamp mechanisms, the creation time and modification time of business datum are scanned, the data of variation are searched out, Here delta data includes the data for increasing newly, modifying and generating variation, and is transmitted by message interface;
Interface packets parsing is carried out to parse the data after recipient receives data and pass through business datum Mapping relations are inserted into data in specified business datum table structure, complete data and transmit and return to mode field.
The type of the source data is based on timestamp mechanism and all saves corresponding timestamp, here when data variation Data variation include newly-increased or modification and the data variation that generates;Then the data are scanned using scheduling process on demand Then message content is transferred in other operation systems to search the data for needing to transmit and carries out reception processing by table.
The reception basic data refers to: by establishing individual reception table, being parsed message content according to the interface of agreement It to data and is stored, then in data mapping relations, original base data and reception data is corresponded to;In business The unique encodings of relied on basic data can be got when data interaction, laid the foundation for synchronizing for business datum.
In the synchronous step of service data scheduling, the thread of scheduling follows close loop maneuver, i.e., needs after sending a data It receives the return value of other side's operation and then terminates thread, and log sheet is written, the crucial ring before data transmission, after receiving Section uses dual logging mode record, i.e., is stored using database journal and text class log.
The interface packets include heading and message body two parts, which is encrypted using private key, message body Using XML format storage service data information, it is based on this, the detailed process of above-mentioned interface packets parsing are as follows: when recipient takes After message, first decryption heading, i.e., be decrypted using public key, if it is possible to by verifying be correct recipient, so It analyzes the XML content of message body again afterwards, and data is inserted into specified table structure by business datum mapping relations, complete Data are transmitted and return to mode field.
Between a kind of heterogeneous system of the invention the autosynchronous implementation method of business datum compared to the prior art, have with It is lower the utility model has the advantages that
The present invention is in deployment and application aspect, using data source and recipient by realizing that data map by the way of configuring, Have the characteristics that easy to operate and implementation is quick, there is preferable popularizing value;It is transmitted across in data publication with what is subscribed to RSA rivest, shamir, adelman is used in journey, ensures the safety and accuracy of data;
Basic data and business datum, it is only necessary to by the definition of a mapping relations, that is, can be used scheduler program automatic According to the scanning strategy of configuration carry out data transmission with it is synchronous, be obviously improved working efficiency;
Support usage scenario more, and can provide data mapping, data permission, parameter configuration (such as synchronizing cycle, it is abnormal in advance It is alert) etc. functions, substantially increase the flexibility of the system integration;
Durings interface transmission etc., stream compression process is safely and effectively recorded using dual logging, and can support Business datum tracing function provides reliable and effective operation authority to define responsibility, practical.
Detailed description of the invention
Attached drawing 1 is system architecture diagram of the invention.
Attached drawing 2 is business process map of the invention.
Specific embodiment
The present invention will be further explained below with reference to the attached drawings and specific examples.
The present invention be suitable for information system it is relatively more, subservice system is irreplaceable, but business datum need integrate with Unified enterprise.Since basic data dictionary between heterogeneous system and business paper data structure are inconsistent, each subsystem is caused Data information forms isolated island, and big data analysis and business fine-grained management to enterprise bring very big difficulty.By this realization Basic data mapping definition, service data scheduling synchronization, interface packets analytics engine, have got through between each heterogeneous system in method The barrier of business datum.Data sharing can be realized at original so that input ratio is lower.
As shown in attached drawing 1, Fig. 2, the autosynchronous implementation method of business datum between a kind of heterogeneous system of the invention, in fact Existing process are as follows:
Basic data mapping is completed, basic data here includes the source that data sender and data receiver transmit and receive Head data, receive two kinds of data, wherein source data be in heterogeneous system, other systems using this data be used as between system uniquely The data of mark;Data are received, are referred to from being received in other systems in own system and legacy data does mapping processing, from And ensure the data identified using data uniqueness;
Synchronous service data dispatch, the integrated business datum table structure of both sides' agreement of data interaction, both sides here are In terms of referring to such as attached drawing 1, GS database shown in Fig. 2 and three method, systems two, wherein three method, systems refer to as shown in 1 right side of attached drawing Cunning software, source data are required to correspond with the table structure field for receiving data;The field of two kinds of data is set simultaneously Mapping relations, so as to assignment when subsequent data transmission;By timestamp mechanism, when scanning the creation time and modification of business datum Between, the data of variation are searched out, delta data here includes the data for increasing newly, modifying and generating variation, and is connect by message Mouth is transmitted;
Interface packets parsing is carried out to parse the data after recipient receives data and pass through business datum Mapping relations are inserted into data in specified business datum table structure, complete data and transmit and return to mode field.
The step of above-mentioned basic data maps mainly allows in business datum the basic data relied on to be consistent, no By being source categorical data and reception categorical data, defined by mapping relations so that all basic datas are provided with uniqueness.
The synchronous step of service data scheduling is mainly based upon the mechanism independent operating of timestamp in the server, can spirit The configuration data living synchronous period, thus reach real-time automatic synchronization, it can also timing automatic synchronization.By to scheduling parameter Configuration, is not necessarily to manual intervention, and system is automatically performed the transmission of specified services data.
The step of interface packets parse, can be with any business system mainly in combination with the xml interface packets format of industry universal System is connected, and automatically parses out the business datum of What You See Is What You Get.And the encryption of heading is increased in transmission process Verification, has ensured Information Security, has not been tampered.
In general, parsing interface packets are completed by interface packets analytics engine, which is the core behaviour of scheduler program Make, realize to data encrypting and deciphering processing and XML message content parsing, and by mapping relations realize data automatically more Newly, it finally realizes and integrates between the system of business datum.
The type of the source data is based on timestamp mechanism and all saves corresponding timestamp, here when data variation Data variation include newly-increased or modification and the data variation that generates;Then the data are scanned using scheduling process on demand Then message content is transferred in other operation systems to search the data for needing to transmit and carries out reception processing by table.
The reception basic data refers to: by establishing individual reception table, being parsed message content according to the interface of agreement It to data and is stored, then in data mapping relations, original base data and reception data is corresponded to;In business The unique encodings of relied on basic data can be got when data interaction, laid the foundation for synchronizing for business datum.
Data permission configuration:, can be according to user or the permission flexible allocation data in post in data mapping definition Permission, thus guarantee basic data operation preciseness.
In the synchronous step of service data scheduling, the thread of scheduling follows close loop maneuver, i.e., needs after sending a data It receives the return value of other side's operation and then terminates thread, and log sheet is written, the crucial ring before data transmission, after receiving Section uses dual logging mode record, i.e., is stored using database journal and text class log.
The interface packets include heading and message body two parts, which is encrypted using private key, message body Using XML format storage service data information, it is based on this, the detailed process of above-mentioned interface packets parsing are as follows: when recipient takes After message, first decryption heading, i.e., be decrypted using public key, if it is possible to by verifying be correct recipient, so It analyzes the XML content of message body again afterwards, and data is inserted into specified table structure by business datum mapping relations, complete Data are transmitted and return to mode field.
The technical personnel in the technical field can readily realize the present invention with the above specific embodiments,.But it answers Work as understanding, the present invention is not limited to above-mentioned specific embodiments.On the basis of the disclosed embodiments, the technical field Technical staff can arbitrarily combine different technical features, to realize different technical solutions.
Except for the technical features described in the specification, it all is technically known to those skilled in the art.

Claims (2)

1. the autosynchronous implementation method of business datum between a kind of heterogeneous system, which is characterized in that it realizes process are as follows:
Basic data mapping is completed, basic data here includes the source number that data sender and data receiver transmit and receive According to, receive two kinds of data, wherein source data be in heterogeneous system, other systems are using this data as unique identification between system Data;Data are received, are referred to from being received in other systems in own system and legacy data does mapping processing, to protect The data that barrier is identified using data uniqueness;
Synchronous service data dispatch, the integrated business datum table structure of both sides' agreement of data interaction, source data and reception number According to table structure field be required to correspond;The field mapping relations of two kinds of data are set simultaneously, so as to subsequent data transmission When assignment;By timestamp mechanism, the creation time and modification time of business datum are scanned, searches out the data of variation, here Delta data include the data for increasing newly, modifying and generating variation, and transmitted by message interface;
Interface packets parsing is carried out, after recipient receives data, parsing is carried out to the data and is mapped by business datum Relationship is inserted into data in specified business datum table structure, completes data and transmits and return to mode field;
The type of the source data is based on timestamp mechanism and all saves corresponding timestamp, number here when data variation It include newly-increased or modification and generation data variation according to variation;Then the tables of data is scanned using scheduling process on demand, from And the data for needing to transmit are searched, then message content is transferred in other operation systems and carries out reception processing;
The reception basic data refers to: by establishing individual reception table, message content being resolved to number according to the interface of agreement According to and stored, then in data mapping relations, original base data and receive data corresponded to;In business datum The unique encodings of relied on basic data can be got when interaction, laid the foundation for synchronizing for business datum;
In the synchronous step of service data scheduling, the thread of scheduling follows close loop maneuver, i.e., needs to connect after sending a data It receives the return value of other side's operation and then terminates thread, and log sheet is written, the key link before data transmission, after receiving is adopted With dual logging mode record, i.e., stored using database journal and text class log.
2. the autosynchronous implementation method of business datum between a kind of heterogeneous system according to claim 1, which is characterized in that The interface packets include heading and message body two parts, which is encrypted using private key, and message body uses XML lattice Formula storage service data information is based on this, the detailed process of above-mentioned interface packets parsing are as follows: first after recipient takes message First decrypt heading, i.e., be decrypted using public key, if it is possible to by verifying be correct recipient, then analyze report again The XML content of style, and data are inserted into specified table structure by business datum mapping relations, complete data transmission simultaneously Return to mode field.
CN201610110464.7A 2016-02-29 2016-02-29 Method for realizing automatic synchronization of service data between heterogeneous systems Active CN105787057B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610110464.7A CN105787057B (en) 2016-02-29 2016-02-29 Method for realizing automatic synchronization of service data between heterogeneous systems

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610110464.7A CN105787057B (en) 2016-02-29 2016-02-29 Method for realizing automatic synchronization of service data between heterogeneous systems

Publications (2)

Publication Number Publication Date
CN105787057A CN105787057A (en) 2016-07-20
CN105787057B true CN105787057B (en) 2019-02-15

Family

ID=56402999

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610110464.7A Active CN105787057B (en) 2016-02-29 2016-02-29 Method for realizing automatic synchronization of service data between heterogeneous systems

Country Status (1)

Country Link
CN (1) CN105787057B (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106503091A (en) * 2016-10-12 2017-03-15 济南浪潮高新科技投资发展有限公司 A kind of implementation method of changeable data structure automatic synchronization coupling
CN109241044A (en) * 2018-08-23 2019-01-18 深圳智慧园区信息技术有限公司 A kind of method of data synchronization and device
CN109918433B (en) * 2019-01-31 2024-05-07 平安科技(深圳)有限公司 Message storage method and device based on universal data interface and computer equipment
CN110009950B (en) * 2019-03-26 2021-05-18 乐佰科(深圳)教育科技有限公司 Online cooperative coding code synchronization method and system
CN110245181A (en) * 2019-04-25 2019-09-17 深圳壹账通智能科技有限公司 Data synchronous synchronous method, device and computer storage medium
CN110209377B (en) * 2019-04-26 2024-06-25 平安科技(深圳)有限公司 Interface message processing method, device, equipment and storage medium based on factory class
CN111159311B (en) * 2019-12-19 2023-09-15 远光软件股份有限公司 Method, device, equipment and storage medium for integrating data mapping
CN111241192A (en) * 2019-12-31 2020-06-05 航天信息软件技术有限公司 Data synchronization method
CN111324649A (en) * 2020-02-13 2020-06-23 山东浪潮通软信息科技有限公司 Method for collecting internal transactions based on heterogeneous system
CN112434004A (en) * 2020-10-28 2021-03-02 金蝶云科技有限公司 Data migration method and device for heterogeneous system, computer equipment and storage medium
CN112434087B (en) * 2020-12-08 2024-05-28 中国人寿保险股份有限公司 Cross-system data comparison method, device, electronic equipment and storage medium
US20240169072A1 (en) * 2022-11-17 2024-05-23 Sap Se Native multi-tenant row table encryption

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102542007A (en) * 2011-12-13 2012-07-04 中国电子科技集团公司第十五研究所 Method and system for synchronization of relational databases
CN104598610A (en) * 2015-01-29 2015-05-06 无锡江南计算技术研究所 Step-by-step database data distribution uploading and synchronizing method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130145258A1 (en) * 2011-12-06 2013-06-06 Google Inc. Incremental Synchronization for Magazines

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102542007A (en) * 2011-12-13 2012-07-04 中国电子科技集团公司第十五研究所 Method and system for synchronization of relational databases
CN104598610A (en) * 2015-01-29 2015-05-06 无锡江南计算技术研究所 Step-by-step database data distribution uploading and synchronizing method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
分布式异构数据库同步技术研究与实现;张振友等;《电脑知识与技术》;20151224;第11卷(第28期);第16-19页 *
分布式异构数据库数据同步系统的实现与优化;申毅等;《桂林电子科技大学学报》;20140825;第34卷(第4期);正文第1章第1.1-1.6节 *

Also Published As

Publication number Publication date
CN105787057A (en) 2016-07-20

Similar Documents

Publication Publication Date Title
CN105787057B (en) Method for realizing automatic synchronization of service data between heterogeneous systems
US9525670B2 (en) Computer product, recording medium, communications apparatus, and communications method
CN105871873A (en) Security encryption authentication module for power distribution terminal communication and method thereof
CN110601931B (en) Batch configuration method and system of intelligent home system
CN102111265A (en) Method for encrypting embedded secure access module (ESAM) of power system acquisition terminal
CN113779607B (en) Industrial data asset management method, system and equipment
CN110035058B (en) Resource request method, device and storage medium
CN104063334A (en) Encryption method and system based on data attributions
CN105049877A (en) Encryption method and device for live and recorded broadcast interaction system
CN105516157A (en) Independent encryption based network information safe input system and method
CN109347625A (en) Crypto-operation, method, cryptographic service platform and the equipment for creating working key
CN109067814A (en) Media data encryption method, system, equipment and storage medium
CN110430039A (en) A kind of production management system and method based on block chain
CN106453246A (en) Equipment identity information distribution method, device and system
CN111079188A (en) mybatis field encryption and decryption device and encryption and decryption system
CN114244851B (en) Block chain-based data distribution method
CN110198320A (en) A kind of ciphered information transmission method
CN103532709A (en) IBE (Identity Based Encryption) cryptographic equipment and data encryption and decryption method
CN111739190B (en) Vehicle diagnostic file encryption method, device, equipment and storage medium
CN113256470A (en) Weapon equipment management system and method based on block chain
CN102970134B (en) Method and system for encapsulating PKCS#7 (public-key cryptography standard #7) data by algorithm of hardware password equipment
Feng et al. Transparent ciphertext retrieval system supporting integration of encrypted heterogeneous database in cloud-assisted IoT
CN112559252B (en) Configuration data management method and device based on attribute classification
CN112559250B (en) Configuration data backup method and device for electric power Internet of things
CN112929169B (en) Key negotiation method and system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant