CN112714182B - Cross-network data exchange technology and method based on distributed message architecture - Google Patents
Cross-network data exchange technology and method based on distributed message architecture Download PDFInfo
- Publication number
- CN112714182B CN112714182B CN202011579939.XA CN202011579939A CN112714182B CN 112714182 B CN112714182 B CN 112714182B CN 202011579939 A CN202011579939 A CN 202011579939A CN 112714182 B CN112714182 B CN 112714182B
- Authority
- CN
- China
- Prior art keywords
- data
- network
- data exchange
- cross
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 21
- 238000005516 engineering process Methods 0.000 title abstract description 14
- 230000005540 biological transmission Effects 0.000 claims abstract description 18
- 238000012545 processing Methods 0.000 claims abstract description 8
- 230000002457 bidirectional effect Effects 0.000 claims description 4
- 238000002955 isolation Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 claims description 4
- 230000006978 adaptation Effects 0.000 abstract description 3
- 230000006835 compression Effects 0.000 abstract description 3
- 238000007906 compression Methods 0.000 abstract description 3
- 230000006837 decompression Effects 0.000 abstract description 3
- 238000001914 filtration Methods 0.000 abstract description 3
- 230000006870 function Effects 0.000 abstract description 3
- 230000002776 aggregation Effects 0.000 abstract description 2
- 238000004220 aggregation Methods 0.000 abstract description 2
- 238000006243 chemical reaction Methods 0.000 abstract description 2
- 238000007689 inspection Methods 0.000 abstract description 2
- 230000007246 mechanism Effects 0.000 abstract description 2
- 230000004888 barrier function Effects 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/02—Network architectures or network communication protocols for network security for separating internal from external traffic, e.g. firewalls
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
- H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a cross-network data exchange technology and a method based on a distributed message architecture, which realize complete high-performance cross-domain data exchange link aggregation and multithreading parallel processing mechanism, provide channel resource sharing, have multiple functions of unified and convenient transmission exchange, service protocol and the like, support multiple parameter entering inspection, result format conversion, result filtration and unified service standard, fully improve channel utilization rate, ensure the stability of data exchange, ensure that data exchange operation can be executed in correct sequence, and respectively deploy a set of intelligent clients at the inner end and the outer end of different network areas to complete the work of protocol adaptation, information acquisition, information compression and information decompression, and realize the safety and controllability of data exchange.
Description
Technical Field
The invention relates to the technical field of cross-network data exchange, in particular to a cross-network data exchange technology and method based on a distributed message architecture.
Background
The cross-network data exchange needs to be exchanged to an opposite-end network by means of the file ferrying function of the unidirectional optical gate, the MQ real-time transmission technology is fused with modes such as DATAX, DOCKER, GEARMAN and the like through a Linux Kernel Kernel, and a built-in proprietary isolation exchange module is used for realizing intelligent content filtering, CRC checking and DDoS/DOS resistance and realizing scenes such as cross-network domain data acquisition, resource request, data exchange and sharing service.
In a low-speed network environment, the data exchange of large files takes a long time and the probability of network faults is high, if the faults are encountered, the file acquisition is unsuccessful, the file is lost in the data exchange process, and the integrity and the safety of the data cannot be ensured. Therefore, the present invention provides a cross-network data exchange technology and method based on a distributed message architecture, so as to solve the problems set forth in the above background art.
Disclosure of Invention
The invention aims to improve the data exchange efficiency, and aims to improve the performance of cross-network service exchange, further protect data and realize intelligent data acquisition.
In order to achieve the above purpose, the present invention provides the following technical solutions:
a cross-network data exchange technology and method based on distributed message architecture, the method is realized by using java programming language, the realization process is as follows:
the method comprises the steps that an operation host and an intelligent client are deployed on the reachable side of a network, and the intelligent client on the unreachable side only needs to install a medium once; the data acquisition party initiates an instruction to acquire related information data of all host devices or systems of the whole network, and executes the instruction after encryption, so that an intelligent client on the network side can receive the information data, and firstly, the information data is decrypted to obtain original information data; checking the information data by using a check code to ensure that the received data is sent by a data acquisition party;
secondly, acquiring the required data to a host machine, creating a text file in the host machine, copying a target data command to a data acquisition side container of an emitting end, and realizing data synchronization and processing by using DATAX; after the data acquisition party obtains feedback from the instruction, the data acquisition party decrypts and verifies the data and then carries out further processing;
and thirdly, after the acquisition is completed, the internal host machine is compressed into a medium through a GEARMAN safety isolation data channel to a network gate, so that closed-loop bidirectional ferry transmission is formed, and the data safety in the data transmission process is ensured.
As a further aspect of the invention, the instructions comprise sender network information data and a unique identifier, including an address.
As a still further aspect of the present invention, the medium is a transmissible medium.
Compared with the prior art, the invention has the beneficial effects that:
1. the method ensures that the data exchange operation can be executed in the correct sequence, and a set of intelligent clients are deployed at the inner end and the outer end of different network areas to complete the work of protocol adaptation, information acquisition, information compression and information decompression.
2. The method utilizes the cross-network security exchange technology to realize cross-department security exchange and sharing fusion of data, and breaks through the traditional technical barrier limit.
3. Aiming at the current invention, the breakpoint transmission is realized by utilizing the MQ technology, the reliability of information transmission under an unstable network state is ensured, the data transmission is realized on the premise of following the environmental safety requirement of government departments, the operation and maintenance monitoring efficiency of the whole network is improved, and the cross-network system or equipment can be monitored, alarmed and analyzed rapidly and effectively.
Detailed Description
The following description of the technical solutions in the embodiments of the present invention will be clear and complete, and it is obvious that the described embodiments are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In the embodiment of the invention, a cross-network data exchange technology and a method based on a distributed message architecture are realized by using a java programming language, and the realization process is as follows:
the method comprises the steps that an operation host and an intelligent client are deployed on the reachable side of a network, and the intelligent client on the unreachable side only needs to install a medium once; the data acquisition party initiates an instruction to acquire related information data of all host devices or systems of the whole network, the initiating instruction comprises a unique identifier such as an address and the like of the network information data of the sender, the instruction is executed after encryption, and an intelligent client on the network side can receive the information data and firstly decrypt the information data to obtain original information data; checking the information data by using a check code to ensure that the received data is sent by a data acquisition party;
secondly, acquiring the required data to a host machine, creating a text file in the host machine, copying a target data command to a data acquisition side container of an emitting end, and realizing data synchronization and processing by using DATAX; after the data acquisition party obtains feedback from the instruction, the data acquisition party decrypts and verifies the data and then carries out further processing;
and thirdly, after the acquisition is completed, the internal host machine is compressed into a medium through a GEARMAN safety isolation data channel to a network gate, and the medium is a medium capable of being transmitted to form closed-loop bidirectional ferry transmission, so that the data safety in the data transmission process is ensured.
The working principle of the invention is as follows:
breakpoint transmission is realized between points by MQ technology, data are synchronized by DATAX, data are managed in a DOCKER host machine in an original copying mode, a text file is created and then copied into a container, a data channel is safely isolated by GEARMAN, a bidirectional ferrying transmission closed loop is formed, and data safety in the data transmission process is ensured
The technology realizes complete high-performance cross-domain data exchange link aggregation and multithreading parallel processing mechanism, provides channel resource sharing, has multiple functions of unified and convenient transmission exchange, service protocol and the like, supports multiple parameter entering inspection, result format conversion, result filtration and unified service standard, fully improves channel utilization rate, ensures the stability of data exchange, ensures that data exchange operation can be executed in correct sequence, and deploys a set of intelligent clients at the inner end and the outer end of different network areas to complete the work of protocol adaptation, information acquisition, information compression and information decompression, and simultaneously realizes the safety and controllability of data exchange.
The method utilizes the cross-network security exchange technology to realize cross-department security exchange and sharing fusion of data, and breaks through the traditional technical barrier limit.
Aiming at the current invention, the breakpoint transmission is realized by utilizing the MQ technology, the reliability of information transmission under an unstable network state is ensured, the data transmission is realized on the premise of following the environmental safety requirement of government departments, the operation and maintenance monitoring efficiency of the whole network is improved, and the cross-network system or equipment can be monitored, alarmed and analyzed rapidly and effectively.
The foregoing is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art, who is within the scope of the present invention, should make equivalent substitutions or modifications according to the technical scheme of the present invention and the inventive concept thereof, and should be covered by the scope of the present invention.
Claims (3)
1. The cross-network data exchange method based on the distributed message architecture is characterized by being realized by using a java programming language, and comprises the following realization processes:
the method comprises the steps that an operation host and an intelligent client are deployed on the reachable side of a network, and the intelligent client on the unreachable side only needs to install a medium once; the data acquisition party initiates an instruction to acquire related information data of all host devices or systems of the whole network, and executes the instruction after encryption, so that an intelligent client on the network side can receive the information data, and firstly, the information data is decrypted to obtain original information data; checking the information data by using a check code to ensure that the received data is sent by a data acquisition party;
secondly, acquiring the required data to a host machine, creating a text file in the host machine, copying a target data command to a data acquisition side container of an emitting end, and realizing data synchronization and processing by using DATAX; after the data acquisition party obtains feedback from the instruction, the data acquisition party decrypts and verifies the data and then carries out further processing;
and thirdly, after the acquisition is completed, the internal host machine is compressed into a medium through a GEARMAN safety isolation data channel to a network gate, so that closed-loop bidirectional ferry transmission is formed, and the data safety in the data transmission process is ensured.
2. A method of cross-network data exchange based on a distributed messaging architecture according to claim 1 wherein the instructions comprise sender network information data and a unique identifier.
3. A method for cross-network data exchange based on a distributed message architecture as claimed in claim 1, wherein the medium is a transmissible medium.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011579939.XA CN112714182B (en) | 2020-12-28 | 2020-12-28 | Cross-network data exchange technology and method based on distributed message architecture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011579939.XA CN112714182B (en) | 2020-12-28 | 2020-12-28 | Cross-network data exchange technology and method based on distributed message architecture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112714182A CN112714182A (en) | 2021-04-27 |
| CN112714182B true CN112714182B (en) | 2024-02-23 |
Family
ID=75545798
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011579939.XA Active CN112714182B (en) | 2020-12-28 | 2020-12-28 | Cross-network data exchange technology and method based on distributed message architecture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112714182B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105049412A (en) * | 2015-06-02 | 2015-11-11 | 深圳市联软科技有限公司 | Secure data exchange method, device and equipment among different networks |
| CN105933140A (en) * | 2016-04-10 | 2016-09-07 | 广州金越软件技术有限公司 | Intelligent cross-network operation and maintenance monitoring technology |
| CN106453389A (en) * | 2016-11-11 | 2017-02-22 | 浙江中烟工业有限责任公司 | Network isolation method based on combination of firewall and gatekeeper |
| CN106789755A (en) * | 2016-11-30 | 2017-05-31 | 中国电子科技集团公司第五十四研究所 | Inter-network data interchange platform |
| CN107800713A (en) * | 2017-11-10 | 2018-03-13 | 北京明朝万达科技股份有限公司 | The secure exchange method and system of data between a kind of net |
| CN109922143A (en) * | 2019-02-26 | 2019-06-21 | 南威软件股份有限公司 | A kind of method and system of the exchange files based on gateway |
| CN110278181A (en) * | 2019-01-29 | 2019-09-24 | 广州金越软件技术有限公司 | A kind of instant protocol conversion technology about inter-network data exchange |
| CN110572288A (en) * | 2019-11-04 | 2019-12-13 | 河南戎磐网络科技有限公司 | Data exchange method based on trusted container |
| CA3063117A1 (en) * | 2018-11-21 | 2020-10-17 | Beijing Yutian Technology Co. Ltd | An emergency resource sharing and exchange system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108694092B (en) * | 2018-05-11 | 2021-01-15 | 华中科技大学 | Container communication method and system for parallel application |
-
2020
- 2020-12-28 CN CN202011579939.XA patent/CN112714182B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105049412A (en) * | 2015-06-02 | 2015-11-11 | 深圳市联软科技有限公司 | Secure data exchange method, device and equipment among different networks |
| CN105933140A (en) * | 2016-04-10 | 2016-09-07 | 广州金越软件技术有限公司 | Intelligent cross-network operation and maintenance monitoring technology |
| CN106453389A (en) * | 2016-11-11 | 2017-02-22 | 浙江中烟工业有限责任公司 | Network isolation method based on combination of firewall and gatekeeper |
| CN106789755A (en) * | 2016-11-30 | 2017-05-31 | 中国电子科技集团公司第五十四研究所 | Inter-network data interchange platform |
| CN107800713A (en) * | 2017-11-10 | 2018-03-13 | 北京明朝万达科技股份有限公司 | The secure exchange method and system of data between a kind of net |
| CA3063117A1 (en) * | 2018-11-21 | 2020-10-17 | Beijing Yutian Technology Co. Ltd | An emergency resource sharing and exchange system |
| CN110278181A (en) * | 2019-01-29 | 2019-09-24 | 广州金越软件技术有限公司 | A kind of instant protocol conversion technology about inter-network data exchange |
| CN109922143A (en) * | 2019-02-26 | 2019-06-21 | 南威软件股份有限公司 | A kind of method and system of the exchange files based on gateway |
| CN110572288A (en) * | 2019-11-04 | 2019-12-13 | 河南戎磐网络科技有限公司 | Data exchange method based on trusted container |
Non-Patent Citations (1)
| Title |
|---|
| 分布式数据交换平台在电子政务中设计与实现;薛辉;《湖南师范大学自然科学学报》;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112714182A (en) | 2021-04-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12010251B2 (en) | Electric border gateway device and method for chaining and storage of sensing data based on the same | |
| CN111711615B (en) | Knowledge base information synchronization system and method for edge security computing node | |
| CN101754221B (en) | Data transmission method between heterogeneous systems and data transmission system | |
| CN105245329B (en) | A kind of credible industrial control network implementation method based on quantum communications | |
| CN107360154B (en) | Intranet secure access method and system | |
| CN108200020A (en) | A kind of industry big data safe transmission device and method | |
| CN114629678B (en) | TLS-based intranet penetration method and device | |
| CN108540507B (en) | Tracing method applied to block chain-based digital command control information transmission and tracing system | |
| CN105551220A (en) | Remote data acquisition method for dry dust removal of converter gas | |
| CN112714182B (en) | Cross-network data exchange technology and method based on distributed message architecture | |
| CN113612757A (en) | Method and system for safely accessing industrial Internet of things terminal to network | |
| Wanying et al. | The study of security issues for the industrial control systems communication protocols | |
| CN203870785U (en) | Disaster detection data communication system based on Internet of Things | |
| CN101052034A (en) | Method and system for transmitting network event journal protocol message | |
| CN111885203A (en) | Method for remote management based on CMSP | |
| CN107819597B (en) | Network data transmission method and front-end processor | |
| CN112118303A (en) | Edge computing Internet of things middleware for multiple communication protocols | |
| CN105933140A (en) | Intelligent cross-network operation and maintenance monitoring technology | |
| JP3813147B2 (en) | MMS-based system and method for monitoring traffic violations | |
| CN103916359A (en) | Method and device for preventing attacks from ARP middleman in network | |
| CN113852544B (en) | Security gateway based on LoraWan and blockchain | |
| CN109672569A (en) | A kind of research of industry control safety monitoring system and application based on protocol depth analysis | |
| KR101082850B1 (en) | Active Sync-based Mobile Device for data Synchronizing and Method at the same | |
| CN113285937A (en) | Safety audit method and system based on traditional substation configuration file and IEC103 protocol flow | |
| CN106301574B (en) | A kind of CAN industrial optical fiber encryption converter and its FPGA Encryption Algorithm implementation method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |