CN206164759U - Network multisource heterogeneous data collection system strides - Google Patents
Network multisource heterogeneous data collection system strides Download PDFInfo
- Publication number
- CN206164759U CN206164759U CN201621241564.5U CN201621241564U CN206164759U CN 206164759 U CN206164759 U CN 206164759U CN 201621241564 U CN201621241564 U CN 201621241564U CN 206164759 U CN206164759 U CN 206164759U
- Authority
- CN
- China
- Prior art keywords
- data
- network
- intranet
- data acquisition
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The utility model discloses a network multisource heterogeneous data collection system strides, include: a plurality of network interface, with the single -pole double -throw of network interface one -to -one, intranet data acquisition processing module, outer net data acquisition processing module, network separate discrete data integration module, data storage module, network interface passes through two motionless ends of single -pole double -throw are connected to respectively intranet data acquisition processing module and outer net data acquisition processing module, intranet data acquisition processing module and outer net data acquisition processing module pass through respectively the network is kept apart and data exchange module is connected to data storage module, the problem of heterogeneous data mutual and storage between physics isolation network has been solved to this device, has improved the data interaction performance on guaranteeing intranet security infrastructure, the expansibility can be high, realized that network interface corresponds the free ratio of outer net or intranet.
Description
Technical field
The utility model is related to Data Interchange Technology field, is a kind of multi-source heterogeneous data acquisition of across a network specifically
Device.
Background technology
At present many large-enterprise networks are divided into physically-isolated internal, external network, and Intranet is used for enterprises production and operation pipe
Reason, outer net is used to provide Internet service, and business application system data are deployed in respectively as needed the number on internal, external network network
According in storehouse.As the Internet, applications develop, the service application for being deployed in outer net is more and more, and enterprise operation and management decision-making is generally needed
The data for gathering internal, external network different business systems are associated analysis, comprehensive assessment.Due to inside and outside network physical isolation,
Typically data exchange is carried out using storage mediums such as USB flash disks between internal, external network, have that data form is limited, a data exchange between intranet and extranet
The problems such as poor real.The network interface of common data harvester is respectively equipped with inner-mesh network interface and outer net network interface,
Its quantitative proportion has just been fixed after device is completed, when the business application system quantity of Intranet or outer net becomes many, network
Interface quantity is not enough.
Utility model content
The technical problems to be solved in the utility model is to provide a kind of multi-source heterogeneous data acquisition unit of across a network, solves
Transmission data form is limited, between intranet and extranet the problems such as data exchange poor real；Can according to the actual requirements flexible proportioning Intranet and
The network interface of outer net.
In order to solve above-mentioned technical problem, the utility model provides a kind of multi-source heterogeneous data acquisition unit of across a network,
Including：Multiple network interfaces and the one-to-one single-pole double-throw switch (SPDT) of the network interface, for gathering intranet data and carry out
The intranet data acquisition processing module of process, for gather outer network data and processed outer net digital sampling and processing,
For Network Isolation that outer net data are one-way transmitted to Intranet and are merged data and Data Integration module, for storing
The data memory module of the data after merging,
Wherein, the network interface by two of the single-pole double-throw switch (SPDT) not moved end be respectively connecting to the interior netting index
According to acquisition processing module and outer net digital sampling and processing；
The intranet data acquisition processing module and outer net digital sampling and processing respectively by the Network Isolation and
Data exchange module is connected to the data memory module.
Further, the intranet data acquisition processing module, including for gather intranet data intranet data gather
Unit and the intranet data processing unit for the intranet data for being collected to be carried out format specification process.
Further, the outer net digital sampling and processing, including for gathering the outer net data acquisition of outer network data
Unit and the outer net data processing unit for the outer network data for being collected to be carried out format specification process.
Further, the Network Isolation and Data Integration module include Network Isolation unit and data integral unit,
The Network Isolation unit, for outer network data to be one-way transmitted into Intranet according to private communication protocol；
The Data Integration unit, for integrating and sending to the data storage mould outer network data and intranet data
Block.
Further, also including mainboard, the Network Isolation and data combiners block, data memory module pass through the master
On-board circuitry connects, and the outer net digital sampling and processing and intranet data acquisition processing module are by slot and the mainboard
Connection.
Further, the mainboard is additionally provided with multiple reserved slots.
Further, also including storage end interface, the storage end interface is connected with the data memory module.
Further, the storage end interface is RJ-45 interfaces.
Further, the network interface is RJ-45 interfaces.
Further, four RJ-45 interfaces are provided with.
The multi-source heterogeneous data acquisition unit of across a network of the present utility model, has the advantages that：
1st, this device integrates data acquisition, intranet and extranet data transfer, data processing, can effectively reduce system deployment
Workload, shortens equipment design, installs and debugging cycle；
2nd, this device is integrated with physical isolation network data one-way transmission module, solves isomeric data in physical isolation net
The problem of interaction between network, on the basis of intranet security is ensured data interaction performance is improve；
3rd, this device digital sampling and processing adopts slot pattern, and scalability is high；
4th, the network interface of this device can free switching to digital sampling and processing or digital sampling and processing, realize
The flexible proportioning of network interface of Intranet or outer net.
Description of the drawings
Fig. 1 is the structural representation of the embodiment of multi-source heterogeneous data acquisition unit one of the across a network of utility model；
Fig. 2 is the intranet data acquisition processing module structural representation of utility model；
Fig. 3 is the outer net digital sampling and processing structural representation of utility model；
Fig. 4 is the Network Isolation of utility model and Data Integration modular structure schematic diagram.
In figure, 1 network interface, 2 single-pole double-throw switch (SPDT)s, 3 intranet data acquisition processing modules, 31 intranet datas collection is single
Unit, 32 intranet data processing units, 4 outer net digital sampling and processings, 41 outer net data acquisition units, 42 outer network datas
Processing unit, 5 Network Isolations and Data Integration module, 51 Data Integration units, 52 Network Isolation units, 6 data storages
Module, 7 storage end interfaces.
Specific embodiment
Below in conjunction with the accompanying drawings the utility model is described in further detail with specific embodiment, so that those skilled in the art
The utility model may be better understood and can be practiced, but illustrated embodiment is not as to restriction of the present utility model.
Embodiment one：
As shown in Figure 1, Figure 2, Fig. 3, a kind of shown, the multi-source heterogeneous data acquisition unit of across a network, including：Multiple network interfaces 1,
Adopt with the one-to-one single-pole double-throw switch (SPDT) 2 of the network interface 1, the intranet data for gathering intranet data and processed
Collection processing module 3, for gather outer network data and processed outer net digital sampling and processing 4, for by outer network data
The Network Isolation for being one-way transmitted to Intranet and merging data and Data Integration module 5, merge for storage after data
Data memory module 6,
Wherein, the network interface 1 by two of the single-pole double-throw switch (SPDT) 2 not moved end be respectively connecting to the Intranet
Digital sampling and processing 3 and outer net digital sampling and processing 4；
The intranet data acquisition processing module 3 and outer net digital sampling and processing 4 are respectively by the Network Isolation
The data memory module 6 is connected to data exchange module 5.
The intranet data acquisition processing module 3, including for gathering the He of intranet data collecting unit 31 of intranet data
For the intranet data for being collected to be carried out the intranet data processing unit 32 of format specification process.
The outer net digital sampling and processing 4, including for gathering the He of outer net data acquisition unit 41 of outer network data
For the outer network data for being collected to be carried out the outer net data processing unit 42 of format specification process.
The intranet data collecting unit 31 is connected by the single-pole double-throw switch (SPDT) 2, network interface 1 with Intranet equipment,
First Data Concurrent of collection Intranet equipment delivers to the intranet data processing unit 32, the intranet data processing unit 32,
First data markers, cleaning, format specification are converted into the 3rd data, and by the 3rd data is activation to network every
Discrete data integrates module 5；
The outer net data acquisition unit 41 is connected by the single-pole double-throw switch (SPDT) 2, network interface 1 with outer net equipment,
Second Data Concurrent of collection outer net equipment delivers to the outer net data processing unit 42, the outer net data processing unit 42,
Second data markers, cleaning, format specification are converted into the 4th data, and by the 4th data is activation to network every
Discrete data integrates module 5；
The Network Isolation and Data Integration module 5 include Network Isolation unit 52 and data integral unit 51,
The Network Isolation unit 52, it is whole for the 4th data to be one-way transmitted into data according to private communication protocol
Close unit 51；
The Data Integration unit 51, for by the 4th data and the 3rd Data Integration be the 5th and send to
The data memory module 6.
Intranet data collecting unit 31, outer net data acquisition unit 41 by configuring corresponding strategies, define related interface,
Cycle, the parameters such as frequency and object are called, automatically from extracted data in Intranet equipment and outer net equipment, data collection strategy can be with
It is defined respectively according to different operation systems, application scenarios and demand；The data source come up of collection is various, quantity is huge
Greatly, configurations, attribute are various, need to carry out the pretreatment works such as data markers, cleaning, format specificationization conversion.Data mark
Note and cleaning operation system, type, structure, size mainly according to belonging to data etc., stamps the mark of unified standard, for marking
Know the attributes such as source, the species of data.Meanwhile, with reference to data rule base, according to the mark of data, will corresponding rule and data
It is packaged, encapsulates the data that complete recognizable, controllable and with corresponding cleaning rule.Data format specificationsization conversion is main
By operations such as data generaliza-tion, standardization, data attribute constructions, the precision and performance of data mining or data Mining stream are improved.
Data generaliza-tion uses Concept Hierarchies, and with high-level concept low level " original " data are replaced, and the initial data in database is general
On chemical conversion user concept hierarchy interested, polymerization, the metadata with statistical significance, provide well for online classification
Data environment.Extensive main policies are included in extensive in minimal decomposition unit, attribute removal, conceptional tree is soaring, increase category
Property etc., related generalization algorithm has generalization algorithm and the generalization algorithm based on data cube of attribute-oriented generalization etc..
Internal, external network data after treatment, form the data of standardization the 3rd and the 4th data of consolidation form.Network Isolation
Unit 52 adopts private communication protocol between internal, external network, only allow Data Integration unit 51 and outer net data processing unit 42 it
Between data one-way transmission.After outer net data processing unit 42 completes to process, to Data Integration unit 51 data transfer is sent
Request message, after Data Integration unit 51 is verified to request message, according to predefined data transmission rule from outer netting index
Data are extracted according to processing unit 42, after data validity and security verification, by Data Integration is for the 5th data and deposits
In storing up data memory module 6.It is fixed that data transfer rule can be carried out according to different operation systems, application scenarios and demand
Justice.
The data memory module 6, for storing the 5th data.
The 5th data being stored in data memory module 6 can be by storing end interface 7, there is provided makes to external equipment
With the storage end interface is RJ-45 interfaces.
The multi-source heterogeneous data acquisition unit of the across a network also includes mainboard, the Network Isolation and data combiners block 5,
Data memory module 6 is connected by the main on-board circuitry, at the intranet data acquisition processing module 3 and outer net data acquisition
Reason module 4 is connected by slot with the mainboard.
The mainboard is additionally provided with multiple reserved slots, can be used to extend the intranet data acquisition processing module 3 and outer
The quantity of network data acquisition processing module 4.
In the present embodiment, four network interfaces 1 are provided with, the network interface is RJ-45 interfaces, the network interface 1
Varying number can also be arranged as required to.
During the multi-source heterogeneous data acquisition unit use of the across a network, switching single-pole double-throw switch (SPDT) 6 can be passed through
Network interface 1 is accessed intranet data acquisition processing module 3 or outer net digital sampling and processing 4 by different conditions, selection, i.e., in fact
In the case that existing network network interface quantity is fixed, the ratio of the network interface 1 of unrestricted choice connection outer net equipment and Intranet equipment.
Embodiment described above is only the preferred embodiment lifted to absolutely prove the utility model, the utility model
Protection domain not limited to this.Equivalent substitute or change that those skilled in the art are made on the basis of the utility model
Change, within protection domain of the present utility model.Protection domain of the present utility model is defined by claims.
Claims (10)
1. the multi-source heterogeneous data acquisition unit of a kind of across a network, it is characterised in that include：Multiple network interfaces and the network
The one-to-one single-pole double-throw switch (SPDT) of interface, for gather intranet data and processed intranet data acquisition processing module,
For gather outer network data and processed outer net digital sampling and processing, for outer net data to be one-way transmitted into Intranet
And the Network Isolation that merges data and Data Integration module, merge for storage after data data memory module,
Wherein, the network interface by two of the single-pole double-throw switch (SPDT) not moved end be respectively connecting to the intranet data and adopt
Collection processing module and outer net digital sampling and processing；
The intranet data acquisition processing module and outer net digital sampling and processing are respectively by the Network Isolation and data
Switching Module is connected to the data memory module.
2. the multi-source heterogeneous data acquisition unit of across a network as claimed in claim 1, it is characterised in that the intranet data collection
Processing module, including for gathering the intranet data collecting unit of intranet data and for the intranet data for being collected to be carried out
The intranet data processing unit of format specificationization process.
3. the multi-source heterogeneous data acquisition unit of across a network as claimed in claim 1, it is characterised in that the outer net data acquisition
Processing module, including for gathering the outer net data acquisition unit of outer network data and for the outer network data for being collected to be carried out
The outer net data processing unit of format specificationization process.
4. the multi-source heterogeneous data acquisition unit of across a network as claimed in claim 1, it is characterised in that the Network Isolation sum
Include Network Isolation unit and data integral unit according to module is integrated,
The Network Isolation unit, for outer network data to be one-way transmitted into Intranet according to private communication protocol；
The Data Integration unit, for integrating and sending to the data memory module outer network data and intranet data.
5. the multi-source heterogeneous data acquisition unit of across a network as described in Claims 1-4 is arbitrary, it is characterised in that also including master
Plate, the Network Isolation and data combiners block, data memory module are connected by the main on-board circuitry, the outer network data
Acquisition processing module and intranet data acquisition processing module are connected by slot with the mainboard.
6. the multi-source heterogeneous data acquisition unit of across a network as claimed in claim 5, it is characterised in that the mainboard is additionally provided with
Multiple reserved slots.
7. the multi-source heterogeneous data acquisition unit of across a network as described in Claims 1-4 is arbitrary, it is characterised in that also including depositing
Storage end interface, the storage end interface is connected with the data memory module.
8. the multi-source heterogeneous data acquisition unit of across a network as claimed in claim 7, it is characterised in that the storage end interface is
RJ-45 interfaces.
9. the multi-source heterogeneous data acquisition unit of across a network as described in Claims 1-4 is arbitrary, it is characterised in that the network
Interface is RJ-45 interfaces.
10. the multi-source heterogeneous data acquisition unit of across a network as claimed in claim 9, it is characterised in that be provided with four RJ-45
Interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201621241564.5U CN206164759U (en) | 2016-11-18 | 2016-11-18 | Network multisource heterogeneous data collection system strides |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201621241564.5U CN206164759U (en) | 2016-11-18 | 2016-11-18 | Network multisource heterogeneous data collection system strides |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN206164759U true CN206164759U (en) | 2017-05-10 |
Family
ID=58660492
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201621241564.5U Active CN206164759U (en) | 2016-11-18 | 2016-11-18 | Network multisource heterogeneous data collection system strides |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN206164759U (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107295087A (en) * | 2017-06-29 | 2017-10-24 | 人民法院信息技术服务中心 | It is a kind of realize net system between data aggregate system and method |
| CN110958283A (en) * | 2018-09-27 | 2020-04-03 | 沈阳铝镁设计研究院有限公司 | System and method for acquiring production operation data of electrolytic cells in multi-electrolytic aluminum plant |
| CN111597196A (en) * | 2020-05-09 | 2020-08-28 | 北京百度网讯科技有限公司 | Data processing method and device and electronic equipment |
-
2016
- 2016-11-18 CN CN201621241564.5U patent/CN206164759U/en active Active
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107295087A (en) * | 2017-06-29 | 2017-10-24 | 人民法院信息技术服务中心 | It is a kind of realize net system between data aggregate system and method |
| CN107295087B (en) * | 2017-06-29 | 2020-06-02 | 人民法院信息技术服务中心 | System and method for realizing data aggregation between network systems |
| CN110958283A (en) * | 2018-09-27 | 2020-04-03 | 沈阳铝镁设计研究院有限公司 | System and method for acquiring production operation data of electrolytic cells in multi-electrolytic aluminum plant |
| CN111597196A (en) * | 2020-05-09 | 2020-08-28 | 北京百度网讯科技有限公司 | Data processing method and device and electronic equipment |
| CN111597196B (en) * | 2020-05-09 | 2024-02-13 | 北京百度网讯科技有限公司 | Data processing method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105005274B (en) | Big data in management process control system | |
| CN206164759U (en) | Network multisource heterogeneous data collection system strides | |
| CN105069703B (en) | A kind of electrical network mass data management method | |
| CN103902537B (en) | Multi-service log data storage processing and inquiring system and method thereof | |
| CN107066499A (en) | The data query method of multi-source data management and visualization system is stored towards isomery | |
| CN107071006A (en) | A kind of acquisition system and acquisition method towards navigation channel big data | |
| CN104573184B (en) | Bullet train product meta-model construction method and device | |
| CN102902669A (en) | Distribution information capturing method based on internet system | |
| CN102083116B (en) | Method for constructing intelligent communication alarm fault positioning expert system based on meta-knowledge | |
| CN112698953A (en) | Power grid intelligent operation and detection platform based on micro-service | |
| CN107247799A (en) | Data processing method, system and its modeling method of compatible a variety of big data storages | |
| CN104834700A (en) | Method for capturing movement data increment based on track change | |
| CN107124325A (en) | A kind of power communication network operation safety evaluation method and system | |
| CN103886508A (en) | Mass farmland data monitoring method and system | |
| CN114153920A (en) | Big data edge platform and method | |
| CN106375480A (en) | Electric energy data real-time acquisition system and method based on distributed system | |
| CN114218218A (en) | Data processing method, device and equipment based on data warehouse and storage medium | |
| CN107895046A (en) | A kind of Heterogeneous Database Integration Platform | |
| CN109618250B (en) | Optical fiber network node management method and system | |
| CN107633025A (en) | Big data business processing system and method | |
| CN104778528A (en) | Method and system for obtaining smart city evaluation indexes by utilizing big data | |
| CN104820700B (en) | The processing method of substation's unstructured data | |
| CN105337764B (en) | A kind of equipment resource information acquisition method | |
| CN101815012B (en) | Method and device for acquiring performance data | |
| CN104899249B (en) | Reliable index upgrade system and method under a kind of mass data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |