CN202068449U - Data exchange platform used for multistage data exchange - Google Patents
Data exchange platform used for multistage data exchange Download PDFInfo
- Publication number
- CN202068449U CN202068449U CN2011201629794U CN201120162979U CN202068449U CN 202068449 U CN202068449 U CN 202068449U CN 2011201629794 U CN2011201629794 U CN 2011201629794U CN 201120162979 U CN201120162979 U CN 201120162979U CN 202068449 U CN202068449 U CN 202068449U
- Authority
- CN
- China
- Prior art keywords
- data
- server
- data exchange
- exchange platform
- etl
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The utility model discloses a data exchange platform used for multistage data exchange. Each stage of the data exchange platform comprises a data exchange service bus server, a data acquisition task scheduling server, an exchanger, an ETL (Extraction-Transformation-Loading) server, an ODS (Operational Data Store) server, and a data warehouse server, wherein the data exchange service bus server, the data acquisition task scheduling server, the ETL server, the ODS server and the data warehouse server are respectively connected with the exchanger, and the ETL server of a higher stage data exchange platform is connected with the data warehouse server of a lower stage data exchange platform via network. The data exchange platform realizes data exchanges of different structures and formats among systems via the unified data exchange platform, realizes the generalization of the data exchange platform, and overcomes the disadvantage that in the prior art, an information system-to-information system connection channel is needed to be constructed according to specific demands.
Description
Technical field
The utility model relates to field of computer technology, particularly is used for the data interchange platform of multi-stage data exchange.
Background technology
Along with the application that deepens continuously of enterprise information system, often need to realize collaborative work, the more particularly report data that need gather by the exchange of data, need perhaps upload to higher level department from a systems exchange to the another one system from department of subordinate.If information system is not considered the exchanges data problem at first stage of construction, when developing, just need handle in the later stage the data exchange.
The available data switching technology mainly is the data exchange ways of employing system to system, promptly make up information system to the interface channel between the information system according to particular demands, this technological means need be researched and developed data exchange system separately to each exchanges data demand, when the exchanges data demand more for a long time, the workload of deployment, change and service data switching system is quite big.Prior art is not considered the demand of multi-stage data exchange in addition, realizes that multi-stage data reports and inefficiency when gathering.
The utility model content
In order to overcome the deficiencies in the prior art, the purpose of this utility model provides the data interchange platform that is used for the multi-stage data exchange, solve the data transmission problems between the heterogeneous system, realize the generalization of data interchange platform, and the Technical Architecture of each rank data interchange platform is unified when realizing the multi-stage data exchange.
The purpose of this utility model is achieved through the following technical solutions: be used for the data interchange platform of multi-stage data exchange, every grade of data switching plane comprises data warehouse server, ODS (operating data storage) server, ETL (extracting conversion loads) server, switch, data exchange service bus server and data acquisition task scheduling server; Described data warehouse server, ODS server, ETL server, data exchange service bus server, data acquisition task scheduling server link to each other with switch respectively; The ETL server of higher level's data interchange platform is connected with the data warehouse server of subordinate data interchange platform by network.
Described ODS server and data warehouse server adopt a station server to realize.
The data interchange platform that is used for the multi-stage data exchange of the present utility model links to each other with request end computer, operation system, Database Systems by network in application, and its course of work is as follows:
(1) exchanges data party in request is by request end computer called Web service.
(2) data acquisition task scheduling server specifically comprises according to the content arrangement exchanges data work of Web service:
Transfer the ETL server and from corresponding business system or database, extract desired data, and to data clean, processing such as conversion and verification, after finishing data are sent to the ODS server;
On the ODS server, the data of separate sources are integrated and gathered, after finishing data are sent in the data warehouse server and preserve.
(3) carry out multi-stage data exchange: higher level's data interchange platform extracts the data in the data warehouse server of subordinate's data interchange platform by the ELT server, and finishes by the ODS server and to store in the data warehouse server of higher level's data interchange platform after data are integrated.
The utility model has the following advantages and effect with respect to prior art:
1, the utility model is by unified data interchange platform, realize the exchanges data of different structure and form between each system, realize the generalization of data interchange platform, having overcome prior art need make up the shortcoming of information system to the interface channel between the information system according to particular demands.
2, the utility model is supported the multi-stage data exchange, has improved the efficient that multi-stage data reports and gathers.
Description of drawings
Fig. 1 is the structural representation of a kind of execution mode of the present utility model.
Fig. 2 is the schematic diagram of data interchange platform in application among Fig. 1.
Schematic diagram when Fig. 3 is applied to three grades of data exchanges for the data interchange platform among Fig. 1.
Fig. 4 is the structural representation of another kind of execution mode of the present utility model.
Embodiment
Below in conjunction with embodiment and accompanying drawing, the utility model is described in further detail, but execution mode of the present utility model is not limited thereto.
Embodiment 1
As shown in Figure 1, the data interchange platform that is used for the multi-stage data exchange of the present utility model, every grade of data switching plane comprises data warehouse server 1, ODS server 2, ETL server 3, switch 4, data exchange service bus server 5 and data acquisition task scheduling server 6; Described data warehouse server 1, ODS server 2, ETL server 3, data exchange service bus server 5, data acquisition task scheduling server 6 link to each other with switch 4 respectively; The ETL server 3 of higher level's data interchange platform is connected with the data warehouse server 1 of subordinate data interchange platform by network.
Fig. 2 is used for the schematic diagram of the data interchange platform of multi-stage data exchange in application, as shown in the figure, the data interchange platform that is used for the multi-stage data exchange is linked to each other with request end computer 9 by network by data exchange service bus server 5, is linked to each other with each operation system 7, Database Systems 8 by network by ETL server 3.
The data interchange platform of multi-stage data exchange that is used for of the present utility model is when work, all data exchange request are all passed through 5 issues of data exchange service bus server, exchanges data party in request at first issues the Web service that comprises the exchanges data demand information by request end computer 9 on data exchange service bus server 5, this Web service promptly can be all has the exchanges data party in request of similar demand that data exchange service is provided.The concrete course of work is as follows:
(1) exchanges data party in request is by request end computer 9 called Web service.
(2) data acquisition task scheduling server 6 specifically comprises according to the content arrangement exchanges data work of Web service:
Transfer ETL server 3 and from corresponding business system 7 or database 8, extract desired data, and to data clean, processing such as conversion and verification, after finishing data are sent to ODS server 2;
On ODS server 2, the data of separate sources are integrated and gathered, after finishing data are sent in the data warehouse server 1 and preserve.
(3) carry out multi-stage data exchange: Fig. 3 and be the application schematic diagram of data interchange platform of the present utility model when being used for three grades of data exchanges, as shown in the figure, the ETL server 3 of higher level's data interchange platform links to each other with the data warehouse server 1 of subordinate data interchange platform by network.When carrying out the multi-stage data exchange, higher level's data interchange platform extracts the data in the data warehouse server 1 of subordinate's data interchange platforms by ELT server 3, and finishes by ODS server 2 and to store in the data warehouse server 1 of higher level's data interchange platform after data are integrated.
Embodiment 2
As shown in Figure 4, the data interchange platform of present embodiment adopts a station server (being ODS and data warehouse server 10) realizes except that data warehouse server and ODS server, the annexation of all the other parts and part is identical with embodiment 1, its course of work is also identical, does not repeat them here.
The foregoing description is the utility model preferred implementation; but execution mode of the present utility model is not limited by the examples; other any do not deviate from change, the modification done under spirit of the present utility model and the principle, substitutes, combination, simplify; all should be the substitute mode of equivalence, be included within the protection range of the present utility model.
Claims (2)
1. the data interchange platform that is used for the multi-stage data exchange, it is characterized in that every grade of data switching plane comprises data warehouse server (1), ODS server (2), ETL server (3), switch (4), data exchange service bus server (5) and data acquisition task scheduling server (6); Described data warehouse server (1), ODS server (2), ETL server (3), data exchange service bus server (5), data acquisition task scheduling server (6) link to each other with switch (4) respectively; The ETL server (3) of higher level's data interchange platform is connected with the data warehouse server (1) of subordinate's data interchange platform by network.
2. the data interchange platform that is used for the multi-stage data exchange according to claim 1 is characterized in that, described ODS server and data warehouse server adopt a station server to realize.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011201629794U CN202068449U (en) | 2011-05-20 | 2011-05-20 | Data exchange platform used for multistage data exchange |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011201629794U CN202068449U (en) | 2011-05-20 | 2011-05-20 | Data exchange platform used for multistage data exchange |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN202068449U true CN202068449U (en) | 2011-12-07 |
Family
ID=45062298
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011201629794U Expired - Fee Related CN202068449U (en) | 2011-05-20 | 2011-05-20 | Data exchange platform used for multistage data exchange |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN202068449U (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105447176A (en) * | 2015-12-09 | 2016-03-30 | 冶金自动化研究设计院 | Enterprise heterogeneous data exchange platform |
| CN105740069A (en) * | 2016-01-29 | 2016-07-06 | 中国电力科学研究院 | Automatic scheduling method for multistage data transformation tasks |
| CN107608985A (en) * | 2016-07-12 | 2018-01-19 | 深圳市远行科技股份有限公司 | Big data service integration method, apparatus and system |
| CN108234608A (en) * | 2017-12-20 | 2018-06-29 | 国家电网公司 | A kind of method of data synchronization between power grid ERP system and third party system |
| CN109246243A (en) * | 2018-10-29 | 2019-01-18 | 杭州数梦工场科技有限公司 | resource transmission method and device |
| CN110008042A (en) * | 2019-03-28 | 2019-07-12 | 北京易华录信息技术股份有限公司 | A kind of algorithm Cascading Methods and system based on container |
-
2011
- 2011-05-20 CN CN2011201629794U patent/CN202068449U/en not_active Expired - Fee Related
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105447176A (en) * | 2015-12-09 | 2016-03-30 | 冶金自动化研究设计院 | Enterprise heterogeneous data exchange platform |
| CN105740069A (en) * | 2016-01-29 | 2016-07-06 | 中国电力科学研究院 | Automatic scheduling method for multistage data transformation tasks |
| CN107608985A (en) * | 2016-07-12 | 2018-01-19 | 深圳市远行科技股份有限公司 | Big data service integration method, apparatus and system |
| CN108234608A (en) * | 2017-12-20 | 2018-06-29 | 国家电网公司 | A kind of method of data synchronization between power grid ERP system and third party system |
| CN109246243A (en) * | 2018-10-29 | 2019-01-18 | 杭州数梦工场科技有限公司 | resource transmission method and device |
| CN109246243B (en) * | 2018-10-29 | 2021-07-30 | 杭州数梦工场科技有限公司 | Resource transmission method and device |
| CN110008042A (en) * | 2019-03-28 | 2019-07-12 | 北京易华录信息技术股份有限公司 | A kind of algorithm Cascading Methods and system based on container |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN202068449U (en) | Data exchange platform used for multistage data exchange | |
| CN103237045B (en) | Parallel processing system and parallel processing method for large-scale real-time traffic data | |
| CN110032592B (en) | Energy big data integration system and method | |
| TW200703024A (en) | Peer data transfer orchestration | |
| CN102394903B (en) | A kind of active reconstruction calculating system constructing system | |
| GB0614193D0 (en) | Aggregated management system | |
| CN101388997A (en) | Method and system for establishing video conference | |
| CN102333120B (en) | Flow storage system for load balance processing | |
| CN103049527A (en) | Large power grid oriented parallel real-time database master and slave switching management system | |
| CN101764746A (en) | Method and device for sending data | |
| CN102427470A (en) | Architecture method of cloud monitoring center | |
| CN101834765A (en) | System and method for remote file transfer | |
| CN102946443B (en) | Multitask scheduling method for realizing large-scale data transmission | |
| CN102801750A (en) | Method for constructing cloud computing target system | |
| CN103729455B (en) | Master data storage method based on primary copy storage pattern | |
| CN202364244U (en) | Processing device of distributed log analysis system | |
| CN111753004A (en) | Information interaction, butt joint and sharing system for multi-energy underground pipe network system | |
| CN110674221A (en) | Spatial data synchronization method, terminal and computer readable storage medium | |
| CN202495968U (en) | Enterprise integration information platform | |
| CN201260187Y (en) | Network topology structure for distributed dynamic load balance | |
| CN207491138U (en) | A kind of user data acquisition module based on Intelligent set top box | |
| CN105303467A (en) | Method keeping data consistency of electric power marketing and power distribution and system thereof | |
| CN104317569A (en) | Method for rapid service aggregation based on application interconnection | |
| CN205281505U (en) | Data centralized management system | |
| Liu et al. | Research based on real time monitoring system of digitized agricultural water supply |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20111207 Termination date: 20120520 |