CN101714946A - Data interchange intermediate system - Google Patents
Data interchange intermediate system Download PDFInfo
- Publication number
- CN101714946A CN101714946A CN200910230385A CN200910230385A CN101714946A CN 101714946 A CN101714946 A CN 101714946A CN 200910230385 A CN200910230385 A CN 200910230385A CN 200910230385 A CN200910230385 A CN 200910230385A CN 101714946 A CN101714946 A CN 101714946A
- Authority
- CN
- China
- Prior art keywords
- data
- application system
- queue
- subscription
- processing engine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013497 data interchange Methods 0.000 title abstract 4
- 238000007726 management method Methods 0.000 claims description 13
- 238000000034 method Methods 0.000 claims description 13
- 230000008569 process Effects 0.000 claims description 6
- 230000015572 biosynthetic process Effects 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 4
- 238000010606 normalization Methods 0.000 claims description 3
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 230000008878 coupling Effects 0.000 claims description 2
- 238000010168 coupling process Methods 0.000 claims description 2
- 238000005859 coupling reaction Methods 0.000 claims description 2
- 238000013523 data management Methods 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 abstract description 4
- 238000013480 data collection Methods 0.000 abstract 1
- 230000002452 interceptive effect Effects 0.000 abstract 1
- 230000006870 function Effects 0.000 description 5
- 101100078001 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) MSC2 gene Proteins 0.000 description 4
- 101150117600 msc1 gene Proteins 0.000 description 4
- 238000003860 storage Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 230000007474 system interaction Effects 0.000 description 2
- 239000012467 final product Substances 0.000 description 1
- 238000005111 flow chemistry technique Methods 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to various IT systems, especially relates to the data interchange field of IT system with multiple data sources, multi-application terminals and data real-time requirement, and specifically relates to a data interchange intermediate system. The invention provides an interactive platform for the data collection systems and application systems, shields various data interfaces of the data user and the data collector and couples the two parts, and the application systems and the collection systems are only needed to understand one technology used by the system. By adopting the data interchange intermediate system of the invention, all access systems can be managed by the system uniformly, real-time data can be easily realized; and the use conditions of data are counted, and the standard of metadata is specified so that all systems can be consistent and lots of repeated codes in each application system can be deleted.
Description
Technical field
The present invention relates to various IT system, relate in particular to multi-data source, many application end and data are had the field of data exchange of the IT system of real-time requirement, be specifically related to a kind of exchanges data intermediate system.
Background technology
In the data of large-scale IT system (comprising application system and data acquisition system) are used, can relate to the situation of multiple development technique and memory technology coexistence usually.Each self-defined oneself data structure of each application system and data acquisition system, the metadata information disunity.The general difficulty of real data is very big.Provide and there is following problem in the both sides that use for data.
For the application system end: when application system of exploitation need be obtained data from various storages when, need to understand the details and the method for attachment of various interconnection techniques, and write respective code for each storage and reach data.If every kind of application is difficult to accomplish code reuse by different vendor's exploitation, has caused a large amount of overlapping development, and be difficult to management.Each application system oneself is used data, can't add up the operating position of each system to data.
For the data acquisition system end: can't notify all application system data to gather and finish, application system to realize data in real time need consume the method for ample resources (such as: poll).Each acquisition system may be by different manufacturer's construction, and operation technique may be different.Application system is difficult to that it is considered as the uniform data source and uses, and realizes the normalization of data.
Summary of the invention
The present invention be directed to above problem, a kind of exchanges data intermediate system is provided, for data acquisition system and application system provide a mutual platform.The both sides system is by system interaction of the present invention, the time real data realization become and realize easily, each application system is added up, the standard of standard metadata to the data operating position, each system is consistent, has saved a large amount of repeated encodings of each application system.
The technical solution adopted for the present invention to solve the technical problems is:
A kind of exchanges data intermediate system comprises metadata management module, service subscription administration module, service processing engine modules, Service Quality Management module and service log management module, wherein,
Described metadata management module is used to finish metadata and unifies function, and the index that provides application system to subscribe to is provided, and checks the details of index;
Described service subscription administration module is used to finish the described function of the application system being used data management, demonstrate the subscription situation of application system, demonstrate the detailed process of subscription, list application system and initiate the detailed process of request, and the subscription that can pass through the real-time cancellation of the page or recover the appointment application system;
Described service processing engine modules is used to finish described subscription/publication function and data normalization and data notification function;
Described Service Quality Management module is used to add up the number of times of Transaction Success and failure;
Described service log management module is used to finish by log understands the function of each application system to the situation of the behaviour in service of data and data acquisition.
The service processing engine modules is carried out exchanges data by using adapter and acquisition system.
The details of index comprise title, describe time granularity, network element granularity.
The service processing engine modules comprises orders formation, command queue and data queue, wherein,
Ordering formation is used for sending order from application system;
Command queue is used to send to using the notice of system;
Data queue is used to send data-message to application system.
Adapter is supported the integrated and conversion from the index table to index of various protocols.
A kind of method of work of exchanges data intermediate system may further comprise the steps:
Step 1, application system sends the subscription data request by the subscription queue in the message queue;
Step 2, service processing engine modules receive order and handle; Subscribe to successfully by the notice application system of the command queue in the message queue;
Step 3, service processing engine modules enquiry of historical data also returns to application system and writes down order by the data queue in the message queue, waits for the data of next time point;
Step 4, data acquisition system are given notice to adapter after collecting the data of next time point;
Step 5, data are converted into index with notice and are transmitted to the service processing engine;
Step 6, service processing engine will notify the data query of time point to come out, and by the order of coupling step 3 record, use the data queue in the message queue that data query is issued application system;
Step 7, service processing engine judge that this order subscription time transmission finishes, and finishes this order.
A kind of exchanges data intermediate system of the present invention, the various data-interfaces of its shadow data user and data acquisition side make both sides' uncoupling.A kind of technology that application system and acquisition system only need be understood the use of native system gets final product.By system interaction of the present invention, the time real data realization become and realize that easily each application system is added up the data operating position, and the standard of standard metadata is consistent each system, has saved a large amount of repeated encodings of each application system.
Description of drawings
The present invention is further described below in conjunction with drawings and Examples.
Fig. 1 is the system construction drawing of a kind of exchanges data intermediate system of the present invention;
Fig. 2 is the order processing flow chart of a kind of exchanges data intermediate system of the present invention;
Fig. 3 is the data notification flow chart of a kind of exchanges data intermediate system of the present invention;
Fig. 4 is the data notification adapter structure figure of a kind of exchanges data intermediate system of the present invention.
Embodiment
Below in conjunction with the drawings and specific embodiments a kind of exchanges data intermediate system of the present invention is further described.
A more preferably embodiment is provided below:
1, by the attendant data configuration of each storage is become index, and acquisition system is related with index.Application system is also inserted by the attendant.Constitute structure as shown in Figure 1.Application system and acquisition system can and the index metadata can on-the-fly modify by the attendant.
When application system has demand data, send the order of content structure such as following table to system of the present invention by subscription queue:
| <？xml?version＝″1.0″encoding＝″UTF-8″？> <order id＝″402881842268424f012268490bfc0009″messageType＝″order″time＝″2009-07-1212:00:00″> <orderInfo?orderType＝″ALL″resultType＝″FILEGET″/> <kpi>Kpi1；Kpi2</kpi> |
| <dimensions> <dimension?type＝″NE″range＝″MSC″value＝″MSC1；MSC2″/> <dimension?type＝″TIME″range＝″HOUR″value＝″2009-04-04?12:00:00--ALL″/> </dimensions> </order> |
This order represents, this application system to native system require from 12 of on April 4th, 2009 backward to future, time granularity is hour, the NE granularity is MSC1 and MSC2 under the MSC, index is the data of Kpi1 and Kpi2.Application system will be extracted data file by FTP.
Indent structure is defined as follows table:
2, native system is through flow processing shown in Figure 2.Send as shown in the table replying:
| <? xml version=" 1.0 " encoding=" UTF-8 "?><orderAck id=" 402881842268424f012268490bfc2203 " ackId=" 402881842268424f012268490bfc0009 " messageType=" ack " time=" 2009-07-1212:00:00 "><state>SUCCESS</state><message>Subscribe to successfully</message></orderAck> |
This response content represents that index orders successfully.
This replys organization definition such as following table:
3, native system inquires historical data and then is returned to data queue with the content format as following table:
| <？xml?version＝″1.0″encoding＝″UTF-8″？> <orderAck id＝″402881842268424f012268490bfc0009″messageType＝″FILEGET″ackId＝″333″time＝″2009-07-1212:00:00″> <file>/opt/ddd/ddd/order111_20090404101000.dat</file> <heads> |
| <head order=" 1 " cellType=" DIM " cellContent=" TIME-HOUR " name=" time "/><head order=" 2 " cellType=" DIM " cellContent=" NE-MSC " name=" network element "/><head order=" 4 " cellType=" KPI " cellContent=" Kpi1 " name=" telephone traffic "/><head order=" 5 " cellType=" KPI " cellContent=" Kpi2 " name=" call completing rate "/></heads></orderAck> |
Content data file form such as following table:
| 2009-04-04?10:00:00，msc1，aaa，1111，22222009-04-04?10:00:00，msc2，aaa，44，332009-04-04?10:00:00，msc1，bbb，33，442009-04-04?10:00:00，msc2，bbb，464，232009-04-04?11:00:00，msc1，aaa，55，24352009-04-04?11:00:00，msc2，aaa，343，5542009-04-04?11:00:00，msc1，bbb，234，2342009-04-04?11:00:00，msc2，bbb，534，2234 |
Reply formal definition such as following table:
If the demand data of following time point is arranged after 4, order is ordered successfully, will be stored in the native system, wait for that acquisition system sends the data acquisition report.Data in real time is sent to application system.
Acquisition system sends to native system adapter as shown in Figure 4 with following content format:
| <kpiready?id＝″40288vd34268424f012fd2190bf4422d″> <kpi>Kpi1</kpi> <dimensions> <dimension?type＝″NE″range＝″MSC″value＝″MSC1；MSC2″/> <dimension?type＝″TIME″range＝″HOUR″value＝″2009-08-04?12:00:00″/> </dimensions> </kpiready> |
This notifies expression, when time granularity is slight, the NE granularity be the index Kpi1 of MSC at MSC1, the last time point of MSC2 be on August 4th, 2,009 12 data gathered and finished.
Data notification organization definition such as following table:
5, native system is received data notification, will real time data be sent to relevant application system of subscribing to through flow process shown in Figure 3.
Application system is finished using to data, when not needing duration data is provided, cancels an order to ordering the formation transmission, and content format is as follows:
| <？xml?version＝″1.0″encoding＝″UTF-8″？><orderAck id＝″40288vd34268424wqx1fdddd0bf4422d″ |
| messageType＝″CANCEL″time＝″2009-07-14?13:00:00″> <cancelId>402881842268424f012268490bfc0009</cancelId> </orderAck> |
Formal definition such as following table:
6, native system is cancelled this order by flow process shown in Figure 1 after receiving this message, and replys to command queue's transmission.
Above-described embodiment, the present invention embodiment a kind of more preferably just, the common variation that those skilled in the art carries out in the technical solution of the present invention scope and replacing all should be included in protection scope of the present invention.
Claims (6)
1. an exchanges data intermediate system comprises metadata management module, service subscription administration module, service processing engine modules, Service Quality Management module and service log management module, wherein,
Described metadata management module is used to finish metadata and unifies function, and the index that provides application system to subscribe to is provided, and checks the details of index;
Described service subscription administration module is used to finish the described function of the application system being used data management, demonstrate the subscription situation of application system, demonstrate the detailed process of subscription, list application system and initiate the detailed process of request, and the subscription that can pass through the real-time cancellation of the page or recover the appointment application system;
Described service processing engine modules is used to finish described subscription/publication function and data normalization and data notification function;
Described Service Quality Management module is used to add up the number of times of Transaction Success and failure;
Described service log management module is used to finish by log understands the function of each application system to the situation of the behaviour in service of data and data acquisition.
2. a kind of exchanges data intermediate system according to claim 1 is characterized in that, described service processing engine modules is carried out exchanges data by using adapter and acquisition system.
3. a kind of exchanges data intermediate system according to claim 1 is characterized in that the details of described index comprise title, describes time granularity, network element granularity.
4. a kind of exchanges data intermediate system according to claim 1 is characterized in that, described service processing engine modules comprises orders formation, command queue and data queue, wherein,
Ordering formation is used for sending order from application system;
Command queue is used to send to using the notice of system;
Data queue is used to send data-message to application system.
5. a kind of exchanges data intermediate system according to claim 2 is characterized in that, described adapter is supported the integrated and conversion from the index table to index of various protocols.
6. the method for work of an exchanges data intermediate system is characterized in that, may further comprise the steps:
Step 1, application system sends the subscription data request by the subscription queue in the message queue;
Step 2, service processing engine modules receive order and handle; Subscribe to successfully by the notice application system of the command queue in the message queue;
Step 3, service processing engine modules enquiry of historical data also returns to application system and writes down order by the data queue in the message queue, waits for the data of next time point;
Step 4, data acquisition system are given notice to adapter after collecting the data of next time point;
Step 5, data are converted into index with notice and are transmitted to the service processing engine;
Step 6, service processing engine will notify the data query of time point to come out, and by the order of coupling step 3 record, use the data queue in the message queue that data query is issued application system;
Step 7, service processing engine judge that this order subscription time transmission finishes, and finishes this order.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910230385XA CN101714946B (en) | 2009-11-16 | 2009-11-16 | Data interchange intermediate system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910230385XA CN101714946B (en) | 2009-11-16 | 2009-11-16 | Data interchange intermediate system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101714946A true CN101714946A (en) | 2010-05-26 |
| CN101714946B CN101714946B (en) | 2012-03-28 |
Family
ID=42418234
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910230385XA Expired - Fee Related CN101714946B (en) | 2009-11-16 | 2009-11-16 | Data interchange intermediate system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101714946B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104954469A (en) * | 2015-06-19 | 2015-09-30 | 长沙廖氏软件科技有限公司 | Information exchange method for heterogeneous system |
| CN106936665A (en) * | 2017-04-01 | 2017-07-07 | 济南浪潮高新科技投资发展有限公司 | A kind of method and system of facility information unification collection |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7574417B1 (en) * | 2006-09-28 | 2009-08-11 | Rockwell Automation Technologies, Inc. | Self configuration of embedded historians |
| CN100573528C (en) * | 2007-10-30 | 2009-12-23 | 北京航空航天大学 | Digital museum gridding and building method thereof |
| CN101436274A (en) * | 2008-11-14 | 2009-05-20 | 山东浪潮齐鲁软件产业股份有限公司 | Method for across-platform monitoring enterprise application system performance |
-
2009
- 2009-11-16 CN CN200910230385XA patent/CN101714946B/en not_active Expired - Fee Related
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104954469A (en) * | 2015-06-19 | 2015-09-30 | 长沙廖氏软件科技有限公司 | Information exchange method for heterogeneous system |
| CN104954469B (en) * | 2015-06-19 | 2018-07-24 | 长沙廖氏软件科技有限公司 | A kind of heterogeneous system information switching method |
| CN106936665A (en) * | 2017-04-01 | 2017-07-07 | 济南浪潮高新科技投资发展有限公司 | A kind of method and system of facility information unification collection |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101714946B (en) | 2012-03-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101636738B (en) | Method for obstruction and capacity information unification monitoring in unification management system environment and system for thereof | |
| CN100477658C (en) | Method for parallel processing big quantities of data in a communication server | |
| CN101316389B (en) | Mobile communication service handling method and device | |
| WO2006068382A1 (en) | Rfid reader interface and event management apparatus for supporting multi-protocol-based heterogeneous readers and method therefor | |
| CN103093342A (en) | Online transaction processing platform and transaction processing method thereof | |
| CN102761454A (en) | Method and system for monitoring internet of things | |
| CN101263699A (en) | System and method for provisioning user device | |
| CN101957927A (en) | Middleware architecture of Internet of things and SOA architecture-based middleware of Internet of things | |
| CN103095498B (en) | Bill record collection method and system | |
| CN103701720A (en) | Communication method with Socket server and online transaction management system | |
| CN101714946B (en) | Data interchange intermediate system | |
| CN100353712C (en) | Managing method for transmission equipment | |
| CN101159972B (en) | Traffic processing method and system and traffic control point | |
| CN102904967A (en) | Intelligent Internet of things data exchange platform scheme based on hardware electromechanical field | |
| CN101556587A (en) | Operation agent device for heterogeneous database | |
| CN101369919B (en) | Message sequence management of enterprise based correlated events | |
| CN104572838A (en) | Improved system and method for writing data to database | |
| CN101571905A (en) | Application interface conversion system of RFID middleware and method | |
| CN105376155A (en) | Intelligent route system and method based on distributed cluster framework | |
| CN101415170A (en) | Method, apparatus and system for processing call ticket customization | |
| CN100455059C (en) | Short message gateway bridging system, method and short message gateway bridge module | |
| CN102486838B (en) | Multi-criteria radio frequency identification (RFID) tag data integration and conversion method | |
| CN115756889A (en) | Task center architecture method for double data buses of aerospace measurement and control ground station network | |
| CN111882296A (en) | Pipe valve management system | |
| CN103379120A (en) | Method for enterprise service system interacting with middleware and device manager |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120328 Termination date: 20131116 |