CN105550355B - Rule-based Hose data delivery system and method - Google Patents
Rule-based Hose data delivery system and method Download PDFInfo
- Publication number
- CN105550355B CN105550355B CN201511006362.2A CN201511006362A CN105550355B CN 105550355 B CN105550355 B CN 105550355B CN 201511006362 A CN201511006362 A CN 201511006362A CN 105550355 B CN105550355 B CN 105550355B
- Authority
- CN
- China
- Prior art keywords
- data
- driving
- pushing
- library
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
Abstract
The invention discloses the rule-based data delivery system of Hose and methods, the system comprises authoritative library, server and object libraries, driving engine, monitor and multiple connectors are provided in the server, it is provided with driven management device, driving engine log logger and multiple drivings in the driving engine, is sequentially set with filter, rule base, processor and logger by flow chart of data processing in the driving；Method includes: the push request of monitor monitored data, and driving engine receives the data-pushing request sended over from connector, and driving processing data-pushing request is successively called in all available drivings in query driven engine；Driving processing request；Filter process request；In the server, multiple connectors and a driving engine are set, filter, rule base, processor and log feeder etc. are inserted into driving, and the object in driving is carried out to orderly combination, to handle data-pushing request.
Description
Technical field
The present invention relates to enterprise's authority's resource management techniques fields, are rule-based Hose data-pushings specifically
System and method.
Background technique
Traditional data-pushing is all the versatility sum number that can not accomplish data-pushing together with business close-coupled
According to the diversity of structure, propelling data process can not accurately be controlled.It is provided in large enterprise for corporate strategy data
Source is all unified management, unified O&M, united analysis, and provides service and data support for corporate business development.Because of data
It saves and safeguards in resource set, there is the shared and distribution problem of data.
It is the effective means of enterprise information management that Data Integration is integrated, by will be distributed over each system of enterprise and data
Data in library are extracted, are combed, unification is safeguarded, establish data authority library.Can be effectively reduced IT application in enterprise at
This, provides information level of the enterprise, provides quick data for business strategy and supports.Data Integration just needs to carry out later
It is shared, the business activity of enterprise could be supported in this way, so a kind of means is needed to realize the distribution of data, and support the reality of data
When synchronous change.But existing technology has the following disadvantages:
1. can only limited data in support business, cause business coupling too strong, do not have versatility and system migration
Property.
2. it is single with the integration mode in authoritative library, lead to integrated difficulty, system reform difficulty is big.
3. can not the data of promotion be carried out with accurate control, data can not flexibly be modified.
4. being directed to relevant database, api interface, web Service interface, text file etc. do not support a variety of data
Object library.
Summary of the invention
The purpose of the present invention is to provide rule-based Hose data delivery system and methods, to solve available data
Distribution, and the problems of technology for supporting the real-time synchronization of data to change and limitation, in order to realize that data change is real-time
It is pushed to object library and builds rule-based Hose data delivery system, using the plug-in type design architecture of original creation, realize system
Multiple components are inserted on demand in system, are directly unloaded or are replaced when not needing, and in the server, multiple connectors and one are arranged
Engine is driven, filter, rule base, processor and log feeder etc. are inserted into driving, and the object in driving is carried out
Orderly combination, to handle data-pushing request；Rule-based Hose data push method of the present invention is using promotion
Data-pushing to object library, when carrying out data-pushing, to drive engine as container, is driven to core by the mode of driving, right
Propelling data and push process are accurately controlled and are monitored, and for the data application rule of promotion, change data, outline mapping is complete
At the push for the data being pushed.
The present invention is achieved through the following technical solutions: rule-based Hose data delivery system, including authoritative library, service
Device and object library are provided with driving engine, monitor and multiple connectors, the connector in the server and draw with driving
It holds up and is connected；Driven management device, driving engine log logger and multiple drivings, the company are provided in the driving engine
It connects device to be connected with driving, is sequentially set with filter, rule base, processor and day by flow chart of data processing in the driving
Will logger；
The server is the Hose data delivery system of an operation；
The driving engine manages the life cycle of the driving by driven management device, carry out driving creation, deletion,
Change, starting and shutoff operation；
The driving engine log logger, record include it is newly-increased to driving itself, delete, change, starting and close
Operation note；
The driven management device, a kind of tool that visually driving is managed；
The driving, the data-pushing for handling authoritative library and object library are distributed, and support more drivings, more authority libraries and multiple target
Library；
The data filtering that the driving does not need push is fallen, is accurately controlled to the data of push by the filter
System；
The rule base controls the data of push, executes additional service logic；And for different driving and
Push request carries out flexible configuration rule；
The processor respectively corresponds different processors according to the difference of object library, is provided with JDBC processor, LDAP
Processor and WebService processor；
The Audit data generated during data-pushing is recorded in file the logger；
The connector, be server entrance, including based on TCP/IP connector, based on the connection of http protocol
Device, the connector based on JMS message, connector memory-based；
The monitor is monitored and is requested by the data-pushing that different channels send over, is authoritative library and Hose data
The entrance for pushing integrated communicaton, according to the technology isomery in authoritative library, correlation limitation provides corresponding monitor object, side
Just it integrates, and requests to draw by connector by the data-pushing listened to using TCP/IP technology or HTTP technology or JMS technology
Enter in server.
The further system described to better implement the present invention, particularly is provided with following structures: in the server
It is additionally provided with console, the console, the visualized management tool based on browser is used for monitoring server state, in conjunction with
Driven management device management driving starts and stops, and driving creation, deletion, editor, and checks the log information of driving.
The further system described to better implement the present invention, particularly is provided with following structures: in the driving engine
It is inside additionally provided with cluster component, the cluster component drives engine will using cluster component in cluster multinode deployed environment
The configuration change of driving is broadcast in cluster other servers, it is ensured that keeps synchronizing in driving configuration cluster.
Rule-based Hose data push method, comprising the following steps:
1) monitor is monitored is requested by the data-pushing that different channels send over, and then requests data-pushing
Driving engine is passed to by connector；
2) the driving engine receives the data-pushing request sended over from connector, it is all in query driven engine can
Driving processing data-pushing request is successively called in driving；
3) driving processing request, the driving receive the data-pushing request passed over from driving engine, and driving is first
It first checks Route Distinguisher, if not supporting this Route Distinguisher, directly returns, data-pushing terminates；If supporting the routing mark
Know, then data-pushing request is passed into filter；
4) filter process is requested, after the filter receives the data-pushing request that driving passes over, filter
The data that do not support are driven to be filtered in requesting data-pushing, the data-pushing request transmitting that will be then pushed
To rule base；
5) request data applying rules are directed to, the rule base receives data-pushing request, requests the data-pushing
Using the rule configured in rule base, rule operation is completed, and executes step 6), and data-pushing request is passed to processor；?
In regular operational process, can interrupt push process directly terminates；
6) processor processing request, the processor receive data-pushing request, from data-pushing request in obtain by
The data being pushed are passed through the format that outline Mapping and Converting can be identified at object library by the data of push.
Further the method to better implement the present invention, especially uses following set-up modes: executing step 1)
The monitor is monitored is requested by the data-pushing that different channels send over, and data-pushing request is transmitted by connector
Following steps are additionally provided with before to driving engine:
Step 1: processing event is monitored in authoritative library, authoritative library obtains initial data from event, and is Raw Data Generation
One can be driven the Route Distinguisher supported and represent object library；
Step 2: authoritative library carries out initial data whole according to push opportunity, object library, data type and action type
Close specification, then by after standardization data and Route Distinguisher be encapsulated as XML format data, and XML format data are made
It is sent in the connector of server for data-pushing request.
Further the method to better implement the present invention, especially uses following set-up modes: further including following step
It is rapid:
7) object library handles data, and after step 6), the object library receives the data being pushed, first to being received
The data being pushed legitimacy and validity verified, the object library for the data being pushed after verified is relationship type number
It is write data into according to the library JDBC that then be used directly；If the object library of data being pushed after verified be WebService service or
Then WebService server-side is written in the data being pushed by person RESTful.
Further the method to better implement the present invention, especially uses following set-up modes: further including following steps
It is rapid:
8) perdurable data and Data Integration is carried out, after step 7), the number being pushed that the object library will receive
According to progress persistence, and the data being pushed and authoritative library keep incidence relation.
Further the method to better implement the present invention, especially uses following set-up modes: further including following steps
It is rapid:
9) after step 8), the processor calls logger, and the audit of data-pushing request treatment process is believed
Breath is recorded, and is saved in disk, processor complete data-pushing request processing and data-pushing, back to driving engine into
Row is handled in next step.
Further the method to better implement the present invention, especially uses following set-up modes: further including following steps
It is rapid:
10) after step 9), the driving engine receives data-pushing request processing result, is responded and is weighed by connector
Wei Ku informs authoritative library data-pushing the result is that success or failure, and the reason of with push failure, completes a number accordingly
It is requested according to push.
Further the method to better implement the present invention, especially uses following set-up modes: further including following steps
It is rapid:
11) after step 10), the data being pushed can be packaged into the data lattice that object library can identify by the processor
Formula, for different object library types, using different processors, after encapsulating data, is pushed to when carrying out data encapsulation
Corresponding object library.
Compared with prior art, the present invention have the following advantages that and the utility model has the advantages that
(1) present invention is the distribution of solution available data, and present in the technology for supporting the real-time synchronization of data to change
Problem and limitation, using the plug-in type design architecture of original creation, multiple components are inserted on demand in realization system, are directly unloaded when not needing
Carry or replacement, in the server, multiple connectors and a driving engine are set, in driving be inserted into filter, rule base,
Processor and log feeder etc., and the object in driving is carried out to orderly combination, to handle data-pushing request；This hair
It is bright while to drive engine as container, it is driven to core, propelling data and push process are accurately controlled and monitored, for promotion
Data application rule, change data, outline mapping, complete the push of data being pushed.
(2) the more drivings of the present invention support that data are pushed in object library by each driving support from authoritative library.Respectively drive it
Between it is independent, without influencing each other.Support that push filter accurately controls synchronous data, it can be with for data application rule
Modify data.
(3) present invention supports plurality of target library type, JDBC, LDAP, WebService, RESTful, text document etc..
(4) the present invention is based on classes and characteristic to carry out data-pushing, accurate control and rule use.
(5) the convenient support to other object libraries such as message-oriented middleware, the domains AD of the present invention extends.
(6) rule-based Hose data delivery system of the present invention provides a feature-rich rule base,
Facilitate extension rule library.
Detailed description of the invention
Fig. 1 is the method for the invention flow chart.
Fig. 2 is the method for the present invention application timing diagram.
Fig. 3 is server rack composition of the present invention.
Fig. 4 is data-pushing architecture diagram of the present invention.
Specific embodiment
The present invention is described in further detail below with reference to embodiment, embodiments of the present invention are not limited thereto.
Hose: implied meaning water pipe.
Authoritative library: the AUTHORITATIVE DATA center of enterprises has authoritative and validity.Such as the ERP system in enterprise
Manage the information such as mechanism, the employee in enterprise.
Object library: the destination of data-pushing, the place that data finally need can be relevant database, text
File, WebService service interface, RESTful service interface, ldap database etc..
Class: describing the format of data, to the canonical representation of data, displaying and system is facilitated to handle.Such as enterprise staff
It is exactly a type, the type includes many characteristics.The abstract ways of the object-oriented of standard.
Characteristic: the characteristic of class.Such as the work number of enterprise staff, name, post, affiliated function etc., these belong to enterprise
The characteristic of this class of employee.
Data-pushing request: a data-pushing process is represented in Hose system, data-pushing request inside, which is held, to be needed
The data and routing iinformation to be pushed.
RESTful: a kind of software architecture style, design style rather than standard, merely provide one group of design principle and
Constraint condition.It is mainly used for the software of client and server interactive class.Software based on this Style Design can be simpler
It is clean, more have levels, it is easier to realize the mechanism such as caching.
WebService:Web service is that a platform is independent, lower coupling, self-contained, based on programmable
Open XML (a subset under standard generalized markup language) standard can be used to describe, issue, send out for the application program of web
Now, coordinate and configure these application programs, for developing the application program of distributed interoperability.
The connection of JDBC:JDBC(Java Data Base Connectivity, java database) it is a kind of for executing
The Java API of SQL statement can provide unified access, the class that it is write by one group with Java language for a variety of relational databases
It is formed with interface.
XML: extensible markup language, the subset of standard generalized markup language are a kind of for marking electronic document to make it
With structural markup language.It can be used to flag data, define data type, be a kind of mark for allowing user to oneself
The original language that note language is defined.
Hose-Service, i.e. server.
LDAP is Light Directory Access Protocol, and full name in English is Lightweight Directory Access
Protocol is generally referred to as LDAP.It is based on X.500 standard, but it is simple mostly and can according to need it is fixed
System.From it is X.500 different, LDAP support TCP/IP, this to access Internet be necessary.The core specification of LDAP is in RFC
It is all defined, all RFCs relevant to LDAP can be found in LDAPman RFC webpage.
Embodiment 1:
Rule-based Hose data delivery system, as shown in Figure 3, Figure 4, including authoritative library, server and object library,
Driving engine, monitor and multiple connectors are provided in the server, the connector is connected with driving engine；Institute
It states and is provided with driven management device, driving engine log logger and multiple drivings in driving engine, the connector and driving phase
Connection, is sequentially set with filter, rule base, processor and logger by flow chart of data processing in the driving；
The server is the Hose data delivery system of an operation；
The driving engine manages the life cycle of the driving by driven management device, carry out driving creation, deletion,
Change, starting and shutoff operation；
The driving engine log logger, record include it is newly-increased to driving itself, delete, change, starting and close
Operation note；
The driven management device, a kind of tool that visually driving is managed；
The driving, the data-pushing for handling authoritative library and object library are distributed, and support more drivings, more authority libraries and multiple target
Library；
The data filtering that the driving does not need push is fallen, is accurately controlled to the data of push by the filter
System；
The rule base controls the data of push, executes additional service logic；And for different driving and
Push request carries out flexible configuration rule；
The processor respectively corresponds different processors according to the difference of object library, is provided with JDBC processor, LDAP
Processor and WebService processor；
The Audit data generated during data-pushing is recorded in file the logger；
The connector, be server entrance, including based on TCP/IP connector, based on the connection of http protocol
Device, the connector based on JMS message, connector memory-based；
The monitor is monitored and is requested by the data-pushing that different channels send over, is authoritative library and Hose data
The entrance for pushing integrated communicaton, according to the technology isomery in authoritative library, correlation limitation provides corresponding monitor object, side
Just it integrates, and requests to draw by connector by the data-pushing listened to using TCP/IP technology or HTTP technology or JMS technology
Enter in server.
Embodiment 2:
The present embodiment is further optimized based on the above embodiments, further institute to better implement the present invention
System is stated, as shown in Figure 3, Figure 4, particularly is provided with following structures: being additionally provided with console, the control in the server
Platform, the visualized management tool based on browser are used for monitoring server state, the starting driven in conjunction with driven management device management
And stopping, and driving creation, deletion, editor, and check the log information of driving.
Embodiment 3:
The present embodiment is further optimized based on the above embodiments, further institute to better implement the present invention
System is stated, as shown in Figure 3, Figure 4, particularly is provided with following structures: being additionally provided with cluster component in the driving engine, it is described
Cluster component drives engine that the configuration change of driving is broadcast to cluster using cluster component in cluster multinode deployed environment
Middle others server, it is ensured that keep synchronizing in driving configuration cluster.
Embodiment 4:
The present embodiment is to advanced optimize based on any of the above embodiments, the rule-based data-pushing side Hose
Method, comprising the following steps:
1) monitor is monitored is requested by the data-pushing that different channels send over, and then requests data-pushing
Driving engine is passed to by connector；
2) the driving engine receives the data-pushing request sended over from connector, it is all in query driven engine can
Driving processing data-pushing request is successively called in driving；
3) driving processing request, the driving receive the data-pushing request passed over from driving engine, and driving is first
It first checks Route Distinguisher, if not supporting this Route Distinguisher, directly returns, data-pushing terminates；If supporting the routing mark
Know, then data-pushing request is passed into filter；
4) filter process is requested, after the filter receives the data-pushing request that driving passes over, filter
The data that do not support are driven to be filtered in requesting data-pushing, the data-pushing request transmitting that will be then pushed
To rule base；
5) request data applying rules are directed to, the rule base receives data-pushing request, requests the data-pushing
Using the rule configured in rule base, rule operation is completed, and executes step 6), and data-pushing request is passed to processor；?
In regular operational process, can interrupt push process directly terminates；
6) processor processing request, the processor receive data-pushing request, from data-pushing request in obtain by
The data being pushed are passed through the format that outline Mapping and Converting can be identified at object library by the data of push.
Embodiment 5:
The present embodiment is further optimized based on the above embodiments, further institute to better implement the present invention
Method is stated, following set-up modes are especially used: executing what the monitoring of monitor described in step 1) was sended over by different channels
Data-pushing request is additionally provided with following steps before data-pushing request is passed to driving engine by connector:
Step 1: processing event is monitored in authoritative library, authoritative library obtains initial data from event, and is Raw Data Generation
One can be driven the Route Distinguisher supported and represent object library；
Step 2: authoritative library carries out initial data whole according to push opportunity, object library, data type and action type
Close specification, then by after standardization data and Route Distinguisher be encapsulated as XML format data, and XML format data are made
It is sent in the connector of server for data-pushing request.
Embodiment 6:
The present embodiment is advanced optimized on the basis of embodiment 4 or 5, further institute to better implement the present invention
Method is stated, following set-up modes are especially used: further comprising the steps of:
7) object library handles data, and after step 6), the object library receives the data being pushed, first to being received
The data being pushed legitimacy and validity verified, the object library for the data being pushed after verified is relationship type number
It is write data into according to the library JDBC that then be used directly；If the object library of data being pushed after verified be WebService service or
Then WebService server-side is written in the data being pushed by person RESTful.
Embodiment 7:
The present embodiment is further optimized based on the above embodiments, further institute to better implement the present invention
Method is stated, following set-up modes is especially used: further including following step:
8) perdurable data and Data Integration is carried out, after step 7), the number being pushed that the object library will receive
According to progress persistence, and the data being pushed and authoritative library keep incidence relation.
Embodiment 8:
The present embodiment is further optimized based on the above embodiments, further institute to better implement the present invention
Method is stated, following set-up modes is especially used: further including following step:
9) after step 8), the processor calls logger, and the audit of data-pushing request treatment process is believed
Breath is recorded, and is saved in disk, processor complete data-pushing request processing and data-pushing, back to driving engine into
Row is handled in next step.
Embodiment 9:
The present embodiment is further optimized based on the above embodiments, further institute to better implement the present invention
Method is stated, following set-up modes is especially used: further including following step:
10) after step 9), the driving engine receives data-pushing request processing result, is responded and is weighed by connector
Wei Ku informs authoritative library data-pushing the result is that success or failure, and the reason of with push failure, completes a number accordingly
It is requested according to push.
Embodiment 10:
The present embodiment is further optimized based on the above embodiments, further institute to better implement the present invention
Method is stated, following set-up modes is especially used: further including following step:
11) after step 10), the data being pushed can be packaged into the data lattice that object library can identify by the processor
Formula, for different object library types, using different processors, after encapsulating data, is pushed to when carrying out data encapsulation
Corresponding object library.
Embodiment 11:
The present embodiment is to advanced optimize based on any of the above embodiments, as shown in connection with fig. 1, rule-based
Hose data push method the following steps are included:
1, monitored data altering event, and data altering event or data-pushing event are handled, authoritative library is monitored to be processed
Event, authoritative library obtain initial data from event to be processed, and can be supported by driving and generation by Raw Data Generation one
The Route Distinguisher of table object library, the Route Distinguisher will determine that this data will be driven processing push by those.The Route Distinguisher
Object library can be represented, a globally unique character string is used in the present invention as Route Distinguisher.Ensure that data will not push away
It is sent to the object library that it should not go；
2, authority data is integrated, XML data is formatted into, sends data-pushing request, authoritative library is according to push opportunity, mesh
Library, data type and action type are marked, initial data is subjected to integration specification, then by the data and Route Distinguisher after standardization
XML format data are encapsulated as, and are sent to XML format data as data-pushing request in the connector of server,
The data type includes: character string, number, Boolean etc.；The action type includes: newly-increased, deletion, update, migration；Institute
It states push opportunity and object library is that authoritative library determines which data can be pushed away, when push, determine
Give data-pushing to which object library；
3, monitor, monitors the data-pushing request sended over by different channels, reception it is all by monitor into
The data-pushing request entered, verifying XML formatted data, by XML format data conversion at the data structure of server internal, verifying
The legitimacy of request is then directly abandoned if it is illegal request and is not processed simultaneously recording exceptional behavior, is subsequent request
Processing prepares data object.The title of data is held in the data structure of server internal, data value, data type, has pushed away
Send mark and Route Distinguisher.Driving engine is submitted into legal request.Monitor is that authoritative library and Hose data-pushing are integrated
The entrance of communication, according to the technology isomery in authoritative library, correlation limitation provides corresponding monitor object, is advantageously integrated；
4, engine is driven, the request sended over from connector is received, calls driving processing request, the driving engine connects
The data-pushing request sended over from connector is received, all available drivings in query driven engine are successively called at driving
Manage data-pushing request；The driven object for driving engine management all is the cord cage of system.Engine is driven to receive from difference
The data-pushing that monitor enters requests object, and driving engine must handle the request of these data-pushings.But driving engine is certainly
Oneself is not handled data-pushing request, data-pushing request is passed to the driving of all startings in driving engine, by driving
It is dynamic that data-pushing request is parsed and handled；
5, driving starts to process request, and the driving receives the data-pushing request passed over from driving engine, drives
It is dynamic to first check for Route Distinguisher, if not supporting this Route Distinguisher, directly return, data-pushing terminates；If supporting the road
By identifying, then data-pushing request is passed into filter；
6, whether driving supports the request, driving to determine processing request.Filter will be filtered the data being pushed,
If it is not supporting the characteristic of push to identify setting push, if characteristic all in a class is not supported to push, set
Set such push mark；
7, for request data with the rule configured in driving, if being configured with push rule in driving, it is directed to quilt
The data of push successively may directly interrupt push process in the operational process of driving with the rule of configuration, can be to quilt
The operation such as characteristic is modified or added to the data of push.Encryption push, such as password, identity are carried out to the data of certain sensitivities
Card number etc..Mapping matching treatment is carried out to the major key for the data being pushed, the data that primary key relationships are pushed；
8, request data applying rules are directed to, in regular operational process, can interrupt push process directly terminates.If
Rule operation is completed, it will is executed next step, is encapsulated data into the data format that object library can identify；
9, record rule executes failure audit information and records failure cause and state if rule executes failure, makees
For the data foundation of problem investigation.
10, outline maps, and converts the data into the format that object library can identify, data processing to this step, processor
The data being pushed can be packaged into the data format that object library can identify, data type conversion, for different object libraries
Type, using different processors, by the data-pushing being pushed to object library；
11, target bank address receives data, handles data, and object library receives Hose data push service (server) and pushes away
The data being pushed brought, first choice need verify data legitimacy and validity.If object library is relevant database
The JDBC that then be used directly writes data into database, then needs a server-side if it is WebService or RESTful,
Data are received, execute service logic for data, main task is exactly data persistence；
12, perdurable data, Data Integration, the data persistence being pushed that object library can will receive, and data
Incidence relation can be kept with authoritative library, provide data supporting for the data correlation in later period；
13, object library processing response is received, audit information is recorded, Hose Push Service may receive object library return
Processing result response message back, Hose system will record, and check and use as subsequent audit problem.Entire data
Push has just been completed, using asynchronous push mode.
Embodiment 12:
The present embodiment is to advanced optimize based on any of the above embodiments, as shown in connection with fig. 2, rule-based
Hose data push method the following steps are included:
1, start data-pushing, authoritative library obtains initial data from event, and can be driven for Raw Data Generation one
The dynamic Route Distinguisher for supporting and representing object library；Authoritative library foundation push opportunity, object library, data type and action type,
Initial data is subjected to integration specification, then by after standardization data and Route Distinguisher be encapsulated as XML format data, and will
XML format data are sent in the connector of server as data-pushing request
2, receive push request, monitor and requested by the data-pushing that different channels send over, then by data-pushing
Request passes to driving engine by connector；
3, analysis request data, verify data push request in data format, by data-pushing request in data turn
Change internal system data structure request object into；
4, request object is obtained, driving engine receives the data-pushing request sended over from connector；
5, driving engine processing request, driving engine receives internal system data structure request object, all by calling
Available driving processing system internal data structure requests object.
6, all available drivings are inquired, driving processing data-pushing request is successively called；
7, driving processing request, driving receive the data-pushing request passed over from driving engine；
8, judge whether to support request, driving first checks for Route Distinguisher, if supporting the Route Distinguisher, by the data
Push request passes to filter；
9, it does not support, if not supporting this Route Distinguisher, directly returns；
10, response processing result is not supported, data-pushing terminates；
11, filter process is requested, and the filter receives the data-pushing request that driving passes over；
12, filter out the data that do not support, filter data-pushing will be requested in drive the data that do not support to carry out
Filter；
13, applying rules, the data-pushing request that can be pushed pass to rule base；
14, rule operates data, and rule base receives data-pushing request, requests application rule to the data-pushing
The rule then configured in library, rule operation are completed, and processing request step is executed, and data-pushing request is passed to processor；
15, rule termination is handled, and in regular operational process, can interrupt push process；
16, processing request, processor receive data-pushing request, obtain the number being pushed from data-pushing request
According to；
17, termination responds processing result, and data-pushing process directly terminates；
18, the format of object library is converted the data into, processor is by the data being pushed by outline Mapping and Converting at mesh
The format that mark library can identify；
19, object library handle data, object library first to the received data being pushed legitimacy and validity into
Row verifying, the object library for the data being pushed after verified are that the relevant database JDBC that then be used directly writes data into；Through
The data being pushed are written if the object library for the data being pushed is WebService service or RESTful after verifying
WebService server-side；
20, processing result is returned to, the data being pushed received are carried out persistence, and the number being pushed by object library
Incidence relation is kept according to authoritative library；
21, Audit data is recorded, processor calls logger, by the audit information of data-pushing request treatment process
It records, is saved in disk, processor completes data-pushing request processing and data-pushing, carries out back to driving engine
It handles in next step；
22, driving engine completes data-pushing, and driving engine receives data-pushing request processing result, passes through connector
Authoritative library is responded, informs authoritative library data-pushing the result is that success or failure, and the reason of with push failure, is completed accordingly
One data-pushing request；
23, processing result is responded, the data being pushed can be packaged into the data that object library can identify by the processor
Format, when carrying out data encapsulation, for different object library types, using different processors, after encapsulating data, push
To corresponding object library.
Data-pushing request of the present invention is entered in server by connector, and connector directly passes legal request object
Pass driving engine.
Driving engine receives legal request object, legal request object can be passed to all drivings.
Driving judges whether it should handle request, if supporting request object, will enter data-pushing process, request pair
As that will enter in filter.
Filter receives request object, filters out the class and characteristic for not supporting push；If driving is configured with rule, ask
Ask object that will enter in rule.
Rule receives request object, and for the data pushed in request, successively operation rule, rule will execute data
Operation；Rule is executed to request, request object will enter in processor.
Processor will finally handle the request object, carry out outline mapping for data, convert the data into object library energy
The data format enough identified, finally sends the data to object library.
Object library returns to processing result, and processor can be preserved processing result by logger, so as to when
Audit and problem investigation.
The present invention selects suitable connector to realize according to authoritative library type and technology platform, realizes authoritative library and Hose
It is integrated between data push service, make authoritative library that the Push Service of Hose system can be used.
One driving is exactly the data communication channel between an authoritative library and object library, and Hose system uses driving engine
Manage all driven objects.
Filter, rule base, processor, logger are needed to configure in driving, wherein rule base is optional, day
Will logger is also optional object, the information generated during the recordable driving propelling data of logger.
Driving only handles oneself interested data-pushing request, and filters out unconcerned data-pushing by filter
Request.
Driving uses filter, is filtered to the data being pushed, and class and characteristic that driving is not supported are filtered out, real
Now to the accurate control and monitoring of the data being pushed.
If driving is configured with rule, for the data application rule being pushed, further data can be carried out
Control and modification.
Processor maps the data format that can identify the data conversion being pushed at object library using outline, and passes through
The mode that processor is realized sends the data to object library, and object library receives data processing data.
The above is only presently preferred embodiments of the present invention, not does limitation in any form to the present invention, it is all according to
According to technical spirit any simple modification to the above embodiments of the invention, equivalent variations, protection of the invention is each fallen within
Within the scope of.
Claims (10)
1. rule-based Hose data delivery system, including authoritative library, server and object library, it is characterised in that: described
Driving engine, monitor and multiple connectors are provided in server, the connector is connected with driving engine；In the drive
Driven management device, driving engine log logger and multiple drivings, the connector is provided in dynamic engine to be connected with driving,
Filter, rule base, processor and logger are sequentially set with by flow chart of data processing in the driving；
The server is the Hose data delivery system of an operation；
The driving engine manages the life cycle of the driving by driven management device, carries out driving creation, deletion, change
More, starting and shutoff operation；
The driving engine log logger, record include the operation to driving itself to increase newly, delete, change, start and close
Record；
The driven management device, a kind of tool that visually driving is managed；
The driving, the data-pushing for handling authoritative library and object library are distributed, and support more drivings, more authority libraries and multiple target library；
The data filtering that the driving does not need push is fallen, is accurately controlled to the data of push by the filter；
The rule base controls the data of push, executes additional service logic；And it is directed to different driving and push
It is required that carrying out flexible configuration rule；
The processor respectively corresponds different processors according to the difference of object library, is provided with JDBC processor, LDAP processing
Device and WebService processor；
The Audit data generated during data-pushing is recorded in file the logger；
The connector is the entrance of server, including the connector based on TCP/IP, the connector based on http protocol, base
Connector, connector memory-based in JMS message；
The monitor is monitored and is requested by the data-pushing that different channels send over, is authoritative library and Hose data-pushing
The entrance of system integration communication, according to the technology isomery in authoritative library, correlation limitation provides corresponding monitor object, side
Just it integrates, and requests to draw by connector by the data-pushing listened to using TCP/IP technology or HTTP technology or JMS technology
Enter in server.
2. rule-based Hose data delivery system according to claim 1, it is characterised in that: in the server
It is additionally provided with console, the console, the visualized management tool based on browser is used for monitoring server state, in conjunction with
Driven management device management driving starts and stops, and driving creation, deletion, editor, and checks the log information of driving.
3. rule-based Hose data delivery system according to claim 1 or 2, it is characterised in that: in the driving
Cluster component is additionally provided in engine, the cluster component drives engine to use cluster group in cluster multinode deployed environment
The configuration change of driving is broadcast in cluster other servers by part, it is ensured that keeps synchronizing in driving configuration cluster.
4. rule-based Hose data push method, it is characterised in that: the following steps are included:
1) monitor is monitored is requested by the data-pushing that different channels send over, and data-pushing request is then passed through connection
Device passes to driving engine；
2) the driving engine receives the data-pushing sended over from connector and requests, all available in query driven engine
Driving processing data-pushing request is successively called in driving；
3) driving processing request, the driving receive the data-pushing request passed over from driving engine, and driving is examined first
Route Distinguisher is looked into, if not supporting this Route Distinguisher, is directly returned, data-pushing terminates；If supporting the Route Distinguisher,
Data-pushing request is passed into filter；
4) filter process is requested, and after the filter receives the data-pushing request that driving passes over, filter will be right
The data that do not support are driven to be filtered in data-pushing request, the data-pushing request that will be then pushed passes to rule
Then library；
5) request data applying rules are directed to, the rule base receives data-pushing request, requests to apply to the data-pushing
The rule configured in rule base, rule operation are completed, and step 6) is executed, and data-pushing request is passed to processor；In rule
In operational process, can interrupt push process directly terminates；
6) processor processing request, the processor receive data-pushing request, are pushed from data-pushing request
Data, the data being pushed are passed through into the format that can identify at object library of outline Mapping and Converting.
5. rule-based Hose data push method according to claim 4, it is characterised in that: executing step 1) prison
It listens device to monitor to request by the data-pushing that different channels send over, data-pushing is requested to pass to driving by connector
Following steps are additionally provided with before engine:
Step 1: event to be processed is monitored in authoritative library, authoritative library obtains initial data from event to be processed, and is initial data
The Route Distinguisher supported and represent object library can be driven by generating one；
Step 2: initial data is carried out integration rule according to push opportunity, object library, data type and action type by authoritative library
Model, then by after standardization data and Route Distinguisher be encapsulated as XML format data, and using XML format data as number
It is sent in the connector of server according to push request.
6. rule-based Hose data push method according to claim 4 or 5, it is characterised in that: further include following
Step:
7) object library handles data, and after step 6), the object library receives the data being pushed, first to the received quilt of institute
The legitimacy and validity of the data of push are verified, and the object library for the data being pushed after verified is relevant database
The JDBC that then be used directly writes data into；If the object library of data being pushed after verified be WebService service or
Then WebService server-side is written in the data being pushed by RESTful.
7. rule-based Hose data push method according to claim 6, it is characterised in that: further include following steps
It is rapid:
8) perdurable data and carry out Data Integration, after step 7), the object library by the data being pushed received into
Row persistence, and the data being pushed and authoritative library keep incidence relation.
8. rule-based Hose data push method according to claim 7, it is characterised in that: further include following steps
It is rapid:
9) after step 8), the processor calls logger, and the audit information of data-pushing request treatment process is remembered
Record is got off, and is saved in disk, and processor completes data-pushing request processing and data-pushing, is carried out down back to driving engine
The processing of one step.
9. rule-based Hose data push method according to claim 8, it is characterised in that: further include following steps
It is rapid:
10) after step 9), the driving engine receives data-pushing request processing result, responds authority by connector
Authoritative library data-pushing is informed the result is that success or failure in library, and the reason of with push failure, completes a data accordingly
Push request.
10. rule-based Hose data push method according to claim 9, it is characterised in that: further include following steps
It is rapid:
11) after step 10), the data being pushed can be packaged into the data format that object library can identify by the processor,
When carrying out data encapsulation, for different object library types, using different processors, after encapsulating data, it is pushed to phase
The object library answered.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511006362.2A CN105550355B (en) | 2015-12-29 | 2015-12-29 | Rule-based Hose data delivery system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511006362.2A CN105550355B (en) | 2015-12-29 | 2015-12-29 | Rule-based Hose data delivery system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105550355A CN105550355A (en) | 2016-05-04 |
| CN105550355B true CN105550355B (en) | 2019-03-15 |
Family
ID=55829544
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201511006362.2A Active CN105550355B (en) | 2015-12-29 | 2015-12-29 | Rule-based Hose data delivery system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105550355B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106997510B (en) * | 2017-04-01 | 2020-09-11 | 南京国电南自轨道交通工程有限公司 | Rule-based accident picture and emergency plan pushing method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104156798A (en) * | 2014-07-08 | 2014-11-19 | 四川中电启明星信息技术有限公司 | System data real-time push framework adopting enterprise authority source and method |
| KR20140147637A (en) * | 2013-06-20 | 2014-12-30 | 주식회사 데이타서브 | Server for providing monitering service of management objective server and method of thereof |
| WO2015002695A1 (en) * | 2013-07-05 | 2015-01-08 | Evernote Corporation | Selective data transformation and access for secure cloud analytics |
| CN104378399A (en) * | 2013-08-15 | 2015-02-25 | 腾讯科技（深圳）有限公司 | Data push method, platform server, client terminal and system |
| CN104468649A (en) * | 2013-09-16 | 2015-03-25 | 北大方正集团有限公司 | Server, terminal, data pushing system and data pushing method |
-
2015
- 2015-12-29 CN CN201511006362.2A patent/CN105550355B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20140147637A (en) * | 2013-06-20 | 2014-12-30 | 주식회사 데이타서브 | Server for providing monitering service of management objective server and method of thereof |
| WO2015002695A1 (en) * | 2013-07-05 | 2015-01-08 | Evernote Corporation | Selective data transformation and access for secure cloud analytics |
| CN104378399A (en) * | 2013-08-15 | 2015-02-25 | 腾讯科技（深圳）有限公司 | Data push method, platform server, client terminal and system |
| CN104468649A (en) * | 2013-09-16 | 2015-03-25 | 北大方正集团有限公司 | Server, terminal, data pushing system and data pushing method |
| CN104156798A (en) * | 2014-07-08 | 2014-11-19 | 四川中电启明星信息技术有限公司 | System data real-time push framework adopting enterprise authority source and method |
Non-Patent Citations (2)
| Title |
|---|
| VPN资源管理中Hose模型的研究;张宏伟,何岩;《光通信研究》;20050531(第131期);全文 |
| 基于Hose虚拟专用网络模型的网络资源优化与路由方法研究;王东;《中国优秀硕士学位论文全文数据库 信息科技辑》;20110415(第04期);全文 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105550355A (en) | 2016-05-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106874461B (en) | A kind of workflow engine supports multi-data source configuration security access system and method | |
| US8028200B2 (en) | Tracing operations in multiple computer systems | |
| US7886278B2 (en) | Object reference monitoring | |
| US8108234B2 (en) | System and method for deriving business processes | |
| CN104899274B (en) | A kind of memory database Efficient Remote access method | |
| US7779113B1 (en) | Audit management system for networks | |
| CN112260877A (en) | AI-based RPA robot management method, platform and storage medium | |
| CN106940643A (en) | Logical APP systems between the police and the people | |
| CN106708859A (en) | Auditing method for resource access behaviors and device | |
| CN109800081A (en) | A kind of management method and relevant device of big data task | |
| CN107704369A (en) | A kind of recording method of Operation Log, electronic equipment, storage medium, system | |
| CN102662655B (en) | The structure system and method for version | |
| CN103475546B (en) | Method and system for detecting repeated login of salesmen | |
| CN111048164A (en) | Medical big data long-term storage system | |
| CN105550355B (en) | Rule-based Hose data delivery system and method | |
| CN113962597A (en) | Data analysis method and device, electronic equipment and storage medium | |
| CN109743233A (en) | A kind of pair of strong identity authentication system carries out the method and computer equipment of data acquisition | |
| CN112700083A (en) | Method and device for constructing scene of resource comprehensive utilization and service index system | |
| CN106357466A (en) | Monitoring method for internet products and monitoring system | |
| CN108959309B (en) | Method and device for data analysis | |
| CN113778709B (en) | Interface calling method, device, server and storage medium | |
| CN113778777A (en) | Log playback method and device | |
| CN111459756A (en) | Log processing method and related equipment | |
| JP2002073585A (en) | Debugging support device, debugging support method, and recording medium | |
| CN112214484A (en) | Unmanned aerial vehicle data monitoring system, method, server and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |