CN108197176A - Core bank data processing method and its system based on distributed type assemblies framework - Google Patents
Core bank data processing method and its system based on distributed type assemblies framework Download PDFInfo
- Publication number
- CN108197176A CN108197176A CN201711393747.8A CN201711393747A CN108197176A CN 108197176 A CN108197176 A CN 108197176A CN 201711393747 A CN201711393747 A CN 201711393747A CN 108197176 A CN108197176 A CN 108197176A
- Authority
- CN
- China
- Prior art keywords
- transaction
- request message
- parameter
- transaction request
- message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/335—Filtering based on additional data, e.g. user or group profiles
- G06F16/337—Profile generation, learning or modification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/02—Banking, e.g. interest calculation or account maintenance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Computing Systems (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Computer Security & Cryptography (AREA)
- Technology Law (AREA)
- General Business, Economics & Management (AREA)
- Computational Linguistics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer And Data Communications (AREA)
Abstract
The present invention relates to core bank data processing method and its system based on distributed type assemblies framework, this method includes starting platform and loads related system table;Obtain transaction request message;Transaction request message is analyzed and processed, obtains parameter transaction;According to parameter transaction and transaction request message, corresponding transaction data is handled, obtains handling result;Return to handling result.The present invention is by the way that system table is loaded onto in shared drive, obtain faster transaction response speed, parameter transaction is pushed into record log, promote the efficiency of application system record log, and ensure reliability, when there are multiple transaction a system is formed using multiple servers, all request dynamics are assigned to by certain mechanism or method by all servers, realize dynamic load leveling, in data handling procedure, has service expansion capacity well, the dependence to the mainframe or middle-size and small-size server of IBM is broken away to a certain extent, it is at low cost, it is more flexible to hardware requirement.
Description
Technical field
The present invention relates to distributed cluster systems, more specifically refer to the core bank number based on distributed type assemblies framework
According to processing method and its system.
Background technology
At present, the core system of most banks all uses the host system of centralized architecture, operates in the host ZOS of IBM
Or under AIX system environment, the hardware that uses is mostly the single server such as IBM mainframe or middle-size and small-size server, application and development
Language used is COBOL.Centralized architecture can be realized is runed using concentration, proprietary, closing system software and tool
IT system, to ensure being perfectly safe for account and data.
The business diversity for developing and becoming increasingly complex with technology changes, and original core banking system also occurs centainly
Bottleneck, also there are some problems using the system processes data, it is as follows to handle the problem in data procedures:Due to original
Core system is using centralized architecture, and opposite can only penetrate increases check figure in core processing, memory number or replace higher one
The HardwareUpgrings modes such as the host of grade are come in response to upgrade cost is larger, can not have and service expansion capacity well to cope with not
The business demand come;COBOL, can only be in host ZOS or AIX as the procedural language for initially aiming at business application and designing
It is used under system environments, it is strong to the dependence of hardware;COBOL is relatively ancient, it is difficult to support following industry by Clustering
The increase of business amount;All be to operate under the host ZOS of IBM or AIX system environment, the hardware used be mostly IBM mainframe or
The single server such as middle-size and small-size server is very strong to the dependence of hardware.
Therefore, it is necessary to design a kind of core bank data processing method based on distributed type assemblies framework, data are realized
Processing procedure has service expansion capacity well, break away to a certain extent to the mainframe of IBM or middle-size and small-size server according to
Rely, it is at low cost, the growth of concurrent users quantity can be met, it is more flexible to hardware requirement.
Invention content
The defects of it is an object of the invention to overcome the prior art, provides the core bank number based on distributed type assemblies framework
According to processing method and its system.
To achieve the above object, the present invention uses following technical scheme:Core bank number based on distributed type assemblies framework
According to processing method, the method includes:
Start platform and load related system table;
Obtain transaction request message;
Transaction request message is analyzed and processed, obtains parameter transaction;
According to parameter transaction and transaction request message, corresponding transaction data is handled, obtains handling result;
Return to handling result.
Its further technical solution is:The step of starting platform and loading related system table, the related system table
It is defined including system initialization at least one in table, application definition table, database instruction allocation list and communication defined parameters table.
Its further technical solution is:The step of obtaining transaction request message, including step in detail below:
Obtain transaction request;
Format conversion is carried out to the XML format message of transaction request, forms the transaction request report of internal system processing format
Text.
Its further technical solution is:The step of being analyzed and processed to transaction request message, obtaining parameter transaction, including
Step in detail below:
Scheduler is started according to related system table;
Transaction request message is handled, obtains parameter transaction;
Parameter transaction is pushed in record log;
The transaction analysis that system level is done for parameter transaction is handled.
Its further technical solution is:According to parameter transaction and transaction request message, corresponding transaction data is handled, is obtained
The step of taking handling result, including step in detail below:
The associated component of business platform is called according to transaction request message;
According to the function subprogram of parameter transaction invocation component, corresponding transaction data is handled, obtains handling result.
The present invention also provides the core bank data processing systems based on distributed type assemblies framework, are configured including table single
Member, Receive message unit, parameter acquiring unit, data processing unit and result returning unit;
The table dispensing unit, for starting platform and loading related system table;
The Receive message unit, for obtaining transaction request message;
The parameter acquiring unit for being analyzed and processed to transaction request message, obtains parameter transaction;
The data processing unit, for according to parameter transaction and transaction request message, handling corresponding transaction data,
Obtain handling result;
The result returning unit, for returning to handling result.
Its further technical solution is:The Receive message unit includes acquisition request module and modular converter;
The acquisition request module, for obtaining transaction request;
The modular converter for carrying out format conversion to the XML format message of transaction request, forms internal system processing
The transaction request message of form.
Its further technical solution is:The parameter acquiring unit includes scheduler starting module, message processing module (MPM), pushes away
Send module and transaction analysis module;
The scheduler starting module, for starting scheduler according to related system table;
The message processing module (MPM) for handling transaction request message, obtains parameter transaction;
The pushing module, for parameter transaction to be pushed in record log;
The transaction analysis module, for being directed to the transaction analysis processing that parameter transaction does system level.
Its further technical solution is:The data processing unit includes component call module and result acquisition module;
The component call module, for calling the associated component of business platform according to transaction request message;
The result acquisition module for the function subprogram according to parameter transaction invocation component, handles corresponding transaction
Data obtain handling result.
Compared with the prior art, the invention has the advantages that:The core bank based on distributed type assemblies framework of the present invention
Data processing method by the way that system table is loaded onto in shared drive, obtains faster transaction response speed, is asked to transaction
It asks in processing procedure, parameter transaction is pushed into KAFKA log server record logs, promotes the effect of application system record log
Rate, and ensure reliability, processing is traded, and return according to the component of system table configuration service platform and corresponding program
Handling result is returned, a system is formed using multiple servers when there are multiple transaction, by certain mechanism or method by institute
Some request dynamics are assigned to all servers, realize dynamic load leveling, in data handling procedure, have good service
Expansion capacity breaks away from the dependence to the mainframe or middle-size and small-size server of IBM to a certain extent, at low cost, can meet and concurrently visit
Ask the growth of number of users, it is more flexible to hardware requirement.
The invention will be further described in the following with reference to the drawings and specific embodiments.
Description of the drawings
Fig. 1 is the core bank data processing method based on distributed type assemblies framework that the specific embodiment of the invention provides
Flow chart;
Fig. 2 is the structure diagram of distributed type assemblies framework that the specific embodiment of the invention provides;
Fig. 3 is the flow chart of acquisition transaction request message that the specific embodiment of the invention provides;
Fig. 4 analyzes and processes transaction request message and obtains parameter transaction for what the specific embodiment of the invention provided
Flow chart;
Fig. 5 be the specific embodiment of the invention provide according to parameter transaction and the corresponding transaction of transaction request Message processing
Data and the flow chart for obtaining handling result;
Fig. 6 is the core bank data processing system based on distributed type assemblies framework that the specific embodiment of the invention provides
Structure diagram;
Fig. 7 is the structure diagram of Receive message unit that the specific embodiment of the invention provides;
Fig. 8 is the structure diagram of parameter acquiring unit that the specific embodiment of the invention provides;
Fig. 9 is the structure diagram of data processing unit that the specific embodiment of the invention provides;
Figure 10 is the core bank data processing method based on distributed type assemblies framework that the specific embodiment of the invention provides
Treatment effeciency schematic diagram.
Specific embodiment
In order to more fully understand the present invention technology contents, with reference to specific embodiment to technical scheme of the present invention into
One step introduction and explanation, but not limited to this.
Specific embodiment as shown in Fig. 1~10, the core bank provided in this embodiment based on distributed type assemblies framework
Data processing method can be used in bank, investment platform, stock exchange platform etc., realize that data handling procedure has very well
Service expansion capacity, break away from the dependence to the mainframe or middle-size and small-size server of IBM to a certain extent, it is at low cost, can meet
The growth of concurrent users quantity is more flexible to hardware requirement.
As shown in Figure 1, present embodiments provide the core bank data processing method based on distributed type assemblies framework, the party
Method includes:
S1, start platform and load related system table;
S2, transaction request message is obtained;
S3, transaction request message is analyzed and processed, obtains parameter transaction;
S4, according to parameter transaction and transaction request message, handle corresponding transaction data, obtain handling result;
S5, handling result is returned.
The distributed type assemblies framework is built by the way of distributed type assemblies deployment, uses Akka Cluster (cluster) frame
Structure provides aggregated structure support, has 7X24 hours continual services, hardware is facilitated to expand, lifting system processing capacity, distribution
Formula clustering design is easy to extending transversely, can facilitate deployment according to business transaction demand dynamic increase and decrease cluster server quantity, be easy to
Management, and single server failure does not influence arm's length dealing, it is ensured that the real-time of transaction 24 hours, duration.The distribution
Aggregated structure includes medium platform, basic platform, business platform and transaction execution part, basic platform and uses Scala languages
Distributed class libraries of making peace is developed, and application program is developed using Java language, and operation on a java virtual machine, has cross-platform operation
Characteristic, Scala therein are run on the Java platform of standard, can merge face with all seamless interactions in Java libraries
The various characteristics programmed to object and function formula, realize cross-platform characteristic.It is developed using distributed class libraries, Akka is to use
The library that Scala writes aims at and makes the fault-tolerant real-time application system of high concurrent, height and give birth to, and Akka is used for based on Actor models
High concurrent, distribution, fault tolerant, the event driven application based on JVM are built, the Distributed Application of structure high concurrent is made more to hold
Easily.Some are loaded into memory by basic platform than relatively time-consuming service allocation list in platform initial start stage, to obtain faster hand over
Easy response speed, while KAFKA log server record log LOG are used, the efficiency of application system record log is promoted, and really
Reliability is protected, using dynamic load leveling ability, a system is formed using multiple servers, passes through certain mechanism or method
All request dynamics are assigned to all servers, realize several times of performances better than individual server processing.
As shown in Fig. 2, distributed type assemblies framework is the logical process mechanism of basic platform and business platform, transaction execution group
Core application is supported into three-tier architecture.
In certain embodiments, above-mentioned S1 steps, the step of starting platform and load related system table, the correlation
System table is defined including system initialization in table, application definition table, database instruction allocation list and communication defined parameters table
It is at least one.Specifically, loading related system table is loaded by the configuration manager in basic platform, by above-mentioned phase
Relationship system table is loaded into the shared drive between cluster, the configuration of associated component and program and calling when being traded, in this way,
In the case where multiple business transactions are carried out at the same time, can be expanded by increasing the number of servers in cluster to cope with business scale
The problem of big, it is only necessary to which server obtains the configuration of associated component and program when corresponding table is traded from shared drive
And calling, you can have the basis of processing transaction, it, can be with using the load balancing between server cluster by increasing server
Meet the growth of concurrent users number.Some are loaded into memory than relatively time-consuming service allocation list in platform initial start stage,
To obtain faster transaction response speed.
Further, in certain embodiments, above-mentioned S2 steps, obtain transaction request message the step of, including with
Lower specific steps:
S21, transaction request is obtained;
S22, format conversion is carried out to the XML format message of transaction request, the transaction for forming internal system processing format please
Seek message.
For above-mentioned S21 steps, specifically front end sends transaction request, such as the shifting for passing through client by medium platform
Application program in dynamic terminal initiates transaction request, which can be remittance or buy the requests such as fund.
It is flat to basis by medium platform transmitted transaction request (the transaction request form is XML) for above-mentioned S22 steps
The message format of platform transaction request herein is exactly XML or other message formats, and platform can convert the message of transaction request
Into internal system processing format.Transaction request message is received by the decoder in basic platform, makees message conversion process, by XML
The transaction request message of form is converted to the transaction request message of internal system processing format.
Further, in certain embodiments, above-mentioned S3 steps, analyze and process transaction request message, obtain
The step of taking parameter transaction, including step in detail below:
S31, scheduler is started according to related system table;
S32, transaction request message is handled, obtains parameter transaction;
S33, parameter transaction is pushed in record log;
S34, the transaction analysis processing that system level is done for parameter transaction.
For above-mentioned S31 steps and above-mentioned S32 steps, configuration manager is according to the parameter in related system table
Start scheduler, receive transaction request message and handled, specifically carry out the extraction process of data, obtain relationship trading ginseng
Transaction request message is forwarded to corresponding blocker by number, scheduler according to relationship trading parameter.
For above-mentioned S33 steps to above-mentioned S34 steps, specifically blocker receives transaction request message, just
Relationship trading parameter first can be pushed into KAFKA server record logs, then do system level before formula processing transaction request message
Transaction analysis processing, such as transaction stroke count statistics, priority ranking etc.;For some without core processing, DB need not be accessed
The special deal of (database) can directly do return processing at this time;Such as network connectivity echo transaction etc., message after having handled
Next component is ported to, to improve the efficiency of data processing, using KAFKA log server record logs, promotes application system
The efficiency for record log of uniting, and ensure reliability.
Further, in certain embodiments, above-mentioned S4 steps, according to parameter transaction and transaction request message,
The step of handling corresponding transaction data, obtaining handling result, including step in detail below:
S41, the associated component that business platform is called according to transaction request message;
S42, the function subprogram according to parameter transaction invocation component handle corresponding transaction data, obtain handling result.
For above-mentioned S41 steps, the trading processing actuator of basic platform receives transaction request message, calls business
The associated component of platform.
For above-mentioned S41 steps, request message circulates to business platform layer, by unified transaction processor according to transaction
Parameter and system table style play corresponding function subprogram;Each function subprogram handles corresponding transaction data, according to not
Service logic with transaction transfers corresponding platform class service module or transaction grade service module, and phase has been adjusted if access list is related to
The data base tool answered carries out related data table handling;The integrality and consistency of transaction are ensured by the data base tool of platform.
For above-mentioned S5 steps, trading processing finishes, and generates response message, that is, handling result, successively returns;Such as
Lower order:Transaction modules, the transaction processor of business platform layer, base platform trading processing actuator, response message block
Cut device (can equally do note LOG or other analyzing and processing), scheduler, transcoder (internal form is switched into XML), response message hair
It send to medium platform;Medium platform receives response message, without remaking transcoding processing, directly returns to respective front ends.
Parameter transaction is pushed to KAFKA server record logs above-mentioned, it is also necessary to which setting merchandises stroke count as N+1, mesh
Be for system statistics trading volume;For above-mentioned S5 steps, during handling result is returned, it is also necessary to by handling result
KAFKA server record logs are sent to, and transaction stroke count N-1 is set.
Due to above-mentioned data handling procedure based on server and open source software come build network system carry out, can be certain
The dependence to the mainframe or middle-size and small-size server of IBM is broken away from degree, thus very much, formation cost can be saved in IT inputs
Advantage;Data handling procedure has dynamic load leveling ability, and hardware system performance upgrading is supported to expand with quantity completely, is passed through
Increase server, using the load balancing between server cluster, the growth of concurrent users number can be met;It enables when dirty
The capable Scala language that can be run under Java context and distributed class libraries, based on JVM virtual units, have cross-platform spy
Property, it is more flexible to hardware requirement.
By taking the process flow that the transaction 6130 for withdrawing detailed single record is employed in an inquiry as an example, which mainly looks into
The detailed consumption (employing) of client, (withdrawal) information of refunding record content are ask, the transaction in platform is registered first, is registered
Transaction request message (XML format) is sent to medium platform afterwards, is then forwarded to the decoder of basic platform, by XML message
It is converted into the processing format of internal system;Configuration manager starts scheduler according to relevant system parameters, and receiving processing transaction please
Message is sought, transaction is sent to by corresponding blocker according to parameter transaction in 6130 messages;Blocker receives transaction request report
6130 parameter transaction is first pushed to KAFKA server record logs by Wen Hou, and setting transaction stroke count is N+1, is system statistics
After trading volume, transaction request message is forwarded to trading processing actuator;Trading processing actuator receives transaction request message
Afterwards, the associated components of 6130 transaction of processing have been adjusted on business platform, in business platform layer, by unified transaction processor according to
6130 configuration parameter tune plays corresponding function subprogram, when function subprogram handles 6130 transaction data, according to transaction
Service logic transfers corresponding platform class service module and transaction grade service module again, which is related to looking into tables of data
It askes, corresponding data base tool can also have been adjusted to carry out related data table handling, that is to say, that business platform and transaction execution part
Inquiry client's employs and withdraws record, by the processing of business platform layer and transaction execution level to transaction data, if transaction
Success, returns to successful response message, otherwise returns to the response message of failure to the trading processing actuator of basic platform;Response
Message first gives response data to KAFKA server record logs, setting transaction stroke count N-1 equally in blocker is responded;Turning
The built-in message format conversion responded in code device by 6130 is XML message, and front end is returned to by medium platform.It is surveyed through excess pressure
Examination, the operational efficiency of transaction is as shown in Figure 10, and test is often increased a server, about may be used using cluster service laterally expand
Increase by 80% single machine treatment effeciency.
By way of further example:Start platform and load related system table, medium platform forwards one and initiated by electric business platform
The inquiry transaction of credit accounts consumption details to basic platform.There is the consumer finance in the request message of consumption details inquiry transaction
The information such as account, inquiry commencement date and deadline, starting detail record serial number, the detailed quantity of inquiry, should by the decoder of basic platform
Transaction message format conversion is the data format of platform interior;The transaction message of the scheduler handle internal form obtains transaction phase
Transaction request message is forwarded to corresponding blocker by related parameter information according to parameter transaction, and blocker receives transaction please
Message is sought, can relationship trading parameter first be pushed into KAFKA server record logs before formally processing transaction request message,
Then the transaction analysis processing of system level is done, this transaction for system in addition to handling transaction stroke count N+1, if the inquiry of input is bright
The amount of counting accurately>10, change detailed quantity=10 of inquiry, if the consumer finance account of input is sky, without doing core processing again,
Return processing directly is done, the function subprogram of the associated component of business platform is otherwise called according to transaction request message;If this
The execution pattern of example is for 24 hours, then calls the function subprogram of pattern for 24 hours, otherwise calls other subprograms;Handle the number of deals
According to, need to have adjusted corresponding data base tool to carry out related data table handling, obtained in data table related employ detailed shelves and
Wealth pays logical sequence information shelves information, obtains credit score detail file data, if the data are normal, obtains consumption single-candidate information by stages
The relevant informations such as shelves, if being not present, reading terminates, then read to employ the detailed shelves of withdrawal and consumption single-candidate by stages information shelves calculate it is bright
Thin record sum and detail record total amount, if return code is 0, export detail record sum and detail record total amount,
If can not find record, the output phase answers error message;Trading processing finishes, and the transaction processor of business platform is by the letter of output
With account consumption details or error message back to basic platform, then successively returning response data to intermediary puts down basic platform
Platform is equally note LOG with input in response message blocker, is system transaction statistic N-1, by internal lattice in transcoder
The response message of formula is converted to XML message.
The above-mentioned core bank data processing method based on distributed type assemblies framework, by the way that system table is loaded onto altogether
It enjoys in memory, obtains faster transaction response speed, in transaction request processing procedure, parameter transaction is pushed into KAFKA
Log server record log, promotes the efficiency of application system record log, and ensures reliability, and industry is configured according to system table
The component of business platform and corresponding program are traded processing, and return to handling result, occur utilizing during multiple transaction multiple
Server forms a system, and all request dynamics are assigned to all servers by certain mechanism or method, real
Existing dynamic load leveling in data handling procedure, has service expansion capacity well, is broken away to a certain extent to the big of IBM
The dependence of type machine or middle-size and small-size server, it is at low cost, the growth of concurrent users quantity can be met, it is more clever to hardware requirement
It is living.
As shown in fig. 6, the present embodiment additionally provides the core bank data processing system based on distributed type assemblies framework,
Including table dispensing unit 1, Receive message unit 2, parameter acquiring unit 3, data processing unit 4 and result returning unit 5.
Table dispensing unit 1, for starting platform and loading related system table.
Receive message unit 2, for obtaining transaction request message.
Parameter acquiring unit 3 for being analyzed and processed to transaction request message, obtains parameter transaction.
Data processing unit 4, for according to parameter transaction and transaction request message, handling corresponding transaction data, obtaining
Take handling result.
As a result returning unit 5, for returning to handling result.
The distributed type assemblies framework is built by the way of distributed type assemblies deployment, uses Akka Cluster (cluster) frame
Structure provides aggregated structure support, has 7X24 hours continual services, hardware is facilitated to expand, lifting system processing capacity, distribution
Formula clustering design is easy to extending transversely, can facilitate deployment according to business transaction demand dynamic increase and decrease cluster server quantity, be easy to
Management, and single server failure does not influence arm's length dealing, it is ensured that the real-time of transaction 24 hours, duration.The distribution
Aggregated structure includes medium platform, basic platform, business platform and transaction execution part, basic platform and uses Scala languages
Distributed class libraries of making peace is developed, and application program is developed using Java language, and operation on a java virtual machine, has cross-platform operation
Characteristic, Scala therein are run on the Java platform of standard, can merge face with all seamless interactions in Java libraries
The various characteristics programmed to object and function formula, realize cross-platform characteristic.It is developed using distributed class libraries, Akka is to use
The library that Scala writes aims at and makes the fault-tolerant real-time application system of high concurrent, height and give birth to, and Akka is used for based on Actor models
High concurrent, distribution, fault tolerant, the event driven application based on JVM are built, the Distributed Application of structure high concurrent is made more to hold
Easily.Some are loaded into memory by basic platform than relatively time-consuming service allocation list in platform initial start stage, to obtain faster hand over
Easy response speed, while KAFKA log server record log LOG are used, the efficiency of application system record log is promoted, and really
Reliability is protected, using dynamic load leveling ability, a system is formed using multiple servers, passes through certain mechanism or method
All request dynamics are assigned to all servers, realize several times of performances better than individual server processing.
As shown in Fig. 2, distributed type assemblies framework is the logical process mechanism of basic platform and business platform, transaction execution group
Core application is supported into three-tier architecture.
In certain embodiments, the related system table involved by above-mentioned table dispensing unit 1 includes system initialization
It defines at least one in table, application definition table, database instruction allocation list and communication defined parameters table.Specifically, loading phase
Relationship system table is loaded by the configuration manager in basic platform, and above-mentioned related system table is loaded between cluster
Shared drive in, the configuration of associated component and program and calling when being traded, in this way, being carried out at the same time in multiple business transactions
In the case of, the problem of business scale expands can be coped with by increasing the number of servers in cluster, it is only necessary to server
Configuration and the calling of associated component and program when corresponding table is traded are obtained from shared drive, you can have processing and hand over
Easy basis by increasing server, using the load balancing between server cluster, can meet the increasing of concurrent users number
It is long.Some are loaded into memory than relatively time-consuming service allocation list in platform initial start stage, to obtain faster transaction response speed
Degree.
Further, in certain embodiments, above-mentioned Receive message unit 2 includes acquisition request module 21 and turns
Change the mold block 22.
Acquisition request module 21, for obtaining transaction request.Specifically front end sends transaction request by medium platform, than
Transaction request is such as initiated by the application program on the mobile terminal of client, which can be remittance or buy fund etc. please
It asks.
Modular converter 22 for carrying out format conversion to the transaction request message of XML format, forms internal system processing lattice
The transaction request message of formula.It is handed over herein to basic platform by medium platform transmitted transaction request (the transaction request form is XML)
The message format easily asked is exactly XML or other message formats, and the message of transaction request can be converted into system by platform
Portion's processing format.Transaction request message is received by the decoder in basic platform, makees message conversion process, by the friendship of XML format
Easy request message is converted to the transaction request message of internal system processing format.
Further, in certain embodiments, above-mentioned parameter acquiring unit 3 includes scheduler starting module 31, report
Literary processing module 32, pushing module 33 and transaction analysis module 34.
Scheduler starting module 31, for starting scheduler according to related system table.
Message processing module (MPM) 32 for handling transaction request message, obtains parameter transaction.
Pushing module 33, for parameter transaction to be pushed in record log.
Transaction analysis module 34, for being directed to the transaction analysis processing that parameter transaction does system level.
For above-mentioned scheduler starting module 31 and message processing module (MPM) 32, configuration manager is according to related system table
Parameter in lattice starts scheduler, receives transaction request message and is handled, specifically carry out the extraction process of data, obtains phase
Parameter transaction is closed, transaction request message is forwarded to corresponding blocker by scheduler according to relationship trading parameter.
For above-mentioned pushing module 33 and transaction analysis module 34, specifically blocker receives transaction request report
Relationship trading parameter first can be pushed KAFKA server record logs, then do and be by text before formally processing transaction request message
The transaction analysis processing of system level, such as transaction stroke count statistics, priority ranking etc.;For some without core processing, need not
The special deal of DB (database) is accessed, can directly do return processing at this time;Such as network connectivity echo transaction etc., it has handled
Message is ported to next component afterwards, to improve the efficiency of data processing, using KAFKA log server record logs, is promoted
The efficiency of application system record log, and ensure reliability.
Further, in certain embodiments, above-mentioned data processing unit 4 includes component call module 41 and knot
Fruit acquisition module 42.
Component call module 41, for calling the associated component of business platform according to transaction request message.Basic platform
Trading processing actuator receives transaction request message, calls the associated component of business platform.
As a result acquisition module 42 for the function subprogram according to parameter transaction invocation component, handle corresponding number of deals
According to acquisition handling result.Request message circulates to business platform layer, according to parameter transaction and is by unified transaction processor
Table tune of uniting plays corresponding function subprogram;Each function subprogram handles corresponding transaction data, according to the industry of different transaction
Business logic transfers corresponding platform class service module or transaction grade service module, and corresponding database has been adjusted if access list is related to
Tool carries out related data table handling;The integrality and consistency of transaction are ensured by the data base tool of platform.
For above-mentioned result returning unit 5, trading processing finishes, and generates response message, that is, handling result,
Successively return;Following order:Transaction modules, the transaction processor of business platform layer, base platform trading processing actuator,
Response message blocker (can equally do note LOG or other analyzing and processing), scheduler, transcoder (internal form is switched into XML),
Response message is sent to medium platform;Medium platform receives response message, without remaking transcoding processing, before directly returning accordingly
End.
Parameter transaction is pushed to KAFKA server record logs above-mentioned, it is also necessary to which setting merchandises stroke count as N+1, mesh
Be for system statistics trading volume;For above-mentioned S5 steps, during handling result is returned, it is also necessary to by handling result
KAFKA server record logs are sent to, and transaction stroke count N-1 is set.
Due to above-mentioned data handling procedure based on server and open source software come build network system carry out, can be certain
The dependence to the mainframe or middle-size and small-size server of IBM is broken away from degree, thus very much, formation cost can be saved in IT inputs
Advantage;Data handling procedure has dynamic load leveling ability, and hardware system performance upgrading is supported to expand with quantity completely, is passed through
Increase server, using the load balancing between server cluster, the growth of concurrent users number can be met;It enables when dirty
The capable Scala language that can be run under Java context and distributed class libraries, based on JVM virtual units, have cross-platform spy
Property, it is more flexible to hardware requirement.
By taking the process flow that the transaction 6130 for withdrawing detailed single record is employed in an inquiry as an example, which mainly looks into
The detailed consumption (employing) of client, (withdrawal) information of refunding record content are ask, the transaction in platform is registered first, is registered
Transaction request message (XML format) is sent to medium platform afterwards, is then forwarded to the decoder of basic platform, by XML message
It is converted into the processing format of internal system;Configuration manager starts scheduler according to relevant system parameters, and receiving processing transaction please
Message is sought, transaction is sent to by corresponding blocker according to parameter transaction in 6130 messages;Blocker receives transaction request report
6130 parameter transaction is first pushed to KAFKA server record logs by Wen Hou, and setting transaction stroke count is N+1, is system statistics
After trading volume, transaction request message is forwarded to trading processing actuator;Trading processing actuator receives transaction request message
Afterwards, the associated components of 6130 transaction of processing have been adjusted on business platform, in business platform layer, by unified transaction processor according to
6130 configuration parameter tune plays corresponding function subprogram, when function subprogram handles 6130 transaction data, according to transaction
Service logic transfers corresponding platform class service module and transaction grade service module again, which is related to looking into tables of data
It askes, corresponding data base tool can also have been adjusted to carry out related data table handling, that is to say, that business platform and transaction execution part
Inquiry client's employs and withdraws record, by the processing of business platform layer and transaction execution level to transaction data, if transaction
Success, returns to successful response message, otherwise returns to the response message of failure to the trading processing actuator of basic platform;Response
Message first gives response data to KAFKA server record logs, setting transaction stroke count N-1 equally in blocker is responded;Turning
The built-in message format conversion responded in code device by 6130 is XML message, and front end is returned to by medium platform.It is surveyed through excess pressure
Examination, the operational efficiency of transaction is as shown in Figure 10, and test is often increased a server, about may be used using cluster service laterally expand
Increase by 80% single machine treatment effeciency.
By way of further example:Start platform and load related system table, medium platform forwards one and initiated by electric business platform
The inquiry transaction of credit accounts consumption details to basic platform.There is the consumer finance in the request message of consumption details inquiry transaction
The information such as account, inquiry commencement date and deadline, starting detail record serial number, the detailed quantity of inquiry, should by the decoder of basic platform
Transaction message format conversion is the data format of platform interior;The transaction message of the scheduler handle internal form obtains transaction phase
Transaction request message is forwarded to corresponding blocker by related parameter information according to parameter transaction, and blocker receives transaction please
Message is sought, can relationship trading parameter first be pushed into KAFKA server record logs before formally processing transaction request message,
Then the transaction analysis processing of system level is done, this transaction for system in addition to handling transaction stroke count N+1, if the inquiry of input is bright
The amount of counting accurately>10, change detailed quantity=10 of inquiry, if the consumer finance account of input is sky, without doing core processing again,
Return processing directly is done, the function subprogram of the associated component of business platform is otherwise called according to transaction request message;If this
The execution pattern of example is for 24 hours, then calls the function subprogram of pattern for 24 hours, otherwise calls other subprograms;Handle the number of deals
According to, need to have adjusted corresponding data base tool to carry out related data table handling, obtained in data table related employ detailed shelves and
Wealth pays logical sequence information shelves information, obtains credit score detail file data, if the data are normal, obtains consumption single-candidate information by stages
The relevant informations such as shelves, if being not present, reading terminates, then read to employ the detailed shelves of withdrawal and consumption single-candidate by stages information shelves calculate it is bright
Thin record sum and detail record total amount, if return code is 0, export detail record sum and detail record total amount,
If can not find record, the output phase answers error message;Trading processing finishes, and the transaction processor of business platform is by the letter of output
With account consumption details or error message back to basic platform, then successively returning response data to intermediary puts down basic platform
Platform is equally note LOG with input in response message blocker, is system transaction statistic N-1, by internal lattice in transcoder
The response message of formula is converted to XML message.
The above-mentioned core bank data processing system based on distributed type assemblies framework, by the way that system table is loaded onto altogether
It enjoys in memory, obtains faster transaction response speed, in transaction request processing procedure, parameter transaction is pushed into KAFKA
Log server record log, promotes the efficiency of application system record log, and ensures reliability, and industry is configured according to system table
The component of business platform and corresponding program are traded processing, and return to handling result, occur utilizing during multiple transaction multiple
Server forms a system, and all request dynamics are assigned to all servers by certain mechanism or method, real
Existing dynamic load leveling in data handling procedure, has service expansion capacity well, is broken away to a certain extent to the big of IBM
The dependence of type machine or middle-size and small-size server, it is at low cost, the growth of concurrent users quantity can be met, it is more clever to hardware requirement
It is living.
It is above-mentioned only with embodiment come the technology contents that further illustrate the present invention, in order to which reader is easier to understand, but not
It represents embodiments of the present invention and is only limitted to this, any technology done according to the present invention extends or recreation, by the present invention's
Protection.Protection scope of the present invention is subject to claims.
Claims (9)
1. the core bank data processing method based on distributed type assemblies framework, which is characterized in that the method includes:
Start platform and load related system table;
Obtain transaction request message;
Transaction request message is analyzed and processed, obtains parameter transaction;
According to parameter transaction and transaction request message, corresponding transaction data is handled, obtains handling result;
Return to handling result.
2. the core bank data processing method according to claim 1 based on distributed type assemblies framework, which is characterized in that
Start platform and the step of load related system table, it is fixed that the related system table including system initialization defines table, program
It is at least one in adopted table, database instruction allocation list and communication defined parameters table.
3. the core bank data processing method according to claim 1 based on distributed type assemblies framework, which is characterized in that
The step of obtaining transaction request message, including step in detail below:
Obtain transaction request;
Format conversion is carried out to the XML format message of transaction request, forms the transaction request message of internal system processing format.
4. the core bank data processing method according to claim 3 based on distributed type assemblies framework, which is characterized in that
The step of being analyzed and processed to transaction request message, obtaining parameter transaction, including step in detail below:
Scheduler is started according to related system table;
Transaction request message is handled, obtains parameter transaction;
Parameter transaction is pushed in record log;
The transaction analysis that system level is done for parameter transaction is handled.
5. the core bank data processing method according to any one of claims 1 to 4 based on distributed type assemblies framework,
It is characterized in that, according to parameter transaction and transaction request message, the step of handling corresponding transaction data, obtain handling result,
Including step in detail below:
The associated component of business platform is called according to transaction request message;
According to the function subprogram of parameter transaction invocation component, corresponding transaction data is handled, obtains handling result.
6. the core bank data processing system based on distributed type assemblies framework, which is characterized in that including table dispensing unit, report
Literary acquiring unit, parameter acquiring unit, data processing unit and result returning unit;
The table dispensing unit, for starting platform and loading related system table;
The Receive message unit, for obtaining transaction request message;
The parameter acquiring unit for being analyzed and processed to transaction request message, obtains parameter transaction;
The data processing unit, for according to parameter transaction and transaction request message, handling corresponding transaction data, obtaining
Handling result;
The result returning unit, for returning to handling result.
7. according to the core bank data processing system based on distributed type assemblies framework described in claim 6, which is characterized in that institute
It states Receive message unit and includes acquisition request module and modular converter;
The acquisition request module, for obtaining transaction request;
The modular converter for carrying out format conversion to the XML format message of transaction request, forms internal system processing format
Transaction request message.
8. according to the core bank data processing system based on distributed type assemblies framework described in claim 7, which is characterized in that institute
It states parameter acquiring unit and includes scheduler starting module, message processing module (MPM), pushing module and transaction analysis module;
The scheduler starting module, for starting scheduler according to related system table;
The message processing module (MPM) for handling transaction request message, obtains parameter transaction;
The pushing module, for parameter transaction to be pushed in record log;
The transaction analysis module, for being directed to the transaction analysis processing that parameter transaction does system level.
9. according to the core bank data processing system according to any one of claims 8 based on distributed type assemblies framework, which is characterized in that institute
It states data processing unit and includes component call module and result acquisition module;
The component call module, for calling the associated component of business platform according to transaction request message;
The result acquisition module for the function subprogram according to parameter transaction invocation component, handles corresponding transaction data,
Obtain handling result.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711393747.8A CN108197176A (en) | 2017-12-21 | 2017-12-21 | Core bank data processing method and its system based on distributed type assemblies framework |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711393747.8A CN108197176A (en) | 2017-12-21 | 2017-12-21 | Core bank data processing method and its system based on distributed type assemblies framework |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108197176A true CN108197176A (en) | 2018-06-22 |
Family
ID=62583446
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201711393747.8A Pending CN108197176A (en) | 2017-12-21 | 2017-12-21 | Core bank data processing method and its system based on distributed type assemblies framework |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108197176A (en) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109547575A (en) * | 2019-01-04 | 2019-03-29 | 中国银行股份有限公司 | A kind of data dispatching method, device and equipment |
CN109636586A (en) * | 2018-11-29 | 2019-04-16 | 中国人民银行清算总中心 | A kind of distribution internet banking system and control method |
CN109658225A (en) * | 2018-11-29 | 2019-04-19 | 中国人民银行清算总中心 | Multicenter distributed internet banking system and service message processing method mostly living |
CN110175792A (en) * | 2019-06-05 | 2019-08-27 | 无锡职业技术学院 | A kind of transition of bank outlets and workload examine auxiliary system |
CN110795003A (en) * | 2019-10-30 | 2020-02-14 | 邵忠 | Interface display method and device |
CN110827139A (en) * | 2019-10-31 | 2020-02-21 | 中国工商银行股份有限公司 | Behavior feature-based bank hacker user identification method and device |
CN111709731A (en) * | 2020-06-18 | 2020-09-25 | 深圳前海微众银行股份有限公司 | Transaction processing method and device |
CN111899087A (en) * | 2020-06-16 | 2020-11-06 | 中国建设银行股份有限公司 | Data providing method and device, electronic equipment and computer readable storage medium |
CN111967874A (en) * | 2020-08-17 | 2020-11-20 | 中国银行股份有限公司 | Transaction log recording method and device |
CN112633867A (en) * | 2020-12-30 | 2021-04-09 | 中国农业银行股份有限公司 | Transaction request processing method and device |
CN112671877A (en) * | 2020-12-16 | 2021-04-16 | 中国建设银行股份有限公司 | Data processing method and device |
CN113065953A (en) * | 2020-12-01 | 2021-07-02 | 上海金融期货信息技术有限公司 | Futures relay trading system based on distribution |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6138143A (en) * | 1999-01-28 | 2000-10-24 | Genrad, Inc. | Method and apparatus for asynchronous transaction processing |
CN101093572A (en) * | 2007-07-20 | 2007-12-26 | 中国建设银行股份有限公司 | A preposition system and a centralized data processing system |
CN106201542A (en) * | 2016-07-14 | 2016-12-07 | 张博 | A kind of WOF quick development platform |
CN106210109A (en) * | 2016-07-26 | 2016-12-07 | 通联支付网络服务股份有限公司 | A kind of product systems for aggregate payment |
CN106775486A (en) * | 2016-12-26 | 2017-05-31 | 中国建设银行股份有限公司 | Data access system, method and routing server, configuration center server |
CN106789335A (en) * | 2017-01-13 | 2017-05-31 | 泰康保险集团股份有限公司 | A kind of method and system for processing information |
-
2017
- 2017-12-21 CN CN201711393747.8A patent/CN108197176A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6138143A (en) * | 1999-01-28 | 2000-10-24 | Genrad, Inc. | Method and apparatus for asynchronous transaction processing |
CN101093572A (en) * | 2007-07-20 | 2007-12-26 | 中国建设银行股份有限公司 | A preposition system and a centralized data processing system |
CN106201542A (en) * | 2016-07-14 | 2016-12-07 | 张博 | A kind of WOF quick development platform |
CN106210109A (en) * | 2016-07-26 | 2016-12-07 | 通联支付网络服务股份有限公司 | A kind of product systems for aggregate payment |
CN106775486A (en) * | 2016-12-26 | 2017-05-31 | 中国建设银行股份有限公司 | Data access system, method and routing server, configuration center server |
CN106789335A (en) * | 2017-01-13 | 2017-05-31 | 泰康保险集团股份有限公司 | A kind of method and system for processing information |
Non-Patent Citations (1)
Title |
---|
韩健: "基于Hadoop技术的银行大数据平台架构设计", 《电子世界》 * |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109636586B (en) * | 2018-11-29 | 2020-08-28 | 中国人民银行清算总中心 | Distributed internet bank system and control method |
CN109636586A (en) * | 2018-11-29 | 2019-04-16 | 中国人民银行清算总中心 | A kind of distribution internet banking system and control method |
CN109658225A (en) * | 2018-11-29 | 2019-04-19 | 中国人民银行清算总中心 | Multicenter distributed internet banking system and service message processing method mostly living |
CN109547575A (en) * | 2019-01-04 | 2019-03-29 | 中国银行股份有限公司 | A kind of data dispatching method, device and equipment |
CN110175792A (en) * | 2019-06-05 | 2019-08-27 | 无锡职业技术学院 | A kind of transition of bank outlets and workload examine auxiliary system |
CN110795003A (en) * | 2019-10-30 | 2020-02-14 | 邵忠 | Interface display method and device |
CN110827139A (en) * | 2019-10-31 | 2020-02-21 | 中国工商银行股份有限公司 | Behavior feature-based bank hacker user identification method and device |
CN111899087A (en) * | 2020-06-16 | 2020-11-06 | 中国建设银行股份有限公司 | Data providing method and device, electronic equipment and computer readable storage medium |
CN111709731A (en) * | 2020-06-18 | 2020-09-25 | 深圳前海微众银行股份有限公司 | Transaction processing method and device |
CN111967874A (en) * | 2020-08-17 | 2020-11-20 | 中国银行股份有限公司 | Transaction log recording method and device |
CN111967874B (en) * | 2020-08-17 | 2023-09-19 | 中国银行股份有限公司 | Transaction log recording method and device |
CN113065953A (en) * | 2020-12-01 | 2021-07-02 | 上海金融期货信息技术有限公司 | Futures relay trading system based on distribution |
CN113065953B (en) * | 2020-12-01 | 2023-11-21 | 上海金融期货信息技术有限公司 | Futures relay trading system based on distribution type |
CN112671877A (en) * | 2020-12-16 | 2021-04-16 | 中国建设银行股份有限公司 | Data processing method and device |
CN112633867A (en) * | 2020-12-30 | 2021-04-09 | 中国农业银行股份有限公司 | Transaction request processing method and device |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108197176A (en) | Core bank data processing method and its system based on distributed type assemblies framework | |
US11276066B2 (en) | Methods and systems for providing a decision making platform | |
US8126791B2 (en) | Methods and systems for providing a decision making platform | |
CN109194495B (en) | Server, message processing method, and computer-readable storage medium | |
Henry et al. | Migrating to microservices | |
CN111932135B (en) | Client risk identification method and device based on distributed database | |
CN107194810A (en) | Asset allocation system and method | |
CN111610979A (en) | API gateway subjected to persistence and coupling degree optimization and method thereof | |
CN112559525B (en) | Data checking system, method, device and server | |
CN108830715A (en) | Batch file part disk returning processing method and system | |
CN111091358A (en) | Unified processing method and system for multiple payment channels | |
CN112669158A (en) | Transaction system and control method and device of transaction service thereof | |
CN104317660B (en) | A kind of bank's parameter management system | |
CN110336791A (en) | A kind of breakpoint data transmission method, device, equipment and computer storage medium | |
CN101493775A (en) | Dynamic loading system and loading method thereof for embedded system | |
CN110674173A (en) | Method and system for caching data on wind control cloud | |
CN110782310A (en) | Method, device and system for asynchronously acquiring user attribute information from third-party platform | |
CN116560712A (en) | Microservice construction method, microservice construction device, microservice construction equipment and computer storage medium | |
CN109992614B (en) | Data acquisition method, device and server | |
US8406401B2 (en) | Interactive voice response system to business application interface | |
CN115617924A (en) | Financial data processing method, device, equipment and storage medium | |
CN113793213A (en) | Method and device for realizing decision mode of asynchronous credit wind control breakpoint continued operation | |
CN110084583A (en) | A kind of pressure button stroke accounting data processing method, apparatus and system | |
CN113360387B (en) | Bank payment and settlement simulator | |
CN113849543B (en) | Account checking information query system, data updating method and account checking query method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180622 |