CN103024080A - Cloud architecture based method and cloud architecture based system for distributed financial data transmission control - Google Patents

Cloud architecture based method and cloud architecture based system for distributed financial data transmission control Download PDF

Info

Publication number
CN103024080A
CN103024080A CN2013100015619A CN201310001561A CN103024080A CN 103024080 A CN103024080 A CN 103024080A CN 2013100015619 A CN2013100015619 A CN 2013100015619A CN 201310001561 A CN201310001561 A CN 201310001561A CN 103024080 A CN103024080 A CN 103024080A
Authority
CN
China
Prior art keywords
data
cloud node
cloud
node unit
service
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2013100015619A
Other languages
Chinese (zh)
Inventor
丁卓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Star Bridge Data Technology Co Ltd
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN2013100015619A priority Critical patent/CN103024080A/en
Publication of CN103024080A publication Critical patent/CN103024080A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a cloud architecture based method and a cloud architecture based system for distributed financial data transmission control. A cloud nodal point unit comprises a low-level cloud nodal point unit and a high-level cloud nodal point unit. The method for distributed financial data transmission control includes the steps: enabling the low-level cloud nodal point unit to provide basic computing service, and enabling the high-level cloud nodal point unit to be responsible for data monitoring interpretation and a core source data directory. The cloud architecture based method and the cloud architecture based system for distributed financial data transmission control have the advantages that the low-level cloud nodal point unit is responsible for basic data computing which accounts for 80% of total computing amount, the high-level cloud nodal point unit is responsible for data monitoring interpretation and the core source data directory and includes computing which accounts for 20% of total computing amount, and accordingly computing resource dynamic allocation is optimized with high data reliability guaranteed, and operating efficiency is improved greatly.

Description

Distributed finance data transfer control method and system based on the cloud framework
Technical field
The present invention relates to the Data Transmission Controlling field, relate in particular to distributed finance data transfer control method and system.
Background technology
The traditional financial computation model is based on the centralized computing architecture in finance data center.As shown in Figure 1, the Industrial and Commercial Bank of China for example, Construction Bank, agricultural bank all are provided with the north and southern data center in Beijing and Shanghai.Divide with north and south, the Changjiang river, the internal data of North of Yangtze River is calculated and commercial Net silver is carried out in Beijing data center.Internal data on the south the Changjiang river is calculated and commercial Net silver is carried out at the Shanghai Data center.The framework at this centralized finance data center is as follows.
Traditional financial centralized data center adopts N layer structuring concept.The application service that is about to thousands of banks converges on N the aspect.These layers have client layer, webpage layer, application service layer, integrated layer, database layer, mainframe layer and data storage layer.Between these different layers by standard agreement such as TCP/IP, XML, EDI, WDSL, JMS/MQ, patch etc. carry out communication.
Although traditional financial data centre centralized computing architecture can reasonablely be finished the processing of bank's existing business, but owing to there is not distributed structure/architecture, with financial cloud computing model, there is not active development to cause in the developing of financial new business and new mechanism, can not well meeting the demands with using the elasticity support.
Layer-stepping calculates: in large-scale parallel calculates, because the difference of calculation task is considered calculated performance optimization, usually adopt layer-stepping to calculate the resource matched problem of computing node that solves.Namely set up N level node in large-scale parallel calculates, the one-level node has maximum calculated capacity and computational speed usually, so the one-level node is responsible for the high concurrent high amount of calculation calculating of high density.Two-level node has larger calculated capacity and computational speed usually, so two-level node is responsible for the medium concurrent medium amount of calculation of comparison intermediate density and calculates, the like.But in practice because 20/80 phenomenon, and 80% computation requests proposes by 20% application service, and remaining 20% computation requests is proposed by 80% application service.Therefore the one-level node has been undertaken 80% amount of calculation usually.And other nodes have only been born 20% amount of calculation.So just cause not mating of resource and demand, and formed computing resource waste.
Summary of the invention
In order to solve the problems of the prior art, the invention provides a kind of distributed finance data transfer control method based on the cloud framework.
The invention provides a kind of distributed finance data transfer control method, comprise the steps:
The cloud node unit comprises rudimentary cloud node unit and senior cloud node unit, and rudimentary cloud node unit provides the basic calculating service, and the data supervision is explained and core source data catalogue then is responsible for by senior cloud node unit.
As a further improvement on the present invention, also comprise:
Rudimentary cloud node unit notifies higher level's cloud node unit and higher level's cloud node unit to confirm data change information the significant data modification information;
Rudimentary cloud node unit superior cloud node request msg supervision provides data supervision and auditing service with audit and higher level's cloud node unit;
Rudimentary cloud node unit gathers computing information to return to higher level's cloud node unit and higher level's cloud node unit and gathers confirmation.
As a further improvement on the present invention, also comprise:
Synchronous significant data modification information is transferred to all cloud node units at the same level and all cloud node units at the same level are confirmed this data synchronization information;
Image information is transferred to all cloud node units at the same level and all these synchronous image informations of cloud node units affirmation at the same level synchronously;
Synchrodata repeatedly communication processed confirms repeatedly information processed of these data for all cloud node units at the same level and all cloud node units at the same level.
As a further improvement on the present invention, also comprise:
When the computing unit generating unit of a rudimentary cloud node unit divides service to interrupt, the control unit that this generating unit is divided the rudimentary cloud node unit that service interrupts provides service to the control unit request of another rudimentary cloud node unit of peer, and the computing unit of another rudimentary cloud node unit at the same level provides service and return information to divide the control unit of the rudimentary cloud node unit of the peer that service interrupts to generating unit.
As a further improvement on the present invention, also comprise: higher level's cloud node unit is synchronized to all cloud node units at the same level with the significant data modification information of subordinate's cloud node unit.
As a further improvement on the present invention, described cloud node unit is a plurality of and is distributed in different zone, geographical position.
The present invention also provides a kind of distributed finance data transmission control system based on the cloud framework, comprises the cloud node unit, and described cloud node unit comprises rudimentary cloud node unit and senior cloud node unit;
Rudimentary cloud node unit is used for providing the basic calculating service;
The data supervision is explained and core source data catalogue is responsible for by senior cloud node unit.
As a further improvement on the present invention, described cloud node unit comprises:
Application layer module is service requester, is used for proposing service request;
Third party's service module provides platform for the 3rd side calculates;
The BPM module is used for being responsible for specifying miscellaneous service and serving operation flow definition and the rule that may relate to;
The data collaborative module is used for defining the Various types of data interface, and formulates the unified communication modes of each data-interface;
The registration service module is used for defining service registry;
Core source data catalogue module is used for defining the core source data catalogue that the cloud software systems can be used, and this core source data catalogue will instruct higher-level node that lower-level nodes is carried out data supervision, data audit, life cycle control function;
The data directory module is used for providing data, services;
ESB is used for the integrated and information sharing of disparate modules;
The Data Source module is used for defining source data.Comprise the general data storehouse, mainframe tables of data, cloud database.
As a further improvement on the present invention, described data directory module comprises: data verification service module, DTS module, data scrubbing service module, quality of data service module, data buffer storage service module, Validation of Data service module, data supervision service module, data are unified service module, data abstraction service module, data field service module.
As a further improvement on the present invention, described Data Source module comprises the general data storehouse, mainframe tables of data, cloud database.
The invention has the beneficial effects as follows: in the distributed finance data transfer control method and system based on the cloud framework of the present invention, lower-level nodes has been responsible for master data calculating, and this part accounts for 80% calculating total amount; The data supervision is explained and core source data catalogue is responsible for by higher-level node, accounts for the amount of calculation 20%; Such arrangement under assurance data high reliability prerequisite, has been optimized the dynamic-configuration of computational resource, thereby has greatly been improved operating efficiency.
Description of drawings
Fig. 1 is traditional financial data centre centralized computing architecture.
Fig. 2 is distributed finance data transfer control method schematic diagram of the present invention.
Fig. 3 is cloud node unit theory diagram of the present invention.
Embodiment
As shown in Figure 2, the invention discloses a kind of distributed finance data transfer control method based on the cloud framework, comprise the steps: that the cloud node unit comprises rudimentary cloud node unit and senior cloud node unit, rudimentary cloud node unit provides the basic calculating service, and the data supervision is explained and core source data catalogue then is responsible for by senior cloud node unit.
Rudimentary cloud node unit and senior cloud node unit are default, and for example cloud node A, cloud Node B 1, the cloud Node B 2 among Fig. 2 all is set as rudimentary cloud node unit, and cloud node C is set as senior cloud node unit.Wherein, the N hypothesis value among Fig. 2 is 2, and cloud node C is 1 grade of node so, and cloud Node B 1 and cloud Node B 2 are 2 grades of nodes, and cloud node A is 3 grades of nodes.1 grade of node is senior cloud node unit.Though 2 grades of nodes and 3 grades of nodes all are set as rudimentary cloud node unit, but 2 grades of nodes that is to say higher level's cloud node unit that 2 grades of nodes are 3 grades of nodes than 3 grades of high ranks of node.Cloud Node B 1 and cloud Node B 2 are 2 grades of nodes, so cloud Node B 1 and cloud Node B 2 are cloud node unit at the same level.
Rudimentary cloud node unit notifies higher level's cloud node unit and higher level's cloud node unit to confirm data change information the significant data modification information;
Rudimentary cloud node unit superior cloud node request msg supervision provides data supervision and auditing service with audit and higher level's cloud node unit;
Rudimentary cloud node unit gathers computing information to return to higher level's cloud node unit and higher level's cloud node unit and gathers confirmation.
Synchronous significant data modification information is transferred to all cloud node units at the same level and all cloud node units at the same level are confirmed this data synchronization information;
Image information is transferred to all cloud node units at the same level and all these synchronous image informations of cloud node units affirmation at the same level synchronously;
Synchrodata repeatedly communication processed confirms repeatedly information processed of these data for all cloud node units at the same level and all cloud node units at the same level.
When the computing unit generating unit of a rudimentary cloud node unit divides service to interrupt, the control unit that this generating unit is divided the rudimentary cloud node unit that service interrupts provides service to the control unit request of another rudimentary cloud node unit of peer, and the computing unit of another rudimentary cloud node unit at the same level provides service and return information to divide the control unit of the rudimentary cloud node unit of the peer that service interrupts to generating unit.For example, when cloud Node B 1 generating unit divided service to interrupt, cloud Node B 1 provided service, cloud Node B 2 to provide service and return information to cloud Node B 1 to 2 requests of cloud Node B.
Higher level's cloud node unit is synchronized to all cloud node units at the same level with the significant data modification information of subordinate's cloud node unit, and for example cloud Node B 1 will be synchronized to the significant data modification information of cloud node A all cloud node units of cloud Node B 2 and 2 grades of nodes.
Described cloud node unit is a plurality of and is distributed in different zone, geographical position.
As shown in Figure 3, the invention also discloses a kind of distributed finance data transmission control system based on the cloud framework, comprise the cloud node unit, described cloud node unit comprises rudimentary cloud node unit and senior cloud node unit; Rudimentary cloud node unit is used for providing the basic calculating service; The data supervision is explained and core source data catalogue is responsible for by senior cloud node unit.
Described cloud node unit comprises:
Application layer module is service requester, is used for proposing service request;
Third party's service module provides platform for the 3rd side calculates, and for example may be Reuter's whole world moneytary operations platform or the Dark Pool of Nomura Securities high frequency transaction platform;
The BPM module is used for being responsible for specifying miscellaneous service and serving operation flow definition and the rule that may relate to;
The data collaborative module is used for defining the Various types of data interface, and formulates the unified communication modes of each data-interface;
The registration service module is used for defining service registry, and the agreement that may use has UDDI, ebXML, LDAP;
Core source data catalogue module is used for defining the core source data catalogue that the cloud software systems can be used, and this core source data catalogue will instruct higher-level node that lower-level nodes is carried out data supervision, data audit, life cycle control function;
Data directory module (XDMS) is used for providing data, services;
ESB is used for the integrated and information sharing of disparate modules;
The Data Source module is used for defining source data.Comprise the general data storehouse, mainframe tables of data, cloud database.
ESB comprises following function: service routing and the positioning service of location transparency are provided; Multiple massage passing formula (request/response, single channel request, publish/subscribe etc.); Support widely used host-host protocol (Http, JMS, MQ etc.); Support the many services integration mode, such as JCA, Web service, Messaging, Adaptor; To the support of cloud infrastructure service management, such as providing of the record of service call, measurement and monitoring data.
Described data directory module comprises: data verification service module, DTS module, data scrubbing service module, quality of data service module, data buffer storage service module, Validation of Data service module, data supervision service module, data are unified service module, data abstraction service module, data field service module.
Described Data Source module comprises the general data storehouse, mainframe tables of data, cloud database.
In distributed finance data transfer control method of the present invention and system, the lower-level nodes of computation-intensive is responsible for 80% calculating; The data supervision is explained and core source data catalogue is responsible for by higher-level node, accounts for the amount of calculation 20%; Increase work efficiency.
Counting accuracy is high: counting accuracy is responsible for by rudimentary cloud node, and data validation and supervision are responsible for by superior node.
Improve the data review efficiency: the data audit has superior node to be responsible for, and downstream site provides convergence.
Data synchronously/BPM and regulation engine are synchronous: image data is in cloud node at the same level inter-sync, the significant data transition information Yun Jiedian of subordinate superior cloud node report.
Improve data efficiency: data de-duplication/data are made repeatedly.
Information Security realizes by encryption, authentication and cloud security.
Above content is the further description of the present invention being done in conjunction with concrete preferred implementation, can not assert that implementation of the present invention is confined to these explanations.For the general technical staff of the technical field of the invention, without departing from the inventive concept of the premise, can also make some simple deduction or replace, all should be considered as belonging to protection scope of the present invention.

Claims (10)

1. the distributed finance data transfer control method based on the cloud framework is characterized in that, comprises the steps:
The cloud node unit comprises rudimentary cloud node unit and senior cloud node unit, and rudimentary cloud node unit provides the basic calculating service, and the data supervision is explained and core source data catalogue then is responsible for by senior cloud node unit.
2. distributed finance data transfer control method according to claim 1 is characterized in that, also comprises:
Rudimentary cloud node unit notifies higher level's cloud node unit and higher level's cloud node unit to confirm data change information the significant data modification information;
Rudimentary cloud node unit superior cloud node request msg supervision provides data supervision and auditing service with audit and higher level's cloud node unit;
Rudimentary cloud node unit gathers computing information to return to higher level's cloud node unit and higher level's cloud node unit and gathers confirmation.
3. distributed finance data transfer control method according to claim 2 is characterized in that, also comprises:
Synchronous significant data modification information is transferred to all cloud node units at the same level and all cloud node units at the same level are confirmed this data synchronization information;
Image information is transferred to all cloud node units at the same level and all these synchronous image informations of cloud node units affirmation at the same level synchronously;
Synchrodata repeatedly communication processed confirms repeatedly information processed of these data for all cloud node units at the same level and all cloud node units at the same level.
4. according to claim 1 to 3 each described distributed finance data transfer control methods, it is characterized in that, also comprise:
When the computing unit generating unit of a rudimentary cloud node unit divides service to interrupt, the control unit that this generating unit is divided the rudimentary cloud node unit that service interrupts provides service to the control unit request of another rudimentary cloud node unit of peer, and the computing unit of another rudimentary cloud node unit at the same level provides service and return information to divide the control unit of the rudimentary cloud node unit of the peer that service interrupts to generating unit.
5. distributed finance data transfer control method according to claim 4 is characterized in that, also comprises: higher level's cloud node unit is synchronized to all cloud node units at the same level with the significant data modification information of subordinate's cloud node unit.
6. distributed finance data transfer control method according to claim 5, it is characterized in that: described cloud node unit is a plurality of and is distributed in different zone, geographical position.
7. finance data transmission control system, it is characterized in that: comprise the cloud node unit, described cloud node unit comprises rudimentary cloud node unit and senior cloud node unit;
Rudimentary cloud node unit is used for providing the basic calculating service;
The data supervision is explained and core source data catalogue is responsible for by senior cloud node unit.
8. finance data transmission control system according to claim 7 is characterized in that, described cloud node unit comprises:
Application layer module is service requester, is used for proposing service request;
Third party's service module provides platform for the 3rd side calculates;
The BPM module is used for being responsible for specifying miscellaneous service and serving operation flow definition and the rule that may relate to;
The data collaborative module is used for defining the Various types of data interface, and formulates the unified communication modes of each data-interface;
The registration service module is used for defining service registry;
Core source data catalogue module is used for defining the core source data catalogue that the cloud software systems can be used, and this core source data catalogue will instruct higher-level node that lower-level nodes is carried out data supervision, data audit, life cycle control function;
The data directory module is used for providing data, services;
ESB is used for the integrated and information sharing of disparate modules;
The Data Source module is used for defining source data, comprises the general data storehouse, mainframe tables of data, cloud database.
9. finance data transmission control system according to claim 8, it is characterized in that described data directory module comprises: data verification service module, DTS module, data scrubbing service module, quality of data service module, data buffer storage service module, Validation of Data service module, data supervision service module, data are unified service module, data abstraction service module, data field service module.
10. finance data transmission control system according to claim 9, it is characterized in that: described Data Source module comprises the general data storehouse, mainframe tables of data, cloud database.
CN2013100015619A 2013-01-04 2013-01-04 Cloud architecture based method and cloud architecture based system for distributed financial data transmission control Pending CN103024080A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2013100015619A CN103024080A (en) 2013-01-04 2013-01-04 Cloud architecture based method and cloud architecture based system for distributed financial data transmission control

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2013100015619A CN103024080A (en) 2013-01-04 2013-01-04 Cloud architecture based method and cloud architecture based system for distributed financial data transmission control

Publications (1)

Publication Number Publication Date
CN103024080A true CN103024080A (en) 2013-04-03

Family

ID=47972204

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2013100015619A Pending CN103024080A (en) 2013-01-04 2013-01-04 Cloud architecture based method and cloud architecture based system for distributed financial data transmission control

Country Status (1)

Country Link
CN (1) CN103024080A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105786913A (en) * 2014-12-25 2016-07-20 北京仿真中心 Cloud manufacturing platform oriented ERP integrated database service interface encapsulation system and method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101719931A (en) * 2009-11-27 2010-06-02 南京邮电大学 Multi-intelligent body-based hierarchical cloud computing model construction method
US20110137805A1 (en) * 2009-12-03 2011-06-09 International Business Machines Corporation Inter-cloud resource sharing within a cloud computing environment
CN102841934A (en) * 2012-08-09 2012-12-26 北京南天软件有限公司 Cloud data service system platform for supporting banking applications

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101719931A (en) * 2009-11-27 2010-06-02 南京邮电大学 Multi-intelligent body-based hierarchical cloud computing model construction method
US20110137805A1 (en) * 2009-12-03 2011-06-09 International Business Machines Corporation Inter-cloud resource sharing within a cloud computing environment
CN102841934A (en) * 2012-08-09 2012-12-26 北京南天软件有限公司 Cloud data service system platform for supporting banking applications

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105786913A (en) * 2014-12-25 2016-07-20 北京仿真中心 Cloud manufacturing platform oriented ERP integrated database service interface encapsulation system and method

Similar Documents

Publication Publication Date Title
Sharma et al. A software defined fog node based distributed blockchain cloud architecture for IoT
CN103440244A (en) Large-data storage and optimization method
US20170091733A1 (en) Sending bills
CN103955510A (en) Massive electricity marketing data integration method uploaded by ETL cloud platform
CN103207920A (en) Parallel metadata acquisition system
Jiao et al. Cost optimization for online social networks on geo-distributed clouds
Zeng et al. A scheme of intelligent traffic light system based on distributed security architecture of blockchain technology
CN104113605A (en) Enterprise cloud application development monitoring processing method
CN105007311A (en) System and method for resource management based on cloud platform and cloud computing
Zhang et al. EB-BFT: An elastic batched BFT consensus protocol in blockchain
Alves et al. Flood: elastic streaming mapreduce
CN103024080A (en) Cloud architecture based method and cloud architecture based system for distributed financial data transmission control
Liu et al. A Solution for A Disaster Recovery Service System in Multi-cloud Environment
Liu et al. Enhancing trust and privacy in distributed networks: a comprehensive survey on blockchain-based federated learning
Zhang et al. Semantic knowledge sharing mechanism based on blockchain
CN105099782A (en) Method and system for controlling big data resource of cloud environment cluster
Waseem et al. Quantitative analysis and performance evaluation of target-oriented replication strategies in cloud computing
CN108897748A (en) A kind of HBase system monitoring method and HBase system
Chakraborty et al. A proposal for high availability of HDFS architecture based on threshold limit and saturation limit of the namenode
CN106453594A (en) A global logical clock synchronization distributed method
Chen [Retracted] Big Data Integration Method of Mathematical Modeling and Manufacturing System Based on Fog Calculation
Li et al. ACEA: A Queueing Model‐Based Elastic Scaling Algorithm for Container Cluster
Sun et al. PROXZONE: one cloud computing system for support paas in energy power applications
Ma et al. Bank big data architecture based on massive parallel processing database
CN104572859A (en) Distributive complex event processing system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
ASS Succession or assignment of patent right

Owner name: SHENZHN XINGQIAO DATA TECHNOLOGY CO., LTD.

Free format text: FORMER OWNER: DING ZHUO

Effective date: 20140307

COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 213017 CHANGZHOU, JIANGSU PROVINCE TO: 518000 SHENZHEN, GUANGDONG PROVINCE

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20140307

Address after: 518000 Guangdong city of Shenzhen province Luohu District South Street People's road International Trade Building or Cetra Building 1908-1910

Applicant after: Shenzhen Star Bridge Data Technology Co., Ltd.

Address before: Green Bay Jiangsu Tianning District 213017 Changzhou 2, building 3, 1504

Applicant before: Ding Zhuo

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20130403