CN107818009A - A kind of method of agency's processing based on distributed transaction - Google Patents
A kind of method of agency's processing based on distributed transaction Download PDFInfo
- Publication number
- CN107818009A CN107818009A CN201710960968.2A CN201710960968A CN107818009A CN 107818009 A CN107818009 A CN 107818009A CN 201710960968 A CN201710960968 A CN 201710960968A CN 107818009 A CN107818009 A CN 107818009A
- Authority
- CN
- China
- Prior art keywords
- sent
- node
- transaction
- request
- agent process
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/466—Transaction processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multi Processors (AREA)
Abstract
The invention discloses a kind of method of agency's processing based on distributed transaction, comprise the following steps：In node, the request to affairs is all sent in the agent process in the node；After the agent process merges the request, transaction nodes are disposably sent to；After the transaction nodes disposably handle a collection of request, the agent process of corresponding node is sent the result to；Request results are sent to service processes by the agent process.Beneficial effects of the present invention：Task manager is sent to by the way that the transactions requests in same node are merged, then by the request after merging, the transactions requests of this batch are handled, and are reduced the pressure of network pressure and task manager, are also improved the handling capacity of system.
Description
Technical field
The present invention relates to database technical field, it particularly relates to what a kind of agency based on distributed transaction was handled
Method.
Background technology
In based on distributed type colony DBMS systems, the issued transaction of database is needed to change by original unit behavior
For Aggregation behaviour.In unit Database Systems, the acquisition of transaction number and transaction snapshot can be inside physical machine, by entering
Locking between journey is realized：Transaction number is sequentially generated, and obtains snapshot parallel.It is being by the distribution of management node-calculate node
In system, each process in multiple management nodes, it is required for obtaining transaction number from the transaction management node of a concentration, together
When, the process in some calculate nodes is also required to obtain transaction number from affairs management node, therefore transaction management node can turn into
Handle bottleneck.
At present, in distributed mpp system, transactions requests are uniformly processed in transaction management module.As shown in figure 1, mpp system
In management node and calculate node can all produce transactions requests, and the process in calculate node and management node, all in affairs
Request transaction service on node.
Service processes in calculate node and management node can all be connected to transaction nodes, carry out transactions requests.It is general next
Say, a management node is seen to have thousands of service processes up to a hundred, therefore, each management node in high-load situations, this
Thousands of individual connection requests up to a hundred can be also corresponding with transaction nodes, existing technical scheme is in prior art in heavy load
Under, transaction nodes are easy to that performance bottleneck can be turned into.
The problem of in correlation technique, effective solution is not yet proposed at present.
Key Term to may relate in the present invention below：
SQL handles service processes：The process of specific SQL business is handled in Database Systems, referred to as service herein into
Journey, or server processes.
Transaction management node：Processing and management transactions requests, groundwork include：Transaction number application, snapshot application, record
Affairs submission etc..
Management node：In distributed data base system, receive client connection, and explain SQL, returning result collection.At this
In invention, this node can apply for transaction number into transaction management node.
Calculate node：Storage and the node for carrying out SQL calculating.In the present invention, this node also can be to transaction management node
Middle application transaction number, but it is frequent without management node.
The content of the invention
For the above-mentioned technical problem in correlation technique, the present invention proposes a kind of agency's processing based on distributed transaction
Method, distributed data base performance can be lifted.
To realize above-mentioned technical purpose, the technical proposal of the invention is realized in this way：
A kind of method of agency's processing based on distributed transaction, comprises the following steps：
In node, the request to affairs is all sent in the agent process in the node S1；
After agent process described in S2 merges the request, transaction nodes are disposably sent to；
After transaction nodes described in S3 disposably handle a collection of request, the agent process of corresponding node is sent the result to；
Request results are sent to service processes by agent process described in S4.
Further, node described in S1 includes management node and calculate node.
Further, communicated between the agent process and service processes using queue, specifically include following steps：
Transactions requests are put into queue by S11 service processes, and notification agent process has message to need to handle；
After S12 agent processes obtain queue message, transaction nodes are sent it to；
The returning result of transaction nodes is issued the service processes by S13 agent processes.
Beneficial effects of the present invention：By the way that the transactions requests in same node are merged, then by after merging please
To ask and be sent to task manager, the transactions requests of this batch are handled, and reduce the pressure of network pressure and task manager,
The handling capacity of raising system.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to institute in embodiment
The accompanying drawing needed to use is briefly described, it should be apparent that, drawings in the following description are only some implementations of the present invention
Example, for those of ordinary skill in the art, on the premise of not paying creative work, can also be obtained according to these accompanying drawings
Obtain other accompanying drawings.
Fig. 1 is the schematic diagram that distributed mpp system carries out transactions requests in the prior art；
Fig. 2 be according to embodiments of the present invention described in it is a kind of based on distributed transaction agency processing method application signal
Figure；
Fig. 3 be according to embodiments of the present invention described in it is a kind of based on distributed transaction agency processing method in service processes
The schematic diagram to be communicated with agent process.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.It is based on
Embodiment in the present invention, the every other embodiment that those of ordinary skill in the art are obtained, belong to what the present invention protected
Scope.
As shown in Figures 1 to 3, the side of described a kind of agency's processing based on distributed transaction according to embodiments of the present invention
Method, comprise the following steps：
In node, the request to affairs is all sent in the agent process in the node S1；
After agent process described in S2 merges the request, transaction nodes are disposably sent to；
After transaction nodes described in S3 disposably handle a collection of request, the agent process of corresponding node is sent the result to；
Request results are sent to service processes by agent process described in S4.
Further, node described in S1 includes management node and calculate node.
Further, communicated between the agent process and service processes using queue, specifically include following steps：
Transactions requests are put into queue by S11 service processes, and notification agent process has message to need to handle；
After S12 agent processes obtain queue message, transaction nodes are sent it to；
The returning result of transaction nodes is issued the service processes by S13 agent processes.
In order to facilitate understand the present invention above-mentioned technical proposal, below by way of in specifically used mode to the present invention it is above-mentioned
Technical scheme is described in detail.
When specifically used, the method that is handled according to a kind of agency based on distributed transaction of the present invention, this section
Point in（Including management node and calculate node）Request to affairs is sent in the agent process in this node, agent process
It will ask after merging, again property（One batch）Be sent to transaction nodes.Transaction nodes can disposably handle a collection of request,
The agent process of corresponding node is sent the result to again, and specific request results are sent to server again and entered by agent process
Journey.Originally the multiple connections for being connected locally to transaction nodes are merged into by a connection by agent process, reduce affairs section
Point pressure, and the request for arriving transaction nodes originally is all forwarded by agent process.
Communicated between service processes and agent process using queue, i.e., typical producers and consumers' model.It is first
First, transactions requests are placed in queue by service processes, and notification agent process has message to need to handle；Agent process is getting team
After row message, transaction nodes are sent it to；Finally, the returning result of transaction nodes is sent to each process by agent process.
In summary, by means of the above-mentioned technical proposal of the present invention, by the way that the transactions requests in same node are carried out
Merge, then the request after merging be sent to task manager, the transactions requests processing of this batch, reduce network pressure and
The pressure of task manager, also improve the handling capacity of system.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all essences in the present invention
God any modification, equivalent substitution and improvements made etc., should be included in the scope of the protection with principle.
Claims (3)
- A kind of 1. method of agency's processing based on distributed transaction, it is characterised in that comprise the following steps：In node, the request to affairs is all sent in the agent process in the node S1；After agent process described in S2 merges the request, transaction nodes are disposably sent to；After transaction nodes described in S3 disposably handle a collection of request, the agent process of corresponding node is sent the result to；Request results are sent to service processes by agent process described in S4.
- 2. the method for agency's processing according to claim 1 based on distributed transaction, it is characterised in that saved described in S1 Point includes management node and calculate node.
- 3. it is according to claim 1 based on distributed transaction agency processing method, it is characterised in that it is described act on behalf of into Communicated between journey and service processes using queue, specifically include following steps：Transactions requests are put into queue by S11 service processes, and notification agent process has message to need to handle；After S12 agent processes obtain queue message, transaction nodes are sent it to；The returning result of transaction nodes is issued the service processes by S13 agent processes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710960968.2A CN107818009A (en) | 2017-10-17 | 2017-10-17 | A kind of method of agency's processing based on distributed transaction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710960968.2A CN107818009A (en) | 2017-10-17 | 2017-10-17 | A kind of method of agency's processing based on distributed transaction |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107818009A true CN107818009A (en) | 2018-03-20 |
Family
ID=61608307
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710960968.2A Pending CN107818009A (en) | 2017-10-17 | 2017-10-17 | A kind of method of agency's processing based on distributed transaction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107818009A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108829709A (en) * | 2018-05-03 | 2018-11-16 | 广州金山安全管理系统技术有限公司 | Distributed database management method, apparatus, storage medium and processor |
| CN109086136A (en) * | 2018-07-26 | 2018-12-25 | 广东浪潮大数据研究有限公司 | A kind of request processing method and relevant apparatus of Samba software |
| CN110362617A (en) * | 2019-06-24 | 2019-10-22 | 北京人大金仓信息技术股份有限公司 | Batch data method and system is quickly exported from database based on more concurrent technologies |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6516368B1 (en) * | 1999-11-09 | 2003-02-04 | International Business Machines Corporation | Bus master and bus snooper for execution of global operations utilizing a single token for multiple operations with explicit release |
| CN101339527A (en) * | 2008-07-28 | 2009-01-07 | 华中科技大学 | Shadow EMS memory backup method and apparatus |
| CN102831156A (en) * | 2012-06-29 | 2012-12-19 | 浙江大学 | Distributed transaction processing method on cloud computing platform |
| CN103294479A (en) * | 2013-06-19 | 2013-09-11 | 成都市欧冠信息技术有限责任公司 | Distribution type transaction processing method and system |
| CN106209682A (en) * | 2016-07-08 | 2016-12-07 | 北京百度网讯科技有限公司 | Business scheduling method, device and system |
| CN106790444A (en) * | 2016-12-06 | 2017-05-31 | 腾讯科技（深圳）有限公司 | Network data exchange method and device |
-
2017
- 2017-10-17 CN CN201710960968.2A patent/CN107818009A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6516368B1 (en) * | 1999-11-09 | 2003-02-04 | International Business Machines Corporation | Bus master and bus snooper for execution of global operations utilizing a single token for multiple operations with explicit release |
| CN101339527A (en) * | 2008-07-28 | 2009-01-07 | 华中科技大学 | Shadow EMS memory backup method and apparatus |
| CN102831156A (en) * | 2012-06-29 | 2012-12-19 | 浙江大学 | Distributed transaction processing method on cloud computing platform |
| CN103294479A (en) * | 2013-06-19 | 2013-09-11 | 成都市欧冠信息技术有限责任公司 | Distribution type transaction processing method and system |
| CN106209682A (en) * | 2016-07-08 | 2016-12-07 | 北京百度网讯科技有限公司 | Business scheduling method, device and system |
| CN106790444A (en) * | 2016-12-06 | 2017-05-31 | 腾讯科技（深圳）有限公司 | Network data exchange method and device |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108829709A (en) * | 2018-05-03 | 2018-11-16 | 广州金山安全管理系统技术有限公司 | Distributed database management method, apparatus, storage medium and processor |
| CN109086136A (en) * | 2018-07-26 | 2018-12-25 | 广东浪潮大数据研究有限公司 | A kind of request processing method and relevant apparatus of Samba software |
| CN110362617A (en) * | 2019-06-24 | 2019-10-22 | 北京人大金仓信息技术股份有限公司 | Batch data method and system is quickly exported from database based on more concurrent technologies |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107657518A (en) | A kind of flow path processing method and relevant apparatus and server based on event | |
| CN102682059B (en) | Method and system for distributing users to clusters | |
| CN103634144B (en) | The configuration file management method of many IDC clusters, system and equipment | |
| CN108897854B (en) | Monitoring method and device for overtime task | |
| CN105631026A (en) | Security data analysis system | |
| CN107818009A (en) | A kind of method of agency's processing based on distributed transaction | |
| CN103970807B (en) | Method and system for managing database connection | |
| CN105868231A (en) | Cache data updating method and device | |
| CN111382150A (en) | Real-time computing method and system based on Flink | |
| CN105933408A (en) | Implementation method and device of Redis universal middleware | |
| US20170147661A1 (en) | Data load system with distributed data facility technology | |
| CN105989163A (en) | Data real-time processing method and system | |
| CN102035879B (en) | Server and data processing system using same | |
| CN104933202A (en) | Method and device for data extraction, transformation and ETL loading | |
| CN107423336A (en) | A kind of data processing method, device and computer-readable storage medium | |
| CN103580951B (en) | Output comparative approach, test migration householder method and the system of multiple information systems | |
| CN111858585A (en) | Block chain strategy processing device, computer readable storage medium and terminal equipment | |
| CN107547643A (en) | A kind of load sharing method and device | |
| CN105447121A (en) | Database cluster connection reestablishing method with high availability | |
| CN105335362B (en) | The processing method and system of real time data, instant disposal system for treating | |
| CN103023986A (en) | System and method for providing relational database management system (RDBMS) services for multiple users | |
| CN105162837A (en) | Method and system for improving I/O throughput rate in massive data storage environment | |
| CN106453637B (en) | The method, apparatus and cloud platform of cloud platform efficient multiplexing server resource | |
| CN107885460A (en) | A kind of data access method of cluster | |
| CN106408793B (en) | A kind of Service Component sharing method and system suitable for ATM business |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180320 |
|
| RJ01 | Rejection of invention patent application after publication |