CN106302148B - Backup data transmission method and system based on LBM - Google Patents
Backup data transmission method and system based on LBM Download PDFInfo
- Publication number
- CN106302148B CN106302148B CN201610681164.4A CN201610681164A CN106302148B CN 106302148 B CN106302148 B CN 106302148B CN 201610681164 A CN201610681164 A CN 201610681164A CN 106302148 B CN106302148 B CN 106302148B
- Authority
- CN
- China
- Prior art keywords
- queue
- data packet
- service data
- service
- stg
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/22—Alternate routing
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a backup data transmission method and a backup data transmission system based on LBM, and relates to the technical field of data transmission. The method comprises the following steps: the first service data packet is sent to the STG queue for reading through the KCXP main link queue; if the STG queue finds that the second service data packet is lost, the second service data packet is requested to be returned to the KCBP standby link queue; the second service data packet is sent to an STG queue for reading through the KCBP standby link queue; and the first service data packet and the second service data packet are integrated into a complete service data packet through the STG queue according to the time sequence of service occurrence. The invention adopts double links to transmit the service data to achieve the purpose that the service data can arrive in time, and when any link has a problem, the transmission of the service data on the other link is not influenced, thereby effectively solving the problem that the service data possibly loses service data packets in the communication process in time and ensuring the stability and reliability of service transmission.
Description
Technical Field
The invention belongs to the technical field of data transmission, and particularly relates to a backup data transmission method and system based on LBM.
Background
KCBP (Kingdom Core Business Platform, golden certificate Core service Platform) is the transaction management middleware developed by Shenzhen City golden certificate shares, Inc. The KCBP is an intermediate layer between the business application and the operating system and is responsible for correctly transmitting transactions, managing the integrity of the transactions, scheduling the operation of application programs, ensuring the high efficiency of the operation of the whole system and providing an auxiliary tool for facilitating the use of operators. KCXP (Kingdom Communication Exchange Platform, national certificate Communication Exchange Platform) is a high-performance and high-availability Communication middleware software developed by national certificate company based on a message queuing technology, and is used in cooperation with KCBP or used alone. Native API is provided and JMS specification is supported. Can run on operating system platforms such as LINUX, Windows, AIX and the like. The KCXP and the KCBP are matched to build a complete online transaction platform, and data are sent from one application to the other application through the middleware. The message middleware is mainly used for solving the problem of communication between applications of cross-operating systems and different network environments. It is responsible for establishing network communication channels, performing reliable data transmission, and ensuring that data is not retransmitted and lost. The LBM (Loadable Business processing Module) is built on the KCBP platform. The application system constructed based on the KCBP comprises a client application program and an LBM. The client application program mainly provides functions of data display, data input/output and the like, and calls a KCBP client API to communicate with the KCBP server. The LBM is a KCBP server business logic program, written by a user, and mainly used for processing business logic. The LBM can ensure that the system is dynamically loaded or unloaded under the condition of not interrupting the operation, and the dynamic updating of the system function is realized.
With the increasing requirements on the security, timeliness, reliability and the like of the service, it is urgently needed to improve the service support of the central transaction system and the intermediate layer stg (security Trading gateway) butted with the transaction interface, the stock Trading gateway and the Trading gateway butted with each large transaction through adaptation). The problem that service data packets are easily lost when the existing security service data are butted with the STG through the centralized transaction system.
The above problems are urgently needed to be solved.
Disclosure of Invention
Aiming at the defect that a service data packet is easy to lose when a centralized transaction system and an STG are in butt joint in the prior art, the embodiment of the invention provides a backup data transmission method and a backup data transmission system based on LBM.
The invention provides a backup data transmission method based on LBM, which comprises the following steps:
the first service data packet is sent to the STG queue for reading through the KCXP main link queue;
if the STG queue finds that the second service data packet is lost, the second service data packet is requested to be returned to the KCBP standby link queue;
the second service data packet is sent to an STG queue for reading through the KCBP standby link queue;
and the first service data packet and the second service data packet are integrated into a complete service data packet through the STG queue according to the time sequence of service occurrence.
Preferably, before the first service data packet is sent to the STG queue via the KCXP master link queue for reading, the method further includes:
and the receiving service counter queue sends the first service data packet to the KCXP main link queue.
Preferably, if the STG queue finds that there is a lost second service data packet, the requesting to return the second service data packet to the KCBP standby link queue specifically includes:
the STG queue sends a leakage scanning request to the service counter queue at regular time, so that the service counter queue obtains the second service data packet according to the leakage scanning request;
and the second service data packet is sent to the STG queue for reading through the KCBP standby link queue.
Preferably, the sending, by the STG queue, a leakage scanning request to the service counter queue at regular time, so that the obtaining, by the service counter queue according to the leakage scanning request, the second service data packet specifically includes:
and the STG queue sends a leakage scanning request to the service counter queue at regular time, so that after the service counter queue receives the leakage scanning request sent by the STG queue, the service counter queue confirms the lost set of the second service data packets according to the state of internal transaction data and returns the lost data according to the time sequence of service occurrence.
Preferably, after the first service data packet and the second service data packet are integrated into a complete service data packet via the STG queue according to the time sequence of service occurrence, the method further includes:
and transmitting the complete service data packet to an interface library of the exchange.
The invention also provides a backup data transmission method system based on LBM, which comprises the following steps:
the first reading module is used for sending the first service data packet to the STG queue for reading through the KCXP main link queue;
a request module, configured to request a KCBP standby link queue to return a second service data packet if the STG queue finds a lost second service data packet;
a second reading module, configured to send the second service data packet to an STG queue via the KCBP standby link queue for reading;
and the integration module is used for integrating the first service data packet and the second service data packet into a complete service data packet through the STG queue according to the time sequence of service occurrence.
Preferably, the system further comprises:
and the sending module is used for receiving the first service data packet sent by the service counter queue to the KCXP main link queue.
Preferably, the request module specifically includes:
a second service data packet obtaining unit, configured to send a leakage scanning request to the service counter queue at regular time through the STG queue, so that the service counter queue obtains the second service data packet according to the leakage scanning request;
and the reading unit is used for sending the second service data packet to the STG queue for reading through the KCBP standby link queue.
Preferably, the second service data packet obtaining unit is specifically configured to:
and sending a leakage scanning request to the service counter queue at regular time through the STG queue, confirming the lost set of the second service data packet according to the state of internal transaction data after the service counter queue receives the leakage scanning request sent by the STG queue, and returning the lost data according to the time sequence of service occurrence.
Preferably, the system further comprises:
and the transmission module is used for transmitting the complete service data packet to an interface library of the exchange.
Has the advantages that: according to the scheme, the service data is received through two paths, and when the main link fails, the standby link is used for bearing data reception, so that data interruption is effectively relieved; when the service data packet is lost in any link of the main link, the standby link completes the retransmission of the lost service data packet. The main link adopts an efficient queue transmission technology, and the standby link adopts an LBM data exchange technology based on KCBP to realize reliable and timely arrival of service data transmission. When any link has a problem, the transmission of the service data on the other link is not influenced, the problem that the service data possibly loses service data packets in the communication process is solved in time, and the stability and the reliability of service transmission are ensured.
Drawings
Fig. 1 is a diagram of steps of a method for transmitting backup data based on LBM according to an embodiment of the present invention;
fig. 2 is a diagram illustrating steps of a method for transmitting backup data based on LBM according to another embodiment of the present invention;
fig. 3 is a diagram illustrating steps of a method for transmitting backup data based on LBM according to another embodiment of the present invention;
fig. 4 is a diagram illustrating steps of a method for transmitting backup data based on LBM according to another embodiment of the present invention;
FIG. 5 is a data reception flow diagram of the KCXP master link queue of FIG. 4;
FIG. 6 is a flow chart of data reception for the KCBP backup link queue of FIG. 4;
fig. 7 is a structural diagram of a backup data transmission system based on LBM according to an embodiment of the present invention;
fig. 8 is a block diagram of a backup data transmission system based on LBM according to another embodiment of the present invention;
fig. 9 is a block diagram of a request module in an LBM-based backup data transmission system according to another embodiment of the present invention;
fig. 10 is a block diagram of a backup data transmission system based on LBM according to another embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The present invention provides a backup data transmission method based on LBM, as shown in fig. 1, including:
s100, sending the first service data packet to an STG queue for reading through a KCXP main link queue;
s200, if the STG queue finds that a second service data packet is lost, requesting to return the second service data packet to a KCBP standby link queue;
s300, the second service data packet is sent to an STG queue for reading through the KCBP standby link queue;
and S400, integrating the first service data packet and the second service data packet into a complete service data packet through the STG queue according to the time sequence of service occurrence.
Specifically, the KCBP is used for carrying the standby link queue data in the method, has high distributed transaction processing capacity, and can ensure the integrity of transaction data of the standby link. The KCXP is used for bearing main link queue data in the method, provides reliable message transmission service and a message priority mechanism, and can ensure complete, reliable and priority transmission of main link transaction data. The LBM is expressed as a data exchange protocol of KCBP in the method, lost transaction data can be conveniently, flexibly and reliably acquired through the protocol, the integrity of the transaction data is ensured, and a strong technical guarantee is provided for efficient and reliable operation of a standby link.
Further, the data of the first service data packet includes: new orders for securities trading, requests for withdrawing orders, network voting and other business data.
Preferably, as shown in fig. 2, before the sending, by the KCXP primary link queue, the first service data packet to the STG queue for reading, the method further includes:
s500, the receiving service counter queue sends the first service data packet to the KCXP main link queue.
Preferably, as shown in fig. 3, if the STG queue finds that there is a missing second service data packet, the requesting to return the second service data packet to the KCBP standby link queue specifically includes:
s201, the STG queue sends a leakage scanning request to the service counter queue at regular time, so that the service counter queue obtains the second service data packet according to the leakage scanning request;
specifically, the time interval of the STG queue timing is determined according to the service requirement, and can be set to 60 seconds generally.
S202, the second service data packet is sent to the STG queue for reading through the KCBP standby link queue.
Preferably, the sending, by the STG queue, a leakage scanning request to the service counter queue at regular time, so that the obtaining, by the service counter queue according to the leakage scanning request, the second service data packet specifically includes:
and the service counter queue receives the leakage scanning request sent by the STG queue, confirms the lost set of the second service data packets according to the state of the internal transaction data after receiving the leakage scanning request sent by the STG queue, and returns the lost data according to the time sequence of service occurrence.
Preferably, as shown in fig. 4 to 6, after the integrating the first service data packet and the second service data packet into a complete service data packet according to the time sequence of service occurrence via the STG queue, the method further includes:
s600, transmitting the complete service data packet to an interface library of the exchange.
Specifically, the interface library of the exchange is as follows: deep exchange STEP transaction data interfaces, exchange bidding and matching platform market participant interfaces, national stock-to-company transaction support platform data interfaces and the like, and the types of the interface libraries comprise a STEP flow, an SQL library, a DBF library and the like. Further, when the complete service data packet is transmitted to an interface library of the exchange, the STG sends a prompt that the service is successfully pushed to the service counter queue; and when the STG queue fails to acquire the complete service data packet for more than or equal to 3 times continuously, directly quitting the data transmission process.
The method provided by the embodiment receives the service data through two paths, and when the main link fails, the standby link undertakes data reception, so that data interruption is effectively relieved; when the service data packet is lost in any link of the main link, the standby link completes the retransmission of the lost service data packet. The main link adopts an efficient queue transmission technology, and the standby link adopts an LBM data exchange technology based on KCBP to realize reliable and timely arrival of service data transmission. When any link has a problem, the transmission of the service data on the other link is not influenced, the problem that the service data possibly loses service data packets in the communication process is solved in time, and the stability and the reliability of service transmission are ensured.
The present invention further provides a system for transmitting backup data based on LBM, as shown in fig. 7, including:
the first reading module 100 is configured to send a first service data packet to an STG queue via a KCXP main link queue for reading;
a request module 200, configured to request a KCBP standby link queue to return a second service data packet if the STG queue finds that the second service data packet is lost;
a second reading module 300, configured to send the second service data packet to an STG queue via the KCBP standby link queue for reading;
and an integration module 400, configured to integrate the first service data packet and the second service data packet into a complete service data packet through the STG queue according to the time sequence of service occurrence.
Preferably, as shown in fig. 8, the system further includes:
a sending module 500, configured to receive the service counter queue and send the first service data packet to the KCXP master link queue.
Preferably, as shown in fig. 9, if the request module 200 specifically includes:
a second service data packet obtaining unit 201, configured to send a leakage scanning request to the service counter queue at regular time through the STG queue, so that the service counter queue obtains the second service data packet according to the leakage scanning request;
a reading unit 202, configured to send the second service data packet to the STG queue via the KCBP backup link queue for reading.
Preferably, the second service data packet obtaining unit is specifically configured to:
sending a leakage scanning request to the service counter queue at regular time through the STG queue, confirming a lost set of the second service data packets according to the state of internal transaction data after the service counter queue receives the leakage scanning request sent by the STG queue, and returning the lost data according to the time sequence of service occurrence;
preferably, as shown in fig. 10, the system further includes:
a transfer module 600, configured to transfer the complete service data packet to an interface library of the exchange.
It should be noted that, since each module in the system provided in the embodiment of the present invention is based on the same concept as that of the embodiment of the method of the present invention, the technical effect brought by the embodiment of the method of the present invention is the same as that of the embodiment of the method of the present invention, and specific contents may be referred to the description in the embodiment of the method of the present invention, and are not described herein again.
The system provided by the embodiment receives the service data through two paths, and when the main link fails, the standby link undertakes data reception, so that data interruption is effectively relieved; when the service data packet is lost in any link of the main link, the standby link completes the retransmission of the lost service data packet. The main link adopts an efficient queue transmission technology, and the standby link adopts an LBM data exchange technology based on KCBP to realize reliable and timely arrival of service data transmission. When any link has a problem, the transmission of the service data on the other link is not influenced, the problem that the service data possibly loses service data packets in the communication process is solved in time, and the stability and the reliability of service transmission are ensured.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (6)
1. A backup data transmission method based on a loadable service processing module (LBM) is characterized by comprising the following steps:
the method comprises the steps that a first service data packet is sent to a main link queue of a voucher communication exchange platform KCXP by a receiving service counter queue;
the first service data packet is sent to a transaction gateway STG queue for reading through a KCXP main link queue;
if the STG queue finds that there is a lost second service data packet, requesting to return the second service data packet to a voucher core service platform KCBP standby link queue, specifically: the STG queue sends a leakage scanning request to the service counter queue at regular time, so that the service counter queue obtains the second service data packet according to the leakage scanning request; the second service data packet is sent to an STG queue for reading through a KCBP standby link queue;
the second service data packet is sent to an STG queue for reading through the KCBP standby link queue;
the first service data packet and the second service data packet are integrated into a complete service data packet through an STG queue according to the time sequence of service occurrence; the KCXP and KCBP work independently.
2. The method of claim 1, wherein the STG queue periodically sends a leak-through request to the service counter queue, causing the service counter queue to obtain the second service data packet in response to the leak-through request comprises:
and the STG queue sends a leakage scanning request to the service counter queue at regular time, so that after the service counter queue receives the leakage scanning request sent by the STG queue, the service counter queue confirms the lost set of the second service data packets according to the state of internal transaction data and returns the lost data according to the time sequence of service occurrence.
3. The method of claim 2, wherein the integrating of the first service data packet and the second service data packet into a complete service data packet via the STG queue in chronological order of service occurrence further comprises:
and transmitting the complete service data packet to an interface library of the exchange.
4. A backup data transmission method system based on a loadable service processing module LBM is characterized by comprising the following steps:
the first reading module is used for sending the first service data packet to a transaction gateway STG queue for reading through a voucher communication exchange platform KCXP main link queue;
the request module is used for requesting to return a second service data packet to a voucher core service platform KCBP standby link queue if the STG queue discovers the lost second service data packet;
a second reading module, configured to send the second service data packet to an STG queue via the KCBP standby link queue for reading;
the integration module is used for integrating the first service data packet and the second service data packet into a complete service data packet through an STG queue according to the time sequence of service occurrence;
the sending module is used for receiving the first service data packet sent by the service counter queue to the KCXP main link queue;
the request module specifically includes: a second service data packet obtaining unit, configured to send a leakage scanning request to the service counter queue at regular time through the STG queue, so that the service counter queue obtains the second service data packet according to the leakage scanning request; a reading unit, configured to send the second service data packet to an STG queue via a KCBP standby link queue for reading;
the KCXP and KCBP work independently.
5. The system of claim 4, wherein the second service data packet obtaining unit is specifically configured to:
and sending a leakage scanning request to the service counter queue at regular time through the STG queue, confirming the lost set of the second service data packet according to the state of internal transaction data after the service counter queue receives the leakage scanning request sent by the STG queue, and returning the lost data according to the time sequence of service occurrence.
6. The system of claim 5, wherein the system further comprises:
and the transmission module is used for transmitting the complete service data packet to an interface library of the exchange.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610681164.4A CN106302148B (en) | 2016-08-17 | 2016-08-17 | Backup data transmission method and system based on LBM |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610681164.4A CN106302148B (en) | 2016-08-17 | 2016-08-17 | Backup data transmission method and system based on LBM |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106302148A CN106302148A (en) | 2017-01-04 |
| CN106302148B true CN106302148B (en) | 2020-01-10 |
Family
ID=57679660
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610681164.4A Active CN106302148B (en) | 2016-08-17 | 2016-08-17 | Backup data transmission method and system based on LBM |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106302148B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110532108B (en) * | 2019-08-15 | 2022-10-11 | 北京拉勾网络技术有限公司 | Resume delivery task processing method, device, server and system |
| CN112162875A (en) * | 2020-10-12 | 2021-01-01 | 上交所技术有限责任公司 | High-reliability message transmission method in transaction system |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102142948A (en) * | 2010-02-02 | 2011-08-03 | 华为技术有限公司 | Data forwarding method, device and system |
| CN102394858A (en) * | 2011-06-30 | 2012-03-28 | 北京邮电大学 | Method and device for transmitting information |
| CN104683023B (en) * | 2013-12-03 | 2018-02-13 | 华为技术有限公司 | Method, equipment and the system of fast quick-recovery after a kind of FCoE network packet loss |
| CN103686446B (en) * | 2013-12-06 | 2018-09-14 | 广州华多网络科技有限公司 | The packet loss repeating method and system of video data transmission |
| CN103891204B (en) * | 2013-12-31 | 2015-11-25 | 华为技术有限公司 | The method of link switchover and switching equipment |
-
2016
- 2016-08-17 CN CN201610681164.4A patent/CN106302148B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN106302148A (en) | 2017-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10547670B2 (en) | Systems and methods for seamless host migration | |
| WO2021249490A1 (en) | Communication method and service data transmission method in blockchain network | |
| US7694178B2 (en) | Method, apparatus and computer program product for transaction recovery | |
| US9003062B1 (en) | Framework for exchanging large B2B transactional in-order messages using distributed file system (DFS) and associated method | |
| EP1543420B1 (en) | Consistent message ordering for semi-active and passive replication | |
| US20020062356A1 (en) | Method and apparatus for communication of message data | |
| CN107528891B (en) | Websocket-based automatic clustering method and system | |
| CN104753817A (en) | Local analogy method and local analogy system for cloud computing message queue service | |
| EP1499970A1 (en) | System, method and apparatus for data processing and storage to provide continuous operations independent of device failure or disaster | |
| CN108600316B (en) | Data management method, system and equipment of cloud storage service | |
| CN105868032A (en) | Message processing system and method supporting multi-system access | |
| CN112788074A (en) | Data transmitting method, processing method, receiving method and equipment and storage medium | |
| CN106302148B (en) | Backup data transmission method and system based on LBM | |
| US7363053B2 (en) | System for integrated mobile devices | |
| KR20140047230A (en) | Method for optimizing distributed transaction in distributed system and distributed system with optimized distributed transaction | |
| CN107071067B (en) | Cgo-based high-performance stock market access system and method | |
| CN103782278A (en) | System and method for providing dynamic invocation and service interface for use in middleware or other environment | |
| CN104079624A (en) | Message access layer framework based on service and implementing method thereof | |
| CN102427474B (en) | Data transmission system in cloud storage | |
| US20090307288A1 (en) | Backup device | |
| CN107911462A (en) | High-volume method of data synchronization based on ActiveMQ | |
| JP4975170B2 (en) | Translation agent server | |
| US20100185714A1 (en) | Distributed communications between database instances | |
| WO2020059532A1 (en) | Network service system, event log recording device, event log management method and program | |
| CN101488134A (en) | Method and system for high-performance affair modification in copying surroundings of database system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |