US11374878B2 - Data processing method and apparatus - Google Patents

Data processing method and apparatus Download PDF

Info

Publication number
US11374878B2
US11374878B2 US17/279,413 US201917279413A US11374878B2 US 11374878 B2 US11374878 B2 US 11374878B2 US 201917279413 A US201917279413 A US 201917279413A US 11374878 B2 US11374878 B2 US 11374878B2
Authority
US
United States
Prior art keywords
communication message
pathways
communication
messages
communication messages
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US17/279,413
Other versions
US20220014483A1 (en
Inventor
Yongkai ZHOU
Danni JIANG
Qi Wang
Dongjie He
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Unionpay Co Ltd
Original Assignee
China Unionpay Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Unionpay Co Ltd filed Critical China Unionpay Co Ltd
Assigned to CHINA UNIONPAY CO., LTD. reassignment CHINA UNIONPAY CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HE, Dongjie, JIANG, Danni, WANG, QI, ZHOU, Yongkai
Publication of US20220014483A1 publication Critical patent/US20220014483A1/en
Application granted granted Critical
Publication of US11374878B2 publication Critical patent/US11374878B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/22Parsing or analysis of headers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/20Support for services
    • H04L49/208Port mirroring
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/161Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields

Definitions

  • the present disclosure generally relates to the technical field of data processing and, more particularly, relates to a method and a device for data processing.
  • non-time-delay-sensitive service systems In the application scenario of large Internet traffic, extremely high requirements are put forward for the processing capabilities of distributed systems.
  • Such systems may be collectively referred to as non-time-delay-sensitive service systems.
  • non-time-delay-sensitive service systems after the service processing is completed, it is necessary to wait for a storage system to store communication messages before proceeding to a next step of the service processing in the existing technology, which may affect the performance of the service processing and may not satisfy the sudden large quantity of Internet processing requests.
  • Various embodiments of the present disclosure provide a method and a device for data processing for a non-time-delay-sensitive service system, which improves the performance of service processing under the premise of ensuring the consistency of the service processing and data stored in a database and satisfies a large number of sudden Internet processing requests.
  • Various embodiments of the present disclosure provide a data processing method, including:
  • the at least two pathways of communication messages are messages intercepted in a bypass manner from messages transmitted by a service processing system to an external system; and the service processing system does not execute logic of record storage;
  • the service processing and data storage are asynchronously decoupled and separated, the communication messages transmitted by the service processing system to the external system are intercepted in the bypass manner, and the data storage is performed according to the acquired communication messages.
  • the service processing system does not execute the logic of record storage, that is, the service processing system does not transmit the communication messages to the database for storage, and there is no need to wait for the communication messages to be stored in the database before performing the next step of the service processing, which accelerates the speed of the service processing, improve service processing performance, and satisfy a large number of sudden Internet processing requests.
  • acquiring the at least two pathways of communication messages includes:
  • two manners for acquiring communication messages are provided, that is, same communication messages are acquired through two independent manners without affecting the communication between the service processing system and the external system.
  • processing the at least two pathways of communication messages includes:
  • pre-processing the diverted communication messages and extracting application layer information in the diverted communication messages after the pre-processing.
  • the communication messages are processed to ensure the integrity of the data and the accuracy of data storage and also reduce the pressure on the database through data processing.
  • storing the communication messages to-be-stored in the database includes:
  • the communication messages to-be-stored are processed to be completed according to the at least two pathways of communication messages. That is, it is mainly based on the communication messages to-be-stored, in the case that the communication messages to-be-stored are not complete, the communication messages to-be-stored are processed to be completed according to other communication messages acquired, which ensures the accuracy of data storage.
  • a data processing device including:
  • an acquiring unit configured to acquire at least two pathways of communication messages, where the at least two pathways of communication messages are messages intercepted in a bypass manner from messages transmitted by a service processing system to an external system; and the service processing system does not execute logic of record storage;
  • a processing unit configured to process the at least two pathways of communication messages, and determine communication messages to-be-stored from the at least two pathways of communication messages processed;
  • a storage unit configured to, according to the at least two pathways of communication messages, store the communication messages to-be-stored in a database.
  • the acquiring unit is specifically configured to:
  • processing unit is specifically configured to:
  • pre-process the diverted communication messages pre-process the diverted communication messages, and extract application layer information in the diverted communication messages after the pre-processing.
  • the storage unit is specifically configured to:
  • various embodiments of the present disclosure provide a computing device, including:
  • a memory configured to store program instructions
  • a processor configured to call the program instructions stored in the memory and execute the above-mentioned data processing method according to acquired programs.
  • various embodiments of the present disclosure provide a non-transitory computer-readable storage medium, including computer-readable instructions; and when a computer reads and executes the computer-readable instructions, the computer executes the above-mentioned data processing method.
  • FIG. 1 illustrates a schematic of a system architecture in various embodiments of the present disclosure
  • FIG. 2 illustrates a schematic flowchart of a data processing method in various embodiments of the present disclosure
  • FIG. 3 illustrates a schematic flowchart of communication message processing in various embodiments of the present disclosure
  • FIG. 4 illustrates a diagram of an electronic payment system in various embodiments of the present disclosure.
  • FIG. 5 illustrates a structural schematic of a data processing device in various embodiments of the present disclosure.
  • FIG. 1 illustrates a schematic of a system architecture in various embodiments of the present disclosure.
  • the system architecture may include a service processing system 110 , a data storage system 120 , a network switching system 130 , and an external system 140 .
  • the service processing system 110 may be configured for service processing and outputting the results after the service processing.
  • the data storage system 120 may include a communication message processing system 121 and a database 122 .
  • the communication message processing system 121 may be configured to process communication messages and store the processed communication messages in the database 122 .
  • the network switching system 130 may be mainly composed of a network switch 131 , and the main function may be to perform the network communication between the service processing system 110 and the external system 140 .
  • the network switching system 130 may copy and output the network communication messages between the service processing system 110 and the external system 140 through a bypass interception manner and transmit the network communication messages to the data storage system 120 .
  • FIG. 2 illustrates a schematic flowchart of a data processing method in various embodiments of the present disclosure.
  • the process may be executed by a data processing device.
  • the data processing device may be located in a network switching system, for example, the network switching system in the present disclosure.
  • the process may specifically include the following steps.
  • step 201 at least two pathways of communication messages may be acquired.
  • At least two pathways of communication messages may be messages intercepted in a bypass manner from the messages transmitted by the service processing system to the external system through the bypass interception manner, where the service processing system may not execute the logic of record storage.
  • the service processing and data storage may be asynchronously decoupled and separated; and the service processing system may only perform service processing, and there is no need to wait for the confirmation of data storage, that is, no logic of record storage is involved.
  • the service processing system may be an electronic payment transfer system in a banking system.
  • the bypass interception manner may include a switch port mirroring manner and a link splitting interception manner.
  • the switch port mirroring manner and the link splitting interception manner may be two manners to acquire the communication messages in parallel. That is, when the bypass interception manner is used to acquire the communication messages, two interception manners may be used simultaneously, and each interception manner may acquire at least one pathway of communication messages, which is equivalent to acquiring at least two pathways of identical communication messages.
  • the communication messages may be copied through the switch port mirroring manner, and at least one pathway of first communication messages may be outputted; and the communication messages may be copied through the link splitting interception manner, and at least one pathway of second communication messages may be outputted.
  • one pathway of first communication messages may be acquired through the switch port mirroring manner, and one pathway of second communication messages may be acquired through the link splitting interception manner, where the first communication messages and the second communication messages are messages with same information.
  • step 202 the at least two pathways of communication messages may be processed, and communication messages to-be-stored may be determined from the at least two pathways of communication messages processed.
  • the at least two pathways of acquired communication messages may be processed, that is, there is a need to process any one pathway of communication messages in the at least two pathways of communication messages.
  • the diverting may be performed on the communication messages; and after pre-processing the diverted communication messages, the application layer information in the diverted communication messages after the above-mentioned pre-processing may be extracted.
  • the diverting may be first performed on the first communication messages, and it may ensure that the messages of a same session are split to a same processing node.
  • the first communication messages after the diverting may be pre-processed, that is, the network layer metadata information may be extracted, the network layer header may be removed, and the entire session may be stitched and restored. Finally, the application layer information in the network messages after the pre-processing may be extracted.
  • the extracted data may also be cached and compressed locally, which may smooth network burst traffic and avoid a relatively large load on the database.
  • the communication messages to-be-stored may be determined from the at least two pathways of communication messages after the processing.
  • the at least one pathway of first communication messages may be acquired through the switch port mirroring manner and the at least one pathway of second communication messages may be acquired through the link splitting interception manner; after the data processing is performed on the at least one pathway of first communication messages and the at least one pathway of second communication messages, one pathway of communication messages to-be-stored may be determined from the at least one pathway of first communication messages processed and the at least one pathway of second communication messages processed.
  • the communication messages to-be-stored may be one pathway of at least one pathway of first communication messages, or one pathway of at least one pathway of second communication messages.
  • one pathway of second communication message acquired through the link splitting interception manner may be determined as the communication messages to-be-stored.
  • the communication messages to-be-stored may be stored in the database according to the at least two pathways of communication messages.
  • whether the communication messages to-be-stored is complete may be first determined.
  • the communication messages to-be-stored may be directly stored in the database.
  • the communication messages to-be-stored may be stored in the database after being processed to be completed.
  • the incomplete communication messages to-be-stored may be processed to be completed according to the at least two pathways of communication messages.
  • the at least two pathways of communication messages are one pathway of first communication messages and one pathway of second communication messages; after the second communication messages are determined as the communication messages to-be-stored, if the second communication messages are not complete, the second communication messages may be processed to be completed according to the first communication messages, such that the complete communication messages may be stored in the database.
  • any communication messages may be taken as an example as shown in FIG. 3 .
  • step 301 the communication messages may be diverted.
  • the diverting processing may need to be performed first on the acquired communication messages, which is convenient for the processing by a back-end node.
  • the diverting strategy may be self-defined according to the characteristics of the service, and it is necessary to ensure that the messages of a same session are split to a same processing node.
  • the communication messages may be pre-processed.
  • the acquired communication messages may be in the format of TCP/IP (transmission control protocol/Internet protocol).
  • TCP/IP transmission control protocol/Internet protocol
  • the communication messages in the TCP/IP format may be pre-processed to extract the network layer metadata information, such as IP, port and the like; and the network layer header may be removed, and the entire session may be stitched and restored.
  • step 303 the application layer information may be extracted.
  • the application layer information in the communication messages may be extracted.
  • the information encoding of such part may be related to specific service logic, for example, the communication messages of a payment transfer system, such that metadata information of nearly a hundred fields may be extracted from the data in the communication messages.
  • Step 304 may be performed for local caching/compression.
  • local caching and compression may be performed to smooth network burst traffic and avoid causing a relatively large load on the back-end database.
  • Step 305 may be performed for storage verification of the database.
  • the switch port mirroring manner There are two manners to acquire the communication messages: the switch port mirroring manner and the link splitting interception manner, such that the integrity of the data source may be ensured to the greatest extent.
  • the data may be mainly acquired by the link splitting interception method, and the data may be secondarily acquired by the switch port mirroring method, which is equivalent to acquiring one pathway of communication messages for each acquisition method, and the data acquired by the link splitting interception method may be used as the data to-be-stored. It may determine whether the data acquired by the link splitting interception method is complete, that is, whether the data to-be-stored can be successfully stored in the database and ensure consistency with the service processing. When the data acquired by the link splitting interception method is incomplete data, the data to-be-stored may need to be processed to be completed according to the data acquired by the switch port mirroring method.
  • the data may be stored in the database.
  • the data that has passed the database storage verification may be stored in the database.
  • the data that has passed the database storage verification may be inserted into database tables through a database API (application programming interface), thereby completing the operation of storing data in the database.
  • a data delay of about 1 minute may be introduced according to different parameter settings, which may be the limit that the non-time-delay-sensitive service system can tolerate.
  • An electronic payment transfer system in the non-time-delay-sensitive service system may be taken an example to describe the specific implementation manner of the present disclosure hereinafter, specifically referring to the system architecture shown in FIG. 4 .
  • the communication connection performed between a transfer processing system 410 and an external system 440 may only be used for transfer service processing; the external system 440 may include an acquirer 441 and a card issuing bank 442 ; the transfer service processing may include receiving transfer requests from the acquirer 441 , token verification, selecting an appropriate card issuing channel, transmitting messages to the card issuing bank 442 or processing the return messages from the card issuing bank 442 and forwarding the messages to the acquirer 441 , and the like.
  • the service processing of the transfer processing system 410 may not involve any transaction storage, that is, the transfer processing system 410 and a transfer recording system 420 may be asynchronously decoupled and separated.
  • a network switching system 430 may acquire one pathway of second communication messages through the link splitting interception method, and acquire one pathway of first communication messages through the switch port mirroring method;
  • a communication message processing system 421 may process the first communication messages and the second communication messages, determine the second communication messages to be the communication messages to-be-stored, and decide whether the communication messages to-be-stored is complete; and if the communication messages to-be-stored is not complete, after the second communication messages are processed to be completed according to the first communication messages and the second communication messages, the second communication messages may be stored in a database 422 .
  • the network switch in the network switching system may be a single physical network switch, or a switching matrix composed of multiple physical switches, or a logical virtual switch for a certain processing system in a cloud data center.
  • the database in the data storage system is a general term for the data storage form, and its specific form may be a centralized relational database, a distributed relational database, a file database, or a nosql database.
  • the characteristics of the non-time-delay-sensitive service system may be fully utilized to asynchronously decouple and separate the service processing system and the data storage system, and the service processing system may only involve data processing logic without any data storage logic, thereby accelerating the service processing speed and satisfying a large number of sudden network processing requests.
  • the network communication system may intercept the communication messages between the service processing system and the external system through the switch port mirroring method and the link splitting interception method, and the intercepted communication messages may be stored in the data storage system after being processed; moreover, the same communication messages may be acquired using two types of independent manners, which may ensure the success rate of storing the complete communication data in the database. Furthermore, the consistency of the service processing and stored data in the database may be insured.
  • the beneficial effects of various embodiments of the present disclosure may include:
  • the service processing and data storage may be asynchronously decoupled and separated, such that the result of each service processing may be quickly returned without waiting for the data result confirmation, thereby improving the processing performance when the network traffic is at peak to the maximum extent; meanwhile, the use of the burst and unevenness of the network traffic may allow data storage to have a certain storage time delay, thereby ensuring that the data in the overall time dimension is effectively cached and stored in the database;
  • the data storage system may perform recording by intercepting transmitted communication data; the diverting of the communication data may adopt the switch port mirroring method and the link splitting interception method to be synchronized and independent, thereby ensuring that the communication data is not lost to the maximum extent; moreover, the bypass manner may be adopted, which may not affect the service processing performance;
  • the existing network performance analysis system such as NPM (network performance monitoring)
  • NPM network performance monitoring
  • FIG. 5 illustrates a structural schematic of a data processing device in various embodiments of the present disclosure.
  • the device may execute the process of the data processing method.
  • An acquiring unit 501 may be configured to acquire at least two pathways of communication messages, where the at least two pathways of communication messages are messages intercepted in the bypass manner from messages transmitted by the service processing system to the external system; and the service processing system does not execute the logic of record storage.
  • a processing unit 502 may be configured to process the at least two pathways of communication messages and determine communication messages to-be-stored from the at least two pathways of communication messages processed.
  • a storage unit 503 may be configured to, according to the at least two pathways of communication messages, store the communication messages to-be-stored in the database.
  • the acquiring unit 501 may be specifically configured to:
  • processing unit 502 may be specifically configured to:
  • pre-process the diverted communication messages and extract the application layer information in the diverted communication messages after the pre-processing.
  • the storage unit 503 may be specifically configured to:
  • various embodiments of the present disclosure also provide a computing device, including:
  • a memory configured to store program instructions
  • a processor configured to call the program instructions stored in the memory and execute the above-mentioned data processing method according to acquired programs.
  • various embodiments of the present disclosure also provide a non-transitory computer-readable storage medium, including computer-readable instructions; when a computer reads and executes the computer-readable instructions, the computer may execute the above-mentioned data processing method.
  • Such computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to work in a specific manner, such that the instructions stored in the computer-readable memory produce a manufacturing article including the instruction device.
  • the instruction device implements the functions specified in one or more processes in the flowcharts and/or one or more blocks in the block diagrams.
  • Such computer program instructions may also be loaded on a computer or other programmable data processing apparatus, such that a series of operation steps are executed on the computer or other programmable apparatus to produce computer-implemented processing. Therefore, the instructions executed by the processor of the computer or other programmable data processing apparatus may implement the functions specified in one or more processes in the flowcharts and/or one or more blocks in the block diagrams.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The present disclosure provides a method and a device for data processing. The method includes acquiring at least two pathways of communication messages, where the at least two pathways of communication messages are messages intercepted in a bypass manner from messages transmitted by a service processing system to an external system; and the service processing system does not execute logic of record storage; processing the at least two pathways of communication messages, and determining communication messages to-be-stored from the at least two pathways of communication messages processed; and according to the at least two pathways of communication messages, storing the communication messages to-be-stored in a database.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
This application is a national phase entry under 35 U.S.C § 371 of International Application No. PCT/CN2019/112568, filed on Oct. 22, 2019, which claims priority of Chinese Patent Application No. 201811279474.9, entitled “Method and Device for Data Processing”, filed with the State Intellectual Property Office of P. R. China on Oct. 30, 2018, the entire content of all of which is incorporated herein by reference.
FIELD OF THE DISCLOSURE
The present disclosure generally relates to the technical field of data processing and, more particularly, relates to a method and a device for data processing.
BACKGROUND
In the application scenario of large Internet traffic, extremely high requirements are put forward for the processing capabilities of distributed systems. There is a type of service system which has extremely high processing performance and throughput requirements but may have a certain tolerance for the time delay of service data storage. Such systems may be collectively referred to as non-time-delay-sensitive service systems. For the non-time-delay-sensitive service systems, after the service processing is completed, it is necessary to wait for a storage system to store communication messages before proceeding to a next step of the service processing in the existing technology, which may affect the performance of the service processing and may not satisfy the sudden large quantity of Internet processing requests.
For the non-time-delay-sensitive service systems, there is a need to develop a method and a device which may asynchronously decouple and separate the service processing and data storage, and within the range of a time delay tolerance allowed by the data storage, may improve the service processing performance to satisfy the sudden large quantity of Internet processing requests.
BRIEF SUMMARY OF THE DISCLOSURE
Various embodiments of the present disclosure provide a method and a device for data processing for a non-time-delay-sensitive service system, which improves the performance of service processing under the premise of ensuring the consistency of the service processing and data stored in a database and satisfies a large number of sudden Internet processing requests.
Various embodiments of the present disclosure provide a data processing method, including:
acquiring at least two pathways of communication messages, where the at least two pathways of communication messages are messages intercepted in a bypass manner from messages transmitted by a service processing system to an external system; and the service processing system does not execute logic of record storage;
processing the at least two pathways of communication messages, and determining communication messages to-be-stored from the at least two pathways of communication messages processed; and
according to the at least two pathways of communication messages, storing the communication messages to-be-stored in a database.
In the above-mentioned technical solution, the service processing and data storage are asynchronously decoupled and separated, the communication messages transmitted by the service processing system to the external system are intercepted in the bypass manner, and the data storage is performed according to the acquired communication messages. The service processing system does not execute the logic of record storage, that is, the service processing system does not transmit the communication messages to the database for storage, and there is no need to wait for the communication messages to be stored in the database before performing the next step of the service processing, which accelerates the speed of the service processing, improve service processing performance, and satisfy a large number of sudden Internet processing requests.
Optionally, acquiring the at least two pathways of communication messages includes:
copying communication messages through a switch port mirroring manner, and outputting at least one pathway of first communication messages; and
copying communication messages through a link splitting interception manner, and outputting at least one pathway of second communication messages.
In the above-mentioned technical solution, two manners for acquiring communication messages are provided, that is, same communication messages are acquired through two independent manners without affecting the communication between the service processing system and the external system.
Optionally, processing the at least two pathways of communication messages includes:
for any one pathway of communication messages in the at least two pathways of communication messages, performing diverting processing on the communication messages; and
pre-processing the diverted communication messages and extracting application layer information in the diverted communication messages after the pre-processing.
In the above-mentioned technical solution, the communication messages are processed to ensure the integrity of the data and the accuracy of data storage and also reduce the pressure on the database through data processing.
Optionally, according to the at least two pathways of communication messages, storing the communication messages to-be-stored in the database includes:
determining whether the communication messages to-be-stored are complete; and if not complete, according to the at least two pathways of communication messages, storing the communication messages to-be-stored in the database after being processed to be completed.
In the above-mentioned technical solution, when the messages to-be-stored are not complete, the communication messages to-be-stored are processed to be completed according to the at least two pathways of communication messages. That is, it is mainly based on the communication messages to-be-stored, in the case that the communication messages to-be-stored are not complete, the communication messages to-be-stored are processed to be completed according to other communication messages acquired, which ensures the accuracy of data storage.
Accordingly, various embodiments of the present disclosure provide a data processing device, including:
an acquiring unit, configured to acquire at least two pathways of communication messages, where the at least two pathways of communication messages are messages intercepted in a bypass manner from messages transmitted by a service processing system to an external system; and the service processing system does not execute logic of record storage;
a processing unit, configured to process the at least two pathways of communication messages, and determine communication messages to-be-stored from the at least two pathways of communication messages processed; and
a storage unit, configured to, according to the at least two pathways of communication messages, store the communication messages to-be-stored in a database.
Optionally, the acquiring unit is specifically configured to:
copy communication messages through a switch port mirroring manner, and output at least one pathway of first communication messages; and
copy communication messages through a link splitting interception manner, and output at least one pathway of second communication messages.
Optionally, the processing unit is specifically configured to:
for any one pathway of communication messages in the at least two pathways of communication messages, perform diverting processing on the communication messages; and
pre-process the diverted communication messages, and extract application layer information in the diverted communication messages after the pre-processing.
Optionally, the storage unit is specifically configured to:
determine whether the communication messages to-be-stored are complete; and if not complete, according to the at least two pathways of communication messages, store the communication messages to-be-stored in the database after being processed to be completed.
Accordingly, various embodiments of the present disclosure provide a computing device, including:
a memory, configured to store program instructions; and
a processor, configured to call the program instructions stored in the memory and execute the above-mentioned data processing method according to acquired programs.
Accordingly, various embodiments of the present disclosure provide a non-transitory computer-readable storage medium, including computer-readable instructions; and when a computer reads and executes the computer-readable instructions, the computer executes the above-mentioned data processing method.
BRIEF DESCRIPTION OF THE DRAWINGS
In order to clearly illustrate the technical solutions in various embodiments of the present disclosure, the accompanying drawings, which are required to be used in the description of disclosed embodiments, are briefly described hereinafter. Obviously, the accompanying drawings in the following description are merely certain embodiments of the present disclosure. Other accompanying drawings derived from such accompanying drawings may be acquired by those skilled in the art without creative work.
FIG. 1 illustrates a schematic of a system architecture in various embodiments of the present disclosure;
FIG. 2 illustrates a schematic flowchart of a data processing method in various embodiments of the present disclosure;
FIG. 3 illustrates a schematic flowchart of communication message processing in various embodiments of the present disclosure;
FIG. 4 illustrates a diagram of an electronic payment system in various embodiments of the present disclosure; and
FIG. 5 illustrates a structural schematic of a data processing device in various embodiments of the present disclosure.
DETAILED DESCRIPTION
The technical solutions in various embodiments of the present disclosure are described clearly and completely in conjunction with the drawings in various embodiments of the present disclosure. Obviously, the described embodiments are merely a part of various embodiments of the present disclosure, but not all of various embodiments. Based on various embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present disclosure.
FIG. 1 illustrates a schematic of a system architecture in various embodiments of the present disclosure. The system architecture may include a service processing system 110, a data storage system 120, a network switching system 130, and an external system 140.
The service processing system 110 may be configured for service processing and outputting the results after the service processing.
The data storage system 120 may include a communication message processing system 121 and a database 122. The communication message processing system 121 may be configured to process communication messages and store the processed communication messages in the database 122.
The network switching system 130 may be mainly composed of a network switch 131, and the main function may be to perform the network communication between the service processing system 110 and the external system 140. The network switching system 130 may copy and output the network communication messages between the service processing system 110 and the external system 140 through a bypass interception manner and transmit the network communication messages to the data storage system 120.
Based on the above-mentioned description, FIG. 2 illustrates a schematic flowchart of a data processing method in various embodiments of the present disclosure. The process may be executed by a data processing device. The data processing device may be located in a network switching system, for example, the network switching system in the present disclosure.
As shown in FIG. 2, the process may specifically include the following steps.
In step 201, at least two pathways of communication messages may be acquired.
At least two pathways of communication messages may be messages intercepted in a bypass manner from the messages transmitted by the service processing system to the external system through the bypass interception manner, where the service processing system may not execute the logic of record storage. In various embodiments of the present disclosure, the service processing and data storage may be asynchronously decoupled and separated; and the service processing system may only perform service processing, and there is no need to wait for the confirmation of data storage, that is, no logic of record storage is involved. The service processing system may be an electronic payment transfer system in a banking system.
When acquiring the communication messages, the communication messages may be acquired through the bypass interception manner. The bypass interception manner may include a switch port mirroring manner and a link splitting interception manner. The switch port mirroring manner and the link splitting interception manner may be two manners to acquire the communication messages in parallel. That is, when the bypass interception manner is used to acquire the communication messages, two interception manners may be used simultaneously, and each interception manner may acquire at least one pathway of communication messages, which is equivalent to acquiring at least two pathways of identical communication messages.
As an implementation manner, the communication messages may be copied through the switch port mirroring manner, and at least one pathway of first communication messages may be outputted; and the communication messages may be copied through the link splitting interception manner, and at least one pathway of second communication messages may be outputted. For example, one pathway of first communication messages may be acquired through the switch port mirroring manner, and one pathway of second communication messages may be acquired through the link splitting interception manner, where the first communication messages and the second communication messages are messages with same information.
In step 202, the at least two pathways of communication messages may be processed, and communication messages to-be-stored may be determined from the at least two pathways of communication messages processed.
The at least two pathways of acquired communication messages may be processed, that is, there is a need to process any one pathway of communication messages in the at least two pathways of communication messages. Specifically, the diverting may be performed on the communication messages; and after pre-processing the diverted communication messages, the application layer information in the diverted communication messages after the above-mentioned pre-processing may be extracted.
Taking the first communication messages acquired by the switch port mirroring manner as an example, the diverting may be first performed on the first communication messages, and it may ensure that the messages of a same session are split to a same processing node. The first communication messages after the diverting may be pre-processed, that is, the network layer metadata information may be extracted, the network layer header may be removed, and the entire session may be stitched and restored. Finally, the application layer information in the network messages after the pre-processing may be extracted.
Furthermore, after extracting the application layer information in the network messages after the pre-processing, the extracted data may also be cached and compressed locally, which may smooth network burst traffic and avoid a relatively large load on the database.
After processing the at least two pathways of acquired communication messages, the communication messages to-be-stored may be determined from the at least two pathways of communication messages after the processing. It should be understood that the at least one pathway of first communication messages may be acquired through the switch port mirroring manner and the at least one pathway of second communication messages may be acquired through the link splitting interception manner; after the data processing is performed on the at least one pathway of first communication messages and the at least one pathway of second communication messages, one pathway of communication messages to-be-stored may be determined from the at least one pathway of first communication messages processed and the at least one pathway of second communication messages processed. The communication messages to-be-stored may be one pathway of at least one pathway of first communication messages, or one pathway of at least one pathway of second communication messages. Optionally, one pathway of second communication message acquired through the link splitting interception manner may be determined as the communication messages to-be-stored.
In step 203, the communication messages to-be-stored may be stored in the database according to the at least two pathways of communication messages.
Specifically, whether the communication messages to-be-stored is complete may be first determined.
If it is determined that the communication messages to-be-stored is complete data, the communication messages to-be-stored may be directly stored in the database.
If it is determined that the communication messages to-be-stored is incomplete data, according to the at least two pathways of communication messages, the communication messages to-be-stored may be stored in the database after being processed to be completed. In other words, when the communication messages to-be-stored is incomplete, the incomplete communication messages to-be-stored may be processed to be completed according to the at least two pathways of communication messages. For example, the at least two pathways of communication messages are one pathway of first communication messages and one pathway of second communication messages; after the second communication messages are determined as the communication messages to-be-stored, if the second communication messages are not complete, the second communication messages may be processed to be completed according to the first communication messages, such that the complete communication messages may be stored in the database.
In order to better understand the above-mentioned implementation manner for processing the at least two pathways of communication messages, any communication messages may be taken as an example as shown in FIG. 3.
In step 301, the communication messages may be diverted.
Since the data volume of the communication messages acquired by the bypass interception manner is relatively large, the diverting processing may need to be performed first on the acquired communication messages, which is convenient for the processing by a back-end node. The diverting strategy may be self-defined according to the characteristics of the service, and it is necessary to ensure that the messages of a same session are split to a same processing node.
In step 302, the communication messages may be pre-processed.
The acquired communication messages may be in the format of TCP/IP (transmission control protocol/Internet protocol). The communication messages in the TCP/IP format may be pre-processed to extract the network layer metadata information, such as IP, port and the like; and the network layer header may be removed, and the entire session may be stitched and restored.
In step 303, the application layer information may be extracted.
The application layer information in the communication messages may be extracted. The information encoding of such part may be related to specific service logic, for example, the communication messages of a payment transfer system, such that metadata information of nearly a hundred fields may be extracted from the data in the communication messages.
Step 304 may be performed for local caching/compression.
For the extracted application layer data, local caching and compression may be performed to smooth network burst traffic and avoid causing a relatively large load on the back-end database.
Step 305 may be performed for storage verification of the database.
There are two manners to acquire the communication messages: the switch port mirroring manner and the link splitting interception manner, such that the integrity of the data source may be ensured to the greatest extent.
Optionally, the data may be mainly acquired by the link splitting interception method, and the data may be secondarily acquired by the switch port mirroring method, which is equivalent to acquiring one pathway of communication messages for each acquisition method, and the data acquired by the link splitting interception method may be used as the data to-be-stored. It may determine whether the data acquired by the link splitting interception method is complete, that is, whether the data to-be-stored can be successfully stored in the database and ensure consistency with the service processing. When the data acquired by the link splitting interception method is incomplete data, the data to-be-stored may need to be processed to be completed according to the data acquired by the switch port mirroring method.
In step 306, the data may be stored in the database.
The data that has passed the database storage verification may be stored in the database. Optionally, the data that has passed the database storage verification may be inserted into database tables through a database API (application programming interface), thereby completing the operation of storing data in the database.
It should be noted that the above-mentioned whole process from the communication message diverting processing to storing data in the database, a data delay of about 1 minute may be introduced according to different parameter settings, which may be the limit that the non-time-delay-sensitive service system can tolerate.
An electronic payment transfer system in the non-time-delay-sensitive service system may be taken an example to describe the specific implementation manner of the present disclosure hereinafter, specifically referring to the system architecture shown in FIG. 4. The communication connection performed between a transfer processing system 410 and an external system 440 may only be used for transfer service processing; the external system 440 may include an acquirer 441 and a card issuing bank 442; the transfer service processing may include receiving transfer requests from the acquirer 441, token verification, selecting an appropriate card issuing channel, transmitting messages to the card issuing bank 442 or processing the return messages from the card issuing bank 442 and forwarding the messages to the acquirer 441, and the like. The service processing of the transfer processing system 410 may not involve any transaction storage, that is, the transfer processing system 410 and a transfer recording system 420 may be asynchronously decoupled and separated. A network switching system 430 may acquire one pathway of second communication messages through the link splitting interception method, and acquire one pathway of first communication messages through the switch port mirroring method; a communication message processing system 421 may process the first communication messages and the second communication messages, determine the second communication messages to be the communication messages to-be-stored, and decide whether the communication messages to-be-stored is complete; and if the communication messages to-be-stored is not complete, after the second communication messages are processed to be completed according to the first communication messages and the second communication messages, the second communication messages may be stored in a database 422.
It should be noted that the network switch in the network switching system may be a single physical network switch, or a switching matrix composed of multiple physical switches, or a logical virtual switch for a certain processing system in a cloud data center.
The database in the data storage system is a general term for the data storage form, and its specific form may be a centralized relational database, a distributed relational database, a file database, or a nosql database.
In the above-mentioned embodiments, the characteristics of the non-time-delay-sensitive service system may be fully utilized to asynchronously decouple and separate the service processing system and the data storage system, and the service processing system may only involve data processing logic without any data storage logic, thereby accelerating the service processing speed and satisfying a large number of sudden network processing requests. The network communication system may intercept the communication messages between the service processing system and the external system through the switch port mirroring method and the link splitting interception method, and the intercepted communication messages may be stored in the data storage system after being processed; moreover, the same communication messages may be acquired using two types of independent manners, which may ensure the success rate of storing the complete communication data in the database. Furthermore, the consistency of the service processing and stored data in the database may be insured.
Compared with the existing data processing method, the beneficial effects of various embodiments of the present disclosure may include:
high processing performance, where, by fully utilizing the characteristics of non-time-delay-sensitive service systems, the service processing and data storage may be asynchronously decoupled and separated, such that the result of each service processing may be quickly returned without waiting for the data result confirmation, thereby improving the processing performance when the network traffic is at peak to the maximum extent; meanwhile, the use of the burst and unevenness of the network traffic may allow data storage to have a certain storage time delay, thereby ensuring that the data in the overall time dimension is effectively cached and stored in the database;
a variety of manners ensuring the data being reliably recorded, where the data storage system may perform recording by intercepting transmitted communication data; the diverting of the communication data may adopt the switch port mirroring method and the link splitting interception method to be synchronized and independent, thereby ensuring that the communication data is not lost to the maximum extent; moreover, the bypass manner may be adopted, which may not affect the service processing performance;
high system reusability, where the communication data acquired through the bypass interception manner may be imported into the database after being processed; the existing network performance analysis system, such as NPM (network performance monitoring), may be multiplexed as such portion, and it may only need to perform further analysis for the messages at the application layer; since a certain storage time delay is allowed, a certain caching and optimization mechanism may effectively reduce the processing pressure of the database.
Based on the same inventive concept, FIG. 5 illustrates a structural schematic of a data processing device in various embodiments of the present disclosure. The device may execute the process of the data processing method.
An acquiring unit 501 may be configured to acquire at least two pathways of communication messages, where the at least two pathways of communication messages are messages intercepted in the bypass manner from messages transmitted by the service processing system to the external system; and the service processing system does not execute the logic of record storage.
A processing unit 502 may be configured to process the at least two pathways of communication messages and determine communication messages to-be-stored from the at least two pathways of communication messages processed.
A storage unit 503 may be configured to, according to the at least two pathways of communication messages, store the communication messages to-be-stored in the database.
Optionally, the acquiring unit 501 may be specifically configured to:
copy communication messages through the switch port mirroring manner, and output at least one pathway of first communication messages; and
copy communication messages through the link splitting interception manner, and output at least one pathway of second communication messages.
Optionally, the processing unit 502 may be specifically configured to:
for any one pathway of communication messages in the at least two pathways of communication messages, perform diverting processing on the communication messages; and
pre-process the diverted communication messages, and extract the application layer information in the diverted communication messages after the pre-processing.
Optionally, the storage unit 503 may be specifically configured to:
determine whether the communication messages to-be-stored are complete; and if not complete, according to the at least two pathways of communication messages, store the communication messages to-be-stored in the database after being processed to be completed.
Based on the same inventive concept, various embodiments of the present disclosure also provide a computing device, including:
a memory, configured to store program instructions; and
a processor, configured to call the program instructions stored in the memory and execute the above-mentioned data processing method according to acquired programs.
Based on the same inventive concept, various embodiments of the present disclosure also provide a non-transitory computer-readable storage medium, including computer-readable instructions; when a computer reads and executes the computer-readable instructions, the computer may execute the above-mentioned data processing method.
The present disclosure is described with reference to flowcharts and/or block diagrams of methods, devices (systems), and computer program products according to various embodiments of the present disclosure. It should be understood that each process and/or block in the flowcharts and/or block diagrams, and the combination of processes and/or blocks in the flowcharts and/or block diagrams may be implemented by computer program instructions. Such computer program instructions may be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing apparatus, such that the instructions executed by the processor of the computer or other programmable data processing apparatus may implement the functions specified in one or more processes in the flowcharts and/or one or more blocks in the block diagrams.
Such computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to work in a specific manner, such that the instructions stored in the computer-readable memory produce a manufacturing article including the instruction device. The instruction device implements the functions specified in one or more processes in the flowcharts and/or one or more blocks in the block diagrams.
Such computer program instructions may also be loaded on a computer or other programmable data processing apparatus, such that a series of operation steps are executed on the computer or other programmable apparatus to produce computer-implemented processing. Therefore, the instructions executed by the processor of the computer or other programmable data processing apparatus may implement the functions specified in one or more processes in the flowcharts and/or one or more blocks in the block diagrams.
Although preferred embodiments of the present disclosure have been described, those skilled in the art may make additional changes and modifications to such embodiments once they learn the basic creative concept. Therefore, the appended claims may be intended to be interpreted as including preferred embodiments and all changes and modifications falling within the scope of the present disclosure.
Obviously, those skilled in the art may make various changes and modifications to the present disclosure without departing from the spirit and scope of the present disclosure. In such way, if these modifications and variations of the present disclosure fall within the scope of the claims of the present disclosure and their equivalent technologies, the present disclosure may also be intended to include these modifications and variations.

Claims (19)

What is claimed is:
1. A method for data processing, implemented by a network switching device, comprising:
intercepting, by simultaneously applying at least two bypass interception manners, an original communication message transmitted by a service processing system to an external system, to acquire at least two pathways of communication messages, each bypass interception manner being applied to acquire at least one pathway of communication message, wherein the at least two bypass interception manner include a switch port mirroring manner and a link splitting interception manner, each message of the at least two pathways of communication messages has same information as the original communication message, and the service processing system does not execute a storage operation of storing the original communication message;
processing the at least two pathways of communication messages, and determining a target communication message to-be-stored from the at least two pathways of communication messages processed; and
according to the at least two pathways of communication messages, storing the target communication message in a database.
2. The method according to claim 1, wherein intercepting, by simultaneously applying the at least two bypass interception manners, the original communication message, to acquire the at least two pathways of communication messages includes:
copying the original communication message through the switch port mirroring manner, and outputting at least one pathway of first communication message, and
copying the original communication message through the link splitting interception manner, and outputting at least one pathway of second communication message.
3. The method according to claim 2, wherein determining a target communication message to-be-stored from the at least two pathways of communication messages processed comprises:
determining that the second communication message acquired through the link splitting interception manner is the target communication message to-be-stored.
4. The method according to claim 3, wherein storing the target communication message in the database comprises:
determining whether the target communication message is complete; and
if not complete, completing the target communication message according to the first communication message acquired through the switch port mirroring manner, and storing the completed target communication message in the database.
5. The method according to claim 1, wherein processing the at least two pathways of communication messages includes:
for any one pathway of communication message in the at least two pathways of communication messages, diverting the pathway of communication message to a corresponding processing node; and
pre-processing the diverted communication message, and extracting application layer information from the pre-processed communication message.
6. The method according to claim 5, wherein diverting the pathway of communication message to a corresponding processing node comprises:
diverting the pathway of communication message to the corresponding processing node that has received a message of a same session as the pathway of communication message.
7. The method according to claim 6, wherein pre-processing the diverted communication message comprises:
extracting network layer metadata information from the pathway of communication message; and
removing network layer header from the network layer metadata information; and
stitching and restoring the session.
8. The method according to claim 1, wherein according to the at least two pathways of communication messages, storing the target communication message in the database includes:
determining whether the target communication message is complete; and
if not complete, completing the target communication message according to another communication message from the at least two pathways of communication messages, and storing the completed target communication message in the database.
9. The method according to claim 8, wherein determining whether the target communication message is complete comprises:
determining whether data to-be-stored extracted from the target communication message can be successfully stored in the database and is consistent with a service processing record.
10. The method according to claim 8, wherein completing the target communication message according to another communication message from the at least two pathways of communication messages comprises:
when the target communication message is acquired through the link splitting interception manner, completing the target communication message according to one of the at least two pathways of communication messages acquired through the switch port mirroring manner; and
when the target communication message is acquired through the switch port mirroring manner, completing the target communication message according to one of the at least two pathways of communication messages acquired through the link splitting interception manner.
11. The method according to claim 1, wherein
the service system does not wait for a confirmation that the target communication message is stored.
12. A network switching device for data processing, comprising:
a memory, configured to store program instructions for performing a method for data processing; and
a processor, coupled with the memory and, when executing the program instructions, configured to:
intercept, by simultaneously applying at least two bypass interception manners, an original communication message transmitted by a service processing system to an external system, to acquire at least two pathways of communication messages, each bypass interception manner being applied to acquire at least one pathway of communication message, wherein the at least two bypass interception manner include a switch port mirroring manner and a link splitting interception manner, each message of the at least two pathways of communication messages has same information as the original communication message, and the service processing system does not execute a storage operation of storing the original communication message;
process the at least two pathways of communication messages, and determine a target communication message to-be-stored from the at least two pathways of communication messages processed; and
according to the at least two pathways of communication messages, store the target communication message in a database.
13. The device according to claim 12, wherein the processor is further configured to:
copy the original communication message through the switch port mirroring manner, and outputting at least one pathway of first communication message; and
copy the original communication message through the link splitting interception manner, and outputting at least one pathway of second communication message.
14. The device according to claim 12, wherein the processor is further configured to:
for any one pathway of communication message in the at least two pathways of communication messages, divert the pathway of communication message to a corresponding processing node; and
pre-process the diverted communication message, and extract application layer information from the pre-processed communication message.
15. The device according to claim 12, wherein the processor is further configured to:
determine whether the target communication message is complete; and
if not complete, complete the target communication message according to another communication message from the at least two pathways of communication messages, and store the completed target communication message in the database.
16. A non-transitory computer-readable storage medium, containing program instructions that, when executed by a processor of a network switching device, causing the processor to perform:
intercepting, by simultaneously applying at least two bypass interception manners, an original communication message transmitted by a service processing system to an external system, to acquire at least two pathways of communication messages, each bypass interception manner being applied to acquire at least one pathway of communication message, wherein the at least two bypass interception manner include a switch port mirroring manner and a link splitting interception manner, each message of the at least two pathways of communication messages has same information as the original communication message, and the service processing system does not execute a storage operation of storing the original communication message;
processing the at least two pathways of communication messages, and determining a target communication message to-be-stored from the at least two pathways of communication messages processed; and
according to the at least two pathways of communication messages, storing the target communication message in a database.
17. The storage medium according to claim 16, wherein intercepting, by simultaneously applying the at least two bypass interception manners, the original communication message, to acquire the at least two pathways of communication messages includes:
copying the original communication message through the switch port mirroring manner, and outputting at least one pathway of first communication message; and
copying the original communication message through the link splitting interception manner, and outputting at least one pathway of second communication message.
18. The storage medium according to claim 16, wherein processing the at least two pathways of communication messages includes:
for any one pathway of communication message in the at least two pathways of communication messages, diverting the pathway of communication message to a corresponding processing node; and
pre-processing the diverted communication message, and extracting application layer information from the pre-processed communication message.
19. The storage medium according to claim 16, wherein according to the at least two pathways of communication messages, storing the target communication message in the database includes:
determining whether the target communication message is complete; and
if not complete, completing the target communication message according to another communication message from the at least two pathways of communication messages, and storing the completed target communication message in the database.
US17/279,413 2018-10-30 2019-10-22 Data processing method and apparatus Active US11374878B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201811279474.9 2018-10-30
CN201811279474.9A CN109446200B (en) 2018-10-30 2018-10-30 Data processing method and device
PCT/CN2019/112568 WO2020088311A1 (en) 2018-10-30 2019-10-22 Data processing method and apparatus

Publications (2)

Publication Number Publication Date
US20220014483A1 US20220014483A1 (en) 2022-01-13
US11374878B2 true US11374878B2 (en) 2022-06-28

Family

ID=65549119

Family Applications (1)

Application Number Title Priority Date Filing Date
US17/279,413 Active US11374878B2 (en) 2018-10-30 2019-10-22 Data processing method and apparatus

Country Status (3)

Country Link
US (1) US11374878B2 (en)
CN (1) CN109446200B (en)
WO (1) WO2020088311A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109446200B (en) 2018-10-30 2021-04-16 中国银联股份有限公司 Data processing method and device
CN114301621B (en) * 2021-11-17 2024-06-14 北京智芯微电子科技有限公司 Intelligent transformer substation and network communication safety control method and device thereof

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100070471A1 (en) * 2008-09-17 2010-03-18 Rohati Systems, Inc. Transactional application events
US20100318665A1 (en) * 2003-04-14 2010-12-16 Riverbed Technology, Inc. Interception of a cloud-based communication connection
US20110225231A1 (en) * 2010-03-15 2011-09-15 Microsoft Corporation Direct addressability and direct server return
JP5620881B2 (en) 2011-05-18 2014-11-05 日本電信電話株式会社 Transaction processing system, transaction processing method, and transaction processing program
US20160036825A1 (en) * 2014-07-29 2016-02-04 Time Warner Cable Enterprises Llc Communication management and policy-based data routing
US20180060308A1 (en) * 2016-08-31 2018-03-01 Beijing Xiaomi Mobile Software Co., Ltd. Method and apparatus for message communication
US9928379B1 (en) * 2008-09-08 2018-03-27 Steven Miles Hoffer Methods using mediation software for rapid health care support over a secured wireless network; methods of composition; and computer program products therefor
US10002526B1 (en) * 2016-12-20 2018-06-19 Arrayent, Inc. Internet-of-things systems and methods
US20180183901A1 (en) * 2016-12-27 2018-06-28 Chicago Mercantile Exchange Inc. Message processing protocol which mitigates optimistic messaging behavior
CN108667921A (en) 2018-04-27 2018-10-16 中国农业银行股份有限公司 A kind of banking recommendation information generation method and system based on network bypass
CN108712306A (en) 2018-05-10 2018-10-26 国网宁夏电力有限公司信息通信公司 A kind of information system automation inspection platform and method for inspecting
US10135772B2 (en) * 2013-09-18 2018-11-20 Tencent Technology (Shenzhen) Company Limited Systems and methods for message prompting
CN109446200A (en) 2018-10-30 2019-03-08 中国银联股份有限公司 A kind of method and device of data processing
US20190140995A1 (en) * 2017-11-03 2019-05-09 Salesforce.Com, Inc. Action response selection based on communication message analysis

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7903671B2 (en) * 2005-08-04 2011-03-08 Cisco Technology, Inc. Service for NAT traversal using IPSEC
CN103995676A (en) * 2014-06-16 2014-08-20 国家电网公司 Data storage method and device and data processing method and device
CN105376110B (en) * 2015-10-26 2018-10-30 上海华讯网络系统有限公司 The analysis method and system of network packet are realized with big data streaming technology
CN107770221B (en) * 2016-08-19 2021-05-14 阿里巴巴集团控股有限公司 Data transmission method, server conversion device, client conversion device and system
CN107395499B (en) * 2017-07-24 2021-01-15 北京三快在线科技有限公司 POS machine communication method and POS terminal
CN108270699B (en) * 2017-12-14 2020-11-24 中国银联股份有限公司 Message processing method, shunt switch and aggregation network

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100318665A1 (en) * 2003-04-14 2010-12-16 Riverbed Technology, Inc. Interception of a cloud-based communication connection
US9928379B1 (en) * 2008-09-08 2018-03-27 Steven Miles Hoffer Methods using mediation software for rapid health care support over a secured wireless network; methods of composition; and computer program products therefor
US20100070471A1 (en) * 2008-09-17 2010-03-18 Rohati Systems, Inc. Transactional application events
US20110225231A1 (en) * 2010-03-15 2011-09-15 Microsoft Corporation Direct addressability and direct server return
JP5620881B2 (en) 2011-05-18 2014-11-05 日本電信電話株式会社 Transaction processing system, transaction processing method, and transaction processing program
US10135772B2 (en) * 2013-09-18 2018-11-20 Tencent Technology (Shenzhen) Company Limited Systems and methods for message prompting
US20160036825A1 (en) * 2014-07-29 2016-02-04 Time Warner Cable Enterprises Llc Communication management and policy-based data routing
US20180060308A1 (en) * 2016-08-31 2018-03-01 Beijing Xiaomi Mobile Software Co., Ltd. Method and apparatus for message communication
US10002526B1 (en) * 2016-12-20 2018-06-19 Arrayent, Inc. Internet-of-things systems and methods
US20180183901A1 (en) * 2016-12-27 2018-06-28 Chicago Mercantile Exchange Inc. Message processing protocol which mitigates optimistic messaging behavior
US20190140995A1 (en) * 2017-11-03 2019-05-09 Salesforce.Com, Inc. Action response selection based on communication message analysis
CN108667921A (en) 2018-04-27 2018-10-16 中国农业银行股份有限公司 A kind of banking recommendation information generation method and system based on network bypass
CN108712306A (en) 2018-05-10 2018-10-26 国网宁夏电力有限公司信息通信公司 A kind of information system automation inspection platform and method for inspecting
CN109446200A (en) 2018-10-30 2019-03-08 中国银联股份有限公司 A kind of method and device of data processing

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
The World Intellectual Property Organization (WIPO) International Search Report for PCT/CN2019/112568 dated Jan. 22, 2020 6 Pages (including translation).

Also Published As

Publication number Publication date
CN109446200A (en) 2019-03-08
WO2020088311A1 (en) 2020-05-07
CN109446200B (en) 2021-04-16
US20220014483A1 (en) 2022-01-13

Similar Documents

Publication Publication Date Title
US7660866B2 (en) Use of virtual targets for preparing and servicing requests for server-free data transfer operations
US11374878B2 (en) Data processing method and apparatus
US20230074102A1 (en) Method and apparatus for processing data based on block chain, device and readable storage medium
CN105635324A (en) Big file uploading and continuous uploading method and device for browser or server
JP2017531250A (en) Granular / semi-synchronous architecture
CN107943572B (en) Data migration method, device, computer equipment and storage medium
CN110502583A (en) Distributed Data Synchronization method, apparatus, equipment and readable storage medium storing program for executing
CN111339192A (en) Distributed edge computing data storage system
CN113419824A (en) Data processing method, device, system and computer storage medium
CN108270520A (en) Message transmitting method, device, storage medium and computer equipment
US20240106893A1 (en) Filecoin cluster data transmission method and system based on remote direct memory access
CN114201421A (en) Data stream processing method, storage control node and readable storage medium
CN112785408A (en) Account checking method and device based on Hash
CN113806301A (en) Data synchronization method, device, server and storage medium
CN104317716A (en) Method for transmitting data among distributed nodes and distributed node equipment
CN111552668B (en) High-performance cross-domain copying method based on zfs file system
CN106383667A (en) Method and apparatus for LUN migration in business operation
US20050165983A1 (en) System and method for processing data in kernel area by a user command
US20120005175A1 (en) Method and a system for real time replaying of database workload at a fixed initial time delay
CN115729700A (en) Data processing method and device, electronic equipment and storage medium
CN111541747B (en) Data check point setting method and device
CN115934417A (en) Data backup method, system and equipment
CN114006703B (en) Intersystem data transmission method and device
CN107506264A (en) A kind of high in the clouds date storage method and device
US11762805B2 (en) Logical paths for unified file and block data storage

Legal Events

Date Code Title Description
AS Assignment

Owner name: CHINA UNIONPAY CO., LTD., CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ZHOU, YONGKAI;JIANG, DANNI;WANG, QI;AND OTHERS;REEL/FRAME:055704/0179

Effective date: 20210202

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE