CN113411382B - Real-time data acquisition system and method based on network equipment F5 - Google Patents

Real-time data acquisition system and method based on network equipment F5 Download PDF

Info

Publication number
CN113411382B
CN113411382B CN202110634126.4A CN202110634126A CN113411382B CN 113411382 B CN113411382 B CN 113411382B CN 202110634126 A CN202110634126 A CN 202110634126A CN 113411382 B CN113411382 B CN 113411382B
Authority
CN
China
Prior art keywords
data
transaction
log
cluster
message
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110634126.4A
Other languages
Chinese (zh)
Other versions
CN113411382A (en
Inventor
吴基科
董健
刘心愉
廖俊杰
叶明基
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Guangfa Bank Co Ltd
Original Assignee
China Guangfa Bank Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Guangfa Bank Co Ltd filed Critical China Guangfa Bank Co Ltd
Priority to CN202110634126.4A priority Critical patent/CN113411382B/en
Publication of CN113411382A publication Critical patent/CN113411382A/en
Application granted granted Critical
Publication of CN113411382B publication Critical patent/CN113411382B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • H04L47/12Avoiding congestion; Recovering from congestion
    • H04L47/125Avoiding congestion; Recovering from congestion by balancing the load, e.g. traffic engineering
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

The invention discloses a real-time data acquisition system and a method based on network equipment F5, wherein the method comprises the following steps: the client is linked with the server, after the link is successfully established, the client sends transaction data to the server, the link is established between the client and the F5 device, the F5 device forwards the transaction data to the data acquisition service cluster according to the iRules rule, the link is established between the data acquisition service cluster and the F5 device, the data acquisition service cluster receives the transaction data forwarded by the F5 device, the configuration data is dynamically loaded, the data message format is analyzed, and the data message format is sent to the Kafka cluster. According to the invention, the deployed network equipment F5 is used for compiling the iRules script to forward the flow passing through the equipment, and the data is analyzed through the data receiving program and collected into the kafka cluster, so that the real-time acquisition of mass data is realized.

Description

Real-time data acquisition system and method based on network equipment F5
Technical Field
The invention relates to the technical field of data acquisition, in particular to a real-time data acquisition system and method based on network equipment F5.
Background
At present, software systems mainly have modes of interface docking, file logging, database logging and the like in terms of technical implementation of real-time data acquisition, but the modes have some limitations. When the interface docking requires that the acquired data is newly added each time, a data producer is required to cooperate with a modification program to newly add a corresponding data sending interface; the file log or database log collection method requires installing a corresponding log collection agent on the log server for data collection, and when the number of the agents is large, the management difficulty is correspondingly increased.
Disclosure of Invention
The invention aims to provide a real-time data acquisition system and a real-time data acquisition method based on network equipment F5, wherein an iRules script is compiled through deployed network equipment F5 to forward flow passing through the equipment, data are analyzed through a data receiving program and collected into a kafka cluster, and real-time acquisition of mass data is realized.
In order to achieve the above object, an embodiment of the present invention provides a real-time data acquisition system based on a network device F5, including: the system comprises a client, a server, F5 equipment, a data acquisition service cluster and a Kafka cluster;
the client is linked with the server, and after the link is established successfully, the client sends transaction data to the server;
the client side establishes a link with the F5 device, and the F5 device forwards the transaction data to the data acquisition service cluster according to an iRules rule;
the data acquisition service cluster is linked with the F5 device, receives the transaction data forwarded by the F5 device, dynamically loads configuration data, analyzes a data message format, and sends the data message format to the kafka cluster.
Preferably, the F5 device is further configured to implement transaction load balancing when the client requests the server.
Preferably, the client establishes a link with the F5 device, and the F5 device forwards the transaction data according to irule rules;
the forwarded data has a specific message format, is distinguished from the contained content and comprises 4 parts of a message header, a transaction request, a transaction return and a reserved field;
the message header comprises a transaction request party IP, a service party IP, a message length, transaction time consumption and a transaction code;
in order to avoid the messy code problem in the transmission process, the transaction request and the transaction return are to directly use a 16-system to add message data in an XML or JSON format into the main message;
the reserved field is used for subsequent function expansion, and a blank field can be reserved properly.
Preferably, a log service cluster is also included;
the log service cluster is used for reserving log data in the processes of message analysis, data acquisition and the like and storing the log data into a database for storage.
Preferably, the system further comprises a management service for hosting data of the data collection service cluster, the kafka cluster and the log service cluster, and the management service is further used for dynamically configuring relevant configurations and viewing data through a web front-end interface.
Preferably, the step of receiving, by the data collection service cluster, the transaction data forwarded by the F5 device, dynamically loading configuration data, parsing a data message format, and sending the data message format to the kafka cluster includes:
if the analysis is unsuccessful, recording log data and sending the log data to the log service cluster;
and if the analysis is successful, continuing the operation, acquiring data into the kafka cluster according to the configuration items, if the acquisition is successful, sending the log to the log service cluster and stopping, otherwise, retrying, and recording and stopping after the configured maximum retrying times are reached.
Preferably, the data acquisition service cluster analyzes the message for the first time in a specific message format, analyzes the transaction request or the transaction return for the second time according to the configuration in the management service, reassembles the analysis result, and generates a target message, wherein the configuration comprises transaction configuration, message configuration and acquisition configuration;
and after the target message is generated, storing the target message data into a message pipeline of the kafka cluster through the kafka cluster to finish the acquisition process.
The embodiment also provides a real-time data acquisition method based on the network device F5, which includes:
according to transaction data sent to a server by a client, data forwarding is carried out through F5 equipment, and specifically, the F5 equipment forwards the data according to an iRules rule;
after the data acquisition service cluster receives the transaction data forwarded by the F5 equipment, dynamically loading configuration data and analyzing the data message format;
according to the analytic data, collecting the analytic data into a kafka cluster.
Preferably, collecting the parsed data into kafka clusters according to the parsed data comprises:
if the analysis is unsuccessful, recording log data and sending the log data to the log service cluster;
and if the analysis is successful, continuing to operate, acquiring data into the kafka cluster according to the configuration items, if the acquisition is successful, sending the log to the log service cluster and stopping, otherwise, retrying, and recording the log and stopping after reaching the configured maximum retrying times.
In the embodiment of the invention, the deployed network equipment F5 is used for compiling the iRules script to forward the flow passing through the equipment, the data is analyzed through the data receiving program and collected into the kafka cluster, and the real-time acquisition of mass data is realized.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a real-time data acquisition system based on a network device F5 according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a real-time data acquisition system based on a network device F5 according to another embodiment of the present invention;
fig. 3 is a basic flowchart illustrating the operation of a real-time data acquisition system based on a network device F5 according to another embodiment of the present invention;
fig. 4 is a schematic flowchart of a real-time data acquisition method based on the network device F5 according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without inventive step based on the embodiments of the present invention, are within the scope of protection of the present invention.
It should be understood that the step numbers used herein are for convenience of description only and are not intended as limitations on the order in which the steps are performed.
It is to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the specification of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
The terms "comprises" and "comprising" indicate the presence of the described features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
The term "and/or" refers to and includes any and all possible combinations of one or more of the associated listed items.
Referring to fig. 1, an embodiment of the present invention provides a real-time data acquisition system based on a network device F5, including: the system comprises a client, a server, F5 equipment, a data acquisition service cluster and a Kafka cluster, wherein the client is linked with the server, after the link is successfully established, the client sends transaction data to the server, the client establishes a link with F5 equipment, the F5 equipment forwards the transaction data to the data acquisition service cluster according to an iRules rule, the data acquisition service cluster establishes a link with F5 equipment, and the data acquisition service cluster is used for receiving the transaction data forwarded by the F5 equipment, dynamically loading configuration data, analyzing a data message format and sending the data message format to the Kafka cluster.
Referring to fig. 2 and 3, specifically, the client is a data producer and sends data to the server, and the F5 device has two functions, namely, when a client program requests the server, transaction load balancing is achieved, and data of the client is forwarded to the data collection service cluster to achieve copying and forwarding of the data. The data acquisition service cluster is used for receiving data forwarded by the F5 device, dynamically loading configuration data, analyzing the data message format, and acquiring the analyzed data into the kafka cluster to realize a complete data acquisition process. Meanwhile, in the process, the log is processed by log service, and kafka is an open-source high-throughput distributed publishing and subscribing message system, so that the unified temporary storage of real-time data is realized, and a data pipeline function is provided.
If the analysis is unsuccessful, recording log data and sending the log data to the log service cluster, if the analysis is successful, continuing to operate, acquiring the data to the kafka cluster according to the configuration items, if the acquisition is successful, sending the log to the log service cluster and stopping, otherwise, retrying, and recording and stopping after the configured maximum retrying times are reached. The log service cluster is used for reserving log data in the processes of message analysis, data acquisition and the like, storing the log data in a database, and facilitating debugging in the development process and monitoring system calling in the operation process. The management service is used for hosting a data acquisition service cluster, a kafka cluster and a log service cluster to the management service, and related configurations can be dynamically configured, data can be viewed and the like through a web front-end interface of the management service.
The specific data forwarding method realizes data forwarding capability by writing an iRules script in F5 equipment, wherein the iRules is a function in a local flow manager and can be used for managing network flow, and the grammar based on an industry standard tool command language is used, so that flexible control of directed flow can be realized.
The forwarded data has a specific message format, is distinguished from the contained content and comprises 4 parts of a message header, a transaction request, a transaction return and a reserved field. The message header contains the meta-information fields of the transaction requester IP, the server IP, the message length, the transaction time consumption, the transaction code and the like. In order to avoid the problem of messy codes in the transmission process of transaction requests and transaction returns, message data in an XML or JSON format is directly added into a main message by using a 16-system format, and blank fields can be properly reserved in consideration of subsequent function expansion.
The data acquisition service cluster analyzes the message for the first time according to a specific message format, analyzes the transaction request or the transaction return for the second time according to the configuration in the management service, reassembles the analysis result and generates the target message. The configuration items comprise: transaction configuration (metadata describing the data transaction, such as ip port of F5, etc.), message configuration (parsing rule describing the message), collection configuration (parameters describing the collected target cluster, timeout, retry, etc.), etc. And after the target message is generated, storing the message data into a kafka message pipeline through the kafka producer client to finish the acquisition process.
In an example, a real-time data collection system based on the network device F5 further includes a log service cluster, where the log service cluster is configured to retain log data of a process of parsing a message, collecting data, and the like, and store the log data in a database storage.
Specifically, the log service cluster is used for reserving log data in the processes of message analysis, data acquisition and the like, and storing the log data in a database for storage, so that debugging in the development process and availability of a monitoring system in the operation process are facilitated.
In an example, a real-time data collection system based on the network device F5 further includes a management service for hosting data of the data collection service cluster, the kafka cluster, and the log service cluster, and the management service is further used for the web front-end interface to dynamically configure the relevant configuration and view the data.
Specifically, the management service is used for hosting a data acquisition service cluster, a kafka cluster and a log service cluster to the management service, and related configurations can be dynamically configured and data viewed through a web front-end interface of the management service.
And the data acquisition service cluster analyzes the message for the first time in a specific message format, analyzes the transaction request or the transaction return for the second time according to the configuration in the management service, reassembles the analysis result to generate a target message, wherein the configuration comprises transaction configuration, message configuration and acquisition configuration, and after the target message is generated, the target message data is stored into a message pipeline of the kafka cluster through the kafka cluster to complete the acquisition process.
In one example, a complete data acquisition process is:
1) establishing a link between the client and the server;
2) after the client establishes the link successfully, the client sends transaction data;
3) when the transaction data passes through the F5 device, the F5 device forwards the data according to the iRules rule;
4) the acquisition service receives the data, analyzes the data according to the agreed primary message format and the configured secondary message format, continues to operate after the analysis is successful, and otherwise records the log and stops;
5) and after the acquisition service successfully analyzes the data, acquiring the data into the kafka cluster according to the configuration items, if the acquisition is successful, sending the log and stopping, otherwise, retrying, and recording the log and stopping after the configured maximum retrying times are reached.
In this embodiment, the present invention writes irule scripts to forward traffic passing through the deployed network device F5, analyzes data by using a data receiving program, and collects the data into a kafka cluster, thereby implementing real-time collection of mass data. When newly adding the collected data, the data acquisition system has no perception to a data producer, does not need the producer to cooperate with development, reduces communication cost, quickens development progress, saves time cost, does not need to deploy a large number of data acquisition agent programs, saves server resources, is simple to maintain, reduces operation and maintenance labor cost, does not need program development when newly adding a data format, only needs configuration service to configure related information to realize configuration dynamic loading, and reduces development cost.
Referring to fig. 4, an embodiment of the present invention provides a real-time data collecting method based on a network device F5, including:
and S101, according to transaction data sent to the server side by the client side, data forwarding is carried out through an F5 device, and specifically, the F5 device forwards the data according to an iRules rule.
Referring to fig. 2 and 3, specifically, the client is a data producer and sends data to the server, and the F5 device has two functions, namely, when a client program requests the server, transaction load balancing is achieved, and data of the client is forwarded to the data collection service cluster to achieve copying and forwarding of the data. The data acquisition service cluster is used for receiving data forwarded by the F5 equipment, dynamically loading configuration data, analyzing the data message format, and acquiring the analyzed data into the kafka cluster to realize a complete data acquisition process. Meanwhile, in the process, logs are processed by log service, and kafka is an open-source high-throughput distributed publishing and subscribing message system, so that the unified temporary storage of real-time data is realized, and a data pipeline function is provided.
If the analysis is unsuccessful, the recorded log data are sent to the log service cluster, if the analysis is successful, the operation is continued, the data are collected into the kafka cluster according to the configuration items, if the collection is successful, the log is sent to the log service cluster and is stopped, otherwise, the log is retried, and the log is recorded and is stopped after the configured maximum retry number is reached. The log service cluster is used for reserving log data in the processes of message analysis, data acquisition and the like, storing the log data in a database, and facilitating debugging in the development process and monitoring system calling in the operation process. The management service is used for hosting a data acquisition service cluster, a kafka cluster and a log service cluster to the management service, and related configurations can be dynamically configured, data can be viewed and the like through a web front-end interface of the management service.
The specific data forwarding method realizes data forwarding capability by writing an iRules script in F5 equipment, wherein the iRules is a function in a local flow manager and can be used for managing network flow, and the grammar based on an industry standard tool command language is used, so that flexible control of directed flow can be realized.
The forwarded data has a specific message format, is distinguished from the contained content and comprises 4 parts of a message header, a transaction request, a transaction return and a reserved field. The message header contains the meta-information fields of the transaction requester IP, the server IP, the message length, the transaction time consumption, the transaction code and the like. In order to avoid the problem of messy codes in the transmission process, the transaction request and the transaction return are to directly use a 16-system to add message data in an XML or JSON format into the main message, and blank fields can be properly reserved in consideration of subsequent function expansion.
And S102, after receiving the transaction data forwarded by the F5 equipment, the data acquisition service cluster dynamically loads configuration data and analyzes the data message format.
The data acquisition service cluster analyzes the message for the first time according to a specific message format, analyzes the transaction request or the transaction return for the second time according to the configuration in the management service, reassembles the analysis result and generates a target message. The configuration items comprise: transaction configuration (metadata describing the data transaction, such as ip port of F5, etc.), message configuration (parsing rule describing the message), collection configuration (parameters describing the collected target cluster, timeout, retry, etc.), etc.
S103, collecting the analysis data into a kafka cluster according to the analysis data.
And after the target message is generated, storing the message data into a kafka message pipeline through the kafka cluster to finish the acquisition process.
In this embodiment, the present invention writes irule scripts to forward traffic passing through the deployed network device F5, analyzes data by using a data receiving program, and collects the data into a kafka cluster, thereby implementing real-time collection of mass data. When newly adding the collected data, the data acquisition system has no perception to a data producer, does not need the producer to cooperate with development, reduces communication cost, quickens development progress, saves time cost, does not need to deploy a large number of data acquisition agent programs, saves server resources, is simple to maintain, reduces operation and maintenance labor cost, does not need program development when newly adding a data format, only needs configuration service to configure related information to realize configuration dynamic loading, and reduces development cost.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.

Claims (7)

1. A real-time data acquisition system based on a network device F5, comprising: the system comprises a client, a server, F5 equipment, a data acquisition service cluster and a kafka cluster;
the client is linked with the server, and after the link is established successfully, the client sends transaction data to the server;
the client side establishes a link with the F5 device, and the F5 device forwards the transaction data to the data acquisition service cluster according to an iRules rule;
the data acquisition service cluster is linked with the F5 device, and is used for receiving the transaction data forwarded by the F5 device, dynamically loading configuration data, analyzing a data message format, and sending the data message format to the kafka cluster; if the analysis is unsuccessful, recording log data and sending the log data to a log service cluster; and if the analysis is successful, continuing the operation, acquiring data into the kafka cluster according to the configuration items, if the acquisition is successful, sending the log to the log service cluster and stopping, otherwise, retrying, and recording and stopping after the configured maximum retrying times are reached.
2. The real-time data acquisition system based on network equipment F5 as claimed in claim 1, wherein the F5 equipment is further configured to implement transaction load balancing when the client requests the server.
3. The real-time data acquisition system based on network equipment F5 as claimed in claim 1, wherein the client establishes a link with the F5 equipment, and the F5 equipment forwards the transaction data according to the iRules rule;
the forwarded data has a specific message format, is distinguished from the contained content and consists of 4 parts, namely a message header, a transaction request, a transaction return and a reserved field;
the message header comprises a transaction request party IP, a service party IP, a message length, transaction time consumption and a transaction code;
the transaction request and the transaction return directly use a 16-system to add message data in an XML or JSON format into a main message, so as to avoid the problem of messy codes in the transmission process;
and the reserved field is used for subsequent function expansion and reserved blank fields.
4. The real-time data acquisition system based on the network device F5 as claimed in claim 3, further comprising a log service cluster;
the log service cluster is used for reserving the log data in the process of analyzing the message and collecting the data and storing the log data into a database for storage.
5. The real-time data acquisition system based on network device F5 as claimed in claim 4, further comprising a management service for hosting data of the data acquisition service cluster, the kafka cluster, and the log service cluster, and further configured for dynamic configuration and data viewing of relevant configuration by the web front end interface.
6. The real-time data acquisition system based on the network device F5 as claimed in claim 5, wherein the data acquisition service cluster performs a first parsing on the packet in a specific packet format, performs a second parsing on the transaction request or the transaction return according to the configuration in the management service, and reassembles the parsing result to generate the target packet, wherein the configuration includes transaction configuration, packet configuration and acquisition configuration;
and after the target message is generated, storing the target message into a message pipeline of the kafka cluster through the kafka cluster to finish the acquisition process.
7. A real-time data acquisition method based on network equipment F5 is characterized by comprising the following steps:
according to the transaction data sent to the server side by the client side, forwarding the data through F5 equipment according to an iRules rule;
after the data acquisition service cluster receives the transaction data forwarded by the F5 equipment, dynamically loading configuration data and analyzing the data message format;
according to the analytic data, collecting the analytic data into a kafka cluster; if the analysis is unsuccessful, recording log data and sending the log data to a log service cluster; and if the analysis is successful, continuing the operation, acquiring data into the kafka cluster according to the configuration items, if the acquisition is successful, sending the log to the log service cluster and stopping, otherwise, retrying, and recording and stopping after the configured maximum retrying times are reached.
CN202110634126.4A 2021-06-07 2021-06-07 Real-time data acquisition system and method based on network equipment F5 Active CN113411382B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110634126.4A CN113411382B (en) 2021-06-07 2021-06-07 Real-time data acquisition system and method based on network equipment F5

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110634126.4A CN113411382B (en) 2021-06-07 2021-06-07 Real-time data acquisition system and method based on network equipment F5

Publications (2)

Publication Number Publication Date
CN113411382A CN113411382A (en) 2021-09-17
CN113411382B true CN113411382B (en) 2022-07-12

Family

ID=77676779

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110634126.4A Active CN113411382B (en) 2021-06-07 2021-06-07 Real-time data acquisition system and method based on network equipment F5

Country Status (1)

Country Link
CN (1) CN113411382B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9264432B1 (en) * 2011-09-22 2016-02-16 F5 Networks, Inc. Automatic proxy device configuration
CN106294866A (en) * 2016-08-23 2017-01-04 北京奇虎科技有限公司 A kind of log processing method and device
CN111401979A (en) * 2020-02-19 2020-07-10 北京值得买科技股份有限公司 Distributed information acquisition method and device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9811562B2 (en) * 2015-02-25 2017-11-07 FactorChain Inc. Event context management system
CN109542733B (en) * 2018-12-05 2020-05-01 焦点科技股份有限公司 High-reliability real-time log collection and visual retrieval method
CN111949633B (en) * 2020-08-03 2021-11-30 杭州电子科技大学 ICT system operation log analysis method based on parallel stream processing

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9264432B1 (en) * 2011-09-22 2016-02-16 F5 Networks, Inc. Automatic proxy device configuration
CN106294866A (en) * 2016-08-23 2017-01-04 北京奇虎科技有限公司 A kind of log processing method and device
CN111401979A (en) * 2020-02-19 2020-07-10 北京值得买科技股份有限公司 Distributed information acquisition method and device

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
《观点丨银行实时数据集市的设计与应用》;朱妍,王钢,王云峰;《搜狐网,金融电子化》;20181206;正文第3节及附图2-4 *
基于F5负载均衡技术的网上选课平台;王佳等;《计算机系统应用》;20170615(第06期);全文 *
负载均衡技术在信号集中监测中心组建中的应用研究;马元等;《铁道通信信号》;20160117(第01期);全文 *

Also Published As

Publication number Publication date
CN113411382A (en) 2021-09-17

Similar Documents

Publication Publication Date Title
US6584491B1 (en) Arrangement for monitoring a progress of a message flowing through a distributed multiprocess system
JP3980596B2 (en) Method and system for remotely and dynamically configuring a server
CN110457176B (en) Monitoring method and device for distributed system, storage medium and electronic equipment
CN107025222A (en) A kind of distributed information log acquisition method and device
CN111970195B (en) Data transmission method and streaming data transmission system
CN111221793B (en) Data mining method, platform, computer equipment and storage medium
CN111338893A (en) Process log processing method and device, computer equipment and storage medium
CN113835911B (en) Intranet penetration agent method, system, host and computer readable storage medium
CN113703997A (en) Bidirectional asynchronous communication middleware system integrating multiple message agents and implementation method
CN116346948A (en) Multi-protocol conversion method and system based on micro-service
CN114741261A (en) Distributed link tracking method, device, equipment and storage medium
CN113411382B (en) Real-time data acquisition system and method based on network equipment F5
CN110569178B (en) Interface early warning method and system based on big data platform
US8077699B2 (en) Independent message stores and message transport agents
CN113760562A (en) Link tracking method, device, system, server and storage medium
CN116069608A (en) Application call link tracking method, device and distributed system
KR20170122874A (en) Apparatus for managing log of application based on data distribution service
CN110569238A (en) data management method, system, storage medium and server based on big data
CN116192849A (en) Heterogeneous accelerator card calculation method, device, equipment and medium
CN115865680A (en) Method, system and device for distributed equipment access, control and data transmission
CN114201659A (en) Message track transmission query method, device and system
Yuni et al. A model and implementation of academic data integration in near-real time using message-oriented middleware to support analysis of student performance in the information technology department of Politeknik Caltex Riau
Favarim et al. Adaptive Fault-Tolerant CORBA Components.
CN107330089B (en) Cross-network structured data collection system
CN100403273C (en) Distributed monitoring method based on bidirectional information flow

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant