CN113297037A - Distributed system tracking monitoring method, system and medium - Google Patents

Distributed system tracking monitoring method, system and medium Download PDF

Info

Publication number
CN113297037A
CN113297037A CN202110849956.9A CN202110849956A CN113297037A CN 113297037 A CN113297037 A CN 113297037A CN 202110849956 A CN202110849956 A CN 202110849956A CN 113297037 A CN113297037 A CN 113297037A
Authority
CN
China
Prior art keywords
information
time
data
timestamp
time delay
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110849956.9A
Other languages
Chinese (zh)
Inventor
肖东升
张希
赵楠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huarui Distributed Beijing Technology Co ltd
Shenzhen Archforce Financial Technology Co Ltd
Original Assignee
Huarui Distributed Beijing Technology Co ltd
Shenzhen Archforce Financial Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huarui Distributed Beijing Technology Co ltd, Shenzhen Archforce Financial Technology Co Ltd filed Critical Huarui Distributed Beijing Technology Co ltd
Priority to CN202110849956.9A priority Critical patent/CN113297037A/en
Publication of CN113297037A publication Critical patent/CN113297037A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3006Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3065Monitoring arrangements determined by the means or processing involved in reporting the monitored data
    • G06F11/3072Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
    • G06F11/3075Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting the data filtering being achieved in order to maintain consistency among the monitored data, e.g. ensuring that the monitored data belong to the same timeframe, to the same system or component
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • G06F16/2308Concurrency control
    • G06F16/2315Optimistic concurrency control
    • G06F16/2322Optimistic concurrency control using timestamps

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Computing Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Mathematical Physics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention discloses a tracking and monitoring method, a system and a medium of a distributed system, wherein the method comprises the following steps: the distributed server receives and processes the entrusted data, generates timestamp information corresponding to the entrusted data according to the information generation rule and sends the timestamp information to the management server, the management server receives the timestamp information and obtains time information corresponding to each entrusted data from the timestamp information, index time delay information of each entrusted data is obtained from the time information of each entrusted data according to the time delay calculation rule, and integration statistics is carried out on index time delay monitoring time of each entrusted data according to the statistical rule to obtain time delay statistical information. The invention belongs to the technical field of distributed system monitoring, and the time delay information of the processing process of committee data in a distributed server is tracked and monitored, so that the time delay of high-throughput data can be measured and counted in real time, the reliability and the accuracy of time delay measurement and statistical analysis are improved, and the efficiency of monitoring the time delay information of a distributed system is improved.

Description

Distributed system tracking monitoring method, system and medium
Technical Field
The present invention relates to the field of distributed system monitoring technologies, and in particular, to a method, a system, and a medium for tracking and monitoring a distributed system.
Background
With the rapid development of internet technology, people pay special attention to time consumption in the data processing process, for example, a user uses a terminal device to send request information to a server, the server feeds back a corresponding output result according to the request information, a time delay (time difference) exists between sending the request information and obtaining the output result, and how to analyze the time delay of each processing stage in the data processing to optimize the data processing process is a key for improving the data processing efficiency, especially, the time delay of each processing stage of each server in a distributed system is obtained and analyzed. The traditional technical method usually adopts the modes of network packet capturing, log analysis and the like to measure the time delay, but the measuring method adopting the network packet capturing can only be suitable for measuring the time delay of network transmission, and cannot realize the measurement of the internal data processing time delay in an application program; the method of analyzing the log needs to occupy the local system resource of the server, and under the condition that the processing capacity of the server is limited, the real-time measurement and statistics of the time delay of each message of the high-throughput data cannot be achieved, so that the reliability and accuracy of the time delay measurement and the subsequent statistical analysis are not high, and the efficiency of monitoring the time delay information of the distributed system is influenced. Therefore, the problem of low efficiency exists in monitoring the delay information of the distributed system in the prior art method.
Disclosure of Invention
The embodiment of the invention provides a tracking and monitoring method, a tracking and monitoring system and a tracking and monitoring medium for a distributed system, and aims to solve the problem of low efficiency in monitoring time delay information of the distributed system in the prior art.
In a first aspect, an embodiment of the present invention provides a distributed system tracking and monitoring method, where the method is applied to a distributed system tracking and monitoring system, the system includes a management server and a plurality of distributed servers, the management server establishes a network connection with each distributed server to implement transmission of data information, and the method includes:
if the distributed server receives the entrusted data, processing the entrusted data, generating timestamp information corresponding to the entrusted data according to a preset information generation rule, and then sending the timestamp information to the management server;
if the management server receives timestamp information from any one of the distributed servers, acquiring time information corresponding to each piece of entrusted data from the timestamp information;
the management server acquires index time delay monitoring time corresponding to each entrusted data from the time information corresponding to each entrusted data according to a preset time delay calculation rule;
and the management server performs integration statistics on the index time delay monitoring time of each entrusted data according to a preset statistical rule to obtain corresponding time delay statistical information.
In a second aspect, an embodiment of the present invention provides a distributed system tracking and monitoring system, where the system includes a management server and a plurality of distributed servers, where the management server establishes a network connection with each of the distributed servers to implement transmission of data information;
the distributed server includes: the time stamp information sending unit is used for processing the entrusted data and generating time stamp information corresponding to the entrusted data according to a preset information generation rule and then sending the time stamp information to the management server if the entrusted data is received;
the management server includes:
a time information obtaining unit, configured to obtain, if time stamp information from any one of the distributed servers is received, time information corresponding to each piece of delegation data from the time stamp information;
an index time delay monitoring time obtaining unit, configured to obtain, according to a preset time delay calculation rule, an index time delay monitoring time corresponding to each piece of delegation data from time information corresponding to each piece of delegation data;
and the time delay statistical information acquisition unit is used for performing integrated statistics on the index time delay monitoring time of each piece of entrusted data according to a preset statistical rule to obtain corresponding time delay statistical information.
In a third aspect, an embodiment of the present invention further provides a computer apparatus, which includes a management server and a plurality of distributed servers, where the management server includes a first memory, a first processor, and a first computer program stored in the first memory and executable on the first processor, and the distributed servers include a second memory, a second processor, and a second computer program stored in the second memory and executable on the second processor, where the first processor executes the first computer program and the second processor executes the second computer program to collectively implement the distributed system tracking and monitoring method described in the first aspect.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, where a first computer program and/or a second computer program are stored, and when the first computer program is executed by a first processor and the second computer program is executed by a second processor, the first computer program and the second computer program jointly implement the distributed system tracking and monitoring method according to the first aspect.
The embodiment of the invention provides a tracking and monitoring method, a tracking and monitoring system and a tracking and monitoring medium for a distributed system. The distributed server receives and processes the entrusted data, generates timestamp information corresponding to the entrusted data according to the information generation rule and sends the timestamp information to the management server, the management server receives the timestamp information and obtains time information corresponding to each entrusted data from the timestamp information, index time delay information of each entrusted data is obtained from the time information of each entrusted data according to the time delay calculation rule, and integration statistics is carried out on index time delay monitoring time of each entrusted data according to the statistical rule to obtain time delay statistical information. By the method, the time delay information of the processing process of the committee data in the distributed server is tracked and monitored, the time delay of each message can be measured and counted in real time for the data with high throughput, the reliability and the accuracy of time delay measurement and statistical analysis are greatly improved, and the efficiency of monitoring the time delay information of the distributed system can be greatly improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flow chart of a distributed system tracking and monitoring method according to an embodiment of the present invention;
fig. 2 is a schematic view of an application scenario of a distributed system tracking and monitoring method according to an embodiment of the present invention;
fig. 3 is a schematic sub-flow chart of a distributed system tracking and monitoring method according to an embodiment of the present invention;
fig. 4 is another sub-flow diagram of the distributed system tracking and monitoring method according to the embodiment of the present invention;
fig. 5 is another schematic flow chart of a distributed system tracking and monitoring method according to an embodiment of the present invention;
fig. 6 is a schematic sub-flow chart of a distributed system tracking and monitoring method according to an embodiment of the present invention;
fig. 7 is a schematic sub-flow chart of a distributed system tracking and monitoring method according to an embodiment of the present invention;
fig. 8 is another schematic flow chart of a distributed system tracking and monitoring method according to an embodiment of the present invention;
FIG. 9 is a schematic block diagram of a distributed system tracking monitoring system provided by an embodiment of the present invention;
FIG. 10 is a schematic block diagram of a computer device provided by an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the specification of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
Referring to fig. 1 and fig. 2, fig. 1 is a schematic flow chart of a distributed system tracking and monitoring method according to an embodiment of the present invention; fig. 2 is a schematic view of an application scenario of a distributed system tracking and monitoring method according to an embodiment of the present invention; the tracking and monitoring method of the distributed system is applied to the tracking and monitoring system of the distributed system, the system comprises a management server 10 and a plurality of distributed servers 20, the tracking and monitoring method of the distributed system is executed by application software installed in the management server 10 and the distributed servers 20, the management server 10 establishes network connection with each distributed server 20 to realize the transmission of data information, the distributed servers 20 are server ends for processing entrusted data, at least one application program is configured in each distributed server 20, the distributed servers 20 process the received entrusted data through the configured application program, corresponding timestamp acquisition points are configured in the application program, the management server 10 is a server end for tracking and monitoring the time delay information of each distributed server 20, such as a server built by an enterprise or government agency. As shown in FIG. 1, the method includes steps S110 to S140.
And S110, if the distributed server receives the entrusted data, processing the entrusted data, generating timestamp information corresponding to the entrusted data according to a preset information generation rule, and then sending the timestamp information to the management server.
And if the distributed server receives the entrusted data, processing the entrusted data, generating timestamp information corresponding to the entrusted data according to a preset information generation rule, and then sending the timestamp information to the management server.
The distributed server may receive externally input entrusting data (such as entrusting data input to the distributed server by the client), and the distributed server processes the entrusting data through the application programs configured therein, so that the entrusting data flows between each application program and each distributed server, and may generate external output. The distributed server generates time stamp information corresponding to each piece of the request data by an information generation rule, and transmits the generated time stamp information to the management server. The application program can be provided with timestamp acquisition points, the entrusted data acquires a timestamp once after passing through the timestamp acquisition points every time and generates corresponding timestamp information, the timestamp information comprises acquisition point identification, data identification and timestamps, the acquisition point identification is identification information uniquely corresponding to each timestamp acquisition point, and the data identification is identification information uniquely corresponding to each entrusted data. Specifically, two or more timestamp acquisition points may be configured in each application program, for example, an input timestamp acquisition point and an output timestamp acquisition point are configured, the input timestamp acquisition point is located at an entry of the application program for inputting the delegation data, and the output timestamp acquisition point is located at an exit of the application program for outputting the delegation data.
In an embodiment, as shown in fig. 3, step S110 includes sub-steps S111, S112, S113 and S114.
And S111, adding acquisition identification information to the head of the entrusted data at a first timestamp acquisition point in the entrusted data arrival processing.
The entrusted data to be sampled needs to be sampled at a first timestamp acquisition point, and the sampling is also a process of screening the received entrusted data by the distributed server, so that the entrusted data meeting the sampling condition is screened out to be used as the entrusted data to be sampled, and sampling identification information is added to the sampled entrusted data. The subsequent timestamp acquisition points can judge whether the time stamp acquisition needs to be carried out on the entrusted data or not by identifying the sampling identification information, and the subsequent timestamp acquisition points do not change the sampling identification information so as to ensure that the data sampling is kept consistent at each timestamp acquisition point.
And S112, generating a timestamp corresponding to each timestamp acquisition point according to the timestamp acquisition point time information which passes through the processing of the entrusted data added with the acquisition identification information.
Each distributed server comprises system time, when entrusted data passes through a certain timestamp acquisition point, current system time is recorded to obtain time information, and a timestamp corresponding to the entrusted data and the current timestamp acquisition point is generated based on the time information.
S113, combining the time stamp, the collecting point identification corresponding to the time stamp collecting point and the data identification corresponding to the entrusted data according to the information generating rule to generate the time stamp information corresponding to the entrusted data.
And combining the time stamp, the acquisition point identifier and the data identifier according to an information combination mode in the information generation rule to generate time stamp information corresponding to the entrusted data. The data identifier may be inherent identification information of each piece of delegation data, or identification information generated based on information of the delegation data, for example, the data identifier may be generated by performing hash processing based on the data information of the delegation data and the input source address, and the hash processing may be sha256 algorithm processing.
S114, sending the entrusted data and the timestamp information corresponding to each timestamp acquisition point to the management server.
The time stamp information can be transmitted to the management server in time every time a piece of time stamp information corresponding to the delegation data is generated.
And S120, if the management server receives the timestamp information from any one of the distributed servers, acquiring the time information corresponding to each piece of entrusted data from the timestamp information.
And if the management server receives the timestamp information from any one of the distributed servers, acquiring the time information corresponding to each piece of entrusted data from the timestamp information. The management server may receive the timestamp information output by any one of the distributed servers, and the management server may first sort the timestamp information to obtain the timestamp information corresponding to each piece of the delegation data.
In addition, after the management server acquires the timestamp information, the management server can store the received timestamp information in a binary form, and can also store the received timestamp information through a time sequence database infilxdb, the latency analyzer acquires the timestamp information stored in any one mode and directly adds a data structure to an appointed file so as to realize data replay on the timestamp information, specifically, the latency analyzer sequentially reads the timestamp data of all timestamp acquisition points stored in the stored timestamp information to perform delay calculation, which is equivalent to that the application retransmits a piece of uniform acquisition point data, namely replay, and can obtain final delay statistical data or a piece of delay data according to the required replay. Meanwhile, the time sequence database infiluxdb can correspondingly store two types of data, namely original timestamp information and time delay statistical information obtained by periodic calculation, for the original timestamp information, timestamp data of a plurality of timestamp acquisition points are associated into a row according to data identifiers (taking the data identifiers as trace _ id), and are listed as names and timestamps of the timestamp acquisition points; the LatencyAnalyzer can calculate time delay once per second based on the stored timestamp information, obtain time delay statistical information obtained by period calculation and store the intermediate result of the time delay calculation into inflixdb, the table data in the inflixdb is completely transparent to application and only used for the LatencyAnalyzer, and the subsequent acquisition of the real-time timestamp information and the analysis of the historical time delay statistical information are performed based on the data stored in the inflixdb.
In an embodiment, as shown in fig. 4, step S120 includes substeps S121 and S122.
S121, classifying the timestamp information according to the data identification contained in the timestamp information to obtain the timestamp information corresponding to the same data identification.
Specifically, the data identifier is identifier information uniquely corresponding to the entrusted data, and the timestamp information can be classified based on the data identifier to obtain timestamp information containing the same data identifier, where the timestamp information of the same data identifier is timestamp information corresponding to the same entrusted data.
Before obtaining the time information corresponding to the entrusted data, integrity check can be carried out on the time stamp information of each entrusted data. Specifically, if a certain entrusted data inevitably passes through eight fixed timestamp acquisition points in the normal processing process, whether acquisition point identifications corresponding to the eight fixed timestamp acquisition points are contained in the timestamp information of the entrusted data can be verified, if the corresponding eight sampling point identifications are not contained in the timestamp information of the entrusted data at the same time, the processing process of the entrusted data can be judged to be abnormal, namely, the check result of the timestamp information of the entrusted data is incomplete, the timestamp information of the abnormal entrusted data can be independently stored in an abnormal data table, and if the timestamp information of the entrusted data contains the corresponding eight sampling point identifications at the same time, the check result of the timestamp information of the entrusted data is complete. And the timestamp information of the abnormal entrusted data is not subjected to subsequent calculation processing, namely, time delay monitoring is not carried out.
And S122, respectively acquiring the time stamp of each piece of time stamp information from the time stamp information contained in the same data identifier, and determining the time information of the entrusted data corresponding to each data identifier.
A corresponding time stamp may be acquired from time stamp information of the same delegation data as time information corresponding to each delegation data.
S130, the management server obtains index time delay monitoring time corresponding to each entrusted data from the time information corresponding to each entrusted data according to a preset time delay calculation rule.
And the management server acquires index time delay monitoring time corresponding to each entrusted data from the time information corresponding to each entrusted data according to a preset time delay calculation rule. The index delay monitoring time corresponding to each piece of entrusted data can be obtained by calculation according to a delay calculation rule, wherein the delay calculation rule comprises at least one delay index, and the index delay monitoring time of each piece of entrusted data also comprises a delay calculation value corresponding to the at least one delay index.
In an embodiment, as shown in fig. 5, step S130 includes steps S1301, S1302, and S1303 before.
S1301, obtaining the system time of each distributed server; s1302, obtaining a time difference between the system time of each distributed server and the current time of the management server; and S1303, performing clock calibration on the time information corresponding to each piece of delegation data according to the time difference of each distributed server to obtain calibrated time information corresponding to each piece of delegation data.
Before calculating the index time delay monitoring time of the entrusted data, the time information of the entrusted data can be calibrated. Specifically, the system time of each distributed server may be obtained at the same time, the time difference between the system time of each distributed server and the current time is calculated according to the current time of the management server, the time information of each delegation data is calibrated according to the calculated time difference, and the time information after each time information is calibrated is obtained.
For example, a distributed server has a system time T1。The current time of the management server is T0A timestamp corresponding to the timestamp acquisition point of the distributed server is T, and the time difference is T1- T0Then the time stamp t is calibratedThe resulting timestamp is T- (T)1- T0)。
In another embodiment, as shown in fig. 6, step S130 includes sub-steps S131, S132, and S133.
S131, acquiring a corresponding start timestamp and an end timestamp from the time information of each piece of entrusted data according to the start acquisition point and the end acquisition point of each time delay index in the time delay calculation rule.
The time delay calculation rule comprises at least one time delay index, each time delay index comprises a starting acquisition point and an ending acquisition point, and the starting acquisition point and the ending acquisition point can be time stamp acquisition points configured by the same application program in the same distributed server, can also be two time stamp acquisition points respectively configured by two different application programs in the same distributed server, and can also be two time stamp acquisition points respectively configured in different distributed servers. Two timestamps can be correspondingly acquired from the time information of each piece of entrusted data according to two timestamp acquisition points contained in the time delay index.
For example, application A is a transaction executive that contains an input timestamp acquisition Point A1And output timestamp acquisition Point A2The application program B configured in the same distributed server is a gateway program which comprises an input timestamp acquisition point B1Output timestamp acquisition Point B2Feedback time stamp acquisition point B3. The starting acquisition point corresponding to the time delay index of 'transaction execution processing time delay' (the processing time delay of the entrusted data in the transaction execution program) is A1End acquisition Point is A2The starting acquisition point corresponding to the time delay index of 'entrusted uplink time delay' (time delay from entrusted data entering gateway program to reporting to exchange) is B1End acquisition Point is B2And the starting acquisition point corresponding to the time delay index of 'entrusting loop time delay' (the time delay from the entrusting data entering the gateway program to the entrusting confirmation fed back by the exchange received from the gateway program) is B2End acquisition Point is B3"program processing delay (entirety of processing of request data in distributed server)Time delay) "this time delay index corresponds to the starting acquisition point of a1End acquisition Point is B2
S132, performing subtraction on each piece of delegation data and the start timestamp and the end timestamp corresponding to each delay indicator to obtain a delay calculation value corresponding to each piece of delegation data and each delay indicator.
And if one piece of entrusted data corresponds to the starting timestamp and the ending timestamp with each delay index, subtracting the starting timestamp from the ending timestamp to obtain a delay calculation value of the entrusted data in each delay index, and obtaining the delay calculation value corresponding to each entrusted data and each delay index respectively by the method.
And S133, acquiring a time delay calculation value of each piece of entrusted data and determining the time delay calculation value as corresponding index time delay monitoring time.
And obtaining the time delay calculation value of each entrusted data, namely obtaining the index time delay monitoring time of each entrusted data.
And S140, the management server performs integration statistics on the index time delay monitoring time of each piece of entrusted data according to a preset statistical rule to obtain corresponding time delay statistical information.
And the management server performs integration statistics on the index time delay monitoring time of each entrusted data according to a preset statistical rule to obtain corresponding time delay statistical information. The index time delay monitoring time of each piece of entrusted data can be integrated and calculated according to a statistical rule, wherein the statistical rule is rule information for integrating and calculating the obtained index time delay monitoring time, and comprises a statistical time period, index item information and statistical item information.
In an embodiment, as shown in fig. 7, step S140 includes sub-steps S141, S142 and S143.
And S141, acquiring a time delay calculation value in the statistical time period from the index time delay monitoring time of each piece of entrusted data according to the statistical time period.
The time delay calculation value in the statistical time period can be obtained according to the statistical time period so as to periodically obtain the time delay calculation value. The statistical time period can be calculated by a preconfigured statistical period, the statistical time period is a time period spaced between the current statistical time point and the last statistical time point, if the statistical period is 1 second, and the last statistical time point is 15:03:05, the current statistical time point is 15:03:06, and the statistical time period is 15:03:05-15:03:06, and all the time delay calculation values received in the statistical time period are obtained, that is, the time delay calculation values in the statistical time period are obtained.
And S142, acquiring a target time delay calculation value corresponding to each index item from the time delay calculation values in the statistical time period according to the index items contained in the index item information.
The statistical rule further includes index item information, the index item information is a specific index item for performing statistics on the time delay calculation values within the statistical time period, the index item information includes at least one index item, and then the target time delay calculation value corresponding to each index item can be obtained from the time delay calculation values within the statistical time period according to the index items included in the index item information.
S143, respectively counting the target time delay calculation value of each index item according to the statistic items contained in the statistic item information, and obtaining a statistic value corresponding to each index item and each statistic item as the time delay statistic information of each index item.
The statistical rule further includes statistical item information, where the statistical item is item information for performing statistics on the target delay calculation value of each index item, and the statistical item information includes at least one statistical item, and specifically, the statistical item may be an average value, a minimum value, a maximum value, a 50% bit value, a 90% bit value, a 95% bit value, a 99% bit value, and the like. Each statistical item can perform statistics on the target delay calculation value of one index item once to obtain one statistical value, the plurality of statistical items can perform statistics on the target delay calculation value of one index item respectively to obtain a plurality of corresponding statistical values, and the statistical values corresponding to each index item can be combined to form the delay statistical information corresponding to each index item.
For example, if the statistical term is a 90% bit value, the target delay calculation values included in the statistical term may be sorted from small to large, and one target delay calculation value at the position where the total number is 90% of the sorted position is taken as the statistical value of the statistical term.
After the time delay statistical information is obtained, a real-time delay curve corresponding to each index item may be generated in the management server based on the time delay statistical information of each index item, so as to facilitate real-time monitoring of the obtained time delay statistical information of the index items, for example, a plurality of corresponding real-time delay curves may be generated based on the time delay statistical information of each index item, each real-time delay curve corresponds to one statistical item (including an average value, a minimum value, a maximum value, a 50% bit value, a 90% bit value, a 95% bit value, and a 99% bit value), and the real-time delay curves are refreshed every 3 seconds. Meanwhile, the time delay statistical information and historical data can be visually analyzed, and if a historical time delay curve can show the time delay variation trend of a certain statistical item of the index items within a period of time, the time delay statistical information and the historical data are historical representations of the real-time delay curve; the time delay distribution diagram can show the time delay distribution conditions of a plurality of statistical items of the index items within a period of time; the scatter/thermodynamic diagram can show the time delay scattering condition of a plurality of statistical items of the index item in a period of time; the internal time delay distribution diagram can comprehensively analyze the time occupation ratio of each processing stage of a complete data processing loop, the complete data processing loop consists of a plurality of processing stages, so that the time delay occupation ratio of which processing node is larger can be clearly seen, and the types of the internal time delay distribution diagram comprise a histogram and an occupation ratio sector diagram; detailed timestamp information for a single delegated data can be queried, including a timestamp collection point name and a corresponding timestamp.
In one embodiment, as shown in fig. 8, step S140 is followed by steps S150 and S160.
S150, the management server carries out format processing on the time delay statistical information according to a pre-stored output format to obtain corresponding time delay statistical output information. And S160, the management server outputs the time delay statistic output information according to a pre-stored output path.
The format processing can be carried out on the time delay statistical information according to the pre-stored output format to obtain the time delay statistical output information corresponding to the output format, and the time delay statistical output information is output according to the pre-stored output path. The output format can be one or more, and the output path can also be one or more. As in the specific embodiment, the delay statistics may be output in three forms: 1. rolling and outputting the command line to a command line console of a management server, wherein the output format is the command line format, and the output path is the console; 2. outputting the data to a file prestored in a management server, additionally recording the statistics of each delay index in each statistical period, and also recording the statistics of each delay index of each data, wherein the output format is a text format such as xml, txt and the like, and the output path is a storage address of the file; 3. the management server can embed an http service component, can receive an http access request from a browser or a program configured in the user terminal, and feeds back a current time delay statistical result to a user of the user terminal in the form of a JSON character string, wherein the output format is the JSON character string, and the output address is an internet address (a terminal address of the user terminal) corresponding to the http access request.
In the tracking and monitoring method for the distributed system provided by the embodiment of the invention, the distributed server receives and processes the entrusted data, generates timestamp information corresponding to the entrusted data according to the information generation rule and sends the timestamp information to the management server, the management server receives the timestamp information and obtains time information corresponding to each entrusted data from the timestamp information, index time delay information of each entrusted data is obtained from the time information of each entrusted data according to the time delay calculation rule, and the index time delay monitoring time of each entrusted data is integrated and counted according to the statistical rule to obtain time delay statistical information. By the method, the time delay information of the processing process of the committee data in the distributed server is tracked and monitored, the time delay of each message can be measured and counted in real time for the data with high throughput, the reliability and the accuracy of time delay measurement and statistical analysis are greatly improved, and the efficiency of monitoring the time delay information of the distributed system can be greatly improved.
The embodiment of the present invention further provides a distributed system tracking and monitoring system 100, where the distributed system tracking and monitoring system 100 includes a management server 10 and a plurality of distributed servers 20, and the distributed system tracking and monitoring system 100 is configured to execute any embodiment of the foregoing distributed system tracking and monitoring method, specifically, refer to fig. 9, and fig. 9 is a schematic block diagram of the distributed system tracking and monitoring system provided in the embodiment of the present invention.
As shown in fig. 9, the distribution server 20 includes a time stamp information transmitting unit 210. The management server 10 includes: a time information obtaining unit 110, an index delay monitoring time obtaining unit 120, and a delay statistical information obtaining unit 130.
And a timestamp information sending unit 210, configured to, if the delegation data is received, process the delegation data, generate timestamp information corresponding to the delegation data according to a preset information generation rule, and send the timestamp information to the management server.
In one embodiment, the timestamp information sending unit 210 includes sub-units: the acquisition identification information adding unit is used for adding acquisition identification information to the head of the entrusted data at a first timestamp acquisition point in the entrusted data arrival processing; the time stamp generating unit is used for generating a time stamp corresponding to each time stamp collecting point according to the time information of the time stamp collecting point, which passes through the processing of the entrusted data added with the collecting identification information; the time stamp information generating unit is used for combining the time stamp, the collecting point identification corresponding to the time stamp collecting point and the data identification corresponding to the entrusted data according to the information generating rule so as to generate time stamp information corresponding to the entrusted data; and the information sending unit is used for sending the entrusted data and the timestamp information corresponding to each timestamp acquisition point to the management server.
A time information obtaining unit 110, configured to, if receiving timestamp information from any one of the distributed servers, obtain, from the timestamp information, time information corresponding to each piece of delegation data.
In one embodiment, the time information obtaining unit 110 includes sub-units: the time stamp information classifying unit is used for classifying the time stamp information according to the data identification contained in the time stamp information so as to obtain the time stamp information corresponding to the same data identification; and the time information determining unit is used for respectively acquiring the time stamp of each piece of time stamp information from the time stamp information contained in the same data identifier and determining the time information of the entrusted data corresponding to each piece of data identifier.
In an embodiment, the management server 10 further comprises sub-units: a system time obtaining unit, configured to obtain a system time of each distributed server; a time difference obtaining unit, configured to obtain a time difference between a system time of each distributed server and a current time of the management server; and the time information calibration unit is used for performing clock calibration on the time information corresponding to each piece of entrusted data according to the time difference of each distributed server to obtain calibrated time information corresponding to each piece of entrusted data.
An index delay monitoring time obtaining unit 120, configured to obtain, according to a preset delay calculation rule, an index delay monitoring time corresponding to each piece of delegation data from time information corresponding to each piece of delegation data.
In an embodiment, the index delay monitoring time obtaining unit 120 includes sub-units: a timestamp obtaining unit, configured to obtain, according to the start acquisition point and the end acquisition point of each delay index in the delay calculation rule, a corresponding start timestamp and an end timestamp from the time information of each piece of delegation data; a delay calculation value obtaining unit, configured to perform subtraction on each piece of delegation data and a start timestamp and an end timestamp corresponding to each delay index to obtain a delay calculation value corresponding to each piece of delegation data and each delay index; and the index time delay monitoring time determining unit is used for acquiring a time delay calculation value of each piece of entrusted data and determining the time delay calculation value as the corresponding index time delay monitoring time.
The delay statistical information obtaining unit 130 is configured to perform integration statistics on the index delay monitoring time of each piece of delegation data according to a preset statistical rule, so as to obtain corresponding delay statistical information.
In an embodiment, the delay statistic information obtaining unit 130 includes sub-units: a delay calculation value acquisition unit, configured to acquire a delay calculation value in the statistical time period from the index delay monitoring time of each piece of delegation data according to the statistical time period; a target time delay calculation value obtaining unit, configured to obtain, according to the index item included in the index item information, a target time delay calculation value corresponding to each index item from the time delay calculation values in the statistical time period; and the statistic value acquisition unit is used for respectively carrying out statistics on the target time delay calculation value of each index item according to the statistic items contained in the statistic item information to obtain the statistic value corresponding to each index item and each statistic item as the time delay statistic information of each index item.
The distributed system tracking and monitoring system provided by the embodiment of the invention applies the distributed system tracking and monitoring method, the distributed server receives and processes entrusted data, generates timestamp information corresponding to the entrusted data according to an information generation rule and sends the timestamp information to the management server, the management server receives the timestamp information and obtains time information corresponding to each entrusted data from the timestamp information, index time delay information of each entrusted data is obtained from the time information of each entrusted data according to a time delay calculation rule, and the index time delay monitoring time of each entrusted data is integrated and counted according to a statistical rule to obtain time delay statistical information. By the method, the time delay information of the processing process of the committee data in the distributed server is tracked and monitored, the time delay of each message can be measured and counted in real time for the data with high throughput, the reliability and the accuracy of time delay measurement and statistical analysis are greatly improved, and the efficiency of monitoring the time delay information of the distributed system can be greatly improved.
The distributed system tracking and monitoring system described above may be implemented in the form of a computer program that may be run on a computer device as shown in fig. 10.
Referring to fig. 10, fig. 10 is a schematic block diagram of a computer device according to an embodiment of the present invention. The computer device may be a management server for executing the distributed system tracking monitoring method, or may be a distributed server 20 for executing the distributed system tracking monitoring method.
Referring to fig. 10, the computer device 500 includes a processor 502, memory, and a network interface 505 connected by a system bus 501, where the memory may include a storage medium 503 and an internal memory 504.
The storage medium 503 may store an operating system 5031 and a computer program 5032. The computer program 5032, when executed, may cause the processor 502 to perform a distributed system tracking monitoring method, wherein the storage medium 503 may be a volatile storage medium or a non-volatile storage medium.
The processor 502 is used to provide computing and control capabilities that support the operation of the overall computer device 500.
The internal memory 504 provides an environment for the execution of the computer program 5032 in the storage medium 503, and when the computer program 5032 is executed by the processor 502, the processor 502 can be enabled to execute the distributed system tracking monitoring method.
The network interface 505 is used for network communication, such as providing transmission of data information. Those skilled in the art will appreciate that the configuration shown in fig. 10 is a block diagram of only a portion of the configuration associated with aspects of the present invention and is not intended to limit the computing device 500 to which aspects of the present invention may be applied, and that a particular computing device 500 may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
The processor 502 is configured to run a computer program 5032 stored in the memory to implement the corresponding functions of the distributed system tracking and monitoring method.
Those skilled in the art will appreciate that the embodiment of a computer device illustrated in fig. 10 does not constitute a limitation on the specific construction of the computer device, and that in other embodiments a computer device may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components. For example, in some embodiments, the computer device may only include a memory and a processor, and in such embodiments, the structures and functions of the memory and the processor are consistent with those of the embodiment shown in fig. 10, and are not described herein again.
It should be understood that, in the embodiment of the present invention, the Processor 502 may be a Central Processing Unit (CPU), and the Processor 502 may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, and the like. Wherein a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
In another embodiment of the invention, a computer-readable storage medium is provided. The computer readable storage medium may be a volatile or non-volatile computer readable storage medium. The computer-readable storage medium stores a first computer program or a second computer program that collectively implement the above-described distributed system tracking monitoring method when executed by a first processor and the second computer program is executed by a second processor.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses, devices and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described in a functional general in the foregoing description for the purpose of illustrating clearly the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided by the present invention, it should be understood that the disclosed apparatus, device and method can be implemented in other ways. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only a logical division, and there may be other divisions when the actual implementation is performed, or units having the same function may be grouped into one unit, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may also be an electric, mechanical or other form of connection.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention essentially contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product stored in a computer-readable storage medium, which includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned computer-readable storage media comprise: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a magnetic disk, or an optical disk.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (10)

1. A tracking and monitoring method for a distributed system is characterized in that the method is applied to the tracking and monitoring system for the distributed system, the system comprises a management server and a plurality of distributed servers, the management server establishes network connection with each distributed server to realize the transmission of data information, and the method comprises the following steps:
if the distributed server receives the entrusted data, processing the entrusted data, generating timestamp information corresponding to the entrusted data according to a preset information generation rule, and then sending the timestamp information to the management server;
if the management server receives timestamp information from any one of the distributed servers, acquiring time information corresponding to each piece of entrusted data from the timestamp information;
the management server acquires index time delay monitoring time corresponding to each entrusted data from the time information corresponding to each entrusted data according to a preset time delay calculation rule;
and the management server performs integration statistics on the index time delay monitoring time of each entrusted data according to a preset statistical rule to obtain corresponding time delay statistical information.
2. The method for tracking and monitoring a distributed system according to claim 1, wherein the processing the delegation data and generating timestamp information corresponding to the delegation data according to a preset information generation rule, and then sending the timestamp information to the management server, comprises:
adding acquisition identification information to the head of the entrusted data at a first timestamp acquisition point in the entrusted data arrival processing;
generating a timestamp corresponding to each timestamp acquisition point according to the time information of the timestamp acquisition point, which passes through the processing of the entrusted data added with the acquisition identification information;
combining the timestamp, the collection point identification corresponding to the timestamp collection point and the data identification corresponding to the entrusted data according to the information generation rule to generate timestamp information corresponding to the entrusted data;
and sending the entrusted data and the timestamp information corresponding to each timestamp acquisition point to the management server.
3. The method for tracking and monitoring a distributed system according to claim 2, wherein the obtaining time information corresponding to each piece of delegation data from the time stamp information includes:
classifying the timestamp information according to the data identification contained in the timestamp information to obtain the timestamp information corresponding to the same data identification;
and respectively acquiring the time stamp of each piece of time stamp information from the time stamp information contained in the same data identifier, and determining the time information of the entrusted data corresponding to each data identifier.
4. The distributed system tracking and monitoring method according to claim 1, wherein before the management server obtains the index delay monitoring time corresponding to each delegation data from the time information corresponding to each delegation data according to a preset delay calculation rule, the method further comprises:
acquiring the system time of each distributed server;
acquiring a time difference between the system time of each distributed server and the current time of the management server;
and performing clock calibration on the time information corresponding to each piece of entrusted data according to the time difference of each distributed server to obtain calibrated time information corresponding to each piece of entrusted data.
5. The distributed system tracking and monitoring method according to claim 1, wherein the acquiring, by the management server, the index delay monitoring time corresponding to each piece of delegation data from the time information corresponding to each piece of delegation data according to a preset delay calculation rule includes:
acquiring a corresponding start timestamp and an end timestamp from the time information of each piece of entrusted data according to the start acquisition point and the end acquisition point of each time delay index in the time delay calculation rule;
subtracting the starting timestamp and the ending timestamp of each entrusted data corresponding to each delay index to obtain a delay calculation value of each entrusted data corresponding to each delay index;
and acquiring a time delay calculation value of each piece of entrusted data and determining the time delay calculation value as corresponding index time delay monitoring time.
6. The distributed system tracking and monitoring method according to claim 1, wherein the statistical rules include statistical time periods, index item information, and statistical item information, and the management server performs integration statistics on the index delay monitoring time of each of the delegation data according to preset statistical rules to obtain corresponding delay statistical information, including:
acquiring a time delay calculation value in the statistical time period from the index time delay monitoring time of each piece of entrusted data according to the statistical time period;
acquiring a target time delay calculation value corresponding to each index item from the time delay calculation values in the statistical time period according to the index items contained in the index item information;
and respectively counting the target time delay calculation value of each index item according to the statistic items contained in the statistic item information to obtain a statistic value corresponding to each index item and each statistic item as the time delay statistic information of each index item.
7. The distributed system tracking and monitoring method according to claim 1, wherein the management server performs integration statistics on the index delay monitoring time of each piece of the delegation data according to a preset statistical rule, and after obtaining corresponding delay statistical information, the method further comprises:
the management server carries out format processing on the time delay statistical information according to a pre-stored output format to obtain corresponding time delay statistical output information;
and the management server outputs the time delay statistic output information according to a pre-stored output path.
8. A distributed system tracking and monitoring system is characterized by comprising a management server and a plurality of distributed servers, wherein the management server establishes network connection with each distributed server to realize data information transmission;
the distributed server includes: the time stamp information sending unit is used for processing the entrusted data and generating time stamp information corresponding to the entrusted data according to a preset information generation rule and then sending the time stamp information to the management server if the entrusted data is received;
the management server includes:
a time information obtaining unit, configured to obtain, if time stamp information from any one of the distributed servers is received, time information corresponding to each piece of delegation data from the time stamp information;
an index time delay monitoring time obtaining unit, configured to obtain, according to a preset time delay calculation rule, an index time delay monitoring time corresponding to each piece of delegation data from time information corresponding to each piece of delegation data;
and the time delay statistical information acquisition unit is used for performing integrated statistics on the index time delay monitoring time of each piece of entrusted data according to a preset statistical rule to obtain corresponding time delay statistical information.
9. A distributed system tracking monitoring system, the system comprising a management server and a plurality of distributed servers, the management server comprising a first memory, a first processor and a first computer program stored on the first memory and executable on the first processor, the distributed servers comprising a second memory, a second processor and a second computer program stored on the second memory and executable on the second processor, the first processor executing the first computer program and the second processor executing the second computer program to collectively implement the distributed system tracking monitoring method of any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a first computer program and/or a second computer program, which together realize the distributed system tracking monitoring method according to any one of claims 1 to 7 when the first computer program is executed by a first processor and the second computer program is executed by a second processor.
CN202110849956.9A 2021-07-27 2021-07-27 Distributed system tracking monitoring method, system and medium Pending CN113297037A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110849956.9A CN113297037A (en) 2021-07-27 2021-07-27 Distributed system tracking monitoring method, system and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110849956.9A CN113297037A (en) 2021-07-27 2021-07-27 Distributed system tracking monitoring method, system and medium

Publications (1)

Publication Number Publication Date
CN113297037A true CN113297037A (en) 2021-08-24

Family

ID=77331118

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110849956.9A Pending CN113297037A (en) 2021-07-27 2021-07-27 Distributed system tracking monitoring method, system and medium

Country Status (1)

Country Link
CN (1) CN113297037A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115168080A (en) * 2022-09-08 2022-10-11 深圳华锐分布式技术股份有限公司 Distributed system time delay measurement method, device, equipment and medium
CN116662208A (en) * 2023-07-25 2023-08-29 华锐分布式(北京)技术有限公司 Transaction testing method, device and medium based on distributed baffle

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109039819A (en) * 2018-08-16 2018-12-18 深圳华锐金融技术股份有限公司 Delay statistics method, apparatus, system and storage medium

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109039819A (en) * 2018-08-16 2018-12-18 深圳华锐金融技术股份有限公司 Delay statistics method, apparatus, system and storage medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115168080A (en) * 2022-09-08 2022-10-11 深圳华锐分布式技术股份有限公司 Distributed system time delay measurement method, device, equipment and medium
CN116662208A (en) * 2023-07-25 2023-08-29 华锐分布式(北京)技术有限公司 Transaction testing method, device and medium based on distributed baffle
CN116662208B (en) * 2023-07-25 2023-09-26 华锐分布式(北京)技术有限公司 Transaction testing method, device and medium based on distributed baffle

Similar Documents

Publication Publication Date Title
CN106105112B (en) Analysis rule adjusts device, analysis rule adjustment system and analysis rule method of adjustment
He et al. An evaluation study on log parsing and its use in log mining
CN107302547B (en) Web service anomaly detection method and device
KR101672378B1 (en) Process for displaying test coverage data during code reviews
CN113297037A (en) Distributed system tracking monitoring method, system and medium
CN110362473B (en) Test environment optimization method and device, storage medium and terminal
CN111506489B (en) Test method, system, device, server and storage medium
US20110093785A1 (en) Apparatus for network traffic classification benchmark
US7111779B2 (en) System, method, and program for generating transaction profile for measuring and analyzing computer system performance
US10447565B2 (en) Mechanism for analyzing correlation during performance degradation of an application chain
US9294560B2 (en) System and method of analysing transfer of data over at least one network
CN114117311B (en) Data access risk detection method and device, computer equipment and storage medium
US10216776B2 (en) Variance based time series dataset alignment
KR20070080313A (en) Method and system for analyzing performance of providing services to client terminal
KR101953558B1 (en) Apparatus and Method for Fault Management of Smart Devices
WO2013147226A1 (en) User sensory quality estimation device, terminal bottleneck determination device, similar operation extraction device, and methods and programs therefor
EP3343839A1 (en) Mechanism for monitoring and alerts of computer system applications
CN111611146A (en) Micro-service fault prediction method and device
CN108306997B (en) Domain name resolution monitoring method and device
CN110490132B (en) Data processing method and device
CN109239750B (en) Method and device for monitoring track parameters and electronic terminal
WO2023200597A1 (en) Automated positive train control event data extraction and analysis engine for performing root cause analysis of unstructured data
CN116244131A (en) Server interface testing method and device, electronic equipment and medium
KR101039874B1 (en) System for integration platform of information communication
JP2019526129A (en) Apparatus and method for digital media measurement including a user panel

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210824