CN112612673A - Analysis method and device for dial test log, storage medium and electronic device - Google Patents
Analysis method and device for dial test log, storage medium and electronic device Download PDFInfo
- Publication number
- CN112612673A CN112612673A CN202011556751.3A CN202011556751A CN112612673A CN 112612673 A CN112612673 A CN 112612673A CN 202011556751 A CN202011556751 A CN 202011556751A CN 112612673 A CN112612673 A CN 112612673A
- Authority
- CN
- China
- Prior art keywords
- dial
- log
- logs
- middleware
- test
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
- G06F11/3072—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
- G06F11/3075—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting the data filtering being achieved in order to maintain consistency among the monitored data, e.g. ensuring that the monitored data belong to the same timeframe, to the same system or component
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Quality & Reliability (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a method and a device for analyzing a dial test log, a storage medium and an electronic device, wherein the method comprises the following steps: determining different channels used for sending the log data of different log types to the cloud server; generating a plurality of first dial test logs corresponding to any channel according to a fixed frequency for any channel in different channels, wherein the number of the first dial test logs is greater than a preset threshold value; and transmitting the plurality of first dial-up logs through a plurality of middleware to obtain a plurality of second dial-up logs corresponding to the plurality of first dial-up logs, and transmitting the plurality of second dial-up logs to a data repository so that a target application connected with the data repository analyzes the plurality of second dial-up logs. By adopting the technical scheme, the problems that the traditional log data processing framework is difficult to analyze the log due to factors such as log source, uncertain log generation frequency and the like are solved.
Description
Technical Field
The invention relates to the field of communication, in particular to a method and a device for analyzing a dial test log, a storage medium and an electronic device.
Background
The log data processing framework aims at collecting, processing and analyzing log data generated by the service system so as to assist in solving problems encountered by the service system, and middleware such as log collection flash, log stream conversion KAFKA, data storage ES and the like is often used in the process of monitoring the running state of the service system; however, the data processing framework is difficult to monitor due to the factors of long circulation chain of the data processing framework, more related middleware, uncertain service log data source and the like.
At present, how to monitor a data processing framework per se ensures the reliability and stability of the data processing framework per se, and further ensures that data analyzed by the data processing framework is effective and credible, so that the data processing framework becomes a difficult point which needs to be solved urgently by a large-data log processing framework.
Aiming at the problems that the traditional log data processing framework is difficult to analyze the logs through the log data processing framework due to factors such as uncertain log sources and log generation frequency in the related technology, an effective solution is not provided at present.
Disclosure of Invention
The embodiment of the invention provides a method and a device for analyzing a dial-up log, a storage medium and an electronic device, which are used for at least solving the problems that the performance of a data processing frame is difficult to analyze due to factors such as log sources, log frequency uncertainty and the like of the traditional data processing frame.
According to an aspect of an embodiment of the present invention, a method for analyzing a dial test log includes: determining different channels used for sending the log data of different log types to the cloud server; for any channel in the different channels, generating a plurality of first dial test logs corresponding to the any channel according to a fixed frequency, wherein the number of the first dial test logs is greater than a preset threshold value; and transmitting the first dial-up logs through a plurality of middleware to obtain a plurality of second dial-up logs corresponding to the first dial-up logs, and transmitting the second dial-up logs to a data repository so that a target application connected with the data repository analyzes the second dial-up logs.
In an exemplary embodiment, for any one of the different channels, generating a plurality of first dial test logs corresponding to the any one channel according to a fixed frequency includes: determining script content of a script corresponding to any channel, wherein the script content is at least used for indicating one of the following: the identification information is used for uniquely identifying the first dial test log and is used for uniquely identifying the identification information of any channel; the generation time of the first dial test log; each middleware in the plurality of middleware receives the receiving time of a first dial test log and the sending time of the first dial test log; and running the script to generate a plurality of first dial test logs corresponding to any channel according to the script content of the script and the fixed frequency.
In an exemplary embodiment, transmitting the first plurality of call logs through a plurality of middleware to obtain a second plurality of call logs corresponding to the first plurality of call logs includes: and under the condition that the plurality of first dial test logs pass through a plurality of middleware, adding the receiving time of each middleware for receiving the first dial test logs and the sending time for sending the first dial test logs to the first dial test logs through each middleware for each middleware in the plurality of middleware to obtain the second dial test logs.
In an exemplary embodiment, transmitting the second plurality of call logs to a data store to cause a target application connected to the data store to analyze the second plurality of call logs comprises: transmitting the second plurality of call test logs to a data store, such that a target application connected to the data store analyzes the second plurality of call test logs by: acquiring the receiving time of each middleware for receiving the first dial test log and the sending time for sending the first dial test log from the plurality of second dial test logs; determining the consumed time of the first dial test log according to the sending time of the last middleware in the plurality of middleware to send the second dial test log and the generation time of the first dial test log, wherein the consumed time of each first dial test log in the plurality of first dial test logs is used for determining at least one of the following parameters of any channel: maximum delay, minimum delay, average time consumption, packet loss rate and average middleware loss.
In an exemplary embodiment, after generating, for any one of the different channels, a plurality of first dial test logs corresponding to the any one channel at a fixed frequency, the method further includes: and uploading the generated plurality of first dial test logs to a target position of any channel, so that the plurality of first dial test logs are transmitted to a data storage library from the target position through a plurality of middleware.
In an exemplary embodiment, the plurality of middleware includes at least one of: the system comprises a log collection middleware, a log circulation middleware and a log storage middleware.
According to another aspect of the embodiments of the present invention, there is also provided an apparatus for analyzing a dial-up log, including: the first determining module is used for determining different channels adopted by the cloud server for sending the log data of different log types; a generating module, configured to generate, for any one of the different channels, a plurality of first dial test logs corresponding to the any one channel according to a fixed frequency, where a number of the plurality of first dial test logs is greater than a preset threshold; and the second determining module is used for transmitting the plurality of first dial-up test logs through a plurality of middleware to obtain a plurality of second dial-up test logs corresponding to the plurality of first dial-up test logs, and transmitting the plurality of second dial-up test logs to a data repository so that a target application connected with the data repository analyzes the plurality of second dial-up test logs.
In an exemplary embodiment, the generating module is further configured to determine script content of a script corresponding to the any channel, where the script content is at least used to indicate one of: the identification information is used for uniquely identifying the first dial test log and is used for uniquely identifying the identification information of any channel; the generation time of the first dial test log; each middleware in the plurality of middleware receives the receiving time of a first dial test log and the sending time of the first dial test log; and running the script to generate a plurality of first dial test logs corresponding to any channel according to the script content of the script and the fixed frequency.
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, in which a computer program is stored, where the computer program is configured to execute the analysis method of the dial test log when running.
According to another aspect of the embodiments of the present invention, there is also provided an electronic apparatus, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the analysis method of the dial test log through the computer program.
According to the method, log data generated by different log generation parties are determined to be sent to different channels adopted by a cloud server, then, for any one of the different channels, a plurality of first dial-up logs corresponding to the different channels are generated according to a fixed frequency, the generated first dial-up logs are transmitted through a plurality of middleware to obtain a plurality of second dial-up logs corresponding to the first dial-up logs, the second dial-up logs are transmitted to a data storage bank, and a target application connected with the data storage bank analyzes the second dial-up logs to obtain a final analysis result. By adopting the technical scheme, the problems that the traditional log data processing framework is difficult to analyze the log through the log data processing framework due to factors such as uncertain log source and log generation frequency and the like are solved. And corresponding to different channels, generating corresponding dial test logs at a fixed frequency, and analyzing the logs.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a block diagram of a hardware configuration of a computer terminal of an analysis method of a dial test log according to an embodiment of the present invention;
fig. 2 is a block diagram (one) of a log data processing framework of an analysis method of a dial-up test log according to an embodiment of the present invention;
FIG. 3 is a flow chart of a method of analyzing a dial-up log according to an embodiment of the invention;
fig. 4 is a whole frame diagram of a log data processing frame of the analysis method of the dial-up test log according to the embodiment of the present invention (ii);
fig. 5 is a block diagram (iii) of the overall frame of the log data processing frame of the analysis method of the dial-up test log according to the embodiment of the present invention;
fig. 6 is a block diagram of an analysis apparatus for a dial test log according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The method embodiments provided in the embodiments of the present application may be executed in a computer terminal or a similar computing device. Taking the example of running on a computer terminal, fig. 1 is a block diagram of a hardware structure of the computer terminal of the analysis method of the dial test log according to the embodiment of the present invention. As shown in fig. 1, the computer terminal may include one or more (only one shown in fig. 1) processors 102 (the processors 102 may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, and in an exemplary embodiment, may also include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the computer terminal. For example, the computer terminal may also include more or fewer components than shown in FIG. 1, or have a different configuration with equivalent functionality to that shown in FIG. 1 or with more functionality than that shown in FIG. 1.
The memory 104 may be used to store a computer program, for example, a software program and a module of an application software, such as a computer program corresponding to the analysis method of the dial test log in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, so as to implement the method described above. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to a computer terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal. In one example, the transmission device 106 includes a Network adapter (NIC), which can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
Fig. 2 is a block diagram (one) of a log data processing framework of an analysis method of a dial-up test log according to an embodiment of the present invention; the method comprises the steps that log data generated by a terminal are uploaded to a cloud end by calling a Hyper Text Transfer Protocol (HTTP) log gateway and stored as a local log file, and the Flume acquires logs in the local log file and transfers the logs to OSS KAFKA middleware, and then the Flume distributes the log data in the OSS KAFKA according to services and stores the log data in OSS Child Kafka, HDFS and ES; and storing the log generated by the cloud application in a local log file, then acquiring the corresponding flash Agent node by using flash, and converging the corresponding flash Agent node to the GW Kafka log gateway by using the Agent node, wherein the subsequent circulation process is the same as that of the above.
In the related technology, the difficulty of monitoring the log data processing frame is that 1) the data source channels are more, and the circulation process of each channel is different; 2) the data flow transfer process is long, the number of related middleware is large, and the whole can not be monitored through monitoring of the middleware and the like; 3) the service log data circulated in the frame changes with the service change, and log output cannot be stably generated, so that the frame cannot be monitored by using the data.
In order to solve the above problem, in this embodiment, a method for analyzing a dial test log is provided, and fig. 3 is a flowchart of the method for analyzing a dial test log according to the embodiment of the present invention, where the flowchart includes the following steps:
step S302, determining different channels used for sending the log data of different log types to the cloud server;
step S304, for any one of the different channels, generating a plurality of first dial test logs corresponding to the any one channel according to a fixed frequency, wherein the number of the plurality of first dial test logs is greater than a preset threshold value;
step S306, transmitting the first dial-up logs through a plurality of middleware to obtain a plurality of second dial-up logs corresponding to the first dial-up logs, and transmitting the second dial-up logs to a data repository so that a target application connected with the data repository analyzes the second dial-up logs.
According to the steps, a method for analyzing the dial-up test logs is introduced, log data generated by different log generators are firstly determined to be sent to different channels adopted by a cloud server, then, for any channel in the different channels, a plurality of first dial-up test logs corresponding to the different channels are generated according to a fixed frequency, the generated first dial-up test logs are transmitted through a plurality of middleware to obtain a plurality of second dial-up test logs corresponding to the first dial-up test logs, the second dial-up test logs are transmitted to a data storage bank, and a target application connected with the data storage bank analyzes the second dial-up test logs to obtain a final analysis result. By adopting the technical scheme, the problems that the traditional log data processing framework is difficult to analyze the log through the log data processing framework due to factors such as uncertain log source and log generation frequency and the like are solved. And corresponding to different channels, generating corresponding dial test logs at a fixed frequency, and analyzing the logs.
It can be understood that, because the channels used by different log generators to transmit the generated logs to the cloud server are different, and the frequency of generating the logs by the log generators (the terminal application and the cloud application) is not fixed, it is difficult to perform corresponding data analysis on the received log data at the cloud server. The method for analyzing the dialing test logs aims to generate a first dialing test log corresponding to a fixed number in a fixed frequency simulation mode according to different channels, then transmit a plurality of generated first dialing test logs through a plurality of middleware to obtain a plurality of second dialing test logs, transmit the plurality of second dialing test logs to a data storage bank, and finally enable a target application connected with the data storage bank to analyze the plurality of second dialing test logs. For example, two major mainstream log producers exist: the system comprises a terminal application and a cloud application, wherein a log generated by the terminal application is stored in a local terminal, the terminal log needs to be transmitted to a cloud server through a channel A, the log generated by the cloud application is stored in the cloud, and the cloud log needs to be transmitted to the cloud server through a channel B. The terminal application can be an application program on a mobile phone and some intelligent household appliances, the cloud application can be an application deployed on a webpage, and the channel can be understood as a protocol adopted by the terminal application or the cloud application to transmit generated log data to a cloud server. And simulating to generate a plurality of dial testing logs corresponding to the protocols through different protocols, transmitting the generated dial testing logs to a data storage bank through different middleware through the protocols, and then obtaining dial testing data from the data storage bank by a monitoring application connected with the data storage bank for data analysis.
There are various ways for generating the dial test log in step S304, and in an optional embodiment, for any one of the different channels, generating a plurality of first dial test logs corresponding to the any one channel according to a fixed frequency includes: determining script content of a script corresponding to any channel, wherein the script content is at least used for indicating one of the following: the identification information is used for uniquely identifying the first dial test log and is used for uniquely identifying the identification information of any channel; the generation time of the first dial test log; each middleware in the plurality of middleware receives the receiving time of a first dial test log and the sending time of the first dial test log; and running the script to generate a plurality of first dial test logs corresponding to any channel according to the script content of the script and the fixed frequency.
In this embodiment, the frequency of generating the first dial test log for any channel may be set, the frequency may be set to generate 1000 dial test logs in one minute, or may be set to generate 2000 dial test logs in 1 minute, in a specific implementation process, the dial test logs are generated by a shell script, and then the shell script is run by an AZKABAN scheduler, where the AZKABAN scheduler may be set to run once in one minute, or may be set to run once in two minutes. For the script content to indicate the following: identification information for uniquely identifying the first dial-up test log; a system for uniquely identifying a first dial-up test log; identification information for uniquely identifying the any channel; the service type is used for distinguishing the logs; the generation time of the first dial test log; each of the plurality of middleware receives a reception time of a first dial test log and a transmission time of transmitting the first dial test log. And then running the script through the content of the script to generate a plurality of first dial test logs corresponding to any one channel.
In step S306, the plurality of first dial test logs are transmitted through the plurality of middleware to obtain a plurality of second dial test logs corresponding to the plurality of first dial test logs, and in an optional embodiment, the following scheme may be implemented: and under the condition that the plurality of first dial test logs pass through a plurality of middleware, adding the receiving time of each middleware for receiving the first dial test logs and the sending time for sending the first dial test logs to the first dial test logs through each middleware for each middleware in the plurality of middleware to obtain the second dial test logs. In this embodiment, the dial-up log generated by the shell script passes through different middleware during transmission, and the different middleware records the time for receiving the log and the time for sending the log to the next middleware into the log information. For example, there is a first dial test log a, which passes through the flash middleware 1, the KAFAK middleware, and the flash middleware 2 in sequence after being generated by the shell, and a field mts in the dial test log a is used for recording the time of each link in the intermediate circulation process of the dial test log a, where the field mts may be understood as being recorded in the script content of the above embodiment: each of the plurality of middleware receives a reception time of a first dial test log and a transmission time of transmitting the first dial test log. If the time when the dial test log a is received by the flash middleware 1 is t1, the time when the dial test log a is sent out is t2, the time when the dial test log a is received by the KAFAK middleware is t3, the time when the dial test log a is sent out is t4, the time when the dial test log a is received by the flash middleware 2 is t5, and the time when the dial test log a is sent out is t 6. After passing through a plurality of pieces of middleware, the dial logging A becomes a second dial logging B, and mts field information in the second dial logging B is't 1, t2, t3, t4, t5 and t 6'.
In step S306, the plurality of second dial test logs are further transmitted to a data repository, and a target application connected to the data repository analyzes the plurality of second dial test logs, which optionally includes: transmitting the second plurality of call test logs to a data store, such that a target application connected to the data store analyzes the second plurality of call test logs by: acquiring the receiving time of each middleware for receiving the first dial test log and the sending time for sending the first dial test log from the plurality of second dial test logs; determining the consumed time of the first dial test log according to the sending time of the last middleware in the plurality of middleware to send the second dial test log and the generation time of the first dial test log, wherein the consumed time of each first dial test log in the plurality of first dial test logs is used for determining at least one of the following parameters of any channel: maximum delay, minimum delay, average consumed time, packet loss rate and average middleware loss. In this embodiment, the target application connected to the data repository may obtain a plurality of second dial-up logs from the data repository at a fixed frequency, for example, once every 3 minutes, then extract log generation time and time of flowing into the data repository from the plurality of second dial-up logs, extract content of an mts field in second dial-up log data, and analyze data obtained from the plurality of second dial-up logs by using the following algorithm, so as to obtain time consumption, a maximum delay value, a minimum delay value, average time consumption, a packet loss rate, and average middleware time consumption of each log in a log data processing frame. If the shell script generates 1000 pieces of dial test logs in one minute, 3000 pieces of dial test logs are generated in 3 minutes, and the time consumption, the delay maximum value, the delay minimum value, the average time consumption, the packet loss rate and the middleware average time consumption of each log are respectively realized by the following algorithms:
algorithm (1): subtracting the log generation time from the last time in the mts field;
algorithm (2): delay maximum is the maximum of the elapsed time of each log of the channel in 3 minutes;
algorithm (3): delay minimum value is the minimum value in the time consumption of each log of each channel in 3 minutes;
algorithm (4): the average consumed time is the average value of the sum of consumed time of each log of each channel in 3 minutes;
algorithm (5): dividing the number of logs received in the data repository by 3000 within 3 minutes;
algorithm (6): and (4) subtracting the related time in the mts from the average consumed time of the middleware, and averaging.
For better understanding, the shell script schedules the generated first dial test log to be uploaded to a target location of any one of the channels through an AZKABAN scheduler so that the plurality of first dial test logs are transmitted from the target location to a data storage through a plurality of middleware. And the plurality of middleware components at least comprise one of the following components: the system comprises a log collection middleware Flume, a log circulation middleware KAFKA and a log storage middleware ES.
It is to be understood that the above-described embodiments are only a few, but not all, embodiments of the present invention. In order to better understand the analysis method of the dial-up log, the following describes the above process with reference to an embodiment, but the method is not limited to the technical solution of the embodiment of the present invention, and specifically:
fig. 4 is a system block diagram (ii) of an analysis method of a dial-up test log according to an embodiment of the present invention, as shown in fig. 4, in an optional embodiment, since a log data processing frame in fig. 2 involves many process links, in order to monitor delay and packet loss rate of data processing, and to measure and monitor an operating state and stability of the processing frame, dial-up test logs are added to different channels at 1-2 positions in fig. 4, the dial-up test logs are periodically called by an AZKABAN scheduler to generate a shell script of the logs, and after a log stream is transferred to a data storage ES middleware, the entry time of the ES is compared with the log generation time to measure the conditions of the overall acquisition delay and the packet loss rate of the logs. In the circulation process of the dial test log, consumption time and time for processing the log to the downstream are added in the flash middleware, and the delay condition of processing the log by each middleware is measured by comparing each time.
The specific Shell script logic is as follows:
channel 1 (position marked 1 in the figure): generating a brand new traceid in each operation, accumulating the span Id from 1 to 1000, and circularly generating 1000 logs by using the traceid, wherein the rest contents of the 1000 logs are completely the same except the serial number and the generation time of the logs; after the logs are generated, calling an HTTP (hyper text transport protocol) interface of a log gateway to upload 1000 logs at a time;
and (3) a channel 2: each run produces a completely new traceid, the span Id accumulates from 1 to 1000, and the traceid is used to cycle through 1000 logs written to a log file (named: oss-monitor-2-yyy-mm-dd. json. log), and the 1000 logs are identical except for log stream number and log generation time. And finally, deploying the Flume to collect the logs in the log file to GW KAFKA. In channel 1 and channel 2, the related information of different dial test logs can be as follows:
channel 1:
{sn:traceid+spanId；
sys:'OSS'；
bName:'datachannel1'；
bid:'monitor'；
sts:'1607304597000'；
mts:'1607304597000,1607304597000'；
}
and (3) a channel 2:
{sn:traceid+spanId；
sys:'OSS'；
bName:'datachannel2'；
bid:'monitor'；
sts:'2020-08-21 12:00:00'；
mts:'1607304597000,1607304597000'；
}
the description of the relevant schema fields is given in the following table:
the specific operation of the U trace monitor application connected to the data storage middleware ES is as follows: data for all bid candidates were obtained from ES at a frequency of 3 minutes, and then the following information was counted by channel: maximum delay, minimum delay, average consumed time, packet loss rate, and average consumed time of each middleware. The statistical method is as follows: the time consumption of each log is the last time in mts minus sts; calculating the time consumption of each log of the channel within 3 minutes, and then taking the maximum time consumption; calculating the time consumption of each log of the channel within 3 minutes, and then taking the minimum time consumption; calculating the sum of the consumed time of each log of the channel in 3 minutes, and then averaging; dividing the number of logs received in the ES by 3000 within 3 minutes; the average time consumed by the middleware is the time associated with the mts is subtracted and then averaged.
In addition, according to the technical scheme of the embodiment of the invention, the dial-up test log is generated by using a fixed frequency, the data processing frame is monitored based on a stable data source, the intermediate data is added in the process to monitor each middleware, and meanwhile, on the basis of not adjusting the original data processing frame, the log data generation is simulated at the source, so that the processing frame is monitored, the efficiency is high, and the cost is low.
Fig. 5 is a frame diagram (iii) of an overall log data processing frame of an analysis method of a dial test log according to an embodiment of the present invention, the dial test log is added to different channels at positions 1 to 4 in fig. 5, the dial test log is periodically called by an AZKABAN scheduler to a shell script generating the log, and after the log stream is transferred to a data storage ES middleware, the storage time of the ES is compared with the log generation time to measure the situations of the overall log collection delay and the packet loss rate. In the circulation process of the dial test log, consumption time and time for processing the log to the downstream are added in the flash middleware, and the delay condition of processing the log by each middleware is measured by comparing each time.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
In this embodiment, an analysis device for a dial-up log is further provided, and the device is used to implement the foregoing embodiments and preferred embodiments, and details are not repeated for what has been described. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementations in hardware or a combination of software and hardware are also possible and contemplated.
Fig. 6 is a block diagram of an apparatus for analyzing a dial test log according to an embodiment of the present invention, where the apparatus includes:
the first determining module 62 is configured to determine different channels used by sending log data of different log types to the cloud server;
a generating module 64, configured to generate, for any one of the different channels, a plurality of first dial test logs corresponding to the any one channel according to a fixed frequency, where a number of the plurality of first dial test logs is greater than a preset threshold;
a second determining module 66, configured to transmit the multiple first dial-up logs through multiple middleware to obtain multiple second dial-up logs corresponding to the multiple first dial-up logs, and transmit the multiple second dial-up logs to a data repository, so that a target application connected to the data repository analyzes the multiple second dial-up logs.
According to the invention, an analysis device of the dial-up test logs is introduced, log data generated by different log generation parties are firstly determined to be sent to different channels adopted by a cloud server, then, for any one of the different channels, a plurality of first dial-up test logs corresponding to the different channels are generated according to a fixed frequency, the generated first dial-up test logs are transmitted through a plurality of middleware to obtain a plurality of second dial-up test logs corresponding to the first dial-up test logs, the second dial-up test logs are transmitted to a data storage library, and a target application connected with the data storage library analyzes the second dial-up test logs to obtain a final analysis result. By adopting the technical scheme, the problems that the traditional log data processing framework is difficult to analyze the log through the log data processing framework due to factors such as uncertain log source and log generation frequency and the like are solved. And corresponding to different channels, generating corresponding dial test logs at a fixed frequency, and analyzing the logs.
It can be understood that, because the channels used by different log generators to transmit the generated logs to the cloud server are different, and the frequency of generating the logs by the log generators (the terminal application and the cloud application) is not fixed, it is difficult to perform corresponding data analysis on the received log data at the cloud server. The method for analyzing the dialing test logs aims to generate a first dialing test log corresponding to a fixed number in a fixed frequency simulation mode according to different channels, then transmit a plurality of generated first dialing test logs through a plurality of middleware to obtain a plurality of second dialing test logs, transmit the plurality of second dialing test logs to a data storage bank, and finally enable a target application connected with the data storage bank to analyze the plurality of second dialing test logs. For example, two major mainstream log producers exist: the system comprises a terminal application and a cloud application, wherein a log generated by the terminal application is stored in a local terminal, the terminal log needs to be transmitted to a cloud server through a channel A, the log generated by the cloud application is stored in the cloud, and the cloud log needs to be transmitted to the cloud server through a channel B. The terminal application can be an application program on a mobile phone and some intelligent household appliances, the cloud application can be an application deployed on a webpage, and the channel can be understood as a protocol adopted by the terminal application or the cloud application to transmit generated log data to a cloud server. And simulating to generate a plurality of dial testing logs corresponding to the protocols through different protocols, transmitting the generated dial testing logs to a data storage bank through different middleware through the protocols, and then obtaining dial testing data from the data storage bank by a monitoring application connected with the data storage bank for data analysis.
For any one of the different channels, generating a plurality of first dial test logs corresponding to the any one channel according to a fixed frequency, optionally, the generating module 64 is configured to: determining script content of a script corresponding to any channel, wherein the script content is at least used for indicating one of the following: the identification information is used for uniquely identifying the first dial test log and is used for uniquely identifying the identification information of any channel; the generation time of the first dial test log; each middleware in the plurality of middleware receives the receiving time of a first dial test log and the sending time of the first dial test log; and running the script to generate a plurality of first dial test logs corresponding to any channel according to the script content of the script and the fixed frequency.
In this embodiment, the frequency of generating the first dial test log for any channel may be set, the frequency may be set to generate 1000 dial test logs in one minute, or may be set to generate 2000 dial test logs in 1 minute, in a specific implementation process, the dial test logs are generated by a shell script, and then the shell script is run by an AZKABAN scheduler, where the AZKABAN scheduler may be set to run once in one minute, or may be set to run once in two minutes. For the script content to indicate the following: identification information for uniquely identifying the first dial-up test log; a system for uniquely identifying a first dial-up test log; identification information for uniquely identifying the any channel; the service type is used for distinguishing the logs; the generation time of the first dial test log; each of the plurality of middleware receives a reception time of a first dial test log and a transmission time of transmitting the first dial test log. And then running the script through the content of the script to generate a plurality of first dial test logs corresponding to any one channel.
In an alternative embodiment, the second confirmation module 66 is configured to: and under the condition that the plurality of first dial test logs pass through a plurality of middleware, adding the receiving time of each middleware for receiving the first dial test logs and the sending time for sending the first dial test logs to the first dial test logs through each middleware for each middleware in the plurality of middleware to obtain the second dial test logs. In this embodiment, the dial-up log generated by the shell script passes through different middleware during transmission, and the different middleware records the time for receiving the log and the time for sending the log to the next middleware into the log information. For example, there is a first dial test log a, which passes through the flash middleware 1, the KAFAK middleware, and the flash middleware 2 in sequence after being generated by the shell, and a field mts in the dial test log a is used for recording the time of each link in the intermediate circulation process of the dial test log a, where the field mts may be understood as being recorded in the script content of the above embodiment: each of the plurality of middleware receives a reception time of a first dial test log and a transmission time of transmitting the first dial test log. If the time when the dial test log a is received by the flash middleware 1 is t1, the time when the dial test log a is sent out is t2, the time when the dial test log a is received by the KAFAK middleware is t3, the time when the dial test log a is sent out is t4, the time when the dial test log a is received by the flash middleware 2 is t5, and the time when the dial test log a is sent out is t 6. After passing through a plurality of pieces of middleware, the dial logging A becomes a second dial logging B, and mts field information in the second dial logging B is't 1, t2, t3, t4, t5 and t 6'.
After the second dial test logs are transmitted to the data repository, the target application connected to the data repository analyzes the second dial test logs, and optionally: the second determining module 66 is further configured to: transmitting the second plurality of call test logs to a data store, such that a target application connected to the data store analyzes the second plurality of call test logs by: acquiring the receiving time of each middleware for receiving the first dial test log and the sending time for sending the first dial test log from the plurality of second dial test logs; determining the consumed time of the first dial test log according to the sending time of the last middleware in the plurality of middleware to send the second dial test log and the generation time of the first dial test log, wherein the consumed time of each first dial test log in the plurality of first dial test logs is used for determining at least one of the following parameters of any channel: maximum delay, minimum delay, average consumed time, packet loss rate and average middleware loss. In this embodiment, the target application connected to the data repository may obtain a plurality of second dial-up logs from the data repository at a fixed frequency, for example, once every 3 minutes, then extract log generation time and time of flowing into the data repository from the plurality of second dial-up logs, extract content of an mts field in second dial-up log data, and analyze data obtained from the plurality of second dial-up logs by using the following algorithm, so as to obtain time consumption, a maximum delay value, a minimum delay value, average time consumption, a packet loss rate, and average middleware time consumption of each log in a log data processing frame. If the shell script generates 1000 pieces of dial test logs in one minute, 3000 pieces of dial test logs are generated in 3 minutes, and the time consumption, the delay maximum value, the delay minimum value, the average time consumption, the packet loss rate and the middleware average time consumption of each log are respectively realized by the following algorithms:
algorithm (1): subtracting the log generation time from the last time in the mts field;
algorithm (2): delay maximum is the maximum of the elapsed time of each log of the channel in 3 minutes;
algorithm (3): delay minimum value is the minimum value in the time consumption of each log of each channel in 3 minutes;
algorithm (4): the average consumed time is the average value of the sum of consumed time of each log of each channel in 3 minutes;
algorithm (5): dividing the number of logs received in the data repository by 3000 within 3 minutes;
algorithm (6): and (4) subtracting the related time in the mts from the average consumed time of the middleware, and averaging.
For better understanding, the shell script schedules the generated first dial test log to be uploaded to a target location of any one of the channels through an AZKABAN scheduler so that the plurality of first dial test logs are transmitted from the target location to a data storage through a plurality of middleware. And the plurality of middleware components at least comprise one of the following components: the system comprises a log collection middleware Flume, a log circulation middleware KAFKA and a log storage middleware ES.
Embodiments of the present invention also provide a computer-readable storage medium having a computer program stored thereon, wherein the computer program is arranged to perform the steps of any of the above-mentioned method embodiments when executed.
Alternatively, in the present embodiment, the storage medium may be configured to store a computer program for executing the steps of:
s1, determining different channels used for sending the log data of different log types to the cloud server;
s2, for any one of the different channels, generating a plurality of first dial test logs corresponding to the any one channel according to a fixed frequency, wherein the number of the plurality of first dial test logs is greater than a preset threshold value;
and S3, configured to transmit the first dial-up logs through a plurality of middleware to obtain a plurality of second dial-up logs corresponding to the first dial-up logs, and transmit the second dial-up logs to a data repository, so that a target application connected to the data repository analyzes the second dial-up logs.
In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to: various media capable of storing computer programs, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary embodiments, and details of this embodiment are not repeated herein.
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, determining different channels used for sending the log data of different log types to the cloud server;
s2, for any one of the different channels, generating a plurality of first dial test logs corresponding to the any one channel according to a fixed frequency, wherein the number of the plurality of first dial test logs is greater than a preset threshold value;
and S3, configured to transmit the first dial-up logs through a plurality of middleware to obtain a plurality of second dial-up logs corresponding to the first dial-up logs, and transmit the second dial-up logs to a data repository, so that a target application connected to the data repository analyzes the second dial-up logs.
In an exemplary embodiment, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary embodiments, and details of this embodiment are not repeated herein.
It will be apparent to those skilled in the art that the various modules or steps of the invention described above may be implemented using a general purpose computing device, they may be centralized on a single computing device or distributed across a network of computing devices, and they may be implemented using program code executable by the computing devices, such that they may be stored in a memory device and executed by the computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into various integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A method for analyzing a dial-up test log is characterized by comprising the following steps:
determining different channels used for sending the log data of different log types to the cloud server;
for any channel in the different channels, generating a plurality of first dial test logs corresponding to the any channel according to a fixed frequency, wherein the number of the first dial test logs is greater than a preset threshold value;
and transmitting the first dial-up logs through a plurality of middleware to obtain a plurality of second dial-up logs corresponding to the first dial-up logs, and transmitting the second dial-up logs to a data repository so that a target application connected with the data repository analyzes the second dial-up logs.
2. The method of claim 1, wherein generating, for any of the different channels, a plurality of first dial test logs corresponding to the any of the different channels at a fixed frequency comprises:
determining script content of a script corresponding to any channel, wherein the script content is at least used for indicating one of the following: the identification information is used for uniquely identifying the first dial test log and is used for uniquely identifying the identification information of any channel; the generation time of the first dial test log; each middleware in the plurality of middleware receives the receiving time of a first dial test log and the sending time of the first dial test log;
and running the script to generate a plurality of first dial test logs corresponding to any channel according to the script content of the script and the fixed frequency.
3. The method of claim 2, wherein transmitting the first plurality of call logs through a plurality of middleware to obtain a second plurality of call logs corresponding to the first plurality of call logs comprises:
and under the condition that the plurality of first dial test logs pass through a plurality of middleware, adding the receiving time of each middleware for receiving the first dial test logs and the sending time for sending the first dial test logs to the first dial test logs through each middleware for each middleware in the plurality of middleware to obtain the second dial test logs.
4. The method of claim 1, wherein transmitting the second plurality of call logs to a data store for analysis of the second plurality of call logs by a target application connected to the data store comprises:
transmitting the second plurality of call test logs to a data store, such that a target application connected to the data store analyzes the second plurality of call test logs by:
acquiring the receiving time of each middleware for receiving the first dial test log and the sending time for sending the first dial test log from the plurality of second dial test logs;
determining the consumed time of the first dial test log according to the sending time of the last middleware in the plurality of middleware to send the second dial test log and the generation time of the first dial test log, wherein the consumed time of each first dial test log in the plurality of first dial test logs is used for determining at least one of the following parameters of any channel: maximum delay, minimum delay, average consumed time, packet loss rate and average middleware loss.
5. The method of claim 1, wherein after generating, for any of the different channels, a plurality of first dial test logs corresponding to the any of the different channels at a fixed frequency, the method further comprises:
and uploading the generated plurality of first dial test logs to a target position of any channel, so that the plurality of first dial test logs are transmitted to a data storage library from the target position through a plurality of middleware.
6. The method of any of claims 1 to 5, wherein the plurality of middleware comprises at least one of: the system comprises a log collection middleware, a log circulation middleware and a log storage middleware.
7. An analysis device for a dial-up log, comprising:
the first determining module is used for determining different channels adopted by the cloud server for sending the log data of different log types;
a generating module, configured to generate, for any one of the different channels, a plurality of first dial test logs corresponding to the any one channel according to a fixed frequency, where a number of the plurality of first dial test logs is greater than a preset threshold;
and the second determining module is used for transmitting the plurality of first dial-up test logs through a plurality of middleware to obtain a plurality of second dial-up test logs corresponding to the plurality of first dial-up test logs, and transmitting the plurality of second dial-up test logs to a data repository so that a target application connected with the data repository analyzes the plurality of second dial-up test logs.
8. The apparatus of claim 7, wherein the generating module is further configured to determine script content of a script corresponding to the any channel, wherein the script content is at least used to indicate one of: the identification information is used for uniquely identifying the first dial test log and is used for uniquely identifying the identification information of any channel; the generation time of the first dial test log; each middleware in the plurality of middleware receives the receiving time of a first dial test log and the sending time of the first dial test log; and running the script to generate a plurality of first dial test logs corresponding to any channel according to the script content of the script and the fixed frequency.
9. A computer-readable storage medium, comprising a stored program, wherein the program is operable to perform the method of any one of claims 1 to 6.
10. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method of any of claims 1 to 6 by means of the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011556751.3A CN112612673B (en) | 2020-12-24 | 2020-12-24 | Analysis method and device for dial testing log, storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011556751.3A CN112612673B (en) | 2020-12-24 | 2020-12-24 | Analysis method and device for dial testing log, storage medium and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112612673A true CN112612673A (en) | 2021-04-06 |
| CN112612673B CN112612673B (en) | 2022-12-06 |
Family
ID=75245254
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011556751.3A Active CN112612673B (en) | 2020-12-24 | 2020-12-24 | Analysis method and device for dial testing log, storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112612673B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113179302A (en) * | 2021-04-19 | 2021-07-27 | 杭州海康威视系统技术有限公司 | Log system, and method and device for collecting log data |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060184529A1 (en) * | 2005-02-16 | 2006-08-17 | Gal Berg | System and method for analysis and management of logs and events |
| CN102457401A (en) * | 2012-01-06 | 2012-05-16 | 北京星网锐捷网络技术有限公司 | Method, device and server for log simulation generation |
| CN104714868A (en) * | 2015-03-27 | 2015-06-17 | 上海新炬网络信息技术有限公司 | Distributed computer automatic dial testing method |
| US20150281037A1 (en) * | 2014-03-31 | 2015-10-01 | Fujitsu Limited | Monitoring omission specifying program, monitoring omission specifying method, and monitoring omission specifying device |
| JP2016006604A (en) * | 2014-06-20 | 2016-01-14 | 株式会社リコー | Information processing device, information processing method, and information processing program |
| CN107273280A (en) * | 2017-06-30 | 2017-10-20 | 百度在线网络技术（北京）有限公司 | A kind of log processing method, device, electronic equipment and storage medium |
| CN108121645A (en) * | 2017-12-25 | 2018-06-05 | 深圳市分期乐网络科技有限公司 | A kind of daily record method for evaluating quality, device, server and storage medium |
| CN109412966A (en) * | 2018-12-12 | 2019-03-01 | 北京信息科技大学 | A kind of extensive log transmission method, apparatus and system |
| CN109471760A (en) * | 2018-10-18 | 2019-03-15 | 北京趣拿软件科技有限公司 | The monitoring method and system of server communication performance, storage medium, electronic device |
| US20200021511A1 (en) * | 2018-07-12 | 2020-01-16 | Fujitsu Limited | Performance analysis for transport networks using frequent log sequence discovery |
| CN111158997A (en) * | 2019-12-24 | 2020-05-15 | 河南文正电子数据处理有限公司 | Safety monitoring method and device for multi-log system |
| CN111367760A (en) * | 2020-02-28 | 2020-07-03 | 平安医疗健康管理股份有限公司 | Log collection method and device, computer equipment and storage medium |
| CN111711544A (en) * | 2020-05-15 | 2020-09-25 | 北京奇艺世纪科技有限公司 | Link dial testing method and device, electronic equipment and storage medium |
-
2020
- 2020-12-24 CN CN202011556751.3A patent/CN112612673B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060184529A1 (en) * | 2005-02-16 | 2006-08-17 | Gal Berg | System and method for analysis and management of logs and events |
| CN102457401A (en) * | 2012-01-06 | 2012-05-16 | 北京星网锐捷网络技术有限公司 | Method, device and server for log simulation generation |
| US20150281037A1 (en) * | 2014-03-31 | 2015-10-01 | Fujitsu Limited | Monitoring omission specifying program, monitoring omission specifying method, and monitoring omission specifying device |
| JP2016006604A (en) * | 2014-06-20 | 2016-01-14 | 株式会社リコー | Information processing device, information processing method, and information processing program |
| CN104714868A (en) * | 2015-03-27 | 2015-06-17 | 上海新炬网络信息技术有限公司 | Distributed computer automatic dial testing method |
| CN107273280A (en) * | 2017-06-30 | 2017-10-20 | 百度在线网络技术（北京）有限公司 | A kind of log processing method, device, electronic equipment and storage medium |
| CN108121645A (en) * | 2017-12-25 | 2018-06-05 | 深圳市分期乐网络科技有限公司 | A kind of daily record method for evaluating quality, device, server and storage medium |
| US20200021511A1 (en) * | 2018-07-12 | 2020-01-16 | Fujitsu Limited | Performance analysis for transport networks using frequent log sequence discovery |
| CN109471760A (en) * | 2018-10-18 | 2019-03-15 | 北京趣拿软件科技有限公司 | The monitoring method and system of server communication performance, storage medium, electronic device |
| CN109412966A (en) * | 2018-12-12 | 2019-03-01 | 北京信息科技大学 | A kind of extensive log transmission method, apparatus and system |
| CN111158997A (en) * | 2019-12-24 | 2020-05-15 | 河南文正电子数据处理有限公司 | Safety monitoring method and device for multi-log system |
| CN111367760A (en) * | 2020-02-28 | 2020-07-03 | 平安医疗健康管理股份有限公司 | Log collection method and device, computer equipment and storage medium |
| CN111711544A (en) * | 2020-05-15 | 2020-09-25 | 北京奇艺世纪科技有限公司 | Link dial testing method and device, electronic equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| 李洋等: "基于Hadoop与Storm的日志实时处理系统研究", 《西南师范大学学报(自然科学版)》, no. 04, 20 April 2017 (2017-04-20) * |
| 林宗缪等: "基于Spark的网络日志分析平台研究与设计", 《自动化与仪器仪表》, no. 11, 25 November 2017 (2017-11-25) * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113179302A (en) * | 2021-04-19 | 2021-07-27 | 杭州海康威视系统技术有限公司 | Log system, and method and device for collecting log data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112612673B (en) | 2022-12-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180054377A1 (en) | Monitoring network traffic in association with an application | |
| Keller et al. | How was your journey? Uncovering routing dynamics in deployed sensor networks with multi-hop network tomography | |
| CN102045222A (en) | Real-time overall test method of network system | |
| US9641405B2 (en) | System and method for sequencing per-hop data in performance-monitored network environments | |
| CN111327539B (en) | Service scheduling method, device and equipment | |
| CN111400127B (en) | Service log monitoring method and device, storage medium and computer equipment | |
| CN107911254B (en) | Log transmission method and device, computing equipment and storage medium | |
| CN112612673B (en) | Analysis method and device for dial testing log, storage medium and electronic device | |
| CN111147403A (en) | Message processing method and device, storage medium and electronic device | |
| CN112148504A (en) | Target message processing method and device, storage medium and electronic device | |
| KR102051732B1 (en) | Advanced remote meter reading system | |
| CN115811484A (en) | Network detection method, device and storage medium | |
| CN117424638B (en) | Network slice management method, device and storage medium based on satellite-ground fusion | |
| CN109587520B (en) | Method and equipment for positioning video service fault | |
| CN109962801B (en) | Communication quality abnormity positioning method, device, equipment and medium | |
| CN107943808A (en) | The method and apparatus of processing equipment reported data | |
| Si et al. | Teacp: A toolkit for evaluation and analysis of collection protocols in wireless sensor networks | |
| Kemal et al. | Optimized scheduling of smart meter data access: A parametric study | |
| CN109474940B (en) | Service quality detection method and device | |
| CN110781878B (en) | Target area determination method and device, storage medium and electronic device | |
| CN114466395A (en) | Method and device for testing performance of base station, storage medium and electronic device | |
| CN112671616A (en) | Flow monitoring method and device, programmable chip, storage medium and electronic device | |
| CN111881153A (en) | Data processing method and device, electronic equipment and machine-readable storage medium | |
| CN105634874B (en) | Flow reports information calibration method and device | |
| CN118075169A (en) | Method and device for testing network switching equipment, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |