CN110806931B - Method and device for realizing call link tracking of distributed service and electronic equipment - Google Patents
Method and device for realizing call link tracking of distributed service and electronic equipment Download PDFInfo
- Publication number
- CN110806931B CN110806931B CN201911050128.8A CN201911050128A CN110806931B CN 110806931 B CN110806931 B CN 110806931B CN 201911050128 A CN201911050128 A CN 201911050128A CN 110806931 B CN110806931 B CN 110806931B
- Authority
- CN
- China
- Prior art keywords
- data
- monitoring
- call
- task scheduling
- monitoring data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3051—Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention relates to a method and a device for realizing the call link tracking of distributed service, electronic equipment and a storage medium, wherein the method for realizing the call link tracking of the distributed service comprises the following steps: responding to a user request, starting a data acquisition agent program in a current thread of the user request, acquiring call data of the current thread according to a preset sampling rule by the data acquisition agent program, performing data processing to generate monitoring data, performing task scheduling based on the monitoring data, and then storing the monitoring data, wherein the preset sampling rule comprises a sampling time interval and a sampling failure processing rule, and the data processing comprises desensitization processing on sensitive data in the call data. The calling link tracking implementation method reduces the code intrusion degree, is simple to maintain, reduces the labor cost, and can meet the scene with higher requirement on data timeliness.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a method and a device for realizing call link tracking of distributed services, electronic equipment and a computer storage medium.
Background
The calling link tracking of the distributed service can realize the monitoring of each node of a one-time request calling path of the distributed service, and the overall performance and the pressure resistance of the distributed service are evaluated through multi-dimensional quantitative indexes such as system overhead (memory, storage and the like), concurrency, throughput, system delay and the like.
The current method for realizing the call link tracking of the distributed service partially adopts a mode with higher code intrusiveness, requires a monitored service to set a buried point in order to realize data uploading, needs a business party to cooperate with a plurality of development and modification, has higher complexity, is more difficult to maintain and has higher labor cost investment; and a log file acquisition mode is adopted in part, and the mode cannot meet the scene with higher requirement on data timeliness because the log is asynchronously read.
Disclosure of Invention
In order to solve the above technical problems, an object of the present invention is to provide a method for implementing call link tracking of distributed services, which reduces code intrusion, is relatively simple to maintain, reduces labor cost, and can satisfy a scenario with a high requirement on data timeliness.
Another object of the present invention is to provide a call link trace implementing apparatus for a distributed service, which implements the call link trace implementing method for a distributed service described above.
In order to achieve the purpose, the invention adopts the following technical scheme:
the method for realizing the call link tracking of the distributed service according to the embodiment of the first aspect of the invention comprises the following steps:
responding to a user request, starting a data acquisition agent program in a current thread of the user request, acquiring call data of the current thread according to a preset sampling rule by the data acquisition agent program, performing data processing to generate monitoring data, performing task scheduling based on the monitoring data, and then storing the monitoring data,
wherein the predetermined sampling rule includes a time interval of sampling and a sampling failure processing rule,
the data processing comprises desensitizing sensitive data in the call data.
Preferably, the task scheduling based on the monitoring data specifically includes:
the method comprises the steps of collecting and distributing data, wherein abnormal data in the monitoring data are checked and filtered out in the collecting process, and the monitoring data are distributed according to the data source, the data type and the data use of the monitoring data;
and performing task scheduling based on the distributed data.
Preferably, in the data collection and distribution, the speed of collecting and distributing the monitoring data is dynamically adjusted according to the speed of generating the monitoring data.
Preferably, the task scheduling based on the distributed data includes: configuring a plurality of data processing pipelines for distributed data to process the data;
and performing task scheduling based on the processed data.
Preferably, the task scheduling based on the processed data includes:
and taking the processed data of the preset time window as a micro batch and submitting the micro batch to a task scheduling center in a micro task form, wherein the task scheduling center distributes the received multiple micro tasks to enable the multiple micro tasks to be executed in parallel.
Preferably, the method for implementing call link tracing further includes:
rules for the collection, distribution, and processing of configuration data.
Preferably, the data collection Agent is configured by a Java Agent.
The device for realizing the call link tracking of the distributed service according to the second aspect of the invention comprises:
the starting module is used for responding to a user request and starting a data acquisition agent program in the current thread of the user request;
the acquisition module is used for acquiring the calling data of the current thread according to a preset sampling rule by the data acquisition agent program and processing the data to generate monitoring data;
the task scheduling module is used for scheduling tasks based on the monitoring data;
a storage module for storing the monitoring data,
wherein the predetermined sampling rule includes a sampling interval and a sampling failure processing rule,
the data processing comprises desensitizing sensitive data in the calling data.
An electronic device for call link tracking implementation of distributed services according to an embodiment of a third aspect of the invention comprises:
one or more processors;
one or more memories having computer readable code stored therein which, when executed by the one or more processors, performs a call link tracking implementation method of a distributed service as described in any of the embodiments above.
A non-transitory computer storage medium according to a fourth aspect of the invention, has stored therein computer readable code which, when executed by one or more processors, performs a method for call link tracking implementation of a distributed service as described in any of the embodiments above.
The invention has the beneficial effects that:
the call data of the current thread is collected and processed by the data collection agent program to generate the monitoring data, only a simple agent program is configured in the monitored system without adding monitoring codes, and the call link tracking implementation method reduces the code intrusion degree, is simple to maintain, reduces the labor cost and can meet the scene with higher requirement on data timeliness; in addition, the efficiency of further processing the monitoring data is improved by scheduling the tasks based on the monitoring data.
The foregoing description is only an overview of the technical solutions of the present invention, and in order to make the technical solutions of the present invention more clearly understood and to implement them in accordance with the contents of the description, the following detailed description is given with reference to the preferred embodiments of the present invention and the accompanying drawings.
Drawings
FIG. 1 is a schematic diagram of an application scenario of an implementation of call link tracking for distributed services according to an embodiment of the present invention;
FIG. 2 is a flowchart of a method for implementing call link tracking of distributed services according to an embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a device for implementing call link tracking of distributed services according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The following detailed description of embodiments of the present invention is provided in connection with the accompanying drawings and examples. The following examples are intended to illustrate the invention, but are not intended to limit the scope of the invention.
It will be appreciated that as used herein, the term module may refer to or include an Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and/or memory that executes one or more software or firmware programs, a combinational logic circuit, and/or other suitable hardware components that provide the described functionality, or may be part of such hardware components.
It will be appreciated that in embodiments of the present invention, the processor may be a microprocessor, a digital signal processor, a microcontroller, or the like, and/or any combination thereof. According to another aspect, the processor may be a single core processor, a multi-core processor, the like, and/or any combination thereof.
As shown in fig. 1, according to an application scenario diagram of the technical solution of the present application according to the embodiment of the present invention, a user 11 sends a service request to a server 12, the server 12 receives the service request and processes the service request, when the server 12 processes the service request, the server 13 and the server 14 may need to be invoked, and the server 14 may need to invoke services on a server 15 and a server 16, which are only schematically illustrated and do not limit the number of servers.
As shown in fig. 2, the method for implementing call link tracking of distributed services according to an embodiment of the present invention includes:
step S1, responding to a user request, starting a data acquisition agent program in a current thread of the user request, and acquiring call data of the current thread according to a preset sampling rule by the data acquisition agent program and performing data processing to generate monitoring data;
s2, scheduling tasks based on the monitoring data;
s3, storing the monitoring data;
wherein the predetermined sampling rule includes a time interval of sampling and a sampling failure processing rule,
the data processing comprises desensitizing sensitive data in the calling data.
Specifically, for each received user request, a thread needs to be opened for each user request respectively, so as to process the user request. The data acquisition agent program supports self-defined configuration related to data acquisition, such as data transmission protocol configuration, different data transmission protocol plug-ins can be configured in the data acquisition agent program, so that data transmission protocols such as HTTP, RPC, gRPC, MQ and the like can be selected according to actual needs, and different storage plug-ins can be configured in the data acquisition agent program, so that data storage modes such as HDFS, HBase, elasticSearch, mySQL and the like can be selected according to actual needs.
According to some embodiments of the invention, the data collection Agent is configured by a Java Agent.
The calling data of the current thread is acquired and processed by the data acquisition agent program to generate monitoring data, and only a simple agent program is configured in the monitored system without adding monitoring codes, so that the calling link tracking implementation method reduces the code intrusion degree, is simple to maintain, reduces the labor cost, and can meet the scene with higher requirement on data timeliness; the task scheduling is carried out based on the monitoring data, so that the efficiency of further processing the monitoring data is improved; in addition, the predetermined sampling rule comprises a sampling time interval and a sampling failure processing rule, so that the reliability and the accuracy of the collected calling data are ensured, and the data processing comprises desensitization processing on sensitive data in the calling data, so that the reliable protection on sensitive private data is ensured.
According to some embodiments of the present invention, the method for implementing call link tracking of distributed services further includes, before step S3:
s4, collecting and distributing data, wherein abnormal data in the monitoring data are checked and filtered out in the collecting process, and the monitoring data are distributed according to the data source, the data type and the data use of the monitoring data;
wherein, step S2 includes: and performing task scheduling based on the distributed data.
Abnormal data in the monitoring data are filtered and removed in the collecting process, the reliability of the monitoring data is further ensured, the monitoring data are distributed according to the data source, the data type and the data use of the monitoring data, so that the monitoring data can be further processed, and the monitoring data can be distributed according to other decision factors as required.
Preferably, in the data collection and distribution, the speed of collecting and distributing the monitoring data is dynamically adjusted according to the speed of generating the monitoring data. So as to greatly reduce the overhead of the system.
Preferably, the method for implementing call link tracking of distributed services further includes, before step S3: configuring a plurality of data processing pipelines for distributed data to process the data;
wherein the task scheduling based on the distributed data comprises:
and performing task scheduling based on the processed data.
Specifically, a plurality of data processing pipelines can be configured for data processing of the distributed data according to needs, each data processing pipeline can obtain processed monitoring data, and the data processing comprises splitting, converting, calculating, aggregating and the like of the data. And a plurality of data processing flow lines are configured for data processing, so that the data processing efficiency is improved.
Preferably, the task scheduling based on the processed data includes:
and taking the processed data of the preset time window as micro batches and submitting the micro batches to a task scheduling center in a micro task form, wherein the task scheduling center distributes the received multiple micro tasks to enable the multiple micro tasks to be executed in parallel.
Preferably, the method for implementing call link tracing further includes:
rules for the collection, distribution, and processing of configuration data.
Specifically, different rules of data collection, distribution and processing can be flexibly configured according to actual needs, so that the required monitoring data can be obtained.
Preferably, the method for implementing call link tracing further includes: and displaying the monitoring data.
Specifically, monitoring data such as a system call link topology graph, response delay, throughput, concurrency, system overhead, an exception log and the like can be visually displayed for a user through a visual graph.
As shown in fig. 3, the call link tracking implementation apparatus for a distributed service according to the embodiment of the present invention, which implements the call link tracking implementation method for a distributed service according to the embodiment of the present invention, includes a starting module 20, a collecting module 30, a task scheduling module 40, and a storage module 50.
The starting module 20 is configured to respond to a user request and start a data collection agent in a current thread of the user request.
The acquisition module 30 is configured to acquire, by the data acquisition agent program, the call data of the current thread according to a predetermined sampling rule and perform data processing to generate monitoring data, where the predetermined sampling rule includes a sampling time interval and a sampling failure processing rule, and the data processing includes desensitization processing on sensitive data in the call data.
And the task scheduling module 40 is used for performing task scheduling based on the monitoring data.
And a storage module 50, configured to store the monitoring data.
The calling data of the current thread is acquired through the data acquisition agent program and is subjected to data processing to generate monitoring data, only a simple agent program needs to be configured in a monitored system without adding a monitoring code, so that the calling link tracking implementation device reduces the code intrusion degree, is relatively simple to maintain, reduces the labor cost, and can meet the scene with higher requirement on data timeliness; the task scheduling is carried out based on the monitoring data, so that the efficiency of further processing the monitoring data is improved; in addition, the predetermined sampling rule comprises a sampling time interval and a sampling failure processing rule, so that the reliability and accuracy of the collected calling data are ensured, and the data processing comprises desensitization processing on sensitive data in the calling data, so that the reliable protection on the sensitive privacy data is ensured.
As shown in fig. 4, based on the same inventive concept as the method for implementing the call link tracking of the distributed service described above, the present application also provides an electronic device 1400, where the electronic device 1400 comprises one or more processors 1401 and one or more memories 1402, where the memories 1402 store computer readable codes,
wherein the computer readable code when executed by the one or more processors 1401 performs the steps of:
responding to a user request, starting a data acquisition agent program in a current thread of the user request, acquiring call data of the current thread according to a preset sampling rule by the data acquisition agent program, performing data processing to generate monitoring data, performing task scheduling based on the monitoring data, and then storing the monitoring data,
wherein the predetermined sampling rule includes a sampling interval and a sampling failure processing rule,
the data processing comprises desensitizing sensitive data in the call data.
Preferably, the task scheduling based on the monitoring data specifically includes:
the method comprises the steps of collecting and distributing data, wherein abnormal data in the monitoring data are checked and filtered out in the collecting process, and the monitoring data are distributed according to the data source, the data type and the data use of the monitoring data;
and performing task scheduling based on the distributed data.
Preferably, in the data collection and distribution, the speed of collecting and distributing the monitoring data is dynamically adjusted according to the speed of generating the monitoring data.
Preferably, the task scheduling based on the distributed data includes: configuring a plurality of data processing pipelines for distributed data to process the data;
and performing task scheduling based on the processed data.
Preferably, the task scheduling based on the processed data includes:
and taking the processed data of the preset time window as a micro batch and submitting the micro batch to a task scheduling center in a micro task form, wherein the task scheduling center distributes the received multiple micro tasks to enable the multiple micro tasks to be executed in parallel.
Preferably, the method for implementing call link tracing further includes:
rules for the collection, distribution, and processing of configuration data.
Preferably, the data collection Agent is configured by a Java Agent.
Further, the electronic device 1400 further includes a network interface 1403, an input device 1404, a hard disk 1405, and a display device 1406.
The various interfaces and devices described above may be interconnected by a bus architecture. A bus architecture may be any structure comprising any number of interconnected buses and bridges. One or more Central Processing Units (CPUs), represented in particular by processor 1401, and the various circuits of one or more memories 1402, represented by memory 1402, are coupled together. The bus architecture may also connect various other circuits such as peripherals, voltage regulators, power management circuits, and the like. It will be appreciated that a bus architecture is used to enable the communication of the connections between these components. The bus architecture includes a power bus, a control bus, and a status signal bus, in addition to a data bus, all of which are well known in the art and therefore will not be described in detail herein.
The network interface 1403 may be connected to a network (e.g., the internet, a local area network, etc.), obtain relevant data from the network, and store the data in the hard disk 1405.
An input device 1404 may receive various instructions input by an operator and send to processor 1401 for execution. The input devices 1404 may include a keyboard or pointing device (e.g., mouse, trackball, touch pad, touch screen, or the like).
The display device 1406 may display a result obtained by the processor 1401 executing the instruction.
The memory 1402 is used for storing programs and data necessary for the operation of the operating system 14021, and data such as intermediate results in the calculation process of the processor 1401.
It will be appreciated that the memory 1402 in the subject embodiments can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. The nonvolatile memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read Only Memory (EPROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), or a flash memory, among others. Volatile memory can be Random Access Memory (RAM), which acts as external cache memory. The memory 1402 of the apparatus and methods described herein is intended to comprise, without being limited to, these and any other suitable types of memory.
In some embodiments, memory 1402 stores the following elements, executable modules or data structures, or a subset or expanded set of them: an operating system 14021 and application programs 14014.
The operating system 14021 includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, and is used for implementing various basic services and processing hardware-based tasks. The application 14014 includes various applications, such as a Browser (Browser), and the like, for implementing various application services. Programs that implement methods of embodiments of the present application may be included in application programs 14014.
The methods disclosed in the embodiments described above may be implemented in processor 1401, or by processor 1401. Processor 1401 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by instructions in the form of hardware integrated logic circuits or software in the processor 1401. The processor 1401 may be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, and may implement or perform the methods, steps, and logic blocks disclosed in the embodiments of the present application. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules may be located in ram, flash, rom, prom, or eprom, registers, etc. as is well known in the art. The storage medium is located in a memory 1402, and a processor 1401 reads information in the memory 1402 and performs the steps of the above method in combination with hardware thereof.
It is to be understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For a hardware implementation, the processing units may be implemented within one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro-controllers, microprocessors, other electronic units designed to perform the functions described herein, or a combination thereof.
For a software implementation, the techniques described herein may be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described herein. The software codes may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.
In the embodiment of the present application, the electronic device 1400 collects and processes the call data of the current thread through the data collection agent to generate the monitoring data, and only a simple agent needs to be configured in the monitored system without adding a monitoring code, so that the electronic device 1400 for implementing call link tracking of distributed services reduces the code intrusion degree, is relatively simple to maintain, reduces the labor cost, and can meet the scenario with a high requirement on data timeliness; the task scheduling is carried out based on the monitoring data, so that the efficiency of further processing the monitoring data is improved; in addition, the predetermined sampling rule comprises a sampling time interval and a sampling failure processing rule, so that the reliability and the accuracy of the collected calling data are ensured, and the data processing comprises desensitization processing on sensitive data in the calling data, so that the reliable protection on sensitive private data is ensured.
Additionally, embodiments of the present application also provide a non-transitory computer storage medium storing computer readable code that when executed by one or more processors performs the steps of:
responding to a user request, starting a data acquisition agent program in a current thread of the user request, acquiring call data of the current thread according to a preset sampling rule by the data acquisition agent program, performing data processing to generate monitoring data, performing task scheduling based on the monitoring data, and then storing the monitoring data,
wherein the predetermined sampling rule includes a sampling interval and a sampling failure processing rule,
the data processing comprises desensitizing sensitive data in the call data.
When executed by the processor, the computer readable code implements each process of the above-mentioned method for implementing call link tracking of distributed services, and can achieve the same technical effect, and for avoiding repetition, detailed processes are not described herein again. The computer storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
In the several embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be physically included alone, or two or more units may be integrated into one unit. The integrated unit may be implemented in the form of hardware, or in the form of hardware plus a software functional unit.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that various changes and modifications can be made by those skilled in the art without departing from the spirit of the invention, and these changes and modifications are all within the scope of the invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A method for realizing call link tracking of distributed service is characterized by comprising the following steps:
responding to a user request, starting a data acquisition agent program in a current thread of the user request, wherein the data acquisition agent program supports self-defined configuration related to data acquisition, and comprises one or more of data transmission protocol configuration, storage configuration and enhancement plug-ins for method level monitoring; the data acquisition agent program acquires the call data of the current thread according to a preset sampling rule and processes the data to generate monitoring data, performs task scheduling based on the monitoring data, and then stores the monitoring data,
wherein the predetermined sampling rule includes a time interval of sampling and a sampling failure processing rule,
the data processing comprises desensitizing sensitive data in the calling data.
2. The call link tracking implementation method according to claim 1, wherein task scheduling based on the monitoring data specifically includes:
the method comprises the following steps of collecting and distributing data, wherein abnormal data in the monitoring data are checked and filtered out in the collecting process, and the monitoring data are distributed according to the data source, the data type and the data use of the monitoring data;
and performing task scheduling based on the distributed data.
3. The call chain tracking implementation method of claim 2, wherein in the data collection and distribution, the speed of collecting and distributing the monitoring data is dynamically adjusted according to the speed of generating the monitoring data.
4. The call chain tracking implementation method of claim 2, wherein the task scheduling based on the distributed data comprises: configuring a plurality of data processing pipelines for distributed data to process the data;
and performing task scheduling based on the processed data.
5. The call chain tracking implementation method of claim 4, wherein the task scheduling based on the processed data comprises:
and taking the processed data of the preset time window as micro batches and submitting the micro batches to a task scheduling center in a micro task form, wherein the task scheduling center distributes the received multiple micro tasks to enable the multiple micro tasks to be executed in parallel.
6. The call tracelink implementation method of claim 4, further comprising:
rules for the collection, distribution, and processing of configuration data.
7. The call link tracing implementation method of claim 1, wherein the data collection Agent is configured by a Java Agent.
8. An apparatus for implementing call link tracking of a distributed service, comprising:
the starting module is used for responding to a user request and starting a data acquisition agent program in a current thread of the user request, wherein the data acquisition agent program supports self-defined configuration related to data acquisition and comprises one or more of data transmission protocol configuration, storage configuration and method level monitoring enhanced plug-ins;
the acquisition module is used for acquiring the calling data of the current thread according to a preset sampling rule by the data acquisition agent program and processing the data to generate monitoring data;
the task scheduling module is used for scheduling tasks based on the monitoring data;
a storage module for storing the monitoring data,
wherein the predetermined sampling rule includes a sampling interval and a sampling failure processing rule,
the data processing comprises desensitizing sensitive data in the calling data.
9. An electronic device for call link tracing implementation of distributed services, comprising:
one or more processors;
one or more memories having computer-readable code stored therein which, when executed by the one or more processors, performs a call link tracking implementation method of a distributed service as recited in any of claims 1-7.
10. A non-transitory computer storage medium having stored therein computer readable code, which when executed by one or more processors, performs a call link tracing implementation method of a distributed service of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911050128.8A CN110806931B (en) | 2019-10-31 | 2019-10-31 | Method and device for realizing call link tracking of distributed service and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911050128.8A CN110806931B (en) | 2019-10-31 | 2019-10-31 | Method and device for realizing call link tracking of distributed service and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110806931A CN110806931A (en) | 2020-02-18 |
| CN110806931B true CN110806931B (en) | 2022-11-22 |
Family
ID=69489737
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911050128.8A Active CN110806931B (en) | 2019-10-31 | 2019-10-31 | Method and device for realizing call link tracking of distributed service and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110806931B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111400129B (en) * | 2020-03-06 | 2022-02-11 | 广东电网有限责任公司 | Distributed application performance monitoring and bottleneck positioning system, method and equipment |
| CN112241355B (en) * | 2020-10-19 | 2024-06-21 | 恩亿科(北京)数据科技有限公司 | Link tracking method, system, computer readable storage medium and electronic device |
| CN112416708B (en) * | 2020-11-17 | 2023-09-22 | 中国工商银行股份有限公司 | Asynchronous call link monitoring method and system |
| CN113094236A (en) * | 2021-04-21 | 2021-07-09 | 北京博睿宏远数据科技股份有限公司 | System data acquisition method and device, computer equipment and storage medium |
| CN113472850B (en) * | 2021-05-31 | 2023-05-09 | 北京达佳互联信息技术有限公司 | Link data acquisition method, device, system, electronic equipment and storage medium |
| US11907693B2 (en) | 2022-04-29 | 2024-02-20 | Zhejiang Lab | Job decomposition processing method for distributed computing |
| CN114579183B (en) * | 2022-04-29 | 2022-10-18 | 之江实验室 | Job decomposition processing method for distributed computation |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101799751A (en) * | 2009-12-02 | 2010-08-11 | 山东浪潮齐鲁软件产业股份有限公司 | Method for building monitoring agent software of host machine |
| CN110062025A (en) * | 2019-03-14 | 2019-07-26 | 深圳绿米联创科技有限公司 | Method, apparatus, server and the storage medium of data acquisition |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5181184B2 (en) * | 2008-03-28 | 2013-04-10 | インターナショナル・ビジネス・マシーンズ・コーポレーション | Apparatus and method for executing agent |
| US9167028B1 (en) * | 2009-09-10 | 2015-10-20 | AppDynamics, Inc. | Monitoring distributed web application transactions |
| CN106951796B (en) * | 2016-01-07 | 2020-12-15 | 创新先进技术有限公司 | Desensitization method and device for data privacy protection |
| US20170222893A1 (en) * | 2016-01-29 | 2017-08-03 | AppDynamics, Inc. | Distributed Business Transaction Path Network Metrics |
| EP3510747B1 (en) * | 2016-09-09 | 2021-09-08 | Microsoft Technology Licensing, LLC | Automated performance debugging of production applications |
| CN107135156A (en) * | 2017-06-07 | 2017-09-05 | 努比亚技术有限公司 | Call chain collecting method, mobile terminal and computer-readable recording medium |
| CN107135128B (en) * | 2017-06-28 | 2021-07-23 | 努比亚技术有限公司 | Call chain data acquisition method, mobile terminal and computer-readable storage medium |
| CN110069358A (en) * | 2019-04-18 | 2019-07-30 | 彩讯科技股份有限公司 | Call chain trace analysis method, apparatus, electronic equipment and storage medium |
| CN110083436A (en) * | 2019-05-14 | 2019-08-02 | 上海理想信息产业（集团）有限公司 | A kind of business datum real-time monitoring system and method based on Java bytecode enhancing technology |
-
2019
- 2019-10-31 CN CN201911050128.8A patent/CN110806931B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101799751A (en) * | 2009-12-02 | 2010-08-11 | 山东浪潮齐鲁软件产业股份有限公司 | Method for building monitoring agent software of host machine |
| CN110062025A (en) * | 2019-03-14 | 2019-07-26 | 深圳绿米联创科技有限公司 | Method, apparatus, server and the storage medium of data acquisition |
Non-Patent Citations (2)
| Title |
|---|
| An agent framework in service oriented environment;Zhiqi Shen等;《2013 IEEE International Conference on Computational Intelligence and Cybernetics (CYBERNETICSCOM)》;20140726;第112-116页 * |
| 分布式系统服务链追踪与监控;郑邦峰;《工业技术创新》;20180425;第84-88页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110806931A (en) | 2020-02-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110806931B (en) | Method and device for realizing call link tracking of distributed service and electronic equipment | |
| CN109271359B (en) | Log information processing method and device, electronic equipment and readable storage medium | |
| CN109039787B (en) | Log processing method and device and big data cluster | |
| CN109245908B (en) | Method and device for switching master cluster and slave cluster | |
| US10013335B2 (en) | Data flow analysis in processor trace logs using compiler-type information method and apparatus | |
| CN113051043A (en) | Micro-service anomaly compensation method and device | |
| CN110598135A (en) | Network request processing method and device, computer readable medium and electronic equipment | |
| WO2018233379A1 (en) | Method and device for obtaining data plaintext, electronic terminal, and readable storage medium | |
| US10613922B2 (en) | Synchronously generating diagnostic data | |
| CN110677699B (en) | Video stream and/or picture stream data sharing method and device and electronic equipment | |
| CN111488257A (en) | Cloud service link tracking monitoring method, device, equipment and storage medium | |
| CN111625532A (en) | Data blood relationship processing method and device, computer equipment and storage medium | |
| CN116545905A (en) | Service health detection method and device, electronic equipment and storage medium | |
| CN107682432B (en) | Spark-based data processing system and method | |
| CN114564286A (en) | Rule engine warning method and rule engine warning system | |
| US10713103B2 (en) | Lightweight application programming interface (API) creation and management | |
| Chen et al. | Analyzing execution path non-determinism of the Linux kernel in different scenarios | |
| CN113114612B (en) | Determination method and device for distributed system call chain | |
| CN113377660B (en) | Test method and device | |
| CN112817813B (en) | Data collection method, device and equipment based on reaction hops | |
| CN114172846A (en) | Kafka platform-based data current limiting method and device, electronic equipment and storage medium | |
| CN113722206A (en) | Data annotation method and device, electronic equipment and computer readable medium | |
| CN116956275A (en) | Data processing method and device and electronic equipment | |
| CN113326188A (en) | Browser testing method and device | |
| CN113900898A (en) | Data processing system, device and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |