CN117614871A

CN117614871A - Method, device, equipment and medium for detecting flow velocity difference of main and standby environments

Info

Publication number: CN117614871A
Application number: CN202311647973.XA
Authority: CN
Inventors: 吴雯祺; 韩东
Original assignee: Beijing Jingdong Century Trading Co Ltd; Beijing Wodong Tianjun Information Technology Co Ltd
Current assignee: Beijing Jingdong Century Trading Co Ltd; Beijing Wodong Tianjun Information Technology Co Ltd
Priority date: 2023-12-04
Filing date: 2023-12-04
Publication date: 2024-02-27

Abstract

The disclosure provides a method, a device, equipment and a medium for detecting flow velocity difference of a main environment and a standby environment, which are executed by first equipment, wherein the first equipment comprises a first environment; the method includes detecting a first upstream data topic in a first environment, wherein the first upstream data topic and a second upstream data topic are data topics generated by a first link task in different environments, the second upstream data topic being generated by a second environment in a second device; determining that first probe data is included in a first upstream data topic, wherein the first probe data is used to detect a first flow rate of a first link task in a first environment; and sending first probe report information according to the first probe data, wherein the first probe report information and the second probe report information are used for determining flow speed difference information of the first flow speed and the second flow speed. Through the flow velocity difference analysis method and device, the flow velocity difference analysis cost can be effectively reduced, and the convenience and analysis efficiency of flow velocity difference analysis are improved.

Description

Method, device, equipment and medium for detecting flow velocity difference of main and standby environments

Technical Field

The disclosure relates to the technical field of computers, and in particular relates to a method, a device, equipment and a medium for detecting flow velocity difference of a main and standby environment.

Background

The real-time computing link is provided with two environments, the two environments operate synchronously, but only one environment provides data service externally, and when one environment has a problem, the other environment is used for taking over to provide data service externally. Because real-time computing tasks are concatenated together in the form of links, the use of real-time message queues allows raw traffic data and result data to flow in the links. The same data on both links of the primary and backup environments may cause flow rate inconsistencies due to several factors. For example, fast in the primary environment and slow in the backup environment, resulting in inconsistent real-time computing progress in both environments. In the related art, by traversing the query real-time message queue, when a keyword is matched, time stamps of a main environment and a standby environment are recorded for determining a flow rate difference. Or through carrying out specific modification on the computer program codes in the main environment and the standby environment, adding corresponding computer program codes for log printing, carrying out deployment and data playback again, and analyzing the flow speed difference according to the printed log information.

In these modes, the flow rate difference analysis is relatively costly, and the analysis is relatively cumbersome and inefficient.

Disclosure of Invention

The present disclosure aims to solve, at least to some extent, one of the technical problems in the related art.

Therefore, the disclosure is directed to a method, an apparatus, an electronic device, a non-transitory computer readable storage medium storing computer instructions, and a computer program product for detecting a flow rate difference in a primary and a secondary environment, which can effectively reduce a flow rate difference analysis cost, and improve convenience and analysis efficiency of flow rate difference analysis.

The method for detecting the flow rate difference of the primary environment and the secondary environment, which is provided by the embodiment of the first aspect of the disclosure, is executed by first equipment, wherein the first equipment comprises a first environment; comprising the following steps: detecting a first upstream data topic in a first environment, wherein the first upstream data topic and a second upstream data topic are data topics generated by a first link task in different environments, and the second upstream data topic is generated by a second environment in a second device; determining that first probe data is included in a first upstream data topic, wherein the first probe data is used to detect a first flow rate of a first link task in a first environment; and sending first probe report information according to the first probe data, wherein the first probe report information and the second probe report information are used for determining flow rate difference information of a first flow rate and a second flow rate, the second flow rate is the flow rate of a first link task in a second environment in second equipment, the second probe report information is determined by second probe data in a second upstream data subject, and the second probe data is used for detecting the second flow rate.

The method for detecting the flow rate difference of the active and standby environments, provided by the embodiment of the second aspect of the present disclosure, is executed by a third device, and includes: receiving first probe report information sent by first equipment and second probe report information sent by second equipment; according to the information reported by the first probe, determining a first flow rate of a first link task in a first environment of the first equipment; determining a second flow rate of the first link task in a second environment of the second equipment according to the information reported by the second probe; and determining flow speed difference information of the first environment and the second environment on the first link task according to the first flow speed and the second flow speed.

The flow rate difference detection device of the primary and backup environments provided by the embodiment of the third aspect of the disclosure is executed by a first device, wherein the first device comprises a first environment; comprising the following steps: the detection module is used for detecting a first upstream data theme in a first environment, wherein the first upstream data theme and a second upstream data theme are data themes generated by a first link task in different environments, and the second upstream data theme is generated by a second environment in second equipment; a first determining module, configured to determine that a first upstream data topic includes first probe data, where the first probe data is used to detect a first flow rate of a first link task in a first environment; the sending module is used for sending first probe report information according to the first probe data, wherein the first probe report information and the second probe report information are used for determining flow speed difference information of a first flow speed and a second flow speed, the second flow speed is the flow speed of a first link task in a second environment in second equipment, the second probe report information is determined by second probe data in a second upstream data subject, and the second probe data is used for detecting the second flow speed.

The flow rate difference detection apparatus of the active/standby environment according to the fourth aspect of the present disclosure is executed by a third device, and includes: the receiving module is used for receiving the first probe report information sent by the first equipment and the second probe report information sent by the second equipment; the second determining module is used for determining a first flow rate of a first link task in a first environment of the first equipment according to the information reported by the first probe; the third determining module is used for determining a second flow rate of the first link task in a second environment of the second equipment according to the information reported by the second probe; and the fourth determining module is used for determining flow rate difference information of the first environment and the second environment on the first link task according to the first flow rate and the second flow rate.

An electronic device according to an embodiment of a fifth aspect of the present disclosure includes: the system comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor realizes the flow speed difference detection method of the primary and backup environments as provided by the embodiment of the first aspect of the disclosure when the processor executes the program.

An embodiment of a sixth aspect of the present disclosure proposes a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method for detecting a flow rate difference of a primary and a secondary environment as proposed by an embodiment of the first aspect of the present disclosure.

An embodiment of a seventh aspect of the present disclosure proposes a computer program product which, when executed by a processor, performs a method for detecting a difference in flow rate of a primary and a secondary environment as proposed by an embodiment of the first aspect of the present disclosure.

The present disclosure provides a method, an apparatus, an electronic device, a non-transitory computer readable storage medium storing computer instructions, and a computer program product for detecting a first upstream data topic in a first environment, where the first upstream data topic and a second upstream data topic are data topics generated by a first link task in different environments, the second upstream data topic is generated by a second environment in a second device, and determining that the first upstream data topic includes first probe data, where the first probe data is used to detect a first flow rate of the first link task in the first environment, and sending first probe report information according to the first probe data, where the first probe report information and the second probe report information are used to determine flow rate difference information of the first flow rate and the second flow rate, and the second flow rate is a flow rate of the first link task in the second environment in the second device, where the second probe report information is used to indicate a second flow rate. In the link task execution process of different environments, probe reporting information is triggered and actively sent based on probe data embedded in the link task in advance, so that flow speed difference information of the link task in different environments is analyzed, and a real-time message queue does not need to be traversed and inquired, and computer program codes in different environments do not need to be modified, so that flow speed difference analysis cost can be effectively reduced, and convenience and analysis efficiency of flow speed difference analysis are improved.

Additional aspects and advantages of the disclosure will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the disclosure.

Drawings

The foregoing and/or additional aspects and advantages of the present disclosure will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:

FIG. 1 is a flow chart of a method for detecting a difference in flow rate between a primary environment and a secondary environment according to an embodiment of the present disclosure;

FIG. 2 is a flow chart of a method for detecting a difference in flow rate in a primary and secondary environment according to another embodiment of the present disclosure;

FIG. 3 is a flow chart of a method for detecting a difference in flow rate in a primary and secondary environment according to another embodiment of the present disclosure;

FIG. 4 is a flow chart of a method for detecting a difference in flow rate in a primary and secondary environment according to another embodiment of the present disclosure;

FIG. 5 is a schematic flow chart of detecting a difference in flow rate of a primary and a secondary environment according to an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of an implementation of a transmit probe data module in an embodiment of the present disclosure;

FIG. 7 is a schematic diagram of a real-time link task identification and process flow in an embodiment of the present disclosure;

FIG. 8 is a flow chart of a probe report data acquisition procedure in an embodiment of the disclosure;

FIG. 9 is a flow chart of an analytical comparison procedure in an embodiment of the present disclosure;

FIG. 10 is a schematic diagram of flow rate difference information in an embodiment of the present disclosure;

FIG. 11 is a schematic structural diagram of a flow rate difference detection device for a primary and a secondary environment according to an embodiment of the present disclosure;

fig. 12 is a schematic structural diagram of a flow rate difference detection device of a primary-backup environment according to another embodiment of the present disclosure;

fig. 13 illustrates a block diagram of an exemplary electronic device suitable for use in implementing embodiments of the present disclosure.

Detailed Description

Embodiments of the present disclosure are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for explaining the present disclosure and are not to be construed as limiting the present disclosure. On the contrary, the embodiments of the disclosure include all alternatives, modifications, and equivalents as may be included within the spirit and scope of the appended claims.

Fig. 1 is a flow chart of a flow rate difference detection method of a primary and a secondary environment according to an embodiment of the disclosure.

The flow rate difference detection method of the active/standby environment is configured as an example in the flow rate difference detection device of the active/standby environment, and the flow rate difference detection method of the active/standby environment in this embodiment may be configured in the flow rate difference detection device of the active/standby environment, and the flow rate difference detection device of the active/standby environment may be provided in a server or may also be provided in an electronic device, which is not limited.

The present embodiment takes an example in which the flow rate difference detection method of the primary and backup environments is configured in the electronic device. Among them, electronic devices such as smartphones, tablet computers, personal digital assistants, electronic books, and the like have hardware devices of various operating systems.

The execution body of the embodiment of the present disclosure may be, for example, a server or a central processing unit (Central Processing Unit, CPU) in an electronic device in hardware, or may be, for example, a server or a related background service in an electronic device in software, which is not limited.

The present embodiment may be executed by a first device, which may be a server or an electronic device as described above, and the first device may include a first environment, for example, a main environment or a standby environment, which is not limited thereto.

As shown in fig. 1, the method for detecting the flow velocity difference of the primary and the secondary environments includes:

s101: a first upstream data topic in a first environment is detected, wherein the first upstream data topic and a second upstream data topic are data topics generated by a first link task in different environments, and the second upstream data topic is generated by a second environment in a second device.

The first device and the second device are redundant devices, the first environment and the second environment are redundant environments, and the first environment and the second environment are different.

The first upstream data theme refers to an upstream data theme generated by the first link task in the first environment. In the first environment, a plurality of data topics may be included, each data topic corresponds to a link task, the link tasks are used for processing service data, processing logic of different link tasks may be the same or different, corresponding different data topics may also be the same or different, in a service data processing link, different data topics may have a corresponding processing sequence, and then the first upstream data topic may be, for example, a data topic generated by a link task in the first processing sequence, or a data topic generated by a link task in any one of specified processing sequences.

Because the first environment and the second environment are redundant environments, the second environment can correspondingly contain the first link task, and when the first link task in the first environment fails, the first link task in the second environment can be started. The data topic generated by the first link task in the second environment may be referred to as a second upstream data topic.

For example, if the first environment is a primary environment, a first upstream data topic in the primary environment may be detected for comparison with a second upstream data topic in a second environment (a backup environment) to determine flow rate differential information under a first link task. If the first environment is a backup environment, a first upstream data topic in the backup environment may be detected for comparison with a second upstream data topic in a second environment (the primary environment) to determine flow rate differential information under the first link task.

S102: the method includes determining that first probe data is included in a first upstream data topic, wherein the first probe data is used to probe a first flow rate of a first link task in a first environment.

In some embodiments, the first probe data may also be sent to a first link task in the first environment prior to detecting the first upstream data topic in the first environment. For example, the first device may receive the first probe data sent by the flow rate analysis platform and send the first probe data to the first link task in the first environment to pre-embed the first probe data.

After detecting the first upstream data topic in the first environment, it may be determined whether the first upstream data topic includes first probe data, where the first probe data is used to detect the first flow rate of the first link task in the first environment, and if it is determined that the first upstream data topic includes the first probe data, step S103 may be triggered.

In some embodiments, the flow rate of the first link task in the first environment may be referred to as a first flow rate, and the flow rate of the first link task in the second environment may be referred to as a second flow rate. The first probe data may be a first link task that is sent in advance to the first environment to probe a first flow rate of the first link task during the calculation of the first link task.

In some embodiments, the first probe data includes at least one of: batch information, wherein the batch information indicates a batch to which the first probe data belongs; a message timestamp, wherein the message timestamp represents a time when the first probe data was sent to a first link task in the first environment; the environment flag bit, wherein the environment flag bit represents the type of the first environment; the number of link task layers, wherein the number of link task layers represents the number of layers of a first link task in a first environment; and customizing the data. Thereby supporting accurate and convenient detection of the flow rate condition of the first link task in the first environment.

S103: and sending first probe report information according to the first probe data, wherein the first probe report information and the second probe report information are used for determining flow rate difference information of a first flow rate and a second flow rate, the second flow rate is the flow rate of a first link task in a second environment in second equipment, the second probe report information is determined by second probe data in a second upstream data subject, and the second probe data is used for detecting the second flow rate.

After determining that the first upstream data subject includes the first probe data, the first probe data may be processed to form first probe report information, and the first probe report information may be sent. For example, the first probe report information may be sent to the flow rate analysis platform, the flow rate analysis platform may receive the first probe report information sent by the first device, and receive the second probe report information sent by the second device, and the implementation process of forming and sending the second probe report information by the second device may refer to the implementation process of forming and sending the first probe report information by the first device, and the flow rate analysis platform may compare the first probe report information with the second probe report information to determine flow rate difference information of the first link task in different environments.

In some embodiments, the first probe reporting information includes at least one of: batch information, wherein the batch information represents a batch to which the first probe report information belongs; actual time, wherein the actual time represents the time when the first probe data arrives at the first link task in the first environment; the environment flag bit, wherein the environment flag bit represents the type of the first environment; the number of link task layers, wherein the number of link task layers represents the number of layers of a first link task in a first environment; task numbers, wherein the task numbers represent the numbers of the first link tasks in the first environment; and the duration time is used for indicating the duration time from the time when the first probe data arrives at the first link task in the first environment to the time when the first probe report information is sent. Thereby supporting the improvement of the accuracy and the analysis effect of the flow velocity difference information analysis.

In this embodiment, the first device may detect a first upstream data topic in a first environment, where the first upstream data topic and the second upstream data topic are data topics generated by a first link task in different environments, the second upstream data topic is generated by a second environment in the second device, and determine that the first upstream data topic includes first probe data, where the first probe data is used to detect a first flow rate of the first link task in the first environment, and send first probe report information according to the first probe data, where the first probe report information and the second probe report information are used to determine flow rate difference information of the first flow rate and the second flow rate, and the second probe report information is used to indicate a flow rate of the first link task in the second environment in the second device. In the link task execution process of different environments, probe reporting information is triggered and actively sent based on probe data embedded in the link task in advance, so that flow speed difference information of the link task in different environments is analyzed, and a real-time message queue does not need to be traversed and inquired, and computer program codes in different environments do not need to be modified, so that flow speed difference analysis cost can be effectively reduced, and convenience and analysis efficiency of flow speed difference analysis are improved.

Fig. 2 is a flow chart of a flow rate difference detection method of a primary and a secondary environment according to another embodiment of the present disclosure.

As shown in fig. 2, the method for detecting the flow velocity difference of the primary and the secondary environments includes:

s201: and determining that the current time reaches the sending time.

In some embodiments, the transmission time of the probe data may be preset. The current time may be detected and if the current time reaches the transmission time, the transmission of the first probe data is triggered.

S202: and sending first probe data to a first link task in a first environment, wherein when the first probe data is sent to the first link task in the first environment, triggering to send second probe data to the first link task in a second environment, wherein the second probe data is used for determining second probe reporting information.

That is, when the first probe data is sent to the first link task in the first environment, the second probe data is triggered to be sent to the first link task in the second environment, the environmental zone bits in the first probe data and the second probe data are different, and other contents can be the same, so that the accuracy of the ratio of the subsequent first probe report information and the second probe report information is improved, and the detection accuracy of the flow velocity difference information is improved.

For example, the first device may receive the first probe data sent by the flow rate analysis platform and send the first probe data to the first link task in the first environment to pre-embed the first probe data. The flow rate analysis platform can send the first probe data to the first device and simultaneously send the second probe data to the first link task in the second environment of the second device, and the second environment can keep consistent with the first environment and synchronously pre-embed the second probe data.

S203: a first upstream data topic in a first environment is detected, wherein the first upstream data topic and a second upstream data topic are data topics generated by a first link task in different environments, and the second upstream data topic is generated by a second environment in a second device.

S204: the method includes determining that first probe data is included in a first upstream data topic, wherein the first probe data is used to probe a first flow rate of a first link task in a first environment.

The descriptions of S203 to S204 may be specifically referred to the above embodiments, and are not repeated herein.

S205: and generating first probe report information according to the first probe data and a first local timestamp in the first environment, wherein the first probe report information and second probe report information are used for determining flow rate difference information of a first flow rate and a second flow rate, the second flow rate is the flow rate of a first link task in a second environment in second equipment, the second probe report information is determined by second probe data in a second upstream data subject, and the second probe data is used for detecting the second flow rate.

Wherein the local time stamp in the first environment may be referred to as a first time stamp and, correspondingly, the local time stamp in the second environment may be referred to as a second time stamp.

In some embodiments, the first probe report information may be generated locally at the first device. For example, the partial data may be parsed from the first probe data and the partial data and the first timestamp may be encapsulated to form the first probe report information. Accordingly, the second probe report information may be generated based on the same or corresponding embodiment as the first probe report information.

S206: and sending the first probe report information according to the first probe data.

The description of S206 may be specifically referred to the above embodiments, and will not be repeated here.

In this embodiment, in the execution process of the link tasks in different environments, the probe reporting information is triggered and actively sent based on the probe data embedded in advance in the link tasks, so as to analyze the flow velocity difference information of the link tasks in different environments. And sending first probe data to a first link task in the first environment by determining that the current time reaches the sending time, wherein when the first probe data is sent to the first link task in the first environment, triggering to send second probe data to the first link task in the second environment, wherein the second probe data is used for determining second probe reporting information, improving the accuracy of the ratio of the subsequent first probe reporting information to the second probe reporting information, and improving the detection accuracy of the flow velocity difference information. By generating the first probe report information according to the first probe data and the first local timestamp in the first environment, the report integrity of the first probe report information can be effectively improved, and the reference value of the first probe report information in the flow velocity difference information comparison process is improved.

In the method provided by the embodiment of the disclosure, under the condition that the first upstream data subject includes the first probe data, the first probe data can be processed to obtain third probe data, and the third probe data is sent to the second link task, where the second link task is a link task downstream of the first link task, the third probe data is used to detect a third flow rate of the second link task, and the third flow rate is used to analyze flow rate difference information of the second environments in the first environment and the second device on the second link task. The flow speed difference information of a plurality of link tasks in the active and standby environments is respectively compared, and accuracy and comparison effect of the flow speed difference information comparison are improved.

The second link task is a link task downstream of the first link task, and the first link task and the second link task may be link tasks belonging to the same environment, and may be deployed in different devices or in the same device, which is not limited. The second link task may be a link task having a processing order subsequent to and adjacent to the processing order of the first link task.

Wherein the third probe data is used to detect a third flow rate of a second link task in the main environment, the flow rate of the second link task may be referred to as a third flow rate. And the third probe data can be buried in a second link task in the main environment so as to report corresponding probe report information in the execution process of the second link task.

In some embodiments, part of the data content in the first probe data may be modified into probe data suitable for the second link task, and the modified probe data may be used as third probe data.

In some embodiments, portions of the first upstream data topic other than the first probe data may also be sent to the second link task together to support efficient execution of the second link task.

Fig. 3 is a flow chart of a flow rate difference detection method of a primary and a secondary environment according to another embodiment of the present disclosure.

As shown in fig. 3, the method for detecting the flow velocity difference of the primary and the secondary environments includes:

S301: a first upstream data topic in a first environment is detected, wherein the first upstream data topic and a second upstream data topic are data topics generated by a first link task in different environments, and the second upstream data topic is generated by a second environment in a second device.

The descriptions of S301 to S302 may be specifically referred to the above embodiments, and are not repeated herein.

S302: it is determined that the first probe data is not included in the first upstream data topic.

In some embodiments, if it is determined that the first probe data is not included in the first upstream data topic, S303 may be triggered.

S303: and sending the first upstream data theme and the first service data related to the first upstream data theme to a second link task, wherein the second link task is a link task downstream of the first link task.

In some embodiments, if the first upstream data topic does not include the first probe data, the first upstream data topic and the first traffic data related to the first upstream data topic may be sent together to the second link task. Further link processing of the first traffic data with reference to the first upstream data topic is performed to support a second link task.

In this embodiment, by detecting a first upstream data topic in a first environment, where the first upstream data topic and a second upstream data topic are data topics generated by a first link task in different environments, the second upstream data topic is generated by a second environment in a second device, determining that the first upstream data topic does not include first probe data, and sending the first upstream data topic and first traffic data related to the first upstream data topic to a second link task, where the second link task is a link task downstream of the first link task. The effective implementation of each link task can be ensured in the flow rate difference information comparison process.

Fig. 4 is a flow chart of a flow rate difference detection method of a primary and a secondary environment according to another embodiment of the present disclosure.

The embodiment may be executed by a third device, where the third device may be configured to carry the above-mentioned flow rate analysis platform, so as to detect flow rate difference information of a first environment of the first device and a second environment of the second device, where, by way of example, the first environment is a main environment, and the second environment is a standby environment; or the first environment is a standby environment and the second environment is a primary environment. There is no limitation in this regard.

As shown in fig. 4, the method for detecting the flow velocity difference of the primary and the secondary environments includes:

s401: and receiving the first probe report information sent by the first equipment and the second probe report information sent by the second equipment.

In some embodiments, the first probe reporting information includes at least one of: batch information, wherein the batch information represents a batch to which the first probe report information belongs; the actual time represents the time when the first probe data arrives at the first link task in the first environment, and the first probe data is used for determining the first probe reporting information; the environment flag bit, wherein the environment flag bit represents the type of the first environment; the number of link task layers, wherein the number of link task layers represents the number of layers of a first link task in a first environment; task numbers, wherein the task numbers represent the numbers of the first link tasks in the first environment; and the duration time is used for indicating the duration time from the time when the first probe data arrives at the first link task in the first environment to the time when the first probe report information is sent.

In some embodiments, the second probe reporting information includes at least one of: batch information, wherein the batch information represents a batch to which the second probe report information belongs; the actual time represents the time when the second probe data arrives at the first link task in the second environment, and the second probe data is used for determining the reporting information of the second probe; the environment flag bit, wherein the environment flag bit represents the type of the second environment; the number of link task layers, wherein the number of link task layers represents the number of layers of the first link task in the second environment; task numbers, wherein the task numbers represent the numbers of the first link tasks in the second environment; and the duration time is the duration time from the second probe data to the first link task in the second environment to the sending of the second probe report information.

S402: and determining a first flow rate of a first link task in a first environment of the first equipment according to the information reported by the first probe.

S403: and determining a second flow rate of the first link task in a second environment of the second equipment according to the information reported by the second probe.

S404: and determining flow rate difference information of the first environment and the second environment in the first link task according to the first flow rate and the second flow rate.

In some embodiments, after receiving the first probe report information sent by the first device and the second probe report information sent by the second device, the third device may determine, according to the first probe report information, a first flow rate of a first link task in a first environment of the first device, determine, according to the second probe report information, a second flow rate of the first link task in a second environment of the second device, and then compare the first flow rate and the second flow rate to determine flow rate difference information of the first environment and the second environment in the first link task.

After embedding the probe data into the second link task, the third device may also receive third probe report information (determined by the probe data embedded in the second link task in the first device) sent by the first device and second probe report information (determined by the probe data embedded in the second link task in the second device) sent by the second device, and analyze flow rate difference information of the first environment and the second environment in the second link task. And the flow speed difference information on each link task in the active and standby environments is analyzed.

In this embodiment, a first flow rate of a first link task in a first environment of a first device is determined by receiving first probe report information sent by the first device and second probe report information sent by the second device, and according to the first probe report information, a second flow rate of the first link task in a second environment of the second device is determined according to the second probe report information, and according to the first flow rate and the second flow rate, flow rate difference information of the first environment and the second environment in the first link task is determined. The flow velocity difference analysis cost can be effectively reduced, and the convenience and analysis efficiency of flow velocity difference analysis are improved. And the flow speed difference information on each link task in the primary and standby environments is analyzed.

Aiming at a real-time computing link with a main environment and a standby environment, the embodiment of the disclosure provides a fast, low-resource-consumption and low-modification mode for fast positioning the difference of flow rates in the real-time link with the main environment and the standby environment, so as to help a development engineer to fast position the cause of the difference of the flow rates. The embodiment of the disclosure can avoid traversing inquiry of all data topics in the real-time link, thereby saving time and machine cost; and the code can be prevented from being modified, the invasiveness of the code is reduced, and the number of times of task reissue and log printing is reduced.

As shown in fig. 5, fig. 5 is a schematic diagram of a flow rate difference detection flow of a primary and a secondary environment in an embodiment of the present disclosure. Firstly, a program for transmitting probe data transmits probe data which realizes a defined format to a specific position in a main and standby environment, such as the most upstream data subject (an optional example of a first upstream data subject), at the same time by using a timing program, wherein other fields except for a main and standby environment zone bit in the probe data are consistent. After receiving a data source a (an optional example of a first upstream data theme), a first layer processing task (an optional example of a first link task) identifies the received data, and after identifying probe data according to a predefined format, the first layer processing task firstly records current timestamp information, then assembles with other necessary information, packages the current timestamp information into probe report information (an optional example of the first probe report information), and sends the probe report information to an acquisition program through a network; and then, the probe data received by the link task of the layer is utilized to be reprocessed into probe data in a format required by the next processing task (an optional example of the second link task), and the probe data is immediately issued to the data source B, so that the probe data continues to flow in the downstream link task. And after the second layer processing task receives the probe data sent by the previous layer, repeating the previous process until the last layer, namely the database layer, is reached, and the circulation of the probe data is finished. For the probe report information collection program, after receiving probe report information sent by each layer of processing task (for example, each layer of link task) in the active/standby environment, the probe report information is converted according to a certain format and stored in a specific database. And finally, comparing and analyzing the report information of the plurality of probes acquired in the report information database by using an analysis and comparison tool, and giving out flow velocity difference information to form a conclusion report.

Implementation of the transmit probe data module may be as shown in fig. 6, and fig. 6 is a schematic diagram of implementation of the transmit probe data module in an embodiment of the disclosure. The main function of the probe data sending module is to send probe data to a data theme in the active and standby environments, so that the probe data flows in a real-time link task. Before formally sending the probe data, the user needs to be supported to set the theme name to be sent to the active/standby environment, and then the program sets a timer to determine the time of sending the probe data. When the sending time is reached, the program can send two pieces of probe data to the data subjects of different environments at the same time, and all other information fields are consistent except that the main and standby environment flag bits are inconsistent. The field descriptions of the probe data are shown in table 1 below.

TABLE 1

Fig. 7 is a schematic diagram of real-time link task identification and processing flow in an embodiment of the disclosure. In the task of the real-time link, firstly, pulling real-time data from an upstream data subject containing probe data, then judging the data type, and if the data is common service data, directly distributing the data to a normal processing logic flow; if the probe data is the probe data, the probe data is firstly analyzed, the various information fields are mainly extracted, then the information and the local timestamp of the equipment are used for assembling, probe report information is assembled, and the probe report information is reported to a probe report information acquisition program. After the report is completed, the link task of the layer can repackage the probe data to meet the format requirement of the link task of the next layer, and meanwhile, the addition operation is carried out on the Level accumulator field. After the encapsulation is completed, it is written to the outgoing down theme along with the normal business data.

Fig. 8 is a schematic flow chart of a probe report data acquisition procedure according to an embodiment of the disclosure. When probe report information sent by a link processing task reaches a server through a hypertext transfer protocol (Hypertext Transfer Protocol, HTTP), an acquisition program of the server firstly analyzes a data packet of the probe report information, mainly analyzes information to be input from the probe report information, and writes the information into an acquisition database in batches after analysis is completed. The fields in the collection database are illustrated in table 2 below. The probe report information may also be referred to as probe report data or report data.

TABLE 2

As shown in fig. 9, fig. 9 is a flow chart of an analysis comparison procedure in an embodiment of the disclosure. After all probe report data are written into the database through the acquisition program, the data can be subjected to grouping statistics through the analysis comparison program so as to analyze the flow velocity condition of the probe data in the main environment and the standby environment. For the streaming situation of probe data in real-time link, the specific calculation logic is:

firstly, screening out probe report data of the same batch of BatchId according to the selection of a user; grouping according to the EnvMark field so as to distinguish the main environment or the standby environment; detecting the flow speed difference of the primary and standby environments according to the Level field from small to large, and drawing the hierarchy relation of the real-time links; and assigning values according to the Duration field, comparing the main environment group with the standby environment group, and outputting the values to a report to prompt a user if the phase difference is too large. The specific analytical comparative report patterns are shown in fig. 10. Fig. 10 is a schematic diagram of flow rate difference information in an embodiment of the present disclosure.

In the embodiment of the disclosure, the flow rate detection for the real-time calculation link is realized by sending probe data, carrying out real-time link task identification processing, reporting data acquisition, comparison analysis and other module programs. The main function of the transmission procedure is to set a timer and then transmit probe data in a special format into the real-time link of the active-standby environment at a near simultaneous point in time. The probe data flows as a 'messenger' in the real-time links of the main environment and the standby environment, reaching each layer of tasks (link tasks) in the real-time links; each real-time link carries out special processing when receiving the probe data, extracts information from the probe data, records the current time point of the machine and the time consumption for reaching the layer, and sends the information to a server end of an acquisition program through an HTTP request after the information is assembled, and meanwhile, repacks the probe data and then sends the probe data to a next layer of real-time task. The acquisition program analyzes the probe report message and writes the message into an acquisition database. Finally, the comparison analysis program screens the report records in the collection database, records the flow velocity difference detection of the grouping primary and secondary environments, draws the hierarchy relation of the real-time link, compares the flow velocity condition of the probe data in the primary and secondary environments according to the report time stamp and time consumption, and finally forms a report and outputs the report to the user. The method can help research and development engineers locate the reason for generating the flow speed difference in the real-time link of the main and standby environments, and saves a great deal of time and machine cost.

Fig. 11 is a schematic structural diagram of a flow rate difference detection device for a primary and a secondary environment according to an embodiment of the present disclosure.

As shown in fig. 11, applied to a first device, the first device includes a first environment; the primary and backup environment flow rate difference detection device 110 includes:

the detecting module 1101 is configured to detect a first upstream data topic in a first environment, where the first upstream data topic and a second upstream data topic are data topics generated by a first link task in different environments, and the second upstream data topic is generated by a second environment in a second device.

A first determining module 1102 is configured to determine that first probe data is included in a first upstream data topic, where the first probe data is used to probe a first flow rate of a first link task in a first environment.

The sending module 1103 is configured to send first probe report information according to first probe data, where the first probe report information and the second probe report information are used to determine flow rate difference information of a first flow rate and a second flow rate, the second flow rate is a flow rate of a first link task in a second environment in the second device, the second probe report information is determined by second probe data in a second upstream data topic, and the second probe data is used to detect the second flow rate.

It should be noted that the foregoing explanation of the method for detecting a flow rate difference between the active and standby environments is also applicable to the apparatus for detecting a flow rate difference between the active and standby environments in this embodiment, and is not repeated here.

Fig. 12 is a schematic structural diagram of a flow rate difference detection device for a primary and a secondary environment according to another embodiment of the present disclosure.

As shown in fig. 12, the flow rate difference detection device 120 applied to the third apparatus, which is a main/standby environment, includes:

and the receiving module 1201 is configured to receive the first probe report information sent by the first device and the second probe report information sent by the second device.

A second determining module 1202, configured to determine a first flow rate of a first link task in a first environment of the first device according to the first probe report information.

A third determining module 1203 is configured to determine, according to the information reported by the second probe, a second flow rate of the first link task in the second environment of the second device.

A fourth determining module 1204, configured to determine, according to the first flow rate and the second flow rate, flow rate difference information of the first environment and the second environment on the first link task.

Fig. 13 illustrates a block diagram of an exemplary electronic device suitable for use in implementing embodiments of the present disclosure. The electronic device 12 shown in fig. 13 is merely an example and should not be construed as limiting the functionality and scope of use of the disclosed embodiments.

As shown in fig. 13, the electronic device 12 is in the form of a general purpose computing device. Components of the electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a memory 28, and a bus 18 that connects the various system components, including the memory 28 and the processing unit 16.

Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include industry Standard architecture (Industry Standard Architecture; hereinafter ISA) bus, micro channel architecture (Micro Channel Architecture; hereinafter MAC) bus, enhanced ISA bus, video electronics standards Association (Video Electronics Standards Association; hereinafter VESA) local bus, and peripheral component interconnect (Peripheral Component Interconnection; hereinafter PCI) bus.

Electronic device 12 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by electronic device 12 and includes both volatile and nonvolatile media, removable and non-removable media.

Memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (Random Access Memory; hereinafter: RAM) 30 and/or cache memory 32. The electronic device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from or write to non-removable, nonvolatile magnetic media (not shown in FIG. 13, commonly referred to as a "hard disk drive").

Although not shown in fig. 13, a disk drive for reading from and writing to a removable nonvolatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable nonvolatile optical disk (e.g., a compact disk read only memory (Compact Disc Read Only Memory; hereinafter CD-ROM), digital versatile read only optical disk (Digital Video Disc Read Only Memory; hereinafter DVD-ROM), or other optical media) may be provided. In such cases, each drive may be coupled to bus 18 through one or more data medium interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of the various embodiments of the disclosure.

A program/utility 40 having a set (at least one) of program modules 42 may be stored in, for example, memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 42 generally perform the functions and/or methods in the embodiments described in this disclosure.

The electronic device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), one or more devices that enable a person to interact with the electronic device 12, and/or any devices (e.g., network card, modem, etc.) that enable the electronic device 12 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 22. Also, the electronic device 12 may communicate with one or more networks, such as a local area network (Local Area Network; hereinafter: LAN), a wide area network (Wide Area Network; hereinafter: WAN) and/or a public network, such as the Internet, via the network adapter 20. As shown, the network adapter 20 communicates with other modules of the electronic device 12 over the bus 18. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with electronic device 12, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.

The processing unit 16 executes various functional applications and data processing by running a program stored in the memory 28, for example, implementing the flow rate difference detection method of the primary and backup environments mentioned in the foregoing embodiment.

In order to implement the above-described embodiments, the present disclosure also proposes a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a flow rate difference detection method of a primary and backup environment as proposed by the foregoing embodiments of the present disclosure.

To achieve the above-described embodiments, the present disclosure also proposes a computer program product which, when executed by a processor, performs a method of detecting a difference in flow rate of a primary and a secondary environment as proposed by the foregoing embodiments of the present disclosure.

It should be noted that in the description of the present disclosure, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Furthermore, in the description of the present disclosure, unless otherwise indicated, the meaning of "a plurality" is two or more.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and further implementations are included within the scope of the preferred embodiment of the present disclosure in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present disclosure.

It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.

Those of ordinary skill in the art will appreciate that all or a portion of the steps carried out in the method of the above-described embodiments may be implemented by a program to instruct related hardware, where the program may be stored in a computer readable storage medium, and where the program, when executed, includes one or a combination of the steps of the method embodiments.

Furthermore, each functional unit in the embodiments of the present disclosure may be integrated in one processing module, or each unit may exist alone physically, or two or more units may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules. The integrated modules may also be stored in a computer readable storage medium if implemented in the form of software functional modules and sold or used as a stand-alone product.

The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, or the like.

In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present disclosure. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

Although embodiments of the present disclosure have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the present disclosure, and that variations, modifications, alternatives, and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the present disclosure.

Claims

1. A method of detecting a difference in flow rates of a primary and a secondary environment, the method being performed by a first device, the first device comprising a first environment; the method comprises the following steps:

Detecting a first upstream data topic in a first environment, wherein the first upstream data topic and a second upstream data topic are data topics generated by a first link task in different environments, and the second upstream data topic is generated by a second environment in a second device;

determining that first probe data is included in the first upstream data topic, wherein the first probe data is used for detecting a first flow rate of a first link task in the first environment;

and sending first probe report information according to the first probe data, wherein the first probe report information and second probe report information are used for determining flow rate difference information of the first flow rate and the second flow rate, the second flow rate is the flow rate of a first link task in a second environment in the second equipment, the second probe report information is determined by second probe data in a second upstream data subject, and the second probe data is used for detecting the second flow rate.

2. The method of claim 1, wherein,

the first probe data includes at least one of:

batch information, wherein the batch information indicates a batch to which the first probe data belongs;

A message timestamp, wherein the message timestamp represents a time when the first probe data was sent to a first link task in the first environment;

an environment flag bit, wherein the environment flag bit represents a type of the first environment;

the number of link task layers, wherein the number of link task layers represents the number of layers of a first link task in the first environment;

custom data;

the first probe reporting information includes at least one of:

batch information, wherein the batch information indicates a batch to which the first probe report information belongs;

an actual time, wherein the actual time represents a time when the first probe data arrives at a first link task in the first environment;

a task number, wherein the task number represents the number of a first link task in the first environment;

and the duration time is used for indicating the duration time from the arrival of the first probe data at a first link task in the first environment to the transmission of the first probe report information.

3. The method of claim 1, wherein prior to said detecting a first upstream data topic in a first environment, the method further comprises:

and sending the first probe data to the first link task in the first environment.

4. The method of claim 3, wherein the sending the first probe data to the first link task in the first environment comprises:

determining that the current time reaches the sending time;

and sending the first probe data to the first link task in the first environment, wherein when the first probe data is sent to the first link task in the first environment, the second probe data is triggered to be sent to the first link task in the second environment.

5. The method of claim 1, wherein the method further comprises:

and generating the first probe report information according to the first probe data and a first local timestamp in the first environment.

6. The method of claim 1, wherein the method further comprises:

determining that the first probe data is not included in the first upstream data topic;

And sending the first upstream data theme and the first business data related to the first upstream data theme to a second link task, wherein the second link task is a link task downstream of the first link task.

7. The method of claim 1, wherein the method further comprises:

processing the first probe data to obtain third probe data;

and sending the third probe data to a second link task, wherein the second link task is a link task downstream of the first link task, the third probe data is used for detecting a third flow rate of the second link task in the first environment, and the third flow rate is used for analyzing flow rate difference information of the second environment in the first environment and the second device on the second link task.

8. A method of detecting a difference in flow rate in a primary and backup environment, the method being performed by a third device, the method comprising:

receiving first probe report information sent by first equipment and second probe report information sent by second equipment;

determining a first flow rate of a first link task in a first environment of the first device according to the information reported by the first probe;

Determining a second flow rate of the first link task in a second environment of the second equipment according to the information reported by the second probe;

and determining flow rate difference information of the first environment and the second environment on the first link task according to the first flow rate and the second flow rate.

9. The method of claim 8, wherein,

the first probe reporting information includes at least one of:

the actual time represents the time when first probe data arrives at a first link task in the first environment, wherein the first probe data is used for determining the first probe reporting information;

the duration time indicates a duration time from when the first probe data arrives at a first link task in the first environment to when the first probe report information is sent;

The second probe reporting information includes at least one of:

batch information, wherein the batch information indicates a batch to which the second probe report information belongs;

the actual time represents the time when second probe data arrives at a first link task in the second environment, wherein the second probe data is used for determining the second probe reporting information;

an environmental flag bit, wherein the environmental flag bit represents a type of the second environment;

the number of link task layers, wherein the number of link task layers represents the number of layers of a first link task in the second environment;

a task number, wherein the task number represents the number of a first link task in the second environment;

and the duration time is represented by the duration time from the arrival of the second probe data at the first link task in the second environment to the transmission of the second probe report information.

10. A flow rate difference detection device of a primary and a secondary environment, which is characterized by being applied to first equipment, wherein the first equipment comprises a first environment; the device comprises:

the detection module is used for detecting a first upstream data theme in a first environment, wherein the first upstream data theme and a second upstream data theme are data themes generated by a first link task in different environments, and the second upstream data theme is generated by a second environment in second equipment;

A first determining module, configured to determine that first probe data is included in the first upstream data topic, where the first probe data is used to detect a first flow rate of a first link task in the first environment;

the sending module is configured to send first probe report information according to the first probe data, where the first probe report information and second probe report information are used to determine flow rate difference information of the first flow rate and the second flow rate, the second flow rate is a flow rate of a first link task in a second environment in the second device, the second probe report information is determined by second probe data in the second upstream data topic, and the second probe data is used to detect the second flow rate.

11. A flow rate difference detection apparatus for a primary and backup environment, the apparatus being applied to a third device, the apparatus comprising:

the receiving module is used for receiving the first probe report information sent by the first equipment and the second probe report information sent by the second equipment;

the second determining module is used for determining a first flow rate of a first link task in a first environment of the first equipment according to the information reported by the first probe;

The third determining module is used for determining a second flow rate of the first link task in a second environment of the second equipment according to the information reported by the second probe;

and the fourth determining module is used for determining flow rate difference information of the first environment and the second environment on the first link task according to the first flow rate and the second flow rate.

12. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-9.

13. A non-transitory computer readable storage medium storing computer instructions, wherein the computer instructions are for causing the computer to perform the method of any one of claims 1-9.