CN109242244B - Method and device for monitoring task flow of power transaction bus and interceptor - Google Patents

Method and device for monitoring task flow of power transaction bus and interceptor Download PDF

Info

Publication number
CN109242244B
CN109242244B CN201810861813.8A CN201810861813A CN109242244B CN 109242244 B CN109242244 B CN 109242244B CN 201810861813 A CN201810861813 A CN 201810861813A CN 109242244 B CN109242244 B CN 109242244B
Authority
CN
China
Prior art keywords
task
receipt
data
interceptor
flow
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810861813.8A
Other languages
Chinese (zh)
Other versions
CN109242244A (en
Inventor
蔡华祥
杨强
严明辉
陈然
王睿琛
吕志强
孙恒一
高航
孙永军
邹贤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kunming Electric Power Transaction Center Co ltd
NR Electric Co Ltd
Original Assignee
Kunming Electric Power Transaction Center Co ltd
NR Electric Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kunming Electric Power Transaction Center Co ltd, NR Electric Co Ltd filed Critical Kunming Electric Power Transaction Center Co ltd
Priority to CN201810861813.8A priority Critical patent/CN109242244B/en
Publication of CN109242244A publication Critical patent/CN109242244A/en
Application granted granted Critical
Publication of CN109242244B publication Critical patent/CN109242244B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0637Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/06Electricity, gas or water supply

Abstract

The invention provides a method and a device for monitoring task flow of a power transaction bus and an interceptor. The method comprises the following steps: the method comprises the steps that an interceptor receives a task sent by a task delivery machine and an effective address of the task; weighing the data amount of the task; sending the task to a task executor corresponding to the effective address; receiving a task receipt from the task executor; weighing the data quantity of the task receipt; and sending the task receipt to the task delivery machine. The invention can realize the decoupling of the statistic monitoring and the task executor, ensure the efficiency of task circulation and processing, ensure the real-time monitoring and statistic of data flow, and ensure the timeliness of the task execution efficiency and the monitoring and statistic.

Description

Method and device for monitoring task flow of power transaction bus and interceptor
Technical Field
The invention relates to the field of electric power transaction, in particular to a method and a device for monitoring task flow of an electric power transaction bus and an interceptor.
Background
With the release of the article "several opinions on further deepening the power system reform" (Zhongkai [ 2015 ] 9), a new power system reform is actively developed nationwide. The number of transaction subjects on the electric power market is continuously increased, the transaction scale is gradually enlarged, the transaction types are gradually enriched, the long-term transaction, the monthly transaction and the day-ahead transaction are gradually developed to the day-in transaction and the real-time transaction, and the continuous development of the electric power market transaction service puts higher requirements on the aspects of service support capability, expansion capability and the like of the electric power transaction platform.
The traditional task flow statistical monitoring mode usually acquires and calculates corresponding parameters in a task executor and finally unifies the parameters into a data set for storage, the accuracy and the effectiveness of parameter statistics in the executor are well solved, but the executor needs to rely on more statistical services and maintains a connection for the statistical data set by each executor, and then the task executor needs to occupy a part of resources to perform statistical tasks, so that the full-time task efficiency of the executor is influenced. Aiming at that each dispersed service is not beneficial to centralized traffic statistics, the statistical calculation cost is shared to the task executor which should only care about service calculation, and the execution efficiency of the task executor is influenced. Meanwhile, the method is difficult to ensure the time window synchronism of the resource statistics of each executor.
Disclosure of Invention
The embodiment of the invention aims to provide a method, an interceptor and a device for monitoring the task flow of a power transaction bus, so as to guarantee the task execution efficiency and the timeliness of monitoring statistics.
The embodiment of the invention provides a method for monitoring task flow of a power transaction bus, which comprises the following steps:
the method comprises the steps that an interceptor receives a task sent by a task delivery machine and an effective address of the task;
weighing the data amount of the task;
sending the task to a task executor corresponding to the effective address;
receiving a task receipt from the task executor;
weighing the data quantity of the task receipt;
and sending the task receipt to the task delivery machine.
Further, before the interceptor receives the task sent by the task delivery machine and the effective address information of the task, the method further comprises the following steps:
the task delivery machine receives tasks delivered by the task system;
analyzing the target task executor information of the task;
searching the effective address of the target task executor in an address list;
and sending the task and the effective address of the task to the interceptor.
Further, the weighing the data amount of the task comprises:
the interceptor obtains a task flow data packet by weighing the data volume of the task;
transmitting the task traffic data packet to a monitoring calculator;
the monitoring calculator analyzes the received flow data packet to obtain a flow calculation result.
Further, the weighing the data amount of the task receipt comprises:
the interceptor carries out data quantity weighing on the task receipt to obtain a receipt flow data packet;
transmitting the receipt traffic data packet to a monitoring calculator;
the monitoring calculator analyzes the received flow data packet to obtain a flow calculation result.
Further, the analyzing the received traffic data packet by the monitoring calculator to obtain a traffic calculation result includes:
the monitoring calculator analyzes the received flow data packet;
determining whether the traffic data packet is a task traffic data packet or a receipt traffic data packet;
calculating the flow data packet to obtain a flow calculation result;
and storing the flow calculation result to a data warehouse.
Further, the storing the flow calculation result to a data warehouse includes:
finding the task in a task traffic list in the data warehouse;
according to the real-time sampling frequency, regularly storing the real-time flow data of the real-time queue in the flow calculation result into a data warehouse;
and storing historical flow data of the historical queue in the flow calculation result to a data warehouse at regular time according to the historical sampling frequency.
The embodiment of the invention also provides an interceptor, which receives the task sent by the task delivery machine and the effective address of the task, weighs the data volume of the task, and sends the task to the task executor corresponding to the effective address;
the interceptor also receives the task receipt from the task executor, performs data weighing on the task receipt, and sends the task receipt to the task delivery machine.
Further, the interceptor comprises:
the delivery interceptor is used for receiving the task sent by the task delivery machine and the effective address of the task, weighing the data volume of the task to obtain a task flow data packet, and transmitting the task flow data packet to the monitoring calculator; sending the task to a task executor corresponding to the effective address;
the receipt interceptor is used for receiving the task receipt from the task executor, weighing the data quantity of the task receipt to obtain a receipt flow data packet and transmitting the receipt flow data packet to the monitoring calculator; and sending the task receipt to the task delivery machine.
The embodiment of the invention also provides a device for monitoring the task flow of the power transaction bus, which comprises:
the interceptor is used for receiving the task sent by the task delivery machine and the effective address of the task, weighing the data volume of the task to obtain a task data traffic packet, sending the task data traffic packet to the monitoring calculator and sending the task to the task executor corresponding to the effective address; the interceptor also receives a task receipt from the task executor, performs data quantity weighing on the task receipt to obtain a receipt data flow packet, sends the receipt data flow packet to the monitoring calculator, and sends the task receipt to the task delivery machine;
and the monitoring calculator receives the flow data packet from the interceptor, analyzes and calculates the flow data packet to obtain a flow calculation result, and stores the calculation result to the data warehouse.
Further, the interceptor comprises:
the delivery interceptor is used for receiving the tasks sent by the task delivery machine and the effective addresses of the tasks; weighing the data quantity of the task to obtain a task flow data packet, and transmitting the task flow data packet to a monitoring calculator; sending the task to a task executor corresponding to the effective address;
the receipt interceptor receives the task receipt from the task executor; weighing the data quantity of the task receipt to obtain a receipt flow data packet, and transmitting the receipt flow data packet to the monitoring calculator; and sending the task receipt to the task delivery machine.
Through the technical scheme provided by the embodiment of the invention, a method for realizing the monitoring of the task flow of the power transaction bus is provided; the decoupling of the statistical monitoring and the task executor can be realized, the efficiency of task circulation and processing is ensured, and the real-time monitoring and statistical data flow are ensured; thereby guaranteeing the efficiency of task execution and the timeliness of monitoring statistics.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flow chart of a method for monitoring task traffic of a power transaction bus according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of a method for monitoring task traffic of a power transaction bus according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating a method for monitoring task traffic of a power transaction bus according to an embodiment of the present invention;
fig. 4 is a flowchart illustrating a method for monitoring task traffic of a power transaction bus according to an embodiment of the present invention;
fig. 5 is a flowchart illustrating a method for monitoring task traffic of a power transaction bus according to an embodiment of the present invention;
fig. 6 is a flowchart illustrating a method for monitoring task traffic of a power transaction bus according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of an interceptor assembly according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of an interceptor assembly according to another embodiment of the present invention;
fig. 9 is a schematic diagram illustrating a power transaction bus task flow monitoring apparatus according to an embodiment of the present invention;
fig. 10 is a schematic diagram illustrating a power transaction bus task flow monitoring apparatus according to another embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more clear, specific embodiments of the technical solutions of the present invention will be described in more detail and clearly with reference to the accompanying drawings and the embodiments. However, the specific embodiments and examples described below are for illustrative purposes only and are not limiting of the invention. It is intended that the present invention cover only some embodiments of the invention and not all embodiments of the invention, and that other embodiments obtained by various modifications of the invention by those skilled in the art are intended to be within the scope of the invention.
Fig. 1 is a flowchart illustrating a method for monitoring task traffic of a power transaction bus according to an embodiment of the present invention, including the following steps.
In step S110, the interceptor receives the task and the effective address of the task sent from the task delivery machine.
The task delivery machine is a unified task access system of the electric power transaction platform. The task request sent to the platform by the task system of the electric power transaction needs to be subjected to authority verification, request filtering and task forwarding through a task delivery machine, and the task delivery machine is used as a post office for task post delivery. And the task delivery machine receives a task sent by the task system, wherein the task comprises a task requester, a target task executor and task parameters. And the task delivery machine acquires the address mapping relation and caches the address mapping relation locally, receives an external task request, analyzes the authority information of the message header and carries out quick verification, and if no authority exists, returns error information. And acquiring the address forwarding request of the available task executor according to the task destination information.
The task is an electric power transaction task, and the service types of the task instance include but are not limited to a main data reading and writing and filing task of a market main body, a reporting data reading and writing and filing task, a transaction result data reading and writing and filing task, a metering data reading and writing task, a settlement result reading and writing and filing task, an analysis statistical result reading and writing and filing service, a data processing calculation and statistical task and a data mirror image service task.
The interceptor is an exit filtering module of the task delivery machine for sending the tasks. The method can be internally or externally arranged and processes the effective task request. The interceptors can be set as total interceptors, and can also be classified according to service types. For example, in this embodiment the interceptor may be set to a delivery interceptor or a return receipt interceptor depending on whether a task or a return receipt is intercepted. The interceptor classification setting facilitates traffic offloading. And after receiving the task and the effective address of the task sent by the task delivery machine, the interceptor monitors the data flow.
In step S120, the task is data volume weighed.
The interceptor only weighs the data amount of the task and calculates the data amount length of the task content without analyzing, disassembling and assembling the task.
In step S130, the interceptor sends the task to the task executor corresponding to the effective address.
Each task executor is a service process which can realize independent operation and deployment of reading and writing of certain electric power transaction data, a task is sent to the task executor, and the task executor executes the task.
In step S140, a task receipt from the task executor is received.
Each task executor is a service process which can realize independent operation and deployment of reading and writing of certain electric power transaction data. And the target task executor receives the task, processes the task, generates a task receipt after processing, and sends the task receipt to the interceptor. The interceptor is an entrance filtering module for the task delivery machine to receive the receipt response, and monitors the data flow after receiving the task receipt sent by the task delivery machine.
In step S150, the task receipt is weighed for data volume.
The interceptor only carries out data quantity weighing on the task receipt, calculates the data quantity length of the task content, and does not carry out analysis, disassembly and assembly tasks.
In step S160, the interceptor sends the task receipt to the task delivery machine.
The task executor replies the distributed task execution condition, the interceptor performs data quantity weighing on the task receipt and then sends the task receipt to the task delivery machine, and the task delivery machine forwards the content of the task receipt to the client system according to the source address information carried by the request.
The inventor of the invention finds that the conventional task flow statistical monitoring mode generally acquires and calculates corresponding parameters in a task executor and finally unifies the parameters to a data set for storage, so that the task executor needs to occupy a part of resources to perform statistical tasks, thereby influencing the full-time task execution efficiency. Meanwhile, the method is difficult to ensure the time window synchronism of the resource statistics of each executor.
In the scheme provided by the embodiment, the data volume is weighed by the interceptor when the task or the task receipt is forwarded, and in addition, the statistical processing is performed, so that the statistical task is separated from the task executor, the decoupling of the statistical monitoring and the task executor is realized, and the task circulation and processing efficiency is ensured.
Fig. 2 is a flowchart illustrating a method for monitoring task traffic of a power transaction bus according to an embodiment of the present invention, including the following steps.
In step 201, a task delivery machine receives a task delivered by a task system.
The task delivery machine is responsible for accessing a platform client request, verifying the request, filtering the request and forwarding the task. The task delivery machine is provided with an address list, a task forwarding rule and an initialization interceptor, and is initially registered to the address list service.
In step 202, the destination task executor information of the task is parsed.
The task delivery machine analyzes the received task and obtains various parameters of the task delivery machine, including information of a task requester, task executor executed by the target task and task parameters.
In step 203, the effective address of the destination task executor is retrieved from the address directory.
The address book is a service system for address management and task registration of internal task executors and task delivery machines in the electric power trading platform, all the trading task executors need to be accessed into the electric power trading platform through the address book to provide services, and the system can improve the management capability and the expansion capability of platform services. The address book is responsible for providing registration management services of the task delivery machine and the task executors, and after the task delivery machine and each task executor service instance of each server are started, the task delivery machine and each task executor service instance are registered in the address book, so that the information of all available task delivery machines and task executor instances can be stored in a service address mapping table of the address book.
The initialization and maintenance process of the address book comprises the following steps: and the address book starts an initialized address mapping relation table and starts a service monitoring port. The address book client, such as a task delivery machine and a task executor, configures the address book after starting and provides service information for the address book client when establishing connection. After the address book is accessed into the connection request, the address mapping table is compared with the accessed service information, overdue invalid address information is eliminated, the address mapping table is updated, and the latest address mapping information is returned to the accessed client side for caching. And the address book opens an address query interface, and the access client periodically queries the address book and updates the cached address mapping table. After receiving the task request, the task delivery machine firstly inquires locally, and if the task request fails, the task delivery machine initiates the address inquiry of the task executor to the address list.
And after receiving the task, the task delivery machine retrieves the address list to obtain the effective address of the target task executor of the task.
In step 204, the task delivery machine sends the task and the effective address of the task to the interceptor.
In step S210, the interceptor receives the task and the effective address of the task sent from the task delivery machine.
In step S220, the task is data volume weighed.
In step S230, the task is sent to the task executor corresponding to the effective address.
In step S240, a task receipt from the task executor is received.
In step S250, the task receipt is data volume weighed.
In step S260, the task receipt is sent to the task delivery machine.
The task delivery machine, the address book and the task executor instance can be deployed on the same server or different servers. The service listening ports of each component cannot be the same, but the task executor can share the same port for access when deployed in the same server.
And the task delivery machine acquires the address mapping relation and caches the address mapping relation locally, receives an external task request, analyzes the authority information of the message header and carries out quick verification, and if no authority exists, returns error information. According to the task destination information, an address forwarding request of an available task executor is obtained, the interceptor calculates the data size length of a task content message body, and sends a flow packet to a message pipeline in real time. And the task delivery machine receives the forwarded task request receipt, calculates the length of the task content message body in the interceptor, and sends a flow packet to the message pipeline in real time. And the task delivery machine forwards the task receipt content to the client system according to the source address information carried by the request.
In this embodiment, steps S210, S220, S230, S240, S250, and S260 are the same as steps S110, S120, S130, S140, S150, and S160 in the above embodiment, and are not repeated.
In the solution provided by this embodiment, the task delivery machine matches the task with the target task executor by retrieving the address book, confirms the permission of task transfer and processing, and improves the efficiency.
Fig. 3 is a flowchart illustrating a method for monitoring task traffic of a power transaction bus according to an embodiment of the present invention, including the following steps.
In step S310, the interceptor receives the task and the effective address of the task sent from the task delivery machine.
In step S321, the interceptor obtains a task traffic data packet by weighing the data amount of the task.
The interceptor only weighs the data amount of the task and calculates the data amount length of the task content without analyzing, disassembling and assembling the task. And the interceptor simply packages the acquired flow data to obtain a task flow data packet.
In step S322, the task traffic packet is transmitted to the monitoring calculator.
In this embodiment, the interceptor issues the task traffic data packet to a message pipe, and the monitoring calculator receives the task traffic data packet through an asynchronous message queue that monitors the message pipe.
In step S323, the monitoring calculator analyzes the received traffic packet to obtain a traffic calculation result.
The monitoring calculator receives the flow data packet at the transmission end of the message pipeline, analyzes the flow data packet and calculates the service to obtain the flow calculation result.
In step S330, the task is sent to the task executor corresponding to the effective address.
In step S340, a task receipt from the task executor is received.
In step S350, the task receipt is data volume weighed.
In step S360, the task receipt is sent to the task delivery machine.
In this embodiment, steps S310, S330, S340, S350, and S360 are the same as steps S110, S130, S140, S150, and S160 in the above embodiment, and are not repeated.
In the scheme provided by the embodiment, the interceptor only weighs the data amount when the task is forwarded, so that the delay of delivery forwarding is hardly influenced in the process of intercepting processing.
Fig. 4 is a flowchart illustrating a method for monitoring task traffic of a power transaction bus according to an embodiment of the present invention, including the following steps.
In step S410, the interceptor receives the task and the effective address of the task sent from the task delivery machine.
In step S420, the task is data volume weighed.
In step S430, the task is sent to the task executor corresponding to the effective address.
In step S440, a task receipt is received from the task executor.
In step S451, the interceptor performs data amount weighing on the task receipt to obtain a receipt flow data packet.
And the task executor generates a task return receipt after executing the task, and sends the task return receipt to the task delivery machine through the interceptor. And the interceptor receives the task receipt, performs data quantity weighing on the task receipt, and calculates the data quantity length of the task receipt without analyzing, disassembling and assembling tasks. And the interceptor simply packages the acquired flow data to obtain a receipt flow data packet.
In step S452, the response piece traffic packet is transmitted to the monitoring calculator.
In this embodiment, the interceptor issues the receipt traffic data packet to a message pipe, and the monitoring calculator receives the receipt traffic data packet through an asynchronous message queue that monitors the message pipe.
In step S453, the monitoring calculator analyzes the received traffic packet to obtain a traffic calculation result.
The monitoring calculator receives the flow data packet at the transmission end of the message pipeline, analyzes the flow data packet and calculates the service to obtain the flow calculation result.
In step S460, the task receipt is sent to the task delivery machine.
In this embodiment, steps S410, S420, S430, S440, and S460 are the same as steps S110, S120, S130, S140, and S160 in the above embodiment, and are not repeated.
In the scheme provided by the embodiment, the interceptor only weighs the data amount when the task receipt is forwarded, so that the delay of delivery forwarding is hardly influenced in the process of intercepting processing.
Fig. 5 is a flowchart illustrating a method for monitoring task traffic of a power transaction bus according to an embodiment of the present invention, including the following steps.
In step S510, the interceptor receives the task and the effective address of the task sent from the task delivery machine.
In step S521, the interceptor obtains a task traffic data packet by weighing the data amount of the task.
In step S522, the task traffic packet is transmitted to the monitoring calculator.
In this embodiment, the interceptor issues the task traffic data packet to a message pipe, and the monitoring calculator receives the task traffic data packet through an asynchronous message queue that monitors the message pipe.
In step S5231, the monitoring calculator parses the received traffic packet.
The monitoring calculator is used as a service system for receiving, arranging, processing and storing the flow, after the monitoring calculator is started, a thread for monitoring the message pipeline is initialized, the thread is used for monitoring the flow data packet in the message pipeline in real time, and meanwhile, a cache synchronization timing task is started to synchronize and update the flow data cache maintained in the monitoring calculator. And receiving the flow packets at the transmission end of the message pipeline, analyzing, unpacking and filtering the flow packets into task flow data packets or task receipt flow data packets.
In step S5232, it is determined whether the traffic packet is a task traffic packet or a receipt traffic packet.
In step S5233, the traffic data packet is calculated to obtain a traffic calculation result.
And the monitoring calculator performs service calculation on the flow data packet. Preferably, the computation can be placed in a cache for computation, thereby improving computation efficiency, but not limited thereto.
In step S5234, the flow calculation results are stored to a data warehouse.
The monitoring calculator searches the task in a task flow list in the data warehouse, updates data of the corresponding task in the data warehouse according to the flow calculation result, and persists the flow calculation result to the data warehouse for storage.
In step S530, the task is sent to the task executor corresponding to the effective address.
In step S540, a task receipt from the task executor is received.
In step S550, the task receipt is weighed for data amount.
In step S560, the task receipt is sent to the task delivery machine.
In this embodiment, steps S510, S530, S540, S550, and S560 are the same as steps S110, S130, S140, S150, and S160 in the above embodiment, and are not repeated.
In the scheme provided by the embodiment, the monitoring calculator processes the task traffic, so that the real-time monitoring and data traffic statistics are ensured, the timeliness of monitoring statistics is guaranteed, the efficiency of task circulation and processing is not influenced, and the access usability and flexibility of the task executor of the electric power transaction platform are improved.
Fig. 6 is a flowchart illustrating a method for monitoring task traffic of a power transaction bus according to an embodiment of the present invention, including the following steps.
In step S610, the interceptor receives the task and the effective address of the task sent from the task delivery machine.
In step S621, the interceptor obtains a task traffic data packet by weighing the data amount of the task.
In step S622, the interceptor transmits the task traffic data packet to the monitoring calculator.
In step S6231, the monitoring calculator analyzes the received traffic packet.
In step S6232, it is determined whether the traffic packet is a task traffic packet or a receipt traffic packet.
In step S6233, the traffic data packet is calculated to obtain a traffic calculation result.
In step S62341, the task is found in the task traffic list in the data warehouse.
The monitoring calculator searches the task in a task flow list in the data warehouse, updates data of the corresponding task in the data warehouse according to the flow calculation result, and persists the flow calculation result to the data warehouse for storage.
In step S62342, the real-time traffic data of the real-time queue in the traffic calculation result is stored in the data warehouse according to the timing sampling frequency.
In this embodiment, the real-time queue is built in the monitoring calculator, the traffic data is updated according to the date, the real-time traffic data judges whether the timestamp information in the real-time traffic is the current date data, and if not, the corresponding invalid data in the cache and the database is cleared. And if so, storing the real-time flow data of the real-time queue in the flow calculation result into a data warehouse. The monitor computer's cache synchronization holds data to facilitate computation.
In step S62343, the historical flow data of the historical queue in the flow calculation result is stored in the data warehouse according to the historical sampling frequency timing.
In this embodiment, the history queue is built in the monitoring calculator, and the historical traffic data in the data warehouse is updated periodically. Preferably, the cache portion of the monitoring calculator also holds data synchronously to facilitate the computation.
In step S630, the task is sent to the task executor corresponding to the effective address.
In step S640, a task receipt from the task executor is received.
In step S650, the task receipt is data volume weighed.
In step S660, the task receipt is sent to the task delivery machine.
In this embodiment, steps S610, S630, S640, S650, and S660 are the same as steps S110, S130, S140, S150, and S160 in the above embodiment, and are not repeated.
Fig. 7 is a block diagram of an interceptor according to an embodiment of the present invention. The interceptor receives the task and the effective address of the task sent by the task delivery machine, weighs the data volume of the task, and sends the task to the task executor corresponding to the effective address. The interceptor also receives the task receipt from the task executor, weighs the data amount of the task receipt and sends the task receipt to the task delivery machine. In a specific implementation process, the interceptor may be implemented by hardware or software, and is not particularly limited.
Fig. 8 is a block diagram of an interceptor 1 according to an embodiment of the present invention, which includes a delivery interceptor 11 and a response piece interceptor 12.
The delivery interceptor 11 receives the task sent by the task delivery machine and the effective address of the task, performs data volume weighing on the task to obtain a task flow data packet, and transmits the task flow data packet to the monitoring calculator; and sending the task to a task executor corresponding to the effective address. The receipt interceptor 12 receives the task receipt from the task executor, performs data weighing on the task receipt to obtain a receipt flow data packet, and transmits the receipt flow data packet to the monitoring calculator; and sending the task return receipt to the task delivery machine.
Fig. 9 is a device for monitoring task traffic of a power transaction bus according to an embodiment of the present invention, which includes an interceptor 21 and a monitoring calculator 22.
The interceptor 21 receives the task and the effective address of the task sent by the task delivery machine, performs data volume weighing on the task to obtain a task data traffic packet, sends the task data traffic packet to the monitoring calculator 22, and sends the task to a task executor corresponding to the effective address; the interceptor 21 also receives the task receipt from the task executor, performs data weighing on the task receipt to obtain a receipt data flow packet, sends the receipt data flow packet to the monitoring calculator 22, and sends the task receipt to the task delivery machine. The monitoring calculator 22 receives the traffic data packet from the interceptor 21, performs analytic calculation on the traffic data packet to obtain a traffic calculation result, and stores the calculation result in the data warehouse.
Fig. 10 is a power transaction bus task flow monitoring device according to another embodiment of the present invention, which includes an interceptor 31 and a monitoring calculator 32, where the interceptor 31 includes a delivery interceptor 311 and a response piece interceptor 312.
The delivery interceptor 311 receives the task sent by the task delivery machine and the effective address of the task, performs data volume weighing on the task to obtain a task data traffic packet to obtain a task traffic data packet, and sends the task traffic data packet to the monitoring calculator 32 to send the task to the task executor corresponding to the effective address. The receipt interceptor 312 receives the task receipt from the task executor, performs data weighing on the task receipt to obtain a receipt data traffic packet, sends the receipt data traffic packet to the monitoring calculator 32, and sends the task receipt to the task delivery machine. The monitoring calculator 32 receives the traffic data packet from the interceptor 31, performs analytic calculation on the traffic data packet to obtain a traffic calculation result, and stores the calculation result in the data warehouse. In the implementation process, the apparatuses for implementing these methods may take any of various forms, and specifically, the interceptor 31 and the monitoring calculator 32 may be implemented by hardware, software, or a combination of hardware and software, and are not limited in particular.
It should be noted that the above-mentioned embodiments described with reference to the drawings are only intended to illustrate the present invention and not to limit the scope of the present invention, and it should be understood by those skilled in the art that modifications and equivalent substitutions can be made without departing from the spirit and scope of the present invention. Furthermore, unless the context indicates otherwise, words that appear in the singular include the plural and vice versa. Additionally, all or a portion of any embodiment may be utilized with all or a portion of any other embodiment, unless stated otherwise.

Claims (10)

1. A power transaction bus task flow monitoring method comprises the following steps:
the method comprises the steps that an interceptor receives a task sent by a task delivery machine and an effective address of the task;
weighing the data amount of the task;
sending the task to a task executor corresponding to the effective address;
receiving a task receipt from the task executor;
weighing the data quantity of the task receipt;
and sending the task receipt to the task delivery machine.
2. The method of claim 1, wherein before the interceptor receives the task sent by the task delivery machine and the effective address information of the task, the method further comprises:
the task delivery machine receives tasks delivered by the task system;
analyzing the target task executor information of the task;
searching the effective address of the target task executor in an address list;
and sending the task and the effective address of the task to the interceptor.
3. The method of claim 1, wherein said weighing the task by a data amount comprises:
the interceptor obtains a task flow data packet by weighing the data volume of the task;
transmitting the task traffic data packet to a monitoring calculator;
the monitoring calculator analyzes the received flow data packet to obtain a flow calculation result.
4. The method of claim 1, wherein said weighing the task receipt by a data amount comprises:
the interceptor carries out data quantity weighing on the task receipt to obtain a receipt flow data packet;
transmitting the receipt traffic data packet to a monitoring calculator;
the monitoring calculator analyzes the received flow data packet to obtain a flow calculation result.
5. The method of any one of claims 3 or 4, wherein the parsing the received traffic data packet by the monitoring calculator to obtain a traffic calculation result comprises:
the monitoring calculator analyzes the received flow data packet;
determining whether the traffic data packet is a task traffic data packet or a receipt traffic data packet;
calculating the flow data packet to obtain a flow calculation result;
and storing the flow calculation result to a data warehouse.
6. The method of claim 5, wherein the storing the flow calculations to a data repository comprises:
finding the task in a task traffic list in the data warehouse;
according to the real-time sampling frequency, regularly storing the real-time flow data of the real-time queue in the flow calculation result into a data warehouse;
and storing historical flow data of the historical queue in the flow calculation result to a data warehouse at regular time according to the historical sampling frequency.
7. An interceptor receives a task sent by a task delivery machine and an effective address of the task, performs data volume weighing on the task, and sends the task to a task executor corresponding to the effective address;
the interceptor also receives the task receipt from the task executor, performs data weighing on the task receipt, and sends the task receipt to the task delivery machine.
8. The interceptor of claim 7, comprising:
the delivery interceptor is used for receiving the task sent by the task delivery machine and the effective address of the task, weighing the data volume of the task to obtain a task flow data packet, and transmitting the task flow data packet to the monitoring calculator; sending the task to a task executor corresponding to the effective address;
the receipt interceptor is used for receiving the task receipt from the task executor, weighing the data quantity of the task receipt to obtain a receipt flow data packet and transmitting the receipt flow data packet to the monitoring calculator; and sending the task receipt to the task delivery machine.
9. An electric power transaction bus task flow monitoring device, comprising:
the interceptor is used for receiving the task sent by the task delivery machine and the effective address of the task, weighing the data volume of the task to obtain a task data traffic packet, sending the task data traffic packet to the monitoring calculator and sending the task to the task executor corresponding to the effective address; the interceptor also receives a task receipt from the task executor, performs data quantity weighing on the task receipt to obtain a receipt data flow packet, sends the receipt data flow packet to the monitoring calculator, and sends the task receipt to the task delivery machine;
and the monitoring calculator receives the flow data packet from the interceptor, analyzes and calculates the flow data packet to obtain a flow calculation result, and stores the calculation result to the data warehouse.
10. The apparatus of claim 9, wherein the interceptor comprises:
the delivery interceptor is used for receiving the tasks sent by the task delivery machine and the effective addresses of the tasks; weighing the data quantity of the task to obtain a task flow data packet, and transmitting the task flow data packet to a monitoring calculator; sending the task to a task executor corresponding to the effective address;
the receipt interceptor receives the task receipt from the task executor; weighing the data quantity of the task receipt to obtain a receipt flow data packet, and transmitting the receipt flow data packet to the monitoring calculator; and sending the task receipt to the task delivery machine.
CN201810861813.8A 2018-08-01 2018-08-01 Method and device for monitoring task flow of power transaction bus and interceptor Active CN109242244B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810861813.8A CN109242244B (en) 2018-08-01 2018-08-01 Method and device for monitoring task flow of power transaction bus and interceptor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810861813.8A CN109242244B (en) 2018-08-01 2018-08-01 Method and device for monitoring task flow of power transaction bus and interceptor

Publications (2)

Publication Number Publication Date
CN109242244A CN109242244A (en) 2019-01-18
CN109242244B true CN109242244B (en) 2021-11-12

Family

ID=65073391

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810861813.8A Active CN109242244B (en) 2018-08-01 2018-08-01 Method and device for monitoring task flow of power transaction bus and interceptor

Country Status (1)

Country Link
CN (1) CN109242244B (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107632894A (en) * 2017-08-09 2018-01-26 中国电力科学研究院 A kind of implementation method and device for power market transaction service call

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8259588B2 (en) * 2009-06-24 2012-09-04 Oracle International Corporation System and method for processing communications using service interceptors
CN103577468B (en) * 2012-08-03 2018-10-23 中国银联股份有限公司 A kind of flow controller and flow control methods suitable for OLTP systems
CN112231606B (en) * 2015-10-14 2024-03-12 创新先进技术有限公司 Webpage processing method and device
CN105761109A (en) * 2016-02-19 2016-07-13 刘隽琦 Smart management system for energy management and electricity transaction in virtual power plant and method for optimizing operation thereof
CN106647437B (en) * 2016-09-30 2024-04-16 衡水益通管业股份有限公司 Pipe gallery signal acquisition node execution controller based on Internet and monitoring method thereof
CN106301971B (en) * 2016-11-17 2019-12-10 国家电网公司 electric power application performance monitoring system based on flow analysis
CN108121312B (en) * 2017-11-29 2020-10-30 南瑞集团有限公司 ARV load balancing system and method based on integrated hydropower management and control platform

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107632894A (en) * 2017-08-09 2018-01-26 中国电力科学研究院 A kind of implementation method and device for power market transaction service call

Also Published As

Publication number Publication date
CN109242244A (en) 2019-01-18

Similar Documents

Publication Publication Date Title
EP2263163B1 (en) Content management
US6990526B1 (en) Method and apparatus for web caching
CN112714192B (en) Data synchronization method and device, computer readable medium and electronic equipment
CN109639754B (en) Method for realizing data audit of power grid dispatching service gateway
US20030220998A1 (en) Server site restructuring
CN110275983A (en) The search method and device of traffic monitoring data
CN101841577A (en) Method and device for implementing domain name resolution agent function
CN108881516B (en) Method and device for scheduling multi-CDN service system
EP1867137A1 (en) Method and apparatus for efficiently expanding a p2p network
CN113452808B (en) Domain name resolution method, device, equipment and storage medium
CN108989390A (en) User requests retransmission method and device, Reverse Proxy and computer readable storage medium
CN111371585A (en) Configuration method and device for CDN node
CN112583895A (en) TCP communication method, system and device
CN111212301B (en) Video code rate matching method, storage medium and terminal equipment
CN113364887B (en) File downloading method based on FTP, proxy server and system
CN109242244B (en) Method and device for monitoring task flow of power transaction bus and interceptor
US20060059251A1 (en) Method and system for request management processing
CN102023997B (en) Data query system, construction method thereof and corresponding data query method
CN114490100A (en) Message queue telemetry transmission load balancing method and device and server
CN115883659B (en) Method and device for supporting batch refreshing of CDN caches
JP2006301769A (en) Server device
KR100475668B1 (en) Apparatus and method of providing information for grid resources in grid network and computer readable recording medium of recording process thereof
US9158732B2 (en) Distributed cache system for delivering contents to display apparatus
JPH10105481A (en) Method for mediating service and its device
CN105577743A (en) Apparatus and method for managing devices

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant