CN117421107B - Monitoring platform scheduling method, monitoring platform scheduling system, readable storage medium and computer - Google Patents
Monitoring platform scheduling method, monitoring platform scheduling system, readable storage medium and computer Download PDFInfo
- Publication number
- CN117421107B CN117421107B CN202311714923.9A CN202311714923A CN117421107B CN 117421107 B CN117421107 B CN 117421107B CN 202311714923 A CN202311714923 A CN 202311714923A CN 117421107 B CN117421107 B CN 117421107B
- Authority
- CN
- China
- Prior art keywords
- task
- platform
- strategy
- scheduling
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 72
- 238000000034 method Methods 0.000 title claims abstract description 33
- 238000012795 verification Methods 0.000 claims abstract description 27
- 238000004458 analytical method Methods 0.000 claims abstract description 6
- 238000012545 processing Methods 0.000 claims description 26
- 238000004590 computer program Methods 0.000 claims description 9
- 238000012216 screening Methods 0.000 claims description 8
- 238000013507 mapping Methods 0.000 claims description 7
- 238000011156 evaluation Methods 0.000 claims description 6
- 238000010276 construction Methods 0.000 claims description 4
- 230000006870 function Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000003915 air pollution Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/211—Schema design and management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a monitoring platform scheduling method, a monitoring platform scheduling system, a readable storage medium and a computer, wherein the monitoring platform scheduling method comprises the following steps: invoking an acquisition strategy in a strategy library based on a task identifier of a scheduling task created by a target user; analyzing the time sequence of the scheduling task by using a time sequence database to obtain a time sequence table; analyzing task demands of the scheduled tasks, and searching a plurality of task platforms according to the task demands and the acquisition strategies; constructing connection with each task platform, and issuing a sequence verification request to each task platform according to a time sequence table of the scheduled task; and when receiving the verification passing signal, classifying each task platform according to the acquisition strategy to obtain a target platform, and calling platform data of the target platform based on the acquisition strategy. According to the method, the platform data of the target platform are called based on the collection strategy, and the target platform is quickly found by means of task analysis and platform verification, so that accurate collection of the data is realized, and the number of invalid data is reduced.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a monitoring platform scheduling method, a monitoring platform scheduling system, a readable storage medium, and a computer.
Background
Along with the rapid development of science and technology and the improvement of living standard of people, ecological construction requirements are continuously improved, and the number of various monitoring platforms is gradually increased, so that the method is particularly important for data management of the monitoring platforms.
At present, for the management of the monitoring platforms, the configuration is issued to all the monitoring platforms at one time, and the issued configuration is identified through all the monitoring platforms, so that the corresponding monitoring platforms upload data according to the configuration, however, when the configuration is modified each time, the configuration creation needs to be carried out again, so that automatic change cannot be carried out according to actual conditions, and the configuration is issued to all the monitoring platforms, so that all the monitoring platforms need to carry out configuration identification, thereby causing insufficient accurate data acquisition and more invalid data.
Disclosure of Invention
Based on this, an object of the present invention is to provide a monitoring platform scheduling method, system, readable storage medium and computer, so as to at least solve the above-mentioned drawbacks.
The invention provides a monitoring platform scheduling method, which comprises the following steps:
acquiring a scheduling task created by a target user, and calling a corresponding acquisition strategy in a preset strategy library based on a task identifier of the scheduling task;
creating a time sequence database, and analyzing the time sequence of the scheduling task by using the time sequence database to obtain a time sequence table of the scheduling task, wherein the step of creating the time sequence database comprises the following steps:
acquiring corresponding network index data based on the task identification of the scheduling task, and acquiring platform index data associated with the task identification in each task platform;
performing attention evaluation on each task platform based on the platform index data to obtain an attention sequence table of each task platform;
constructing a mapping relation between the network index data and the attention sequence table on a calibrated time axis to obtain a corresponding data sequence table, and constructing a time sequence database according to the data sequence table;
analyzing task demands of the scheduling task, and searching a plurality of task platforms according to the task demands and the acquisition strategy;
establishing connection with each task platform, and issuing a sequence verification request to each task platform according to the time sequence list of the scheduling task;
and when receiving the verification passing signal, classifying each task platform according to the acquisition strategy to obtain a corresponding target platform, and calling platform data of the target platform based on the acquisition strategy.
Further, the step of classifying each task platform according to the collection policy to obtain a corresponding target platform includes:
analyzing a strategy type of the acquisition strategy, wherein the strategy type comprises a passive monitoring strategy and an active issuing strategy;
when the strategy type is a passive monitoring strategy, reading operation servers of all task platforms, and screening out task platforms, the operation servers of which accord with the passive monitoring strategy, as target platforms;
when the strategy type is an active issuing strategy, the operation parameters of each task platform and the acquisition threshold value of the scheduling task are read, the acquisition interval corresponding to each task platform is defined according to the operation parameters, and the target platform is determined in each task platform according to the acquisition threshold value and the acquisition interval.
Further, after the step of analyzing the policy type of the collection policy, the method further includes:
when the strategy type is a passive monitoring strategy and an active issuing strategy, calculating the resource consumption rate of the scheduling task;
and distributing each task platform according to the resource consumption rate so as to obtain the target platform of the scheduling task.
The invention also provides a monitoring platform dispatching system, which comprises:
the task acquisition module is used for acquiring a scheduling task created by a target user and calling a corresponding acquisition strategy in a preset strategy library based on a task identifier of the scheduling task;
the database creation module is configured to create a time sequence database, and parse the time sequence of the scheduled task by using the time sequence database to obtain a time sequence table of the scheduled task, where the database creation module includes:
the data acquisition unit is used for acquiring corresponding network index data based on the task identification of the scheduling task and acquiring platform index data associated with the task identification in each task platform;
the attention evaluation unit is used for evaluating the attention of each task platform based on the platform index data so as to obtain an attention sequence table of each task platform;
the database construction unit is used for constructing a mapping relation between the network index data and the attention degree sequence table on a calibrated time axis to obtain a corresponding data sequence table, and constructing a time sequence database according to the data sequence table;
the demand processing module is used for analyzing the task demands of the dispatching task and searching a plurality of task platforms according to the task demands and the acquisition strategy;
the verification request module is used for constructing connection with each task platform and issuing a sequence verification request to each task platform according to the time sequence table of the scheduling task;
and the platform scheduling module is used for classifying each task platform according to the acquisition strategy when receiving the verification passing signal so as to obtain a corresponding target platform and calling the platform data of the target platform based on the acquisition strategy.
Further, the platform scheduling module includes:
the strategy analysis unit is used for analyzing the strategy type of the acquisition strategy, wherein the strategy type comprises a passive monitoring strategy and an active issuing strategy;
the first processing unit is used for reading the operation server of each task platform when the strategy type is a passive monitoring strategy, and screening out the task platform of which the operation server accords with the passive monitoring strategy as a target platform;
and the second processing unit is used for reading the operation parameters of the task platforms and the acquisition threshold values of the dispatching tasks when the strategy type is an active issuing strategy, defining the acquisition intervals corresponding to the task platforms according to the operation parameters, and determining target platforms in the task platforms according to the acquisition threshold values and the acquisition intervals.
Further, the platform scheduling module further includes:
the third processing unit is used for calculating the resource consumption rate of the scheduling task when the strategy type is a passive monitoring strategy and an active issuing strategy;
and the fourth processing unit is used for distributing the task platforms according to the resource consumption rate so as to obtain the target platform of the scheduling task.
The invention also provides a readable storage medium, on which a computer program is stored, which when executed by a processor implements the above-mentioned monitoring platform scheduling method.
The invention also provides a computer, which comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor realizes the monitoring platform scheduling method when executing the computer program.
According to the monitoring platform scheduling method, the system, the readable storage medium and the computer, the scheduling task is analyzed through the time sequence database, so that the scheduling task can accurately determine the target platform, the task requirement of the scheduling task and the corresponding acquisition strategy are analyzed, the task platform is subjected to sequence verification, the accurate issuing of the scheduling task is improved through the sequence verification, the platform data of the target platform is called based on the acquisition strategy, the target platform is quickly found through the task analysis and the platform verification, the accurate acquisition of the data is realized, and the quantity of invalid data is reduced.
Drawings
FIG. 1 is a flowchart of a monitoring platform scheduling method according to a first embodiment of the present invention;
FIG. 2 is a detailed flowchart of step S102 in FIG. 1;
FIG. 3 is a detailed flowchart of step S105 in FIG. 1;
FIG. 4 is a block diagram illustrating a second embodiment of a monitoring platform scheduling system according to the present invention;
fig. 5 is a block diagram showing a structure of a computer according to a third embodiment of the present invention.
The invention will be further described in the following detailed description in conjunction with the above-described figures.
Detailed Description
In order that the invention may be readily understood, a more complete description of the invention will be rendered by reference to the appended drawings. Several embodiments of the invention are presented in the figures. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The term "and/or" as used herein includes any and all combinations of one or more of the associated listed items.
Example 1
Referring to fig. 1, a monitoring platform scheduling method according to a first embodiment of the present invention is shown, and the method specifically includes steps S101 to S105:
s101, acquiring a scheduling task created by a target user, and calling a corresponding acquisition strategy in a preset strategy library based on a task identifier of the scheduling task;
in a specific implementation, when a user needs to schedule a certain type of monitoring platform, a corresponding scheduling task is uploaded through a terminal device, for example: when a user needs to call related data of the air pollution monitoring platform, a corresponding instruction is created, the corresponding instruction is issued to a cloud server (terminal server), and the corresponding instruction is transmitted to the related platform through the server, wherein the terminal equipment comprises, but is not limited to, equipment with communication functions such as a mobile phone, a tablet personal computer and a server;
in this embodiment, the task identifier of the scheduling task transmitted by the user is analyzed, the acquisition strategy is invoked in a pre-constructed strategy library based on the task identifier of the scheduling task, the acquisition strategies corresponding to the task identifiers of various scheduling tasks are stored in the strategy library, and the corresponding acquisition strategies can be obtained quickly through the task identifiers.
S102, creating a time sequence database, and analyzing the time sequence of the scheduling task by using the time sequence database to obtain a time sequence table of the scheduling task;
further, referring to fig. 2, the step S102 specifically includes steps S1021 to S1023:
s1021, acquiring corresponding network index data based on the task identification of the scheduling task, and acquiring platform index data associated with the task identification in each task platform;
s1022, performing attention evaluation on each task platform based on the platform index data to obtain an attention sequence table of each task platform;
s1023, constructing a mapping relation between the network index data and the attention sequence table on a calibrated time axis to obtain a corresponding data sequence table, and constructing a time sequence database according to the data sequence table.
In a specific implementation, the time sequence database is a database for storing, managing and querying each platform data and time sequence data and time-related index data, and because the monitoring platform needs to accurately manage and control time, in this embodiment, the corresponding network index data is obtained based on a task identifier of a scheduled task, where the network index data is a time sequence of the platform data or time-related data that needs to be scheduled by the scheduled task, and collects platform index data associated with the task identifier in each task platform that has created a connection, and the platform index data is a related index of a task that is used by the task platform to process the task identifier, for example: processing time, processing accuracy and the like, and the heat of a user using the task platform can be reflected through the platform index data, so that a attention degree sequence table of each task platform is obtained;
specifically, the obtained network index data and the attention sequence table are constructed into a mapping relation on a calibration time axis, wherein the calibration time axis is a time line in which the network index data and the attention sequence table are overlapped, and the obtained data sequence table and a preset database learner are optimally combined, so that a time sequence database is constructed.
Further, the time sequence database is utilized to analyze the time sequence of the scheduling task, so that a time sequence table of the scheduling task on a corresponding time line is obtained.
S103, analyzing task requirements of the scheduling task, and searching a plurality of task platforms according to the task requirements and the acquisition strategy;
in specific implementation, the task requirements of the scheduled task are analyzed, wherein the task requirements are task requirements that a target user needs to perform when creating the scheduled task, for example: and (3) invoking atmosphere monitoring data, invoking reservoir monitoring data and the like, and screening task platforms related to task requirements and acquisition strategies from various task platforms according to the task requirements and the acquisition strategies.
S104, constructing connection with each task platform, and issuing a sequence verification request to each task platform according to the time sequence table of the scheduling task;
when the method is implemented, after the corresponding task platform is obtained, interface calling instructions are issued to each task platform so as to construct connection with each task platform, sequence verification requests are issued to each task platform according to the time sequence table of the scheduling task, and task processing can be carried out by calling the corresponding task platform according to the calling task through verifying the time sequence table of the task platform and the scheduling task, so that invalid data redundancy caused by acquiring data of all the platforms is avoided.
S105, when receiving the verification passing signal, classifying each task platform according to the acquisition strategy to obtain a corresponding target platform, and calling platform data of the target platform based on the acquisition strategy.
Further, referring to fig. 3, the step S105 specifically includes steps S1051 to S1053:
s1051, analyzing the strategy type of the acquisition strategy, wherein the strategy type comprises a passive monitoring strategy and an active issuing strategy;
s1052, when the strategy type is a passive monitoring strategy, reading operation servers of all task platforms, and screening out task platforms, the operation servers of which accord with the passive monitoring strategy, as target platforms;
s1053, when the strategy type is an active issuing strategy, reading the operation parameters of each task platform and the acquisition threshold of the scheduling task, defining the acquisition interval corresponding to each task platform according to the operation parameters, and determining a target platform in each task platform according to the acquisition threshold and the acquisition interval.
When the task platform receives the verification request, the corresponding digital certificate is fed back, the validity of the data certificate is verified, a verification passing signal is transmitted after the validity of the data certificate passes, and at the moment, the strategy type of the acquisition strategy is analyzed, wherein the strategy type comprises a passive monitoring strategy and an active issuing strategy;
specifically, when the policy type is a passive monitoring policy, reading an operation server of each task platform, and screening out the task platform of which the operation server accords with the passive monitoring policy as a target platform; when the strategy type is an active issuing strategy, reading the operation parameters of each task platform and the acquisition threshold value of the dispatching task, defining the acquisition interval corresponding to each task platform according to the operation parameters, determining a target platform in each task platform by using the acquisition threshold value and the acquisition interval, wherein the operation parameters of each task platform are the acquisition granularity of the platform, the acquisition threshold value is the minimum value of the acquisition granularity required by the dispatching task, and taking the task platform with the acquisition interval larger than or equal to the acquisition threshold value as the target platform; the acquisition granularity is the detail degree of the acquired information, and the detail degree of the acquired information is determined by the acquisition granularity, so that the integrity and the accuracy of the information are affected, and when the acquisition granularity is smaller than an acquisition threshold value, the phenomenon that the information acquired by the task platform is incomplete or missing exists is indicated.
In some alternative embodiments, after step S1052, the method further comprises:
when the strategy type is a passive monitoring strategy and an active issuing strategy, calculating the resource consumption rate of the scheduling task;
and distributing each task platform according to the resource consumption rate so as to obtain the target platform of the scheduling task.
When the policy type is a passive monitoring policy and an active issuing policy, counting the resource consumption rate of the scheduling task, wherein the resource consumption rate is the resource rate required to be consumed by the system for processing the scheduling task, counting the resource consumption data of each task platform, distributing the resource consumption data and the resource consumption rate of each task platform to the task platform, and taking the task platform with the resource consumption data smaller than the resource consumption rate as a target platform of the scheduling task; and calling the platform data of the target platform according to the acquired acquisition strategy, wherein the passive monitoring strategy is not influenced by the acquisition granularity.
In summary, according to the monitoring platform scheduling method in the embodiment of the invention, the scheduling task is analyzed through the time sequence database, so that the scheduling task can more accurately determine the target platform, the task requirement and the corresponding acquisition strategy of the scheduling task are analyzed, the task platform is subjected to sequence verification, the accurate issuing of the scheduling task is improved through the sequence verification, the platform data of the target platform is called based on the acquisition strategy, and the target platform is quickly found by utilizing the task analysis and the platform verification modes, so that the accurate acquisition of the data is realized, and the quantity of invalid data is reduced.
Example two
In another aspect, please refer to fig. 4, which shows a monitoring platform scheduling system according to a second embodiment of the present invention, where the system includes:
the task acquisition module 11 is used for acquiring a scheduling task created by a target user and calling a corresponding acquisition strategy in a preset strategy library based on a task identifier of the scheduling task;
the database creation module 12 is configured to create a time sequence database, and parse the time sequence of the scheduled task by using the time sequence database to obtain a time sequence table of the scheduled task;
further, the database creation module 12 includes:
the data acquisition unit is used for acquiring corresponding network index data based on the task identification of the scheduling task and acquiring platform index data associated with the task identification in each task platform;
the attention evaluation unit is used for evaluating the attention of each task platform based on the platform index data so as to obtain an attention sequence table of each task platform;
and the database construction unit is used for constructing a mapping relation between the network index data and the attention degree sequence table on a calibrated time axis to obtain a corresponding data sequence table, and constructing a time sequence database according to the data sequence table.
The demand processing module 13 is configured to analyze a task demand of the scheduled task, and find a plurality of task platforms according to the task demand and the acquisition strategy;
a verification request module 14, configured to construct a connection with each task platform, and issue a sequence verification request to each task platform according to the time sequence table of the scheduled task;
and the platform scheduling module 15 is used for classifying each task platform according to the acquisition strategy when receiving the verification passing signal so as to obtain a corresponding target platform, and calling the platform data of the target platform based on the acquisition strategy.
Further, the platform scheduling module 15 includes:
the strategy analysis unit is used for analyzing the strategy type of the acquisition strategy, wherein the strategy type comprises a passive monitoring strategy and an active issuing strategy;
the first processing unit is used for reading the operation server of each task platform when the strategy type is a passive monitoring strategy, and screening out the task platform of which the operation server accords with the passive monitoring strategy as a target platform;
and the second processing unit is used for reading the operation parameters of the task platforms and the acquisition threshold values of the dispatching tasks when the strategy type is an active issuing strategy, defining the acquisition intervals corresponding to the task platforms according to the operation parameters, and determining target platforms in the task platforms according to the acquisition threshold values and the acquisition intervals.
Further, the platform scheduling module 15 further includes:
the third processing unit is used for calculating the resource consumption rate of the scheduling task when the strategy type is a passive monitoring strategy and an active issuing strategy;
and the fourth processing unit is used for distributing the task platforms according to the resource consumption rate so as to obtain the target platform of the scheduling task.
The functions or operation steps implemented when the above modules and units are executed are substantially the same as those in the above method embodiments, and are not described herein again.
The implementation principle and the generated technical effects of the monitoring platform scheduling system provided by the embodiment of the invention are the same as those of the embodiment of the method, and for the sake of brief description, the corresponding contents in the embodiment of the method can be referred to for the parts of the embodiment of the system that are not mentioned.
Example III
The present invention also proposes a computer, please refer to fig. 5, which shows a computer according to a third embodiment of the present invention, including a memory 10, a processor 20, and a computer program 30 stored in the memory 10 and capable of running on the processor 20, wherein the processor 20 implements the above-mentioned monitoring platform scheduling method when executing the computer program 30.
The memory 10 includes at least one type of readable storage medium including flash memory, a hard disk, a multimedia card, a card memory (e.g., SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, etc. Memory 10 may in some embodiments be an internal storage unit of a computer, such as a hard disk of the computer. The memory 10 may also be an external storage device in other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card), etc. Further, the memory 10 may also include both internal storage units and external storage devices of the computer. The memory 10 may be used not only for storing application software installed in a computer and various types of data, but also for temporarily storing data that has been output or is to be output.
The processor 20 may be, in some embodiments, an electronic control unit (Electronic Control Unit, ECU), a central processing unit (Central Processing Unit, CPU), a controller, a microcontroller, a microprocessor, or other data processing chip, for executing program codes or processing data stored in the memory 10, such as executing an access restriction program, or the like.
It should be noted that the structure shown in fig. 5 is not limiting of the computer, and in other embodiments, the computer may include fewer or more components than shown, or may combine certain components, or may have a different arrangement of components.
The embodiment of the invention also provides a readable storage medium, on which a computer program is stored, which when executed by a processor, implements the monitoring platform scheduling method as described above.
Those of skill in the art will appreciate that the logic and/or steps represented in the flow diagrams or otherwise described herein, e.g., a ordered listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program is printed, as the program may be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
It is to be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
The technical features of the above-described embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above-described embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The above examples merely represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application is to be determined by the claims appended hereto.
Claims (8)
1. A monitoring platform scheduling method, comprising:
acquiring a scheduling task created by a target user, and calling a corresponding acquisition strategy in a preset strategy library based on a task identifier of the scheduling task;
creating a time sequence database, and analyzing the time sequence of the scheduling task by using the time sequence database to obtain a time sequence table of the scheduling task, wherein the step of creating the time sequence database comprises the following steps:
acquiring corresponding network index data based on the task identifier of the scheduled task, and acquiring platform index data associated with the task identifier in each task platform, wherein the network index data is a time sequence of platform data required to be scheduled by the scheduled task or data related to time, the platform index data is a related index of the task platform for processing the task identifier, and the heat of a user using the task platform can be reflected through the platform index data;
performing attention evaluation on each task platform based on the platform index data to obtain an attention sequence table of each task platform;
constructing a mapping relation between the network index data and the attention sequence table on a calibrated time axis to obtain a corresponding data sequence table, and constructing a time sequence database according to the data sequence table;
analyzing task demands of the scheduling task, and searching a plurality of task platforms according to the task demands and the acquisition strategy;
establishing connection with each task platform, and issuing a sequence verification request to each task platform according to the time sequence list of the scheduling task;
and when receiving the verification passing signal, classifying each task platform according to the acquisition strategy to obtain a corresponding target platform, and calling platform data of the target platform based on the acquisition strategy.
2. The method of claim 1, wherein classifying each of the task platforms according to the collection policy to obtain a corresponding target platform comprises:
analyzing a strategy type of the acquisition strategy, wherein the strategy type comprises a passive monitoring strategy and an active issuing strategy;
when the strategy type is a passive monitoring strategy, reading operation servers of all task platforms, and screening out task platforms, the operation servers of which accord with the passive monitoring strategy, as target platforms;
when the strategy type is an active issuing strategy, the operation parameters of each task platform and the acquisition threshold value of the scheduling task are read, the acquisition interval corresponding to each task platform is defined according to the operation parameters, and the target platform is determined in each task platform according to the acquisition threshold value and the acquisition interval.
3. The monitoring platform scheduling method according to claim 2, wherein after the step of analyzing the policy type of the acquisition policy, the method further comprises:
when the strategy type is a passive monitoring strategy and an active issuing strategy, calculating the resource consumption rate of the scheduling task;
and distributing each task platform according to the resource consumption rate so as to obtain the target platform of the scheduling task.
4. A monitoring platform scheduling system, comprising:
the task acquisition module is used for acquiring a scheduling task created by a target user and calling a corresponding acquisition strategy in a preset strategy library based on a task identifier of the scheduling task;
the database creation module is configured to create a time sequence database, and parse the time sequence of the scheduled task by using the time sequence database to obtain a time sequence table of the scheduled task, where the database creation module includes:
the data acquisition unit is used for acquiring corresponding network index data based on the task identifier of the scheduled task and acquiring platform index data associated with the task identifier in each task platform, wherein the network index data is a time sequence of the platform data required to be scheduled by the scheduled task or data related to time, the platform index data is a related index of the task platform for processing the task identifier, and the heat of a user using the task platform can be reflected through the platform index data;
the attention evaluation unit is used for evaluating the attention of each task platform based on the platform index data so as to obtain an attention sequence table of each task platform;
the database construction unit is used for constructing a mapping relation between the network index data and the attention degree sequence table on a calibrated time axis to obtain a corresponding data sequence table, and constructing a time sequence database according to the data sequence table;
the demand processing module is used for analyzing the task demands of the dispatching task and searching a plurality of task platforms according to the task demands and the acquisition strategy;
the verification request module is used for constructing connection with each task platform and issuing a sequence verification request to each task platform according to the time sequence table of the scheduling task;
and the platform scheduling module is used for classifying each task platform according to the acquisition strategy when receiving the verification passing signal so as to obtain a corresponding target platform and calling the platform data of the target platform based on the acquisition strategy.
5. The monitoring platform scheduling system of claim 4, wherein the platform scheduling module comprises:
the strategy analysis unit is used for analyzing the strategy type of the acquisition strategy, wherein the strategy type comprises a passive monitoring strategy and an active issuing strategy;
the first processing unit is used for reading the operation server of each task platform when the strategy type is a passive monitoring strategy, and screening out the task platform of which the operation server accords with the passive monitoring strategy as a target platform;
and the second processing unit is used for reading the operation parameters of the task platforms and the acquisition threshold values of the dispatching tasks when the strategy type is an active issuing strategy, defining the acquisition intervals corresponding to the task platforms according to the operation parameters, and determining target platforms in the task platforms according to the acquisition threshold values and the acquisition intervals.
6. The monitoring platform scheduling system of claim 5, wherein the platform scheduling module further comprises:
the third processing unit is used for calculating the resource consumption rate of the scheduling task when the strategy type is a passive monitoring strategy and an active issuing strategy;
and the fourth processing unit is used for distributing the task platforms according to the resource consumption rate so as to obtain the target platform of the scheduling task.
7. A readable storage medium having stored thereon a computer program, which when executed by a processor implements a monitoring platform scheduling method according to any one of claims 1 to 3.
8. A computer comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the monitoring platform scheduling method of any one of claims 1 to 3 when the computer program is executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311714923.9A CN117421107B (en) | 2023-12-14 | 2023-12-14 | Monitoring platform scheduling method, monitoring platform scheduling system, readable storage medium and computer |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311714923.9A CN117421107B (en) | 2023-12-14 | 2023-12-14 | Monitoring platform scheduling method, monitoring platform scheduling system, readable storage medium and computer |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117421107A CN117421107A (en) | 2024-01-19 |
| CN117421107B true CN117421107B (en) | 2024-03-08 |
Family
ID=89526915
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311714923.9A Active CN117421107B (en) | 2023-12-14 | 2023-12-14 | Monitoring platform scheduling method, monitoring platform scheduling system, readable storage medium and computer |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117421107B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2241975A2 (en) * | 2009-04-17 | 2010-10-20 | Technology Currents LLC | Scheduling and/or organizing task execution for a target computing platform |
| CN105207358A (en) * | 2015-09-16 | 2015-12-30 | 国家电网公司 | Electrical energy quality online monitoring platform |
| CN110018893A (en) * | 2019-03-12 | 2019-07-16 | 平安普惠企业管理有限公司 | A kind of method for scheduling task and relevant device based on data processing |
| CN110287228A (en) * | 2019-05-20 | 2019-09-27 | 广西电网有限责任公司 | Implementation method based on dispatching of power netwoks domain equipment monitoring real-time data acquisition |
| CN111625337A (en) * | 2020-05-28 | 2020-09-04 | 浪潮电子信息产业股份有限公司 | Task scheduling method and device, electronic equipment and readable storage medium |
| CN113987025A (en) * | 2021-11-02 | 2022-01-28 | 清华大学 | Standardized hotspot monitoring method and device |
| CN114721833A (en) * | 2022-05-17 | 2022-07-08 | 中诚华隆计算机技术有限公司 | Intelligent cloud coordination method and device based on platform service type |
| CN116662014A (en) * | 2023-06-30 | 2023-08-29 | 济南浪潮数据技术有限公司 | Task allocation method, device, equipment and medium |
-
2023
- 2023-12-14 CN CN202311714923.9A patent/CN117421107B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2241975A2 (en) * | 2009-04-17 | 2010-10-20 | Technology Currents LLC | Scheduling and/or organizing task execution for a target computing platform |
| CN105207358A (en) * | 2015-09-16 | 2015-12-30 | 国家电网公司 | Electrical energy quality online monitoring platform |
| CN110018893A (en) * | 2019-03-12 | 2019-07-16 | 平安普惠企业管理有限公司 | A kind of method for scheduling task and relevant device based on data processing |
| CN110287228A (en) * | 2019-05-20 | 2019-09-27 | 广西电网有限责任公司 | Implementation method based on dispatching of power netwoks domain equipment monitoring real-time data acquisition |
| CN111625337A (en) * | 2020-05-28 | 2020-09-04 | 浪潮电子信息产业股份有限公司 | Task scheduling method and device, electronic equipment and readable storage medium |
| CN113987025A (en) * | 2021-11-02 | 2022-01-28 | 清华大学 | Standardized hotspot monitoring method and device |
| CN114721833A (en) * | 2022-05-17 | 2022-07-08 | 中诚华隆计算机技术有限公司 | Intelligent cloud coordination method and device based on platform service type |
| CN116662014A (en) * | 2023-06-30 | 2023-08-29 | 济南浪潮数据技术有限公司 | Task allocation method, device, equipment and medium |
Non-Patent Citations (2)
| Title |
|---|
| 基于物联网的水电厂全息感知联合巡检系统;冯康康;《工业控制计算机》;20220925;第35卷(第9期);全文 * |
| 舰载多传感器协同探测资源调度模型构建;王发龙;姜宁;;现代防御技术;20160215(第01期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117421107A (en) | 2024-01-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110309125B (en) | Data verification method, electronic device and storage medium | |
| CN108595157B (en) | Block chain data processing method, device, equipment and storage medium | |
| CN110554958A (en) | Graph database testing method, system, device and storage medium | |
| CN109241084B (en) | Data query method, terminal equipment and medium | |
| CN110956269A (en) | Data model generation method, device, equipment and computer storage medium | |
| CN111338958B (en) | Parameter generation method and device for test cases and terminal equipment | |
| CN108305012A (en) | A kind of air control regulation obtaining method and device | |
| CN115422592A (en) | Big data security processing method and system | |
| CN111813788A (en) | Information query method and device and information synchronization method and device | |
| CN109690571A (en) | Group echo system and method based on study | |
| CN110471912B (en) | Employee attribute information verification method and device and terminal equipment | |
| CN111338622B (en) | Supply chain code identification method, device, server and readable storage medium | |
| CN117785491B (en) | GPU cloud computing resource management method, system and storage medium | |
| CN110457332B (en) | Information processing method and related equipment | |
| CN114743132A (en) | Target algorithm selection method and device, electronic equipment and storage medium | |
| CN109710827B (en) | Picture attribute management method and device, picture server and business processing terminal | |
| CN113806343B (en) | Evaluation method and system for Internet of vehicles data quality | |
| CN117421107B (en) | Monitoring platform scheduling method, monitoring platform scheduling system, readable storage medium and computer | |
| CN111459932A (en) | Block chain-based data evidence storage method and device and storage medium | |
| CN109948608A (en) | A kind of license plate number knows method for distinguishing, computer installation and computer readable storage medium | |
| CN115099922A (en) | Financial data query method, system, readable storage medium and computer equipment | |
| CN116166675A (en) | Data detection method, device and storage medium | |
| CN113706056A (en) | Bidding unit performance identification early warning method, device, equipment and storage medium | |
| CN112598228B (en) | Enterprise competitiveness analysis method, device, equipment and storage medium | |
| CN114356571A (en) | Processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |