CN113742083A - Scheduling simulation method and device, computer equipment and storage medium - Google Patents

Scheduling simulation method and device, computer equipment and storage medium Download PDF

Info

Publication number
CN113742083A
CN113742083A CN202111069193.2A CN202111069193A CN113742083A CN 113742083 A CN113742083 A CN 113742083A CN 202111069193 A CN202111069193 A CN 202111069193A CN 113742083 A CN113742083 A CN 113742083A
Authority
CN
China
Prior art keywords
target
simulation
determining
information corresponding
candidate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111069193.2A
Other languages
Chinese (zh)
Other versions
CN113742083B (en
Inventor
杨业飞
李希伟
杨庆东
周光
樊建刚
涂会
周海锐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jingdong Technology Information Technology Co Ltd
Original Assignee
Jingdong Technology Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jingdong Technology Information Technology Co Ltd filed Critical Jingdong Technology Information Technology Co Ltd
Priority to CN202111069193.2A priority Critical patent/CN113742083B/en
Publication of CN113742083A publication Critical patent/CN113742083A/en
Application granted granted Critical
Publication of CN113742083B publication Critical patent/CN113742083B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061—Partitioning or combining of resources
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The disclosure provides a scheduling simulation method, a scheduling simulation device, computer equipment and a storage medium. Applied to a cluster, the cluster comprising: the specific scheme of the multiple simulation nodes is as follows: determining a simulation node to be simulated from a plurality of simulation nodes, determining a target simulation manager corresponding to the simulation node to be simulated, wherein the target simulation manager corresponds to a target management identifier, determining resource use information corresponding to the target simulation manager according to the target management identifier, and determining target resource use information corresponding to the simulation node to be simulated according to the corresponding resource use information. By the method and the device, the real dispatching condition of the cluster can be accurately represented, the accuracy of the dispatching simulation result is effectively improved, and meanwhile, the dispatching simulation result is easier to observe by a third party.

Description

Scheduling simulation method and device, computer equipment and storage medium
Technical Field
The present disclosure relates to the field of cluster technologies, and in particular, to a scheduling simulation method and apparatus, a computer device, and a storage medium.
Background
The container arrangement engine (kubernets, k8s) cluster is an open source, is used for managing containerized applications on a plurality of hosts in a cloud platform, is mainly used for automatically deploying, expanding and managing the container applications, and provides a whole set of functions of resource scheduling, deployment management, service discovery, capacity expansion and reduction, monitoring and the like. In the k8s cluster scheduling process, according to the resource usage information of the nodes in the cluster as the measurement index, the minimum scheduling unit (pod) is only created on the Node with the largest resource residual amount to ensure the balance of the used resources of each Node, and in this process, there is a problem of resource waste.
In the related art, a scheduling simulation method usually observes a scheduling effect through a Request function.
In this way, the real resource usage information of the simulation node cannot be characterized, and the real scheduling condition cannot be reflected.
Disclosure of Invention
The present disclosure is directed to solving, at least to some extent, one of the technical problems in the related art.
Therefore, the present disclosure aims to provide a scheduling simulation method, an apparatus, a computer device, and a storage medium, which can accurately characterize a real scheduling condition of a cluster, effectively improve accuracy of a scheduling simulation result, and make it easier for a third party to observe the scheduling simulation result.
In order to achieve the above object, an embodiment of the first aspect of the present disclosure provides a scheduling simulation method, which is applied to a cluster, where the cluster includes: a plurality of analog nodes, comprising: determining a simulation node to be simulated from the plurality of simulation nodes; determining a target simulation manager corresponding to the node to be simulated, wherein the target simulation manager corresponds to a target management identifier; determining resource use information corresponding to the target simulation manager according to the target management identifier; and determining target resource use information corresponding to the node to be simulated according to the corresponding resource use information.
According to the scheduling simulation method provided by the embodiment of the first aspect of the disclosure, a node to be simulated is determined from the plurality of simulation nodes, a target simulation manager corresponding to the node to be simulated is determined, the target simulation manager corresponds to a target management identifier, resource usage information corresponding to the target simulation manager is determined according to the target management identifier, and target resource usage information corresponding to the node to be simulated is determined according to the corresponding resource usage information, so that a real scheduling condition of a cluster can be accurately represented, the accuracy of a scheduling simulation result is effectively improved, and meanwhile, a third party can observe the scheduling simulation result more easily.
In order to achieve the above object, an embodiment of a second aspect of the present disclosure provides a scheduling simulation apparatus, which is applied to a cluster, where the cluster includes: a plurality of analog nodes, comprising: the first determining module is used for determining a simulation node to be simulated from the plurality of simulation nodes; the second determining module is used for determining a target simulation manager corresponding to the node to be simulated, wherein the target simulation manager corresponds to a target management identifier; a third determining module, configured to determine, according to the target management identifier, resource usage information corresponding to the target simulation manager; and the fourth determining module is used for determining target resource use information corresponding to the node to be simulated according to the corresponding resource use information.
According to the scheduling simulation device provided by the embodiment of the second aspect of the disclosure, a node to be simulated is determined from the plurality of simulation nodes, a target simulation manager corresponding to the node to be simulated is determined, the target simulation manager corresponds to a target management identifier, resource use information corresponding to the target simulation manager is determined according to the target management identifier, and target resource use information corresponding to the node to be simulated is determined according to the corresponding resource use information, so that the real scheduling condition of a cluster can be accurately represented, the accuracy of a scheduling simulation result is effectively improved, and meanwhile, a third party can observe the scheduling simulation result more easily.
An embodiment of a third aspect of the present disclosure provides a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor executes the program to implement the scheduling simulation method as set forth in the embodiment of the first aspect of the present disclosure.
A fourth aspect of the present disclosure provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the scheduling simulation method as set forth in the first aspect of the present disclosure.
An embodiment of a fifth aspect of the present disclosure provides a computer program product, which when executed by an instruction processor in the computer program product, performs the scheduling simulation method as set forth in the embodiment of the first aspect of the present disclosure.
Additional aspects and advantages of the disclosure will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the disclosure.
Drawings
The foregoing and/or additional aspects and advantages of the present disclosure will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic flowchart of a scheduling simulation method according to an embodiment of the present disclosure;
fig. 2 is a schematic flowchart of a scheduling simulation method according to another embodiment of the disclosure;
fig. 3 is a schematic flowchart of a scheduling simulation method according to another embodiment of the disclosure;
FIG. 4 is a schematic flow diagram of a scheduling simulation method according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a scheduling simulation apparatus according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of a scheduling simulation apparatus according to another embodiment of the present disclosure;
FIG. 7 illustrates a block diagram of an exemplary computer device suitable for use in implementing embodiments of the present disclosure.
Detailed Description
Reference will now be made in detail to the embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of illustrating the present disclosure and should not be construed as limiting the same. On the contrary, the embodiments of the disclosure include all changes, modifications and equivalents coming within the spirit and terms of the claims appended hereto.
Fig. 1 is a schematic flowchart of a scheduling simulation method according to an embodiment of the present disclosure.
It should be noted that the execution main body of the scheduling simulation method of this embodiment is a scheduling simulation apparatus, the apparatus may be implemented by software and/or hardware, the apparatus may be configured in a computer device, and the computer device may include, but is not limited to, a terminal, a server, and the like.
As shown in fig. 1, the scheduling simulation method includes:
s101: and determining a simulation node to be simulated from the plurality of simulation nodes.
The scheduling simulation method described in the embodiment of the present disclosure may be applied to a cluster, where the cluster may be specifically obtained by performing simulation creation on a cluster performance testing tool (kubemarrk) on the basis of a container arrangement engine (kubernees, k8s), and this is not limited.
The cluster may include a plurality of nodes, which may specifically be, for example, a Master Node (Master) and a plurality of other nodes (nodes), and may create a plurality of minimum scheduling units (pod) on the nodes, and use the plurality of nodes on which the minimum scheduling units are created as a corresponding plurality of simulation nodes (mocknodes).
Among the plurality of analog nodes, a node to be currently scheduled and simulated may be referred to as an analog node.
In some embodiments, the to-be-simulated node is determined from the plurality of simulation nodes, which may be selected from the simulation nodes meeting a minimum scheduling unit (pod) scheduling requirement, the selected simulation nodes are scored according to a series of functions, and the simulation node with the highest score is used as the to-be-simulated node, which is not limited.
S102: and determining a target simulation manager corresponding to the node to be simulated, wherein the target simulation manager corresponds to the target management identifier.
After the to-be-simulated node is determined from the plurality of simulation nodes, a target simulation manager corresponding to the to-be-simulated node can be determined.
In this embodiment, a minimum scheduling unit (pod) may be created, where the pod may be used to schedule a simulation node, and each simulation node may schedule a plurality of simulation managers (Mockpod), and correspondingly, a plurality of simulation managers that can be scheduled by a simulation node to be simulated may be referred to as a target simulation manager.
The target management identifier may be used to identify a target simulation manager, and the plurality of target simulation managers may correspond to the plurality of target management identifiers, respectively.
In some embodiments, the determining of the target simulation manager corresponding to the node to be simulated may be determining, according to a target management identifier corresponding to the target simulation manager, a simulation manager corresponding to the target management identifier from a plurality of simulation managers, and using the simulation manager as the target simulation manager, and certainly, any other possible manner may also be used to determine the target simulation manager corresponding to the node to be simulated, which is not limited herein.
S103: and determining resource use information corresponding to the target simulation manager according to the target management identifier.
The information describing the resource usage corresponding to the target simulation manager may be referred to as resource usage information.
The resource usage information may specifically be, for example, a resource usage rate of a Central Processing Unit (CPU), a resource usage rate of a memory, a resource usage rate of a Graphics Processing Unit (GPU), and the like, which is not limited thereto.
In some embodiments, determining the resource usage information corresponding to the target simulation manager according to the target management identifier may be monitoring the resource usage information of the plurality of simulation managers respectively to obtain a plurality of resource usage information corresponding to the plurality of simulation managers respectively, and determining the resource usage information corresponding to the target simulation manager from the plurality of resource usage information according to the target management identifier corresponding to the target simulation manager, which is not limited herein.
In this embodiment, the resource usage information corresponding to the target simulation manager is determined according to the target management identifier, which may be determining a real-time resource usage rate corresponding to the target simulation manager according to the target management identifier, and using the determined real-time resource usage rate as the resource usage information corresponding to the target simulation manager, which is not limited thereto.
S104: and determining target resource use information corresponding to the node to be simulated according to the corresponding resource use information.
After determining the resource usage information corresponding to the target simulation manager according to the target management identifier, the resource usage information corresponding to the node to be simulated may be determined according to the resource usage information corresponding to the target simulation manager, where the resource usage information may be referred to as target resource usage information.
In some embodiments, a plurality of target simulation managers may be scheduled on the node to be simulated, and accordingly, the target resource usage information corresponding to the node to be simulated is determined according to the corresponding resource usage information, or a plurality of resource usage information of the plurality of target simulation managers corresponding to the node to be simulated may be respectively determined, and then the plurality of resource usage information are collectively used as the target resource usage information, which is not limited to this.
Optionally, in other embodiments, the resource usage information corresponding to the node to be simulated is determined according to the resource usage information, which may be that aggregation processing is performed on the resource usage information corresponding to multiple target simulation managers, and the resource usage information obtained through the aggregation processing is used as the target resource usage information.
For example, the actual resource utilization rates of the target simulation managers respectively corresponding to the simulation nodes may be accumulated, and the accumulated actual resource utilization rates may be used as target resource utilization information corresponding to the simulation nodes to be simulated.
After the resource usage information corresponding to the target simulation managers is aggregated to obtain the resource usage information corresponding to the nodes to be simulated, the resource usage information corresponding to the nodes to be simulated is provided to a third party through a pre-established Application Programming Interface (API), so that the third party can observe the scheduling effect of the nodes to be simulated in the cluster.
In the embodiment, the node to be simulated is determined from the plurality of simulation nodes, the target simulation manager corresponding to the node to be simulated is determined, the target simulation manager corresponds to the target management identifier, the resource use information corresponding to the target simulation manager is determined according to the target management identifier, and the target resource use information corresponding to the node to be simulated is determined according to the corresponding resource use information.
Fig. 2 is a schematic flowchart of a scheduling simulation method according to another embodiment of the disclosure.
As shown in fig. 2, the scheduling simulation method includes:
s201: and determining a simulation node to be simulated from the plurality of simulation nodes.
S202: and determining a target simulation manager corresponding to the node to be simulated, wherein the target simulation manager corresponds to the target management identifier.
For the description of S201-S202, reference may be made to the above embodiments, which are not described herein again.
S203: and determining a plurality of applications, wherein the plurality of applications respectively correspond to the plurality of application identifications.
The target simulation manager may run a plurality of applications, the plurality of applications correspond to a plurality of application identifiers respectively, the plurality of application identifiers may be used to identify the plurality of applications, and the application identifiers may specifically be, for example, names of the applications, numbers of the applications, physical addresses of the applications, and the like, which is not limited thereto.
The determining of the plurality of applications may be determining a plurality of applications running in a plurality of target simulation managers, and then using the determined applications running in the plurality of target simulation managers as a plurality of applications together, which is not limited herein.
S204: a plurality of online operation information corresponding to the plurality of applications, respectively, is acquired.
The information describing the running conditions of the plurality of application lines may be referred to as on-line running information.
In some embodiments, the obtaining of the on-line operation information corresponding to the multiple applications may be to monitor the on-line operation conditions of the multiple applications in real time, respectively, to obtain historical operation information of the multiple applications, and use the monitored historical operation information as the on-line operation information corresponding to the multiple applications, which is not limited herein.
S205: and establishing a simulation monitoring resource pool according to the plurality of application identifications and the plurality of on-line operation information respectively corresponding to the application identifications.
After the plurality of on-line operation information respectively corresponding to the plurality of applications is obtained, the simulation monitoring resource pool can be constructed according to the plurality of application identifiers and the plurality of on-line operation information respectively corresponding to the plurality of applications, so that the construction effect of the simulation monitoring resource pool can be effectively improved, and the target resource use information corresponding to the node to be simulated can be obtained in real time based on the simulation monitoring resource pool.
Optionally, in some embodiments, the simulation monitoring resource pool is constructed according to a plurality of application identifiers and a plurality of on-line operation information respectively corresponding to the application identifiers, the on-line monitoring resource pool may be constructed according to a plurality of application identifiers and a plurality of on-line operation information respectively corresponding to the application identifiers, the candidate application identifiers may be obtained from a plurality of application identifiers in the on-line monitoring resource pool according to the candidate time range, the candidate on-line operation information corresponding to the candidate application identifiers and the candidate time range may be obtained, and the simulation monitoring resource pool may be constructed according to the candidate application identifiers and the candidate time range by combining the corresponding candidate on-line operation information, since data interaction may be performed between the on-line monitoring resource pool and the simulation monitoring resource pool, data of the simulation monitoring resource pool may be updated based on data of the on-line monitoring resource pool, and authenticity of data in the simulation monitoring resource pool may be effectively guaranteed, therefore, the dispatching simulation effect can be effectively assisted to be improved.
The online monitoring resource pool can store a plurality of online running information corresponding to a plurality of applications respectively, namely the online monitoring resource pool can store a plurality of online running information of the applications monitored in real time.
Accordingly, an online monitoring resource pool can be constructed according to the plurality of application identifiers and the plurality of online running information respectively corresponding to the application identifiers.
The online monitoring resource pool can store historical online running information of a plurality of applications, namely the online running information of the plurality of applications stored in the online monitoring resource pool can correspond to a certain historical time range, the time range to be selected currently in the time range can be called a candidate time range, namely, according to the candidate time range, a corresponding application identifier is selected from a plurality of application identifiers corresponding to the plurality of applications in the certain historical time range stored in the online monitoring resource pool, and the application identifier can be called a candidate application identifier.
Further, after obtaining the candidate application identifier from the plurality of application identifiers in the online monitoring resource pool, online running information corresponding to the candidate application identifier and the candidate time range may be obtained from the online monitoring resource pool, and the online running information may be referred to as candidate online running information.
After obtaining the candidate online operation information from the online monitoring resource pool, the simulation monitoring resource pool can be constructed by combining the corresponding candidate online operation information according to the candidate application identifier and the candidate time range.
For example, the simulation monitoring resource pool may be constructed according to the time sequence database, after the construction of the simulation monitoring resource pool is completed, an information acquisition request may be initiated to the online monitoring resource pool, and after the online monitoring resource pool receives the information acquisition request initiated by the simulation monitoring resource pool, the online monitoring resource pool may provide candidate online operation information corresponding to the candidate application identifier and the candidate time range to the simulation monitoring resource pool according to the candidate application identifier and the candidate time range in the information acquisition request.
S206: and determining resource use information corresponding to the target management identification from a pre-constructed simulation monitoring resource pool.
After the simulation monitoring resource pool is constructed according to the plurality of application identifiers and the plurality of on-line operation information respectively corresponding to the application identifiers, the resource use information corresponding to the target management identifier can be determined from the simulation monitoring resource pool constructed in advance.
That is, in this embodiment, the pre-constructed simulation monitoring resource pool may include a plurality of resource usage information of a plurality of simulation managers, and accordingly, the resource usage information corresponding to the target management identifier may be determined from the plurality of resource usage information of the plurality of simulation managers in the simulation monitoring resource pool according to the target management identifier corresponding to the target simulation manager, so that the logic for acquiring the resource usage information may be effectively simplified, and the comprehensiveness and reliability of the resource usage information may be effectively improved.
S207: and determining target resource use information corresponding to the node to be simulated according to the corresponding resource use information.
For the description of S207, reference may be made to the above embodiments, which are not described herein again.
In this embodiment, by determining a node to be simulated from a plurality of simulation nodes, determining a target simulation manager corresponding to the node to be simulated, where the target simulation manager corresponds to a target management identifier, and then determining a plurality of applications, where the plurality of applications correspond to a plurality of application identifiers, respectively, and obtaining a plurality of online running information corresponding to the plurality of applications, respectively, and constructing a simulation monitoring resource pool according to the plurality of application identifiers and the plurality of online running information corresponding to the plurality of applications, the construction effect of the simulation monitoring resource pool can be effectively improved, so that target resource usage information corresponding to the node to be simulated can be obtained in real time based on the simulation monitoring resource pool, and resource usage information corresponding to the target management identifier is determined from a pre-constructed simulation monitoring resource pool, thereby effectively simplifying the logic for obtaining the resource usage information, the comprehensiveness and reliability of the resource use information are effectively improved, the target resource use information corresponding to the node to be simulated is determined according to the corresponding resource use information, the real scheduling condition of the cluster can be accurately represented, and the accuracy of the scheduling simulation result is effectively improved.
Fig. 3 is a schematic flowchart of a scheduling simulation method according to another embodiment of the disclosure.
As shown in fig. 3, the scheduling simulation method includes:
s301: and determining a simulation node to be simulated from the plurality of simulation nodes.
S302: and determining a target simulation manager corresponding to the node to be simulated, wherein the target simulation manager corresponds to the target management identifier.
For the descriptions of S301 to S302, reference may be made to the above embodiments, which are not described herein again.
S303: metadata information corresponding to the target management identity is determined.
Where the unit data information used to describe the data may be referred to as metadata information, the metadata information may be a fixed data field in the target simulation manager that may be used to identify the corresponding unit data information.
In this embodiment, the application identifiers corresponding to the plurality of applications in the target simulation manager may be filled in the fixed data field to form metadata information corresponding to the target management identifiers of the target simulation manager.
S304: and analyzing the metadata information to obtain a target application identifier.
Among them, the identifier for identifying the target application in the plurality of application identifiers may be referred to as a target application identifier.
After the metadata information corresponding to the target management identifier is determined, the metadata information may be analyzed to obtain the target application identifier.
In some embodiments, the metadata information may be analyzed by text analysis, model analysis, and the like to obtain the target application identifier, which is not limited.
S305: and determining online running information corresponding to the target application identifier from the simulation monitoring resource pool and using the online running information as resource use information.
After the metadata information corresponding to the target management identifier is analyzed to obtain the target application identifier, the online running information corresponding to the target application identifier can be determined from the simulation monitoring resource pool and used as the resource utilization information, so that the accuracy of the resource utilization information can be effectively improved, and the scheduling simulation quality can be effectively assisted to be improved.
Optionally, in some embodiments, the on-line operation information corresponding to the target application identifier is determined from the simulation monitoring resource pool and used as the resource usage information, which may be determining a simulation time point, determining a target time range corresponding to the simulation time point, and then using the target time range and the candidate on-line operation information corresponding to the target application identifier as the corresponding on-line operation information, thereby providing a completely new dimension for the acquisition of the on-line operation information, because different acquisition scenarios generally require the corresponding acquisition of different time ranges or different on-line operation information of different applications, when the adaptive configuration of the target time range and the target application identifier is supported, the logic for acquiring the on-line operation information can meet the personalized requirements of the acquisition scenario, the hit effect of the acquisition of the on-line operation information is effectively improved, while the accuracy of the on-line operation information is effectively ensured, the rationality of the on-line operation information acquisition process is effectively improved, and the deployment and implementation of the scheduling simulation method are facilitated.
The current time point may be referred to as a simulation time point.
Accordingly, in the execution process of the scheduling simulation method, a time point can be arbitrarily selected to observe the scheduling simulation situation from the time point to the simulation time point, and the time range from the time point to the simulation time point can be called a target time range, and the target time range belongs to a plurality of candidate time ranges.
In some embodiments, the simulation time point may be determined by a time acquisition device, and then the target time range corresponding to the simulation time point is determined, and in the candidate on-line operation information corresponding to the candidate application identifier and the candidate time range, the candidate on-line operation information corresponding to the target time range and the target application identifier is determined and used as the corresponding on-line operation information.
S306: and determining target resource use information corresponding to the node to be simulated according to the corresponding resource use information.
For the description of S306, reference may be made to the foregoing embodiments, which are not described herein again.
In this embodiment, as shown in fig. 4, fig. 4 is a schematic flowchart of a scheduling simulation method according to an embodiment of the present disclosure, and includes: the cluster management system comprises a cluster management module (Operator), wherein the cluster management module can be used for monitoring resource use information of a master node (master) in a cluster, the master node (master) can comprise other nodes (nodes), a plurality of simulation nodes (mockpodes) can dispatch a plurality of target simulation managers (mockpodes) from the plurality of simulation nodes (mockpodes), the plurality of target simulation managers (mockpodes) can be provided with corresponding target management identifiers, a plurality of resource use information corresponding to the target management identifiers can be obtained from a pre-constructed simulation monitoring resource pool (data interaction can occur between the simulation monitoring resource pool and an on-line monitoring resource pool) through the target management identifiers, and then the target resource use information corresponding to a node (Mockpod) to be simulated is determined according to the plurality of resource use information.
In the embodiment, by determining a node to be simulated from a plurality of simulation nodes, determining a target simulation manager corresponding to the node to be simulated, wherein the target simulation manager corresponds to a target management identifier, and determining metadata information corresponding to the target management identifier, after analyzing the metadata information corresponding to the target management identifier to obtain a target application identifier, online running information corresponding to the target application identifier can be determined from a simulation monitoring resource pool and used as resource utilization information, so that the accuracy of the resource utilization information can be effectively improved, the scheduling simulation quality can be effectively improved in an auxiliary manner, and then the target resource utilization information corresponding to the node to be simulated is determined according to the corresponding resource utilization information, so that the real scheduling condition of a cluster can be accurately represented, and the accuracy of a scheduling simulation result can be effectively improved, meanwhile, the scheduling simulation result is easier to observe by a third party.
Fig. 5 is a schematic structural diagram of a scheduling simulation apparatus according to an embodiment of the present disclosure.
As shown in fig. 5, the scheduling simulation apparatus 50 is applied to a cluster including: a plurality of analog nodes, comprising:
a first determining module 501, configured to determine a simulation node to be simulated from a plurality of simulation nodes;
a second determining module 502, configured to determine a target simulation manager corresponding to a node to be simulated, where the target simulation manager corresponds to a target management identifier;
a third determining module 503, configured to determine, according to the target management identifier, resource usage information corresponding to the target simulation manager;
a fourth determining module 504, configured to determine, according to the corresponding resource usage information, target resource usage information corresponding to the node to be simulated.
In some embodiments of the present disclosure, as shown in fig. 6, fig. 6 is a schematic structural diagram of a scheduling simulation apparatus according to another embodiment of the present disclosure, and the third determining module 503 is specifically configured to:
and determining resource use information corresponding to the target management identification from a pre-constructed simulation monitoring resource pool.
In some embodiments of the present disclosure, the third determining module 503 is specifically configured to:
determining metadata information corresponding to the target management identification;
analyzing the metadata information to obtain a target application identifier;
determining online running information corresponding to the target application identifier from the simulation monitoring resource pool and using the online running information as resource use information;
the target application identification is used for identifying the target application, and the online running information is used for describing the online running condition of the target application.
In some embodiments of the present disclosure, the scheduling simulation apparatus 50 further includes:
a fifth determining module 505, configured to determine, before determining, according to the target management identifier, resource usage information corresponding to the target simulation manager, a plurality of applications, where the plurality of applications correspond to the plurality of application identifiers, respectively;
an obtaining module 506, configured to obtain a plurality of online running information corresponding to a plurality of applications, respectively;
the building module 507 is configured to build a simulation monitoring resource pool according to the plurality of application identifiers and the plurality of on-line operation information respectively corresponding to the plurality of application identifiers.
In some embodiments of the present disclosure, the building module 507 is specifically configured to:
establishing an online monitoring resource pool according to the application identifications and the corresponding online running information;
according to the candidate time range, acquiring a candidate application identifier from a plurality of application identifiers in the online monitoring resource pool, and acquiring candidate online running information corresponding to the candidate application identifier and the candidate time range;
and establishing a simulation monitoring resource pool by combining corresponding candidate online operation information according to the candidate application identification and the candidate time range.
In some embodiments of the present disclosure, the third determining module 503 is specifically configured to:
determining a simulation time point;
determining a target time range corresponding to the simulation time point, wherein the target time range belongs to a plurality of candidate time ranges;
and taking the candidate online running information corresponding to the target time range and the target application identification as corresponding online running information.
In some embodiments of the present disclosure, the fourth determining module 504 is specifically configured to:
and performing aggregation processing on the resource use information corresponding to the target simulation managers, and taking the resource use information obtained through the aggregation processing as target resource use information.
Corresponding to the scheduling simulation method provided in the embodiments of fig. 1 to 4, the present disclosure also provides a scheduling simulation apparatus, and since the scheduling simulation apparatus provided in the embodiments of the present disclosure corresponds to the scheduling simulation method provided in the embodiments of fig. 1 to 4, the implementation manner of the scheduling simulation method is also applicable to the scheduling simulation apparatus provided in the embodiments of the present disclosure, and is not described in detail in the embodiments of the present disclosure.
In the embodiment, the node to be simulated is determined from the plurality of simulation nodes, the target simulation manager corresponding to the node to be simulated is determined, the target simulation manager corresponds to the target management identifier, the resource use information corresponding to the target simulation manager is determined according to the target management identifier, and the target resource use information corresponding to the node to be simulated is determined according to the corresponding resource use information.
In order to implement the foregoing embodiments, the present disclosure also provides a computer device, including: the scheduling simulation method comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the processor executes the program, the scheduling simulation method provided by the previous embodiment of the disclosure is realized.
In order to achieve the above embodiments, the present disclosure also proposes a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the scheduling simulation method as proposed by the foregoing embodiments of the present disclosure.
In order to implement the foregoing embodiments, the present disclosure further provides a computer program product, which when executed by an instruction processor in the computer program product, executes the scheduling simulation method as proposed by the foregoing embodiments of the present disclosure.
FIG. 7 illustrates a block diagram of an exemplary computer device suitable for use in implementing embodiments of the present disclosure. The computer device 12 shown in fig. 7 is only an example and should not bring any limitations to the functionality or scope of use of the embodiments of the present disclosure.
As shown in FIG. 7, computer device 12 is in the form of a general purpose computing device. The components of computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.
Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. These architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus, to name a few.
Computer device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer device 12 and includes both volatile and nonvolatile media, removable and non-removable media.
Memory 28 may include computer system readable media in the form of volatile Memory, such as Random Access Memory (RAM) 30 and/or cache Memory 32. Computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 7, and commonly referred to as a "hard drive").
Although not shown in FIG. 7, a disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a Compact disk Read Only Memory (CD-ROM), a Digital versatile disk Read Only Memory (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the disclosure.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally perform the functions and/or methodologies of the embodiments described in this disclosure.
Computer device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with computer device 12, and/or with any devices (e.g., network card, modem, etc.) that enable computer device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Moreover, computer device 12 may also communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public Network such as the Internet) via Network adapter 20. As shown, network adapter 20 communicates with the other modules of computer device 12 via bus 18. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with computer device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 16 executes various functional applications and data processing by executing programs stored in the system memory 28, for example, implementing the scheduling simulation method mentioned in the foregoing embodiments.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
It should be noted that, in the description of the present disclosure, the terms "first", "second", etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Further, in the description of the present disclosure, "a plurality" means two or more unless otherwise specified.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present disclosure includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present disclosure.
It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present disclosure may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Although embodiments of the present disclosure have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present disclosure, and that changes, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present disclosure.

Claims (16)

1. A scheduling simulation method applied to a cluster, the cluster comprising: a plurality of simulation nodes, the method comprising:
determining a simulation node to be simulated from the plurality of simulation nodes;
determining a target simulation manager corresponding to the node to be simulated, wherein the target simulation manager corresponds to a target management identifier;
determining resource use information corresponding to the target simulation manager according to the target management identifier;
and determining target resource use information corresponding to the node to be simulated according to the corresponding resource use information.
2. The method of claim 1, wherein said determining resource usage information corresponding to the target simulation manager based on the target management identity comprises:
and determining resource use information corresponding to the target management identification from a pre-constructed simulation monitoring resource pool.
3. The method of claim 2, wherein determining resource usage information corresponding to the target management identity from a pre-built pool of simulated monitoring resources comprises:
determining metadata information corresponding to the target management identification;
analyzing the metadata information to obtain a target application identifier;
determining online running information corresponding to the target application identifier from the simulation monitoring resource pool and using the online running information as the resource use information;
the target application identifier is used for identifying a target application, and the online running information is used for describing the online running condition of the target application.
4. The method of claim 3, prior to said determining resource usage information corresponding to said target simulation manager based on said target management identity, further comprising:
determining a plurality of applications, wherein the plurality of applications respectively correspond to a plurality of application identifiers;
acquiring a plurality of online running information respectively corresponding to the plurality of applications;
and constructing the simulation monitoring resource pool according to the application identifications and the on-line operation information respectively corresponding to the application identifications.
5. The method of claim 4, wherein said building the pool of simulation monitoring resources from the plurality of application identifications and the respectively corresponding plurality of online running information comprises:
establishing an online monitoring resource pool according to the application identifications and the corresponding online running information;
according to a candidate time range, acquiring a candidate application identifier from the plurality of application identifiers in the online monitoring resource pool, and acquiring candidate online running information corresponding to the candidate application identifier and the candidate time range;
and constructing the simulation monitoring resource pool by combining the corresponding candidate online operation information according to the candidate application identifier and the candidate time range.
6. The method of claim 5, wherein said determining online running information corresponding to said target application identification from said pool of simulation monitoring resources and as said resource usage information comprises:
determining a simulation time point;
determining a target time range corresponding to the simulation time point, wherein the target time range belongs to a plurality of candidate time ranges;
and taking the candidate online running information corresponding to the target time range and the target application identifier as the corresponding online running information.
7. The method of claim 1, wherein the number of the target simulation managers is plural, and the determining the target resource usage information corresponding to the simulation node to be simulated according to the corresponding resource usage information comprises:
and aggregating the resource use information corresponding to the target simulation managers, and taking the resource use information obtained by aggregation as the target resource use information.
8. A scheduling simulation apparatus, applied to a cluster, the cluster comprising: a plurality of analog nodes, the apparatus comprising:
the first determining module is used for determining a simulation node to be simulated from the plurality of simulation nodes;
the second determining module is used for determining a target simulation manager corresponding to the node to be simulated, wherein the target simulation manager corresponds to a target management identifier;
a third determining module, configured to determine, according to the target management identifier, resource usage information corresponding to the target simulation manager;
and the fourth determining module is used for determining target resource use information corresponding to the node to be simulated according to the corresponding resource use information.
9. The apparatus of claim 8, wherein the third determining module is specifically configured to:
and determining resource use information corresponding to the target management identification from a pre-constructed simulation monitoring resource pool.
10. The apparatus of claim 9, wherein the third determining module is specifically configured to:
determining metadata information corresponding to the target management identification;
analyzing the metadata information to obtain a target application identifier;
determining online running information corresponding to the target application identifier from the simulation monitoring resource pool and using the online running information as the resource use information;
the target application identifier is used for identifying a target application, and the online running information is used for describing the online running condition of the target application.
11. The apparatus of claim 10, further comprising:
a fifth determining module, configured to determine a plurality of applications before determining, according to the target management identifier, resource usage information corresponding to the target simulation manager, where the plurality of applications correspond to a plurality of application identifiers respectively;
an acquisition module, configured to acquire a plurality of online running information corresponding to the plurality of applications, respectively;
and the construction module is used for constructing the simulation monitoring resource pool according to the application identifications and the corresponding on-line operation information.
12. The apparatus of claim 11, wherein the building block is specifically configured to:
establishing an online monitoring resource pool according to the application identifications and the corresponding online running information;
according to a candidate time range, acquiring a candidate application identifier from the plurality of application identifiers in the online monitoring resource pool, and acquiring candidate online running information corresponding to the candidate application identifier and the candidate time range;
and constructing the simulation monitoring resource pool by combining the corresponding candidate online operation information according to the candidate application identifier and the candidate time range.
13. The apparatus of claim 12, wherein the third determining module is specifically configured to:
determining a simulation time point;
determining a target time range corresponding to the simulation time point, wherein the target time range belongs to a plurality of candidate time ranges;
and taking the candidate online running information corresponding to the target time range and the target application identifier as the corresponding online running information.
14. The apparatus of claim 8, wherein the fourth determining module is specifically configured to:
and aggregating the resource use information corresponding to the target simulation managers, and taking the resource use information obtained by aggregation as the target resource use information.
15. A computer device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.
16. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-7.
CN202111069193.2A 2021-09-13 2021-09-13 Scheduling simulation method, scheduling simulation device, computer equipment and storage medium Active CN113742083B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111069193.2A CN113742083B (en) 2021-09-13 2021-09-13 Scheduling simulation method, scheduling simulation device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111069193.2A CN113742083B (en) 2021-09-13 2021-09-13 Scheduling simulation method, scheduling simulation device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN113742083A true CN113742083A (en) 2021-12-03
CN113742083B CN113742083B (en) 2024-06-18

Family

ID=78738333

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111069193.2A Active CN113742083B (en) 2021-09-13 2021-09-13 Scheduling simulation method, scheduling simulation device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113742083B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114629801A (en) * 2022-02-28 2022-06-14 国家电投集团科学技术研究院有限公司 High closure detection method and device for fluid network model of nuclear power plant

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100106476A1 (en) * 2008-10-27 2010-04-29 Synopsys, Inc. Fast Simulation Method For Integrated Circuits With Power Management Circuitry
CN103955373A (en) * 2014-04-30 2014-07-30 浙江工商大学 Design method of SDN (Software Defined Networking) application integration development environment
CN107784152A (en) * 2016-08-26 2018-03-09 株式会社日立制作所 Include the simulation of multiple simulators
US20200184026A1 (en) * 2018-12-06 2020-06-11 Microsoft Technology Licensing, Llc Computing system simulation and testing environment
CN112560244A (en) * 2020-12-08 2021-03-26 河海大学 Virtual simulation experiment system and method based on Docker
WO2021063339A1 (en) * 2019-09-30 2021-04-08 星环信息科技(上海)股份有限公司 Cluster resource scheduling method, apparatus, device and storage medium
US20210160142A1 (en) * 2019-11-22 2021-05-27 International Business Machines Corporation Generalized correlation of network resources and associated data records in dynamic network environments
CN113037545A (en) * 2021-02-26 2021-06-25 中电数据服务有限公司 Network simulation method, device, equipment and storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100106476A1 (en) * 2008-10-27 2010-04-29 Synopsys, Inc. Fast Simulation Method For Integrated Circuits With Power Management Circuitry
CN103955373A (en) * 2014-04-30 2014-07-30 浙江工商大学 Design method of SDN (Software Defined Networking) application integration development environment
CN107784152A (en) * 2016-08-26 2018-03-09 株式会社日立制作所 Include the simulation of multiple simulators
US20200184026A1 (en) * 2018-12-06 2020-06-11 Microsoft Technology Licensing, Llc Computing system simulation and testing environment
WO2021063339A1 (en) * 2019-09-30 2021-04-08 星环信息科技(上海)股份有限公司 Cluster resource scheduling method, apparatus, device and storage medium
US20210160142A1 (en) * 2019-11-22 2021-05-27 International Business Machines Corporation Generalized correlation of network resources and associated data records in dynamic network environments
CN112560244A (en) * 2020-12-08 2021-03-26 河海大学 Virtual simulation experiment system and method based on Docker
CN113037545A (en) * 2021-02-26 2021-06-25 中电数据服务有限公司 Network simulation method, device, equipment and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114629801A (en) * 2022-02-28 2022-06-14 国家电投集团科学技术研究院有限公司 High closure detection method and device for fluid network model of nuclear power plant
CN114629801B (en) * 2022-02-28 2023-09-22 国家电投集团科学技术研究院有限公司 Method and device for detecting high closure of nuclear power plant fluid network model

Also Published As

Publication number Publication date
CN113742083B (en) 2024-06-18

Similar Documents

Publication Publication Date Title
US10467128B2 (en) Measuring and optimizing test resources and test coverage effectiveness through run time customer profiling and analytics
CN111563014A (en) Interface service performance test method, device, equipment and storage medium
US9875169B2 (en) Modeling real capacity consumption changes using process-level data
CN112101803A (en) Business process monitoring method, device, system, equipment and medium
CN112148779B (en) Method, device and storage medium for determining business index
CN111400189A (en) Code coverage rate monitoring method and device, electronic equipment and storage medium
US9787549B2 (en) Server virtualization
CN113835830A (en) AI-based RPA cluster management method, device and storage medium
CN112598135A (en) Model training processing method and device, computer equipment and medium
CN106664259A (en) Virtual network function capacity expansion method and apparatus
CN113742083B (en) Scheduling simulation method, scheduling simulation device, computer equipment and storage medium
EP4152715A1 (en) Method and apparatus for determining resource configuration of cloud service system
CN110018932A (en) A kind of monitoring method and device of container disk
CN113760672A (en) Performance test method, equipment and storage medium for multi-cloud platform resources
CN115022201B (en) Data processing function test method, device, equipment and storage medium
CN113535560B (en) Test execution method, device, storage medium and computing equipment
CN114338472A (en) Capacity test method, device, equipment, medium and product of map server
CN109324802B (en) Method and device for configuring server
US11526849B2 (en) Data set filtering for machine learning
CN115812195A (en) Calculating developer time in a development process
CN114692382B (en) Management method and device for nuclear power simulation model development data and computer equipment
CN111679924A (en) Component software system reliability simulation method and device and electronic equipment
CN104883273A (en) Method and system for processing service influence model in virtualized service management platform
CN109634636A (en) Application processing method, device, equipment and medium
CN118672786A (en) Control method, device, equipment and storage medium for testing environment container resources

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant