CN112540838B - System resource scheduling method and device and computer storage medium - Google Patents
System resource scheduling method and device and computer storage medium Download PDFInfo
- Publication number
- CN112540838B CN112540838B CN202011522695.1A CN202011522695A CN112540838B CN 112540838 B CN112540838 B CN 112540838B CN 202011522695 A CN202011522695 A CN 202011522695A CN 112540838 B CN112540838 B CN 112540838B
- Authority
- CN
- China
- Prior art keywords
- server
- micro
- application
- application micro
- historical behavior
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 63
- 230000006399 behavior Effects 0.000 claims description 64
- 238000012545 processing Methods 0.000 claims description 23
- 238000012544 monitoring process Methods 0.000 claims description 15
- 230000006870 function Effects 0.000 claims description 7
- 238000005516 engineering process Methods 0.000 abstract description 10
- 230000008569 process Effects 0.000 description 14
- 238000004590 computer program Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 238000004364 calculation method Methods 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000003542 behavioural effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000005059 dormancy Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000012466 permeate Substances 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
Abstract
The invention discloses a system resource scheduling method, which comprises the following steps: receiving a registration request sent by an application micro server, registering the application micro server according to the registration request, and generating registration information of the application micro server; when receiving a data update notification sent by the application micro server, reading historical behavior log data corresponding to the application micro server from a shared space according to the registration information; acquiring a system state report according to historical behavior log data corresponding to the application micro server; and scheduling the system resources by adopting a preset resource scheduling rule based on the system state report. The invention also discloses a system resource scheduling device and a computer storage medium, which solve the problem that the micro-service technology cannot normally operate due to insufficient system resources in the prior art, and improve the efficiency and the performance of the software information system.
Description
Technical Field
The present invention relates to the field of system resource management technologies, and in particular, to a system resource scheduling method, a system resource scheduling device, and a computer storage medium.
Background
The existing micro-service technology is widely applied to large commercial information systems and customized platforms of B2B, and gradually permeates into edge computing and Internet of things products, and then the existing micro-service management technologies such as docker, kubernetes, dubbo, zookeeper are applied, so that the problems of deployment, monitoring, resource scheduling and the like of the micro-service are greatly solved; however, at the same time, the requirements of the technologies on the configuration and performance of hardware resources are very high, only some large information systems are actually adopted, and the application is not very large for small and medium information systems, edge computing gateways and intelligent terminals, mainly because the hardware resources of the information systems are limited, most of the resources are preferentially used for service processing, and the rest of the resources are insufficient to support the normal operation of similar huge micro-service technologies, and the adoption of the technologies can bring negative effects on the aspects of system performance and the like.
Therefore, it is important to design a system resource scheduling method to improve the efficiency and performance of a software information system.
Disclosure of Invention
The invention mainly aims to provide a system resource scheduling method, a system resource scheduling device and a computer storage medium, and aims to solve the problem that the micro-service technology cannot normally operate due to insufficient system resources in the prior art.
In order to achieve the above object, the present invention provides a system resource scheduling method applied to at least one application micro server and at least one application micro server, in an embodiment, the system resource scheduling method includes the following steps:
receiving a registration request sent by an application micro server, registering the application micro server according to the registration request, and generating registration information of the application micro server;
when receiving a data update notification sent by the application micro server, reading historical behavior log data corresponding to the application micro server from a shared space according to the registration information;
acquiring a system state report according to historical behavior log data corresponding to the application micro server;
and scheduling the system resources by adopting a preset resource scheduling rule based on the system state report.
In an embodiment, the receiving a registration request sent by the application micro server, before registering the application micro server according to the registration request, includes:
acquiring configuration information of a management micro-server, and determining an application micro-server to be monitored according to the configuration information;
and sending the registration request of the application micro server needing to be monitored to the management micro server.
In an embodiment, the registration information is obtained by the application micro server reading configuration information of the management micro server.
In an embodiment, before receiving the data update notification sent by the application micro server, the method includes:
acquiring historical behavior log data of an application micro-server, and transmitting the historical behavior log data to a shared space;
and carrying out data update on the shared space by adopting the historical behavior log data, generating a data update notification, and sending the data update notification to the management micro-server.
In one embodiment, the historical behavioral log data includes: message information, interrupt information, and interrupted resource information.
In an embodiment, the obtaining the system status report according to the historical behavior log data corresponding to the application micro server includes:
acquiring historical behavior log data in a shared space, and counting the historical behavior log data to generate statistical information;
and analyzing the use condition of the system resources according to the statistical information and generating a system state report.
In one embodiment, the system resource operation report includes at least: the utilization rate of system resources, the message processing efficiency and the dependency relationship of application micro services.
In an embodiment, the scheduling the system resource by using a preset resource scheduling rule based on the system status report includes: and according to the system resource operation report, carrying out cold scheduling or hot scheduling on the system resources by adopting a preset resource scheduling rule according to the hardware configuration of the system or the priority of the application micro-service.
In order to achieve the above object, the present invention also provides a system resource scheduling apparatus, which includes a memory, a processor, and a system resource scheduler stored in the memory and executable on the processor, the system resource scheduler implementing the steps of the system resource scheduling method as described above when executed by the processor.
To achieve the above object, the present invention also provides a computer storage medium storing a system resource scheduler which, when executed by a processor, implements the steps of the system resource scheduling method as described above.
The system resource scheduling method and system, the system resource scheduling device and the computer storage medium provided by the invention have at least the following technical effects:
because the configuration information of the management micro server is acquired, the application micro server needing to be monitored is determined according to the configuration information, the registration request of the application micro server needing to be monitored is sent to the management micro server, the registration request sent by the application micro server is received, the application micro server is registered according to the registration request, the registration information of the application micro server is generated, the historical behavior log data of the application micro server is acquired, the historical behavior log data is sent to a shared space, the data of the shared space is updated by adopting the historical behavior log data, the lightweight management of an information system is realized, and the registration of the management micro server can be omitted for micro services needing not to be monitored.
And when the data update notification sent by the application micro server is received, reading historical behavior log data corresponding to the application micro server from a shared space according to the registration information, acquiring a system state report according to the historical behavior log data corresponding to the application micro server, and scheduling system resources by adopting a preset resource scheduling rule based on the system state report.
Drawings
Fig. 1 is a schematic structural diagram of a system resource scheduling device according to an embodiment of the present invention;
FIG. 2 is a flowchart of a system resource scheduling method according to a first embodiment of the present invention;
FIG. 3 is a flowchart illustrating a second embodiment of a system resource scheduling method according to the present invention;
FIG. 4 is a flowchart illustrating a third embodiment of a system resource scheduling method according to the present invention;
FIG. 5 is a detailed flowchart of step S370 of the third embodiment of the system resource scheduling method of the present invention;
the achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
In order to solve the problem that the micro service technology cannot normally operate due to insufficient system resources in the prior art, the method comprises the steps of receiving a registration request sent by an application micro service end, registering the application micro service end according to the registration request, and generating registration information of the application micro service end; when receiving a data update notification sent by the application micro server, reading historical behavior log data corresponding to the application micro server from a shared space according to the registration information; acquiring a system state report according to historical behavior log data corresponding to the application micro server; based on the system state report, a technical scheme of scheduling system resources by adopting a preset resource scheduling rule is adopted, so that the efficiency and performance of the software information system are improved.
In order to better understand the above technical solution, exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Those skilled in the art will appreciate that the system resource scheduler structure shown in fig. 1 does not constitute a limitation of the system resource scheduler, and that the system resource scheduler may include more or fewer components than shown, or may combine certain components, or may have a different arrangement of components.
The processor 1100 may be an integrated circuit chip with signal processing capabilities. In implementation, the steps of the methods described above may be performed by integrated logic circuitry in hardware or instructions in software in processor 1100. The processor 1100 described above may be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The software modules may be located in a computer storage medium well known in the art such as random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, and the like. The computer storage medium is located in the memory 1200, and the processor 1100 reads information in the memory 1200, and in combination with its hardware, performs the steps of the method described above.
It is to be appreciated that memory 1200 in embodiments of the invention may be volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The nonvolatile Memory may be a Read Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable EPROM (EEPROM), or a flash Memory. The volatile memory may be random access memory (Random Access Memory, RAM) which acts as an external cache. By way of example, and not limitation, many forms of RAM are available, such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (Double Data Rate SDRAM), enhanced SDRAM (ESDRAM), synchronous DRAM (SLDRAM), and Direct RAM (DRRAM). The memory 1200 of the systems and methods described in embodiments of the present invention is intended to comprise, without being limited to, these and any other suitable types of memory.
In an embodiment of the present application, the processor 1100 may be configured to invoke a system resource scheduler stored in the memory 1200 and perform the following operations:
receiving a registration request sent by an application micro server, registering the application micro server according to the registration request, and generating registration information of the application micro server;
when receiving a data update notification sent by the application micro server, reading historical behavior log data corresponding to the application micro server from a shared space according to the registration information;
acquiring a system state report according to historical behavior log data corresponding to the application micro server;
and scheduling the system resources by adopting a preset resource scheduling rule based on the system state report.
In an embodiment of the present application, the processor 1100 may be configured to invoke a system resource scheduler stored in the memory 1200 and perform the following operations:
acquiring configuration information of a management micro-server, and determining an application micro-server to be monitored according to the configuration information;
and sending the registration request of the application micro server needing to be monitored to the management micro server.
In an embodiment of the present application, the processor 1100 may be configured to invoke a system resource scheduler stored in the memory 1200 and perform the following operations:
acquiring historical behavior log data of an application micro-server, and transmitting the historical behavior log data to a shared space;
and carrying out data update on the shared space by adopting the historical behavior log data, generating a data update notification, and sending the data update notification to the management micro-server.
In an embodiment of the present application, the processor 1100 may be configured to invoke a system resource scheduler stored in the memory 1200 and perform the following operations:
acquiring historical behavior log data in a shared space, and counting the historical behavior log data to generate statistical information;
and analyzing the use condition of the system resources according to the statistical information and generating a system state report.
In an embodiment of the present application, the processor 1100 may be configured to invoke a system resource scheduler stored in the memory 1200 and perform the following operations:
and according to the system resource operation report, carrying out cold scheduling or hot scheduling on the system resources by adopting a preset resource scheduling rule according to the hardware configuration of the system or the priority of the application micro-service.
Since the system resource scheduling device provided in the embodiments of the present application is a system resource scheduling device used for implementing the method in the embodiments of the present application, based on the method described in the embodiments of the present application, a person skilled in the art can understand the specific structure and the deformation of the system resource scheduling device, and therefore, the detailed description thereof is omitted herein. All the system resource scheduling devices adopted by the method of the embodiment of the application belong to the scope of protection required by the application. The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
For a software implementation, the techniques described in embodiments of the present invention may be implemented by modules (e.g., procedures, functions, and so on) that perform the functions described in embodiments of the present invention. The software codes may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.
Based on the above-described structure, an embodiment of the present invention is presented.
Referring to fig. 2, fig. 2 is a flowchart of a first embodiment of a system resource scheduling method according to the present invention, including the following steps:
step S110, receiving a registration request sent by an application micro server, registering the application micro server according to the registration request, and generating registration information of the application micro server.
In this embodiment, the whole micro service or process may be divided into three states, one is that the service or process of the system is in a dormant state, the service in this state has low access to the system resources, the resource occupancy rate of the system is low, one is that the service or process of the system is in an operating state, the service in this state has high access to the system resources, the resource occupancy rate of the system is also high, the other is that the service or process of the system is in a waiting state, the service in this state has queued access to the system resources, and the system resources are in a high-speed running state.
In this embodiment, all micro services of the system may be regarded as a micro service list, including one or more management micro service terminals and a series of application micro service terminals, where in this application, the management micro service terminal implements monitoring and management of system resources, and the application micro service terminal implements various service requirements.
In this embodiment, the registration request is a registration request sent by the application microservice to the management microservice; the registration information is obtained by reading the configuration information of the management micro server by the application micro server, and instead of sending the registration information of the application micro server to the management micro server, the registration information is registered in a memory area of the application micro server by reading the configuration information of the management micro server, such as service information, API information and the like of the management micro server, so that a relation between registration and a reflection table is embodied, wherein the management micro server supports a plurality of application micro services, a registration table is formed after the final registration is completed, and the configuration information of all the management micro server is stored in the registration table.
In this embodiment, registering an application micro service of an application micro service end that satisfies a registration condition in a registry of a management micro service end is to implement a process of monitoring an agent, where the monitoring agent is designed and implemented by combining features of an operating system with the monitoring agent, where the monitoring agent has a data area for storing monitored real-time data, and the data area is cleaned regularly, so that frequent notification of the management micro service end is avoided, system performance is consumed, excessive memory resources are avoided, normal service processing is affected, the data area is properly controlled according to a condition requiring hardware, and event notification of each application micro service can be implemented by using a unified message management component, so that an interface is unified, and management is simplified.
Step S120, when receiving the data update notification sent by the application micro server, reading, according to the registration information, historical behavior log data corresponding to the application micro server from a shared space.
In this embodiment, the historical behavior log data is monitoring agent real-time monitoring data, such as event processing data, interrupt processing data, hardware access data, etc., and these data are stored in a data area of the shared space, where the historical behavior log data includes message information, interrupt information, and interrupted resource information; the application requires that the monitoring data of each application micro-service, namely the historical behavior log data, have a standard data format and identification, so that the management micro-service end can process the monitoring data of different application micro-services in a unified mode.
In this embodiment, after the management micro server is initialized, the management micro server enters a semi-dormant or fully dormant state, and is not awakened to enter a working state until a notification event of applying the micro service is received; when the application micro-service registration is completed, the application micro-service sends the historical behavior log data of the application micro-service to a data area of the data sharing space, and meanwhile, the application micro-service sends an event notification message to the management micro-service to notify the management micro-service that the historical behavior log data stored in the data area of the application micro-service sharing space is updated, and the management micro-service reads the historical behavior log data corresponding to the application micro-service from the sharing space after receiving the notification, so that the shared space is accessed.
Step S130, acquiring a system state report according to the historical behavior log data corresponding to the application micro server.
In this embodiment, the system resource operation report includes at least: the utilization rate of system resources, the message processing efficiency and the dependency relationship of application micro-services; the management micro server acquires historical behavior log data in the shared space according to a sender applying the event of the micro server, counts the historical behavior log data to generate statistical information, analyzes the use condition of system resources according to the statistical information and generates a system state report, and the specific analysis process is as shown in step S371 to step S372, which is not repeated here.
Step S140, scheduling system resources by adopting a preset resource scheduling rule based on the system status report.
In this embodiment, rescheduling system resources according to the generated system resource operation report, and performing cold scheduling or hot scheduling of system resources by adopting a preset resource scheduling rule according to the hardware configuration situation of the system or the priority of application micro-services, mainly managing and scheduling services in a waiting state; for example, the preset resource scheduling rule may be a structure for acquiring a system resource usage condition and a message processing condition in a system resource operation report, for example, hardware IO is in a high load state, and 20% of application micro services in the related application micro services may be rescheduled according to a 2:8 rule, so that the system is in a relatively balanced state, and other micro services may access to corresponding hardware resources.
In this embodiment, for a multi-core operating system, processing and accessing of a plurality of system application micro services are performed simultaneously, which has little influence on the operation of the system, and service resource migration can be implemented in a hot scheduling manner; for a single-core operating system, when some application micro-services are terminated at the same time and some application micro-services are restarted, the micro-services can be transferred in a mode of not influencing the running of the micro-services by adopting a cold scheduling mode, so that messages and events of other services can be processed in time; in the application, a scheduling log is generated according to a scheduling process and a scheduling result, and the scheduling log is used for secondary analysis and system improvement of system resources; and after the management micro server finishes processing the current event, entering a dormant state, and waiting for the next round of event processing and resource analysis statistics.
The management micro-service end receives the event notification information of the application micro-service, then starts a working mode, reads data in a data area of the shared space, respectively carries out statistical calculation on the monitored data, further outputs the monitoring information as a system state report according to a calculation result and a scheduling policy in combination with an analysis policy, and schedules system resources according to the state report and the scheduling policy, thereby realizing the lightweight management of an information system.
Referring to fig. 3, fig. 3 is a flowchart of a second embodiment of the system resource scheduling method according to the present invention, which includes the following steps:
step S210, obtaining configuration information of the management micro server, and determining an application micro server needing to be monitored according to the configuration information.
In this embodiment, after the system is started, the application microservices register with the management microservices, after the system is started, the management microservices are preferentially started, and management microservices are initialized, wherein the number of the management microservices is 1 or more, if the number of the management microservices is more than 1, each management microservices is respectively responsible for management tasks with different authorities, such as management tasks of performance statistics, resource scheduling and the like, and at this time, after the management microservices are initialized, the management microservices enter a semi-dormancy state or a complete dormancy state; starting an application micro-server, registering the application micro-server to a management micro-server, wherein the application micro-server performs an initialization task, reads configuration information of the management micro-server, adds the configuration information of the management micro-server such as service information and API information into a registration queue of the application micro-server, the registration queue supports a plurality of centralized or asynchronous management micro-service registrations, generates a corresponding monitoring agency, determines the application micro-server to be detected according to the acquired configuration information of the management micro-server, and determines whether the application micro-service needs micro-service management by judging whether the application micro-service needs micro-service management or not, wherein the process is equivalent to a traversing process, and if so, the application micro-service registers to the management micro-server; if not, the application micro-service executes the self business process, including the initialization of the business process and the resource application, and enters a normal task execution state until the execution of the application micro-service business process is completed.
Step S220, sending a registration request of the application micro server to be monitored to the management micro server.
In this embodiment, after all the application micro services are traversed, the application micro services to be monitored are determined, at this time, the application micro services to be monitored send a registration request to the management micro service end, and request to be monitored, because there may be a plurality of application micro services to be monitored, they are added to the registry, each application micro service in the registry has a service priority, and the running sequence of the application micro services is determined according to the service priority.
Step S230, a registration request sent by an application micro server is received, the application micro server is registered according to the registration request, and registration information of the application micro server is generated.
Step S240, when receiving the data update notification sent by the application micro server, reading, according to the registration information, historical behavior log data corresponding to the application micro server from a shared space.
Step S250, acquiring a system state report according to the historical behavior log data corresponding to the application micro server.
Step S260, based on the system status report, adopting a preset resource scheduling rule to schedule the system resource.
Compared with the first embodiment, the second embodiment has steps S210 to S220 added thereto, and other steps are the same as those of the first embodiment, and will not be described again.
The beneficial effects are that:
referring to fig. 4, fig. 4 is a flowchart of a third embodiment of the system resource scheduling method according to the present invention, which includes the following steps:
step S310, obtaining configuration information of the management micro server, and determining the application micro server needing to be monitored according to the configuration information.
Step S320, sending a registration request of the application micro server to be monitored to the management micro server.
Step S330, a registration request sent by an application micro server is received, the application micro server is registered according to the registration request, and registration information of the application micro server is generated.
Step S340, acquiring historical behavior log data of the application micro server, and sending the historical behavior log data to a shared space.
In this embodiment, after the registration of the application micro service is completed, the application micro service sends its own historical behavior log data to the data area of the data sharing space, and in this application, the application micro service is used as an event proxy unit for hardware interrupt, software interrupt and system scheduling, and in the working state, registers its own processing information and hardware interrupt information into the sharing space, including information, interrupt information, interrupted resource information, and the like.
And step S350, carrying out data update on the shared space by adopting the historical behavior log data, generating a data update notification, and sending the data update notification to the management micro server.
In this embodiment, the application microservice sends and stores the historical behavior log data in real time in the shared space, and updates the data in the shared space so as to monitor the management microservice, and at the same time, the application microservice generates a data update notification, and sends the historical behavior log data in the shared space to the management microservice through an event notification to update the historical behavior log data.
Step S360, when receiving the data update notification sent by the application micro server, reading the historical behavior log data corresponding to the application micro server from the shared space according to the registration information.
Step S370, acquiring a system state report according to the historical behavior log data corresponding to the application micro server.
Referring to fig. 5, fig. 5 is a detailed flowchart of step S370 of the third embodiment of the system resource scheduling method of the present invention, which includes the following steps:
step S371, obtaining historical behavior log data in the shared space, and counting the historical behavior log data to generate statistical information.
In this embodiment, the management micro server obtains the historical behavior log data in the shared space, and performs statistical calculation on the historical behavior log data, wherein an algorithm for statistical calculation can be issued to the management micro server in a template manner, and the algorithm performs corresponding configuration according to different hardware conditions, processing speeds and memory sizes, and performs configuration in combination with actual requirements; for example: the statistics of the occurrence times of different message events in the system in unit time is assumed, a is the occurrence times of the message 1, b, c and d are the occurrence times of the messages 2, 3 and 4 respectively, t is the statistics time period, and (a+b+c+d)/t is used for representing the occurrence times of the different message events in the system in unit time, so that the management micro server performs corresponding historical behavior log data processing and calculation according to a configured statistics algorithm to further form statistics information.
Step S372, analyzing the use condition of the system resources according to the statistical information and generating a system state report.
In this embodiment, the resource statistics is calculated, and after the calculation is completed, the analysis is triggered, and whether the current system resource is in a rule definition is determined, where the rule definition may also be configured correspondingly according to different hardware conditions, processing speed, and memory size, and define in combination with actual requirements, for example, when (a+b+c+d)/t is greater than 6, it indicates that the system is in a high load, and when the system is in a normal state, it indicates that the system is in a high load, rescheduling the micro service by soft interrupt or other modes, so as to implement reasonable deployment of the micro service, and in addition, generate a system resource operation report, including the utilization rate of the resource, the message processing efficiency, the dependency relationship of the service, and so on, thereby helping information system research personnel to improve the performance of the micro service.
Because the technical scheme of acquiring the historical behavior log data in the shared space, counting the historical behavior log data to generate statistical information, analyzing the service condition of system resources according to the statistical information and generating a system state report is adopted, the corresponding adjustment is carried out on the data in the system state report, the problem that the micro-service technology cannot normally operate due to insufficient system resources in the prior art is solved, and the efficiency and the performance of the software information system are improved.
Step S380, based on the system state report, adopting a preset resource scheduling rule to schedule the system resources.
Compared with the second embodiment, the third embodiment has steps S340 to S350, S371 to S372, and other steps are the same as those of the first embodiment, and will not be repeated.
The method comprises the steps of acquiring configuration information of a management micro server, determining an application micro server to be monitored according to the configuration information, sending a registration request of the application micro server to be monitored to the management micro server, receiving the registration request sent by the application micro server, registering the application micro server according to the registration request, generating registration information of the application micro server, acquiring historical behavior log data of the application micro server, sending the historical behavior log data to a shared space, carrying out data update on the shared space by adopting the historical behavior log data, generating a data update notification, sending the data update notification to the management micro server, reading historical behavior log data corresponding to the application micro server from the shared space according to the registration information when the data update notification sent by the application micro server is received, acquiring a system state report according to the historical behavior log data corresponding to the application micro server, and adopting a preset resource scheduling rule based on the system state report.
Based on the same inventive concept, the embodiments of the present application further provide a system resource scheduling device, where the device includes one or more processors, a memory, and a system resource scheduler stored in the memory and capable of running on the processor, where each step of the system resource scheduler method described above is implemented when the processor executes the system resource scheduler, and the same technical effect can be achieved, so that repetition is avoided and redundant description is omitted herein.
Since the system resource scheduling device provided in the embodiments of the present application is a system resource scheduling device used for implementing the method in the embodiments of the present application, based on the method described in the embodiments of the present application, a person skilled in the art can understand the specific structure and the deformation of the system resource scheduling device, and therefore, the detailed description thereof is omitted herein. All the system resource scheduling devices adopted by the method of the embodiment of the application belong to the scope of protection required by the application. The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
Based on the same inventive concept, the embodiments of the present application further provide a computer storage medium, where the computer storage medium stores a system resource scheduler, where each step of the system resource scheduling method described above is implemented when the system resource scheduler is executed by a processor, and the same technical effects can be achieved, so that repetition is avoided, and no redundant description is given here.
Because the computer storage medium provided in the embodiments of the present application is a computer storage medium used for implementing the method in the embodiments of the present application, based on the method described in the embodiments of the present application, a person skilled in the art can understand the specific structure and the modification of the computer storage medium, and therefore, the details are not repeated herein. All computer storage media used in the methods of the embodiments of the present application are within the scope of the present application.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the invention may take the form of a computer program product embodied on one or more computer-usable computer storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, third, etc. do not denote any order. These words may be interpreted as names.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (7)
1. A system resource scheduling method, applied to at least one management micro server, the method comprising:
receiving a registration request sent by an application micro-server, registering the application micro-server according to the registration request, and generating registration information of the application micro-server, wherein the registration information is obtained by the application micro-server by reading configuration information of a management micro-server, so that the application micro-server registers an application micro-service meeting registration conditions into a registry of the management micro-server, and a monitoring agent is realized, and the monitoring agent has the functions of monitoring event processing, interrupt processing and hardware access of the application micro-service;
acquiring historical behavior log data of an application micro server, and sending the historical behavior log data to a shared space, wherein the historical behavior log data comprises message information, interrupt information and interrupted resource information;
adopting the historical behavior log data to update the data of the shared space, generating a data update notification, and sending the data update notification to the management micro server;
when receiving a data update notification sent by the application micro server, reading historical behavior log data corresponding to the application micro server from a shared space according to the registration information;
acquiring a system state report according to historical behavior log data corresponding to the application micro server;
and scheduling the system resources by adopting a preset resource scheduling rule based on the system state report.
2. The system resource scheduling method of claim 1, wherein the receiving a registration request sent by an application micro server, before registering the application micro server according to the registration request, includes:
acquiring configuration information of a management micro-server, and determining an application micro-server to be monitored according to the configuration information;
and sending the registration request of the application micro server needing to be monitored to the management micro server.
3. The system resource scheduling method of claim 1, wherein the obtaining the system status report according to the historical behavior log data corresponding to the application micro server comprises:
acquiring historical behavior log data in a shared space, and counting the historical behavior log data to generate statistical information;
and analyzing the use condition of the system resources according to the statistical information and generating a system state report.
4. The system resource scheduling method of claim 3, wherein the system resource operation report includes at least: the utilization rate of system resources, the message processing efficiency and the dependency relationship of application micro services.
5. The system resource scheduling method of claim 1, wherein the scheduling system resources using a preset resource scheduling rule based on the system status report comprises: and according to the system resource operation report, carrying out cold scheduling or hot scheduling on the system resources by adopting a preset resource scheduling rule according to the hardware configuration of the system or the priority of the application micro-service.
6. A system resource scheduling apparatus comprising a memory, a processor and a system resource scheduler stored in the memory and operable on the processor, the system resource scheduler when executed by the processor implementing the steps of the system resource scheduling method of any of claims 1-5.
7. A computer storage medium storing a system resource scheduler which when executed by a processor performs the steps of the system resource scheduling method of any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011522695.1A CN112540838B (en) | 2020-12-18 | 2020-12-18 | System resource scheduling method and device and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011522695.1A CN112540838B (en) | 2020-12-18 | 2020-12-18 | System resource scheduling method and device and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112540838A CN112540838A (en) | 2021-03-23 |
| CN112540838B true CN112540838B (en) | 2024-04-09 |
Family
ID=75019442
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011522695.1A Active CN112540838B (en) | 2020-12-18 | 2020-12-18 | System resource scheduling method and device and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112540838B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000235499A (en) * | 1999-02-15 | 2000-08-29 | Fujitsu Ltd | System operation management device |
| CN103533654A (en) * | 2013-08-14 | 2014-01-22 | 华为技术有限公司 | Method and equipment for allocating code channel resources |
| WO2017067230A1 (en) * | 2015-10-21 | 2017-04-27 | 中兴通讯股份有限公司 | Software function expansion method and apparatus based on micro service architecture |
| CN110971449A (en) * | 2019-10-25 | 2020-04-07 | 武汉烽火众智数字技术有限责任公司 | Service management and control system based on micro-service architecture |
| CN111309270A (en) * | 2020-03-13 | 2020-06-19 | 清华大学 | Persistent memory key value storage system |
| CN111935286A (en) * | 2020-08-12 | 2020-11-13 | 创意信息技术股份有限公司 | Micro-service framework for software development and construction method thereof |
| WO2020237797A1 (en) * | 2019-05-31 | 2020-12-03 | 烽火通信科技股份有限公司 | Dynamic configuration management method and system in microservice framework |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150095078A1 (en) * | 2013-09-27 | 2015-04-02 | International Business Machines Corporation | Resource scheduling based on historical success rate |
| US10783046B2 (en) * | 2016-11-22 | 2020-09-22 | Nutanix, Inc. | Executing resource management operations in distributed computing systems |
| US10469600B2 (en) * | 2017-11-14 | 2019-11-05 | Dell Products, L.P. | Local Proxy for service discovery |
| US11057487B2 (en) * | 2019-05-17 | 2021-07-06 | Citrix Systems, Inc. | Systems and methods for recording metadata about microservices for requests to the microservices |
-
2020
- 2020-12-18 CN CN202011522695.1A patent/CN112540838B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000235499A (en) * | 1999-02-15 | 2000-08-29 | Fujitsu Ltd | System operation management device |
| CN103533654A (en) * | 2013-08-14 | 2014-01-22 | 华为技术有限公司 | Method and equipment for allocating code channel resources |
| WO2017067230A1 (en) * | 2015-10-21 | 2017-04-27 | 中兴通讯股份有限公司 | Software function expansion method and apparatus based on micro service architecture |
| WO2020237797A1 (en) * | 2019-05-31 | 2020-12-03 | 烽火通信科技股份有限公司 | Dynamic configuration management method and system in microservice framework |
| CN110971449A (en) * | 2019-10-25 | 2020-04-07 | 武汉烽火众智数字技术有限责任公司 | Service management and control system based on micro-service architecture |
| CN111309270A (en) * | 2020-03-13 | 2020-06-19 | 清华大学 | Persistent memory key value storage system |
| CN111935286A (en) * | 2020-08-12 | 2020-11-13 | 创意信息技术股份有限公司 | Micro-service framework for software development and construction method thereof |
Non-Patent Citations (1)
| Title |
|---|
| 机群环境中基于信度模型的作业调度算法;张树东等;《北京航空航天大学学报》(第11期);第1097-1100页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112540838A (en) | 2021-03-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019128535A1 (en) | Message management method and device, and storage medium | |
| CN109656782A (en) | Visual scheduling monitoring method, device and server | |
| WO2021190087A1 (en) | Task execution method, device and system, and server | |
| US20170329655A1 (en) | Method and apparatus of unloading out of memory processing flow to user space | |
| CN109117280B (en) | Electronic device, method for limiting inter-process communication thereof and storage medium | |
| CN110012062B (en) | Multi-computer-room task scheduling method and device and storage medium | |
| WO2020238989A1 (en) | Method and apparatus for scheduling task processing entity | |
| CN111427751A (en) | Method and system for processing service based on asynchronous processing mechanism | |
| CN114595186B (en) | Inter-core communication method and communication device of multi-core processor | |
| CN112181621A (en) | Task scheduling system, method, equipment and storage medium | |
| US8132171B2 (en) | Method of controlling thread access to a synchronization object | |
| CN111190854A (en) | Communication data processing method, device, equipment, system and storage medium | |
| CN112860387A (en) | Distributed task scheduling method and device, computer equipment and storage medium | |
| CN114153635A (en) | Message processing method, device, storage medium and computer equipment | |
| CN112540838B (en) | System resource scheduling method and device and computer storage medium | |
| CN112395062A (en) | Task processing method, device, equipment and computer readable storage medium | |
| CN111475312B (en) | Message driving method and device based on real-time operating system | |
| CN111831408A (en) | Asynchronous task processing method and device, electronic equipment and medium | |
| CN111597056A (en) | Distributed scheduling method, system, storage medium and device | |
| CN112486638A (en) | Method, apparatus, device and storage medium for executing processing task | |
| CN112445597B (en) | Timing task scheduling method and device | |
| CN116069500A (en) | Model training task processing method and device, electronic equipment and readable medium | |
| CN112948096A (en) | Batch scheduling method, device and equipment | |
| CN109062707B (en) | Electronic device, method for limiting inter-process communication thereof and storage medium | |
| Rao et al. | Development of scheduler for real time and embedded system domain |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |