WO2021042373A1 - Data processing and task scheduling method, device and system, and storage medium - Google Patents

Data processing and task scheduling method, device and system, and storage medium Download PDF

Info

Publication number
WO2021042373A1
WO2021042373A1 PCT/CN2019/104727 CN2019104727W WO2021042373A1 WO 2021042373 A1 WO2021042373 A1 WO 2021042373A1 CN 2019104727 W CN2019104727 W CN 2019104727W WO 2021042373 A1 WO2021042373 A1 WO 2021042373A1
Authority
WO
WIPO (PCT)
Prior art keywords
power consumption
data
performance
physical device
kernel
Prior art date
Application number
PCT/CN2019/104727
Other languages
French (fr)
Chinese (zh)
Inventor
陶原
卢毅军
李栈
宋军
奉有泉
赵旭
陈钢
Original Assignee
阿里巴巴集团控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司 filed Critical 阿里巴巴集团控股有限公司
Priority to CN201980095635.5A priority Critical patent/CN113748398B/en
Priority to PCT/CN2019/104727 priority patent/WO2021042373A1/en
Publication of WO2021042373A1 publication Critical patent/WO2021042373A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Definitions

  • This application relates to the field of data processing technology, and in particular to a data processing and task scheduling method, device, system and storage medium.
  • DVFS Dynamic Voltage Frequency Scaling
  • C-mode C-state
  • These power consumption management mechanisms are related to some device parameters, and some device parameters may have multiple values.
  • the power consumption management mechanism can produce different energy-saving effects under different parameter values. How to reasonably set the parameter values of the power consumption management mechanism in an efficient and low-cost manner so that the power consumption management mechanism can produce a better or optimal energy-saving effect is a problem faced by the existing power consumption management mechanism.
  • Various aspects of the present application provide a data processing and task scheduling method, device, system, and storage medium, which are used to efficiently and reasonably set the parameter values of the power consumption management mechanism and reduce costs.
  • An embodiment of the application provides a data processing method, including: determining at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device from the kernel parameters of the physical device; Describe the performance data and power consumption data under multiple value combinations corresponding to at least one core parameter, where at least some of the performance data and power consumption data under the value combination are estimated based on the performance-power consumption prediction model; Determine the target value combination corresponding to the at least one kernel parameter according to the performance data and power consumption data of the physical device under the multiple value combinations; determine the target value combination for the at least one kernel parameter according to the target value combination Setting is made so that the power consumption management mechanism operates according to the value in the target value combination.
  • An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device from the kernel parameters of the physical device; Performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter; perform model training according to the performance data and power consumption data of the physical device under the partial value combination to Obtain a performance-power consumption prediction model; use the performance-power consumption prediction model to predict the performance data and power consumption data of the physical device under other value combinations corresponding to the at least one core parameter.
  • An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to device performance from the kernel parameters of the physical device; and obtaining multiple selections of the physical device corresponding to the at least one kernel parameter.
  • the performance data under the value combination wherein at least part of the performance data under the value combination is estimated based on the performance prediction model; the performance data of the physical device under the multiple value combinations is determined
  • a target value combination corresponding to at least one kernel parameter; the at least one kernel parameter is set according to the target value combination, so that the physical device operates according to the value in the target value combination.
  • An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to device performance from the kernel parameters of the physical device; using a load test tool to test that the physical device corresponds to the at least one kernel parameter The performance data under the partial value combination of the; perform model training according to the performance data of the physical device under the partial value combination to obtain the performance prediction model; use the performance prediction model to predict the physical device Performance data under other value combinations corresponding to the at least one kernel parameter.
  • An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to the power consumption of the device from the kernel parameters of the physical device; and obtaining multiple types of parameters corresponding to the at least one kernel parameter of the physical device.
  • the power data under the value combination wherein at least part of the power data under the value combination is estimated based on the power estimation model; and the power data of the physical device under the multiple value combinations is determined
  • the target value combination corresponding to the at least one kernel parameter; and the at least one kernel parameter is set according to the target value combination, so that the physical device operates according to the value in the target value combination.
  • An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to the power consumption of the device from the kernel parameters of the physical device; using a load test tool to test the physical device in the at least one kernel parameter Corresponding power data under the partial value combination; perform model training according to the power data of the physical device under the partial value combination to obtain a power estimation model; use the power estimation model to estimate the physical Power data of the device under other value combinations corresponding to the at least one kernel parameter.
  • An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device from the kernel parameters of the physical device; Performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter; perform model training according to the performance data and power consumption data of the physical device under the partial value combination to Obtain a performance-power consumption prediction model; use the performance-power consumption prediction model to predict the performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one core parameter; wherein, The multiple value combinations include the partial value combinations.
  • An embodiment of the present application also provides a device management system, including: at least one physical device and at least one model computing device; wherein the at least one physical device supports a kernel-mode power management mechanism; the at least one A model computing device for determining at least one kernel parameter related to the power management mechanism of the kernel state supported by the target device from the kernel parameters of the target device, and obtaining the target device in the target device based on the artificial intelligence model Performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter; the target device is any one of the at least one physical device; the target device is configured to The performance data and power consumption data of the target device under multiple value combinations corresponding to the at least one kernel parameter obtained by the model computing device determine the target value combination corresponding to the at least one kernel parameter, and according to the The target value combination sets the at least one kernel parameter.
  • An embodiment of the present application further provides a data center system, including: a model computing device and at least one computer room, the at least one computer room includes at least one physical device, and the at least one physical device respectively supports a kernel-mode power management mechanism
  • the model computing device is used to determine from the kernel parameters of the target device at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device, and obtain the target device in the target device based on the artificial intelligence model Performance data and power consumption data under multiple value combinations corresponding to the at least one kernel parameter;
  • the target device is any one of the at least one physical device;
  • the target device is configured to The performance data and power consumption data of the target device under multiple value combinations corresponding to the at least one kernel parameter obtained by the model computing device are determined, and the target value combination corresponding to the at least one kernel parameter is determined, and the target value combination is determined according to the The target value combination sets the at least one kernel parameter.
  • An embodiment of the present application also provides a physical device, including: a memory and a processor; the memory is used for storing a computer program; the processor is coupled with the memory and is used for executing the computer program for : From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device; obtain multiple selections of the physical device corresponding to the at least one kernel parameter The performance data and power consumption data under the value combination, wherein at least part of the performance data and power consumption data under the value combination are estimated based on the performance-power consumption prediction model; according to the physical device in the multiple Determine the target value combination corresponding to the at least one core parameter based on the performance data and power consumption data under the value combination; set the at least one core parameter according to the target value combination to enable the power consumption management The mechanism operates according to the value in the target value combination.
  • An embodiment of the present application also provides a model computing device, including: a memory and a processor; the memory is used to store a computer program; the processor is coupled with the memory and is used to execute the computer program for use In: From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel state supported by the physical device; use a load test tool to test the physical device in the at least one kernel parameter corresponding to the at least one kernel parameter.
  • the performance-power consumption prediction model estimates the performance data and power consumption data of the physical device under other value combinations corresponding to the at least one core parameter.
  • the embodiments of the present application also provide a computer-readable storage medium storing a computer program.
  • the processor When the computer program is executed by a processor, the processor is caused to implement the steps in the various data processing methods provided in the embodiments of the present application. .
  • An embodiment of the present application also provides a task scheduling method, including: obtaining the task to be scheduled and the performance requirements of the task to be scheduled; selecting from at least one resource device that meets the performance requirements and the value of the power consumption parameter in the kernel mode meets the design requirements.
  • a resource device with a fixed power consumption requirement schedule the task to be scheduled to a resource device that meets the performance requirements and the value of the power consumption parameter in the kernel mode meets the set power consumption requirement; wherein the value of the kernel power consumption parameter refers to A value combination of at least one kernel parameter related to the power management mechanism of the kernel mode supported by the resource device.
  • An embodiment of the present application also provides a task scheduling device, including: a memory and a processor; the memory is used to store a computer program; the processor is coupled with the memory and is used to execute the computer program for use
  • the scheduling task is scheduled to the resource device that meets the performance requirements and the core-mode power consumption parameter value meets the set power consumption requirement; wherein the core-mode power consumption parameter value refers to the core-mode power management mechanism supported by the resource device
  • the embodiment of the present application also provides a computer-readable storage medium storing a computer program.
  • the processor When the computer program is executed by a processor, the processor is caused to implement the steps in the task scheduling method provided by the embodiment of the present application.
  • the setting operation of the kernel parameters related to the power management mechanism is combined with artificial intelligence, and the performance-power consumption estimation model trained based on the artificial intelligence obtains a variety of choices corresponding to the kernel parameters of the physical device.
  • the performance data and power consumption data under the value combination, and then, based on the obtained performance data and power consumption data, appropriate values can be set for the kernel parameters, taking into account the power consumption and performance of the physical device, and combining with artificial intelligence , Which can improve the efficiency of parameter setting and reduce costs.
  • FIG. 1 is a schematic structural diagram of a data center system provided by an exemplary embodiment of this application;
  • FIG. 2 is a schematic diagram of the principle of kernel parameter setting of a data center system provided by an exemplary embodiment of this application;
  • FIG. 3 is a schematic diagram of the working principle of a performance-power consumption prediction model provided by an exemplary embodiment of this application;
  • FIG. 4a is a schematic structural diagram of a device management system provided by an exemplary embodiment of this application.
  • FIG. 4b is a schematic structural diagram of an edge cloud network system provided by an exemplary embodiment of this application.
  • FIG. 5a is a schematic flowchart of a data processing method provided by an exemplary embodiment of this application.
  • FIG. 5b is a schematic flowchart of another data processing method provided by an exemplary embodiment of this application.
  • FIG. 6a is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application.
  • FIG. 6b is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application.
  • FIG. 7a is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application.
  • FIG. 7b is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application.
  • FIG. 7c is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application.
  • FIG. 7d is a schematic flowchart of a task scheduling method provided by an exemplary embodiment of this application.
  • FIG. 8a is a schematic structural diagram of a physical device provided by an exemplary embodiment of this application.
  • FIG. 8b is a schematic structural diagram of a model computing device provided by an exemplary embodiment of this application.
  • Fig. 8c is a schematic structural diagram of a task scheduling device provided by an exemplary embodiment of this application.
  • the setting operation of the kernel parameters related to the power management mechanism is combined with artificial intelligence, and the performance-power consumption prediction model trained based on artificial intelligence can be obtained
  • the performance data and power consumption data of the physical device under multiple combinations of values corresponding to the kernel parameters.
  • appropriate values can be set for the kernel parameters, taking into account the functions of the physical device. Consumption and performance, combined with artificial intelligence, can improve the efficiency of parameter setting and reduce costs.
  • Fig. 1 is a schematic structural diagram of a data center system provided by an exemplary embodiment of this application.
  • the data center system 100 includes: a model computing device 101 and at least one computer room 102; the at least one computer room 102 includes at least one physical device 103.
  • the machine room 102 refers to a physical place where machinery and equipment are stored, for example, it may be a room or a factory building. This embodiment does not limit the number of physical devices 103 in each computer room 102. Each computer room 102 may include one physical device 103 or multiple physical devices 103. Generally speaking, a computer room 102 will include multiple physical devices 103.
  • the physical device 103 refers to a physical device that has an operating system installed and supports a kernel-mode power management mechanism.
  • the computer room 102 may also contain some devices that do not require an operating system, and some devices that do not support the kernel mode even though the operating system is installed. There are no restrictions on devices with power management mechanisms.
  • the focus is on the physical device 103 that is installed with an operating system and supports a kernel-mode power management mechanism.
  • the device form of the physical device 103 is not limited, and any device form that has an operating system installed and supports a kernel-mode power management mechanism is applicable to the embodiment of the present application.
  • the physical device 103 may be some IT devices installed with an operating system and supporting a kernel-mode power management mechanism, but it is not limited to this.
  • the physical device 103 may include but is not limited to at least one of the following: various server devices, computer devices, and various network switching devices.
  • the server device may include, but is not limited to, a conventional server, a server array, or a cloud server.
  • various applications or services can be run on these physical devices 103, such as cloud computing services, game services, instant messaging services, mail services, or online transaction services.
  • these physical devices 103 may not run any applications or services. Among them, according to whether the physical device 103 runs applications or services, and the type and quantity of running applications or services, the power consumption management mechanism on the physical device 103 will be triggered and play a corresponding role.
  • the operating system is a kind of software that is responsible for controlling the hardware resources of physical devices and providing an environment for upper-level applications to run.
  • the operating system provides two CPU operating states, kernel mode and user mode.
  • User mode is the activity space of upper-level applications.
  • the execution of applications must rely on the resources provided by the operating system, including CPU resources, storage resources, and I/O resources.
  • the power consumption management mechanism of this embodiment is a mechanism provided by the operating system to manage the power consumption of physical devices. It is a power consumption management mechanism at the operating system level and needs to run in the kernel mode, referred to as power consumption in the kernel mode for short. Management mechanism. It is worth noting that the power management mechanisms in the kernel mode supported by different physical devices 103 may be the same or different.
  • the power management mechanism of the kernel mode is related to the operating system. If the operating system of the physical device 103 is different, the power management mechanism of the kernel mode supported by the physical device 103 will also be different. For example, if the physical device 103 adopts the Linux operating system as an example, the power management mechanisms in the kernel state supported by it include, but are not limited to: DVFS and C-state.
  • DVFS is a dynamic technology that dynamically adjusts the operating frequency and voltage of the chip according to the different needs of the application program running on the chip (such as the CPU) for computing power, so as to achieve the purpose of energy saving.
  • the higher the operating frequency the higher the voltage required and the greater the energy consumption.
  • C-state is a low-power mechanism that allows the CPU to enter a low-power state when it is idle.
  • the C-states included in C-states start from C0 to Cn.
  • C0 is the normal operating mode of the CPU, and the CPU is at 100% Running state; the higher the value of n after C, the deeper the CPU sleeps, the lower the power consumption of the CPU, and of course it takes more time to return to the C0 mode; where n is a positive integer.
  • the power management mechanism in the kernel mode is related to some kernel parameters.
  • These kernel parameters are also the parameters of the power management mechanism in the kernel mode.
  • the values of these kernel parameters can affect the energy saving of the power management mechanism in the kernel mode. effect.
  • the kernel parameters generally refer to the parameters in the source code of various operating systems, such as the kernel parameters of the Linux operating system, the kernel parameters of the Windows operating system, the kernel parameters of the UNIX operating system, or the kernel parameters of the MAC operating system.
  • the kernel parameters related to DVFS include but are not limited to: the minimum operating frequency that the CPU can run (denoted as scaling_min_freq), the highest operating frequency that the CPU can run (denoted as scaling_max_freq), and the adjustment mode of the CPU operating frequency (Denoted as scaling_governor); for the physical device 103, the energy saving effect of the DVFS can be changed by adjusting the value of at least one of the three parameters.
  • the kernel parameters related to C-states include, but are not limited to: the entry time threshold corresponding to each level of C mode (denoted as target_residency); where the entry time threshold indicates that the physical device 103 has entered the corresponding C mode at least The time required to stay in this mode is the time condition that the physical device 103 needs to meet to enter the corresponding C mode; for the physical device 103, the difficulty of the CPU entering the corresponding C mode can be changed by adjusting the entry time threshold corresponding to the corresponding C mode. Easy to change the energy-saving effect of the C-states mechanism.
  • the kernel parameters related to it may have multiple values.
  • the maximum operating frequency scaling_max_freq at which the processor can run can be set to 2.4GHZ, 3.6GHZ, and so on.
  • the value of the kernel parameter related to the power management mechanism is different, and the energy saving effect that the power management mechanism can produce will be different.
  • the power consumption of the physical device 103 has a certain relationship with performance. Generally speaking, the lower the power consumption, the worse the performance will be. Therefore, we cannot blindly pursue low power consumption. Ideally, it should be based on application requirements. Balance between power consumption and performance. In different application scenarios, the physical device 103 has different requirements for power consumption and performance.
  • the kernel parameters related to the power management mechanism are system-level parameters and need to be set in the source code of the operating system. Each time the values of these kernel parameters are reset, the operating system needs to be reinstalled, and only when the operating system is running After a certain period of time, it can be judged whether the current value can meet the requirements of the device for power consumption and performance, and whether it needs to be adjusted again. If there are many kernel parameters related to the power management mechanism, the number of value combinations of these kernel parameters will also be larger. If a trial method is adopted to select the best value combination, it will take a long time.
  • the kernel parameter setting operation is combined with artificial intelligence, and based on the artificial intelligence model, the performance data and functions of the physical device 103 under various value combinations corresponding to the relevant kernel parameters are obtained.
  • the kernel parameter settings can not only set appropriate values for the kernel parameters, but also At the same time, it takes into account the requirements of the physical device 103 for power consumption and performance, and the combination with artificial intelligence can improve the efficiency of parameter setting and reduce the cost.
  • a model computing device 101 is added, which is mainly responsible for obtaining the performance data and power consumption data of the physical device 103 under various value combinations corresponding to related kernel parameters.
  • the model computing device 101 for each physical device 103, at least one kernel parameter related to the power management mechanism of the kernel state supported by the physical device 103 can be determined from the kernel parameters of the physical device 103, based on artificial intelligence
  • the model provides the physical device 103 with its performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter, so that the physical device 103 can complete the setting of related kernel parameters accordingly.
  • the model computing device 101 may be set in a certain computer room 102, or be independent of each computer room 102, and be set separately in a certain place, for example, it may be set in the cloud.
  • this embodiment does not limit the device form of the model computing device 101, and may be any computing device with certain computing capabilities and communication capabilities.
  • the model computing device 101 may be a conventional server, a cloud server, a server with a GPU, a server with a specific Ai chip, or a server array, etc.
  • the model computing device 101 may communicate with each physical device 103. After obtaining the performance data and power consumption data of each physical device 103 under multiple value combinations corresponding to the relevant kernel parameters, it may be based on The communication connection between it and each physical device 103 provides each physical device 103 with its performance data and power consumption data under a variety of value combinations corresponding to related kernel parameters. Wherein, the model computing device 101 and each physical device 103 may be wirelessly or wiredly connected. Optionally, the physical device 103 can communicate with the model computing device 101 via a mobile network.
  • the network standard of the mobile network can be 2G (GSM), 2.5G (GPRS), 3G (WCDMA, TD-SCDMA, CDMA2000, UTMS), 4G (LTE), 4G+ (LTE+), 5G, WiMax or coming soon in the future Any of the new network standards, etc.
  • the physical device 103 can also communicate with the model computing device 101 through Bluetooth, WiFi, infrared, zigbee, or NFC.
  • model computing device 101 does not have to establish a communication connection with the physical device 103.
  • some mobile storage devices such as mobile hard disks and U disks can also be used to combine the physical device 103 under various combinations of values corresponding to the relevant kernel parameters.
  • the performance data and power consumption data are copied from the model computing device 101 to the physical device 103.
  • this embodiment takes any physical device 103 as an example, and uses the flowchart shown in FIG. 2 to describe the working principle of the system.
  • the target device is used as an example in the following content to expand the description, and the target device represents any physical device 103.
  • the newly added physical device can be used as the target device.
  • the source code of the operating system can be modified according to the application requirements of the target device. Kernel parameters related to the power management mechanism are set, and the operating system is installed on the target device according to the operating system source code after the parameter setting.
  • the load information such as an application or service
  • the operating system source code and power consumption can be re-modified.
  • the value of the kernel parameter related to the management mechanism, and the operating system is reinstalled for the target device according to the modified operating system source code.
  • the equipment rented and sold to the customer can be used as the target equipment.
  • the target can be set according to the customer’s requirements.
  • the device installs the operating system and sets the kernel parameters related to the power management mechanism in the operating system source code before installing the operating system.
  • the model computing device 101 can determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device from the kernel parameters of the target device.
  • the number of core parameters can be one or more, depending on the power management mechanism.
  • the model computing device 101 may have human-computer interaction capabilities, and may perform human-computer interaction with the administrator of the data center system 100 to determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device .
  • the model computing device 101 can provide a human-computer interaction interface or a command window, and the administrator can input the target device identification and the kernel mode power management mechanism supported by the target device to the model computing device 101 through the human-computer interaction interface or command window.
  • the model computing device 101 determines from the kernel parameters of the target device, at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device.
  • the administrator can input the identification of the target device and the information of the power management mechanism in the kernel mode supported by the target device into the model computing device 101 by voice; the model computing device 101 according to With this information, from the kernel parameters of the target device, at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device is determined.
  • the administrator can also directly input to the model computing device 101 the identification of at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device, such as the parameter name.
  • the model computing device 101 may collect the performance data and power consumption data of the target device under the partial value combination corresponding to the at least one kernel parameter, As sample data, and use these sample data for model training to obtain a performance-power consumption prediction model, as shown in Figure 2.
  • the performance data of the target device will be different according to different services or applications running on the target device.
  • Performance data mainly refers to some data that can reflect the capacity of the target device to undertake the service and guarantee the service. For example, it can be the actually achieved QoS, QPS, TPS, or response time to the request of the service on the target device, and so on.
  • one value combination includes one value; if the number of at least one kernel parameter is more than one, then one value combination includes multiple kernel parameters one by one. Corresponding multiple values, and the multiple values included in different value combinations are not completely the same.
  • the model computing device 101 can use a load test tool to collect performance data and power consumption data of the target device under a partial value combination corresponding to at least one kernel parameter. Install and run the load test tool on the target device.
  • the load test tool can simulate the performance data and power consumption data of the target device under different load conditions.
  • the load test tool is used to obtain the performance data and power consumption data of the target device when the value combination meets the corresponding requirements.
  • the performance data and power consumption data when the corresponding requirements are met under the partial value combination are provided to the model computing device 101.
  • the performance data and power consumption data of the target device when it meets the corresponding requirements under each value combination are referred to as the performance data and power consumption data of the target device under each value combination for short.
  • the process of using the load test tool to obtain the performance data and power consumption data of the target device under the value combination includes: for the value combination, first operate The value of at least one kernel parameter in the system source code is modified to the value in the value combination, and the operating system is installed on the target device according to the modified operating system source code; after the operating system is successfully installed, on the target device Install the load test tool, and use the load test tool to simulate the corresponding load condition and obtain the performance data and power consumption data of the target device under the corresponding load according to the load, power consumption and/or performance requirements that the target device should meet.
  • load testing tools are not limited, and can be flexibly selected according to application requirements, operating system types, and the like.
  • this embodiment lists several load testing tools: Stream testing tool for memory performance testing; Specjbb testing tool for testing CPU performance; Speccpu testing tool for testing CPU performance; Fio testing tool for testing disks IO performance; Sysbench testing tool for testing mysql database performance, etc.
  • a power consumption collection tool such as a fuel gauge can be used to collect power consumption data of the physical device during the testing process.
  • the relevant performance parameters tested by the load test tool and the power consumption data collected by the power consumption collection tool during the test are the performance data and power consumption data of the physical device 103 when it meets the corresponding requirements under a certain combination of values. .
  • the model computing device 101 After obtaining the performance data and power consumption data of the target device under the partial value combination corresponding to at least one kernel parameter, the model computing device 101 uses these data as sample data for model training.
  • the process of model training performed by the model computing device 101 is not limited. For example, it can be a model training process based on a deep neural network, or a model training process based on regression analysis, where at least one kernel parameter can be analyzed.
  • the model training method of the association relationship between the value combination of and the performance data and power consumption data of the target device is applicable to the embodiments of the present application.
  • regression analysis is a statistical analysis method to determine the quantitative relationship between two or more variables, and it is a predictive modeling technique.
  • the model computing device 101 may adopt a modeling method based on regression analysis. Based on this, the process of model training performed by the model computing device 101 is actually a process of performing regression analysis on the performance data and power consumption data of the target device under the partial value combination corresponding to at least one kernel parameter. After regression analysis, at least one The correlation between the value combination corresponding to the kernel parameter and the performance data and power consumption data of the target device is the performance-power consumption prediction model.
  • regression analysis includes linear regression analysis and logistic regression analysis.
  • linear regression analysis is preferred for modeling.
  • the process of model training performed by the model computing device 101 includes: taking partial value combinations corresponding to at least one kernel parameter as an independent variable, and taking the performance data and power consumption data of the target device under the partial value combination as the dependent variable for linearization.
  • the performance-power consumption prediction model is obtained.
  • the performance-power consumption prediction model obtained by this optional embodiment is a linear regression model.
  • the model computing device 101 may use the performance-power consumption prediction model to predict the performance of the target device under other value combinations corresponding to at least one core parameter. Data and power consumption data are shown in Figure 2. Compared with the method of using the load test tool to test, using the performance-power estimation model to estimate the performance data and power consumption data of the target device under other value combinations is much faster and can save a lot of time and cost.
  • the performance data and power consumption data of the target device under other value combinations corresponding to at least one core parameter estimated by the performance-power consumption prediction model are combined with the target device tested by the load test tool in at least one core
  • the performance data and power consumption data under the partial value combinations corresponding to the parameters can obtain the performance data and power consumption data of the target device under multiple value combinations corresponding to at least one core parameter.
  • the “multiple value combinations” here can be all value combinations of at least one kernel parameter, or part of all value combinations of at least one kernel parameter. Regardless of whether “multiple value combinations" are all value combinations of at least one kernel parameter or partial value combinations, “multiple value combinations” include the above “partial value combinations" and "other value combinations”. or,
  • the model computing device 101 may use the performance-power consumption prediction model to estimate that the target device is under multiple value combinations corresponding to at least one kernel parameter Performance data and power consumption data.
  • the “multiple value combinations” here can be all value combinations of at least one kernel parameter, or part of all value combinations of at least one kernel parameter. Regardless of whether “multiple value combinations" are all value combinations of at least one kernel parameter or partial value combinations, “multiple value combinations” include the above “partial value combinations" and "other value combinations”.
  • the model computing device 101 can actively place the target device in at least one core based on the communication connection between it and the target device.
  • the performance data and power consumption data under multiple value combinations corresponding to the parameters are sent to the target device, or, according to the request of the target device, the performance data of the target device under multiple value combinations corresponding to at least one kernel parameter
  • power consumption data are sent to the target device, or the target device can also actively download its performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter to the model computing device 101; or it can also be related
  • the personnel sends the performance data and power consumption data of the target device under multiple value combinations corresponding to at least one kernel parameter to the target device through a mobile storage device and copies them from the model computing device 101 to the target device.
  • the embodiment of the present application does not limit the specific manner in which the target device obtains its performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter.
  • the performance data and power consumption data under multiple value combinations corresponding to at least one core parameter can be obtained, and during the parameter setting process, the multiple values corresponding to at least one core parameter can be used
  • a target value combination corresponding to at least one core parameter is determined, and at least one core parameter is set according to the target value combination.
  • the process of setting at least one kernel parameter according to the target value combination includes: modifying the value of at least one kernel parameter related to the power consumption management mechanism in the operating system source code to the value in the target value combination, and then,
  • the operating system can also be installed on the physical device according to the modified operating system source code.
  • installing the operating system on the physical device according to the modified operating system source code includes: compiling the modified operating system source code to obtain an installation file of the operating system, and running the installation file to complete the installation of the operating system.
  • the specific implementation of determining the target value combination corresponding to at least one core parameter based on the performance data and power consumption data of the target device under multiple value combinations corresponding to at least one core parameter is not limited. the way.
  • the target value combination can be directly determined from the multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations.
  • the power consumption data and/or performance data that the target device actually needs to meet can be obtained; the power consumption data and/or performance data that the target device actually needs to meet can be combined with the target device in multiple values Match the performance data and power consumption data under the following; according to the actual power consumption data and/or performance data that the target device needs to meet with the performance data and power consumption data of the target device under multiple value combinations, from Among the multiple value combinations, a value combination that meets the matching degree requirement is selected as the target value combination.
  • At least one candidate value combination can be selected from multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations; the load test tool is used to test the target device Performance data and power consumption data under at least one candidate value combination; further, according to the performance data and power consumption data of the target device under at least one candidate value combination tested by the load test tool, from at least one candidate value combination Determine the target value combination in the value combination.
  • the load test tool in addition to the performance data and power consumption data of the target device under multiple value combinations, is also combined to improve the accuracy of the final selected target value combination, and is beneficial to Improve the accuracy of parameter settings.
  • the target device in the process of selecting at least one candidate value combination from multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations, can be directly selected according to the target value combination.
  • at least one candidate value combination is selected from the multiple value combinations.
  • the power consumption data and/or performance data that the target device actually needs to meet can be analyzed according to the QoS of the service that the target device actually needs to carry.
  • each service has its own set of standards to measure its own service performance, such as how long it takes for a request to read the database to get a response is acceptable.
  • the power consumption data and/or performance data required by the service deployment user may also be obtained as the power consumption data and/or performance data that the target device actually needs to meet.
  • Service deployment users refer to users who need to deploy services on target devices. Service deployment users have certain requirements for the services they deploy, such as requiring performance to meet a certain standard, or requiring power consumption not to exceed a certain power threshold, etc. Obtain the power consumption data that the target device actually needs to meet from the power consumption requirements, or obtain the performance data that the target device actually needs to meet from the performance requirements.
  • the target device can obtain the power consumption data that it actually needs to meet, and compare the power consumption data that the target device actually needs to meet with the performance data and power consumption data of the target device under a combination of multiple values corresponding to at least one core parameter. Perform matching; from a variety of value combinations, obtain a value combination that has a matching degree with the power consumption data that the target device actually needs to meet and meets the matching degree requirement as a candidate value combination.
  • the power consumption requirements of the target device can be given priority according to application requirements, and the kernel parameters related to the power consumption management mechanism can be set to make the target device meet the power consumption requirements.
  • the target device can obtain the performance data that it actually needs to meet, and compare the performance data that the target device actually needs to meet with the performance data and power consumption data of the target device under multiple combinations of values corresponding to at least one kernel parameter. Matching: From a variety of value combinations, obtain a value combination that has a matching degree with the performance data that the target device actually needs to meet and meets the matching degree requirement as a candidate value combination.
  • the performance requirements of the target device can be prioritized according to application requirements.
  • the target device can meet the power consumption requirements by converting energy consumption to performance.
  • the target device can obtain the power consumption data and performance data that it actually needs to meet, and combine the performance data and power consumption data that the target device actually needs to meet with the target device under a combination of multiple values corresponding to at least one kernel parameter
  • the performance data and power consumption data are matched; from a variety of value combinations, the value combination that meets the matching degree requirements of the power consumption data and the performance data that the target device actually needs to meet is obtained as the candidate value combination.
  • the power consumption and performance requirements of the target device can be considered at the same time, and the power consumption and performance can be taken into consideration by setting the kernel parameters related to the power consumption management mechanism.
  • using a load test tool to test the performance data and power consumption data of the target device under at least one candidate value combination is to use the load test tool to test the performance data of the target device under each candidate value combination. And the process of power consumption data.
  • the process of using a load test tool to test the performance data and power consumption data of the target device under the first candidate value combination includes: modifying the value of at least one kernel parameter in the source code of the operating system For the value in the first candidate value combination, install the operating system on the target device according to the modified operating system source code; run the load test tool on the target device to test the target device under the first candidate value combination Performance data and power consumption data.
  • the first candidate value combination is any one of at least one candidate value combination.
  • the performance data and power consumption data of the target device under the target value combination tested by the load test tool can be used to determine the performance -The power consumption estimation model is revised.
  • the performance data and power consumption data of the target device tested by the load test tool under the target value combination are more in line with the actual requirements, which are used as sample data to modify the performance-power consumption prediction model, which is conducive to improving the performance-power
  • the accuracy of the consumption estimation model makes the estimated performance data and power consumption data more in line with actual requirements.
  • the kernel mode power management mechanism supported by the target device may include: DVFS, then at least one kernel related to DVFS
  • the parameters include: at least one of the lowest operating frequency at which the CPU can run, the highest operating frequency at which the CPU can run, and an adjustment mode of the CPU operating frequency.
  • the model computing device 101 can use the load test tool to test the performance data and power consumption data of the target device under the partial value combination corresponding to these three parameters, and use the target device to test the performance data and power consumption data of the three parameters.
  • the kernel mode power management mechanism supported by the target device includes in addition to DVFS, it can also include: C-state, C-state contains 3 -11 levels of C mode, each level of C mode has its own corresponding entry time threshold. Based on this, at least one kernel parameter not only includes the above three parameters related to DVFS, but also includes the entry time threshold corresponding to the C mode of each level under the C-state.
  • At least one kernel parameter includes the entry time threshold corresponding to the 6 levels of C mode, plus the above 3 parameters required by DVFS, for a total of 9 parameters , Specifically: scaling_min_freq, scaling_max_freq, scaling_governor, Target_residency: C1, Target_residency: C2, Target_residency: C3, Target_residency: C4, Target_residency: C5, and Target_residency: C6.
  • the model computing device 101 can use the load test tool to test the performance data and power consumption data of the target device under the partial value combination corresponding to these 9 parameters, and use the target device to test the performance data and power consumption data of the 9 parameters.
  • Perform model training on the performance data and power consumption data under the corresponding partial value combination to obtain the performance-power consumption estimation model, and then estimate the target device's other values corresponding to these 9 parameters based on the performance-power consumption estimation model Combine the performance data and power consumption data to obtain the performance data and power consumption data of the target device under various value combinations corresponding to these 9 parameters, as shown in Figure 3.
  • the target device can set these 9 parameters based on its performance data and power consumption data under various value combinations corresponding to these 9 parameters.
  • the core state power management mechanism supported by the target device may include DVFS alone, or both DVFS and C-state, or C-state alone.
  • at least one kernel parameter related to the power management mechanism includes: the entry time threshold corresponding to each level of the C mode. If the C-state includes 11 levels of C mode, at least one kernel parameter includes the entry time threshold corresponding to the 11 levels of C mode, for a total of 11 parameters.
  • the model computing device 101 can use the load test tool to test the performance data and power consumption data of the target device under the partial value combinations corresponding to these 11 parameters, and use the performance data of the target device under the partial value combinations corresponding to these 11 parameters.
  • the model computing device 101 can combine the setting operation of the kernel parameters related to the power management mechanism with artificial intelligence, and train the performance-power consumption prediction based on artificial intelligence. Based on the performance-power estimation model, the performance data and power consumption data of the physical device under multiple value combinations corresponding to the relevant kernel parameters are obtained, so that the physical device can use its performance under multiple value combinations Based on the data and power consumption data, the relevant kernel parameters can be set, and appropriate values can be set for the relevant kernel parameters, taking into account the power consumption and performance of the physical device, and the combination of artificial intelligence can improve the efficiency of parameter setting and reduce the cost .
  • the performance-power estimation model is trained by considering the two aspects of power consumption and performance, but not Limited to this.
  • the model computing device 101 can also use In a similar way, the performance prediction model is trained, and the physical device 103 is provided with its performance data under multiple value combinations corresponding to the device performance-related kernel parameters, so that the physical device 103 can use the device performance-related kernel accordingly.
  • the parameters are set.
  • At least one kernel parameter related to the device performance can be determined from the kernel parameters of the physical device; the load test tool is used to test the performance data of the target device under the partial value combination corresponding to the at least one kernel parameter ; Perform model training according to the performance data of the target device under some value combinations to obtain a performance prediction model; use the performance prediction model to predict the performance data of the target device under other value combinations corresponding to at least one kernel parameter.
  • At least one kernel parameter related to device performance can be determined from its kernel parameters; its performance data under multiple value combinations corresponding to at least one kernel parameter can be obtained from the model computing device 101; Determine the target value combination corresponding to at least one kernel parameter from the performance data under multiple value combinations; set at least one kernel parameter according to the target value combination to operate according to the value in the target value combination.
  • the detailed implementation manners or alternative implementation manners of related descriptions can be referred to the foregoing embodiments, and details are not described herein again.
  • the power consumption of the device may be focused on, and the performance requirements of the device are not high or not required. It is necessary to set reasonable values for the kernel parameters related to the power consumption of the device; for this reason, the model computing device 101 also
  • the power consumption estimation model can be trained in a similar manner, and the physical device 103 can be provided with its power consumption data under various combinations of values corresponding to the kernel parameters related to the power consumption of the device, so that the physical device 103 can respond accordingly. Kernel parameters related to device performance are set.
  • At least one kernel parameter related to the power consumption of the device can be determined from the kernel parameters of the physical device; the load test tool is used to test the target device under the partial value combination corresponding to the at least one kernel parameter.
  • the power consumption data of the target device perform model training according to the power consumption data of the target device under partial value combinations to obtain the power consumption estimation model; use the power consumption estimation model to estimate the target device's other corresponding to the at least one core Power consumption data under the combination of values.
  • At least one kernel parameter related to the power consumption of the device can be determined from its kernel parameters; the power consumption of the at least one kernel parameter corresponding to multiple value combinations can be obtained from the model computing device 101 Data; determine the target value combination corresponding to at least one core parameter according to its power consumption data under multiple value combinations; set at least one core parameter according to the target value combination to follow the target value combination Value running.
  • the detailed implementation manners or alternative implementation manners of related descriptions can be referred to the foregoing embodiments, and details are not described herein again.
  • a data center system is taken as an example for description, but the solution of combining the kernel parameter setting operation with artificial intelligence provided in the embodiments of the present application is not limited to the data center system.
  • the scheme of combining the kernel parameter setting operation with artificial intelligence provided in the embodiment of the application can be extended to any system or device that needs to set the kernel parameter of the device.
  • Fig. 4a is a schematic structural diagram of a device management system provided by an exemplary embodiment of this application.
  • the device management system 400 includes: at least one physical device 401 and at least one model computing device 402. This embodiment does not limit the number of physical devices 401, and it may be one or multiple. Similarly, this embodiment does not limit the number of model computing devices 402, and it may be one or multiple.
  • the physical device 401 may include, but is not limited to, at least one of the following device forms: server devices, computer devices, desktop computers, notebook computers, smart phones, tablet computers, network switching devices, and the like.
  • the server device may include, but is not limited to, a conventional server, a server array, or a cloud server.
  • the model computing device 402 may be a server device such as a conventional server, a cloud server, or a server array.
  • the device form and quantity of the physical device 401 and the model computing device 402 shown in FIG. 4a are only examples and are not limited thereto.
  • At least one physical device 401 refers to a physical device installed with an operating system and supporting a kernel-mode power management mechanism. It should be noted that, in addition to the physical device 401 that is installed with an operating system and supports the kernel-mode power management mechanism, the device management system 400 may also include some devices that do not require an operating system, and some devices that are installed with an operating system but do not support There is no restriction on the devices with the power management mechanism in the kernel mode. In this embodiment and other embodiments, the focus is on the physical device 401 that is installed with an operating system and supports a kernel-mode power management mechanism.
  • the power management mechanism in the kernel mode supported by the physical device 401 is related to some kernel parameters, and these kernel parameters generally have multiple values.
  • the different values of the kernel parameters result in different energy-saving effects in the power management mechanism.
  • the kernel parameter setting operation is combined with artificial intelligence, and the artificial intelligence model is used as the basis to obtain The performance data and power consumption data of the physical device 401 under multiple value combinations corresponding to the relevant kernel parameters, and further, based on the performance data and power consumption data of the physical device 401 under multiple value combinations corresponding to the relevant kernel parameters ,
  • the kernel parameter setting can not only set the appropriate value for the kernel parameter, but also take into account the power consumption and performance requirements of the physical device 401 at the same time, and the combination of artificial intelligence can improve the parameter setting efficiency and reduce the cost.
  • At least one model computing device 402 is mainly used to: for each physical device 401, determine from the kernel parameters of the physical device 401 related to the power management mechanism of the kernel state supported by the physical device 401 At least one kernel parameter, based on the artificial intelligence model, provides the physical device 401 with its performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter, so that the physical device 401 can complete the relevant kernel parameter Set up.
  • this embodiment takes any physical device 401 as an example, and records any physical device 401 as a target device to describe the detailed working principle of the system.
  • the model computing device 402 may determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device from the kernel parameters of the target device. After that, the model computing device 402 can collect the performance data and power consumption data of the target device under the partial value combination corresponding to at least one core parameter as sample data, and use these sample data for model training to obtain the performance-power consumption estimate model.
  • the model computing device 402 may use a load test tool to collect performance data and power consumption data of the target device under a partial value combination corresponding to at least one kernel parameter. Install and run the load test tool on the target device.
  • the load test tool can simulate the performance data and power consumption data of the target device under different load conditions.
  • the load test tool is used to obtain the performance data and power consumption data of the target device when the value combination meets the corresponding requirements.
  • the performance data and power consumption data when the corresponding requirements are met under the partial value combination are provided to the model computing device 402.
  • the performance data and power consumption data of the target device when it meets the corresponding requirements under each value combination are referred to as the performance data and power consumption data of the target device under each value combination for short.
  • the process of using the load test tool to obtain the performance data and power consumption data of the target device under the value combination includes: for the value combination, first operate The value of at least one kernel parameter in the system source code is modified to the value in the value combination, and the operating system is installed on the target device according to the modified operating system source code; after the operating system is successfully installed, on the target device Install the load test tool, and use the load test tool to simulate the corresponding load condition and obtain the performance data and power consumption data of the target device under the corresponding load according to the load, power consumption and/or performance requirements that the target device should meet.
  • the model computing device 402 After obtaining the performance data and power consumption data of the target device under the partial value combination corresponding to at least one kernel parameter, the model computing device 402 uses these data as sample data for model training.
  • the process of model training performed by the model computing device 402 is not limited. For example, it can be a model training process based on a deep neural network, or a model training process based on regression analysis, where at least one kernel parameter can be analyzed.
  • the model training method of the association relationship between the value combination of and the performance data and power consumption data of the target device is applicable to the embodiments of the present application.
  • the model computing device 402 may adopt a regression analysis-based modeling method, that is, perform regression analysis on the performance data and power consumption data of the target device under a combination of partial values corresponding to at least one kernel parameter. Regression analysis can obtain the correlation between the value combination corresponding to at least one kernel parameter and the performance data and power consumption data of the target device, that is, the performance-power consumption prediction model.
  • the process of model training by the model computing device 402 includes: taking the partial value combination corresponding to at least one kernel parameter as an independent variable, and using the performance data and power consumption data of the target device under the partial value combination as the dependent variable to perform linearization. Regression analysis, the performance-power consumption prediction model is obtained.
  • the model calculation device 402 can use the performance-power consumption prediction model to predict the performance of the target device under other value combinations corresponding to at least one core parameter. Data and power consumption data. Or, after obtaining the performance-power consumption prediction model, the model computing device 101 may use the performance-power consumption prediction model to estimate the performance data and power consumption data of the target device under multiple value combinations corresponding to at least one core parameter .
  • the performance data and power consumption data under multiple value combinations corresponding to at least one core parameter can be obtained, and during the parameter setting process, the multiple values corresponding to at least one core parameter can be used
  • a target value combination corresponding to at least one core parameter is determined, and at least one core parameter is set according to the target value combination.
  • the process of setting at least one kernel parameter according to the target value combination includes: modifying the value of at least one kernel parameter related to the power consumption management mechanism in the operating system source code to the value in the target value combination, and then,
  • the operating system can also be installed on the physical device according to the modified operating system source code.
  • installing the operating system on the physical device according to the modified operating system source code includes: compiling the modified operating system source code to obtain an installation file of the operating system, and running the installation file to complete the installation of the operating system.
  • an implementation manner of determining the target value combination corresponding to at least one kernel parameter includes: directly determining from the multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations Get the target value combination.
  • another implementation manner for determining the target value combination corresponding to at least one kernel parameter includes: obtaining power consumption data and/or performance data that the target device actually needs to meet; and comparing the power consumption data and/or performance data that the target device actually needs to meet Or performance data to match the performance data and power consumption data of the target device under multiple value combinations; according to the power consumption data and/or performance data that the target device actually needs to meet with the target device under multiple value combinations For the matching degree between the performance data and the power consumption data, a value combination that meets the matching degree requirement is selected from the multiple value combinations as the target value combination.
  • another implementation manner of determining the target value combination corresponding to at least one kernel parameter includes: selecting at least one of the multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations A combination of candidate values; using a load test tool to test the performance data and power consumption data of the target device under at least one combination of candidate values; further, the target device tested according to the load test tool under at least one combination of candidate values Determine the target value combination from at least one candidate value combination based on the performance data and power consumption data.
  • the load test tool is also combined to help improve the accuracy of the final selected target value combination, which is beneficial to Improve the accuracy of parameter settings.
  • the power consumption data that the target device actually needs to meet can be combined, or the performance data that the target device actually needs to meet, or the power consumption data that the target device actually needs to meet at the same time.
  • performance data For example, the power consumption data that the target device actually needs to meet can be obtained, and the power consumption data and/or performance data that the target device actually needs to meet can be combined with the performance data of the target device under a combination of multiple values corresponding to at least one kernel parameter.
  • the performance data and power consumption data of the target device under the target value combination tested by the load test tool can be used to evaluate the performance-power consumption prediction model Make corrections.
  • the performance data and power consumption data of the target device tested by the load test tool under the target value combination are more in line with the actual requirements, which are used as sample data to modify the performance-power consumption prediction model, which is conducive to improving the performance-power
  • the accuracy of the consumption estimation model makes the estimated performance data and power consumption data more in line with actual requirements.
  • model computing device 402 For the related description of the model computing device 402, please refer to the related description of the model computing device 101 in the foregoing embodiment. Similarly, for the related description of the target device, please refer to the corresponding description in the foregoing embodiment, which will not be repeated here.
  • the device management system 400 of this embodiment can be implemented as a system of any form or nature, for example, it can be a data center, or a cluster, or a computer room system, or an edge cloud network system, or a central cloud network system, etc.
  • the embodiment does not limit this.
  • the device management system 400 is implemented as an edge cloud network system as an example for illustration.
  • the edge cloud network system includes: edge computing nodes and servers deployed in the cloud or in the client room.
  • the server communicates with the edge computing node through the network.
  • the server can respond to the request of the edge computing node and provide related cloud services for the edge computing node; in addition, the server can also control, operate and maintain the edge computing node.
  • Edge computing nodes include hardware infrastructure, hardware infrastructure drivers, operating systems, and related applications.
  • the hardware infrastructure includes but is not limited to: CPU, network card, memory, etc.
  • Edge computing nodes may include: base stations, home gateways, personal computers, smart phones, street lights, traffic lights, and/or electronic monitoring equipment on buildings that are added to the edge cloud network.
  • the server can have the functions of the model computing device 402 in Figure 4a.
  • another server dedicated to model training can also be deployed (used to implement the model computing device 402 in Figure 4a).
  • the function of the edge computing node can be used as the physical device 401 in Figure 4a.
  • the edge cloud node supports two mechanisms, DFVS and C-state, and C-state has 6 levels of C modes.
  • the kernel parameters related to DFVS and C-state include: scaling_min_freq, scaling_max_freq, scaling_governor, C1-C6 levels
  • the corresponding target_residency has 9 parameters.
  • edge computing node Before the edge computing node provides services to customers, it is necessary to install the operating system on the edge computing node for the customer, and set the kernel parameters related to DFVS and C-state in the edge computing node, so that the edge computing node can work in the optimal parameter combination To achieve the goal of balancing performance and power consumption.
  • the server can use the load test tool to test the performance data and power consumption data of the edge computing node under the partial value combination corresponding to the above 9 parameters, and use the edge computing node to select the partial value combination corresponding to the 9 parameters.
  • the edge computing node receives its performance data and power consumption data under various value combinations corresponding to these 9 parameters issued by the server, and uses its performance data under various value combinations corresponding to these 9 parameters and Based on the power consumption data, these 9 parameters are set so that the edge computing node can work under the optimal parameter combination after startup, and reduce power consumption as much as possible while ensuring performance.
  • FIG. 5a is a schematic flowchart of a data processing method provided by an exemplary embodiment of this application. This data processing method can be used to set the kernel parameters of the physical device. As shown in Figure 5a, the method includes:
  • the execution subject of this embodiment may be a physical device, and the physical device runs an operating system and supports a kernel-mode power management mechanism.
  • the physical device can adjust or manage the kernel power management mechanism through some kernel parameters, and these kernel parameters are also the parameters of the kernel power management mechanism.
  • the kernel parameters related to the kernel-mode power management mechanism may have multiple values, and under different values, the energy-saving effect that the power management mechanism can produce will be different.
  • the kernel parameter setting operation is combined with artificial intelligence, and based on the artificial intelligence model, the performance data and power consumption data of the physical device under multiple value combinations corresponding to the relevant kernel parameters are obtained, so that the physical device can be Based on the performance data and power consumption data under the multiple value combinations corresponding to the relevant kernel parameters, the relevant kernel parameters can be set, and appropriate values can be set for the relevant kernel parameters, taking into account the power consumption and performance of the physical device. Combining with artificial intelligence can improve the efficiency of parameter setting and reduce costs.
  • an implementation manner of step 503 includes: selecting at least one candidate value combination from the multiple value combinations according to the performance data and power consumption data of the physical device under multiple value combinations ; Use a load test tool to test the performance data and power consumption data of the physical device under at least one candidate value combination; use the load test tool to test the performance data and power consumption data of the physical device under at least one candidate value combination , Determine the target value combination from at least one candidate value combination.
  • determining the target value combination it also includes: using the performance data and power consumption data of the physical device tested by the load test tool under the target value combination to modify the performance-power consumption prediction model.
  • the above-mentioned use of the load test tool to test the performance data and power consumption data of the physical device under at least one candidate value combination includes: for the first candidate value combination, the value of at least one kernel parameter in the operating system source code Modify to the value in the first candidate value combination, and install the operating system on the physical device according to the modified operating system source code; run the load test tool on the physical device to test the physical device in the first candidate value combination Performance data and power consumption data below; where the first candidate value combination is any one of at least one candidate value combination.
  • the foregoing selecting at least one candidate value combination from the multiple value combinations according to the performance data and power consumption data of the physical device under multiple value combinations includes: obtaining power consumption data that the physical device actually needs to meet; Match the power consumption data that the physical device actually needs to meet with the performance data and power consumption data of the physical device under multiple value combinations; obtain the power consumption data that the physical device actually needs to meet from multiple value combinations
  • the matching degree of at least one candidate value combination that meets the matching degree requirement includes: obtaining the performance data that the physical device actually needs to meet, and combining the performance data that the physical device actually needs to meet with the physical device under a combination of multiple values corresponding to at least one kernel parameter.
  • step 503 includes: obtaining performance data and power consumption data that the physical device actually needs to meet, and corresponding the performance data and power consumption data that the physical device actually needs to meet with the physical device in at least one kernel parameter Match the performance data and power consumption data under multiple value combinations of, from multiple value combinations, obtain the performance data and power consumption data that the physical device actually needs to meet the matching degree that meets at least one of the matching degree requirements A combination of candidate values.
  • obtaining the power consumption data that the physical device actually needs to meet includes: analyzing the power consumption data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, obtaining the power required by the service deployment user
  • the power consumption data is the power consumption data that the physical device actually needs to meet.
  • obtaining the performance data that the physical device actually needs to meet includes: analyzing the performance data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, obtaining the performance data required by the service deployment user, As the actual performance data that physical equipment needs to meet.
  • obtaining the power consumption data and performance data that the physical device actually needs to meet includes: analyzing the power consumption data and performance data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, obtaining The performance data and performance data required by the service deployment user are the power consumption data and performance data that the physical device actually needs to meet.
  • an implementation manner of step 502 includes: using a load test tool to test the performance data and power consumption data of the physical device under partial value combinations among the above-mentioned multiple value combinations; Perform model training on performance data and power consumption data under partial value combinations to obtain the performance-power consumption prediction model; use the performance-power consumption prediction model to predict the physical device under other value combinations among multiple value combinations Performance data and power consumption data.
  • model training is performed according to the performance data and power consumption data of the physical device under partial value combinations to obtain the performance-power consumption prediction model, including: performance data and power consumption data of the physical device under partial value combinations
  • the power consumption data is subjected to regression analysis to obtain the performance-power consumption prediction model.
  • perform regression analysis on the performance data and power consumption data of the physical device under partial value combinations to obtain the performance-power consumption prediction model including: taking some value combinations as independent variables, and taking the physical device in part
  • the performance data and power consumption data under the value combination are used as dependent variables to perform linear regression analysis to obtain a performance-power consumption prediction model.
  • acquiring the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one kernel parameter includes: receiving the physical device sent by the model computing device corresponding to the at least one kernel parameter Performance data and power consumption data under multiple value combinations; among them, the performance data and power consumption data under at least some value combinations are estimated by the model computing device based on the performance-power consumption prediction model.
  • the performance-power consumption prediction model obtained by the model computing device and the performance-power consumption prediction model estimated based on the performance-power consumption prediction model the detailed implementation of the performance data and power consumption data of the physical device under at least partial value combinations can be found in the foregoing embodiments. This will not be repeated here.
  • FIG. 5b is a schematic flowchart of another data processing method provided by an exemplary embodiment of this application. As shown in Figure 5b, the method includes:
  • an implementation manner of step 53 includes: performing regression analysis on the performance data and power consumption data of the physical device under the above-mentioned partial value combinations to obtain a performance-power consumption prediction model.
  • the linear regression analysis method can be used for model training.
  • the model training process of obtaining the performance-power consumption prediction model includes: using the above combination of values as independent variables, and using the performance data and power consumption data of the physical device under the above combination of values as dependent variables to perform linear regression analysis to obtain Performance-power consumption prediction model.
  • Kernel parameter settings provide data conditions.
  • another embodiment of a data processing method includes:
  • the kernel parameter setting operation is combined with artificial intelligence, and based on the artificial intelligence model, the performance data of the physical device under multiple value combinations corresponding to the relevant kernel parameters is obtained, so that the physical device can be used in the relevant kernel.
  • the relevant kernel parameters can be set, and appropriate values can be set for the relevant kernel parameters, which is conducive to ensuring the performance of the physical device, and the combination with artificial intelligence can improve Parameter setting efficiency and cost reduction.
  • FIG. 6b Another embodiment of a data processing method includes:
  • the performance prediction model is trained based on the collected data, and the performance prediction model is estimated based on the performance prediction model.
  • the performance data of the physical device under other value combinations corresponding to the above at least one kernel parameter can be obtained, which can greatly improve the efficiency of data acquisition, reduce the cost, and provide data conditions for the physical device to perform the kernel parameter setting.
  • another embodiment of a data processing method includes:
  • the kernel parameter setting operation is combined with artificial intelligence, and based on the artificial intelligence model, the power consumption data of the physical device under multiple value combinations corresponding to the relevant kernel parameter is obtained, so that the physical device can be Based on the power consumption data under the multiple value combinations corresponding to the kernel parameters, the relevant kernel parameters can be set, and appropriate values can be set for the relevant kernel parameters, which is conducive to reducing the power consumption of physical devices and combining with artificial intelligence , Which can improve the efficiency of parameter setting and reduce costs.
  • FIG. 7b another embodiment of a data processing method includes:
  • the power consumption estimation model is trained based on the collected data, and the power consumption estimation is based on The model predicts the power consumption data of the physical device under other value combinations corresponding to at least one of the above-mentioned kernel parameters, which can greatly improve data acquisition efficiency, reduce costs, and provide data conditions for the physical device to set the kernel parameters.
  • another embodiment of a data processing method includes:
  • Kernel parameter settings provide data conditions.
  • the embodiment of the present application also provides a task scheduling method.
  • the task scheduling method includes:
  • the value of the power consumption parameter in the kernel mode refers to a combination of values of at least one kernel parameter related to the power management mechanism of the kernel mode supported by the resource device.
  • the power management mechanism in the kernel mode refers to a mechanism provided by the operating system to manage the power consumption of physical devices. It is a power management mechanism at the operating system level and needs to run in the kernel mode.
  • the type of operating system is not limited.
  • it may be a Linux operating system, a Windows operating system, a UNIX operating system, or a MAC operating system.
  • the power management mechanism of the kernel mode supported by different operating systems will be different.
  • DVFS and C-state are examples of two kernel-state power management mechanisms supported by the Linux operating system.
  • the power management mechanism in the kernel mode is related to some kernel parameters.
  • These kernel parameters are also the parameters of the power management mechanism in the kernel mode.
  • the value of these kernel parameters can affect the energy saving effect of the power management mechanism in the kernel mode.
  • the prerequisite for the normal use of the power management mechanism in the kernel mode is to set the values of the kernel parameters related to the power management mechanism in the kernel mode in advance.
  • at least one kernel parameter related to the power management mechanism of the kernel mode of the device in the normal working state has a certain value, and the combination of these values is the kernel mode power consumption parameter value of this embodiment.
  • the core state power consumption parameter value of the resource device can reflect the power consumption of the resource device to a certain extent.
  • resource devices refer to various physical devices responsible for performing tasks in resource scheduling scenarios.
  • they can be terminal devices such as laptops, tablets, smart phones, or edge computing nodes, or they can be servers, server clusters, and server arrays.
  • server-side equipment such as cloud servers.
  • the resource device can be a server or a server cluster, but it is not limited to this.
  • a task scheduling device (or called a task scheduler) is generally deployed, which is mainly used to schedule tasks to be scheduled to appropriate resource devices.
  • the task scheduling device can run program codes such as task scheduling services, programs, or plug-ins to implement the following task scheduling process.
  • the task scheduling device may provide a human-computer interaction interface for the user, and the user may provide the tasks to be scheduled and their performance requirements through the human-computer interaction interface.
  • the human-computer interaction interface can be an application page, a web page or a command window.
  • the task scheduling device can also support voice interaction and recognition technology, and users can submit tasks to be scheduled and their performance requirements through voice instructions. The performance requirements of different tasks to be scheduled will be different, which is not limited.
  • a resource device that meets the performance requirement and the core state power consumption parameter value meets the set power consumption requirement can be selected from at least one resource device; the task to be scheduled is scheduled to meet the performance requirement And the resource device whose core state power consumption parameter value meets the set power consumption requirement.
  • the performance data and performance of at least one resource device under the respective core-mode power consumption parameter value may be selected.
  • Consumption data That is, according to the performance data and power consumption data of at least one resource device under the respective core-state power consumption parameter values, a resource device that meets the performance requirement and the core-mode power consumption parameter value meets the set power consumption requirement is selected.
  • the resource device includes: selecting a candidate resource device that meets the above performance requirements according to the performance data of at least one resource device under the respective core state power consumption parameter value; according to the power consumption data of the candidate resource device under the respective core state power consumption parameter value , Select a resource device whose power consumption data meets the set power consumption requirement from the candidate resource devices.
  • the number of candidate resource devices meeting the foregoing performance requirements may be one or more.
  • the power consumption data of the candidate resource device under the kernel state power consumption parameter value meets the set power consumption requirement, which means that the kernel state power consumption parameter value of the candidate resource device meets the set power consumption requirement.
  • the resource device includes: selecting a candidate resource device whose core state power consumption parameter value meets the set power consumption requirement according to the power consumption data of at least one resource device under the respective core state power consumption parameter value; according to the candidate resource device in the respective core According to the performance data under the state power consumption parameter value, a resource device whose power consumption data meets the set power consumption requirement is selected from the candidate resource devices.
  • the “set power consumption requirement” is not limited, and can be flexibly set according to application requirements.
  • setting the power consumption requirement may require that the core state power consumption parameter value brings the lowest power consumption to the resource device. Based on this, the power consumption can be selected from candidate resource devices that meet the above performance requirements. The resource device with the lowest data consumption; then the task to be scheduled is scheduled to the resource device with the lowest data consumption.
  • the resource device with the best core-mode power consumption parameter value can be selected under the condition of guaranteed performance.
  • a load test tool may be used to collect performance data and power consumption data of each resource device under its own core state power consumption parameter value.
  • an artificial intelligence model can be pre-trained, such as a performance-power consumption prediction model.
  • a performance-power consumption prediction model When the kernel state power consumption parameter value of each resource device is known, the performance-power consumption prediction model can be used. The estimation model predicts the performance data and power consumption data of each resource device under its own core state power consumption parameter value. Regarding the training process and the use process of the performance-power consumption estimation model, refer to the foregoing embodiment, which will not be repeated here.
  • the core-state power consumption parameter value of each resource device is set using the method provided in the foregoing embodiment of this application, and in the process of setting the core-mode power consumption parameter value for each resource device, it has been learned
  • the performance data and power consumption data of each resource device under its own core state power consumption parameter value, and the performance data and power consumption data of each resource device learned in advance under its own core state power consumption parameter value can be saved, so that, In the task scheduling process, the performance data and power consumption data of each resource device under the respective core state power consumption parameter values can be directly read.
  • the core state power consumption parameter value of each resource device refers to the target value combination finally set by the method provided in the foregoing embodiment.
  • the resource device with the better core state power consumption parameter value in combination with the core state power consumption parameter value of the resource device, the resource device with the better core state power consumption parameter value can be preferentially selected to execute the task when the performance requirements are met. While taking into account performance requirements, reduce power consumption.
  • the execution subject of each step of the method provided in the foregoing embodiment may be the same device, or different devices may also be the execution subject of the method.
  • the execution subject of steps 501 to 504 may be device A; for another example, the execution subject of steps 501, 503, and 504 may be device A, and the execution subject of step 502 may be device B; and so on.
  • Fig. 8a is a schematic structural diagram of a physical device provided by an exemplary embodiment of this application. As shown in FIG. 8a, the physical device includes: a memory 81a and a processor 82a.
  • the memory 81a is used to store computer programs, and can be configured to store various other data to support operations on the physical device. Examples of such data include instructions for any application or method operated on the physical device, contact data, phone book data, messages, pictures, videos, etc.
  • the processor 82a is coupled to the memory 81a, and is configured to execute the computer program in the memory 81a to determine from the kernel parameters of the physical device related to the power management mechanism of the kernel mode supported by the physical device At least one kernel parameter; acquiring performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one kernel parameter, where at least part of the performance data and power consumption data under the value combination are based on The performance-power consumption prediction model predicts; according to the performance data and power consumption data of the physical device under the multiple value combinations, the target value combination corresponding to the at least one core parameter is determined; The target value combination sets the at least one kernel parameter so that the power consumption management mechanism operates according to the value in the target value combination.
  • the processor 82a when the processor 82a determines the target value combination corresponding to the at least one kernel parameter, it is specifically configured to: according to the performance data and function of the physical device under the multiple value combinations Select at least one candidate value combination from the multiple value combinations; use a load test tool to test the performance data and power consumption data of the physical device under the at least one candidate value combination; The performance data and power consumption data of the physical device under the at least one candidate value combination tested by the load testing tool are used to determine the target value combination from the at least one candidate value combination.
  • the processor 82a is further configured to, after determining the target value combination, use the load test tool to test the performance data and power consumption data of the physical device under the target value combination , Revise the performance-power consumption prediction model.
  • the processor 82a uses a load testing tool to test the performance data and power consumption data of the physical device under the at least one candidate value combination, it is specifically configured to: for the first candidate value combination, set the operating system The value of the at least one kernel parameter in the source code is modified to the value in the first candidate value combination, and the operating system is installed on the physical device according to the modified operating system source code; Run the load test tool on the device to test the performance data and power consumption data of the physical device under the first candidate value combination; wherein, the first candidate value combination is the at least one candidate Any combination of candidate values in the value combination.
  • the processor 82a selects at least one candidate value combination from the multiple value combinations, it is specifically configured to: obtain power consumption data that the physical device actually needs to meet; and compare the power consumption data that the physical device actually needs to meet , To match the performance data and power consumption data of the physical device under multiple value combinations; from the multiple value combinations, obtain at least one of the matching degrees with the power consumption data that the physical device actually needs to meet.
  • a combination of candidate values or,
  • the processor 82a when the processor 82a selects at least one candidate value combination from the multiple value combinations, it is specifically configured to: obtain performance data that the physical device actually needs to meet, and compare the physical device's actual needs Satisfied performance data is matched with the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one core parameter; from multiple value combinations, the performance data that the physical device actually needs to meet is obtained The matching degree of at least one candidate value combination that meets the matching degree requirement. or,
  • the processor 82a when the processor 82a selects at least one candidate value combination from the multiple value combinations, it is specifically configured to: obtain the performance data and power consumption data that the physical device actually needs to meet, and The performance data and power consumption data that the physical device actually needs to meet are matched with the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one core parameter; from multiple value combinations, The matching degree of the performance data and the power consumption data that the physical device actually needs to meet all meets at least one candidate value combination that meets the matching degree requirement.
  • the processor 82a is specifically configured to: analyze the power consumption data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, Obtain the power consumption data required by the service deployment user as the power consumption data that the physical device actually needs to meet.
  • the processor 82a obtains the performance data that the physical device actually needs to meet, it is specifically used to: analyze the performance data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, obtain the service Deploy the performance data required by the user as the actual performance data that the physical device needs to meet.
  • the processor 82a when the processor 82a obtains the power consumption data and performance data that the physical device actually needs to meet, it is specifically used to: analyze the power consumption data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry And performance data; or, obtain the performance data and performance data required by the service deployment user as the power consumption data and performance data that the physical device actually needs to meet.
  • the processor 82a when the processor 82a obtains the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one kernel parameter, it is specifically configured to: use a load test tool to test that the physical device is in the above-mentioned Performance data and power consumption data under partial value combinations among multiple value combinations; perform model training based on the performance data and power consumption data of the physical device under the above partial value combinations to obtain a performance-power consumption prediction model; Use the performance-power consumption prediction model to estimate the performance data and power consumption data of the physical device under other value combinations among multiple value combinations.
  • the processor 82a when the processor 82a obtains the performance-power consumption prediction model, it is specifically used to: perform regression analysis on the performance data and power consumption data of the physical device under partial value combinations to obtain the performance-power consumption prediction model. Estimate the model.
  • processor 82a is specifically configured to: use partial value combinations as independent variables, and use the performance data and power consumption data of the physical device under the partial value combinations as dependent variables to perform linear regression analysis to obtain performance-power consumption estimates model.
  • the processor 82a when the processor 82a obtains the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one kernel parameter, it is specifically configured to: receive the physical device sent by the model computing device Performance data and power consumption data under multiple value combinations corresponding to at least one core parameter; among them, the performance data and power consumption data under at least some value combinations are estimated by the model computing device based on the performance-power consumption prediction model of.
  • the performance-power consumption prediction model obtained by the model computing device and the performance-power consumption prediction model estimated based on the performance-power consumption prediction model
  • the detailed implementation of the performance data and power consumption data of the physical device under at least partial value combinations can be found in the foregoing embodiments. This will not be repeated here.
  • the processor 82 may also implement the following functions: determine at least one kernel parameter related to the performance of the device from the kernel parameters of the physical device; The performance data under multiple value combinations corresponding to the at least one kernel parameter, wherein the performance data under at least part of the value combinations is estimated based on the performance prediction model; according to the physical device in the multiple value combinations The performance data under the value combination, determine the target value combination corresponding to the at least one kernel parameter; set the at least one kernel parameter according to the target value combination, so that the physical device takes the value according to the target The value in the combination runs.
  • the processor 82 may also implement the following functions: determine at least one kernel parameter related to the power consumption of the device from the kernel parameters of the physical device; and obtain the physical device.
  • the physical device further includes: a communication component 83a, a display 84a, a power supply component 85a, an audio component 86a and other components. Only part of the components are schematically shown in FIG. 8a, which does not mean that the physical device only includes the components shown in FIG. 8a. In addition, depending on the implementation form of the physical device, the components in the dashed box in FIG. 8a are optional components, not mandatory components.
  • the physical device when the physical device is implemented as a terminal device such as a smart phone, a tablet computer, or a desktop computer, it can include the components in the dashed box in Figure 8a; when the physical device is implemented as a server such as a conventional server, a cloud server, a data center, or a server array When the device is used, the components in the dashed box in Figure 8a may not be included.
  • an embodiment of the present application also provides a computer-readable storage medium storing a computer program.
  • the processor When the computer program is executed by a processor, the processor will cause the processor to implement the method in the method embodiment shown in FIG. 5a, FIG. 6a, or FIG. 7a. The steps.
  • Fig. 8b is a schematic structural diagram of a model computing device provided by an exemplary embodiment of this application. As shown in FIG. 8b, the physical device includes: a memory 81b and a processor 82b.
  • the memory 81b is used to store computer programs, and can be configured to store various other data to support operations on the physical device. Examples of such data include instructions for any application or method operated on the physical device, contact data, phone book data, messages, pictures, videos, etc.
  • the processor 82b is coupled with the memory 81b, and is configured to execute the computer program in the memory 81b to determine at least one related to the power management mechanism of the kernel state supported by the physical device from the kernel parameters of the physical device Kernel parameters; use a load test tool to test the performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter; according to the performance data of the physical device under the partial value combination Perform model training with power consumption data to obtain a performance-power consumption prediction model; use the performance-power consumption prediction model to predict the performance of the physical device under other value combinations corresponding to the at least one core parameter Data and power consumption data.
  • the processor 82b when the processor 82b obtains the performance-power consumption prediction model, it is specifically configured to: perform regression analysis on the performance data and power consumption data of the physical device under the partial value combination, In order to get the performance-power consumption prediction model.
  • the processor 82b is specifically configured to: use the partial value combination as an independent variable, and use the performance data and power consumption data of the physical device under the partial value combination as the dependent variable to perform linear regression analysis , Get the performance-power consumption prediction model.
  • the model computing device of this embodiment may also implement the following functions: determine at least one kernel parameter related to device performance from the kernel parameters of the physical device; use a load test tool Testing the performance data of the physical device under the partial value combination corresponding to the at least one kernel parameter; performing model training according to the performance data of the physical device under the partial value combination to obtain a performance prediction model; The performance prediction model is used to predict the performance data of the physical device under other value combinations corresponding to the at least one kernel parameter.
  • the model computing device of this embodiment may also implement the following functions: determine at least one kernel parameter related to the power consumption of the device from the kernel parameters of the physical device; A tool to test the power data of the physical device under the partial value combination corresponding to the at least one kernel parameter; perform model training according to the power data of the physical device under the partial value combination to obtain a power estimation model ; Using the power estimation model to predict the power data of the physical device under other value combinations corresponding to the at least one kernel parameter.
  • the model computing device of this embodiment may also implement the following functions: from the kernel parameters of the physical device, determine the power management mechanism of the kernel state supported by the physical device Relevant at least one kernel parameter; use a load test tool to test the performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter; according to the physical device in the partial value combination Perform model training on the performance data and power consumption data under the following performance data to obtain a performance-power consumption prediction model; use the performance-power consumption prediction model to estimate that the physical device is in multiple selections corresponding to the at least one core parameter. Performance data and power consumption data under value combinations; wherein the multiple value combinations include the partial value combinations.
  • the model computing device further includes: a communication component 83b, a power supply component 85b and other components. Only part of the components are schematically shown in FIG. 8b, which does not mean that the model computing device only includes the components shown in FIG. 8b.
  • the model computing device can be implemented as a server device such as a conventional server, a cloud server, a data center, or a server array.
  • an embodiment of the present application also provides a computer-readable storage medium storing a computer program.
  • the processor When the computer program is executed by a processor, the processor causes the processor to implement the method shown in FIG. 5b, FIG. 6b, FIG. 7b, or FIG. 7c. The steps in the example.
  • Fig. 8c is a schematic structural diagram of a task scheduling device provided by an exemplary embodiment of this application. As shown in FIG. 8c, the task scheduling device includes: a memory 81c and a processor 82c.
  • the memory 81c is used to store computer programs, and can be configured to store other various data to support operations on the task scheduling device. Examples of such data include instructions for any application or method to operate on the task scheduling device, task lists, messages, pictures, videos, etc.
  • the processor 82c is coupled with the memory 81c, and is configured to execute the computer program in the memory 81c to obtain the tasks to be scheduled and the performance requirements of the tasks to be scheduled; from at least one resource device, select the core device that meets the performance requirements and The resource device whose value of the power consumption parameter meets the set power consumption requirement; schedule the task to be scheduled to the resource device that meets the performance requirement and the value of the kernel power consumption parameter meets the set power consumption requirement; wherein, the kernel power consumption parameter The value refers to a value combination of at least one kernel parameter related to the power management mechanism of the kernel mode supported by the resource device.
  • the resource device may be a server or a server cluster.
  • the processor 82c when the processor 82c selects a resource device that meets the performance requirements and the core state power consumption parameter value meets the set power consumption requirement, it is specifically configured to: The performance data and power consumption data under the consumption parameter value are selected to select a resource device that meets the performance requirement and the core state power consumption parameter value meets the set power consumption requirement.
  • the processor 82c is specifically configured to: select a candidate resource device that meets the performance requirements according to the performance data of at least one resource device under the respective core state power consumption parameter value; according to the candidate resource device's performance in the respective core state For the power consumption data under the consumption parameter value, a resource device whose power consumption data meets the set power consumption requirement is selected from the candidate resource devices.
  • the processor 82c is specifically configured to select the resource device with the lowest power consumption data from the candidate resource devices according to the power consumption data of the candidate resource devices under their respective core state power consumption parameter values.
  • the task scheduling device further includes: a communication component 83c, a display 84c, a power supply component 85c, an audio component 86c and other components. Only some components are schematically shown in FIG. 8c, which does not mean that the task scheduling device only includes the components shown in FIG. 8c. In addition, according to the different implementation forms of the task scheduling device, the components in the dashed box in FIG. 8c are optional components, not mandatory components.
  • the task scheduling device when the task scheduling device is implemented as a terminal device such as a smart phone, a tablet computer, or a desktop computer, it can include the components in the dashed box in Figure 8c; when the task scheduling device is implemented as a conventional server, cloud server, data center, or server array, etc. When the server device is used, the components in the dashed box in Figure 8c may not be included.
  • an embodiment of the present application also provides a computer-readable storage medium storing a computer program.
  • the processor causes the processor to implement the steps in the method embodiment shown in FIG. 7d.
  • the communication components in Figs. 8a to 8c are configured to facilitate wired or wireless communication between the device where the communication component is located and other devices.
  • the device where the communication component is located can access wireless networks based on communication standards, such as WiFi, 2G, 3G, 4G/LTE, 5G and other mobile communication networks, or a combination of them.
  • the communication component receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component may further include a near field communication (NFC) module, radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra wideband (UWB) technology, Bluetooth (BT) technology Wait.
  • NFC near field communication
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra wideband
  • Bluetooth Bluetooth
  • the above-mentioned display in Figs. 8a-8c includes a screen, and the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation.
  • the power supply components in Figures 8a to 8c above provide power for various components of the equipment where the power supply components are located.
  • the power supply component may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device where the power supply component is located.
  • the audio components in Figs. 8a to 8c may be configured to output and/or input audio signals.
  • the audio component includes a microphone (MIC).
  • the microphone When the device where the audio component is located is in an operating mode, such as call mode, recording mode, and voice recognition mode, the microphone is configured to receive external audio signals.
  • the received audio signal can be further stored in a memory or sent via a communication component.
  • the audio component further includes a speaker for outputting audio signals.
  • the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment.
  • the instructions provide steps for implementing the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • the computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • processors CPUs
  • input/output interfaces network interfaces
  • memory volatile and non-volatile memory
  • the memory may include non-permanent memory in a computer readable medium, random access memory (RAM) and/or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM). Memory is an example of computer readable media.
  • RAM random access memory
  • ROM read-only memory
  • flash RAM flash memory
  • Computer-readable media include permanent and non-permanent, removable and non-removable media, and information storage can be realized by any method or technology.
  • the information can be computer-readable instructions, data structures, program modules, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical storage, Magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media can be used to store information that can be accessed by computing devices. According to the definition in this article, computer-readable media does not include transitory media, such as modulated data signals and carrier waves.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Power Sources (AREA)

Abstract

A data processing method, device and system, and a storage medium. A setting operation for kernel parameters related to a power consumption management mechanism is combined with artificial intelligence. A performance-power consumption estimation model obtained through training on the basis of artificial intelligence estimates performance data and power consumption data of a physical device under a plurality of value combinations of kernel parameters; furthermore, on the basis of the obtained performance data and power consumption data, suitable values can be set for the kernel parameters, so that the power consumption and performance of the physical device can both be taken into account, and combining same with artificial intelligence can improve the efficiency of parameter setting and reduce the costs.

Description

数据处理与任务调度方法、设备、系统及存储介质Data processing and task scheduling method, equipment, system and storage medium 技术领域Technical field
本申请涉及数据处理技术领域,尤其涉及一种数据处理与任务调度方法、设备、系统及存储介质。This application relates to the field of data processing technology, and in particular to a data processing and task scheduling method, device, system and storage medium.
背景技术Background technique
随着电子技术的发展,服务器、计算机等物理设备的功耗管理越来越重要。为了在设备正常运行的基础上,减少功耗,在操作系统中加入了的功耗管理机制。以Linux操作系统为例,动态电压频率技术(Dynamic Voltage Dynamic Frequency Scaling,DVFS)和C-模式(C-state)是处理器用来减少功耗并保证性能主要使用的两种机制。With the development of electronic technology, power management of physical devices such as servers and computers has become more and more important. In order to reduce power consumption based on the normal operation of the device, a power management mechanism is added to the operating system. Taking the Linux operating system as an example, dynamic voltage frequency technology (Dynamic Voltage Frequency Scaling, DVFS) and C-mode (C-state) are the two main mechanisms used by the processor to reduce power consumption and ensure performance.
这些功耗管理机制与一些设备参数相关,有些设备参数可能具有多种取值,功耗管理机制在不同参数取值下可产生不同的节能效果。如何以高效、低成本的方式,合理设置功耗管理机制的参数取值,以使功耗管理机制产生较优或最优的节能效果,是现有功耗管理机制面临的一个问题。These power consumption management mechanisms are related to some device parameters, and some device parameters may have multiple values. The power consumption management mechanism can produce different energy-saving effects under different parameter values. How to reasonably set the parameter values of the power consumption management mechanism in an efficient and low-cost manner so that the power consumption management mechanism can produce a better or optimal energy-saving effect is a problem faced by the existing power consumption management mechanism.
发明内容Summary of the invention
本申请的多个方面提供一种数据处理与任务调度方法、设备、系统及存储介质,用以高效地、合理地设置功耗管理机制的参数取值,降低成本。Various aspects of the present application provide a data processing and task scheduling method, device, system, and storage medium, which are used to efficiently and reasonably set the parameter values of the power consumption management mechanism and reduce costs.
本申请实施例提供一种数据处理方法,包括:从物理设备的内核参数中,确定与所述物理设备支持的内核态的功耗管理机制相关的至少一个内核参数;获取所述物理设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,其中,至少部分取值组合下的性能数据和功耗数据是基 于性能-功耗预估模型预估出的;根据所述物理设备在所述多种取值组合下的性能数据和功耗数据,确定所述至少一个内核参数对应的目标取值组合;根据所述目标取值组合对所述至少一个内核参数进行设置,以使所述功耗管理机制按照所述目标取值组合中的取值运行。An embodiment of the application provides a data processing method, including: determining at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device from the kernel parameters of the physical device; Describe the performance data and power consumption data under multiple value combinations corresponding to at least one core parameter, where at least some of the performance data and power consumption data under the value combination are estimated based on the performance-power consumption prediction model; Determine the target value combination corresponding to the at least one kernel parameter according to the performance data and power consumption data of the physical device under the multiple value combinations; determine the target value combination for the at least one kernel parameter according to the target value combination Setting is made so that the power consumption management mechanism operates according to the value in the target value combination.
本申请实施例还提供一种数据处理方法,包括:从物理设备的内核参数中,确定与所述物理设备支持的内核态的功耗管理机制相关的至少一个内核参数;利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部分取值组合下的性能数据和功耗数据;根据所述物理设备在所述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型;利用所述性能-功耗预估模型预估所述物理设备在所述至少一个内核参数对应的其它取值组合下的性能数据和功耗数据。An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device from the kernel parameters of the physical device; Performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter; perform model training according to the performance data and power consumption data of the physical device under the partial value combination to Obtain a performance-power consumption prediction model; use the performance-power consumption prediction model to predict the performance data and power consumption data of the physical device under other value combinations corresponding to the at least one core parameter.
本申请实施例还提供一种数据处理方法,包括:从物理设备的内核参数中,确定与设备性能相关的至少一个内核参数;获取所述物理设备在所述至少一个内核参数对应的多种取值组合下的性能数据,其中,至少部分取值组合下的性能数据是基于性能预估模型预估出的;根据所述物理设备在所述多种取值组合下的性能数据,确定所述至少一个内核参数对应的目标取值组合;根据所述目标取值组合对所述至少一个内核参数进行设置,以使所述物理设备按照所述目标取值组合中的取值运行。An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to device performance from the kernel parameters of the physical device; and obtaining multiple selections of the physical device corresponding to the at least one kernel parameter. The performance data under the value combination, wherein at least part of the performance data under the value combination is estimated based on the performance prediction model; the performance data of the physical device under the multiple value combinations is determined A target value combination corresponding to at least one kernel parameter; the at least one kernel parameter is set according to the target value combination, so that the physical device operates according to the value in the target value combination.
本申请实施例还提供一种数据处理方法,包括:从物理设备的内核参数中,确定与设备性能相关的至少一个内核参数;利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部分取值组合下的性能数据;根据所述物理设备在所述部分取值组合下的性能数据进行模型训练,以得到性能预估模型;利用所述性能预估模型预估所述物理设备在所述至少一个内核参数对应的其它取值组合下的性能数据。An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to device performance from the kernel parameters of the physical device; using a load test tool to test that the physical device corresponds to the at least one kernel parameter The performance data under the partial value combination of the; perform model training according to the performance data of the physical device under the partial value combination to obtain the performance prediction model; use the performance prediction model to predict the physical device Performance data under other value combinations corresponding to the at least one kernel parameter.
本申请实施例还提供一种数据处理方法,包括:从物理设备的内核参数中,确定与设备功耗相关的至少一个内核参数;获取所述物理设备在所述至少一个内核参数对应的多种取值组合下的功率数据,其中,至少部分取值组 合下的功率数据是基于功率预估模型预估出的;根据所述物理设备在所述多种取值组合下的功率数据,确定所述至少一个内核参数对应的目标取值组合;根据所述目标取值组合对所述至少一个内核参数进行设置,以使所述物理设备按照所述目标取值组合中的取值运行。An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to the power consumption of the device from the kernel parameters of the physical device; and obtaining multiple types of parameters corresponding to the at least one kernel parameter of the physical device. The power data under the value combination, wherein at least part of the power data under the value combination is estimated based on the power estimation model; and the power data of the physical device under the multiple value combinations is determined The target value combination corresponding to the at least one kernel parameter; and the at least one kernel parameter is set according to the target value combination, so that the physical device operates according to the value in the target value combination.
本申请实施例还提供一种数据处理方法,包括:从物理设备的内核参数中,确定与设备功耗相关的至少一个内核参数;利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部分取值组合下的功率数据;根据所述物理设备在所述部分取值组合下的功率数据进行模型训练,以得到功率预估模型;利用所述功率预估模型预估所述物理设备在所述至少一个内核参数对应的其它取值组合下的功率数据。An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to the power consumption of the device from the kernel parameters of the physical device; using a load test tool to test the physical device in the at least one kernel parameter Corresponding power data under the partial value combination; perform model training according to the power data of the physical device under the partial value combination to obtain a power estimation model; use the power estimation model to estimate the physical Power data of the device under other value combinations corresponding to the at least one kernel parameter.
本申请实施例还提供一种数据处理方法,包括:从物理设备的内核参数中,确定与所述物理设备支持的内核态的功耗管理机制相关的至少一个内核参数;利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部分取值组合下的性能数据和功耗数据;根据所述物理设备在所述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型;利用所述性能-功耗预估模型预估所述物理设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据;其中,所述多种取值组合包括所述部分取值组合。An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device from the kernel parameters of the physical device; Performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter; perform model training according to the performance data and power consumption data of the physical device under the partial value combination to Obtain a performance-power consumption prediction model; use the performance-power consumption prediction model to predict the performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one core parameter; wherein, The multiple value combinations include the partial value combinations.
本申请实施例还提供一种设备管理系统,包括:至少一台物理设备和至少一台模型计算设备;其中,所述至少一台物理设备分别支持内核态的功耗管理机制;所述至少一台模型计算设备,用于从目标设备的内核参数中,确定与所述目标设备支持的内核态的功耗管理机制相关的至少一个内核参数,并基于人工智能模型得到所述目标设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据;所述目标设备是所述至少一台物理设备中的任意一台物理设备;所述目标设备,用于根据所述模型计算设备得到的所述目标设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,确定所述至少一个内核参数对应的目标取值组合,并根据所述目 标取值组合对所述至少一个内核参数进行设置。An embodiment of the present application also provides a device management system, including: at least one physical device and at least one model computing device; wherein the at least one physical device supports a kernel-mode power management mechanism; the at least one A model computing device for determining at least one kernel parameter related to the power management mechanism of the kernel state supported by the target device from the kernel parameters of the target device, and obtaining the target device in the target device based on the artificial intelligence model Performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter; the target device is any one of the at least one physical device; the target device is configured to The performance data and power consumption data of the target device under multiple value combinations corresponding to the at least one kernel parameter obtained by the model computing device determine the target value combination corresponding to the at least one kernel parameter, and according to the The target value combination sets the at least one kernel parameter.
本申请实施例还提供一种数据中心系统,包括:模型计算设备和至少一个机房,所述至少一个机房包括至少一台物理设备,所述至少一台物理设备分别支持内核态的功耗管理机制;所述模型计算设备,用于从目标设备的内核参数中,确定与所述目标设备支持的内核态的功耗管理机制相关的至少一个内核参数,并基于人工智能模型得到所述目标设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据;所述目标设备是所述至少一台物理设备中任意一台物理设备;所述目标设备,用于根据所述模型计算设备得到的所述目标设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,确定所述至少一个内核参数对应的目标取值组合,并根据所述目标取值组合对所述至少一个内核参数进行设置。An embodiment of the present application further provides a data center system, including: a model computing device and at least one computer room, the at least one computer room includes at least one physical device, and the at least one physical device respectively supports a kernel-mode power management mechanism The model computing device is used to determine from the kernel parameters of the target device at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device, and obtain the target device in the target device based on the artificial intelligence model Performance data and power consumption data under multiple value combinations corresponding to the at least one kernel parameter; the target device is any one of the at least one physical device; the target device is configured to The performance data and power consumption data of the target device under multiple value combinations corresponding to the at least one kernel parameter obtained by the model computing device are determined, and the target value combination corresponding to the at least one kernel parameter is determined, and the target value combination is determined according to the The target value combination sets the at least one kernel parameter.
本申请实施例还提供一种物理设备,包括:存储器和处理器;所述存储器,用于存储计算机程序;所述处理器,与所述存储器耦合,用于执行所述计算机程序,以用于:从所述物理设备的内核参数中,确定与所述物理设备支持的内核态的功耗管理机制相关的至少一个内核参数;获取所述物理设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,其中,至少部分取值组合下的性能数据和功耗数据是基于性能-功耗预估模型预估出的;根据所述物理设备在所述多种取值组合下的性能数据和功耗数据,确定所述至少一个内核参数对应的目标取值组合;根据所述目标取值组合对所述至少一个内核参数进行设置,以使所述功耗管理机制按照所述目标取值组合中的取值运行。An embodiment of the present application also provides a physical device, including: a memory and a processor; the memory is used for storing a computer program; the processor is coupled with the memory and is used for executing the computer program for : From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device; obtain multiple selections of the physical device corresponding to the at least one kernel parameter The performance data and power consumption data under the value combination, wherein at least part of the performance data and power consumption data under the value combination are estimated based on the performance-power consumption prediction model; according to the physical device in the multiple Determine the target value combination corresponding to the at least one core parameter based on the performance data and power consumption data under the value combination; set the at least one core parameter according to the target value combination to enable the power consumption management The mechanism operates according to the value in the target value combination.
本申请实施例还提供一种模型计算设备,包括:存储器和处理器;所述存储器,用于存储计算机程序;所述处理器,与所述存储器耦合,用于执行所述计算机程序,以用于:从物理设备的内核参数中,确定与所述物理设备支持的内核态的功耗管理机制相关的至少一个内核参数;利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部分取值组合下的性能数据和功耗数据;根据所述物理设备在所述部分取值组合下的性能数据和功耗 数据进行模型训练,以得到性能-功耗预估模型;利用所述性能-功耗预估模型预估所述物理设备在所述至少一个内核参数对应的其它取值组合下的性能数据和功耗数据。An embodiment of the present application also provides a model computing device, including: a memory and a processor; the memory is used to store a computer program; the processor is coupled with the memory and is used to execute the computer program for use In: From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel state supported by the physical device; use a load test tool to test the physical device in the at least one kernel parameter corresponding to the at least one kernel parameter. Perform model training based on the performance data and power consumption data of the physical device under the partial value combination to obtain a performance-power consumption prediction model; use the performance data and power consumption data of the physical device under the partial value combination; The performance-power consumption prediction model estimates the performance data and power consumption data of the physical device under other value combinations corresponding to the at least one core parameter.
本申请实施例还提供一种存储有计算机程序的计算机可读存储介质,当所述计算机程序被处理器执行时,致使所述处理器实现本申请实施例提供的各种数据处理方法中的步骤。The embodiments of the present application also provide a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the processor is caused to implement the steps in the various data processing methods provided in the embodiments of the present application. .
本申请实施例还提供一种任务调度方法,包括:获取待调度任务以及所述待调度任务的性能要求;从至少一个资源设备中,选择满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备;将所述待调度任务调度至满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备;其中,所述内核态功耗参数值是指与资源设备支持的内核态的功耗管理机制相关的至少一个内核参数的取值组合。An embodiment of the present application also provides a task scheduling method, including: obtaining the task to be scheduled and the performance requirements of the task to be scheduled; selecting from at least one resource device that meets the performance requirements and the value of the power consumption parameter in the kernel mode meets the design requirements. A resource device with a fixed power consumption requirement; schedule the task to be scheduled to a resource device that meets the performance requirements and the value of the power consumption parameter in the kernel mode meets the set power consumption requirement; wherein the value of the kernel power consumption parameter refers to A value combination of at least one kernel parameter related to the power management mechanism of the kernel mode supported by the resource device.
本申请实施例还提供一种任务调度设备,包括:存储器和处理器;所述存储器,用于存储计算机程序;所述处理器,与所述存储器耦合,用于执行所述计算机程序,以用于:获取待调度任务以及所述待调度任务的性能要求;从至少一个资源设备中,选择满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备;将所述待调度任务调度至满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备;其中,所述内核态功耗参数值是指与资源设备支持的内核态的功耗管理机制相关的至少一个内核参数的取值组合。An embodiment of the present application also provides a task scheduling device, including: a memory and a processor; the memory is used to store a computer program; the processor is coupled with the memory and is used to execute the computer program for use In: Obtain the task to be scheduled and the performance requirements of the task to be scheduled; from at least one resource device, select a resource device that meets the performance requirements and the core state power consumption parameter value meets the set power consumption requirements; The scheduling task is scheduled to the resource device that meets the performance requirements and the core-mode power consumption parameter value meets the set power consumption requirement; wherein the core-mode power consumption parameter value refers to the core-mode power management mechanism supported by the resource device The value combination of at least one core parameter that is related.
本申请实施例还提供一种存储有计算机程序的计算机可读存储介质,当所述计算机程序被处理器执行时,致使所述处理器实现本申请实施例提供的任务调度方法中的步骤。The embodiment of the present application also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the processor is caused to implement the steps in the task scheduling method provided by the embodiment of the present application.
在本申请实施例中,将与功耗管理机制相关的内核参数的设置操作与人工智能相结合,基于人工智能训练出的性能-功耗预估模型得到物理设备在内核参数对应的多种取值组合下的性能数据和功耗数据,进而,以得到的性能数据和功耗数据为依据,可为内核参数设置合适的取值,兼顾物理设备的功 耗和性能,而与人工智能相结合,可提高参数设置效率,降低成本。In the embodiment of the present application, the setting operation of the kernel parameters related to the power management mechanism is combined with artificial intelligence, and the performance-power consumption estimation model trained based on the artificial intelligence obtains a variety of choices corresponding to the kernel parameters of the physical device. The performance data and power consumption data under the value combination, and then, based on the obtained performance data and power consumption data, appropriate values can be set for the kernel parameters, taking into account the power consumption and performance of the physical device, and combining with artificial intelligence , Which can improve the efficiency of parameter setting and reduce costs.
附图说明Description of the drawings
此处所说明的附图用来提供对本申请的进一步理解,构成本申请的一部分,本申请的示意性实施例及其说明用于解释本申请,并不构成对本申请的不当限定。在附图中:The drawings described here are used to provide a further understanding of the application and constitute a part of the application. The exemplary embodiments and descriptions of the application are used to explain the application, and do not constitute an improper limitation of the application. In the attached picture:
图1为本申请示例性实施例提供的一种数据中心系统的结构示意图;FIG. 1 is a schematic structural diagram of a data center system provided by an exemplary embodiment of this application;
图2为本申请示例性实施例提供的一种数据中心系统进行内核参数设置的原理示意图;FIG. 2 is a schematic diagram of the principle of kernel parameter setting of a data center system provided by an exemplary embodiment of this application;
图3为本申请示例性实施例提供的一种性能-功耗预估模型的工作原理示意图;FIG. 3 is a schematic diagram of the working principle of a performance-power consumption prediction model provided by an exemplary embodiment of this application;
图4a为本申请示例性实施例提供的一种设备管理系统的结构示意图;FIG. 4a is a schematic structural diagram of a device management system provided by an exemplary embodiment of this application;
图4b为本申请示例性实施例提供的一种边缘云网络系统的结构示意图;FIG. 4b is a schematic structural diagram of an edge cloud network system provided by an exemplary embodiment of this application;
图5a为本申请示例性实施例提供的一种数据处理方法的流程示意图;FIG. 5a is a schematic flowchart of a data processing method provided by an exemplary embodiment of this application;
图5b为本申请示例性实施例提供的另一种数据处理方法的流程示意图;FIG. 5b is a schematic flowchart of another data processing method provided by an exemplary embodiment of this application;
图6a为本申请示例性实施例提供的又一种数据处理方法的流程示意图;FIG. 6a is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application;
图6b为本申请示例性实施例提供的又一种数据处理方法的流程示意图;FIG. 6b is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application;
图7a为本申请示例性实施例提供的又一种数据处理方法的流程示意图;FIG. 7a is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application;
图7b为本申请示例性实施例提供的又一种数据处理方法的流程示意图;FIG. 7b is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application;
图7c为本申请示例性实施例提供的又一种数据处理方法的流程示意图;FIG. 7c is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application;
图7d为本申请示例性实施例提供的一种任务调度方法的流程示意图;FIG. 7d is a schematic flowchart of a task scheduling method provided by an exemplary embodiment of this application;
图8a为本申请示例性实施例提供的一种物理设备的结构示意图;FIG. 8a is a schematic structural diagram of a physical device provided by an exemplary embodiment of this application;
图8b为本申请示例性实施例提供的一种模型计算设备的结构示意图;FIG. 8b is a schematic structural diagram of a model computing device provided by an exemplary embodiment of this application;
图8c为本申请示例性实施例提供的一种任务调度设备的结构示意图。Fig. 8c is a schematic structural diagram of a task scheduling device provided by an exemplary embodiment of this application.
具体实施方式detailed description
为使本申请的目的、技术方案和优点更加清楚,下面将结合本申请具体 实施例及相应的附图对本申请技术方案进行清楚、完整地描述。显然,所描述的实施例仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the objectives, technical solutions and advantages of the present application clearer, the technical solutions of the present application will be described clearly and completely in conjunction with specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.
针对现有技术存在的问题,在本申请实施例中,将与功耗管理机制相关的内核参数的设置操作与人工智能相结合,基于人工智能训练出的性能-功耗预估模型,可得到物理设备在内核参数对应的多种取值组合下的性能数据和功耗数据,进而,以得到的性能数据和功耗数据为依据,可为内核参数设置合适的取值,兼顾物理设备的功耗和性能,而与人工智能相结合,可提高参数设置效率,降低成本。In view of the problems existing in the prior art, in the embodiments of the present application, the setting operation of the kernel parameters related to the power management mechanism is combined with artificial intelligence, and the performance-power consumption prediction model trained based on artificial intelligence can be obtained The performance data and power consumption data of the physical device under multiple combinations of values corresponding to the kernel parameters. Furthermore, based on the obtained performance data and power consumption data, appropriate values can be set for the kernel parameters, taking into account the functions of the physical device. Consumption and performance, combined with artificial intelligence, can improve the efficiency of parameter setting and reduce costs.
以下结合附图,详细说明本申请各实施例提供的技术方案。The technical solutions provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.
图1为本申请示例性实施例提供的一种数据中心系统的结构示意图。如图1所示,该数据中心系统100包括:模型计算设备101和至少一个机房102;至少一个机房102包括至少一台物理设备103。Fig. 1 is a schematic structural diagram of a data center system provided by an exemplary embodiment of this application. As shown in FIG. 1, the data center system 100 includes: a model computing device 101 and at least one computer room 102; the at least one computer room 102 includes at least one physical device 103.
其中,机房102是指存放机器设备的物理场所,例如可以是一个房间或厂房等。本实施例并不限定每个机房102内物理设备103的数量,每个机房102可以包括一台物理设备103,也可以包括多台物理设备103。一般来说,一个机房102会包括多台物理设备103。Among them, the machine room 102 refers to a physical place where machinery and equipment are stored, for example, it may be a room or a factory building. This embodiment does not limit the number of physical devices 103 in each computer room 102. Each computer room 102 may include one physical device 103 or multiple physical devices 103. Generally speaking, a computer room 102 will include multiple physical devices 103.
在本实施例中,物理设备103是指安装有操作系统,且支持内核态的功耗管理机制的物理设备。当然,机房102内除了包括安装有操作系统且支持内核态的功耗管理机制的物理设备103之外,也可以包含一些无需操作系统的设备,以及一些虽然安装有操作系统但不支持内核态的功耗管理机制的设备,对此不做限定。在本实施例以及其它实施例中重点关注安装有操作系统且支持内核态的功耗管理机制的物理设备103。In this embodiment, the physical device 103 refers to a physical device that has an operating system installed and supports a kernel-mode power management mechanism. Of course, in addition to the physical devices 103 that are installed with the operating system and support the power management mechanism in the kernel mode, the computer room 102 may also contain some devices that do not require an operating system, and some devices that do not support the kernel mode even though the operating system is installed. There are no restrictions on devices with power management mechanisms. In this embodiment and other embodiments, the focus is on the physical device 103 that is installed with an operating system and supports a kernel-mode power management mechanism.
在本实施例中,并不限定物理设备103的设备形态,凡是安装有操作系统且支持内核态的功耗管理机制的设备形态均适用于本申请实施例。可选地,物理设备103可以是一些安装有操作系统且支持内核态的功耗管理机制的IT 设备,但不限于此。例如,物理设备103可以包括但不限于以下至少一种:各种服务器设备、计算机设备、以及各种网络交换设备等。服务器设备可以是包括但不限于:常规服务器、服务器阵列或云服务器等。可选地,这些物理设备103上可以运行各种应用或服务,例如云计算服务、游戏服务,即时通信服务、邮件服务或在线交易服务等。当然,这些物理设备103上也可以不运行任何应用或服务。其中,根据物理设备103是否运行应用或服务,以及运行应用或服务的类型、数量等因素,物理设备103上的功耗管理机制会被触发并发挥相应作用。In this embodiment, the device form of the physical device 103 is not limited, and any device form that has an operating system installed and supports a kernel-mode power management mechanism is applicable to the embodiment of the present application. Optionally, the physical device 103 may be some IT devices installed with an operating system and supporting a kernel-mode power management mechanism, but it is not limited to this. For example, the physical device 103 may include but is not limited to at least one of the following: various server devices, computer devices, and various network switching devices. The server device may include, but is not limited to, a conventional server, a server array, or a cloud server. Optionally, various applications or services can be run on these physical devices 103, such as cloud computing services, game services, instant messaging services, mail services, or online transaction services. Of course, these physical devices 103 may not run any applications or services. Among them, according to whether the physical device 103 runs applications or services, and the type and quantity of running applications or services, the power consumption management mechanism on the physical device 103 will be triggered and play a corresponding role.
从本质上看,操作系统是一种软件,负责控制物理设备的硬件资源,并提供上层应用程序运行的环境。操作系统提供了两种CPU运行状态,为内核态和用户态。用户态是上层应用程序的活动空间,应用程序的执行必须依托于操作系统提供的资源,包括CPU资源、存储资源、I/O资源等。而本实施例的功耗管理机制是操作系统提供的一种对物理设备的功耗进行管理的机制,是操作系统级的功耗管理机制,需要运行在内核态,简称为内核态的功耗管理机制。值得说明的是,不同物理设备103所支持的内核态的功耗管理机制可以相同,也可以不相同。内核态的功耗管理机制与操作系统有关,若物理设备103的操作系统不同,物理设备103所支持的内核态的功耗管理机制也会有所不同。例如,以物理设备103采用Linux操作系统为例,则其支持的内核态的功耗管理机制包括但不限于:DVFS和C-state。In essence, the operating system is a kind of software that is responsible for controlling the hardware resources of physical devices and providing an environment for upper-level applications to run. The operating system provides two CPU operating states, kernel mode and user mode. User mode is the activity space of upper-level applications. The execution of applications must rely on the resources provided by the operating system, including CPU resources, storage resources, and I/O resources. The power consumption management mechanism of this embodiment is a mechanism provided by the operating system to manage the power consumption of physical devices. It is a power consumption management mechanism at the operating system level and needs to run in the kernel mode, referred to as power consumption in the kernel mode for short. Management mechanism. It is worth noting that the power management mechanisms in the kernel mode supported by different physical devices 103 may be the same or different. The power management mechanism of the kernel mode is related to the operating system. If the operating system of the physical device 103 is different, the power management mechanism of the kernel mode supported by the physical device 103 will also be different. For example, if the physical device 103 adopts the Linux operating system as an example, the power management mechanisms in the kernel state supported by it include, but are not limited to: DVFS and C-state.
其中,DVFS是根据芯片(如CPU)所运行的应用程序对计算能力的不同需要,动态调节芯片的运行频率和电压,从而达到节能目的的一种动态技术。对于同一芯片来说,其运行频率越高,需要的电压也越高,能耗越大。C-state是一种可以让CPU在空闲状态时进入低功耗状态的低功耗机制,C-states包含的C模式从C0开始一直到Cn,C0是CPU的正常工作模式,CPU处于100%运行状态;C后n的取值越高,CPU睡眠得越深,CPU的功耗越小,当然也就需要更多的时间返回到C0模式;其中,n是正整数。Among them, DVFS is a dynamic technology that dynamically adjusts the operating frequency and voltage of the chip according to the different needs of the application program running on the chip (such as the CPU) for computing power, so as to achieve the purpose of energy saving. For the same chip, the higher the operating frequency, the higher the voltage required and the greater the energy consumption. C-state is a low-power mechanism that allows the CPU to enter a low-power state when it is idle. The C-states included in C-states start from C0 to Cn. C0 is the normal operating mode of the CPU, and the CPU is at 100% Running state; the higher the value of n after C, the deeper the CPU sleeps, the lower the power consumption of the CPU, and of course it takes more time to return to the C0 mode; where n is a positive integer.
在本实施例中,内核态的功耗管理机制与一些内核参数相关,这些内核 参数也就是内核态的功耗管理机制的参数,这些内核参数的取值可影响内核态功耗管理机制的节能效果。在本实施例中,内核参数泛指各类操作系统源代码中的参数,例如Linux操作系统的内核参数、Windows操作系统的内核参数、UNIX操作系的内核参数或MAC操作系统的内核参数等。In this embodiment, the power management mechanism in the kernel mode is related to some kernel parameters. These kernel parameters are also the parameters of the power management mechanism in the kernel mode. The values of these kernel parameters can affect the energy saving of the power management mechanism in the kernel mode. effect. In this embodiment, the kernel parameters generally refer to the parameters in the source code of various operating systems, such as the kernel parameters of the Linux operating system, the kernel parameters of the Windows operating system, the kernel parameters of the UNIX operating system, or the kernel parameters of the MAC operating system.
以Linux操作系统为例,与DVFS相关的内核参数包括但不限于:CPU能够运行的最低工作频率(记为scaling_min_freq)、CPU能够运行的最高工作频率(记为scaling_max_freq)以及CPU工作频率的调节模式(记为scaling_governor);对物理设备103来说,可通过调整这三个参数中至少一个参数的取值来改变DVFS的节能效果。以Linux操作系统为例,与C-states相关的内核参数包括但不限于:各级C模式对应的进入时间阈值(记为target_residency);其中,进入时间阈值表示物理设备103进入相应C模式后至少需要在该模式下保持的时间,是物理设备103进入相应C模式需要满足的时间条件;对物理设备103来说,可通过调整相应C模式对应的进入时间阈值来改变CPU进入相应C模式的难易程度,改变C-states机制的节能效果。Taking the Linux operating system as an example, the kernel parameters related to DVFS include but are not limited to: the minimum operating frequency that the CPU can run (denoted as scaling_min_freq), the highest operating frequency that the CPU can run (denoted as scaling_max_freq), and the adjustment mode of the CPU operating frequency (Denoted as scaling_governor); for the physical device 103, the energy saving effect of the DVFS can be changed by adjusting the value of at least one of the three parameters. Taking the Linux operating system as an example, the kernel parameters related to C-states include, but are not limited to: the entry time threshold corresponding to each level of C mode (denoted as target_residency); where the entry time threshold indicates that the physical device 103 has entered the corresponding C mode at least The time required to stay in this mode is the time condition that the physical device 103 needs to meet to enter the corresponding C mode; for the physical device 103, the difficulty of the CPU entering the corresponding C mode can be changed by adjusting the entry time threshold corresponding to the corresponding C mode. Easy to change the energy-saving effect of the C-states mechanism.
无论是哪种内核态的功耗管理机制,与其相关的内核参数可能具有多种取值。例如,处理器能够运行的最高工作频率scaling_max_freq可以设置为2.4GHZ、3.6GHZ等。与功耗管理机制相关的内核参数的取值不同,功耗管理机制所能产生的节能效果会有所不同。在实际应用中,物理设备103的功耗与性能有一定关系,一般来说,功耗越低,性能会越差,所以并不能一味的追求低功耗,理想地,应该是根据应用需求追求功耗与性能之间的均衡。在不同应用场景下,物理设备103对功耗和性能的要求会有所不同,如何设置与物理设备103所支持的内核态功耗管理机制相关的内核参数的取值,以使功耗管理机制产生较优或最优的节能效果,且同时满足物理设备103对性能的要求,是需要解决的一个问题。Regardless of the power management mechanism in the kernel mode, the kernel parameters related to it may have multiple values. For example, the maximum operating frequency scaling_max_freq at which the processor can run can be set to 2.4GHZ, 3.6GHZ, and so on. The value of the kernel parameter related to the power management mechanism is different, and the energy saving effect that the power management mechanism can produce will be different. In practical applications, the power consumption of the physical device 103 has a certain relationship with performance. Generally speaking, the lower the power consumption, the worse the performance will be. Therefore, we cannot blindly pursue low power consumption. Ideally, it should be based on application requirements. Balance between power consumption and performance. In different application scenarios, the physical device 103 has different requirements for power consumption and performance. How to set the value of the kernel parameter related to the kernel mode power management mechanism supported by the physical device 103 to enable the power management mechanism It is a problem that needs to be solved to produce a better or optimal energy-saving effect and at the same time meet the performance requirements of the physical device 103.
其中,与功耗管理机制相关的内核参数属于系统级参数,需要在操作系统源代码中进行设置,每次重新设置这些内核参数的取值之后,需要重新安装操作系统,而且只有在操作系统运行一定时间之后才能判断当前取值是否 能够满足设备对功耗和性能的要求,是否需要重新调整。若与功耗管理机制相关的内核参数较多,这些内核参数的取值组合的数量也会较多,如果采用一种一种尝试的方式来选取最佳取值组合,会花费很长时间。Among them, the kernel parameters related to the power management mechanism are system-level parameters and need to be set in the source code of the operating system. Each time the values of these kernel parameters are reset, the operating system needs to be reinstalled, and only when the operating system is running After a certain period of time, it can be judged whether the current value can meet the requirements of the device for power consumption and performance, and whether it needs to be adjusted again. If there are many kernel parameters related to the power management mechanism, the number of value combinations of these kernel parameters will also be larger. If a trial method is adopted to select the best value combination, it will take a long time.
基于上述考虑,在本实施例中,将内核参数的设置操作与人工智能相结合,以人工智能模型为基础,得到物理设备103在相关内核参数对应的多种取值组合下的性能数据和功耗数据,进而,以物理设备103在相关内核参数对应的多种取值组合下的性能数据和功耗数据为依据,进行内核参数的设置,不仅可为内核参数设置合适的取值,而且可以同时兼顾物理设备103对功耗和性能的要求,而与人工智能相结合,可提高参数设置效率,降低成本。Based on the above considerations, in this embodiment, the kernel parameter setting operation is combined with artificial intelligence, and based on the artificial intelligence model, the performance data and functions of the physical device 103 under various value combinations corresponding to the relevant kernel parameters are obtained. Based on the performance data and power consumption data of the physical device 103 under various value combinations corresponding to the relevant kernel parameters, the kernel parameter settings can not only set appropriate values for the kernel parameters, but also At the same time, it takes into account the requirements of the physical device 103 for power consumption and performance, and the combination with artificial intelligence can improve the efficiency of parameter setting and reduce the cost.
为了实现上述目的,在本实施例的数据中心系统100中,增设模型计算设备101,主要负责得到物理设备103在相关内核参数对应的多种取值组合下的性能数据和功耗数据。对模型计算设备101而言,可针对每台物理设备103,从该物理设备103的内核参数中确定与该物理设备103支持的内核态的功耗管理机制相关的至少一个内核参数,基于人工智能模型为该物理设备103提供其在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,以供该物理设备103据此完成相关内核参数的设置。In order to achieve the above purpose, in the data center system 100 of this embodiment, a model computing device 101 is added, which is mainly responsible for obtaining the performance data and power consumption data of the physical device 103 under various value combinations corresponding to related kernel parameters. For the model computing device 101, for each physical device 103, at least one kernel parameter related to the power management mechanism of the kernel state supported by the physical device 103 can be determined from the kernel parameters of the physical device 103, based on artificial intelligence The model provides the physical device 103 with its performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter, so that the physical device 103 can complete the setting of related kernel parameters accordingly.
其中,模型计算设备101可以设置在某个机房102内,或者独立于各机房102,单独设置于某处,例如可设置在云端。另外,本实施例并不限定模型计算设备101的设备形态,可以是任何具有一定计算能力和通信能力的计算设备。如图1所示,模型计算设备101可以是常规服务器、云服务器、带有GPU的服务器、具有特定Ai芯片的服务器或服务器阵列等。Wherein, the model computing device 101 may be set in a certain computer room 102, or be independent of each computer room 102, and be set separately in a certain place, for example, it may be set in the cloud. In addition, this embodiment does not limit the device form of the model computing device 101, and may be any computing device with certain computing capabilities and communication capabilities. As shown in FIG. 1, the model computing device 101 may be a conventional server, a cloud server, a server with a GPU, a server with a specific Ai chip, or a server array, etc.
可选地,模型计算设备101可以与每台物理设备103之间通信连接,在得到每台物理设备103在相关内核参数对应的多种取值组合下的性能数据和功耗数据之后,可基于其与每台物理设备103之间的通信连接,向每台物理设备103提供其在相关内核参数对应的多种取值组合下的性能数据和功耗数据。其中,模型计算设备101与每台物理设备103之间可以是无线或有线连接。可选地,物理设备103可以通过移动网络与模型计算设备101进行通信 连接。其中,移动网络的网络制式可以为2G(GSM)、2.5G(GPRS)、3G(WCDMA、TD-SCDMA、CDMA2000、UTMS)、4G(LTE)、4G+(LTE+)、5G、WiMax或者未来即将出现的新网络制式等中的任意一种。可选地,物理设备103也可以通过蓝牙、WiFi、红外、zigbee或NFC等方式与模型计算设备101进行通信连接。Optionally, the model computing device 101 may communicate with each physical device 103. After obtaining the performance data and power consumption data of each physical device 103 under multiple value combinations corresponding to the relevant kernel parameters, it may be based on The communication connection between it and each physical device 103 provides each physical device 103 with its performance data and power consumption data under a variety of value combinations corresponding to related kernel parameters. Wherein, the model computing device 101 and each physical device 103 may be wirelessly or wiredly connected. Optionally, the physical device 103 can communicate with the model computing device 101 via a mobile network. Among them, the network standard of the mobile network can be 2G (GSM), 2.5G (GPRS), 3G (WCDMA, TD-SCDMA, CDMA2000, UTMS), 4G (LTE), 4G+ (LTE+), 5G, WiMax or coming soon in the future Any of the new network standards, etc. Optionally, the physical device 103 can also communicate with the model computing device 101 through Bluetooth, WiFi, infrared, zigbee, or NFC.
需要说明的是,模型计算设备101不是必须与物理设备103之间建立通信连接。在模型计算设备101与物理设备103之间未建立通信连接的场景中,也可以通过一些移动硬盘、U盘等移动存储设备,将物理设备103在相关内核参数对应的多种取值组合下的性能数据和功耗数据从模型计算设备101上拷贝到物理设备103上。It should be noted that the model computing device 101 does not have to establish a communication connection with the physical device 103. In the scenario where a communication connection is not established between the model computing device 101 and the physical device 103, some mobile storage devices such as mobile hard disks and U disks can also be used to combine the physical device 103 under various combinations of values corresponding to the relevant kernel parameters. The performance data and power consumption data are copied from the model computing device 101 to the physical device 103.
为了便于描述,本实施例以任意一台物理设备103为例,并结合图2所示流程图,对本系统的工作原理进行说明。为便于描述和区分,在后续内容中以目标设备为例展开描述,目标设备代表任意一台物理设备103。For ease of description, this embodiment takes any physical device 103 as an example, and uses the flowchart shown in FIG. 2 to describe the working principle of the system. For ease of description and distinction, the target device is used as an example in the following content to expand the description, and the target device represents any physical device 103.
例如,在某个机房102中新增物理设备的情况下,可将该新增的物理设备作为目标设备,在为目标设备安装操作系统之前,可根据目标设备的应用需求对操作系统源代码中与功耗管理机制相关的内核参数进行设置,并根据经过参数设置后的操作系统源代码在目标设备上安装操作系统。又例如,在目标设备上的负载信息(例如应用或服务)发生变化的情况下,为了让目标设备能够满足新负载信息对功耗和性能的要求,可以重新修改操作系统源代码中与功耗管理机制相关的内核参数的取值,并根据修改后的操作系统源代码重新为目标设备安装操作系统。又例如,在将某台设备租售给某个客户的情况下,可将租售给客户的设备作为目标设备,为保证目标设备能够成功为客户提供相应服务,可根据客户的要求为该目标设备安装操作系统并在安装操作系统之前对操作系统源代码中与功耗管理机制相关的内核参数进行设置。For example, in the case of a new physical device in a certain computer room 102, the newly added physical device can be used as the target device. Before installing the operating system for the target device, the source code of the operating system can be modified according to the application requirements of the target device. Kernel parameters related to the power management mechanism are set, and the operating system is installed on the target device according to the operating system source code after the parameter setting. For another example, when the load information (such as an application or service) on the target device changes, in order to allow the target device to meet the power consumption and performance requirements of the new load information, the operating system source code and power consumption can be re-modified. The value of the kernel parameter related to the management mechanism, and the operating system is reinstalled for the target device according to the modified operating system source code. For another example, in the case of renting and selling a piece of equipment to a certain customer, the equipment rented and sold to the customer can be used as the target equipment. In order to ensure that the target equipment can successfully provide corresponding services to the customer, the target can be set according to the customer’s requirements. The device installs the operating system and sets the kernel parameters related to the power management mechanism in the operating system source code before installing the operating system.
无论是上述哪种需求,模型计算设备101可以从目标设备的内核参数中,确定与目标设备支持的内核态的功耗管理机制相关的至少一个内核参数。内 核参数的数量可以是一个,也可以是多个,具体视功耗管理机制而定。Regardless of the foregoing requirements, the model computing device 101 can determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device from the kernel parameters of the target device. The number of core parameters can be one or more, depending on the power management mechanism.
可选地,模型计算设备101可具有人机交互能力,则可与数据中心系统100的管理员进行人机交互,从而确定与目标设备支持的内核态的功耗管理机制相关的至少一个内核参数。例如,模型计算设备101可以提供人机交互界面或命令窗口,管理员可以通过人机交互界面或命令窗口,向模型计算设备101输入目标设备的标识、目标设备支持的内核态的功耗管理机制的信息;模型计算设备101根据这些信息,从目标设备的内核参数中,确定与目标设备支持的内核态的功耗管理机制相关的至少一个内核参数。又例如,模型计算设备101具备语音识别能力,则管理员可以以语音方式,向模型计算设备101输入目标设备的标识和目标设备支持的内核态的功耗管理机制的信息;模型计算设备101根据这些信息,从目标设备的内核参数中,确定与目标设备支持的内核态的功耗管理机制相关的至少一个内核参数。当然,除了上面信息之外,管理员也可以直接向模型计算设备101输入与目标设备支持的内核态的功耗管理机制相关的至少一个内核参数的标识,例如参数名称。Optionally, the model computing device 101 may have human-computer interaction capabilities, and may perform human-computer interaction with the administrator of the data center system 100 to determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device . For example, the model computing device 101 can provide a human-computer interaction interface or a command window, and the administrator can input the target device identification and the kernel mode power management mechanism supported by the target device to the model computing device 101 through the human-computer interaction interface or command window. According to the information; the model computing device 101 determines from the kernel parameters of the target device, at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device. For another example, if the model computing device 101 is capable of speech recognition, the administrator can input the identification of the target device and the information of the power management mechanism in the kernel mode supported by the target device into the model computing device 101 by voice; the model computing device 101 according to With this information, from the kernel parameters of the target device, at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device is determined. Of course, in addition to the above information, the administrator can also directly input to the model computing device 101 the identification of at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device, such as the parameter name.
在确定与目标设备支持的内核态的功耗管理机制相关的至少一个内核参数之后,模型计算设备101可以收集目标设备在至少一个内核参数对应的部分取值组合下的性能数据和功耗数据,作为样本数据,并利用这些样本数据进行模型训练,得到性能-功耗预估模型,如图2所示。其中,根据目标设备上运行的服务或应用的不同,目标设备的性能数据会有所不同。性能数据主要是指一些能够反应目标设备承担服务并且保障服务的能力大小的数据。例如,可以是目标设备上服务的实际达到的QoS、QPS、TPS或者对请求的响应时间,等等。After determining at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device, the model computing device 101 may collect the performance data and power consumption data of the target device under the partial value combination corresponding to the at least one kernel parameter, As sample data, and use these sample data for model training to obtain a performance-power consumption prediction model, as shown in Figure 2. Among them, the performance data of the target device will be different according to different services or applications running on the target device. Performance data mainly refers to some data that can reflect the capacity of the target device to undertake the service and guarantee the service. For example, it can be the actually achieved QoS, QPS, TPS, or response time to the request of the service on the target device, and so on.
在此说明,若至少一个内核参数的数量为一个,则一个取值组合包含一个取值;若至少一个内核参数的数量为多个,则一个取值组合中包含与多个内核参数一一对应的多个取值,且不同取值组合包含的多个取值不完全相同。It is explained here that if the number of at least one kernel parameter is one, then one value combination includes one value; if the number of at least one kernel parameter is more than one, then one value combination includes multiple kernel parameters one by one. Corresponding multiple values, and the multiple values included in different value combinations are not completely the same.
在本实施例中,如图2所示,模型计算设备101可以借助负载测试工具收集目标设备在至少一个内核参数对应的部分取值组合下的性能数据和功耗 数据。在目标设备上安装并运行负载测试工具,负载测试工具可模拟目标设备在不同负载情况的性能数据和功耗数据。详细地,从至少一个内核参数对应的多种取值组合中,选定部分取值组合,部分取值组合的数量只要满足模型训练所需的数量即可;针对部分取值组合中的每一种取值组合,根据目标设备需要满足的负载、功耗和/或性能要求,利用负载测试工具得到目标设备在该取值组合下满足相应要求时的性能数据和功耗数据;将目标设备在部分取值组合下满足相应要求时的性能数据和功耗数据提供给模型计算设备101。为了简化描述,将目标设备在每种取值组合下满足相应要求时的性能数据和功耗数据,简称为目标设备在每种取值组合下的性能数据和功耗数据。In this embodiment, as shown in FIG. 2, the model computing device 101 can use a load test tool to collect performance data and power consumption data of the target device under a partial value combination corresponding to at least one kernel parameter. Install and run the load test tool on the target device. The load test tool can simulate the performance data and power consumption data of the target device under different load conditions. In detail, from multiple value combinations corresponding to at least one kernel parameter, select some value combinations, and the number of some value combinations only needs to meet the number required for model training; for each of the partial value combinations According to the load, power consumption and/or performance requirements that the target device needs to meet, the load test tool is used to obtain the performance data and power consumption data of the target device when the value combination meets the corresponding requirements. The performance data and power consumption data when the corresponding requirements are met under the partial value combination are provided to the model computing device 101. In order to simplify the description, the performance data and power consumption data of the target device when it meets the corresponding requirements under each value combination are referred to as the performance data and power consumption data of the target device under each value combination for short.
其中,针对部分取值组合中的每一种取值组合,在利用负载测试工具得到目标设备在该取值组合下的性能数据和功耗数据的过程包括:针对该取值组合,先将操作系统源代码中至少一个内核参数的取值修改为该取值组合中的取值,并根据修改后的操作系统源代码在目标设备上安装操作系统;在成功安装操作系统之后,在目标设备上安装负载测试工具,根据目标设备应该满足的负载、功耗和/或性能要求,利用负载测试工具模拟相应负载情况并获取目标设备在相应负载情况下的性能数据和功耗数据。Among them, for each value combination in the partial value combination, the process of using the load test tool to obtain the performance data and power consumption data of the target device under the value combination includes: for the value combination, first operate The value of at least one kernel parameter in the system source code is modified to the value in the value combination, and the operating system is installed on the target device according to the modified operating system source code; after the operating system is successfully installed, on the target device Install the load test tool, and use the load test tool to simulate the corresponding load condition and obtain the performance data and power consumption data of the target device under the corresponding load according to the load, power consumption and/or performance requirements that the target device should meet.
在本实施例中,并不限定负载测试工具的数量以及类型,可根据应用需求、操作系统类型等灵活选择。例如,本实施例列举几种负载测试工具:Stream测试工具,用于内存性能测试;Specjbb测试工具,用于测试cpu性能;Speccpu测试工具,用于测试CPU性能;Fio测试工具,用于测试磁盘IO性能;Sysbench测试工具,用于测试mysql数据库性能,等等。In this embodiment, the number and types of load testing tools are not limited, and can be flexibly selected according to application requirements, operating system types, and the like. For example, this embodiment lists several load testing tools: Stream testing tool for memory performance testing; Specjbb testing tool for testing CPU performance; Speccpu testing tool for testing CPU performance; Fio testing tool for testing disks IO performance; Sysbench testing tool for testing mysql database performance, etc.
可选地,在上述几种负载测试工具测试过程中,可以借助功耗采集工具例如电量计,采集物理设备在测试过程中的功耗数据。其中,负载测试工具测试出的相关性能参数和功耗采集工具在测试过程中采集到的功耗数据,即为物理设备103在某种取值组合下满足相应要求时的性能数据和功耗数据。Optionally, during the testing process of the above-mentioned several load testing tools, a power consumption collection tool such as a fuel gauge can be used to collect power consumption data of the physical device during the testing process. Among them, the relevant performance parameters tested by the load test tool and the power consumption data collected by the power consumption collection tool during the test are the performance data and power consumption data of the physical device 103 when it meets the corresponding requirements under a certain combination of values. .
在得到目标设备在至少一个内核参数对应的部分取值组合下的性能数据和功耗数据之后,模型计算设备101以这些数据作为样本数据进行模型训练。 在本实施例中,并不限定模型计算设备101进行模型训练的过程,例如可以是基于深度神经网络的模型训练过程,也可以基于回归分析的模型训练过程,凡是可以分析出至少一个内核参数对应的取值组合与目标设备的性能数据和功耗数据之间的关联关系的模型训练方法均适用于本申请实施例。After obtaining the performance data and power consumption data of the target device under the partial value combination corresponding to at least one kernel parameter, the model computing device 101 uses these data as sample data for model training. In this embodiment, the process of model training performed by the model computing device 101 is not limited. For example, it can be a model training process based on a deep neural network, or a model training process based on regression analysis, where at least one kernel parameter can be analyzed. The model training method of the association relationship between the value combination of and the performance data and power consumption data of the target device is applicable to the embodiments of the present application.
其中,回归分析是确定两种或两种以上变量间相互依赖的定量关系的一种统计分析方法,是一种预测性的建模技术。在一可选实施例中,模型计算设备101可以采用基于回归分析的建模方法。基于此,模型计算设备101进行模型训练的过程实际是,对目标设备在至少一个内核参数对应的部分取值组合下的性能数据和功耗数据进行回归分析的过程,经过回归分析可得到至少一个内核参数对应的取值组合与目标设备的性能数据和功耗数据之间的关联关系,即性能-功耗预估模型。Among them, regression analysis is a statistical analysis method to determine the quantitative relationship between two or more variables, and it is a predictive modeling technique. In an optional embodiment, the model computing device 101 may adopt a modeling method based on regression analysis. Based on this, the process of model training performed by the model computing device 101 is actually a process of performing regression analysis on the performance data and power consumption data of the target device under the partial value combination corresponding to at least one kernel parameter. After regression analysis, at least one The correlation between the value combination corresponding to the kernel parameter and the performance data and power consumption data of the target device is the performance-power consumption prediction model.
其中,回归分析包括线性回归分析、逻辑回归分析等多种。在本申请一可选实施例中,优先选择线性回归分析进行建模。基于此,模型计算设备101进行模型训练的过程包括:将至少一个内核参数对应的部分取值组合作为自变量,将目标设备在部分取值组合下的性能数据和功耗数据作为因变量进行线性回归分析,得到性能-功耗预估模型。该可选实施例得到的性能-功耗预估模型是一种线性回归模型。Among them, regression analysis includes linear regression analysis and logistic regression analysis. In an optional embodiment of the present application, linear regression analysis is preferred for modeling. Based on this, the process of model training performed by the model computing device 101 includes: taking partial value combinations corresponding to at least one kernel parameter as an independent variable, and taking the performance data and power consumption data of the target device under the partial value combination as the dependent variable for linearization. Regression analysis, the performance-power consumption prediction model is obtained. The performance-power consumption prediction model obtained by this optional embodiment is a linear regression model.
在一可选实施例中,在得到性能-功耗预估模型之后,模型计算设备101可以利用性能-功耗预估模型预估目标设备在至少一个内核参数对应的其它取值组合下的性能数据和功耗数据,如图2所示。与利用负载测试工具测试的方式相比,利用性能-功耗预估模型进行预估目标设备在其它取值组合下的性能数据和功耗数据,速度要快很多,可节约大量时间成本。其中,由性能-功耗预估模型预估出的目标设备在至少一个内核参数对应的其它取值组合下的性能数据和功耗数据,结合采用负载测试工具测试到的目标设备在至少一个内核参数对应的部分取值组合下的性能数据和功耗数据,可得到目标设备在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据。这里的“多种取值组合”可以是至少一个内核参数的所有取值组合,也可以是至少一个 内核参数的所有取值组合中的一部分。无论“多种取值组合”是至少一个内核参数的所有取值组合,还是部分取值组合,“多种取值组合”包括上文中的“部分取值组合”和“其余取值组合”。或者,In an optional embodiment, after the performance-power consumption prediction model is obtained, the model computing device 101 may use the performance-power consumption prediction model to predict the performance of the target device under other value combinations corresponding to at least one core parameter. Data and power consumption data are shown in Figure 2. Compared with the method of using the load test tool to test, using the performance-power estimation model to estimate the performance data and power consumption data of the target device under other value combinations is much faster and can save a lot of time and cost. Among them, the performance data and power consumption data of the target device under other value combinations corresponding to at least one core parameter estimated by the performance-power consumption prediction model are combined with the target device tested by the load test tool in at least one core The performance data and power consumption data under the partial value combinations corresponding to the parameters can obtain the performance data and power consumption data of the target device under multiple value combinations corresponding to at least one core parameter. The "multiple value combinations" here can be all value combinations of at least one kernel parameter, or part of all value combinations of at least one kernel parameter. Regardless of whether "multiple value combinations" are all value combinations of at least one kernel parameter or partial value combinations, "multiple value combinations" include the above "partial value combinations" and "other value combinations". or,
在另一可选实施例中,在得到性能-功耗预估模型之后,模型计算设备101可以利用性能-功耗预估模型预估目标设备在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据。同理,这里的“多种取值组合”可以是至少一个内核参数的所有取值组合,也可以是至少一个内核参数的所有取值组合中的一部分。无论“多种取值组合”是至少一个内核参数的所有取值组合,还是部分取值组合,“多种取值组合”包括上文中的“部分取值组合”和“其余取值组合”。In another optional embodiment, after the performance-power consumption prediction model is obtained, the model computing device 101 may use the performance-power consumption prediction model to estimate that the target device is under multiple value combinations corresponding to at least one kernel parameter Performance data and power consumption data. In the same way, the "multiple value combinations" here can be all value combinations of at least one kernel parameter, or part of all value combinations of at least one kernel parameter. Regardless of whether "multiple value combinations" are all value combinations of at least one kernel parameter or partial value combinations, "multiple value combinations" include the above "partial value combinations" and "other value combinations".
在得到目标设备在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据之后,模型计算设备101可基于其与目标设备之间的通信连接,主动将目标设备在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据发送给目标设备,或者,也可以根据目标设备的请求,将目标设备在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据发送给目标设备,或者,目标设备也可以主动到模型计算设备101上下载其在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据;或者也可以由相关人员通过移动存储设备将目标设备在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据发送给目标设备从模型计算设备101上拷贝到目标设备上。本申请实施例并不限定目标设备具体以何种方式获取其在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据。After obtaining the performance data and power consumption data of the target device under multiple value combinations corresponding to at least one core parameter, the model computing device 101 can actively place the target device in at least one core based on the communication connection between it and the target device. The performance data and power consumption data under multiple value combinations corresponding to the parameters are sent to the target device, or, according to the request of the target device, the performance data of the target device under multiple value combinations corresponding to at least one kernel parameter And power consumption data are sent to the target device, or the target device can also actively download its performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter to the model computing device 101; or it can also be related The personnel sends the performance data and power consumption data of the target device under multiple value combinations corresponding to at least one kernel parameter to the target device through a mobile storage device and copies them from the model computing device 101 to the target device. The embodiment of the present application does not limit the specific manner in which the target device obtains its performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter.
对目标设备来说,可获取其在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,并在参数设置过程中,以其在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据为依据,确定至少一个内核参数对应的目标取值组合,根据目标取值组合对至少一个内核参数进行设置。其中,根据目标取值组合对至少一个内核参数进行设置的过程包括:将操作系统源代码中与功耗管理机制相关的至少一个内核参数的取值修改为目标值组 合中的取值,之后,还可以根据修改后的操作系统源代码在物理设备上安装操作系统。其中,根据修改后的操作系统源代码在物理设备上安装操作系统包括:对修改后的操作系统源代码进行编译,得到操作系统的安装文件,运行安装文件完成操作系统的安装。For the target device, the performance data and power consumption data under multiple value combinations corresponding to at least one core parameter can be obtained, and during the parameter setting process, the multiple values corresponding to at least one core parameter can be used Based on the combined performance data and power consumption data, a target value combination corresponding to at least one core parameter is determined, and at least one core parameter is set according to the target value combination. The process of setting at least one kernel parameter according to the target value combination includes: modifying the value of at least one kernel parameter related to the power consumption management mechanism in the operating system source code to the value in the target value combination, and then, The operating system can also be installed on the physical device according to the modified operating system source code. Wherein, installing the operating system on the physical device according to the modified operating system source code includes: compiling the modified operating system source code to obtain an installation file of the operating system, and running the installation file to complete the installation of the operating system.
在本申请实施例中,并不限定以目标设备在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据为依据,确定至少一个内核参数对应的目标取值组合的具体实施方式。下面示例性列举几种可选的实施方式:In the embodiments of the present application, the specific implementation of determining the target value combination corresponding to at least one core parameter based on the performance data and power consumption data of the target device under multiple value combinations corresponding to at least one core parameter is not limited. the way. The following exemplarily lists several optional implementation manners:
在可选实施方式A中,可以根据目标设备在多种取值组合下的性能数据和功耗数据,直接从多种取值组合中确定出目标取值组合。In optional implementation A, the target value combination can be directly determined from the multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations.
在可选实施方式B中,可以获取目标设备实际需要满足的功耗数据和/或性能数据;将目标设备实际需要满足的功耗数据和/或性能数据,与目标设备在多种取值组合下的性能数据和功耗数据进行匹配;根据目标设备实际需要满足的功耗数据和/或性能数据与目标设备在多种取值组合下的性能数据和功耗数据之间的匹配度,从所述多种取值组合中选择满足匹配度要求的取值组合作为目标取值组合。In optional implementation B, the power consumption data and/or performance data that the target device actually needs to meet can be obtained; the power consumption data and/or performance data that the target device actually needs to meet can be combined with the target device in multiple values Match the performance data and power consumption data under the following; according to the actual power consumption data and/or performance data that the target device needs to meet with the performance data and power consumption data of the target device under multiple value combinations, from Among the multiple value combinations, a value combination that meets the matching degree requirement is selected as the target value combination.
在可选实施方式C中,可以根据目标设备在多种取值组合下的性能数据和功耗数据,从多种取值组合中选择至少一种候选取值组合;利用负载测试工具测试目标设备在至少一种候选取值组合下的性能数据和功耗数据;进而,根据负载测试工具测试出的目标设备在至少一种候选取值组合下的性能数据和功耗数据,从至少一种候选取值组合中确定目标取值组合。在实施方式C中,除了依据目标设备在多种取值组合下的性能数据和功耗数据之外,还结合负载测试工具,有利于提高最终选择出的目标取值组合的准确性,有利于提高参数设置的精度。In optional implementation C, at least one candidate value combination can be selected from multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations; the load test tool is used to test the target device Performance data and power consumption data under at least one candidate value combination; further, according to the performance data and power consumption data of the target device under at least one candidate value combination tested by the load test tool, from at least one candidate value combination Determine the target value combination in the value combination. In Embodiment C, in addition to the performance data and power consumption data of the target device under multiple value combinations, the load test tool is also combined to improve the accuracy of the final selected target value combination, and is beneficial to Improve the accuracy of parameter settings.
进一步,在实施方式C中,在根据目标设备在多种取值组合下的性能数据和功耗数据,从多种取值组合中选择至少一种候选取值组合的过程中,可以直接根据目标设备在多种取值组合下的性能数据和功耗数据,从多种取值组合中选择出至少一种候选取值组合。或者,还可以结合目标设备实际需要 满足的功耗数据,或结合目标设备实际需要满足的性能数据,或者同时结合目标设备实际需要满足的功耗数据和性能数据,从多种取值组合中选择至少一种候选取值组合。Further, in Embodiment C, in the process of selecting at least one candidate value combination from multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations, the target device can be directly selected according to the target value combination. For the performance data and power consumption data of the device under multiple value combinations, at least one candidate value combination is selected from the multiple value combinations. Or, you can also combine the power consumption data that the target device actually needs to meet, or combine the performance data that the target device actually needs to meet, or combine the power consumption data and performance data that the target device actually needs to meet, and choose from a variety of value combinations At least one combination of candidate values.
其中,可以根据目标设备实际需要承载的服务的QoS,分析出目标设备实际需要满足的功耗数据和/或性能数据。一般来说,每个服务都有自己的一套标准来衡量自己的服务性能,例如发出一个读取数据库的请求多久得到回复是可以接受的等。或者,也可以获取服务部署用户要求的功耗数据和/或性能数据,作为目标设备实际需要满足的功耗数据和/或性能数据。服务部署用户是指需要在目标设备上部署服务的用户,服务部署用户对其所部署的服务会有一定要求,例如要求性能达到某个标准,或者要求功耗不能超过某个功率阈值等,可以从对功耗的要求中获取目标设备实际需要满足的功耗数据,或者从对性能的要求中获取目标设备实际需要满足的性能数据。Among them, the power consumption data and/or performance data that the target device actually needs to meet can be analyzed according to the QoS of the service that the target device actually needs to carry. Generally speaking, each service has its own set of standards to measure its own service performance, such as how long it takes for a request to read the database to get a response is acceptable. Alternatively, the power consumption data and/or performance data required by the service deployment user may also be obtained as the power consumption data and/or performance data that the target device actually needs to meet. Service deployment users refer to users who need to deploy services on target devices. Service deployment users have certain requirements for the services they deploy, such as requiring performance to meet a certain standard, or requiring power consumption not to exceed a certain power threshold, etc. Obtain the power consumption data that the target device actually needs to meet from the power consumption requirements, or obtain the performance data that the target device actually needs to meet from the performance requirements.
例如,目标设备可以获取其实际需要满足的功耗数据,将目标设备实际需要满足的功耗数据,与目标设备在至少一种内核参数对应的多种取值组合下的性能数据和功耗数据进行匹配;从多种取值组合中,获取与目标设备实际需要满足的功耗数据的匹配度满足匹配度要求的取值组合作为候选取值组合。在该实施例中,可根据应用需求,优先考虑对目标设备的功耗要求,通过设置与功耗管理机制相关的内核参数,使得目标设备满足功耗要求。For example, the target device can obtain the power consumption data that it actually needs to meet, and compare the power consumption data that the target device actually needs to meet with the performance data and power consumption data of the target device under a combination of multiple values corresponding to at least one core parameter. Perform matching; from a variety of value combinations, obtain a value combination that has a matching degree with the power consumption data that the target device actually needs to meet and meets the matching degree requirement as a candidate value combination. In this embodiment, the power consumption requirements of the target device can be given priority according to application requirements, and the kernel parameters related to the power consumption management mechanism can be set to make the target device meet the power consumption requirements.
又例如,目标设备可以获取其实际需要满足的性能数据,将目标设备实际需要满足的性能数据,与目标设备在至少一种内核参数对应的多种取值组合下的性能数据和功耗数据进行匹配;从多种取值组合中,获取与目标设备实际需要满足的性能数据的匹配度满足匹配度要求的取值组合作为候选取值组合。在该实施例中,可根据应用需求,优先考虑对目标设备的性能要求,通过设置与功耗管理机制相关的内核参数,可以通过能耗换性能,使目标设备满足功耗要求。For another example, the target device can obtain the performance data that it actually needs to meet, and compare the performance data that the target device actually needs to meet with the performance data and power consumption data of the target device under multiple combinations of values corresponding to at least one kernel parameter. Matching: From a variety of value combinations, obtain a value combination that has a matching degree with the performance data that the target device actually needs to meet and meets the matching degree requirement as a candidate value combination. In this embodiment, the performance requirements of the target device can be prioritized according to application requirements. By setting kernel parameters related to the power consumption management mechanism, the target device can meet the power consumption requirements by converting energy consumption to performance.
又例如,目标设备可以获取其实际需要满足的功耗数据和性能数据,将目标设备实际需要满足的性能数据和功耗数据,与目标设备在至少一种内核 参数对应的多种取值组合下的性能数据和功耗数据进行匹配;从多种取值组合中,获取与目标设备实际需要满足的功耗数据和性能数据的匹配度均满足匹配度要求的取值组合作为候选取值组合。在该实施例中,可根据应用需求,可同时考虑对目标设备的功耗和性能要求,通过设置与功耗管理机制相关的内核参数,兼顾功耗和性能。For another example, the target device can obtain the power consumption data and performance data that it actually needs to meet, and combine the performance data and power consumption data that the target device actually needs to meet with the target device under a combination of multiple values corresponding to at least one kernel parameter The performance data and power consumption data are matched; from a variety of value combinations, the value combination that meets the matching degree requirements of the power consumption data and the performance data that the target device actually needs to meet is obtained as the candidate value combination. In this embodiment, according to application requirements, the power consumption and performance requirements of the target device can be considered at the same time, and the power consumption and performance can be taken into consideration by setting the kernel parameters related to the power consumption management mechanism.
进一步,在实施方式C中,利用负载测试工具测试目标设备在至少一种候选取值组合下的性能数据和功耗数据是利用负载测试工具测试目标设备在每种候选取值组合下的性能数据和功耗数据的过程。以第一候选取值组合为例,利用负载测试工具测试目标设备在第一候选取值组合下的性能数据和功耗数据的过程包括:将操作系统源代码中至少一个内核参数的取值修改为第一候选取值组合中的取值,并根据修改后的操作系统源代码在目标设备上安装操作系统;在目标设备上运行负载测试工具,以测试目标设备在第一候选取值组合下的性能数据和功耗数据。其中,第一候选取值组合是至少一种候选取值组合中任一种候选取值组合。Further, in Embodiment C, using a load test tool to test the performance data and power consumption data of the target device under at least one candidate value combination is to use the load test tool to test the performance data of the target device under each candidate value combination. And the process of power consumption data. Taking the first candidate value combination as an example, the process of using a load test tool to test the performance data and power consumption data of the target device under the first candidate value combination includes: modifying the value of at least one kernel parameter in the source code of the operating system For the value in the first candidate value combination, install the operating system on the target device according to the modified operating system source code; run the load test tool on the target device to test the target device under the first candidate value combination Performance data and power consumption data. Wherein, the first candidate value combination is any one of at least one candidate value combination.
进一步,如图2所示,在实施方式C中,在选择出目标取值组合之后,还可以利用负载测试工具测试出的目标设备在目标取值组合下的性能数据和功耗数据,对性能-功耗预估模型进行修正。其中,负载测试工具测试出的目标设备在目标取值组合下的性能数据和功耗数据更加符合实际要求,以此作为样本数据对性能-功耗预估模型进行修正,有利于提高性能-功耗预估模型的精度,使得预估出的性能数据和功耗数据更加符合实际要求。Further, as shown in FIG. 2, in the implementation C, after the target value combination is selected, the performance data and power consumption data of the target device under the target value combination tested by the load test tool can be used to determine the performance -The power consumption estimation model is revised. Among them, the performance data and power consumption data of the target device tested by the load test tool under the target value combination are more in line with the actual requirements, which are used as sample data to modify the performance-power consumption prediction model, which is conducive to improving the performance-power The accuracy of the consumption estimation model makes the estimated performance data and power consumption data more in line with actual requirements.
在一示例性实施例中,以目标设备是使用Linux操作系统的服务器或电脑设备等设备为例,目标设备支持的内核态的功耗管理机制可以包括:DVFS,则与DVFS相关的至少一个内核参数包括:CPU能够运行的最低工作频率、CPU能够运行的最高工作频率以及CPU工作频率的调节模式中的至少一个。以同时包括这3个参数为例,模型计算设备101可以利用负载测试工具测试目标设备在这3个参数对应的部分取值组合下的性能数据和功耗数据,利用目标设备在这3个参数对应的部分取值组合下的性能数据和功耗数据进行模 型训练得到性能-功耗预估模型,进而基于该性能-功耗预估模型预估目标设备在这3个参数对应的其它取值组合下的性能数据和功耗数据,得到目标设备在这3个参数对应的各种取值组合下的性能数据和功耗数据;目标设备以其在这3个参数对应的各种取值组合下的性能数据和功耗数据为依据,对这3个参数进行设置。In an exemplary embodiment, taking the target device as a server or computer device using the Linux operating system as an example, the kernel mode power management mechanism supported by the target device may include: DVFS, then at least one kernel related to DVFS The parameters include: at least one of the lowest operating frequency at which the CPU can run, the highest operating frequency at which the CPU can run, and an adjustment mode of the CPU operating frequency. Taking these three parameters as an example, the model computing device 101 can use the load test tool to test the performance data and power consumption data of the target device under the partial value combination corresponding to these three parameters, and use the target device to test the performance data and power consumption data of the three parameters. Perform model training on the performance data and power consumption data under the corresponding partial value combination to obtain the performance-power consumption estimation model, and then estimate the target device's other values corresponding to these 3 parameters based on the performance-power consumption estimation model Combine the performance data and power consumption data to obtain the performance data and power consumption data of the target device under various value combinations corresponding to these 3 parameters; the target device uses its various value combinations corresponding to these 3 parameters Set these 3 parameters based on the performance data and power consumption data below.
进一步,以目标设备是使用Linux操作系统的服务器或电脑设备等设备为例,目标设备支持的内核态的功耗管理机制除了包括DVFS之外,还可以包括:C-state,C-state包含3-11个级别的C模式,每个级别的C模式有自己对应的进入时间阈值。基于此,至少一个内核参数除了包括与DVFS相关的上述3个参数之外,还会包括C-state下各级别的C模式对应的进入时间阈值。若C-state包含6个级别的C模式,记为C1-C6,则至少一个内核参数包括6个级别的C模式对应的进入时间阈值,加上DVFS需要的上述3个参数,共9个参数,具体为:scaling_min_freq、scaling_max_freq、scaling_governor、Target_residency:C1、Target_residency:C2、Target_residency:C3、Target_residency:C4、Target_residency:C5以及Target_residency:C6。以同时包含这9个参数为例,模型计算设备101可以利用负载测试工具测试目标设备在这9个参数对应的部分取值组合下的性能数据和功耗数据,利用目标设备在这9个参数对应的部分取值组合下的性能数据和功耗数据进行模型训练得到性能-功耗预估模型,进而基于该性能-功耗预估模型预估目标设备在这9个参数对应的其它取值组合下的性能数据和功耗数据,得到目标设备在这9个参数对应的各种取值组合下的性能数据和功耗数据,如图3所示。之后,目标设备可以其在这9个参数对应的各种取值组合下的性能数据和功耗数据为依据,对这9个参数进行设置。Further, taking the target device as a server or computer device using the Linux operating system as an example, the kernel mode power management mechanism supported by the target device includes in addition to DVFS, it can also include: C-state, C-state contains 3 -11 levels of C mode, each level of C mode has its own corresponding entry time threshold. Based on this, at least one kernel parameter not only includes the above three parameters related to DVFS, but also includes the entry time threshold corresponding to the C mode of each level under the C-state. If the C-state contains 6 levels of C mode, denoted as C1-C6, at least one kernel parameter includes the entry time threshold corresponding to the 6 levels of C mode, plus the above 3 parameters required by DVFS, for a total of 9 parameters , Specifically: scaling_min_freq, scaling_max_freq, scaling_governor, Target_residency: C1, Target_residency: C2, Target_residency: C3, Target_residency: C4, Target_residency: C5, and Target_residency: C6. Taking these 9 parameters as an example, the model computing device 101 can use the load test tool to test the performance data and power consumption data of the target device under the partial value combination corresponding to these 9 parameters, and use the target device to test the performance data and power consumption data of the 9 parameters. Perform model training on the performance data and power consumption data under the corresponding partial value combination to obtain the performance-power consumption estimation model, and then estimate the target device's other values corresponding to these 9 parameters based on the performance-power consumption estimation model Combine the performance data and power consumption data to obtain the performance data and power consumption data of the target device under various value combinations corresponding to these 9 parameters, as shown in Figure 3. After that, the target device can set these 9 parameters based on its performance data and power consumption data under various value combinations corresponding to these 9 parameters.
当然,目标设备支持的内核态的功耗管理机制可以单独包括DVFS,也可以同时包括DVFS和C-state,也可以单独包括C-state。在目标设备支持的内核态的功耗管理机制单独包括C-state的情况下,与功耗管理机制相关的至少一个内核参数包括:各级别的C模式对应的进入时间阈值。若C-state包含11 个级别的C模式,则至少一个内核参数包括11个级别的C模式对应的进入时间阈值,共11个参数。模型计算设备101可以利用负载测试工具测试目标设备在这11个参数对应的部分取值组合下的性能数据和功耗数据,利用目标设备在这11个参数对应的部分取值组合下的性能数据和功耗数据进行模型训练得到性能-功耗预估模型,进而基于该性能-功耗预估模型预估目标设备在这11个参数对应的其它取值组合下的性能数据和功耗数据,得到目标设备在这11个参数对应的各种取值组合下的性能数据和功耗数据;目标设备以其在这11个参数对应的各种取值组合下的性能数据和功耗数据为依据,对这11个参数进行设置。Of course, the core state power management mechanism supported by the target device may include DVFS alone, or both DVFS and C-state, or C-state alone. In the case that the power management mechanism of the kernel state supported by the target device separately includes the C-state, at least one kernel parameter related to the power management mechanism includes: the entry time threshold corresponding to each level of the C mode. If the C-state includes 11 levels of C mode, at least one kernel parameter includes the entry time threshold corresponding to the 11 levels of C mode, for a total of 11 parameters. The model computing device 101 can use the load test tool to test the performance data and power consumption data of the target device under the partial value combinations corresponding to these 11 parameters, and use the performance data of the target device under the partial value combinations corresponding to these 11 parameters. Perform model training with power consumption data to obtain a performance-power consumption estimation model, and then estimate the performance data and power consumption data of the target device under other combinations of values corresponding to these 11 parameters based on the performance-power estimation model. Obtain the performance data and power consumption data of the target device under various value combinations corresponding to these 11 parameters; the target device is based on its performance data and power consumption data under various value combinations corresponding to these 11 parameters , To set these 11 parameters.
在本申请实施例中,针对内核态的功耗管理机制,模型计算设备101可将与功耗管理机制相关的内核参数的设置操作与人工智能相结合,基于人工智能训练出性能-功耗预估模型,进而基于性能-功耗预估模型得到物理设备在相关内核参数对应的多种取值组合下的性能数据和功耗数据,使得物理设备能够以其在多种取值组合下的性能数据和功耗数据为依据,对相关内核参数进行设置,可为相关内核参数设置合适的取值,兼顾物理设备的功耗和性能,而与人工智能相结合,可提高参数设置效率,降低成本。In the embodiment of the present application, for the power management mechanism in the kernel mode, the model computing device 101 can combine the setting operation of the kernel parameters related to the power management mechanism with artificial intelligence, and train the performance-power consumption prediction based on artificial intelligence. Based on the performance-power estimation model, the performance data and power consumption data of the physical device under multiple value combinations corresponding to the relevant kernel parameters are obtained, so that the physical device can use its performance under multiple value combinations Based on the data and power consumption data, the relevant kernel parameters can be set, and appropriate values can be set for the relevant kernel parameters, taking into account the power consumption and performance of the physical device, and the combination of artificial intelligence can improve the efficiency of parameter setting and reduce the cost .
值得说明的是,在上述实施例中,在与功耗管理机制相关的内核参数的设置操作中,综合考虑了功耗和性能这两个方面训练出性能-功耗预估模型,但并不限于此。It is worth noting that, in the above-mentioned embodiment, in the setting operation of the kernel parameters related to the power management mechanism, the performance-power estimation model is trained by considering the two aspects of power consumption and performance, but not Limited to this.
例如,在一些应用场景中,可能会重点关注设备性能,对设备功耗要求不高或没有要求,需要为与设备性能相关的内核参数设置合理取值;为此,模型计算设备101也可以采用类似的方式训练出性能预估模型,并为物理设备103提供其在与设备性能相关的内核参数对应的多种取值组合下的性能数据,以供物理设备103据此对于设备性能相关的内核参数进行设置。For example, in some application scenarios, you may focus on device performance, and have low or no requirements for device power consumption. It is necessary to set reasonable values for the kernel parameters related to device performance; for this, the model computing device 101 can also use In a similar way, the performance prediction model is trained, and the physical device 103 is provided with its performance data under multiple value combinations corresponding to the device performance-related kernel parameters, so that the physical device 103 can use the device performance-related kernel accordingly. The parameters are set.
对模型计算设备101来说,可以从物理设备的内核参数中,确定与设备性能相关的至少一个内核参数;利用负载测试工具测试目标设备在至少一个内核参数对应的部分取值组合下的性能数据;根据目标设备在部分取值组合 下的性能数据进行模型训练,以得到性能预估模型;利用性能预估模型预估目标设备在至少一个内核参数对应的其它取值组合下的性能数据。对目标设备来说,可从其内核参数中,确定与设备性能相关的至少一个内核参数;从模型计算设备101获取其在至少一个内核参数对应的多种取值组合下的性能数据;根据其在多种取值组合下的性能数据,确定至少一个内核参数对应的目标取值组合;根据目标取值组合对至少一个内核参数进行设置,以按照目标取值组合中的取值运行。其中,关于相关描述的详细实施方式或可选实施方式均可参见前述实施例,在此不再赘述。For the model computing device 101, at least one kernel parameter related to the device performance can be determined from the kernel parameters of the physical device; the load test tool is used to test the performance data of the target device under the partial value combination corresponding to the at least one kernel parameter ; Perform model training according to the performance data of the target device under some value combinations to obtain a performance prediction model; use the performance prediction model to predict the performance data of the target device under other value combinations corresponding to at least one kernel parameter. For the target device, at least one kernel parameter related to device performance can be determined from its kernel parameters; its performance data under multiple value combinations corresponding to at least one kernel parameter can be obtained from the model computing device 101; Determine the target value combination corresponding to at least one kernel parameter from the performance data under multiple value combinations; set at least one kernel parameter according to the target value combination to operate according to the value in the target value combination. Among them, the detailed implementation manners or alternative implementation manners of related descriptions can be referred to the foregoing embodiments, and details are not described herein again.
又例如,在一些应用场景中,可能会重点关注设备功耗,对设备性能要求不高或没有要求,需要为与设备功耗相关的内核参数设置合理取值;为此,模型计算设备101也可以采用类似的方式训练出功耗预估模型,并为物理设备103提供其在与设备功耗相关的内核参数对应的多种取值组合下的功耗数据,以供物理设备103据此对于设备性能相关的内核参数进行设置。For another example, in some application scenarios, the power consumption of the device may be focused on, and the performance requirements of the device are not high or not required. It is necessary to set reasonable values for the kernel parameters related to the power consumption of the device; for this reason, the model computing device 101 also The power consumption estimation model can be trained in a similar manner, and the physical device 103 can be provided with its power consumption data under various combinations of values corresponding to the kernel parameters related to the power consumption of the device, so that the physical device 103 can respond accordingly. Kernel parameters related to device performance are set.
对模型计算设备101来说,可以从物理设备的内核参数中,确定与设备功耗相关的至少一个内核参数;利用负载测试工具测试目标设备在所述至少一个内核参数对应的部分取值组合下的功耗数据;根据目标设备在部分取值组合下的功耗数据进行模型训练,以得到功耗预估模型;利用功耗预估模型预估目标设备在所述至少一个内核参数对应的其它取值组合下的功耗数据。对目标设备来说,可从其内核参数中,确定与设备功耗相关的至少一个内核参数;从模型计算设备101获取其在所述至少一个内核参数对应的多种取值组合下的功耗数据;根据其在多种取值组合下的功耗数据,确定至少一个内核参数对应的目标取值组合;根据目标取值组合对至少一个内核参数进行设置,以按照目标取值组合中的取值运行。其中,关于相关描述的详细实施方式或可选实施方式均可参见前述实施例,在此不再赘述。For the model computing device 101, at least one kernel parameter related to the power consumption of the device can be determined from the kernel parameters of the physical device; the load test tool is used to test the target device under the partial value combination corresponding to the at least one kernel parameter. The power consumption data of the target device; perform model training according to the power consumption data of the target device under partial value combinations to obtain the power consumption estimation model; use the power consumption estimation model to estimate the target device's other corresponding to the at least one core Power consumption data under the combination of values. For the target device, at least one kernel parameter related to the power consumption of the device can be determined from its kernel parameters; the power consumption of the at least one kernel parameter corresponding to multiple value combinations can be obtained from the model computing device 101 Data; determine the target value combination corresponding to at least one core parameter according to its power consumption data under multiple value combinations; set at least one core parameter according to the target value combination to follow the target value combination Value running. Among them, the detailed implementation manners or alternative implementation manners of related descriptions can be referred to the foregoing embodiments, and details are not described herein again.
在本申请上述实施例中,以数据中心系统为例进行了说明,但本申请实施例提供的将内核参数的设置操作与人工智能相结合的方案并不限于数据中心系统。本申请实施例提供的将内核参数的设置操作与人工智能相结合的方 案,可扩展到任何需要对设备内核参数进行设置的系统或设备中。In the foregoing embodiments of the present application, a data center system is taken as an example for description, but the solution of combining the kernel parameter setting operation with artificial intelligence provided in the embodiments of the present application is not limited to the data center system. The scheme of combining the kernel parameter setting operation with artificial intelligence provided in the embodiment of the application can be extended to any system or device that needs to set the kernel parameter of the device.
图4a为本申请示例性实施例提供的一种设备管理系统的结构示意图。如图4a所示,该设备管理系统400包括:至少一台物理设备401和至少一台模型计算设备402。本实施例并不限定物理设备401的数量,可以是一台,也可以是多台。同理,本实施例也不限定模型计算设备402的数量,可以是一台也,可以是多台。Fig. 4a is a schematic structural diagram of a device management system provided by an exemplary embodiment of this application. As shown in FIG. 4a, the device management system 400 includes: at least one physical device 401 and at least one model computing device 402. This embodiment does not limit the number of physical devices 401, and it may be one or multiple. Similarly, this embodiment does not limit the number of model computing devices 402, and it may be one or multiple.
另外,本实施例也不限定物理设备401和模型计算设备402的设备形态。物理设备401可以包括但不限于以下至少一种设备形态:服务器设备、计算机设备、台式电脑、笔记本电脑、智能手机、平板电脑以及网络交换设备等。服务器设备可以是包括但不限于:常规服务器、服务器阵列或云服务器等。模型计算设备402可以是常规服务器、云服务器或服务器阵列等服务端设备。图4a中示出的物理设备401和模型计算设备402的设备形态以及数量仅为示例,并不限于此。In addition, this embodiment does not limit the device form of the physical device 401 and the model computing device 402. The physical device 401 may include, but is not limited to, at least one of the following device forms: server devices, computer devices, desktop computers, notebook computers, smart phones, tablet computers, network switching devices, and the like. The server device may include, but is not limited to, a conventional server, a server array, or a cloud server. The model computing device 402 may be a server device such as a conventional server, a cloud server, or a server array. The device form and quantity of the physical device 401 and the model computing device 402 shown in FIG. 4a are only examples and are not limited thereto.
在本实施例中,至少一台物理设备401是指安装有操作系统,且支持内核态的功耗管理机制的物理设备。需要说明的是,设备管理系统400除了安装有操作系统且支持内核态的功耗管理机制的物理设备401之外,也可以包含一些无需操作系统的设备,以及一些虽然安装有操作系统但不支持内核态的功耗管理机制的设备,对此不做限定。在本实施例以及其它实施例中重点关注安装有操作系统且支持内核态的功耗管理机制的物理设备401。In this embodiment, at least one physical device 401 refers to a physical device installed with an operating system and supporting a kernel-mode power management mechanism. It should be noted that, in addition to the physical device 401 that is installed with an operating system and supports the kernel-mode power management mechanism, the device management system 400 may also include some devices that do not require an operating system, and some devices that are installed with an operating system but do not support There is no restriction on the devices with the power management mechanism in the kernel mode. In this embodiment and other embodiments, the focus is on the physical device 401 that is installed with an operating system and supports a kernel-mode power management mechanism.
物理设备401支持的内核态的功耗管理机制,与一些内核参数相关,这些内核参数一般具有多种取值。内核参数的不同取值,致使功耗管理机制产生不同的节能效果。为了在不同应用场景和应用需求下,产生较优或最优节能效果,且满足性能要求,在本实施例中,将内核参数的设置操作与人工智能相结合,以人工智能模型为基础,得到物理设备401在相关内核参数对应的多种取值组合下的性能数据和功耗数据,进而,以物理设备401在相关内核参数对应的多种取值组合下的性能数据和功耗数据为依据,进行内核参数的设置,不仅可为内核参数设置合适的取值,而且可以同时兼顾物理设备401 对功耗和性能的要求,而与人工智能相结合,可提高参数设置效率,降低成本。The power management mechanism in the kernel mode supported by the physical device 401 is related to some kernel parameters, and these kernel parameters generally have multiple values. The different values of the kernel parameters result in different energy-saving effects in the power management mechanism. In order to produce better or optimal energy-saving effects under different application scenarios and application requirements, and meet performance requirements, in this embodiment, the kernel parameter setting operation is combined with artificial intelligence, and the artificial intelligence model is used as the basis to obtain The performance data and power consumption data of the physical device 401 under multiple value combinations corresponding to the relevant kernel parameters, and further, based on the performance data and power consumption data of the physical device 401 under multiple value combinations corresponding to the relevant kernel parameters , The kernel parameter setting can not only set the appropriate value for the kernel parameter, but also take into account the power consumption and performance requirements of the physical device 401 at the same time, and the combination of artificial intelligence can improve the parameter setting efficiency and reduce the cost.
在本实施例中,至少一台模型计算设备402主要用于:针对每台物理设备401,从该物理设备401的内核参数中确定与该物理设备401支持的内核态的功耗管理机制相关的至少一个内核参数,基于人工智能模型为该物理设备401提供其在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,以供该物理设备401据此完成相关内核参数的设置。In this embodiment, at least one model computing device 402 is mainly used to: for each physical device 401, determine from the kernel parameters of the physical device 401 related to the power management mechanism of the kernel state supported by the physical device 401 At least one kernel parameter, based on the artificial intelligence model, provides the physical device 401 with its performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter, so that the physical device 401 can complete the relevant kernel parameter Set up.
为便于描述,本实施例以任意一台物理设备401为例,并将任意一台物理设备401记为目标设备,对本系统的详细工作原理进行说明。For ease of description, this embodiment takes any physical device 401 as an example, and records any physical device 401 as a target device to describe the detailed working principle of the system.
模型计算设备402可以从目标设备的内核参数中,确定与目标设备支持的内核态的功耗管理机制相关的至少一个内核参数。之后,模型计算设备402可以收集目标设备在至少一个内核参数对应的部分取值组合下的性能数据和功耗数据,作为样本数据,并利用这些样本数据进行模型训练,得到性能-功耗预估模型。The model computing device 402 may determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device from the kernel parameters of the target device. After that, the model computing device 402 can collect the performance data and power consumption data of the target device under the partial value combination corresponding to at least one core parameter as sample data, and use these sample data for model training to obtain the performance-power consumption estimate model.
可选地,模型计算设备402可以借助负载测试工具收集目标设备在至少一个内核参数对应的部分取值组合下的性能数据和功耗数据。在目标设备上安装并运行负载测试工具,负载测试工具可模拟目标设备在不同负载情况的性能数据和功耗数据。详细地,从至少一个内核参数对应的多种取值组合中,选定部分取值组合,部分取值组合的数量只要满足模型训练所需的数量即可;针对部分取值组合中的每一种取值组合,根据目标设备需要满足的负载、功耗和/或性能要求,利用负载测试工具得到目标设备在该取值组合下满足相应要求时的性能数据和功耗数据;将目标设备在部分取值组合下满足相应要求时的性能数据和功耗数据提供给模型计算设备402。为了简化描述,将目标设备在每种取值组合下满足相应要求时的性能数据和功耗数据,简称为目标设备在每种取值组合下的性能数据和功耗数据。Optionally, the model computing device 402 may use a load test tool to collect performance data and power consumption data of the target device under a partial value combination corresponding to at least one kernel parameter. Install and run the load test tool on the target device. The load test tool can simulate the performance data and power consumption data of the target device under different load conditions. In detail, from multiple value combinations corresponding to at least one kernel parameter, select some value combinations, and the number of some value combinations only needs to meet the number required for model training; for each of the partial value combinations According to the load, power consumption and/or performance requirements that the target device needs to meet, the load test tool is used to obtain the performance data and power consumption data of the target device when the value combination meets the corresponding requirements. The performance data and power consumption data when the corresponding requirements are met under the partial value combination are provided to the model computing device 402. In order to simplify the description, the performance data and power consumption data of the target device when it meets the corresponding requirements under each value combination are referred to as the performance data and power consumption data of the target device under each value combination for short.
其中,针对部分取值组合中的每一种取值组合,在利用负载测试工具得到目标设备在该取值组合下的性能数据和功耗数据的过程包括:针对该取值 组合,先将操作系统源代码中至少一个内核参数的取值修改为该取值组合中的取值,并根据修改后的操作系统源代码在目标设备上安装操作系统;在成功安装操作系统之后,在目标设备上安装负载测试工具,根据目标设备应该满足的负载、功耗和/或性能要求,利用负载测试工具模拟相应负载情况并获取目标设备在相应负载情况下的性能数据和功耗数据。Among them, for each value combination in the partial value combination, the process of using the load test tool to obtain the performance data and power consumption data of the target device under the value combination includes: for the value combination, first operate The value of at least one kernel parameter in the system source code is modified to the value in the value combination, and the operating system is installed on the target device according to the modified operating system source code; after the operating system is successfully installed, on the target device Install the load test tool, and use the load test tool to simulate the corresponding load condition and obtain the performance data and power consumption data of the target device under the corresponding load according to the load, power consumption and/or performance requirements that the target device should meet.
在得到目标设备在至少一个内核参数对应的部分取值组合下的性能数据和功耗数据之后,模型计算设备402以这些数据作为样本数据进行模型训练。在本实施例中,并不限定模型计算设备402进行模型训练的过程,例如可以是基于深度神经网络的模型训练过程,也可以基于回归分析的模型训练过程,凡是可以分析出至少一个内核参数对应的取值组合与目标设备的性能数据和功耗数据之间的关联关系的模型训练方法均适用于本申请实施例。After obtaining the performance data and power consumption data of the target device under the partial value combination corresponding to at least one kernel parameter, the model computing device 402 uses these data as sample data for model training. In this embodiment, the process of model training performed by the model computing device 402 is not limited. For example, it can be a model training process based on a deep neural network, or a model training process based on regression analysis, where at least one kernel parameter can be analyzed. The model training method of the association relationship between the value combination of and the performance data and power consumption data of the target device is applicable to the embodiments of the present application.
在一可选实施例中,模型计算设备402可以采用基于回归分析的建模方法,即对目标设备在至少一个内核参数对应的部分取值组合下的性能数据和功耗数据进行回归分析,经过回归分析可得到至少一个内核参数对应的取值组合与目标设备的性能数据和功耗数据之间的关联关系,即性能-功耗预估模型。In an optional embodiment, the model computing device 402 may adopt a regression analysis-based modeling method, that is, perform regression analysis on the performance data and power consumption data of the target device under a combination of partial values corresponding to at least one kernel parameter. Regression analysis can obtain the correlation between the value combination corresponding to at least one kernel parameter and the performance data and power consumption data of the target device, that is, the performance-power consumption prediction model.
进一步可选地,选择使用线性回归分析进行建模。基于此,模型计算设备402进行模型训练的过程包括:将至少一个内核参数对应的部分取值组合作为自变量,将目标设备在部分取值组合下的性能数据和功耗数据作为因变量进行线性回归分析,得到性能-功耗预估模型。Further optionally, choose to use linear regression analysis for modeling. Based on this, the process of model training by the model computing device 402 includes: taking the partial value combination corresponding to at least one kernel parameter as an independent variable, and using the performance data and power consumption data of the target device under the partial value combination as the dependent variable to perform linearization. Regression analysis, the performance-power consumption prediction model is obtained.
在一可选实施例中,在得到性能-功耗预估模型之后,模型计算设备402可以利用性能-功耗预估模型预估目标设备在至少一个内核参数对应的其它取值组合下的性能数据和功耗数据。或者,在得到性能-功耗预估模型之后,模型计算设备101可以利用性能-功耗预估模型预估目标设备在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据。In an optional embodiment, after the performance-power consumption prediction model is obtained, the model calculation device 402 can use the performance-power consumption prediction model to predict the performance of the target device under other value combinations corresponding to at least one core parameter. Data and power consumption data. Or, after obtaining the performance-power consumption prediction model, the model computing device 101 may use the performance-power consumption prediction model to estimate the performance data and power consumption data of the target device under multiple value combinations corresponding to at least one core parameter .
对目标设备来说,可获取其在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,并在参数设置过程中,以其在至少一个内核参数对 应的多种取值组合下的性能数据和功耗数据为依据,确定至少一个内核参数对应的目标取值组合,根据目标取值组合对至少一个内核参数进行设置。其中,根据目标取值组合对至少一个内核参数进行设置的过程包括:将操作系统源代码中与功耗管理机制相关的至少一个内核参数的取值修改为目标值组合中的取值,之后,还可以根据修改后的操作系统源代码在物理设备上安装操作系统。其中,根据修改后的操作系统源代码在物理设备上安装操作系统包括:对修改后的操作系统源代码进行编译,得到操作系统的安装文件,运行安装文件完成操作系统的安装。For the target device, the performance data and power consumption data under multiple value combinations corresponding to at least one core parameter can be obtained, and during the parameter setting process, the multiple values corresponding to at least one core parameter can be used Based on the combined performance data and power consumption data, a target value combination corresponding to at least one core parameter is determined, and at least one core parameter is set according to the target value combination. The process of setting at least one kernel parameter according to the target value combination includes: modifying the value of at least one kernel parameter related to the power consumption management mechanism in the operating system source code to the value in the target value combination, and then, The operating system can also be installed on the physical device according to the modified operating system source code. Wherein, installing the operating system on the physical device according to the modified operating system source code includes: compiling the modified operating system source code to obtain an installation file of the operating system, and running the installation file to complete the installation of the operating system.
可选地,上述确定至少一个内核参数对应的目标取值组合的一种实施方式包括:根据目标设备在多种取值组合下的性能数据和功耗数据,直接从多种取值组合中确定出目标取值组合。或者,上述确定至少一个内核参数对应的目标取值组合的另一种实施方式包括:获取目标设备实际需要满足的功耗数据和/或性能数据;将目标设备实际需要满足的功耗数据和/或性能数据,与目标设备在多种取值组合下的性能数据和功耗数据进行匹配;根据目标设备实际需要满足的功耗数据和/或性能数据与目标设备在多种取值组合下的性能数据和功耗数据之间的匹配度,从所述多种取值组合中选择满足匹配度要求的取值组合作为目标取值组合。或者,上述确定至少一个内核参数对应的目标取值组合的又一种实施方式包括:根据目标设备在多种取值组合下的性能数据和功耗数据,从多种取值组合中选择至少一种候选取值组合;利用负载测试工具测试目标设备在至少一种候选取值组合下的性能数据和功耗数据;进而,根据负载测试工具测试出的目标设备在至少一种候选取值组合下的性能数据和功耗数据,从至少一种候选取值组合中确定目标取值组合。在该实施方式中,除了依据目标设备在多种取值组合下的性能数据和功耗数据之外,还结合负载测试工具,有利于提高最终选择出的目标取值组合的准确性,有利于提高参数设置的精度。Optionally, an implementation manner of determining the target value combination corresponding to at least one kernel parameter includes: directly determining from the multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations Get the target value combination. Alternatively, another implementation manner for determining the target value combination corresponding to at least one kernel parameter includes: obtaining power consumption data and/or performance data that the target device actually needs to meet; and comparing the power consumption data and/or performance data that the target device actually needs to meet Or performance data to match the performance data and power consumption data of the target device under multiple value combinations; according to the power consumption data and/or performance data that the target device actually needs to meet with the target device under multiple value combinations For the matching degree between the performance data and the power consumption data, a value combination that meets the matching degree requirement is selected from the multiple value combinations as the target value combination. Alternatively, another implementation manner of determining the target value combination corresponding to at least one kernel parameter includes: selecting at least one of the multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations A combination of candidate values; using a load test tool to test the performance data and power consumption data of the target device under at least one combination of candidate values; further, the target device tested according to the load test tool under at least one combination of candidate values Determine the target value combination from at least one candidate value combination based on the performance data and power consumption data. In this embodiment, in addition to the performance data and power consumption data of the target device under a variety of value combinations, the load test tool is also combined to help improve the accuracy of the final selected target value combination, which is beneficial to Improve the accuracy of parameter settings.
进一步,在选择至少一种候选取值组合的过程中,可以结合目标设备实际需要满足的功耗数据,或结合目标设备实际需要满足的性能数据,或者同 时结合目标设备实际需要满足的功耗数据和性能数据。例如,可以获取目标设备实际需要满足的功耗数据,将目标设备实际需要满足的功耗数据和/或性能数据,与目标设备在至少一种内核参数对应的多种取值组合下的性能数据和功耗数据进行匹配;从多种取值组合中,获取与目标设备实际需要满足的功耗数据和/或性能数据的匹配度满足匹配度要求的取值组合作为候选取值组合。Further, in the process of selecting at least one combination of candidate values, the power consumption data that the target device actually needs to meet can be combined, or the performance data that the target device actually needs to meet, or the power consumption data that the target device actually needs to meet at the same time. And performance data. For example, the power consumption data that the target device actually needs to meet can be obtained, and the power consumption data and/or performance data that the target device actually needs to meet can be combined with the performance data of the target device under a combination of multiple values corresponding to at least one kernel parameter. Matching with the power consumption data; from a variety of value combinations, obtain a value combination whose matching degree with the power consumption data and/or performance data that the target device actually needs to meet the matching degree requirement as a candidate value combination.
进一步,在上述实施方式中,在选择出目标取值组合之后,还可以利用负载测试工具测试出的目标设备在目标取值组合下的性能数据和功耗数据,对性能-功耗预估模型进行修正。其中,负载测试工具测试出的目标设备在目标取值组合下的性能数据和功耗数据更加符合实际要求,以此作为样本数据对性能-功耗预估模型进行修正,有利于提高性能-功耗预估模型的精度,使得预估出的性能数据和功耗数据更加符合实际要求。Further, in the above embodiment, after the target value combination is selected, the performance data and power consumption data of the target device under the target value combination tested by the load test tool can be used to evaluate the performance-power consumption prediction model Make corrections. Among them, the performance data and power consumption data of the target device tested by the load test tool under the target value combination are more in line with the actual requirements, which are used as sample data to modify the performance-power consumption prediction model, which is conducive to improving the performance-power The accuracy of the consumption estimation model makes the estimated performance data and power consumption data more in line with actual requirements.
关于模型计算设备402的相关描述可参见前述实施例中模型计算设备101的相关描述,同理,关于目标设备的相关描述也可参见前述实施例中的相应描述,在此不再赘述。For the related description of the model computing device 402, please refer to the related description of the model computing device 101 in the foregoing embodiment. Similarly, for the related description of the target device, please refer to the corresponding description in the foregoing embodiment, which will not be repeated here.
在此说明,本实施例的设备管理系统400可以实现为任何形式或任何性质的系统,例如可以是数据中心,或者集群,或机房系统,或者边缘云网络系统,或者中心云网络系统等,本实施例对此不做限定。It is explained here that the device management system 400 of this embodiment can be implemented as a system of any form or nature, for example, it can be a data center, or a cluster, or a computer room system, or an edge cloud network system, or a central cloud network system, etc. The embodiment does not limit this.
例如,以设备管理系统400实现为边缘云网络系统为例进行示例性说明。如图4b所示,该边缘云网络系统包括:边缘计算节点以及部署在云端或客户机房中的服务器。服务器与边缘计算节点通过网络进行通信,服务器可响应边缘计算节点的请求,为边缘计算节点提供相关云服务;另外,服务器也可对边缘计算节点进行管控、运维等。边缘计算节点包括硬件基础设施、硬件基础设施的驱动程序、操作系统以及相关应用程序等。硬件基础设施包括但不限于:CPU、网卡以及存储器等。边缘计算节点可以包括:加入边缘云网络中的基站、家庭网关、个人电脑、智能手机、路灯、交通灯和/或建筑物上的电子监控设备等。For example, the device management system 400 is implemented as an edge cloud network system as an example for illustration. As shown in Figure 4b, the edge cloud network system includes: edge computing nodes and servers deployed in the cloud or in the client room. The server communicates with the edge computing node through the network. The server can respond to the request of the edge computing node and provide related cloud services for the edge computing node; in addition, the server can also control, operate and maintain the edge computing node. Edge computing nodes include hardware infrastructure, hardware infrastructure drivers, operating systems, and related applications. The hardware infrastructure includes but is not limited to: CPU, network card, memory, etc. Edge computing nodes may include: base stations, home gateways, personal computers, smart phones, street lights, traffic lights, and/or electronic monitoring equipment on buildings that are added to the edge cloud network.
在图4b所示的边缘云网络系统中,服务器可以具备图4a中模型计算设备402的功能,当然,也可以另外部署一台专用于模型训练的服务器(用于实现图4a中模型计算设备402的功能),边缘计算节点可以作为图4a中的物理设备401。假设边缘云节点支持DFVS和C-state两种机制,且C-state具有6种级别的C模式,其中,与DFVS和C-state相关的内核参数包括:scaling_min_freq、scaling_max_freq、scaling_governor、C1-C6级别对应的target_residency,共9个参数。In the edge cloud network system shown in Figure 4b, the server can have the functions of the model computing device 402 in Figure 4a. Of course, another server dedicated to model training can also be deployed (used to implement the model computing device 402 in Figure 4a). The function of the edge computing node can be used as the physical device 401 in Figure 4a. Assume that the edge cloud node supports two mechanisms, DFVS and C-state, and C-state has 6 levels of C modes. Among them, the kernel parameters related to DFVS and C-state include: scaling_min_freq, scaling_max_freq, scaling_governor, C1-C6 levels The corresponding target_residency has 9 parameters.
在边缘计算节点为客户提供服务之前,需要为客户在边缘计算节点中安装操作系统,并设置好边缘计算节点中与DFVS和C-state相关的内核参数,以便边缘计算节点工作在最优参数组合下,达到兼顾性能和功耗的目的。Before the edge computing node provides services to customers, it is necessary to install the operating system on the edge computing node for the customer, and set the kernel parameters related to DFVS and C-state in the edge computing node, so that the edge computing node can work in the optimal parameter combination To achieve the goal of balancing performance and power consumption.
为实现上述目的,服务器可以利用负载测试工具测试边缘计算节点在上述9个参数对应的部分取值组合下的性能数据和功耗数据,利用边缘计算节点在这9个参数对应的部分取值组合下的性能数据和功耗数据进行模型训练得到性能-功耗预估模型;进而,基于该性能-功耗预估模型预估边缘计算节点在这9个参数对应的其它取值组合下的性能数据和功耗数据,从而得到边缘计算节点在这9个参数对应的各种取值组合下的性能数据和功耗数据;将边缘计算节点在这9个参数对应的各种取值组合下的性能数据和功耗数据下发给边缘计算节点。边缘计算节点接收服务器下发的其在这9个参数对应的各种取值组合下的性能数据和功耗数据,并以其在这9个参数对应的各种取值组合下的性能数据和功耗数据为依据,对这9个参数进行设置,使得边缘计算节点在启动后能够工作在最优参数组合下,在保证性能的情况下,尽量减少功耗。In order to achieve the above purpose, the server can use the load test tool to test the performance data and power consumption data of the edge computing node under the partial value combination corresponding to the above 9 parameters, and use the edge computing node to select the partial value combination corresponding to the 9 parameters. Perform model training on the performance data and power consumption data below to obtain the performance-power consumption prediction model; further, based on the performance-power consumption prediction model, predict the performance of the edge computing node under other combinations of values corresponding to these 9 parameters Data and power consumption data, so as to obtain the performance data and power consumption data of the edge computing node under the various value combinations corresponding to these 9 parameters; the edge computing node’s performance data and power consumption data under the various value combinations corresponding to these 9 parameters Performance data and power consumption data are delivered to edge computing nodes. The edge computing node receives its performance data and power consumption data under various value combinations corresponding to these 9 parameters issued by the server, and uses its performance data under various value combinations corresponding to these 9 parameters and Based on the power consumption data, these 9 parameters are set so that the edge computing node can work under the optimal parameter combination after startup, and reduce power consumption as much as possible while ensuring performance.
图5a为本申请示例性实施例提供的一种数据处理方法的流程示意图。该数据处理方法可用来设置物理设备的内核参数。如图5a所示,该方法包括:FIG. 5a is a schematic flowchart of a data processing method provided by an exemplary embodiment of this application. This data processing method can be used to set the kernel parameters of the physical device. As shown in Figure 5a, the method includes:
501、从物理设备的内核参数中,确定与物理设备支持的内核态的功耗管理机制相关的至少一个内核参数。501. From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device.
502、获取物理设备在上述至少一个内核参数对应的多种取值组合下的性 能数据和功耗数据,其中,至少部分取值组合下的性能数据和功耗数据是基于性能-功耗预估模型预估出的。502. Acquire performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one core parameter above, where at least some of the performance data and power consumption data under the value combination are based on performance-power consumption estimation Estimated by the model.
503、根据物理设备在上述多种取值组合下的性能数据和功耗数据,确定至少一个内核参数对应的目标取值组合。503. Determine a target value combination corresponding to at least one kernel parameter according to the performance data and power consumption data of the physical device under the foregoing multiple value combinations.
504、根据目标取值组合对上述至少一个内核参数进行设置,以使功耗管理机制按照目标取值组合中的取值运行。504. Set the aforementioned at least one kernel parameter according to the target value combination, so that the power consumption management mechanism operates according to the value in the target value combination.
本实施例的执行主体可以是物理设备,物理设备运行有操作系统,并支持内核态的功耗管理机制。物理设备可通过一些内核参数调整或管理内核态功耗管理机制,这些内核参数也就是内核态功耗管理机制的参数。与内核态功耗管理机制相关的内核参数可能具有多种取值,在不同取值情况下,功耗管理机制所能产生的节能效果会有所不同。The execution subject of this embodiment may be a physical device, and the physical device runs an operating system and supports a kernel-mode power management mechanism. The physical device can adjust or manage the kernel power management mechanism through some kernel parameters, and these kernel parameters are also the parameters of the kernel power management mechanism. The kernel parameters related to the kernel-mode power management mechanism may have multiple values, and under different values, the energy-saving effect that the power management mechanism can produce will be different.
在本实施例中,将内核参数的设置操作与人工智能相结合,基于人工智能模型得到物理设备在相关内核参数对应的多种取值组合下的性能数据和功耗数据,使得物理设备可以以其在相关内核参数对应的多种取值组合下的性能数据和功耗数据为依据,对相关内核参数进行设置,可为相关内核参数设置合适的取值,兼顾物理设备的功耗和性能,而与人工智能相结合,可提高参数设置效率,降低成本。In this embodiment, the kernel parameter setting operation is combined with artificial intelligence, and based on the artificial intelligence model, the performance data and power consumption data of the physical device under multiple value combinations corresponding to the relevant kernel parameters are obtained, so that the physical device can be Based on the performance data and power consumption data under the multiple value combinations corresponding to the relevant kernel parameters, the relevant kernel parameters can be set, and appropriate values can be set for the relevant kernel parameters, taking into account the power consumption and performance of the physical device. Combining with artificial intelligence can improve the efficiency of parameter setting and reduce costs.
在一可选实施例中,步骤503的一种实施方式包括:根据物理设备在多种取值组合下的性能数据和功耗数据,从多种取值组合中选择至少一种候选取值组合;利用负载测试工具测试物理设备在至少一种候选取值组合下的性能数据和功耗数据;根据负载测试工具测试出的物理设备在至少一种候选取值组合下的性能数据和功耗数据,从至少一种候选取值组合中确定目标取值组合。In an optional embodiment, an implementation manner of step 503 includes: selecting at least one candidate value combination from the multiple value combinations according to the performance data and power consumption data of the physical device under multiple value combinations ; Use a load test tool to test the performance data and power consumption data of the physical device under at least one candidate value combination; use the load test tool to test the performance data and power consumption data of the physical device under at least one candidate value combination , Determine the target value combination from at least one candidate value combination.
进一步,在确定目标取值组合之后,还包括:利用负载测试工具测试出的物理设备在目标取值组合下的性能数据和功耗数据,对性能-功耗预估模型进行修正。Further, after determining the target value combination, it also includes: using the performance data and power consumption data of the physical device tested by the load test tool under the target value combination to modify the performance-power consumption prediction model.
进一步,上述利用负载测试工具测试物理设备在至少一种候选取值组合 下的性能数据和功耗数据,包括:针对第一候选取值组合,将操作系统源代码中至少一个内核参数的取值修改为第一候选取值组合中的取值,并根据修改后的操作系统源代码在物理设备上安装操作系统;在物理设备上运行负载测试工具,以测试物理设备在第一候选取值组合下的性能数据和功耗数据;其中,第一候选取值组合是至少一种候选取值组合中任一种候选取值组合。Further, the above-mentioned use of the load test tool to test the performance data and power consumption data of the physical device under at least one candidate value combination includes: for the first candidate value combination, the value of at least one kernel parameter in the operating system source code Modify to the value in the first candidate value combination, and install the operating system on the physical device according to the modified operating system source code; run the load test tool on the physical device to test the physical device in the first candidate value combination Performance data and power consumption data below; where the first candidate value combination is any one of at least one candidate value combination.
进一步,上述根据物理设备在多种取值组合下的性能数据和功耗数据,从多种取值组合中选择至少一种候选取值组合,包括:获取物理设备实际需要满足的功耗数据;将物理设备实际需要满足的功耗数据,与物理设备在多种取值组合下的性能数据和功耗数据进行匹配;从多种取值组合中,获取与物理设备实际需要满足的功耗数据的匹配度满足匹配度要求的至少一种候选取值组合。或者,步骤503的另一种实施方式包括:获取物理设备实际需要满足的性能数据,将物理设备实际需要满足的性能数据,与物理设备在至少一种内核参数对应的多种取值组合下的性能数据和功耗数据进行匹配;从多种取值组合中,获取与物理设备实际需要满足的性能数据的匹配度满足匹配度要求的至少一种候选取值组合。或者,步骤503的又一种实施方式包括:获取物理设备实际需要满足的性能数据和功耗数据,将物理设备实际需要满足的性能数据和功耗数据,与物理设备在至少一种内核参数对应的多种取值组合下的性能数据和功耗数据进行匹配;从多种取值组合中,获取与物理设备实际需要满足的性能数据和功耗数据的匹配度均满足匹配度要求的至少一种候选取值组合。Further, the foregoing selecting at least one candidate value combination from the multiple value combinations according to the performance data and power consumption data of the physical device under multiple value combinations includes: obtaining power consumption data that the physical device actually needs to meet; Match the power consumption data that the physical device actually needs to meet with the performance data and power consumption data of the physical device under multiple value combinations; obtain the power consumption data that the physical device actually needs to meet from multiple value combinations The matching degree of at least one candidate value combination that meets the matching degree requirement. Alternatively, another implementation manner of step 503 includes: obtaining the performance data that the physical device actually needs to meet, and combining the performance data that the physical device actually needs to meet with the physical device under a combination of multiple values corresponding to at least one kernel parameter. The performance data and the power consumption data are matched; from the multiple value combinations, at least one candidate value combination whose matching degree with the performance data actually needs to be met by the physical device meets the matching degree requirement is obtained. Or, another implementation manner of step 503 includes: obtaining performance data and power consumption data that the physical device actually needs to meet, and corresponding the performance data and power consumption data that the physical device actually needs to meet with the physical device in at least one kernel parameter Match the performance data and power consumption data under multiple value combinations of, from multiple value combinations, obtain the performance data and power consumption data that the physical device actually needs to meet the matching degree that meets at least one of the matching degree requirements A combination of candidate values.
进一步可选地,获取物理设备实际需要满足的功耗数据,包括:根据物理设备实际需要承载的服务的QoS,分析出物理设备实际需要满足的功耗数据;或者,获取服务部署用户要求的功耗数据,作为物理设备实际需要满足的功耗数据。Further optionally, obtaining the power consumption data that the physical device actually needs to meet includes: analyzing the power consumption data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, obtaining the power required by the service deployment user The power consumption data is the power consumption data that the physical device actually needs to meet.
进一步可选地,获取物理设备实际需要满足的性能数据,包括:根据物理设备实际需要承载的服务的QoS,分析出物理设备实际需要满足的性能数据;或者,获取服务部署用户要求的性能数据,作为物理设备实际需要满足 的性能数据。Further optionally, obtaining the performance data that the physical device actually needs to meet includes: analyzing the performance data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, obtaining the performance data required by the service deployment user, As the actual performance data that physical equipment needs to meet.
进一步可选地,获取物理设备实际需要满足的功耗数据和性能数据,包括:根据物理设备实际需要承载的服务的QoS,分析出物理设备实际需要满足的功耗数据和性能数据;或者,获取服务部署用户要求的性能数据和和性能数据,作为物理设备实际需要满足的功耗数据和性能数据。Further optionally, obtaining the power consumption data and performance data that the physical device actually needs to meet includes: analyzing the power consumption data and performance data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, obtaining The performance data and performance data required by the service deployment user are the power consumption data and performance data that the physical device actually needs to meet.
在一可选实施例中,步骤502的一种实施方式包括:利用负载测试工具测试物理设备在上述多种取值组合中部分取值组合下的性能数据和功耗数据;根据物理设备在上述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型;利用性能-功耗预估模型预估物理设备在多种取值组合中其它取值组合下的性能数据和功耗数据。In an optional embodiment, an implementation manner of step 502 includes: using a load test tool to test the performance data and power consumption data of the physical device under partial value combinations among the above-mentioned multiple value combinations; Perform model training on performance data and power consumption data under partial value combinations to obtain the performance-power consumption prediction model; use the performance-power consumption prediction model to predict the physical device under other value combinations among multiple value combinations Performance data and power consumption data.
进一步可选地,根据物理设备在部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型,包括:对物理设备在部分取值组合下的性能数据和功耗数据进行回归分析,以得到性能-功耗预估模型。Further optionally, model training is performed according to the performance data and power consumption data of the physical device under partial value combinations to obtain the performance-power consumption prediction model, including: performance data and power consumption data of the physical device under partial value combinations The power consumption data is subjected to regression analysis to obtain the performance-power consumption prediction model.
更进一步,对物理设备在部分取值组合下的性能数据和功耗数据进行回归分析,以得到性能-功耗预估模型,包括:将部分取值组合作为自变量,将物理设备在部分取值组合下的性能数据和功耗数据作为因变量进行线性回归分析,得到性能-功耗预估模型。Furthermore, perform regression analysis on the performance data and power consumption data of the physical device under partial value combinations to obtain the performance-power consumption prediction model, including: taking some value combinations as independent variables, and taking the physical device in part The performance data and power consumption data under the value combination are used as dependent variables to perform linear regression analysis to obtain a performance-power consumption prediction model.
在另一可选实施例中,获取物理设备在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,包括:接收模型计算设备发送的物理设备在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据;其中,至少部分取值组合下的性能数据和功耗数据是模型计算设备基于性能-功耗预估模型预估出的。关于模型计算设备获得性能-功耗预估模型以及基于性能-功耗预估模型预估出物理设备在至少部分取值组合下的性能数据和功耗数据的详细实现可参见前述实施例,在此不再赘述。In another optional embodiment, acquiring the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one kernel parameter includes: receiving the physical device sent by the model computing device corresponding to the at least one kernel parameter Performance data and power consumption data under multiple value combinations; among them, the performance data and power consumption data under at least some value combinations are estimated by the model computing device based on the performance-power consumption prediction model. For the detailed implementation of the performance-power consumption prediction model obtained by the model computing device and the performance-power consumption prediction model estimated based on the performance-power consumption prediction model, the detailed implementation of the performance data and power consumption data of the physical device under at least partial value combinations can be found in the foregoing embodiments. This will not be repeated here.
图5b为本申请示例性实施例提供的另一种数据处理方法的流程示意图。如图5b所示,该方法包括:FIG. 5b is a schematic flowchart of another data processing method provided by an exemplary embodiment of this application. As shown in Figure 5b, the method includes:
51、从物理设备的内核参数中,确定与物理设备支持的内核态的功耗管 理机制相关的至少一个内核参数。51. From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device.
52、利用负载测试工具测试物理设备在上述至少一个内核参数对应的部分取值组合下的性能数据和功耗数据。52. Use a load test tool to test the performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter.
53、根据物理设备在上述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型。53. Perform model training according to the performance data and power consumption data of the physical device under the above-mentioned partial value combination to obtain a performance-power consumption prediction model.
54、利用性能-功耗预估模型预估物理设备在上述至少一个内核参数对应的其它取值组合下的性能数据和功耗数据。54. Use the performance-power consumption estimation model to estimate the performance data and power consumption data of the physical device under other value combinations corresponding to the at least one kernel parameter mentioned above.
在一可选实施例中,步骤53的一种实施方式包括:对物理设备在上述部分取值组合下的性能数据和功耗数据进行回归分析,以得到性能-功耗预估模型。In an optional embodiment, an implementation manner of step 53 includes: performing regression analysis on the performance data and power consumption data of the physical device under the above-mentioned partial value combinations to obtain a performance-power consumption prediction model.
进一步,可以采用线性回归分析方法进行模型训练。获取性能-功耗预估模型的模型训练过程包括:将上述部分取值组合作为自变量,将物理设备在上述部分取值组合下的性能数据和功耗数据作为因变量进行线性回归分析,得到性能-功耗预估模型。Further, the linear regression analysis method can be used for model training. The model training process of obtaining the performance-power consumption prediction model includes: using the above combination of values as independent variables, and using the performance data and power consumption data of the physical device under the above combination of values as dependent variables to perform linear regression analysis to obtain Performance-power consumption prediction model.
在本实施例中,结合人工智能,只需收集物理设备在上述至少一个内核参数对应的部分取值组合下的性能数据和功耗数据,基于收集的数据训练出性能-功耗预估模型,基于性能-功耗预估模型预估出物理设备在上述至少一个内核参数对应的其它取值组合下的性能数据和功耗数据,这个可以极大地提高数据获取效率,降低成本,为物理设备进行内核参数设置提供数据条件。In this embodiment, combined with artificial intelligence, only the performance data and power consumption data of the physical device under the partial value combination corresponding to the above at least one kernel parameter are collected, and the performance-power consumption prediction model is trained based on the collected data. Based on the performance-power consumption prediction model, the performance data and power consumption data of the physical device under other combinations of values corresponding to at least one of the above-mentioned core parameters are estimated. This can greatly improve the efficiency of data acquisition, reduce costs, and perform processing for the physical device. Kernel parameter settings provide data conditions.
除上述方法实施例之外,本申请还提供了以下方法实施例。In addition to the foregoing method embodiments, this application also provides the following method embodiments.
如图6a所示,又一种数据处理方法实施例包括:As shown in FIG. 6a, another embodiment of a data processing method includes:
601、从物理设备的内核参数中,确定与设备性能相关的至少一个内核参数。601. Determine at least one kernel parameter related to the performance of the device from the kernel parameters of the physical device.
602、获取物理设备在上述至少一个内核参数对应的多种取值组合下的性能数据,其中,至少部分取值组合下的性能数据是基于性能预估模型预估出的。602. Acquire performance data of the physical device under multiple value combinations corresponding to the at least one kernel parameter, where at least part of the performance data under the value combination is estimated based on a performance prediction model.
603、根据物理设备在上述多种取值组合下的性能数据,确定至少一个内 核参数对应的目标取值组合。603. Determine the target value combination corresponding to at least one core parameter according to the performance data of the physical device under the foregoing multiple value combinations.
604、根据目标取值组合对上述至少一个内核参数进行设置,以使物理设备按照目标取值组合中的取值运行。604. Set the at least one kernel parameter mentioned above according to the target value combination, so that the physical device operates according to the value in the target value combination.
在本实施例中,将内核参数的设置操作与人工智能相结合,基于人工智能模型得到物理设备在相关内核参数对应的多种取值组合下的性能数据,使得物理设备可以以其在相关内核参数对应的多种取值组合下的性能数据为依据,对相关内核参数进行设置,可为相关内核参数设置合适的取值,有利于保证物理设备的性能,而与人工智能相结合,可提高参数设置效率,降低成本。In this embodiment, the kernel parameter setting operation is combined with artificial intelligence, and based on the artificial intelligence model, the performance data of the physical device under multiple value combinations corresponding to the relevant kernel parameters is obtained, so that the physical device can be used in the relevant kernel. Based on the performance data under the multiple value combinations corresponding to the parameters, the relevant kernel parameters can be set, and appropriate values can be set for the relevant kernel parameters, which is conducive to ensuring the performance of the physical device, and the combination with artificial intelligence can improve Parameter setting efficiency and cost reduction.
如图6b所示,又一种数据处理方法实施例包括:As shown in Figure 6b, another embodiment of a data processing method includes:
61、从物理设备的内核参数中,确定与设备性能相关的至少一个内核参数。61. From the kernel parameters of the physical device, determine at least one kernel parameter related to the performance of the device.
62、利用负载测试工具测试物理设备在上述至少一个内核参数对应的部分取值组合下的性能数据。62. Use a load test tool to test the performance data of the physical device under the partial value combination corresponding to the at least one kernel parameter.
63、根据物理设备在上述部分取值组合下的性能数据进行模型训练,以得到性能预估模型。63. Perform model training according to the performance data of the physical equipment under the above combination of partial values to obtain a performance prediction model.
64、利用性能预估模型预估物理设备在至少一个内核参数对应的其它取值组合下的性能数据。64. Use the performance prediction model to predict the performance data of the physical device under other value combinations corresponding to at least one kernel parameter.
在本实施例中,结合人工智能,只需收集物理设备在上述至少一个内核参数对应的部分取值组合下的性能数据,基于收集的数据训练出性能预估模型,基于性能预估模型预估出物理设备在上述至少一个内核参数对应的其它取值组合下的性能数据,这个可以极大地提高数据获取效率,降低成本,为物理设备进行内核参数设置提供数据条件。In this embodiment, combined with artificial intelligence, only the performance data of the physical device under the partial value combination corresponding to the above-mentioned at least one kernel parameter is collected, and the performance prediction model is trained based on the collected data, and the performance prediction model is estimated based on the performance prediction model. The performance data of the physical device under other value combinations corresponding to the above at least one kernel parameter can be obtained, which can greatly improve the efficiency of data acquisition, reduce the cost, and provide data conditions for the physical device to perform the kernel parameter setting.
如图7a所示,又一种数据处理方法实施例包括:As shown in FIG. 7a, another embodiment of a data processing method includes:
701、从物理设备的内核参数中,确定与设备功耗相关的至少一个内核参数。701. From the kernel parameters of the physical device, determine at least one kernel parameter related to the power consumption of the device.
702、获取物理设备在上述至少一个内核参数对应的多种取值组合下的功 耗数据,其中,至少部分取值组合下的功耗数据是基于功耗预估模型预估出的。702. Acquire power consumption data of the physical device under multiple value combinations corresponding to the at least one kernel parameter, where at least part of the power consumption data under the value combination is estimated based on a power consumption estimation model.
703、根据物理设备在上述多种取值组合下的功耗数据,确定至少一个内核参数对应的目标取值组合。703. Determine a target value combination corresponding to at least one kernel parameter according to the power consumption data of the physical device under the foregoing multiple value combinations.
704、根据目标取值组合对上述至少一个内核参数进行设置,以使物理设备按照目标取值组合中的取值运行。704. Set the at least one kernel parameter mentioned above according to the target value combination, so that the physical device operates according to the value in the target value combination.
在本实施例中,将内核参数的设置操作与人工智能相结合,基于人工智能模型得到物理设备在相关内核参数对应的多种取值组合下的功耗数据,使得物理设备可以以其在相关内核参数对应的多种取值组合下的功耗数据为依据,对相关内核参数进行设置,可为相关内核参数设置合适的取值,有利于降低物理设备的功耗,而与人工智能相结合,可提高参数设置效率,降低成本。In this embodiment, the kernel parameter setting operation is combined with artificial intelligence, and based on the artificial intelligence model, the power consumption data of the physical device under multiple value combinations corresponding to the relevant kernel parameter is obtained, so that the physical device can be Based on the power consumption data under the multiple value combinations corresponding to the kernel parameters, the relevant kernel parameters can be set, and appropriate values can be set for the relevant kernel parameters, which is conducive to reducing the power consumption of physical devices and combining with artificial intelligence , Which can improve the efficiency of parameter setting and reduce costs.
如图7b所示,又一种数据处理方法实施例包括:As shown in Figure 7b, another embodiment of a data processing method includes:
71、从物理设备的内核参数中,确定与设备功耗相关的至少一个内核参数。71. From the kernel parameters of the physical device, determine at least one kernel parameter related to the power consumption of the device.
72、利用负载测试工具测试物理设备在上述至少一个内核参数对应的部分取值组合下的功耗数据。72. Use a load test tool to test the power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter.
73、根据物理设备在部分取值组合下的功耗数据进行模型训练,以得到功耗预估模型。73. Perform model training according to the power consumption data of the physical device under partial value combinations to obtain a power consumption prediction model.
74、利用功耗预估模型预估物理设备在上述至少一个内核参数对应的其它取值组合下的功耗数据。74. Use the power consumption estimation model to estimate the power consumption data of the physical device under other value combinations corresponding to the at least one kernel parameter mentioned above.
在本实施例中,结合人工智能,只需收集物理设备在上述至少一个内核参数对应的部分取值组合下的功耗数据,基于收集的数据训练出功耗预估模型,基于功耗预估模型预估出物理设备在上述至少一个内核参数对应的其它取值组合下的功耗数据,这个可以极大地提高数据获取效率,降低成本,为物理设备进行内核参数设置提供数据条件。In this embodiment, combined with artificial intelligence, only the power consumption data of the physical device under the partial value combination corresponding to the above at least one kernel parameter is collected, and the power consumption estimation model is trained based on the collected data, and the power consumption estimation is based on The model predicts the power consumption data of the physical device under other value combinations corresponding to at least one of the above-mentioned kernel parameters, which can greatly improve data acquisition efficiency, reduce costs, and provide data conditions for the physical device to set the kernel parameters.
如图7c所示,又一种数据处理方法实施例包括:As shown in FIG. 7c, another embodiment of a data processing method includes:
711、从物理设备的内核参数中,确定与物理设备支持的内核态的功耗管理机制相关的至少一个内核参数。711. From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device.
712、利用负载测试工具测试物理设备在上述至少一个内核参数对应的部分取值组合下的性能数据和功耗数据。712. Use a load test tool to test the performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter.
713、根据物理设备在部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型。713. Perform model training according to the performance data and power consumption data of the physical device under partial value combinations to obtain a performance-power consumption prediction model.
714、利用性能-功耗预估模型预估物理设备在上述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据;其中,所述多种取值组合包括上述部分取值组合。714. Use the performance-power consumption estimation model to estimate the performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one kernel parameter; wherein, the multiple value combinations include the aforementioned partial values combination.
在本实施例中,结合人工智能,只需收集物理设备在上述至少一个内核参数对应的部分取值组合下的性能数据和功耗数据,基于收集的数据训练出性能-功耗预估模型,基于性能-功耗预估模型预估出物理设备在上述至少一个内核参数对应的其它取值组合下的性能数据和功耗数据,这个可以极大地提高数据获取效率,降低成本,为物理设备进行内核参数设置提供数据条件。In this embodiment, combined with artificial intelligence, only the performance data and power consumption data of the physical device under the partial value combination corresponding to the above at least one kernel parameter are collected, and the performance-power consumption prediction model is trained based on the collected data. Based on the performance-power consumption prediction model, the performance data and power consumption data of the physical device under other combinations of values corresponding to at least one of the above-mentioned core parameters are estimated. This can greatly improve the efficiency of data acquisition, reduce costs, and perform processing for the physical device. Kernel parameter settings provide data conditions.
除上述数据处理方法之外,本申请实施例还提供一种任务调度方法。如图7d所示,该任务调度方法包括:In addition to the foregoing data processing method, the embodiment of the present application also provides a task scheduling method. As shown in Figure 7d, the task scheduling method includes:
721、获取待调度任务以及待调度任务的性能要求。721. Obtain the to-be-scheduled task and the performance requirements of the to-be-scheduled task.
722、从至少一个资源设备中,选择满足上述性能要求且内核态功耗参数值满足设定功耗要求的资源设备。722. From at least one resource device, select a resource device that meets the foregoing performance requirements and that the value of the core state power consumption parameter meets the set power consumption requirement.
723、将待调度任务调度至满足上述性能要求且内核态功耗参数值满足设定功耗要求的资源设备。723. Schedule the task to be scheduled to a resource device that meets the foregoing performance requirements and the core state power consumption parameter value meets the set power consumption requirement.
在本实施例中,内核态功耗参数值是指与资源设备支持的内核态的功耗管理机制相关的至少一个内核参数的取值组合。其中,内核态的功耗管理机制,是指操作系统提供的一种对物理设备的功耗进行管理的机制,是操作系统级的功耗管理机制,需要运行在内核态。In this embodiment, the value of the power consumption parameter in the kernel mode refers to a combination of values of at least one kernel parameter related to the power management mechanism of the kernel mode supported by the resource device. Among them, the power management mechanism in the kernel mode refers to a mechanism provided by the operating system to manage the power consumption of physical devices. It is a power management mechanism at the operating system level and needs to run in the kernel mode.
在本实施例中,并不限定操作系统的类型,例如可以是Linux操作系统、Windows操作系统、UNIX操作系统或MAC操作系统等。不同操作系统支持 的内核态的功耗管理机制会有所不同。其中,DVFS和C-state是Linux操作系统支持的两种内核态的功耗管理机制的示例。In this embodiment, the type of operating system is not limited. For example, it may be a Linux operating system, a Windows operating system, a UNIX operating system, or a MAC operating system. The power management mechanism of the kernel mode supported by different operating systems will be different. Among them, DVFS and C-state are examples of two kernel-state power management mechanisms supported by the Linux operating system.
其中,内核态的功耗管理机制与一些内核参数相关,这些内核参数也就是内核态的功耗管理机制的参数,这些内核参数的取值可影响内核态功耗管理机制的节能效果。对任一资源设备来说,正常使用其内核态的功耗管理机制的前提,是预先设置好与内核态的功耗管理机制相关的内核参数的取值。这意味着,处于正常工作状态的设备,与其内核态的功耗管理机制有关的至少一个内核参数都有确定的取值,这些取值的组合即为本实施例的内核态功耗参数值。资源设备的内核态功耗参数值一定程度上可以反映资源设备的功耗情况。Among them, the power management mechanism in the kernel mode is related to some kernel parameters. These kernel parameters are also the parameters of the power management mechanism in the kernel mode. The value of these kernel parameters can affect the energy saving effect of the power management mechanism in the kernel mode. For any resource device, the prerequisite for the normal use of the power management mechanism in the kernel mode is to set the values of the kernel parameters related to the power management mechanism in the kernel mode in advance. This means that at least one kernel parameter related to the power management mechanism of the kernel mode of the device in the normal working state has a certain value, and the combination of these values is the kernel mode power consumption parameter value of this embodiment. The core state power consumption parameter value of the resource device can reflect the power consumption of the resource device to a certain extent.
基于上述考虑,在机房、数据中心或边缘云网络等需要进行任务调度的场景中,可以结合资源设备的内核态功耗参数值进行任务调度。其中,资源设备是指资源调度场景中负责执行任务的各类物理设备,例如可以是笔记本电脑、平板电脑、智能手机或边缘计算节点等终端类设备,也可以是一些服务器、服务器集群、服务器阵列或云服务器等服务端设备。例如,资源设备可以服务器或服务器集群,但并不限于此。Based on the above considerations, in scenarios that require task scheduling such as computer rooms, data centers, or edge cloud networks, task scheduling can be performed in combination with the core state power consumption parameter values of resource devices. Among them, resource devices refer to various physical devices responsible for performing tasks in resource scheduling scenarios. For example, they can be terminal devices such as laptops, tablets, smart phones, or edge computing nodes, or they can be servers, server clusters, and server arrays. Or server-side equipment such as cloud servers. For example, the resource device can be a server or a server cluster, but it is not limited to this.
在任务调度场景中,一般部署有任务调度设备(或称为任务调度器),主要用于将待调度任务调度至合适的资源设备上。该任务调度设备可以运行任务调度服务、程序或插件等程序代码实现下述任务调度过程。In a task scheduling scenario, a task scheduling device (or called a task scheduler) is generally deployed, which is mainly used to schedule tasks to be scheduled to appropriate resource devices. The task scheduling device can run program codes such as task scheduling services, programs, or plug-ins to implement the following task scheduling process.
在任务调度过程中,需要获取待调度任务以及待调度任务的性能要求。可选地,任务调度设备可以面向用户提供人机交互界面,用户可以通过该人机交互界面提供待调度任务及其性能要求。该人机交互界面可以是应用程序页面,web页面或者是命令窗口。或者,任务调度设备也可以支持语音交互与识别技术,用户可以通过语音指令提交待调度任务及其性能要求。不同待调度任务的性能要求会有所不同,对此不做限定。In the task scheduling process, the task to be scheduled and the performance requirements of the task to be scheduled need to be obtained. Optionally, the task scheduling device may provide a human-computer interaction interface for the user, and the user may provide the tasks to be scheduled and their performance requirements through the human-computer interaction interface. The human-computer interaction interface can be an application page, a web page or a command window. Alternatively, the task scheduling device can also support voice interaction and recognition technology, and users can submit tasks to be scheduled and their performance requirements through voice instructions. The performance requirements of different tasks to be scheduled will be different, which is not limited.
之后,可根据待调度任务的性能要求,从至少一个资源设备中,选择满足该性能要求且内核态功耗参数值满足设定功耗要求的资源设备;将待调度 任务调度至满足该性能要求且内核态功耗参数值满足设定功耗要求的资源设备。After that, according to the performance requirements of the task to be scheduled, from at least one resource device, a resource device that meets the performance requirement and the core state power consumption parameter value meets the set power consumption requirement can be selected from at least one resource device; the task to be scheduled is scheduled to meet the performance requirement And the resource device whose core state power consumption parameter value meets the set power consumption requirement.
可选地,在选择满足该性能要求且内核态功耗参数值满足设定功耗要求的资源设备的过程中,可以依据至少一个资源设备在各自内核态功耗参数值下的性能数据和功耗数据。即,根据至少一个资源设备在各自内核态功耗参数值下的性能数据和功耗数据,选择满足该性能要求且内核态功耗参数值满足设定功耗要求的资源设备。Optionally, in the process of selecting a resource device that meets the performance requirements and that the core-mode power consumption parameter value meets the set power consumption requirement, the performance data and performance of at least one resource device under the respective core-mode power consumption parameter value may be selected. Consumption data. That is, according to the performance data and power consumption data of at least one resource device under the respective core-state power consumption parameter values, a resource device that meets the performance requirement and the core-mode power consumption parameter value meets the set power consumption requirement is selected.
在一种可选实施方式中,根据至少一个资源设备在各自内核态功耗参数值下的性能数据和功耗数据,选择满足该性能要求且内核态功耗参数值满足设定功耗要求的资源设备,包括:根据至少一个资源设备在各自内核态功耗参数值下的性能数据,选择满足上述性能要求的候选资源设备;根据候选资源设备在各自内核态功耗参数值下的功耗数据,从候选资源设备中选择功耗数据满足设定功耗要求的资源设备。其中,满足上述性能要求的候选资源设备的数量可以是一个或多个。候选资源设备在内核态功耗参数值下的功耗数据满足设定功耗要求,表示候选资源设备的内核态功耗参数值满足设定功耗要求。In an optional implementation manner, according to the performance data and power consumption data of at least one resource device under the respective core-state power consumption parameter values, the one that meets the performance requirements and the core-state power consumption parameter values meets the set power consumption requirements is selected. The resource device includes: selecting a candidate resource device that meets the above performance requirements according to the performance data of at least one resource device under the respective core state power consumption parameter value; according to the power consumption data of the candidate resource device under the respective core state power consumption parameter value , Select a resource device whose power consumption data meets the set power consumption requirement from the candidate resource devices. Wherein, the number of candidate resource devices meeting the foregoing performance requirements may be one or more. The power consumption data of the candidate resource device under the kernel state power consumption parameter value meets the set power consumption requirement, which means that the kernel state power consumption parameter value of the candidate resource device meets the set power consumption requirement.
在另一种可选实施方式中,根据至少一个资源设备在各自内核态功耗参数值下的性能数据和功耗数据,选择满足该性能要求且内核态功耗参数值满足设定功耗要求的资源设备,包括:根据至少一个资源设备在各自内核态功耗参数值下的功耗数据,选择内核态功耗参数值满足设定功耗要求的候选资源设备;根据候选资源设备在各自内核态功耗参数值下的性能数据,从候选资源设备中选择功耗数据满足设定功耗要求的资源设备。In another optional implementation manner, according to the performance data and power consumption data of at least one resource device under the respective core-state power consumption parameter values, it is selected to meet the performance requirements and the core-mode power consumption parameter values meet the set power consumption requirements The resource device includes: selecting a candidate resource device whose core state power consumption parameter value meets the set power consumption requirement according to the power consumption data of at least one resource device under the respective core state power consumption parameter value; according to the candidate resource device in the respective core According to the performance data under the state power consumption parameter value, a resource device whose power consumption data meets the set power consumption requirement is selected from the candidate resource devices.
在上述各实施例中,并不对“设定功耗要求”进行限定,可以根据应用需求灵活设定。例如,在一可选实施例中,设定功耗要求可以要求内核态功耗参数值给资源设备带来的功耗最低,基于此,可以从满足上述性能要求的候选资源设备中,选择功耗数据最低的资源设备;然后将待调度任务调度至该功耗数据最低的资源设备上。在该可选实施例中,可以在保证性能的情况 下,选择具有最佳的内核态功耗参数值的资源设备。In the foregoing embodiments, the “set power consumption requirement” is not limited, and can be flexibly set according to application requirements. For example, in an optional embodiment, setting the power consumption requirement may require that the core state power consumption parameter value brings the lowest power consumption to the resource device. Based on this, the power consumption can be selected from candidate resource devices that meet the above performance requirements. The resource device with the lowest data consumption; then the task to be scheduled is scheduled to the resource device with the lowest data consumption. In this alternative embodiment, the resource device with the best core-mode power consumption parameter value can be selected under the condition of guaranteed performance.
在使用至少一个资源设备在各自内核态功耗参数值下的性能数据和功耗数据之前,需要先获取至少一个资源设备在各自内核态功耗参数值下的性能数据和功耗数据。Before using the performance data and power consumption data of at least one resource device under the respective core-state power consumption parameter values, it is necessary to first obtain the performance data and power consumption data of the at least one resource device under the respective core-state power consumption parameter values.
在一些可选实施例中,可以借助负载测试工具收集各资源设备在各自内核态功耗参数值下的性能数据和功耗数据。In some optional embodiments, a load test tool may be used to collect performance data and power consumption data of each resource device under its own core state power consumption parameter value.
在另一些可选实施例中,可以预先训练出人工智能模型,例如性能-功耗预估模型,在知道各资源设备的内核态功耗参数值的情况下,可以利用该性能-功耗预估模型预测出各资源设备在各自内核态功耗参数值下的性能数据和功耗数据。关于性能-功耗预估模型的训练过程以及使用过程可参见前述实施例,在此不再赘述。In other optional embodiments, an artificial intelligence model can be pre-trained, such as a performance-power consumption prediction model. When the kernel state power consumption parameter value of each resource device is known, the performance-power consumption prediction model can be used. The estimation model predicts the performance data and power consumption data of each resource device under its own core state power consumption parameter value. Regarding the training process and the use process of the performance-power consumption estimation model, refer to the foregoing embodiment, which will not be repeated here.
在又一些实施例中,各资源设备的内核态功耗参数值是采用本申请前述实施例提供的方法设置的,则在为各资源设备设置内核态功耗参数值的过程中,已经学习到了各资源设备在各自内核态功耗参数值下的性能数据和功耗数据,预先学习到的各资源设备在各自内核态功耗参数值下的性能数据和功耗数据可以被保存下来,这样,在任务调度过程中,可以直接读取各资源设备在各自内核态功耗参数值下的性能数据和功耗数据。需要说明的是,各资源设备的内核态功耗参数值是指采用前述实施例提供的方法最终设置的目标取值组合。In still other embodiments, the core-state power consumption parameter value of each resource device is set using the method provided in the foregoing embodiment of this application, and in the process of setting the core-mode power consumption parameter value for each resource device, it has been learned The performance data and power consumption data of each resource device under its own core state power consumption parameter value, and the performance data and power consumption data of each resource device learned in advance under its own core state power consumption parameter value can be saved, so that, In the task scheduling process, the performance data and power consumption data of each resource device under the respective core state power consumption parameter values can be directly read. It should be noted that the core state power consumption parameter value of each resource device refers to the target value combination finally set by the method provided in the foregoing embodiment.
在本申请实施例提供的任务调度方法中,结合资源设备的内核态功耗参数值,可在满足性能要求的情况下,优先选择内核态功耗参数值较佳的资源设备执行任务,可在兼顾性能要求的同时,降低功耗。In the task scheduling method provided by the embodiment of the present application, in combination with the core state power consumption parameter value of the resource device, the resource device with the better core state power consumption parameter value can be preferentially selected to execute the task when the performance requirements are met. While taking into account performance requirements, reduce power consumption.
需要说明的是,上述实施例所提供方法的各步骤的执行主体均可以是同一设备,或者,该方法也由不同设备作为执行主体。比如,步骤501至步骤504的执行主体可以为设备A;又比如,步骤501、503和504的执行主体可以为设备A,步骤502的执行主体可以为设备B;等等。It should be noted that the execution subject of each step of the method provided in the foregoing embodiment may be the same device, or different devices may also be the execution subject of the method. For example, the execution subject of steps 501 to 504 may be device A; for another example, the execution subject of steps 501, 503, and 504 may be device A, and the execution subject of step 502 may be device B; and so on.
另外,在上述实施例及附图中的描述的一些流程中,包含了按照特定顺 序出现的多个操作,但是应该清楚了解,这些操作可以不按照其在本文中出现的顺序来执行或并行执行,操作的序号如501、502等,仅仅是用于区分开各个不同的操作,序号本身不代表任何的执行顺序。另外,这些流程可以包括更多或更少的操作,并且这些操作可以按顺序执行或并行执行。需要说明的是,本文中的“第一”、“第二”等描述,是用于区分不同的消息、设备、模块等,不代表先后顺序,也不限定“第一”和“第二”是不同的类型。In addition, in some of the processes described in the above embodiments and drawings, multiple operations appearing in a specific order are included, but it should be clearly understood that these operations may be performed out of the order in which they appear in this document or performed in parallel. The sequence numbers of operations, such as 501, 502, etc., are only used to distinguish different operations, and the sequence numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed sequentially or in parallel. It should be noted that the descriptions of "first" and "second" in this article are used to distinguish different messages, devices, modules, etc., and do not represent a sequence, nor do they limit the "first" and "second" Are different types.
图8a为本申请示例性实施例提供的一种物理设备的结构示意图。如图8a所示,该物理设备包括:存储器81a和处理器82a。Fig. 8a is a schematic structural diagram of a physical device provided by an exemplary embodiment of this application. As shown in FIG. 8a, the physical device includes: a memory 81a and a processor 82a.
存储器81a,用于存储计算机程序,并可被配置为存储其它各种数据以支持在物理设备上的操作。这些数据的示例包括用于在物理设备上操作的任何应用程序或方法的指令,联系人数据,电话簿数据,消息,图片,视频等。The memory 81a is used to store computer programs, and can be configured to store various other data to support operations on the physical device. Examples of such data include instructions for any application or method operated on the physical device, contact data, phone book data, messages, pictures, videos, etc.
处理器82a,与存储器81a耦合,用于执行存储器81a中的计算机程序,以用于:从所述物理设备的内核参数中,确定与所述物理设备支持的内核态的功耗管理机制相关的至少一个内核参数;获取所述物理设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,其中,至少部分取值组合下的性能数据和功耗数据是基于性能-功耗预估模型预估出的;根据所述物理设备在所述多种取值组合下的性能数据和功耗数据,确定所述至少一个内核参数对应的目标取值组合;根据所述目标取值组合对所述至少一个内核参数进行设置,以使所述功耗管理机制按照所述目标取值组合中的取值运行。The processor 82a is coupled to the memory 81a, and is configured to execute the computer program in the memory 81a to determine from the kernel parameters of the physical device related to the power management mechanism of the kernel mode supported by the physical device At least one kernel parameter; acquiring performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one kernel parameter, where at least part of the performance data and power consumption data under the value combination are based on The performance-power consumption prediction model predicts; according to the performance data and power consumption data of the physical device under the multiple value combinations, the target value combination corresponding to the at least one core parameter is determined; The target value combination sets the at least one kernel parameter so that the power consumption management mechanism operates according to the value in the target value combination.
在一可选实施例中,处理器82a在确定所述至少一个内核参数对应的目标取值组合时,具体用于:根据所述物理设备在所述多种取值组合下的性能数据和功耗数据,从所述多种取值组合中选择至少一种候选取值组合;利用负载测试工具测试所述物理设备在所述至少一种候选取值组合下的性能数据和功耗数据;根据所述负载测试工具测试出的所述物理设备在所述至少一种候选取值组合下的性能数据和功耗数据,从所述至少一种候选取值组合中确定所述目标取值组合。In an optional embodiment, when the processor 82a determines the target value combination corresponding to the at least one kernel parameter, it is specifically configured to: according to the performance data and function of the physical device under the multiple value combinations Select at least one candidate value combination from the multiple value combinations; use a load test tool to test the performance data and power consumption data of the physical device under the at least one candidate value combination; The performance data and power consumption data of the physical device under the at least one candidate value combination tested by the load testing tool are used to determine the target value combination from the at least one candidate value combination.
进一步可选地,处理器82a还用于,在确定所述目标取值组合之后,利用所述负载测试工具测试出的所述物理设备在所述目标取值组合下的性能数据和功耗数据,对所述性能-功耗预估模型进行修正。Further optionally, the processor 82a is further configured to, after determining the target value combination, use the load test tool to test the performance data and power consumption data of the physical device under the target value combination , Revise the performance-power consumption prediction model.
进一步,处理器82a在利用负载测试工具测试所述物理设备在所述至少一种候选取值组合下的性能数据和功耗数据时,具体用于:针对第一候选取值组合,将操作系统源代码中所述至少一个内核参数的取值修改为所述第一候选取值组合中的取值,并根据修改后的操作系统源代码在所述物理设备上安装操作系统;在所述物理设备上运行所述负载测试工具,以测试所述物理设备在所述第一候选取值组合下的性能数据和功耗数据;其中,所述第一候选取值组合是所述至少一种候选取值组合中任一种候选取值组合。Further, when the processor 82a uses a load testing tool to test the performance data and power consumption data of the physical device under the at least one candidate value combination, it is specifically configured to: for the first candidate value combination, set the operating system The value of the at least one kernel parameter in the source code is modified to the value in the first candidate value combination, and the operating system is installed on the physical device according to the modified operating system source code; Run the load test tool on the device to test the performance data and power consumption data of the physical device under the first candidate value combination; wherein, the first candidate value combination is the at least one candidate Any combination of candidate values in the value combination.
进一步,处理器82a在从所述多种取值组合中选择至少一种候选取值组合时,具体用于:获取物理设备实际需要满足的功耗数据;将物理设备实际需要满足的功耗数据,与物理设备在多种取值组合下的性能数据和功耗数据进行匹配;从多种取值组合中,获取与物理设备实际需要满足的功耗数据的匹配度满足匹配度要求的至少一种候选取值组合。或者,Further, when the processor 82a selects at least one candidate value combination from the multiple value combinations, it is specifically configured to: obtain power consumption data that the physical device actually needs to meet; and compare the power consumption data that the physical device actually needs to meet , To match the performance data and power consumption data of the physical device under multiple value combinations; from the multiple value combinations, obtain at least one of the matching degrees with the power consumption data that the physical device actually needs to meet. A combination of candidate values. or,
在一可选实施例中,处理器82a在从所述多种取值组合中选择至少一种候选取值组合时,具体用于:获取物理设备实际需要满足的性能数据,将物理设备实际需要满足的性能数据,与物理设备在至少一种内核参数对应的多种取值组合下的性能数据和功耗数据进行匹配;从多种取值组合中,获取与物理设备实际需要满足的性能数据的匹配度满足匹配度要求的至少一种候选取值组合。或者,In an optional embodiment, when the processor 82a selects at least one candidate value combination from the multiple value combinations, it is specifically configured to: obtain performance data that the physical device actually needs to meet, and compare the physical device's actual needs Satisfied performance data is matched with the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one core parameter; from multiple value combinations, the performance data that the physical device actually needs to meet is obtained The matching degree of at least one candidate value combination that meets the matching degree requirement. or,
在一可选实施例中,处理器82a在从所述多种取值组合中选择至少一种候选取值组合时,具体用于:获取物理设备实际需要满足的性能数据和功耗数据,将物理设备实际需要满足的性能数据和功耗数据,与物理设备在至少一种内核参数对应的多种取值组合下的性能数据和功耗数据进行匹配;从多种取值组合中,获取与物理设备实际需要满足的性能数据和功耗数据的匹配度均满足匹配度要求的至少一种候选取值组合。In an optional embodiment, when the processor 82a selects at least one candidate value combination from the multiple value combinations, it is specifically configured to: obtain the performance data and power consumption data that the physical device actually needs to meet, and The performance data and power consumption data that the physical device actually needs to meet are matched with the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one core parameter; from multiple value combinations, The matching degree of the performance data and the power consumption data that the physical device actually needs to meet all meets at least one candidate value combination that meets the matching degree requirement.
进一步可选地,处理器82a在获取物理设备实际需要满足的功耗数据时,具体用于:根据物理设备实际需要承载的服务的QoS,分析出物理设备实际需要满足的功耗数据;或者,获取服务部署用户要求的功耗数据,作为物理设备实际需要满足的功耗数据。Further optionally, when obtaining the power consumption data that the physical device actually needs to meet, the processor 82a is specifically configured to: analyze the power consumption data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, Obtain the power consumption data required by the service deployment user as the power consumption data that the physical device actually needs to meet.
进一步可选地,处理器82a在获取物理设备实际需要满足的性能数据时,具体用于:根据物理设备实际需要承载的服务的QoS,分析出物理设备实际需要满足的性能数据;或者,获取服务部署用户要求的性能数据,作为物理设备实际需要满足的性能数据。Further optionally, when the processor 82a obtains the performance data that the physical device actually needs to meet, it is specifically used to: analyze the performance data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, obtain the service Deploy the performance data required by the user as the actual performance data that the physical device needs to meet.
进一步可选地,处理器82a在获取物理设备实际需要满足的功耗数据和性能数据时,具体用于:根据物理设备实际需要承载的服务的QoS,分析出物理设备实际需要满足的功耗数据和性能数据;或者,获取服务部署用户要求的性能数据和和性能数据,作为物理设备实际需要满足的功耗数据和性能数据。Further optionally, when the processor 82a obtains the power consumption data and performance data that the physical device actually needs to meet, it is specifically used to: analyze the power consumption data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry And performance data; or, obtain the performance data and performance data required by the service deployment user as the power consumption data and performance data that the physical device actually needs to meet.
在一可选实施例中,处理器82a在获取物理设备在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据时,具体用于:利用负载测试工具测试物理设备在上述多种取值组合中部分取值组合下的性能数据和功耗数据;根据物理设备在上述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型;利用性能-功耗预估模型预估物理设备在多种取值组合中其它取值组合下的性能数据和功耗数据。In an optional embodiment, when the processor 82a obtains the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one kernel parameter, it is specifically configured to: use a load test tool to test that the physical device is in the above-mentioned Performance data and power consumption data under partial value combinations among multiple value combinations; perform model training based on the performance data and power consumption data of the physical device under the above partial value combinations to obtain a performance-power consumption prediction model; Use the performance-power consumption prediction model to estimate the performance data and power consumption data of the physical device under other value combinations among multiple value combinations.
进一步可选地,处理器82a在得到性能-功耗预估模型时,具体用于:对物理设备在部分取值组合下的性能数据和功耗数据进行回归分析,以得到性能-功耗预估模型。Further optionally, when the processor 82a obtains the performance-power consumption prediction model, it is specifically used to: perform regression analysis on the performance data and power consumption data of the physical device under partial value combinations to obtain the performance-power consumption prediction model. Estimate the model.
更进一步,处理器82a具体用于:将部分取值组合作为自变量,将物理设备在部分取值组合下的性能数据和功耗数据作为因变量进行线性回归分析,得到性能-功耗预估模型。Furthermore, the processor 82a is specifically configured to: use partial value combinations as independent variables, and use the performance data and power consumption data of the physical device under the partial value combinations as dependent variables to perform linear regression analysis to obtain performance-power consumption estimates model.
在一可选实施例中,处理器82a在获取物理设备在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据时,具体用于:接收模型计算设 备发送的物理设备在至少一个内核参数对应的多种取值组合下的性能数据和功耗数据;其中,至少部分取值组合下的性能数据和功耗数据是模型计算设备基于性能-功耗预估模型预估出的。关于模型计算设备获得性能-功耗预估模型以及基于性能-功耗预估模型预估出物理设备在至少部分取值组合下的性能数据和功耗数据的详细实现可参见前述实施例,在此不再赘述。In an optional embodiment, when the processor 82a obtains the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one kernel parameter, it is specifically configured to: receive the physical device sent by the model computing device Performance data and power consumption data under multiple value combinations corresponding to at least one core parameter; among them, the performance data and power consumption data under at least some value combinations are estimated by the model computing device based on the performance-power consumption prediction model of. For the detailed implementation of the performance-power consumption prediction model obtained by the model computing device and the performance-power consumption prediction model estimated based on the performance-power consumption prediction model, the detailed implementation of the performance data and power consumption data of the physical device under at least partial value combinations can be found in the foregoing embodiments. This will not be repeated here.
可选地,本实施例的物理设备除了具有上述功能之外,处理器82还可以实现以下功能:从物理设备的内核参数中,确定与设备性能相关的至少一个内核参数;获取物理设备在所述至少一个内核参数对应的多种取值组合下的性能数据,其中,至少部分取值组合下的性能数据是基于性能预估模型预估出的;根据所述物理设备在所述多种取值组合下的性能数据,确定所述至少一个内核参数对应的目标取值组合;根据所述目标取值组合对所述至少一个内核参数进行设置,以使所述物理设备按照所述目标取值组合中的取值运行。Optionally, in addition to the above-mentioned functions of the physical device of this embodiment, the processor 82 may also implement the following functions: determine at least one kernel parameter related to the performance of the device from the kernel parameters of the physical device; The performance data under multiple value combinations corresponding to the at least one kernel parameter, wherein the performance data under at least part of the value combinations is estimated based on the performance prediction model; according to the physical device in the multiple value combinations The performance data under the value combination, determine the target value combination corresponding to the at least one kernel parameter; set the at least one kernel parameter according to the target value combination, so that the physical device takes the value according to the target The value in the combination runs.
可选地,本实施例的物理设备除了具有上述功能之外,处理器82还可以实现以下功能:从物理设备的内核参数中,确定与设备功耗相关的至少一个内核参数;获取所述物理设备在所述至少一个内核参数对应的多种取值组合下的功率数据,其中,至少部分取值组合下的功率数据是基于功率预估模型预估出的;根据所述物理设备在所述多种取值组合下的功率数据,确定所述至少一个内核参数对应的目标取值组合;根据所述目标取值组合对所述至少一个内核参数进行设置,以使所述物理设备按照所述目标取值组合中的取值运行。Optionally, in addition to the above-mentioned functions of the physical device of this embodiment, the processor 82 may also implement the following functions: determine at least one kernel parameter related to the power consumption of the device from the kernel parameters of the physical device; and obtain the physical device. The power data of the device under multiple value combinations corresponding to the at least one kernel parameter, wherein the power data under at least some of the value combinations is estimated based on the power estimation model; according to the physical device in the Determine the target value combination corresponding to the at least one kernel parameter based on the power data under multiple value combinations; set the at least one kernel parameter according to the target value combination, so that the physical device follows the The value in the target value combination runs.
进一步,如图8a所示,该物理设备还包括:通信组件83a、显示器84a、电源组件85a、音频组件86a等其它组件。图8a中仅示意性给出部分组件,并不意味着物理设备只包括图8a所示组件。另外,根据物理设备的实现形态的不同,图8a中虚线框内的组件为可选组件,而非必选组件。例如,当物理设备实现为智能手机、平板电脑或台式电脑等终端设备时,可以包括图8a中虚线框内的组件;当物理设备实现为常规服务器、云服务器、数据中心或服务器阵列等服务端设备时,可以不包括图8a中虚线框内的组件。Further, as shown in FIG. 8a, the physical device further includes: a communication component 83a, a display 84a, a power supply component 85a, an audio component 86a and other components. Only part of the components are schematically shown in FIG. 8a, which does not mean that the physical device only includes the components shown in FIG. 8a. In addition, depending on the implementation form of the physical device, the components in the dashed box in FIG. 8a are optional components, not mandatory components. For example, when the physical device is implemented as a terminal device such as a smart phone, a tablet computer, or a desktop computer, it can include the components in the dashed box in Figure 8a; when the physical device is implemented as a server such as a conventional server, a cloud server, a data center, or a server array When the device is used, the components in the dashed box in Figure 8a may not be included.
相应地,本申请实施例还提供一种存储有计算机程序的计算机可读存储介质,计算机程序被处理器执行时,致使处理器实现上述图5a、图6a或图7a所示方法实施例中的各步骤。Correspondingly, an embodiment of the present application also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the processor will cause the processor to implement the method in the method embodiment shown in FIG. 5a, FIG. 6a, or FIG. 7a. The steps.
图8b为本申请示例性实施例提供的一种模型计算设备的结构示意图。如图8b所示,该物理设备包括:存储器81b和处理器82b。Fig. 8b is a schematic structural diagram of a model computing device provided by an exemplary embodiment of this application. As shown in FIG. 8b, the physical device includes: a memory 81b and a processor 82b.
存储器81b,用于存储计算机程序,并可被配置为存储其它各种数据以支持在物理设备上的操作。这些数据的示例包括用于在物理设备上操作的任何应用程序或方法的指令,联系人数据,电话簿数据,消息,图片,视频等。The memory 81b is used to store computer programs, and can be configured to store various other data to support operations on the physical device. Examples of such data include instructions for any application or method operated on the physical device, contact data, phone book data, messages, pictures, videos, etc.
处理器82b,与存储器81b耦合,用于执行存储器81b中的计算机程序,以用于:从物理设备的内核参数中,确定与所述物理设备支持的内核态的功耗管理机制相关的至少一个内核参数;利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部分取值组合下的性能数据和功耗数据;根据所述物理设备在所述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型;利用所述性能-功耗预估模型预估所述物理设备在所述至少一个内核参数对应的其它取值组合下的性能数据和功耗数据。The processor 82b is coupled with the memory 81b, and is configured to execute the computer program in the memory 81b to determine at least one related to the power management mechanism of the kernel state supported by the physical device from the kernel parameters of the physical device Kernel parameters; use a load test tool to test the performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter; according to the performance data of the physical device under the partial value combination Perform model training with power consumption data to obtain a performance-power consumption prediction model; use the performance-power consumption prediction model to predict the performance of the physical device under other value combinations corresponding to the at least one core parameter Data and power consumption data.
在一可选实施例中,处理器82b在得到性能-功耗预估模型时,具体用于:对所述物理设备在所述部分取值组合下的性能数据和功耗数据进行回归分析,以得到性能-功耗预估模型。In an optional embodiment, when the processor 82b obtains the performance-power consumption prediction model, it is specifically configured to: perform regression analysis on the performance data and power consumption data of the physical device under the partial value combination, In order to get the performance-power consumption prediction model.
进一步可选地,处理器82b具体用于:将所述部分取值组合作为自变量,将所述物理设备在所述部分取值组合下的性能数据和功耗数据作为因变量进行线性回归分析,得到性能-功耗预估模型。Further optionally, the processor 82b is specifically configured to: use the partial value combination as an independent variable, and use the performance data and power consumption data of the physical device under the partial value combination as the dependent variable to perform linear regression analysis , Get the performance-power consumption prediction model.
可选地,本实施例的模型计算设备除了具有上述功能之外,处理器82还可以实现以下功能:从物理设备的内核参数中,确定与设备性能相关的至少一个内核参数;利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部分取值组合下的性能数据;根据所述物理设备在所述部分取值组合下的性能数据进行模型训练,以得到性能预估模型;利用所述性能预估模型预估所述物理设备在所述至少一个内核参数对应的其它取值组合下的性能 数据。Optionally, in addition to the above-mentioned functions, the model computing device of this embodiment may also implement the following functions: determine at least one kernel parameter related to device performance from the kernel parameters of the physical device; use a load test tool Testing the performance data of the physical device under the partial value combination corresponding to the at least one kernel parameter; performing model training according to the performance data of the physical device under the partial value combination to obtain a performance prediction model; The performance prediction model is used to predict the performance data of the physical device under other value combinations corresponding to the at least one kernel parameter.
可选地,本实施例的模型计算设备除了具有上述功能之外,处理器82还可以实现以下功能:从物理设备的内核参数中,确定与设备功耗相关的至少一个内核参数;利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部分取值组合下的功率数据;根据所述物理设备在所述部分取值组合下的功率数据进行模型训练,以得到功率预估模型;利用所述功率预估模型预估所述物理设备在所述至少一个内核参数对应的其它取值组合下的功率数据。Optionally, in addition to the above-mentioned functions, the model computing device of this embodiment may also implement the following functions: determine at least one kernel parameter related to the power consumption of the device from the kernel parameters of the physical device; A tool to test the power data of the physical device under the partial value combination corresponding to the at least one kernel parameter; perform model training according to the power data of the physical device under the partial value combination to obtain a power estimation model ; Using the power estimation model to predict the power data of the physical device under other value combinations corresponding to the at least one kernel parameter.
可选地,本实施例的模型计算设备除了具有上述功能之外,处理器82还可以实现以下功能:从物理设备的内核参数中,确定与所述物理设备支持的内核态的功耗管理机制相关的至少一个内核参数;利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部分取值组合下的性能数据和功耗数据;根据所述物理设备在所述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型;利用所述性能-功耗预估模型预估所述物理设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据;其中,所述多种取值组合包括所述部分取值组合。Optionally, in addition to the above-mentioned functions, the model computing device of this embodiment may also implement the following functions: from the kernel parameters of the physical device, determine the power management mechanism of the kernel state supported by the physical device Relevant at least one kernel parameter; use a load test tool to test the performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter; according to the physical device in the partial value combination Perform model training on the performance data and power consumption data under the following performance data to obtain a performance-power consumption prediction model; use the performance-power consumption prediction model to estimate that the physical device is in multiple selections corresponding to the at least one core parameter. Performance data and power consumption data under value combinations; wherein the multiple value combinations include the partial value combinations.
进一步,如图8b所示,该模型计算设备还包括:通信组件83b、电源组件85b等其它组件。图8b中仅示意性给出部分组件,并不意味着模型计算设备只包括图8b所示组件。可选地,模型计算设备可实现为常规服务器、云服务器、数据中心或服务器阵列等服务端设备。Further, as shown in FIG. 8b, the model computing device further includes: a communication component 83b, a power supply component 85b and other components. Only part of the components are schematically shown in FIG. 8b, which does not mean that the model computing device only includes the components shown in FIG. 8b. Optionally, the model computing device can be implemented as a server device such as a conventional server, a cloud server, a data center, or a server array.
相应地,本申请实施例还提供一种存储有计算机程序的计算机可读存储介质,计算机程序被处理器执行时,致使处理器实现上述图5b、图6b、图7b或图7c所示方法实施例中的各步骤。Correspondingly, an embodiment of the present application also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the processor causes the processor to implement the method shown in FIG. 5b, FIG. 6b, FIG. 7b, or FIG. 7c. The steps in the example.
图8c为本申请示例性实施例提供的一种任务调度设备的结构示意图。如图8c所示,该任务调度设备包括:存储器81c和处理器82c。Fig. 8c is a schematic structural diagram of a task scheduling device provided by an exemplary embodiment of this application. As shown in FIG. 8c, the task scheduling device includes: a memory 81c and a processor 82c.
存储器81c,用于存储计算机程序,并可被配置为存储其它各种数据以支持在任务调度设备上的操作。这些数据的示例包括用于在任务调度设备上操 作的任何应用程序或方法的指令,任务列表,消息,图片,视频等。The memory 81c is used to store computer programs, and can be configured to store other various data to support operations on the task scheduling device. Examples of such data include instructions for any application or method to operate on the task scheduling device, task lists, messages, pictures, videos, etc.
处理器82c,与存储器81c耦合,用于执行存储器81c中的计算机程序,以用于:获取待调度任务以及待调度任务的性能要求;从至少一个资源设备中,选择满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备;将待调度任务调度至满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备;其中,内核态功耗参数值是指与资源设备支持的内核态的功耗管理机制相关的至少一个内核参数的取值组合。The processor 82c is coupled with the memory 81c, and is configured to execute the computer program in the memory 81c to obtain the tasks to be scheduled and the performance requirements of the tasks to be scheduled; from at least one resource device, select the core device that meets the performance requirements and The resource device whose value of the power consumption parameter meets the set power consumption requirement; schedule the task to be scheduled to the resource device that meets the performance requirement and the value of the kernel power consumption parameter meets the set power consumption requirement; wherein, the kernel power consumption parameter The value refers to a value combination of at least one kernel parameter related to the power management mechanism of the kernel mode supported by the resource device.
可选地,资源设备可以是服务器,或服务器集群。Optionally, the resource device may be a server or a server cluster.
在一可选实施例中,处理器82c在选择满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备时,具体用于:根据至少一个资源设备在各自内核态功耗参数值下的性能数据和功耗数据,选择满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备。In an optional embodiment, when the processor 82c selects a resource device that meets the performance requirements and the core state power consumption parameter value meets the set power consumption requirement, it is specifically configured to: The performance data and power consumption data under the consumption parameter value are selected to select a resource device that meets the performance requirement and the core state power consumption parameter value meets the set power consumption requirement.
进一步可选地,处理器82c具体用于:根据至少一个资源设备在各自内核态功耗参数值下的性能数据,选择满足所述性能要求的候选资源设备;根据候选资源设备在各自内核态功耗参数值下的功耗数据,从候选资源设备中选择功耗数据满足设定功耗要求的资源设备。Further optionally, the processor 82c is specifically configured to: select a candidate resource device that meets the performance requirements according to the performance data of at least one resource device under the respective core state power consumption parameter value; according to the candidate resource device's performance in the respective core state For the power consumption data under the consumption parameter value, a resource device whose power consumption data meets the set power consumption requirement is selected from the candidate resource devices.
更进一步,处理器82c具体用于:根据候选资源设备在各自内核态功耗参数值下的功耗数据,从候选资源设备中选择功耗数据最低的资源设备。Furthermore, the processor 82c is specifically configured to select the resource device with the lowest power consumption data from the candidate resource devices according to the power consumption data of the candidate resource devices under their respective core state power consumption parameter values.
进一步,如图8c所示,该任务调度设备还包括:通信组件83c、显示器84c、电源组件85c、音频组件86c等其它组件。图8c中仅示意性给出部分组件,并不意味着任务调度设备只包括图8c所示组件。另外,根据任务调度设备的实现形态的不同,图8c中虚线框内的组件为可选组件,而非必选组件。例如,当任务调度设备实现为智能手机、平板电脑或台式电脑等终端设备时,可以包括图8c中虚线框内的组件;当任务调度设备实现为常规服务器、云服务器、数据中心或服务器阵列等服务端设备时,可以不包括图8c中虚线框内的组件。Further, as shown in FIG. 8c, the task scheduling device further includes: a communication component 83c, a display 84c, a power supply component 85c, an audio component 86c and other components. Only some components are schematically shown in FIG. 8c, which does not mean that the task scheduling device only includes the components shown in FIG. 8c. In addition, according to the different implementation forms of the task scheduling device, the components in the dashed box in FIG. 8c are optional components, not mandatory components. For example, when the task scheduling device is implemented as a terminal device such as a smart phone, a tablet computer, or a desktop computer, it can include the components in the dashed box in Figure 8c; when the task scheduling device is implemented as a conventional server, cloud server, data center, or server array, etc. When the server device is used, the components in the dashed box in Figure 8c may not be included.
相应地,本申请实施例还提供一种存储有计算机程序的计算机可读存储 介质,计算机程序被处理器执行时,致使处理器实现上述图7d所示方法实施例中的各步骤。Correspondingly, an embodiment of the present application also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the processor causes the processor to implement the steps in the method embodiment shown in FIG. 7d.
上述图8a-图8c中的通信组件被配置为便于通信组件所在设备和其他设备之间有线或无线方式的通信。通信组件所在设备可以接入基于通信标准的无线网络,如WiFi,2G、3G、4G/LTE、5G等移动通信网络,或它们的组合。在一个示例性实施例中,通信组件经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中,所述通信组件还可以包括近场通信(NFC)模块,射频识别(RFID)技术,红外数据协会(IrDA)技术,超宽带(UWB)技术,蓝牙(BT)技术等。The communication components in Figs. 8a to 8c are configured to facilitate wired or wireless communication between the device where the communication component is located and other devices. The device where the communication component is located can access wireless networks based on communication standards, such as WiFi, 2G, 3G, 4G/LTE, 5G and other mobile communication networks, or a combination of them. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component may further include a near field communication (NFC) module, radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra wideband (UWB) technology, Bluetooth (BT) technology Wait.
上述图8a-图8c中的显示器包括屏幕,其屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与所述触摸或滑动操作相关的持续时间和压力。The above-mentioned display in Figs. 8a-8c includes a screen, and the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation.
上述图8a-图8c中的电源组件,为电源组件所在设备的各种组件提供电力。电源组件可以包括电源管理系统,一个或多个电源,及其他与为电源组件所在设备生成、管理和分配电力相关联的组件。The power supply components in Figures 8a to 8c above provide power for various components of the equipment where the power supply components are located. The power supply component may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device where the power supply component is located.
上述图8a-图8c中的音频组件,可被配置为输出和/或输入音频信号。例如,音频组件包括一个麦克风(MIC),当音频组件所在设备处于操作模式,如呼叫模式、记录模式和语音识别模式时,麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器或经由通信组件发送。在一些实施例中,音频组件还包括一个扬声器,用于输出音频信号。The audio components in Figs. 8a to 8c may be configured to output and/or input audio signals. For example, the audio component includes a microphone (MIC). When the device where the audio component is located is in an operating mode, such as call mode, recording mode, and voice recognition mode, the microphone is configured to receive external audio signals. The received audio signal can be further stored in a memory or sent via a communication component. In some embodiments, the audio component further includes a speaker for outputting audio signals.
本领域内的技术人员应明白,本发明的实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention is described with reference to flowcharts and/or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are generated It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment. The instructions provide steps for implementing the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
在一个典型的配置中,计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。In a typical configuration, the computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
内存可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM)。内存是计算机可读介质的示例。The memory may include non-permanent memory in a computer readable medium, random access memory (RAM) and/or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM). Memory is an example of computer readable media.
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读 存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括暂存电脑可读媒体(transitory media),如调制的数据信号和载波。Computer-readable media include permanent and non-permanent, removable and non-removable media, and information storage can be realized by any method or technology. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical storage, Magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media can be used to store information that can be accessed by computing devices. According to the definition in this article, computer-readable media does not include transitory media, such as modulated data signals and carrier waves.
还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、商品或者设备中还存在另外的相同要素。It should also be noted that the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or equipment including a series of elements not only includes those elements, but also includes Other elements that are not explicitly listed, or they also include elements inherent to such processes, methods, commodities, or equipment. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, commodity, or equipment that includes the element.
以上所述仅为本申请的实施例而已,并不用于限制本申请。对于本领域技术人员来说,本申请可以有各种更改和变化。凡在本申请的精神和原理之内所作的任何修改、等同替换、改进等,均应包含在本申请的权利要求范围之内。The foregoing descriptions are only examples of the present application, and are not used to limit the present application. For those skilled in the art, this application can have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included in the scope of the claims of this application.

Claims (33)

  1. 一种数据处理方法,其特征在于,包括:A data processing method, characterized in that it comprises:
    从物理设备的内核参数中,确定与所述物理设备支持的内核态的功耗管理机制相关的至少一个内核参数;From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device;
    获取所述物理设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,其中,至少部分取值组合下的性能数据和功耗数据是基于性能-功耗预估模型预估出的;Acquire performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one kernel parameter, where at least some of the performance data and power consumption data under the value combination are based on performance-power consumption prediction Estimated by the estimation model;
    根据所述物理设备在所述多种取值组合下的性能数据和功耗数据,确定所述至少一个内核参数对应的目标取值组合;Determine the target value combination corresponding to the at least one kernel parameter according to the performance data and power consumption data of the physical device under the multiple value combinations;
    根据所述目标取值组合对所述至少一个内核参数进行设置,以使所述功耗管理机制按照所述目标取值组合中的取值运行。The at least one kernel parameter is set according to the target value combination, so that the power consumption management mechanism operates according to the value in the target value combination.
  2. 根据权利要求1所述的方法,其特征在于,根据所述物理设备在所述多种取值组合下的性能数据和功耗数据,确定所述至少一个内核参数对应的目标取值组合,包括:The method according to claim 1, wherein determining the target value combination corresponding to the at least one kernel parameter according to the performance data and power consumption data of the physical device under the multiple value combinations, comprising :
    根据所述物理设备在所述多种取值组合下的性能数据和功耗数据,从所述多种取值组合中选择至少一种候选取值组合;Selecting at least one candidate value combination from the multiple value combinations according to the performance data and power consumption data of the physical device under the multiple value combinations;
    利用负载测试工具测试所述物理设备在所述至少一种候选取值组合下的性能数据和功耗数据;Using a load test tool to test the performance data and power consumption data of the physical device under the at least one candidate value combination;
    根据所述负载测试工具测试出的所述物理设备在所述至少一种候选取值组合下的性能数据和功耗数据,从所述至少一种候选取值组合中确定所述目标取值组合。According to the performance data and power consumption data of the physical device under the at least one candidate value combination tested by the load test tool, the target value combination is determined from the at least one candidate value combination .
  3. 根据权利要求2所述的方法,其特征在于,利用负载测试工具测试所述物理设备在所述至少一种候选取值组合下的性能数据和功耗数据,包括:The method according to claim 2, wherein using a load test tool to test the performance data and power consumption data of the physical device under the at least one candidate value combination comprises:
    针对第一候选取值组合,将操作系统源代码中所述至少一个内核参数的取值修改为所述第一候选取值组合中的取值,并根据修改后的操作系统源代码在所述物理设备上安装操作系统;For the first candidate value combination, modify the value of the at least one kernel parameter in the operating system source code to the value in the first candidate value combination, and use the modified operating system source code in the Install the operating system on the physical device;
    在所述物理设备上运行所述负载测试工具,以测试所述物理设备在所述第一候选取值组合下的性能数据和功耗数据;其中,所述第一候选取值组合是所述至少一种候选取值组合中任一种候选取值组合。Run the load test tool on the physical device to test the performance data and power consumption data of the physical device under the first candidate value combination; wherein, the first candidate value combination is the Any one of the at least one candidate value combination.
  4. 根据权利要求2所述的方法,其特征在于,根据所述物理设备在所述多种取值组合下的性能数据和功耗数据,从所述多种取值组合中选择至少一种候选取值组合,包括:The method according to claim 2, characterized in that, according to the performance data and power consumption data of the physical device under the multiple value combinations, at least one candidate is selected from the multiple value combinations. Value combinations, including:
    获取所述物理设备实际需要满足的功耗数据和/或性能数据;Acquiring power consumption data and/or performance data that the physical device actually needs to meet;
    将所述物理设备实际需要满足的功耗数据和/或性能数据,与所述物理设备在所述多种取值组合下的性能数据和功耗数据进行匹配;Matching power consumption data and/or performance data that the physical device actually needs to meet with the performance data and power consumption data of the physical device under the multiple value combinations;
    从所述多种取值组合中,获取与所述物理设备实际需要满足的功耗数据和/或性能数据的匹配度满足匹配度要求的至少一种候选取值组合。From the multiple value combinations, obtain at least one candidate value combination whose matching degree with the power consumption data and/or performance data that the physical device actually needs to meet meets the matching degree requirement.
  5. 根据权利要求4所述的方法,其特征在于,获取所述物理设备实际需要满足的功耗数据和/或性能数据,包括:The method according to claim 4, wherein obtaining power consumption data and/or performance data that the physical device actually needs to meet includes:
    根据所述物理设备实际需要承载的服务的QoS,分析出所述物理设备实际需要满足的功耗数据和/或性能数据;或者According to the QoS of the service that the physical device actually needs to carry, analyze the power consumption data and/or performance data that the physical device actually needs to meet; or
    获取服务部署用户要求的功耗数据和/或性能数据,作为所述物理设备实际需要满足的功耗数据和/或性能数据。Acquire the power consumption data and/or performance data required by the service deployment user as the power consumption data and/or performance data that the physical device actually needs to meet.
  6. 根据权利要求2所述的方法,其特征在于,在确定所述目标取值组合之后,还包括:The method according to claim 2, wherein after determining the target value combination, the method further comprises:
    利用所述负载测试工具测试出的所述物理设备在所述目标取值组合下的性能数据和功耗数据,对所述性能-功耗预估模型进行修正。The performance data and power consumption data of the physical device under the target value combination tested by the load test tool are used to modify the performance-power consumption prediction model.
  7. 根据权利要求1所述的方法,其特征在于,所述功耗管理机制包括:DVFS,则所述至少一个内核参数包括:处理器能够运行的最低工作频率、处理器能够运行的最高工作频率以及处理器工作频率的调节模式中的至少一个。The method according to claim 1, wherein the power consumption management mechanism comprises: DVFS, and the at least one kernel parameter comprises: the lowest operating frequency at which the processor can run, the highest operating frequency at which the processor can run, and At least one of the adjustment modes of the operating frequency of the processor.
  8. 根据权利要求7所述的方法,其特征在于,所述功耗管理机制还包括:C-state机制,则所述至少一个内核参数还包括:各级别的C模式对应的进入 时间阈值;其中,所述进入时间阈值表示所述物理设备进入相应C模式后至少需要保持的时间。7. The method according to claim 7, wherein the power consumption management mechanism further comprises: a C-state mechanism, and the at least one kernel parameter further comprises: entry time thresholds corresponding to the C mode of each level; wherein, The entry time threshold represents at least the time that the physical device needs to be maintained after entering the corresponding C mode.
  9. 根据权利要求1所述的方法,其特征在于,所述物理设备支持的内核态的功耗管理机制包括:C-state机制,则所述至少一个内核参数包括:各级别的C模式对应的进入时间阈值;其中,所述进入时间阈值表示所述物理设备进入相应C模式后至少需要保持的时间。The method according to claim 1, wherein the power management mechanism of the kernel state supported by the physical device comprises: a C-state mechanism, and the at least one kernel parameter comprises: entry corresponding to each level of C mode Time threshold; wherein, the entry time threshold indicates the time that the physical device needs to be maintained at least after entering the corresponding C mode.
  10. 根据权利要求1-9任一项所述的方法,其特征在于,获取所述物理设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,包括:The method according to any one of claims 1-9, wherein obtaining performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one kernel parameter comprises:
    利用负载测试工具测试所述物理设备在所述多种取值组合中部分取值组合下的性能数据和功耗数据;Using a load test tool to test the performance data and power consumption data of the physical device under partial value combinations among the multiple value combinations;
    根据所述物理设备在所述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型;Performing model training according to the performance data and power consumption data of the physical device under the partial value combination to obtain a performance-power consumption prediction model;
    利用所述性能-功耗预估模型预估所述物理设备在所述多种取值组合中其它取值组合下的性能数据和功耗数据。The performance-power consumption prediction model is used to predict the performance data and power consumption data of the physical device under other value combinations among the multiple value combinations.
  11. 根据权利要求10所述的方法,其特征在于,根据所述物理设备在所述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型,包括:The method according to claim 10, wherein performing model training according to the performance data and power consumption data of the physical device under the partial value combination to obtain the performance-power consumption prediction model comprises:
    对所述物理设备在所述部分取值组合下的性能数据和功耗数据进行回归分析,以得到性能-功耗预估模型。Perform regression analysis on the performance data and power consumption data of the physical device under the partial value combination to obtain a performance-power consumption prediction model.
  12. 根据权利要求11所述的方法,其特征在于,对所述物理设备在所述部分取值组合下的性能数据和功耗数据进行回归分析,以得到性能-功耗预估模型,包括:The method according to claim 11, wherein performing regression analysis on the performance data and power consumption data of the physical device under the partial value combination to obtain a performance-power consumption prediction model comprises:
    将所述部分取值组合作为自变量,将所述物理设备在所述部分取值组合下的性能数据和功耗数据作为因变量进行线性回归分析,得到性能-功耗预估模型。The partial value combination is used as an independent variable, and the performance data and power consumption data of the physical device under the partial value combination are used as dependent variables to perform linear regression analysis to obtain a performance-power consumption prediction model.
  13. 根据权利要求1-9任一项所述的方法,其特征在于,获取所述物理设 备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,包括:The method according to any one of claims 1-9, wherein acquiring the performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one kernel parameter comprises:
    接收模型计算设备发送的所述物理设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据;其中,至少部分取值组合下的性能数据和功耗数据是所述模型计算设备基于性能-功耗预估模型预估出的。Receive performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one kernel parameter sent by the model computing device; wherein, at least part of the performance data and power consumption data under the value combination are all values The model calculation equipment is estimated based on the performance-power consumption estimation model.
  14. 一种数据处理方法,其特征在于,包括:A data processing method, characterized in that it comprises:
    从物理设备的内核参数中,确定与所述物理设备支持的内核态的功耗管理机制相关的至少一个内核参数;From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device;
    利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部分取值组合下的性能数据和功耗数据;Using a load test tool to test the performance data and power consumption data of the physical device under a partial value combination corresponding to the at least one kernel parameter;
    根据所述物理设备在所述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型;Performing model training according to the performance data and power consumption data of the physical device under the partial value combination to obtain a performance-power consumption prediction model;
    利用所述性能-功耗预估模型预估所述物理设备在所述至少一个内核参数对应的其它取值组合下的性能数据和功耗数据。The performance-power consumption prediction model is used to predict the performance data and power consumption data of the physical device under other value combinations corresponding to the at least one core parameter.
  15. 根据权利要求14所述的方法,其特征在于,根据所述物理设备在所述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型,包括:The method according to claim 14, wherein performing model training according to the performance data and power consumption data of the physical device under the partial value combination to obtain the performance-power consumption prediction model comprises:
    对所述物理设备在所述部分取值组合下的性能数据和功耗数据进行回归分析,以得到性能-功耗预估模型。Perform regression analysis on the performance data and power consumption data of the physical device under the partial value combination to obtain a performance-power consumption prediction model.
  16. 根据权利要求15所述的方法,其特征在于,对所述物理设备在所述部分取值组合下的性能数据和功耗数据进行回归分析,以得到性能-功耗预估模型,包括:The method according to claim 15, wherein performing regression analysis on the performance data and power consumption data of the physical device under the partial value combination to obtain a performance-power consumption prediction model comprises:
    将所述部分取值组合作为自变量,将所述物理设备在所述部分取值组合下的性能数据和功耗数据作为因变量进行线性回归分析,得到性能-功耗预估模型。The partial value combination is used as an independent variable, and the performance data and power consumption data of the physical device under the partial value combination are used as dependent variables to perform linear regression analysis to obtain a performance-power consumption prediction model.
  17. 一种数据处理方法,其特征在于,包括:A data processing method, characterized in that it comprises:
    从物理设备的内核参数中,确定与设备性能相关的至少一个内核参数;From the kernel parameters of the physical device, determine at least one kernel parameter related to the performance of the device;
    获取所述物理设备在所述至少一个内核参数对应的多种取值组合下的性能数据,其中,至少部分取值组合下的性能数据是基于性能预估模型预估出的;Acquiring performance data of the physical device under multiple value combinations corresponding to the at least one kernel parameter, where at least part of the performance data under the value combination is estimated based on a performance prediction model;
    根据所述物理设备在所述多种取值组合下的性能数据,确定所述至少一个内核参数对应的目标取值组合;Determine the target value combination corresponding to the at least one kernel parameter according to the performance data of the physical device under the multiple value combinations;
    根据所述目标取值组合对所述至少一个内核参数进行设置,以使所述物理设备按照所述目标取值组合中的取值运行。The at least one kernel parameter is set according to the target value combination, so that the physical device operates according to the value in the target value combination.
  18. 一种数据处理方法,其特征在于,包括:A data processing method, characterized in that it comprises:
    从物理设备的内核参数中,确定与设备性能相关的至少一个内核参数;From the kernel parameters of the physical device, determine at least one kernel parameter related to the performance of the device;
    利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部分取值组合下的性能数据;Using a load test tool to test the performance data of the physical device under the partial value combination corresponding to the at least one kernel parameter;
    根据所述物理设备在所述部分取值组合下的性能数据进行模型训练,以得到性能预估模型;Performing model training according to the performance data of the physical device under the partial value combination to obtain a performance prediction model;
    利用所述性能预估模型预估所述物理设备在所述至少一个内核参数对应的其它取值组合下的性能数据。The performance prediction model is used to predict the performance data of the physical device under other value combinations corresponding to the at least one kernel parameter.
  19. 一种数据处理方法,其特征在于,包括:A data processing method, characterized in that it comprises:
    从物理设备的内核参数中,确定与设备功耗相关的至少一个内核参数;From the kernel parameters of the physical device, determine at least one kernel parameter related to the power consumption of the device;
    获取所述物理设备在所述至少一个内核参数对应的多种取值组合下的功率数据,其中,至少部分取值组合下的功率数据是基于功率预估模型预估出的;Acquiring power data of the physical device under multiple value combinations corresponding to the at least one kernel parameter, where at least part of the power data under the value combination is estimated based on a power estimation model;
    根据所述物理设备在所述多种取值组合下的功率数据,确定所述至少一个内核参数对应的目标取值组合;Determine the target value combination corresponding to the at least one kernel parameter according to the power data of the physical device under the multiple value combinations;
    根据所述目标取值组合对所述至少一个内核参数进行设置,以使所述物理设备按照所述目标取值组合中的取值运行。The at least one kernel parameter is set according to the target value combination, so that the physical device operates according to the value in the target value combination.
  20. 一种数据处理方法,其特征在于,包括:A data processing method, characterized in that it comprises:
    从物理设备的内核参数中,确定与设备功耗相关的至少一个内核参数;From the kernel parameters of the physical device, determine at least one kernel parameter related to the power consumption of the device;
    利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部 分取值组合下的功率数据;Using a load test tool to test the power data of the physical device under the partial value combination corresponding to the at least one kernel parameter;
    根据所述物理设备在所述部分取值组合下的功率数据进行模型训练,以得到功率预估模型;Performing model training according to the power data of the physical device under the partial value combination to obtain a power estimation model;
    利用所述功率预估模型预估所述物理设备在所述至少一个内核参数对应的其它取值组合下的功率数据。Using the power estimation model to predict the power data of the physical device under other value combinations corresponding to the at least one kernel parameter.
  21. 一种数据处理方法,其特征在于,包括:A data processing method, characterized in that it comprises:
    从物理设备的内核参数中,确定与所述物理设备支持的内核态的功耗管理机制相关的至少一个内核参数;From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device;
    利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部分取值组合下的性能数据和功耗数据;Using a load test tool to test the performance data and power consumption data of the physical device under a partial value combination corresponding to the at least one kernel parameter;
    根据所述物理设备在所述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型;Performing model training according to the performance data and power consumption data of the physical device under the partial value combination to obtain a performance-power consumption prediction model;
    利用所述性能-功耗预估模型预估所述物理设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据;其中,所述多种取值组合包括所述部分取值组合。The performance-power consumption estimation model is used to estimate the performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one core parameter; wherein, the multiple value combinations include all Combinations of the values mentioned above.
  22. 一种设备管理系统,其特征在于,包括:至少一台物理设备和至少一台模型计算设备;其中,所述至少一台物理设备分别支持内核态的功耗管理机制;A device management system, characterized by comprising: at least one physical device and at least one model computing device; wherein the at least one physical device respectively supports a kernel-mode power management mechanism;
    所述至少一台模型计算设备,用于从目标设备的内核参数中,确定与所述目标设备支持的内核态的功耗管理机制相关的至少一个内核参数,并基于人工智能模型得到所述目标设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据;所述目标设备是所述至少一台物理设备中的任意一台物理设备;The at least one model computing device is configured to determine from the kernel parameters of the target device at least one kernel parameter related to the power management mechanism of the kernel state supported by the target device, and obtain the target based on the artificial intelligence model Performance data and power consumption data of the device under multiple value combinations corresponding to the at least one kernel parameter; the target device is any one of the at least one physical device;
    所述目标设备,用于根据所述模型计算设备得到的所述目标设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,确定所述至少一个内核参数对应的目标取值组合,并根据所述目标取值组合对所述至少一个内核参数进行设置。The target device is configured to determine that the at least one kernel parameter corresponds to the performance data and power consumption data of the target device under multiple value combinations corresponding to the at least one kernel parameter obtained by the model calculation device The target value combination of, and the at least one kernel parameter is set according to the target value combination.
  23. 根据权利要求19所述的系统,其特征在于,所述模型计算设备具体用于:The system according to claim 19, wherein the model calculation device is specifically used for:
    利用负载测试工具测试所述目标设备在所述至少一个内核参数对应的部分取值组合下的性能数据和功耗数据;Using a load test tool to test the performance data and power consumption data of the target device under a partial value combination corresponding to the at least one kernel parameter;
    根据所述物理设备在所述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型;以及Perform model training according to the performance data and power consumption data of the physical device under the partial value combination to obtain a performance-power consumption prediction model; and
    利用所述性能-功耗预估模型预估所述物理设备在所述至少一个内核参数对应的其它取值组合下的性能数据和功耗数据,以得到所述目标设备在所述物理设备在所述多种取值组合下的性能数据和功耗数据。The performance-power consumption estimation model is used to estimate the performance data and power consumption data of the physical device under other combinations of values corresponding to the at least one core parameter, so as to obtain that the target device is in the physical device Performance data and power consumption data under the multiple value combinations.
  24. 一种数据中心系统,其特征在于,包括:模型计算设备和至少一个机房,所述至少一个机房包括至少一台物理设备,所述至少一台物理设备分别支持内核态的功耗管理机制;A data center system is characterized by comprising: a model computing device and at least one computer room, the at least one computer room includes at least one physical device, and the at least one physical device respectively supports a core-mode power management mechanism;
    所述模型计算设备,用于从目标设备的内核参数中,确定与所述目标设备支持的内核态的功耗管理机制相关的至少一个内核参数,并基于人工智能模型得到所述目标设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据;所述目标设备是所述至少一台物理设备中任意一台物理设备;The model computing device is used to determine from the kernel parameters of the target device at least one kernel parameter related to the power management mechanism of the kernel state supported by the target device, and obtain the target device's location based on the artificial intelligence model. Performance data and power consumption data under multiple value combinations corresponding to the at least one kernel parameter; the target device is any one of the at least one physical device;
    所述目标设备,用于根据所述模型计算设备得到的所述目标设备在所述至少一个内核参数对应的多种取值组合下的性能数据和功耗数据,确定所述至少一个内核参数对应的目标取值组合,并根据所述目标取值组合对所述至少一个内核参数进行设置。The target device is configured to determine that the at least one kernel parameter corresponds to the performance data and power consumption data of the target device under multiple value combinations corresponding to the at least one kernel parameter obtained by the model calculation device The target value combination of, and the at least one kernel parameter is set according to the target value combination.
  25. 一种物理设备,其特征在于,包括:存储器和处理器;A physical device, characterized by comprising: a memory and a processor;
    所述存储器,用于存储计算机程序;The memory is used to store a computer program;
    所述处理器,与所述存储器耦合,用于执行所述计算机程序,以用于:The processor, coupled with the memory, is configured to execute the computer program for:
    从所述物理设备的内核参数中,确定与所述物理设备支持的内核态的功耗管理机制相关的至少一个内核参数;From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device;
    获取所述物理设备在所述至少一个内核参数对应的多种取值组合下的性 能数据和功耗数据,其中,至少部分取值组合下的性能数据和功耗数据是基于性能-功耗预估模型预估出的;Acquire performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one kernel parameter, where at least some of the performance data and power consumption data under the value combination are based on performance-power consumption prediction Estimated by the estimation model;
    根据所述物理设备在所述多种取值组合下的性能数据和功耗数据,确定所述至少一个内核参数对应的目标取值组合;Determine the target value combination corresponding to the at least one kernel parameter according to the performance data and power consumption data of the physical device under the multiple value combinations;
    根据所述目标取值组合对所述至少一个内核参数进行设置,以使所述功耗管理机制按照所述目标取值组合中的取值运行。The at least one kernel parameter is set according to the target value combination, so that the power consumption management mechanism operates according to the value in the target value combination.
  26. 一种模型计算设备,其特征在于,包括:存储器和处理器;A model computing device, which is characterized by comprising: a memory and a processor;
    所述存储器,用于存储计算机程序;The memory is used to store a computer program;
    所述处理器,与所述存储器耦合,用于执行所述计算机程序,以用于:The processor, coupled with the memory, is configured to execute the computer program for:
    从物理设备的内核参数中,确定与所述物理设备支持的内核态的功耗管理机制相关的至少一个内核参数;From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device;
    利用负载测试工具测试所述物理设备在所述至少一个内核参数对应的部分取值组合下的性能数据和功耗数据;Using a load test tool to test the performance data and power consumption data of the physical device under a partial value combination corresponding to the at least one kernel parameter;
    根据所述物理设备在所述部分取值组合下的性能数据和功耗数据进行模型训练,以得到性能-功耗预估模型;Performing model training according to the performance data and power consumption data of the physical device under the partial value combination to obtain a performance-power consumption prediction model;
    利用所述性能-功耗预估模型预估所述物理设备在所述至少一个内核参数对应的其它取值组合下的性能数据和功耗数据。The performance-power consumption prediction model is used to predict the performance data and power consumption data of the physical device under other value combinations corresponding to the at least one core parameter.
  27. 一种存储有计算机程序的计算机存储介质,其特征在于,当所述计算机程序被处理器执行时,致使所述处理器实现权利要求1-21任一项所述方法中的步骤。A computer storage medium storing a computer program, wherein when the computer program is executed by a processor, the processor is caused to implement the steps in the method of any one of claims 1-21.
  28. 一种任务调度方法,其特征在于,包括:A task scheduling method, characterized in that it comprises:
    获取待调度任务以及所述待调度任务的性能要求;Acquiring the task to be scheduled and the performance requirements of the task to be scheduled;
    从至少一个资源设备中,选择满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备;From at least one resource device, select a resource device that meets the performance requirements and the value of the core state power consumption parameter meets the set power consumption requirement;
    将所述待调度任务调度至满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备;Scheduling the to-be-scheduled task to a resource device that meets the performance requirement and the kernel-mode power consumption parameter value meets the set power consumption requirement;
    其中,所述内核态功耗参数值是指与资源设备支持的内核态的功耗管理 机制相关的至少一个内核参数的取值组合。Wherein, the value of the kernel mode power consumption parameter refers to a value combination of at least one kernel parameter related to the kernel mode power consumption management mechanism supported by the resource device.
  29. 根据权利要求28所述的方法,其特征在于,从至少一个资源设备中,选择满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备,包括:The method according to claim 28, characterized in that, from at least one resource device, selecting a resource device that meets the performance requirement and that the value of the core state power consumption parameter meets the set power consumption requirement comprises:
    根据所述至少一个资源设备在各自内核态功耗参数值下的性能数据和功耗数据,选择满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备。According to the performance data and power consumption data of the at least one resource device under the respective core-state power consumption parameter values, a resource device that meets the performance requirements and the core-mode power consumption parameter values meets the set power consumption requirements is selected.
  30. 根据权利要求29所述的方法,其特征在于,根据所述至少一个资源设备在各自内核态功耗参数值下的性能数据和功耗数据,选择满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备,包括:The method according to claim 29, characterized in that, according to the performance data and power consumption data of the at least one resource device under the respective core-state power consumption parameter values, select the core-mode power consumption parameter values that meet the performance requirements Resource equipment that meets the set power consumption requirements, including:
    根据所述至少一个资源设备在各自内核态功耗参数值下的性能数据,选择满足所述性能要求的候选资源设备;Selecting a candidate resource device that meets the performance requirement according to the performance data of the at least one resource device under the respective core state power consumption parameter value;
    根据所述候选资源设备在各自内核态功耗参数值下的功耗数据,从所述候选资源设备中选择功耗数据满足设定功耗要求的资源设备。According to the power consumption data of the candidate resource devices under the respective core state power consumption parameter values, resource devices whose power consumption data meets the set power consumption requirements are selected from the candidate resource devices.
  31. 根据权利要求30所述的方法,其特征在于,根据所述候选资源设备在各自内核态功耗参数值下的功耗数据,从所述候选资源设备中选择功耗数据满足设定功耗要求的资源设备,包括:The method according to claim 30, characterized in that, according to the power consumption data of the candidate resource devices under the respective core state power consumption parameter values, power consumption data is selected from the candidate resource devices to meet the set power consumption requirements The resource equipment, including:
    根据所述候选资源设备在各自内核态功耗参数值下的功耗数据,从所述候选资源设备中选择功耗数据最低的资源设备。According to the power consumption data of the candidate resource devices under the respective core state power consumption parameter values, the resource device with the lowest power consumption data is selected from the candidate resource devices.
  32. 一种任务调度设备,其特征在于,包括:存储器和处理器;A task scheduling device, which is characterized by comprising: a memory and a processor;
    所述存储器,用于存储计算机程序;The memory is used to store a computer program;
    所述处理器,与所述存储器耦合,用于执行所述计算机程序,以用于:The processor, coupled with the memory, is configured to execute the computer program for:
    获取待调度任务以及所述待调度任务的性能要求;Acquiring the task to be scheduled and the performance requirements of the task to be scheduled;
    从至少一个资源设备中,选择满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备;From at least one resource device, select a resource device that meets the performance requirements and the value of the core state power consumption parameter meets the set power consumption requirement;
    将所述待调度任务调度至满足所述性能要求且内核态功耗参数值满足设定功耗要求的资源设备;Scheduling the to-be-scheduled task to a resource device that meets the performance requirement and the core state power consumption parameter value meets the set power consumption requirement;
    其中,所述内核态功耗参数值是指与资源设备支持的内核态的功耗管理机制相关的至少一个内核参数的取值组合。Wherein, the value of the kernel mode power consumption parameter refers to a value combination of at least one kernel parameter related to the kernel mode power consumption management mechanism supported by the resource device.
  33. 一种存储有计算机程序的计算机存储介质,其特征在于,当所述计算机程序被处理器执行时,致使所述处理器实现权利要求28-31任一项所述方法中的步骤。A computer storage medium storing a computer program, wherein when the computer program is executed by a processor, the processor is caused to implement the steps in the method of any one of claims 28-31.
PCT/CN2019/104727 2019-09-06 2019-09-06 Data processing and task scheduling method, device and system, and storage medium WO2021042373A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980095635.5A CN113748398B (en) 2019-09-06 2019-09-06 Data processing and task scheduling method, device, system and storage medium
PCT/CN2019/104727 WO2021042373A1 (en) 2019-09-06 2019-09-06 Data processing and task scheduling method, device and system, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/104727 WO2021042373A1 (en) 2019-09-06 2019-09-06 Data processing and task scheduling method, device and system, and storage medium

Publications (1)

Publication Number Publication Date
WO2021042373A1 true WO2021042373A1 (en) 2021-03-11

Family

ID=74852953

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/104727 WO2021042373A1 (en) 2019-09-06 2019-09-06 Data processing and task scheduling method, device and system, and storage medium

Country Status (2)

Country Link
CN (1) CN113748398B (en)
WO (1) WO2021042373A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114048040A (en) * 2021-11-29 2022-02-15 中南大学 Task scheduling method based on time delay relation between memory and image classification model

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101187831A (en) * 2006-10-24 2008-05-28 国际商业机器公司 Method for autonomous dynamic voltage and frequency scaling of microprocessors and computer system
CN104657219A (en) * 2015-02-27 2015-05-27 西安交通大学 Application program thread count dynamic regulating method used under isomerous many-core system
CN106991030A (en) * 2017-03-01 2017-07-28 北京航空航天大学 A kind of light weight method of the system power dissipation optimization based on on-line study
CN107861606A (en) * 2017-11-21 2018-03-30 北京工业大学 A kind of heterogeneous polynuclear power cap method by coordinating DVFS and duty mapping

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8489745B2 (en) * 2010-02-26 2013-07-16 International Business Machines Corporation Optimizing power consumption by dynamic workload adjustment
US8689220B2 (en) * 2011-11-30 2014-04-01 International Business Machines Corporation Job scheduling to balance energy consumption and schedule performance
CN105243068A (en) * 2014-07-09 2016-01-13 华为技术有限公司 Database system query method, server and energy consumption test system
US9910481B2 (en) * 2015-02-13 2018-03-06 Intel Corporation Performing power management in a multicore processor
CN105577796A (en) * 2015-12-25 2016-05-11 曙光信息产业(北京)有限公司 Cluster power consumption control method and device
US20180095792A1 (en) * 2016-10-05 2018-04-05 Mediatek Inc. Multi-core system including heterogeneous processor cores with different instruction set architectures
CN107656851B (en) * 2017-09-30 2021-01-19 华南理工大学 Cloud server energy consumption measuring and calculating method and system based on component energy consumption model
CN108595301B (en) * 2018-03-26 2021-03-26 中国科学院计算技术研究所 Server energy consumption prediction method and system based on machine learning
CN109840180B (en) * 2018-12-18 2022-07-08 平安科技(深圳)有限公司 Server operation power consumption management method and device and computer readable storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101187831A (en) * 2006-10-24 2008-05-28 国际商业机器公司 Method for autonomous dynamic voltage and frequency scaling of microprocessors and computer system
CN104657219A (en) * 2015-02-27 2015-05-27 西安交通大学 Application program thread count dynamic regulating method used under isomerous many-core system
CN106991030A (en) * 2017-03-01 2017-07-28 北京航空航天大学 A kind of light weight method of the system power dissipation optimization based on on-line study
CN107861606A (en) * 2017-11-21 2018-03-30 北京工业大学 A kind of heterogeneous polynuclear power cap method by coordinating DVFS and duty mapping

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114048040A (en) * 2021-11-29 2022-02-15 中南大学 Task scheduling method based on time delay relation between memory and image classification model
CN114048040B (en) * 2021-11-29 2022-05-13 中南大学 Task scheduling method based on time delay relation between memory and image classification model

Also Published As

Publication number Publication date
CN113748398B (en) 2023-01-17
CN113748398A (en) 2021-12-03

Similar Documents

Publication Publication Date Title
US11009836B2 (en) Apparatus and method for optimizing quantifiable behavior in configurable devices and systems
Ibrahim et al. Governing energy consumption in Hadoop through CPU frequency scaling: An analysis
US10175745B2 (en) Optimizing power consumption by dynamic workload adjustment
US8869158B2 (en) Job scheduling to balance energy consumption and schedule performance
Piraghaj et al. Virtual machine customization and task mapping architecture for efficient allocation of cloud data center resources
CN102103516B (en) Virtual-CPU based frequency and voltage scaling
Imes et al. Energy-efficient application resource scheduling using machine learning classifiers
US20120102503A1 (en) Green computing via event stream management
Luo et al. Simulation of power consumption of cloud data centers
KR101990411B1 (en) System for scaling resource based on priority in cloud system, apparatus and method thereof
US20120254822A1 (en) Processing optimization load adjustment
WO2019085754A1 (en) Application cleaning method and apparatus, and storage medium and electronic device
Wolski et al. QPRED: Using quantile predictions to improve power usage for private clouds
US11537377B2 (en) Method and system for profile based deployments
WO2021042373A1 (en) Data processing and task scheduling method, device and system, and storage medium
CN108574600B (en) Service quality guarantee method for power consumption and resource competition cooperative control of cloud computing server
WO2021046774A1 (en) Resource scheduling method and information prediction method, device, system, and storage medium
Gupta et al. Detecting energy patterns in software development
CN110609747A (en) Information processing method and electronic equipment
CN113728294B (en) Power consumption control and scheme generation method, device, system and storage medium
Wu Analysis of offloading decision making in mobile cloud computing
CN110347546B (en) Dynamic adjustment method, device, medium and electronic equipment for monitoring task
US20140122403A1 (en) Loading prediction method and electronic device using the same
US10884484B2 (en) Extending a battery life of a battery-powered computing device
CN109960572B (en) Equipment resource management method and device and intelligent terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19944134

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19944134

Country of ref document: EP

Kind code of ref document: A1