WO2021042373A1 - Procédé, dispositif et système de traitement de données et de planification de tâches, et support de stockage - Google Patents

Procédé, dispositif et système de traitement de données et de planification de tâches, et support de stockage Download PDF

Info

Publication number
WO2021042373A1
WO2021042373A1 PCT/CN2019/104727 CN2019104727W WO2021042373A1 WO 2021042373 A1 WO2021042373 A1 WO 2021042373A1 CN 2019104727 W CN2019104727 W CN 2019104727W WO 2021042373 A1 WO2021042373 A1 WO 2021042373A1
Authority
WO
WIPO (PCT)
Prior art keywords
power consumption
data
performance
physical device
kernel
Prior art date
Application number
PCT/CN2019/104727
Other languages
English (en)
Chinese (zh)
Inventor
陶原
卢毅军
李栈
宋军
奉有泉
赵旭
陈钢
Original Assignee
阿里巴巴集团控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司 filed Critical 阿里巴巴集团控股有限公司
Priority to CN201980095635.5A priority Critical patent/CN113748398B/zh
Priority to PCT/CN2019/104727 priority patent/WO2021042373A1/fr
Publication of WO2021042373A1 publication Critical patent/WO2021042373A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Definitions

  • This application relates to the field of data processing technology, and in particular to a data processing and task scheduling method, device, system and storage medium.
  • DVFS Dynamic Voltage Frequency Scaling
  • C-mode C-state
  • These power consumption management mechanisms are related to some device parameters, and some device parameters may have multiple values.
  • the power consumption management mechanism can produce different energy-saving effects under different parameter values. How to reasonably set the parameter values of the power consumption management mechanism in an efficient and low-cost manner so that the power consumption management mechanism can produce a better or optimal energy-saving effect is a problem faced by the existing power consumption management mechanism.
  • Various aspects of the present application provide a data processing and task scheduling method, device, system, and storage medium, which are used to efficiently and reasonably set the parameter values of the power consumption management mechanism and reduce costs.
  • An embodiment of the application provides a data processing method, including: determining at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device from the kernel parameters of the physical device; Describe the performance data and power consumption data under multiple value combinations corresponding to at least one core parameter, where at least some of the performance data and power consumption data under the value combination are estimated based on the performance-power consumption prediction model; Determine the target value combination corresponding to the at least one kernel parameter according to the performance data and power consumption data of the physical device under the multiple value combinations; determine the target value combination for the at least one kernel parameter according to the target value combination Setting is made so that the power consumption management mechanism operates according to the value in the target value combination.
  • An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device from the kernel parameters of the physical device; Performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter; perform model training according to the performance data and power consumption data of the physical device under the partial value combination to Obtain a performance-power consumption prediction model; use the performance-power consumption prediction model to predict the performance data and power consumption data of the physical device under other value combinations corresponding to the at least one core parameter.
  • An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to device performance from the kernel parameters of the physical device; and obtaining multiple selections of the physical device corresponding to the at least one kernel parameter.
  • the performance data under the value combination wherein at least part of the performance data under the value combination is estimated based on the performance prediction model; the performance data of the physical device under the multiple value combinations is determined
  • a target value combination corresponding to at least one kernel parameter; the at least one kernel parameter is set according to the target value combination, so that the physical device operates according to the value in the target value combination.
  • An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to device performance from the kernel parameters of the physical device; using a load test tool to test that the physical device corresponds to the at least one kernel parameter The performance data under the partial value combination of the; perform model training according to the performance data of the physical device under the partial value combination to obtain the performance prediction model; use the performance prediction model to predict the physical device Performance data under other value combinations corresponding to the at least one kernel parameter.
  • An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to the power consumption of the device from the kernel parameters of the physical device; and obtaining multiple types of parameters corresponding to the at least one kernel parameter of the physical device.
  • the power data under the value combination wherein at least part of the power data under the value combination is estimated based on the power estimation model; and the power data of the physical device under the multiple value combinations is determined
  • the target value combination corresponding to the at least one kernel parameter; and the at least one kernel parameter is set according to the target value combination, so that the physical device operates according to the value in the target value combination.
  • An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to the power consumption of the device from the kernel parameters of the physical device; using a load test tool to test the physical device in the at least one kernel parameter Corresponding power data under the partial value combination; perform model training according to the power data of the physical device under the partial value combination to obtain a power estimation model; use the power estimation model to estimate the physical Power data of the device under other value combinations corresponding to the at least one kernel parameter.
  • An embodiment of the present application also provides a data processing method, including: determining at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device from the kernel parameters of the physical device; Performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter; perform model training according to the performance data and power consumption data of the physical device under the partial value combination to Obtain a performance-power consumption prediction model; use the performance-power consumption prediction model to predict the performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one core parameter; wherein, The multiple value combinations include the partial value combinations.
  • An embodiment of the present application also provides a device management system, including: at least one physical device and at least one model computing device; wherein the at least one physical device supports a kernel-mode power management mechanism; the at least one A model computing device for determining at least one kernel parameter related to the power management mechanism of the kernel state supported by the target device from the kernel parameters of the target device, and obtaining the target device in the target device based on the artificial intelligence model Performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter; the target device is any one of the at least one physical device; the target device is configured to The performance data and power consumption data of the target device under multiple value combinations corresponding to the at least one kernel parameter obtained by the model computing device determine the target value combination corresponding to the at least one kernel parameter, and according to the The target value combination sets the at least one kernel parameter.
  • An embodiment of the present application further provides a data center system, including: a model computing device and at least one computer room, the at least one computer room includes at least one physical device, and the at least one physical device respectively supports a kernel-mode power management mechanism
  • the model computing device is used to determine from the kernel parameters of the target device at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device, and obtain the target device in the target device based on the artificial intelligence model Performance data and power consumption data under multiple value combinations corresponding to the at least one kernel parameter;
  • the target device is any one of the at least one physical device;
  • the target device is configured to The performance data and power consumption data of the target device under multiple value combinations corresponding to the at least one kernel parameter obtained by the model computing device are determined, and the target value combination corresponding to the at least one kernel parameter is determined, and the target value combination is determined according to the The target value combination sets the at least one kernel parameter.
  • An embodiment of the present application also provides a physical device, including: a memory and a processor; the memory is used for storing a computer program; the processor is coupled with the memory and is used for executing the computer program for : From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the physical device; obtain multiple selections of the physical device corresponding to the at least one kernel parameter The performance data and power consumption data under the value combination, wherein at least part of the performance data and power consumption data under the value combination are estimated based on the performance-power consumption prediction model; according to the physical device in the multiple Determine the target value combination corresponding to the at least one core parameter based on the performance data and power consumption data under the value combination; set the at least one core parameter according to the target value combination to enable the power consumption management The mechanism operates according to the value in the target value combination.
  • An embodiment of the present application also provides a model computing device, including: a memory and a processor; the memory is used to store a computer program; the processor is coupled with the memory and is used to execute the computer program for use In: From the kernel parameters of the physical device, determine at least one kernel parameter related to the power management mechanism of the kernel state supported by the physical device; use a load test tool to test the physical device in the at least one kernel parameter corresponding to the at least one kernel parameter.
  • the performance-power consumption prediction model estimates the performance data and power consumption data of the physical device under other value combinations corresponding to the at least one core parameter.
  • the embodiments of the present application also provide a computer-readable storage medium storing a computer program.
  • the processor When the computer program is executed by a processor, the processor is caused to implement the steps in the various data processing methods provided in the embodiments of the present application. .
  • An embodiment of the present application also provides a task scheduling method, including: obtaining the task to be scheduled and the performance requirements of the task to be scheduled; selecting from at least one resource device that meets the performance requirements and the value of the power consumption parameter in the kernel mode meets the design requirements.
  • a resource device with a fixed power consumption requirement schedule the task to be scheduled to a resource device that meets the performance requirements and the value of the power consumption parameter in the kernel mode meets the set power consumption requirement; wherein the value of the kernel power consumption parameter refers to A value combination of at least one kernel parameter related to the power management mechanism of the kernel mode supported by the resource device.
  • An embodiment of the present application also provides a task scheduling device, including: a memory and a processor; the memory is used to store a computer program; the processor is coupled with the memory and is used to execute the computer program for use
  • the scheduling task is scheduled to the resource device that meets the performance requirements and the core-mode power consumption parameter value meets the set power consumption requirement; wherein the core-mode power consumption parameter value refers to the core-mode power management mechanism supported by the resource device
  • the embodiment of the present application also provides a computer-readable storage medium storing a computer program.
  • the processor When the computer program is executed by a processor, the processor is caused to implement the steps in the task scheduling method provided by the embodiment of the present application.
  • the setting operation of the kernel parameters related to the power management mechanism is combined with artificial intelligence, and the performance-power consumption estimation model trained based on the artificial intelligence obtains a variety of choices corresponding to the kernel parameters of the physical device.
  • the performance data and power consumption data under the value combination, and then, based on the obtained performance data and power consumption data, appropriate values can be set for the kernel parameters, taking into account the power consumption and performance of the physical device, and combining with artificial intelligence , Which can improve the efficiency of parameter setting and reduce costs.
  • FIG. 1 is a schematic structural diagram of a data center system provided by an exemplary embodiment of this application;
  • FIG. 2 is a schematic diagram of the principle of kernel parameter setting of a data center system provided by an exemplary embodiment of this application;
  • FIG. 3 is a schematic diagram of the working principle of a performance-power consumption prediction model provided by an exemplary embodiment of this application;
  • FIG. 4a is a schematic structural diagram of a device management system provided by an exemplary embodiment of this application.
  • FIG. 4b is a schematic structural diagram of an edge cloud network system provided by an exemplary embodiment of this application.
  • FIG. 5a is a schematic flowchart of a data processing method provided by an exemplary embodiment of this application.
  • FIG. 5b is a schematic flowchart of another data processing method provided by an exemplary embodiment of this application.
  • FIG. 6a is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application.
  • FIG. 6b is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application.
  • FIG. 7a is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application.
  • FIG. 7b is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application.
  • FIG. 7c is a schematic flowchart of yet another data processing method provided by an exemplary embodiment of this application.
  • FIG. 7d is a schematic flowchart of a task scheduling method provided by an exemplary embodiment of this application.
  • FIG. 8a is a schematic structural diagram of a physical device provided by an exemplary embodiment of this application.
  • FIG. 8b is a schematic structural diagram of a model computing device provided by an exemplary embodiment of this application.
  • Fig. 8c is a schematic structural diagram of a task scheduling device provided by an exemplary embodiment of this application.
  • the setting operation of the kernel parameters related to the power management mechanism is combined with artificial intelligence, and the performance-power consumption prediction model trained based on artificial intelligence can be obtained
  • the performance data and power consumption data of the physical device under multiple combinations of values corresponding to the kernel parameters.
  • appropriate values can be set for the kernel parameters, taking into account the functions of the physical device. Consumption and performance, combined with artificial intelligence, can improve the efficiency of parameter setting and reduce costs.
  • Fig. 1 is a schematic structural diagram of a data center system provided by an exemplary embodiment of this application.
  • the data center system 100 includes: a model computing device 101 and at least one computer room 102; the at least one computer room 102 includes at least one physical device 103.
  • the machine room 102 refers to a physical place where machinery and equipment are stored, for example, it may be a room or a factory building. This embodiment does not limit the number of physical devices 103 in each computer room 102. Each computer room 102 may include one physical device 103 or multiple physical devices 103. Generally speaking, a computer room 102 will include multiple physical devices 103.
  • the physical device 103 refers to a physical device that has an operating system installed and supports a kernel-mode power management mechanism.
  • the computer room 102 may also contain some devices that do not require an operating system, and some devices that do not support the kernel mode even though the operating system is installed. There are no restrictions on devices with power management mechanisms.
  • the focus is on the physical device 103 that is installed with an operating system and supports a kernel-mode power management mechanism.
  • the device form of the physical device 103 is not limited, and any device form that has an operating system installed and supports a kernel-mode power management mechanism is applicable to the embodiment of the present application.
  • the physical device 103 may be some IT devices installed with an operating system and supporting a kernel-mode power management mechanism, but it is not limited to this.
  • the physical device 103 may include but is not limited to at least one of the following: various server devices, computer devices, and various network switching devices.
  • the server device may include, but is not limited to, a conventional server, a server array, or a cloud server.
  • various applications or services can be run on these physical devices 103, such as cloud computing services, game services, instant messaging services, mail services, or online transaction services.
  • these physical devices 103 may not run any applications or services. Among them, according to whether the physical device 103 runs applications or services, and the type and quantity of running applications or services, the power consumption management mechanism on the physical device 103 will be triggered and play a corresponding role.
  • the operating system is a kind of software that is responsible for controlling the hardware resources of physical devices and providing an environment for upper-level applications to run.
  • the operating system provides two CPU operating states, kernel mode and user mode.
  • User mode is the activity space of upper-level applications.
  • the execution of applications must rely on the resources provided by the operating system, including CPU resources, storage resources, and I/O resources.
  • the power consumption management mechanism of this embodiment is a mechanism provided by the operating system to manage the power consumption of physical devices. It is a power consumption management mechanism at the operating system level and needs to run in the kernel mode, referred to as power consumption in the kernel mode for short. Management mechanism. It is worth noting that the power management mechanisms in the kernel mode supported by different physical devices 103 may be the same or different.
  • the power management mechanism of the kernel mode is related to the operating system. If the operating system of the physical device 103 is different, the power management mechanism of the kernel mode supported by the physical device 103 will also be different. For example, if the physical device 103 adopts the Linux operating system as an example, the power management mechanisms in the kernel state supported by it include, but are not limited to: DVFS and C-state.
  • DVFS is a dynamic technology that dynamically adjusts the operating frequency and voltage of the chip according to the different needs of the application program running on the chip (such as the CPU) for computing power, so as to achieve the purpose of energy saving.
  • the higher the operating frequency the higher the voltage required and the greater the energy consumption.
  • C-state is a low-power mechanism that allows the CPU to enter a low-power state when it is idle.
  • the C-states included in C-states start from C0 to Cn.
  • C0 is the normal operating mode of the CPU, and the CPU is at 100% Running state; the higher the value of n after C, the deeper the CPU sleeps, the lower the power consumption of the CPU, and of course it takes more time to return to the C0 mode; where n is a positive integer.
  • the power management mechanism in the kernel mode is related to some kernel parameters.
  • These kernel parameters are also the parameters of the power management mechanism in the kernel mode.
  • the values of these kernel parameters can affect the energy saving of the power management mechanism in the kernel mode. effect.
  • the kernel parameters generally refer to the parameters in the source code of various operating systems, such as the kernel parameters of the Linux operating system, the kernel parameters of the Windows operating system, the kernel parameters of the UNIX operating system, or the kernel parameters of the MAC operating system.
  • the kernel parameters related to DVFS include but are not limited to: the minimum operating frequency that the CPU can run (denoted as scaling_min_freq), the highest operating frequency that the CPU can run (denoted as scaling_max_freq), and the adjustment mode of the CPU operating frequency (Denoted as scaling_governor); for the physical device 103, the energy saving effect of the DVFS can be changed by adjusting the value of at least one of the three parameters.
  • the kernel parameters related to C-states include, but are not limited to: the entry time threshold corresponding to each level of C mode (denoted as target_residency); where the entry time threshold indicates that the physical device 103 has entered the corresponding C mode at least The time required to stay in this mode is the time condition that the physical device 103 needs to meet to enter the corresponding C mode; for the physical device 103, the difficulty of the CPU entering the corresponding C mode can be changed by adjusting the entry time threshold corresponding to the corresponding C mode. Easy to change the energy-saving effect of the C-states mechanism.
  • the kernel parameters related to it may have multiple values.
  • the maximum operating frequency scaling_max_freq at which the processor can run can be set to 2.4GHZ, 3.6GHZ, and so on.
  • the value of the kernel parameter related to the power management mechanism is different, and the energy saving effect that the power management mechanism can produce will be different.
  • the power consumption of the physical device 103 has a certain relationship with performance. Generally speaking, the lower the power consumption, the worse the performance will be. Therefore, we cannot blindly pursue low power consumption. Ideally, it should be based on application requirements. Balance between power consumption and performance. In different application scenarios, the physical device 103 has different requirements for power consumption and performance.
  • the kernel parameters related to the power management mechanism are system-level parameters and need to be set in the source code of the operating system. Each time the values of these kernel parameters are reset, the operating system needs to be reinstalled, and only when the operating system is running After a certain period of time, it can be judged whether the current value can meet the requirements of the device for power consumption and performance, and whether it needs to be adjusted again. If there are many kernel parameters related to the power management mechanism, the number of value combinations of these kernel parameters will also be larger. If a trial method is adopted to select the best value combination, it will take a long time.
  • the kernel parameter setting operation is combined with artificial intelligence, and based on the artificial intelligence model, the performance data and functions of the physical device 103 under various value combinations corresponding to the relevant kernel parameters are obtained.
  • the kernel parameter settings can not only set appropriate values for the kernel parameters, but also At the same time, it takes into account the requirements of the physical device 103 for power consumption and performance, and the combination with artificial intelligence can improve the efficiency of parameter setting and reduce the cost.
  • a model computing device 101 is added, which is mainly responsible for obtaining the performance data and power consumption data of the physical device 103 under various value combinations corresponding to related kernel parameters.
  • the model computing device 101 for each physical device 103, at least one kernel parameter related to the power management mechanism of the kernel state supported by the physical device 103 can be determined from the kernel parameters of the physical device 103, based on artificial intelligence
  • the model provides the physical device 103 with its performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter, so that the physical device 103 can complete the setting of related kernel parameters accordingly.
  • the model computing device 101 may be set in a certain computer room 102, or be independent of each computer room 102, and be set separately in a certain place, for example, it may be set in the cloud.
  • this embodiment does not limit the device form of the model computing device 101, and may be any computing device with certain computing capabilities and communication capabilities.
  • the model computing device 101 may be a conventional server, a cloud server, a server with a GPU, a server with a specific Ai chip, or a server array, etc.
  • the model computing device 101 may communicate with each physical device 103. After obtaining the performance data and power consumption data of each physical device 103 under multiple value combinations corresponding to the relevant kernel parameters, it may be based on The communication connection between it and each physical device 103 provides each physical device 103 with its performance data and power consumption data under a variety of value combinations corresponding to related kernel parameters. Wherein, the model computing device 101 and each physical device 103 may be wirelessly or wiredly connected. Optionally, the physical device 103 can communicate with the model computing device 101 via a mobile network.
  • the network standard of the mobile network can be 2G (GSM), 2.5G (GPRS), 3G (WCDMA, TD-SCDMA, CDMA2000, UTMS), 4G (LTE), 4G+ (LTE+), 5G, WiMax or coming soon in the future Any of the new network standards, etc.
  • the physical device 103 can also communicate with the model computing device 101 through Bluetooth, WiFi, infrared, zigbee, or NFC.
  • model computing device 101 does not have to establish a communication connection with the physical device 103.
  • some mobile storage devices such as mobile hard disks and U disks can also be used to combine the physical device 103 under various combinations of values corresponding to the relevant kernel parameters.
  • the performance data and power consumption data are copied from the model computing device 101 to the physical device 103.
  • this embodiment takes any physical device 103 as an example, and uses the flowchart shown in FIG. 2 to describe the working principle of the system.
  • the target device is used as an example in the following content to expand the description, and the target device represents any physical device 103.
  • the newly added physical device can be used as the target device.
  • the source code of the operating system can be modified according to the application requirements of the target device. Kernel parameters related to the power management mechanism are set, and the operating system is installed on the target device according to the operating system source code after the parameter setting.
  • the load information such as an application or service
  • the operating system source code and power consumption can be re-modified.
  • the value of the kernel parameter related to the management mechanism, and the operating system is reinstalled for the target device according to the modified operating system source code.
  • the equipment rented and sold to the customer can be used as the target equipment.
  • the target can be set according to the customer’s requirements.
  • the device installs the operating system and sets the kernel parameters related to the power management mechanism in the operating system source code before installing the operating system.
  • the model computing device 101 can determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device from the kernel parameters of the target device.
  • the number of core parameters can be one or more, depending on the power management mechanism.
  • the model computing device 101 may have human-computer interaction capabilities, and may perform human-computer interaction with the administrator of the data center system 100 to determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device .
  • the model computing device 101 can provide a human-computer interaction interface or a command window, and the administrator can input the target device identification and the kernel mode power management mechanism supported by the target device to the model computing device 101 through the human-computer interaction interface or command window.
  • the model computing device 101 determines from the kernel parameters of the target device, at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device.
  • the administrator can input the identification of the target device and the information of the power management mechanism in the kernel mode supported by the target device into the model computing device 101 by voice; the model computing device 101 according to With this information, from the kernel parameters of the target device, at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device is determined.
  • the administrator can also directly input to the model computing device 101 the identification of at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device, such as the parameter name.
  • the model computing device 101 may collect the performance data and power consumption data of the target device under the partial value combination corresponding to the at least one kernel parameter, As sample data, and use these sample data for model training to obtain a performance-power consumption prediction model, as shown in Figure 2.
  • the performance data of the target device will be different according to different services or applications running on the target device.
  • Performance data mainly refers to some data that can reflect the capacity of the target device to undertake the service and guarantee the service. For example, it can be the actually achieved QoS, QPS, TPS, or response time to the request of the service on the target device, and so on.
  • one value combination includes one value; if the number of at least one kernel parameter is more than one, then one value combination includes multiple kernel parameters one by one. Corresponding multiple values, and the multiple values included in different value combinations are not completely the same.
  • the model computing device 101 can use a load test tool to collect performance data and power consumption data of the target device under a partial value combination corresponding to at least one kernel parameter. Install and run the load test tool on the target device.
  • the load test tool can simulate the performance data and power consumption data of the target device under different load conditions.
  • the load test tool is used to obtain the performance data and power consumption data of the target device when the value combination meets the corresponding requirements.
  • the performance data and power consumption data when the corresponding requirements are met under the partial value combination are provided to the model computing device 101.
  • the performance data and power consumption data of the target device when it meets the corresponding requirements under each value combination are referred to as the performance data and power consumption data of the target device under each value combination for short.
  • the process of using the load test tool to obtain the performance data and power consumption data of the target device under the value combination includes: for the value combination, first operate The value of at least one kernel parameter in the system source code is modified to the value in the value combination, and the operating system is installed on the target device according to the modified operating system source code; after the operating system is successfully installed, on the target device Install the load test tool, and use the load test tool to simulate the corresponding load condition and obtain the performance data and power consumption data of the target device under the corresponding load according to the load, power consumption and/or performance requirements that the target device should meet.
  • load testing tools are not limited, and can be flexibly selected according to application requirements, operating system types, and the like.
  • this embodiment lists several load testing tools: Stream testing tool for memory performance testing; Specjbb testing tool for testing CPU performance; Speccpu testing tool for testing CPU performance; Fio testing tool for testing disks IO performance; Sysbench testing tool for testing mysql database performance, etc.
  • a power consumption collection tool such as a fuel gauge can be used to collect power consumption data of the physical device during the testing process.
  • the relevant performance parameters tested by the load test tool and the power consumption data collected by the power consumption collection tool during the test are the performance data and power consumption data of the physical device 103 when it meets the corresponding requirements under a certain combination of values. .
  • the model computing device 101 After obtaining the performance data and power consumption data of the target device under the partial value combination corresponding to at least one kernel parameter, the model computing device 101 uses these data as sample data for model training.
  • the process of model training performed by the model computing device 101 is not limited. For example, it can be a model training process based on a deep neural network, or a model training process based on regression analysis, where at least one kernel parameter can be analyzed.
  • the model training method of the association relationship between the value combination of and the performance data and power consumption data of the target device is applicable to the embodiments of the present application.
  • regression analysis is a statistical analysis method to determine the quantitative relationship between two or more variables, and it is a predictive modeling technique.
  • the model computing device 101 may adopt a modeling method based on regression analysis. Based on this, the process of model training performed by the model computing device 101 is actually a process of performing regression analysis on the performance data and power consumption data of the target device under the partial value combination corresponding to at least one kernel parameter. After regression analysis, at least one The correlation between the value combination corresponding to the kernel parameter and the performance data and power consumption data of the target device is the performance-power consumption prediction model.
  • regression analysis includes linear regression analysis and logistic regression analysis.
  • linear regression analysis is preferred for modeling.
  • the process of model training performed by the model computing device 101 includes: taking partial value combinations corresponding to at least one kernel parameter as an independent variable, and taking the performance data and power consumption data of the target device under the partial value combination as the dependent variable for linearization.
  • the performance-power consumption prediction model is obtained.
  • the performance-power consumption prediction model obtained by this optional embodiment is a linear regression model.
  • the model computing device 101 may use the performance-power consumption prediction model to predict the performance of the target device under other value combinations corresponding to at least one core parameter. Data and power consumption data are shown in Figure 2. Compared with the method of using the load test tool to test, using the performance-power estimation model to estimate the performance data and power consumption data of the target device under other value combinations is much faster and can save a lot of time and cost.
  • the performance data and power consumption data of the target device under other value combinations corresponding to at least one core parameter estimated by the performance-power consumption prediction model are combined with the target device tested by the load test tool in at least one core
  • the performance data and power consumption data under the partial value combinations corresponding to the parameters can obtain the performance data and power consumption data of the target device under multiple value combinations corresponding to at least one core parameter.
  • the “multiple value combinations” here can be all value combinations of at least one kernel parameter, or part of all value combinations of at least one kernel parameter. Regardless of whether “multiple value combinations" are all value combinations of at least one kernel parameter or partial value combinations, “multiple value combinations” include the above “partial value combinations" and "other value combinations”. or,
  • the model computing device 101 may use the performance-power consumption prediction model to estimate that the target device is under multiple value combinations corresponding to at least one kernel parameter Performance data and power consumption data.
  • the “multiple value combinations” here can be all value combinations of at least one kernel parameter, or part of all value combinations of at least one kernel parameter. Regardless of whether “multiple value combinations" are all value combinations of at least one kernel parameter or partial value combinations, “multiple value combinations” include the above “partial value combinations" and "other value combinations”.
  • the model computing device 101 can actively place the target device in at least one core based on the communication connection between it and the target device.
  • the performance data and power consumption data under multiple value combinations corresponding to the parameters are sent to the target device, or, according to the request of the target device, the performance data of the target device under multiple value combinations corresponding to at least one kernel parameter
  • power consumption data are sent to the target device, or the target device can also actively download its performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter to the model computing device 101; or it can also be related
  • the personnel sends the performance data and power consumption data of the target device under multiple value combinations corresponding to at least one kernel parameter to the target device through a mobile storage device and copies them from the model computing device 101 to the target device.
  • the embodiment of the present application does not limit the specific manner in which the target device obtains its performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter.
  • the performance data and power consumption data under multiple value combinations corresponding to at least one core parameter can be obtained, and during the parameter setting process, the multiple values corresponding to at least one core parameter can be used
  • a target value combination corresponding to at least one core parameter is determined, and at least one core parameter is set according to the target value combination.
  • the process of setting at least one kernel parameter according to the target value combination includes: modifying the value of at least one kernel parameter related to the power consumption management mechanism in the operating system source code to the value in the target value combination, and then,
  • the operating system can also be installed on the physical device according to the modified operating system source code.
  • installing the operating system on the physical device according to the modified operating system source code includes: compiling the modified operating system source code to obtain an installation file of the operating system, and running the installation file to complete the installation of the operating system.
  • the specific implementation of determining the target value combination corresponding to at least one core parameter based on the performance data and power consumption data of the target device under multiple value combinations corresponding to at least one core parameter is not limited. the way.
  • the target value combination can be directly determined from the multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations.
  • the power consumption data and/or performance data that the target device actually needs to meet can be obtained; the power consumption data and/or performance data that the target device actually needs to meet can be combined with the target device in multiple values Match the performance data and power consumption data under the following; according to the actual power consumption data and/or performance data that the target device needs to meet with the performance data and power consumption data of the target device under multiple value combinations, from Among the multiple value combinations, a value combination that meets the matching degree requirement is selected as the target value combination.
  • At least one candidate value combination can be selected from multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations; the load test tool is used to test the target device Performance data and power consumption data under at least one candidate value combination; further, according to the performance data and power consumption data of the target device under at least one candidate value combination tested by the load test tool, from at least one candidate value combination Determine the target value combination in the value combination.
  • the load test tool in addition to the performance data and power consumption data of the target device under multiple value combinations, is also combined to improve the accuracy of the final selected target value combination, and is beneficial to Improve the accuracy of parameter settings.
  • the target device in the process of selecting at least one candidate value combination from multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations, can be directly selected according to the target value combination.
  • at least one candidate value combination is selected from the multiple value combinations.
  • the power consumption data and/or performance data that the target device actually needs to meet can be analyzed according to the QoS of the service that the target device actually needs to carry.
  • each service has its own set of standards to measure its own service performance, such as how long it takes for a request to read the database to get a response is acceptable.
  • the power consumption data and/or performance data required by the service deployment user may also be obtained as the power consumption data and/or performance data that the target device actually needs to meet.
  • Service deployment users refer to users who need to deploy services on target devices. Service deployment users have certain requirements for the services they deploy, such as requiring performance to meet a certain standard, or requiring power consumption not to exceed a certain power threshold, etc. Obtain the power consumption data that the target device actually needs to meet from the power consumption requirements, or obtain the performance data that the target device actually needs to meet from the performance requirements.
  • the target device can obtain the power consumption data that it actually needs to meet, and compare the power consumption data that the target device actually needs to meet with the performance data and power consumption data of the target device under a combination of multiple values corresponding to at least one core parameter. Perform matching; from a variety of value combinations, obtain a value combination that has a matching degree with the power consumption data that the target device actually needs to meet and meets the matching degree requirement as a candidate value combination.
  • the power consumption requirements of the target device can be given priority according to application requirements, and the kernel parameters related to the power consumption management mechanism can be set to make the target device meet the power consumption requirements.
  • the target device can obtain the performance data that it actually needs to meet, and compare the performance data that the target device actually needs to meet with the performance data and power consumption data of the target device under multiple combinations of values corresponding to at least one kernel parameter. Matching: From a variety of value combinations, obtain a value combination that has a matching degree with the performance data that the target device actually needs to meet and meets the matching degree requirement as a candidate value combination.
  • the performance requirements of the target device can be prioritized according to application requirements.
  • the target device can meet the power consumption requirements by converting energy consumption to performance.
  • the target device can obtain the power consumption data and performance data that it actually needs to meet, and combine the performance data and power consumption data that the target device actually needs to meet with the target device under a combination of multiple values corresponding to at least one kernel parameter
  • the performance data and power consumption data are matched; from a variety of value combinations, the value combination that meets the matching degree requirements of the power consumption data and the performance data that the target device actually needs to meet is obtained as the candidate value combination.
  • the power consumption and performance requirements of the target device can be considered at the same time, and the power consumption and performance can be taken into consideration by setting the kernel parameters related to the power consumption management mechanism.
  • using a load test tool to test the performance data and power consumption data of the target device under at least one candidate value combination is to use the load test tool to test the performance data of the target device under each candidate value combination. And the process of power consumption data.
  • the process of using a load test tool to test the performance data and power consumption data of the target device under the first candidate value combination includes: modifying the value of at least one kernel parameter in the source code of the operating system For the value in the first candidate value combination, install the operating system on the target device according to the modified operating system source code; run the load test tool on the target device to test the target device under the first candidate value combination Performance data and power consumption data.
  • the first candidate value combination is any one of at least one candidate value combination.
  • the performance data and power consumption data of the target device under the target value combination tested by the load test tool can be used to determine the performance -The power consumption estimation model is revised.
  • the performance data and power consumption data of the target device tested by the load test tool under the target value combination are more in line with the actual requirements, which are used as sample data to modify the performance-power consumption prediction model, which is conducive to improving the performance-power
  • the accuracy of the consumption estimation model makes the estimated performance data and power consumption data more in line with actual requirements.
  • the kernel mode power management mechanism supported by the target device may include: DVFS, then at least one kernel related to DVFS
  • the parameters include: at least one of the lowest operating frequency at which the CPU can run, the highest operating frequency at which the CPU can run, and an adjustment mode of the CPU operating frequency.
  • the model computing device 101 can use the load test tool to test the performance data and power consumption data of the target device under the partial value combination corresponding to these three parameters, and use the target device to test the performance data and power consumption data of the three parameters.
  • the kernel mode power management mechanism supported by the target device includes in addition to DVFS, it can also include: C-state, C-state contains 3 -11 levels of C mode, each level of C mode has its own corresponding entry time threshold. Based on this, at least one kernel parameter not only includes the above three parameters related to DVFS, but also includes the entry time threshold corresponding to the C mode of each level under the C-state.
  • At least one kernel parameter includes the entry time threshold corresponding to the 6 levels of C mode, plus the above 3 parameters required by DVFS, for a total of 9 parameters , Specifically: scaling_min_freq, scaling_max_freq, scaling_governor, Target_residency: C1, Target_residency: C2, Target_residency: C3, Target_residency: C4, Target_residency: C5, and Target_residency: C6.
  • the model computing device 101 can use the load test tool to test the performance data and power consumption data of the target device under the partial value combination corresponding to these 9 parameters, and use the target device to test the performance data and power consumption data of the 9 parameters.
  • Perform model training on the performance data and power consumption data under the corresponding partial value combination to obtain the performance-power consumption estimation model, and then estimate the target device's other values corresponding to these 9 parameters based on the performance-power consumption estimation model Combine the performance data and power consumption data to obtain the performance data and power consumption data of the target device under various value combinations corresponding to these 9 parameters, as shown in Figure 3.
  • the target device can set these 9 parameters based on its performance data and power consumption data under various value combinations corresponding to these 9 parameters.
  • the core state power management mechanism supported by the target device may include DVFS alone, or both DVFS and C-state, or C-state alone.
  • at least one kernel parameter related to the power management mechanism includes: the entry time threshold corresponding to each level of the C mode. If the C-state includes 11 levels of C mode, at least one kernel parameter includes the entry time threshold corresponding to the 11 levels of C mode, for a total of 11 parameters.
  • the model computing device 101 can use the load test tool to test the performance data and power consumption data of the target device under the partial value combinations corresponding to these 11 parameters, and use the performance data of the target device under the partial value combinations corresponding to these 11 parameters.
  • the model computing device 101 can combine the setting operation of the kernel parameters related to the power management mechanism with artificial intelligence, and train the performance-power consumption prediction based on artificial intelligence. Based on the performance-power estimation model, the performance data and power consumption data of the physical device under multiple value combinations corresponding to the relevant kernel parameters are obtained, so that the physical device can use its performance under multiple value combinations Based on the data and power consumption data, the relevant kernel parameters can be set, and appropriate values can be set for the relevant kernel parameters, taking into account the power consumption and performance of the physical device, and the combination of artificial intelligence can improve the efficiency of parameter setting and reduce the cost .
  • the performance-power estimation model is trained by considering the two aspects of power consumption and performance, but not Limited to this.
  • the model computing device 101 can also use In a similar way, the performance prediction model is trained, and the physical device 103 is provided with its performance data under multiple value combinations corresponding to the device performance-related kernel parameters, so that the physical device 103 can use the device performance-related kernel accordingly.
  • the parameters are set.
  • At least one kernel parameter related to the device performance can be determined from the kernel parameters of the physical device; the load test tool is used to test the performance data of the target device under the partial value combination corresponding to the at least one kernel parameter ; Perform model training according to the performance data of the target device under some value combinations to obtain a performance prediction model; use the performance prediction model to predict the performance data of the target device under other value combinations corresponding to at least one kernel parameter.
  • At least one kernel parameter related to device performance can be determined from its kernel parameters; its performance data under multiple value combinations corresponding to at least one kernel parameter can be obtained from the model computing device 101; Determine the target value combination corresponding to at least one kernel parameter from the performance data under multiple value combinations; set at least one kernel parameter according to the target value combination to operate according to the value in the target value combination.
  • the detailed implementation manners or alternative implementation manners of related descriptions can be referred to the foregoing embodiments, and details are not described herein again.
  • the power consumption of the device may be focused on, and the performance requirements of the device are not high or not required. It is necessary to set reasonable values for the kernel parameters related to the power consumption of the device; for this reason, the model computing device 101 also
  • the power consumption estimation model can be trained in a similar manner, and the physical device 103 can be provided with its power consumption data under various combinations of values corresponding to the kernel parameters related to the power consumption of the device, so that the physical device 103 can respond accordingly. Kernel parameters related to device performance are set.
  • At least one kernel parameter related to the power consumption of the device can be determined from the kernel parameters of the physical device; the load test tool is used to test the target device under the partial value combination corresponding to the at least one kernel parameter.
  • the power consumption data of the target device perform model training according to the power consumption data of the target device under partial value combinations to obtain the power consumption estimation model; use the power consumption estimation model to estimate the target device's other corresponding to the at least one core Power consumption data under the combination of values.
  • At least one kernel parameter related to the power consumption of the device can be determined from its kernel parameters; the power consumption of the at least one kernel parameter corresponding to multiple value combinations can be obtained from the model computing device 101 Data; determine the target value combination corresponding to at least one core parameter according to its power consumption data under multiple value combinations; set at least one core parameter according to the target value combination to follow the target value combination Value running.
  • the detailed implementation manners or alternative implementation manners of related descriptions can be referred to the foregoing embodiments, and details are not described herein again.
  • a data center system is taken as an example for description, but the solution of combining the kernel parameter setting operation with artificial intelligence provided in the embodiments of the present application is not limited to the data center system.
  • the scheme of combining the kernel parameter setting operation with artificial intelligence provided in the embodiment of the application can be extended to any system or device that needs to set the kernel parameter of the device.
  • Fig. 4a is a schematic structural diagram of a device management system provided by an exemplary embodiment of this application.
  • the device management system 400 includes: at least one physical device 401 and at least one model computing device 402. This embodiment does not limit the number of physical devices 401, and it may be one or multiple. Similarly, this embodiment does not limit the number of model computing devices 402, and it may be one or multiple.
  • the physical device 401 may include, but is not limited to, at least one of the following device forms: server devices, computer devices, desktop computers, notebook computers, smart phones, tablet computers, network switching devices, and the like.
  • the server device may include, but is not limited to, a conventional server, a server array, or a cloud server.
  • the model computing device 402 may be a server device such as a conventional server, a cloud server, or a server array.
  • the device form and quantity of the physical device 401 and the model computing device 402 shown in FIG. 4a are only examples and are not limited thereto.
  • At least one physical device 401 refers to a physical device installed with an operating system and supporting a kernel-mode power management mechanism. It should be noted that, in addition to the physical device 401 that is installed with an operating system and supports the kernel-mode power management mechanism, the device management system 400 may also include some devices that do not require an operating system, and some devices that are installed with an operating system but do not support There is no restriction on the devices with the power management mechanism in the kernel mode. In this embodiment and other embodiments, the focus is on the physical device 401 that is installed with an operating system and supports a kernel-mode power management mechanism.
  • the power management mechanism in the kernel mode supported by the physical device 401 is related to some kernel parameters, and these kernel parameters generally have multiple values.
  • the different values of the kernel parameters result in different energy-saving effects in the power management mechanism.
  • the kernel parameter setting operation is combined with artificial intelligence, and the artificial intelligence model is used as the basis to obtain The performance data and power consumption data of the physical device 401 under multiple value combinations corresponding to the relevant kernel parameters, and further, based on the performance data and power consumption data of the physical device 401 under multiple value combinations corresponding to the relevant kernel parameters ,
  • the kernel parameter setting can not only set the appropriate value for the kernel parameter, but also take into account the power consumption and performance requirements of the physical device 401 at the same time, and the combination of artificial intelligence can improve the parameter setting efficiency and reduce the cost.
  • At least one model computing device 402 is mainly used to: for each physical device 401, determine from the kernel parameters of the physical device 401 related to the power management mechanism of the kernel state supported by the physical device 401 At least one kernel parameter, based on the artificial intelligence model, provides the physical device 401 with its performance data and power consumption data under multiple value combinations corresponding to at least one kernel parameter, so that the physical device 401 can complete the relevant kernel parameter Set up.
  • this embodiment takes any physical device 401 as an example, and records any physical device 401 as a target device to describe the detailed working principle of the system.
  • the model computing device 402 may determine at least one kernel parameter related to the power management mechanism of the kernel mode supported by the target device from the kernel parameters of the target device. After that, the model computing device 402 can collect the performance data and power consumption data of the target device under the partial value combination corresponding to at least one core parameter as sample data, and use these sample data for model training to obtain the performance-power consumption estimate model.
  • the model computing device 402 may use a load test tool to collect performance data and power consumption data of the target device under a partial value combination corresponding to at least one kernel parameter. Install and run the load test tool on the target device.
  • the load test tool can simulate the performance data and power consumption data of the target device under different load conditions.
  • the load test tool is used to obtain the performance data and power consumption data of the target device when the value combination meets the corresponding requirements.
  • the performance data and power consumption data when the corresponding requirements are met under the partial value combination are provided to the model computing device 402.
  • the performance data and power consumption data of the target device when it meets the corresponding requirements under each value combination are referred to as the performance data and power consumption data of the target device under each value combination for short.
  • the process of using the load test tool to obtain the performance data and power consumption data of the target device under the value combination includes: for the value combination, first operate The value of at least one kernel parameter in the system source code is modified to the value in the value combination, and the operating system is installed on the target device according to the modified operating system source code; after the operating system is successfully installed, on the target device Install the load test tool, and use the load test tool to simulate the corresponding load condition and obtain the performance data and power consumption data of the target device under the corresponding load according to the load, power consumption and/or performance requirements that the target device should meet.
  • the model computing device 402 After obtaining the performance data and power consumption data of the target device under the partial value combination corresponding to at least one kernel parameter, the model computing device 402 uses these data as sample data for model training.
  • the process of model training performed by the model computing device 402 is not limited. For example, it can be a model training process based on a deep neural network, or a model training process based on regression analysis, where at least one kernel parameter can be analyzed.
  • the model training method of the association relationship between the value combination of and the performance data and power consumption data of the target device is applicable to the embodiments of the present application.
  • the model computing device 402 may adopt a regression analysis-based modeling method, that is, perform regression analysis on the performance data and power consumption data of the target device under a combination of partial values corresponding to at least one kernel parameter. Regression analysis can obtain the correlation between the value combination corresponding to at least one kernel parameter and the performance data and power consumption data of the target device, that is, the performance-power consumption prediction model.
  • the process of model training by the model computing device 402 includes: taking the partial value combination corresponding to at least one kernel parameter as an independent variable, and using the performance data and power consumption data of the target device under the partial value combination as the dependent variable to perform linearization. Regression analysis, the performance-power consumption prediction model is obtained.
  • the model calculation device 402 can use the performance-power consumption prediction model to predict the performance of the target device under other value combinations corresponding to at least one core parameter. Data and power consumption data. Or, after obtaining the performance-power consumption prediction model, the model computing device 101 may use the performance-power consumption prediction model to estimate the performance data and power consumption data of the target device under multiple value combinations corresponding to at least one core parameter .
  • the performance data and power consumption data under multiple value combinations corresponding to at least one core parameter can be obtained, and during the parameter setting process, the multiple values corresponding to at least one core parameter can be used
  • a target value combination corresponding to at least one core parameter is determined, and at least one core parameter is set according to the target value combination.
  • the process of setting at least one kernel parameter according to the target value combination includes: modifying the value of at least one kernel parameter related to the power consumption management mechanism in the operating system source code to the value in the target value combination, and then,
  • the operating system can also be installed on the physical device according to the modified operating system source code.
  • installing the operating system on the physical device according to the modified operating system source code includes: compiling the modified operating system source code to obtain an installation file of the operating system, and running the installation file to complete the installation of the operating system.
  • an implementation manner of determining the target value combination corresponding to at least one kernel parameter includes: directly determining from the multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations Get the target value combination.
  • another implementation manner for determining the target value combination corresponding to at least one kernel parameter includes: obtaining power consumption data and/or performance data that the target device actually needs to meet; and comparing the power consumption data and/or performance data that the target device actually needs to meet Or performance data to match the performance data and power consumption data of the target device under multiple value combinations; according to the power consumption data and/or performance data that the target device actually needs to meet with the target device under multiple value combinations For the matching degree between the performance data and the power consumption data, a value combination that meets the matching degree requirement is selected from the multiple value combinations as the target value combination.
  • another implementation manner of determining the target value combination corresponding to at least one kernel parameter includes: selecting at least one of the multiple value combinations according to the performance data and power consumption data of the target device under multiple value combinations A combination of candidate values; using a load test tool to test the performance data and power consumption data of the target device under at least one combination of candidate values; further, the target device tested according to the load test tool under at least one combination of candidate values Determine the target value combination from at least one candidate value combination based on the performance data and power consumption data.
  • the load test tool is also combined to help improve the accuracy of the final selected target value combination, which is beneficial to Improve the accuracy of parameter settings.
  • the power consumption data that the target device actually needs to meet can be combined, or the performance data that the target device actually needs to meet, or the power consumption data that the target device actually needs to meet at the same time.
  • performance data For example, the power consumption data that the target device actually needs to meet can be obtained, and the power consumption data and/or performance data that the target device actually needs to meet can be combined with the performance data of the target device under a combination of multiple values corresponding to at least one kernel parameter.
  • the performance data and power consumption data of the target device under the target value combination tested by the load test tool can be used to evaluate the performance-power consumption prediction model Make corrections.
  • the performance data and power consumption data of the target device tested by the load test tool under the target value combination are more in line with the actual requirements, which are used as sample data to modify the performance-power consumption prediction model, which is conducive to improving the performance-power
  • the accuracy of the consumption estimation model makes the estimated performance data and power consumption data more in line with actual requirements.
  • model computing device 402 For the related description of the model computing device 402, please refer to the related description of the model computing device 101 in the foregoing embodiment. Similarly, for the related description of the target device, please refer to the corresponding description in the foregoing embodiment, which will not be repeated here.
  • the device management system 400 of this embodiment can be implemented as a system of any form or nature, for example, it can be a data center, or a cluster, or a computer room system, or an edge cloud network system, or a central cloud network system, etc.
  • the embodiment does not limit this.
  • the device management system 400 is implemented as an edge cloud network system as an example for illustration.
  • the edge cloud network system includes: edge computing nodes and servers deployed in the cloud or in the client room.
  • the server communicates with the edge computing node through the network.
  • the server can respond to the request of the edge computing node and provide related cloud services for the edge computing node; in addition, the server can also control, operate and maintain the edge computing node.
  • Edge computing nodes include hardware infrastructure, hardware infrastructure drivers, operating systems, and related applications.
  • the hardware infrastructure includes but is not limited to: CPU, network card, memory, etc.
  • Edge computing nodes may include: base stations, home gateways, personal computers, smart phones, street lights, traffic lights, and/or electronic monitoring equipment on buildings that are added to the edge cloud network.
  • the server can have the functions of the model computing device 402 in Figure 4a.
  • another server dedicated to model training can also be deployed (used to implement the model computing device 402 in Figure 4a).
  • the function of the edge computing node can be used as the physical device 401 in Figure 4a.
  • the edge cloud node supports two mechanisms, DFVS and C-state, and C-state has 6 levels of C modes.
  • the kernel parameters related to DFVS and C-state include: scaling_min_freq, scaling_max_freq, scaling_governor, C1-C6 levels
  • the corresponding target_residency has 9 parameters.
  • edge computing node Before the edge computing node provides services to customers, it is necessary to install the operating system on the edge computing node for the customer, and set the kernel parameters related to DFVS and C-state in the edge computing node, so that the edge computing node can work in the optimal parameter combination To achieve the goal of balancing performance and power consumption.
  • the server can use the load test tool to test the performance data and power consumption data of the edge computing node under the partial value combination corresponding to the above 9 parameters, and use the edge computing node to select the partial value combination corresponding to the 9 parameters.
  • the edge computing node receives its performance data and power consumption data under various value combinations corresponding to these 9 parameters issued by the server, and uses its performance data under various value combinations corresponding to these 9 parameters and Based on the power consumption data, these 9 parameters are set so that the edge computing node can work under the optimal parameter combination after startup, and reduce power consumption as much as possible while ensuring performance.
  • FIG. 5a is a schematic flowchart of a data processing method provided by an exemplary embodiment of this application. This data processing method can be used to set the kernel parameters of the physical device. As shown in Figure 5a, the method includes:
  • the execution subject of this embodiment may be a physical device, and the physical device runs an operating system and supports a kernel-mode power management mechanism.
  • the physical device can adjust or manage the kernel power management mechanism through some kernel parameters, and these kernel parameters are also the parameters of the kernel power management mechanism.
  • the kernel parameters related to the kernel-mode power management mechanism may have multiple values, and under different values, the energy-saving effect that the power management mechanism can produce will be different.
  • the kernel parameter setting operation is combined with artificial intelligence, and based on the artificial intelligence model, the performance data and power consumption data of the physical device under multiple value combinations corresponding to the relevant kernel parameters are obtained, so that the physical device can be Based on the performance data and power consumption data under the multiple value combinations corresponding to the relevant kernel parameters, the relevant kernel parameters can be set, and appropriate values can be set for the relevant kernel parameters, taking into account the power consumption and performance of the physical device. Combining with artificial intelligence can improve the efficiency of parameter setting and reduce costs.
  • an implementation manner of step 503 includes: selecting at least one candidate value combination from the multiple value combinations according to the performance data and power consumption data of the physical device under multiple value combinations ; Use a load test tool to test the performance data and power consumption data of the physical device under at least one candidate value combination; use the load test tool to test the performance data and power consumption data of the physical device under at least one candidate value combination , Determine the target value combination from at least one candidate value combination.
  • determining the target value combination it also includes: using the performance data and power consumption data of the physical device tested by the load test tool under the target value combination to modify the performance-power consumption prediction model.
  • the above-mentioned use of the load test tool to test the performance data and power consumption data of the physical device under at least one candidate value combination includes: for the first candidate value combination, the value of at least one kernel parameter in the operating system source code Modify to the value in the first candidate value combination, and install the operating system on the physical device according to the modified operating system source code; run the load test tool on the physical device to test the physical device in the first candidate value combination Performance data and power consumption data below; where the first candidate value combination is any one of at least one candidate value combination.
  • the foregoing selecting at least one candidate value combination from the multiple value combinations according to the performance data and power consumption data of the physical device under multiple value combinations includes: obtaining power consumption data that the physical device actually needs to meet; Match the power consumption data that the physical device actually needs to meet with the performance data and power consumption data of the physical device under multiple value combinations; obtain the power consumption data that the physical device actually needs to meet from multiple value combinations
  • the matching degree of at least one candidate value combination that meets the matching degree requirement includes: obtaining the performance data that the physical device actually needs to meet, and combining the performance data that the physical device actually needs to meet with the physical device under a combination of multiple values corresponding to at least one kernel parameter.
  • step 503 includes: obtaining performance data and power consumption data that the physical device actually needs to meet, and corresponding the performance data and power consumption data that the physical device actually needs to meet with the physical device in at least one kernel parameter Match the performance data and power consumption data under multiple value combinations of, from multiple value combinations, obtain the performance data and power consumption data that the physical device actually needs to meet the matching degree that meets at least one of the matching degree requirements A combination of candidate values.
  • obtaining the power consumption data that the physical device actually needs to meet includes: analyzing the power consumption data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, obtaining the power required by the service deployment user
  • the power consumption data is the power consumption data that the physical device actually needs to meet.
  • obtaining the performance data that the physical device actually needs to meet includes: analyzing the performance data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, obtaining the performance data required by the service deployment user, As the actual performance data that physical equipment needs to meet.
  • obtaining the power consumption data and performance data that the physical device actually needs to meet includes: analyzing the power consumption data and performance data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, obtaining The performance data and performance data required by the service deployment user are the power consumption data and performance data that the physical device actually needs to meet.
  • an implementation manner of step 502 includes: using a load test tool to test the performance data and power consumption data of the physical device under partial value combinations among the above-mentioned multiple value combinations; Perform model training on performance data and power consumption data under partial value combinations to obtain the performance-power consumption prediction model; use the performance-power consumption prediction model to predict the physical device under other value combinations among multiple value combinations Performance data and power consumption data.
  • model training is performed according to the performance data and power consumption data of the physical device under partial value combinations to obtain the performance-power consumption prediction model, including: performance data and power consumption data of the physical device under partial value combinations
  • the power consumption data is subjected to regression analysis to obtain the performance-power consumption prediction model.
  • perform regression analysis on the performance data and power consumption data of the physical device under partial value combinations to obtain the performance-power consumption prediction model including: taking some value combinations as independent variables, and taking the physical device in part
  • the performance data and power consumption data under the value combination are used as dependent variables to perform linear regression analysis to obtain a performance-power consumption prediction model.
  • acquiring the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one kernel parameter includes: receiving the physical device sent by the model computing device corresponding to the at least one kernel parameter Performance data and power consumption data under multiple value combinations; among them, the performance data and power consumption data under at least some value combinations are estimated by the model computing device based on the performance-power consumption prediction model.
  • the performance-power consumption prediction model obtained by the model computing device and the performance-power consumption prediction model estimated based on the performance-power consumption prediction model the detailed implementation of the performance data and power consumption data of the physical device under at least partial value combinations can be found in the foregoing embodiments. This will not be repeated here.
  • FIG. 5b is a schematic flowchart of another data processing method provided by an exemplary embodiment of this application. As shown in Figure 5b, the method includes:
  • an implementation manner of step 53 includes: performing regression analysis on the performance data and power consumption data of the physical device under the above-mentioned partial value combinations to obtain a performance-power consumption prediction model.
  • the linear regression analysis method can be used for model training.
  • the model training process of obtaining the performance-power consumption prediction model includes: using the above combination of values as independent variables, and using the performance data and power consumption data of the physical device under the above combination of values as dependent variables to perform linear regression analysis to obtain Performance-power consumption prediction model.
  • Kernel parameter settings provide data conditions.
  • another embodiment of a data processing method includes:
  • the kernel parameter setting operation is combined with artificial intelligence, and based on the artificial intelligence model, the performance data of the physical device under multiple value combinations corresponding to the relevant kernel parameters is obtained, so that the physical device can be used in the relevant kernel.
  • the relevant kernel parameters can be set, and appropriate values can be set for the relevant kernel parameters, which is conducive to ensuring the performance of the physical device, and the combination with artificial intelligence can improve Parameter setting efficiency and cost reduction.
  • FIG. 6b Another embodiment of a data processing method includes:
  • the performance prediction model is trained based on the collected data, and the performance prediction model is estimated based on the performance prediction model.
  • the performance data of the physical device under other value combinations corresponding to the above at least one kernel parameter can be obtained, which can greatly improve the efficiency of data acquisition, reduce the cost, and provide data conditions for the physical device to perform the kernel parameter setting.
  • another embodiment of a data processing method includes:
  • the kernel parameter setting operation is combined with artificial intelligence, and based on the artificial intelligence model, the power consumption data of the physical device under multiple value combinations corresponding to the relevant kernel parameter is obtained, so that the physical device can be Based on the power consumption data under the multiple value combinations corresponding to the kernel parameters, the relevant kernel parameters can be set, and appropriate values can be set for the relevant kernel parameters, which is conducive to reducing the power consumption of physical devices and combining with artificial intelligence , Which can improve the efficiency of parameter setting and reduce costs.
  • FIG. 7b another embodiment of a data processing method includes:
  • the power consumption estimation model is trained based on the collected data, and the power consumption estimation is based on The model predicts the power consumption data of the physical device under other value combinations corresponding to at least one of the above-mentioned kernel parameters, which can greatly improve data acquisition efficiency, reduce costs, and provide data conditions for the physical device to set the kernel parameters.
  • another embodiment of a data processing method includes:
  • Kernel parameter settings provide data conditions.
  • the embodiment of the present application also provides a task scheduling method.
  • the task scheduling method includes:
  • the value of the power consumption parameter in the kernel mode refers to a combination of values of at least one kernel parameter related to the power management mechanism of the kernel mode supported by the resource device.
  • the power management mechanism in the kernel mode refers to a mechanism provided by the operating system to manage the power consumption of physical devices. It is a power management mechanism at the operating system level and needs to run in the kernel mode.
  • the type of operating system is not limited.
  • it may be a Linux operating system, a Windows operating system, a UNIX operating system, or a MAC operating system.
  • the power management mechanism of the kernel mode supported by different operating systems will be different.
  • DVFS and C-state are examples of two kernel-state power management mechanisms supported by the Linux operating system.
  • the power management mechanism in the kernel mode is related to some kernel parameters.
  • These kernel parameters are also the parameters of the power management mechanism in the kernel mode.
  • the value of these kernel parameters can affect the energy saving effect of the power management mechanism in the kernel mode.
  • the prerequisite for the normal use of the power management mechanism in the kernel mode is to set the values of the kernel parameters related to the power management mechanism in the kernel mode in advance.
  • at least one kernel parameter related to the power management mechanism of the kernel mode of the device in the normal working state has a certain value, and the combination of these values is the kernel mode power consumption parameter value of this embodiment.
  • the core state power consumption parameter value of the resource device can reflect the power consumption of the resource device to a certain extent.
  • resource devices refer to various physical devices responsible for performing tasks in resource scheduling scenarios.
  • they can be terminal devices such as laptops, tablets, smart phones, or edge computing nodes, or they can be servers, server clusters, and server arrays.
  • server-side equipment such as cloud servers.
  • the resource device can be a server or a server cluster, but it is not limited to this.
  • a task scheduling device (or called a task scheduler) is generally deployed, which is mainly used to schedule tasks to be scheduled to appropriate resource devices.
  • the task scheduling device can run program codes such as task scheduling services, programs, or plug-ins to implement the following task scheduling process.
  • the task scheduling device may provide a human-computer interaction interface for the user, and the user may provide the tasks to be scheduled and their performance requirements through the human-computer interaction interface.
  • the human-computer interaction interface can be an application page, a web page or a command window.
  • the task scheduling device can also support voice interaction and recognition technology, and users can submit tasks to be scheduled and their performance requirements through voice instructions. The performance requirements of different tasks to be scheduled will be different, which is not limited.
  • a resource device that meets the performance requirement and the core state power consumption parameter value meets the set power consumption requirement can be selected from at least one resource device; the task to be scheduled is scheduled to meet the performance requirement And the resource device whose core state power consumption parameter value meets the set power consumption requirement.
  • the performance data and performance of at least one resource device under the respective core-mode power consumption parameter value may be selected.
  • Consumption data That is, according to the performance data and power consumption data of at least one resource device under the respective core-state power consumption parameter values, a resource device that meets the performance requirement and the core-mode power consumption parameter value meets the set power consumption requirement is selected.
  • the resource device includes: selecting a candidate resource device that meets the above performance requirements according to the performance data of at least one resource device under the respective core state power consumption parameter value; according to the power consumption data of the candidate resource device under the respective core state power consumption parameter value , Select a resource device whose power consumption data meets the set power consumption requirement from the candidate resource devices.
  • the number of candidate resource devices meeting the foregoing performance requirements may be one or more.
  • the power consumption data of the candidate resource device under the kernel state power consumption parameter value meets the set power consumption requirement, which means that the kernel state power consumption parameter value of the candidate resource device meets the set power consumption requirement.
  • the resource device includes: selecting a candidate resource device whose core state power consumption parameter value meets the set power consumption requirement according to the power consumption data of at least one resource device under the respective core state power consumption parameter value; according to the candidate resource device in the respective core According to the performance data under the state power consumption parameter value, a resource device whose power consumption data meets the set power consumption requirement is selected from the candidate resource devices.
  • the “set power consumption requirement” is not limited, and can be flexibly set according to application requirements.
  • setting the power consumption requirement may require that the core state power consumption parameter value brings the lowest power consumption to the resource device. Based on this, the power consumption can be selected from candidate resource devices that meet the above performance requirements. The resource device with the lowest data consumption; then the task to be scheduled is scheduled to the resource device with the lowest data consumption.
  • the resource device with the best core-mode power consumption parameter value can be selected under the condition of guaranteed performance.
  • a load test tool may be used to collect performance data and power consumption data of each resource device under its own core state power consumption parameter value.
  • an artificial intelligence model can be pre-trained, such as a performance-power consumption prediction model.
  • a performance-power consumption prediction model When the kernel state power consumption parameter value of each resource device is known, the performance-power consumption prediction model can be used. The estimation model predicts the performance data and power consumption data of each resource device under its own core state power consumption parameter value. Regarding the training process and the use process of the performance-power consumption estimation model, refer to the foregoing embodiment, which will not be repeated here.
  • the core-state power consumption parameter value of each resource device is set using the method provided in the foregoing embodiment of this application, and in the process of setting the core-mode power consumption parameter value for each resource device, it has been learned
  • the performance data and power consumption data of each resource device under its own core state power consumption parameter value, and the performance data and power consumption data of each resource device learned in advance under its own core state power consumption parameter value can be saved, so that, In the task scheduling process, the performance data and power consumption data of each resource device under the respective core state power consumption parameter values can be directly read.
  • the core state power consumption parameter value of each resource device refers to the target value combination finally set by the method provided in the foregoing embodiment.
  • the resource device with the better core state power consumption parameter value in combination with the core state power consumption parameter value of the resource device, the resource device with the better core state power consumption parameter value can be preferentially selected to execute the task when the performance requirements are met. While taking into account performance requirements, reduce power consumption.
  • the execution subject of each step of the method provided in the foregoing embodiment may be the same device, or different devices may also be the execution subject of the method.
  • the execution subject of steps 501 to 504 may be device A; for another example, the execution subject of steps 501, 503, and 504 may be device A, and the execution subject of step 502 may be device B; and so on.
  • Fig. 8a is a schematic structural diagram of a physical device provided by an exemplary embodiment of this application. As shown in FIG. 8a, the physical device includes: a memory 81a and a processor 82a.
  • the memory 81a is used to store computer programs, and can be configured to store various other data to support operations on the physical device. Examples of such data include instructions for any application or method operated on the physical device, contact data, phone book data, messages, pictures, videos, etc.
  • the processor 82a is coupled to the memory 81a, and is configured to execute the computer program in the memory 81a to determine from the kernel parameters of the physical device related to the power management mechanism of the kernel mode supported by the physical device At least one kernel parameter; acquiring performance data and power consumption data of the physical device under multiple value combinations corresponding to the at least one kernel parameter, where at least part of the performance data and power consumption data under the value combination are based on The performance-power consumption prediction model predicts; according to the performance data and power consumption data of the physical device under the multiple value combinations, the target value combination corresponding to the at least one core parameter is determined; The target value combination sets the at least one kernel parameter so that the power consumption management mechanism operates according to the value in the target value combination.
  • the processor 82a when the processor 82a determines the target value combination corresponding to the at least one kernel parameter, it is specifically configured to: according to the performance data and function of the physical device under the multiple value combinations Select at least one candidate value combination from the multiple value combinations; use a load test tool to test the performance data and power consumption data of the physical device under the at least one candidate value combination; The performance data and power consumption data of the physical device under the at least one candidate value combination tested by the load testing tool are used to determine the target value combination from the at least one candidate value combination.
  • the processor 82a is further configured to, after determining the target value combination, use the load test tool to test the performance data and power consumption data of the physical device under the target value combination , Revise the performance-power consumption prediction model.
  • the processor 82a uses a load testing tool to test the performance data and power consumption data of the physical device under the at least one candidate value combination, it is specifically configured to: for the first candidate value combination, set the operating system The value of the at least one kernel parameter in the source code is modified to the value in the first candidate value combination, and the operating system is installed on the physical device according to the modified operating system source code; Run the load test tool on the device to test the performance data and power consumption data of the physical device under the first candidate value combination; wherein, the first candidate value combination is the at least one candidate Any combination of candidate values in the value combination.
  • the processor 82a selects at least one candidate value combination from the multiple value combinations, it is specifically configured to: obtain power consumption data that the physical device actually needs to meet; and compare the power consumption data that the physical device actually needs to meet , To match the performance data and power consumption data of the physical device under multiple value combinations; from the multiple value combinations, obtain at least one of the matching degrees with the power consumption data that the physical device actually needs to meet.
  • a combination of candidate values or,
  • the processor 82a when the processor 82a selects at least one candidate value combination from the multiple value combinations, it is specifically configured to: obtain performance data that the physical device actually needs to meet, and compare the physical device's actual needs Satisfied performance data is matched with the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one core parameter; from multiple value combinations, the performance data that the physical device actually needs to meet is obtained The matching degree of at least one candidate value combination that meets the matching degree requirement. or,
  • the processor 82a when the processor 82a selects at least one candidate value combination from the multiple value combinations, it is specifically configured to: obtain the performance data and power consumption data that the physical device actually needs to meet, and The performance data and power consumption data that the physical device actually needs to meet are matched with the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one core parameter; from multiple value combinations, The matching degree of the performance data and the power consumption data that the physical device actually needs to meet all meets at least one candidate value combination that meets the matching degree requirement.
  • the processor 82a is specifically configured to: analyze the power consumption data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, Obtain the power consumption data required by the service deployment user as the power consumption data that the physical device actually needs to meet.
  • the processor 82a obtains the performance data that the physical device actually needs to meet, it is specifically used to: analyze the performance data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry; or, obtain the service Deploy the performance data required by the user as the actual performance data that the physical device needs to meet.
  • the processor 82a when the processor 82a obtains the power consumption data and performance data that the physical device actually needs to meet, it is specifically used to: analyze the power consumption data that the physical device actually needs to meet according to the QoS of the service that the physical device actually needs to carry And performance data; or, obtain the performance data and performance data required by the service deployment user as the power consumption data and performance data that the physical device actually needs to meet.
  • the processor 82a when the processor 82a obtains the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one kernel parameter, it is specifically configured to: use a load test tool to test that the physical device is in the above-mentioned Performance data and power consumption data under partial value combinations among multiple value combinations; perform model training based on the performance data and power consumption data of the physical device under the above partial value combinations to obtain a performance-power consumption prediction model; Use the performance-power consumption prediction model to estimate the performance data and power consumption data of the physical device under other value combinations among multiple value combinations.
  • the processor 82a when the processor 82a obtains the performance-power consumption prediction model, it is specifically used to: perform regression analysis on the performance data and power consumption data of the physical device under partial value combinations to obtain the performance-power consumption prediction model. Estimate the model.
  • processor 82a is specifically configured to: use partial value combinations as independent variables, and use the performance data and power consumption data of the physical device under the partial value combinations as dependent variables to perform linear regression analysis to obtain performance-power consumption estimates model.
  • the processor 82a when the processor 82a obtains the performance data and power consumption data of the physical device under multiple value combinations corresponding to at least one kernel parameter, it is specifically configured to: receive the physical device sent by the model computing device Performance data and power consumption data under multiple value combinations corresponding to at least one core parameter; among them, the performance data and power consumption data under at least some value combinations are estimated by the model computing device based on the performance-power consumption prediction model of.
  • the performance-power consumption prediction model obtained by the model computing device and the performance-power consumption prediction model estimated based on the performance-power consumption prediction model
  • the detailed implementation of the performance data and power consumption data of the physical device under at least partial value combinations can be found in the foregoing embodiments. This will not be repeated here.
  • the processor 82 may also implement the following functions: determine at least one kernel parameter related to the performance of the device from the kernel parameters of the physical device; The performance data under multiple value combinations corresponding to the at least one kernel parameter, wherein the performance data under at least part of the value combinations is estimated based on the performance prediction model; according to the physical device in the multiple value combinations The performance data under the value combination, determine the target value combination corresponding to the at least one kernel parameter; set the at least one kernel parameter according to the target value combination, so that the physical device takes the value according to the target The value in the combination runs.
  • the processor 82 may also implement the following functions: determine at least one kernel parameter related to the power consumption of the device from the kernel parameters of the physical device; and obtain the physical device.
  • the physical device further includes: a communication component 83a, a display 84a, a power supply component 85a, an audio component 86a and other components. Only part of the components are schematically shown in FIG. 8a, which does not mean that the physical device only includes the components shown in FIG. 8a. In addition, depending on the implementation form of the physical device, the components in the dashed box in FIG. 8a are optional components, not mandatory components.
  • the physical device when the physical device is implemented as a terminal device such as a smart phone, a tablet computer, or a desktop computer, it can include the components in the dashed box in Figure 8a; when the physical device is implemented as a server such as a conventional server, a cloud server, a data center, or a server array When the device is used, the components in the dashed box in Figure 8a may not be included.
  • an embodiment of the present application also provides a computer-readable storage medium storing a computer program.
  • the processor When the computer program is executed by a processor, the processor will cause the processor to implement the method in the method embodiment shown in FIG. 5a, FIG. 6a, or FIG. 7a. The steps.
  • Fig. 8b is a schematic structural diagram of a model computing device provided by an exemplary embodiment of this application. As shown in FIG. 8b, the physical device includes: a memory 81b and a processor 82b.
  • the memory 81b is used to store computer programs, and can be configured to store various other data to support operations on the physical device. Examples of such data include instructions for any application or method operated on the physical device, contact data, phone book data, messages, pictures, videos, etc.
  • the processor 82b is coupled with the memory 81b, and is configured to execute the computer program in the memory 81b to determine at least one related to the power management mechanism of the kernel state supported by the physical device from the kernel parameters of the physical device Kernel parameters; use a load test tool to test the performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter; according to the performance data of the physical device under the partial value combination Perform model training with power consumption data to obtain a performance-power consumption prediction model; use the performance-power consumption prediction model to predict the performance of the physical device under other value combinations corresponding to the at least one core parameter Data and power consumption data.
  • the processor 82b when the processor 82b obtains the performance-power consumption prediction model, it is specifically configured to: perform regression analysis on the performance data and power consumption data of the physical device under the partial value combination, In order to get the performance-power consumption prediction model.
  • the processor 82b is specifically configured to: use the partial value combination as an independent variable, and use the performance data and power consumption data of the physical device under the partial value combination as the dependent variable to perform linear regression analysis , Get the performance-power consumption prediction model.
  • the model computing device of this embodiment may also implement the following functions: determine at least one kernel parameter related to device performance from the kernel parameters of the physical device; use a load test tool Testing the performance data of the physical device under the partial value combination corresponding to the at least one kernel parameter; performing model training according to the performance data of the physical device under the partial value combination to obtain a performance prediction model; The performance prediction model is used to predict the performance data of the physical device under other value combinations corresponding to the at least one kernel parameter.
  • the model computing device of this embodiment may also implement the following functions: determine at least one kernel parameter related to the power consumption of the device from the kernel parameters of the physical device; A tool to test the power data of the physical device under the partial value combination corresponding to the at least one kernel parameter; perform model training according to the power data of the physical device under the partial value combination to obtain a power estimation model ; Using the power estimation model to predict the power data of the physical device under other value combinations corresponding to the at least one kernel parameter.
  • the model computing device of this embodiment may also implement the following functions: from the kernel parameters of the physical device, determine the power management mechanism of the kernel state supported by the physical device Relevant at least one kernel parameter; use a load test tool to test the performance data and power consumption data of the physical device under the partial value combination corresponding to the at least one kernel parameter; according to the physical device in the partial value combination Perform model training on the performance data and power consumption data under the following performance data to obtain a performance-power consumption prediction model; use the performance-power consumption prediction model to estimate that the physical device is in multiple selections corresponding to the at least one core parameter. Performance data and power consumption data under value combinations; wherein the multiple value combinations include the partial value combinations.
  • the model computing device further includes: a communication component 83b, a power supply component 85b and other components. Only part of the components are schematically shown in FIG. 8b, which does not mean that the model computing device only includes the components shown in FIG. 8b.
  • the model computing device can be implemented as a server device such as a conventional server, a cloud server, a data center, or a server array.
  • an embodiment of the present application also provides a computer-readable storage medium storing a computer program.
  • the processor When the computer program is executed by a processor, the processor causes the processor to implement the method shown in FIG. 5b, FIG. 6b, FIG. 7b, or FIG. 7c. The steps in the example.
  • Fig. 8c is a schematic structural diagram of a task scheduling device provided by an exemplary embodiment of this application. As shown in FIG. 8c, the task scheduling device includes: a memory 81c and a processor 82c.
  • the memory 81c is used to store computer programs, and can be configured to store other various data to support operations on the task scheduling device. Examples of such data include instructions for any application or method to operate on the task scheduling device, task lists, messages, pictures, videos, etc.
  • the processor 82c is coupled with the memory 81c, and is configured to execute the computer program in the memory 81c to obtain the tasks to be scheduled and the performance requirements of the tasks to be scheduled; from at least one resource device, select the core device that meets the performance requirements and The resource device whose value of the power consumption parameter meets the set power consumption requirement; schedule the task to be scheduled to the resource device that meets the performance requirement and the value of the kernel power consumption parameter meets the set power consumption requirement; wherein, the kernel power consumption parameter The value refers to a value combination of at least one kernel parameter related to the power management mechanism of the kernel mode supported by the resource device.
  • the resource device may be a server or a server cluster.
  • the processor 82c when the processor 82c selects a resource device that meets the performance requirements and the core state power consumption parameter value meets the set power consumption requirement, it is specifically configured to: The performance data and power consumption data under the consumption parameter value are selected to select a resource device that meets the performance requirement and the core state power consumption parameter value meets the set power consumption requirement.
  • the processor 82c is specifically configured to: select a candidate resource device that meets the performance requirements according to the performance data of at least one resource device under the respective core state power consumption parameter value; according to the candidate resource device's performance in the respective core state For the power consumption data under the consumption parameter value, a resource device whose power consumption data meets the set power consumption requirement is selected from the candidate resource devices.
  • the processor 82c is specifically configured to select the resource device with the lowest power consumption data from the candidate resource devices according to the power consumption data of the candidate resource devices under their respective core state power consumption parameter values.
  • the task scheduling device further includes: a communication component 83c, a display 84c, a power supply component 85c, an audio component 86c and other components. Only some components are schematically shown in FIG. 8c, which does not mean that the task scheduling device only includes the components shown in FIG. 8c. In addition, according to the different implementation forms of the task scheduling device, the components in the dashed box in FIG. 8c are optional components, not mandatory components.
  • the task scheduling device when the task scheduling device is implemented as a terminal device such as a smart phone, a tablet computer, or a desktop computer, it can include the components in the dashed box in Figure 8c; when the task scheduling device is implemented as a conventional server, cloud server, data center, or server array, etc. When the server device is used, the components in the dashed box in Figure 8c may not be included.
  • an embodiment of the present application also provides a computer-readable storage medium storing a computer program.
  • the processor causes the processor to implement the steps in the method embodiment shown in FIG. 7d.
  • the communication components in Figs. 8a to 8c are configured to facilitate wired or wireless communication between the device where the communication component is located and other devices.
  • the device where the communication component is located can access wireless networks based on communication standards, such as WiFi, 2G, 3G, 4G/LTE, 5G and other mobile communication networks, or a combination of them.
  • the communication component receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component may further include a near field communication (NFC) module, radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra wideband (UWB) technology, Bluetooth (BT) technology Wait.
  • NFC near field communication
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra wideband
  • Bluetooth Bluetooth
  • the above-mentioned display in Figs. 8a-8c includes a screen, and the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation.
  • the power supply components in Figures 8a to 8c above provide power for various components of the equipment where the power supply components are located.
  • the power supply component may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device where the power supply component is located.
  • the audio components in Figs. 8a to 8c may be configured to output and/or input audio signals.
  • the audio component includes a microphone (MIC).
  • the microphone When the device where the audio component is located is in an operating mode, such as call mode, recording mode, and voice recognition mode, the microphone is configured to receive external audio signals.
  • the received audio signal can be further stored in a memory or sent via a communication component.
  • the audio component further includes a speaker for outputting audio signals.
  • the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment.
  • the instructions provide steps for implementing the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • the computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • processors CPUs
  • input/output interfaces network interfaces
  • memory volatile and non-volatile memory
  • the memory may include non-permanent memory in a computer readable medium, random access memory (RAM) and/or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM). Memory is an example of computer readable media.
  • RAM random access memory
  • ROM read-only memory
  • flash RAM flash memory
  • Computer-readable media include permanent and non-permanent, removable and non-removable media, and information storage can be realized by any method or technology.
  • the information can be computer-readable instructions, data structures, program modules, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical storage, Magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media can be used to store information that can be accessed by computing devices. According to the definition in this article, computer-readable media does not include transitory media, such as modulated data signals and carrier waves.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Power Sources (AREA)

Abstract

L'invention concerne un procédé, un dispositif et un système de traitement de données, et un support de stockage. Une opération de réglage pour des paramètres de noyau associés à un mécanisme de gestion de consommation d'énergie est combinée à une intelligence artificielle. Un modèle d'estimation de consommation d'énergie-performance obtenu par entraînement sur la base d'une intelligence artificielle estime des données de performance et des données de consommation d'énergie d'un dispositif physique sous une pluralité de combinaisons de valeurs de paramètres de noyau ; en outre, sur la base des données de performance et des données de consommation d'énergie obtenues, des valeurs appropriées peuvent être définies pour les paramètres de noyau, de telle sorte que la consommation d'énergie et les performances du dispositif physique peuvent être prises en compte, et la combinaison de celles-ci avec une intelligence artificielle peut améliorer l'efficacité de réglage de paramètres et réduire les coûts.
PCT/CN2019/104727 2019-09-06 2019-09-06 Procédé, dispositif et système de traitement de données et de planification de tâches, et support de stockage WO2021042373A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980095635.5A CN113748398B (zh) 2019-09-06 2019-09-06 数据处理与任务调度方法、设备、系统及存储介质
PCT/CN2019/104727 WO2021042373A1 (fr) 2019-09-06 2019-09-06 Procédé, dispositif et système de traitement de données et de planification de tâches, et support de stockage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/104727 WO2021042373A1 (fr) 2019-09-06 2019-09-06 Procédé, dispositif et système de traitement de données et de planification de tâches, et support de stockage

Publications (1)

Publication Number Publication Date
WO2021042373A1 true WO2021042373A1 (fr) 2021-03-11

Family

ID=74852953

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/104727 WO2021042373A1 (fr) 2019-09-06 2019-09-06 Procédé, dispositif et système de traitement de données et de planification de tâches, et support de stockage

Country Status (2)

Country Link
CN (1) CN113748398B (fr)
WO (1) WO2021042373A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114048040A (zh) * 2021-11-29 2022-02-15 中南大学 基于内存与图像分类模型时延关系的任务调度方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101187831A (zh) * 2006-10-24 2008-05-28 国际商业机器公司 微处理器的自主动态电压和频率调节的方法和计算机系统
CN104657219A (zh) * 2015-02-27 2015-05-27 西安交通大学 一种用于异构众核系统下的应用程序线程数动态调整方法
CN106991030A (zh) * 2017-03-01 2017-07-28 北京航空航天大学 一种基于在线学习的系统功耗优化的轻量级方法
CN107861606A (zh) * 2017-11-21 2018-03-30 北京工业大学 一种通过协调dvfs和任务映射的异构多核功率封顶方法

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8489745B2 (en) * 2010-02-26 2013-07-16 International Business Machines Corporation Optimizing power consumption by dynamic workload adjustment
US8689220B2 (en) * 2011-11-30 2014-04-01 International Business Machines Corporation Job scheduling to balance energy consumption and schedule performance
CN105243068A (zh) * 2014-07-09 2016-01-13 华为技术有限公司 数据库系统的查询方法、服务器和能耗测试系统
US9910481B2 (en) * 2015-02-13 2018-03-06 Intel Corporation Performing power management in a multicore processor
CN105577796A (zh) * 2015-12-25 2016-05-11 曙光信息产业(北京)有限公司 集群的功耗控制方法及装置
US20180095792A1 (en) * 2016-10-05 2018-04-05 Mediatek Inc. Multi-core system including heterogeneous processor cores with different instruction set architectures
CN107656851B (zh) * 2017-09-30 2021-01-19 华南理工大学 一种基于部件能耗模型的云服务器能耗测算方法及系统
CN108595301B (zh) * 2018-03-26 2021-03-26 中国科学院计算技术研究所 一种基于机器学习的服务器能耗预测方法和系统
CN109840180B (zh) * 2018-12-18 2022-07-08 平安科技（深圳）有限公司 服务器运行功耗管理方法、装置及计算机可读存储介质

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101187831A (zh) * 2006-10-24 2008-05-28 国际商业机器公司 微处理器的自主动态电压和频率调节的方法和计算机系统
CN104657219A (zh) * 2015-02-27 2015-05-27 西安交通大学 一种用于异构众核系统下的应用程序线程数动态调整方法
CN106991030A (zh) * 2017-03-01 2017-07-28 北京航空航天大学 一种基于在线学习的系统功耗优化的轻量级方法
CN107861606A (zh) * 2017-11-21 2018-03-30 北京工业大学 一种通过协调dvfs和任务映射的异构多核功率封顶方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114048040A (zh) * 2021-11-29 2022-02-15 中南大学 基于内存与图像分类模型时延关系的任务调度方法
CN114048040B (zh) * 2021-11-29 2022-05-13 中南大学 基于内存与图像分类模型时延关系的任务调度方法

Also Published As

Publication number Publication date
CN113748398B (zh) 2023-01-17
CN113748398A (zh) 2021-12-03

Similar Documents

Publication Publication Date Title
US11009836B2 (en) Apparatus and method for optimizing quantifiable behavior in configurable devices and systems
Ibrahim et al. Governing energy consumption in Hadoop through CPU frequency scaling: An analysis
US10175745B2 (en) Optimizing power consumption by dynamic workload adjustment
US8869158B2 (en) Job scheduling to balance energy consumption and schedule performance
Piraghaj et al. Virtual machine customization and task mapping architecture for efficient allocation of cloud data center resources
CN102103516B (zh) 基于虚拟cpu的频率和电压调节
Imes et al. Energy-efficient application resource scheduling using machine learning classifiers
US20120102503A1 (en) Green computing via event stream management
Luo et al. Simulation of power consumption of cloud data centers
KR101990411B1 (ko) 클라우드 시스템에서의 우선 순위 기반 자원 스케일링 시스템, 장치 및 방법
US20120254822A1 (en) Processing optimization load adjustment
WO2019085754A1 (fr) Procédé et appareil de nettoyage d'application, et support d'informations et dispositif électronique
Wolski et al. QPRED: Using quantile predictions to improve power usage for private clouds
US11537377B2 (en) Method and system for profile based deployments
WO2021042373A1 (fr) Procédé, dispositif et système de traitement de données et de planification de tâches, et support de stockage
CN108574600B (zh) 云计算服务器的功耗和资源竞争协同控制的服务质量保障方法
WO2021046774A1 (fr) Procédé de planification de ressources et procédé de prédiction d'informations, dispositif, système, et support de stockage
Gupta et al. Detecting energy patterns in software development
CN110609747A (zh) 信息处理方法及电子设备
CN113728294B (zh) 功耗控制与方案生成方法、设备、系统及存储介质
Wu Analysis of offloading decision making in mobile cloud computing
CN110347546B (zh) 监控任务动态调整方法、装置、介质及电子设备
US20140122403A1 (en) Loading prediction method and electronic device using the same
US10884484B2 (en) Extending a battery life of a battery-powered computing device
CN109960572B (zh) 设备资源管理方法和装置以及智能终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19944134

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19944134

Country of ref document: EP

Kind code of ref document: A1