CN114003310A - Parameter selection method, device, equipment and medium based on service scene - Google Patents
Parameter selection method, device, equipment and medium based on service scene Download PDFInfo
- Publication number
- CN114003310A CN114003310A CN202111275590.5A CN202111275590A CN114003310A CN 114003310 A CN114003310 A CN 114003310A CN 202111275590 A CN202111275590 A CN 202111275590A CN 114003310 A CN114003310 A CN 114003310A
- Authority
- CN
- China
- Prior art keywords
- performance
- configuration parameters
- service
- configuration
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010187 selection method Methods 0.000 title claims abstract description 13
- 238000004458 analytical method Methods 0.000 claims abstract description 82
- 238000011056 performance test Methods 0.000 claims abstract description 49
- 238000000034 method Methods 0.000 claims abstract description 31
- 238000012360 testing method Methods 0.000 claims description 43
- 238000012549 training Methods 0.000 claims description 29
- 238000004590 computer program Methods 0.000 claims description 13
- 238000012986 modification Methods 0.000 abstract description 16
- 230000004048 modification Effects 0.000 abstract description 16
- 238000012545 processing Methods 0.000 description 13
- 238000005457 optimization Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 5
- 230000006872 improvement Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000013500 data storage Methods 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012550 audit Methods 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000011158 quantitative evaluation Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44505—Configuring for program initiating, e.g. using registry, configuration files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
Abstract
The embodiment of the application discloses a parameter selection method, a device, equipment and a medium based on a service scene, and the method comprises the steps of obtaining service data and configuration parameters corresponding to a service scene identifier; wherein the configuration parameters may include at least two sets of configuration parameters. The configuration parameters comprise a mode of analyzing the service data, and the performance test equipment is trained by using the configuration parameters and the service data, so that performance analysis results corresponding to at least two groups of configuration parameters are obtained. Based on the performance analysis result corresponding to each of the at least two sets of configuration parameters, the configuration parameter corresponding to the performance test device when the performance of the performance test device is better can be determined, and the configuration parameter is the configuration parameter matched with the service scene identifier. The performance test equipment is used for simulating the service scene, so that the performance test of at least two groups of configuration parameters is realized, and the influence of the modification of the configuration parameters on the performance of the database can be quickly and accurately identified under the condition of not influencing the actual service.
Description
Technical Field
The present application relates to the field of performance testing technologies, and in particular, to a method, an apparatus, a device, and a computer-readable storage medium for selecting a parameter based on a service scenario.
Background
A database may be an organization or a general purpose data processing system in the field of applications that stores collections of related data pertaining to businesses and institutions, groups, and individuals. Various databases at the present stage, such as a relational Database (MySQL _ num _ rows, MySQL), a distributed Database (Oracle Database, Oracle), and the like, respectively provide various personalized system configuration parameters, and different open parameters can be provided for different service scenes to configure so as to meet different service requirements.
For various types of databases, open parameters provide more possibilities, but based on the underlying performance, the default configuration parameters provided by the database may not be able to meet the actual requirements of the business scenario, or may not fully exploit the actual performance that can be provided. This will result in that the effect achieved in the same service scenario is naturally not ideal if the configuration parameters are not correctly adjusted.
At present, various cloud database manufacturers only provide a mode for modifying the configuration parameters of the database, and do not relate to a mode for evaluating the performance influence caused by the modified configuration parameters. Because the configuration items provided by the database are hundreds of items and the configuration parameters are influenced mutually, a user can hardly know whether the modification of the configuration parameters can bring actual performance improvement or not clearly, so that the configuration parameters most suitable for the current service scene cannot be selected.
It can be seen that how to optimize the configuration parameters is a problem to be solved by those skilled in the art.
Disclosure of Invention
An object of the embodiments of the present application is to provide a method, an apparatus, a device, and a computer-readable storage medium for selecting parameters based on a service scenario, which can implement optimization of configuration parameters.
In order to solve the foregoing technical problem, an embodiment of the present application provides a method for selecting a parameter based on a service scenario, including:
acquiring service data and configuration parameters corresponding to the service scene identification; wherein the configuration parameters comprise at least two sets of configuration parameters;
training performance test equipment by using the configuration parameters and the service data to obtain performance analysis results corresponding to at least two groups of configuration parameters;
and determining the configuration parameters matched with the service scene identification based on the performance analysis result corresponding to the at least two groups of configuration parameters.
Optionally, the training the performance testing device by using the configuration parameters and the service data to obtain the performance analysis result corresponding to each of the at least two sets of configuration parameters includes:
and inputting the service data into the performance test equipment so that the performance test equipment can analyze the service data according to the configuration parameters and output a performance analysis result.
Optionally, the acquiring the service data corresponding to the service scene identifier includes:
collecting scene data corresponding to a service scene;
testing the performance of the database according to a set pressure testing mode to obtain corresponding service performance parameters;
and taking the scene data and the service performance parameters as service data corresponding to the service scene identification.
Optionally, the determining, based on the performance analysis result corresponding to each of the at least two sets of configuration parameters, a configuration parameter matched with the service scene identifier includes:
dividing the performance indexes contained in each performance analysis result according to set dimension information to obtain performance indexes corresponding to different dimension information;
and comparing the performance indexes corresponding to at least two groups of configuration parameters under the same dimension information to determine the configuration parameters matched with the service scene identifier.
Optionally, the determining, based on a performance analysis result corresponding to each of the at least two sets of configuration parameters, the configuration parameter matching the service scenario identifier includes:
inquiring a weight list corresponding to each performance index to determine a first performance value corresponding to a performance analysis result of the first configuration parameter;
inquiring a weight list corresponding to each performance index to determine a second performance value corresponding to the performance analysis result of the second configuration parameter;
and taking the second configuration parameter as the configuration parameter matched with the service scene identification under the condition that the second performance value is higher than the first performance value.
Optionally, the performance test device is a virtual machine device; after the training of the performance testing device by using the configuration parameters and the service data, the method further comprises:
adjusting hardware configuration corresponding to the virtual machine equipment;
and training the virtual machine equipment after the hardware configuration is adjusted by using the configuration parameters and the service data to obtain a performance analysis result corresponding to the virtual machine equipment after the hardware configuration is adjusted.
Optionally, the method further comprises:
and determining the configuration parameters matched with the service scene identifier based on the performance analysis results corresponding to the at least two groups of configuration parameters and the performance analysis results corresponding to the performance test equipment after the hardware configuration is adjusted.
The embodiment of the application also provides a parameter selection device based on the service scene, which comprises an acquisition unit, a training unit and a determination unit;
the acquiring unit is used for acquiring the service data and the configuration parameters corresponding to the service scene identification; wherein the configuration parameters comprise at least two sets of configuration parameters;
the training unit is used for training the performance test equipment by using the configuration parameters and the service data to obtain performance analysis results corresponding to at least two groups of configuration parameters;
and the determining unit is used for determining the configuration parameters matched with the service scene identifiers based on the performance analysis results corresponding to the at least two groups of configuration parameters.
Optionally, the training unit comprises an input subunit;
the input subunit is configured to input the service data to the performance testing device, so that the performance testing device analyzes the service data according to the configuration parameter and outputs a performance analysis result.
Optionally, the acquiring unit includes an acquiring subunit, a testing subunit, and a serving subunit;
the acquisition subunit is used for acquiring scene data corresponding to the service scene;
the test subunit is used for testing the performance of the database according to a set pressure test mode to acquire corresponding service performance parameters;
the serving as a subunit, configured to use the scene data and the service performance parameter as service data corresponding to the service scene identifier.
Optionally, the determining unit includes a dividing subunit and a comparing subunit;
the dividing subunit is configured to divide the performance indexes included in each performance analysis result according to set dimension information to obtain performance indexes corresponding to different dimension information;
and the comparison subunit is configured to compare the performance indexes corresponding to the at least two sets of configuration parameters under the same dimension information, so as to determine the configuration parameters matched with the service scene identifier.
Optionally, the at least two sets of configuration parameters include a first configuration parameter and a second configuration parameter, and the determining unit includes a first querying subunit, a second querying subunit, and a serving subunit;
the first query subunit is configured to query a weight list corresponding to each performance index to determine a first performance value corresponding to a performance analysis result of the first configuration parameter;
the second query subunit is configured to query a weight list corresponding to each performance index to determine a second performance value corresponding to a performance analysis result of the second configuration parameter;
and the acting subunit is configured to, when the second performance value is higher than the first performance value, act the second configuration parameter as a configuration parameter matching the service scenario identifier.
Optionally, the performance test device is a virtual machine device; the device further comprises an adjustment unit;
the adjusting unit is used for adjusting the hardware configuration corresponding to the virtual machine equipment;
and the training unit is used for training the virtual machine equipment after the hardware configuration is adjusted by using the configuration parameters and the service data so as to obtain a performance analysis result corresponding to the virtual machine equipment after the hardware configuration is adjusted.
Optionally, the determining unit is configured to determine, based on a performance analysis result corresponding to each of the at least two sets of configuration parameters and a performance analysis result corresponding to the performance test device after the hardware configuration is adjusted, a configuration parameter matching the service scene identifier.
The embodiment of the present application further provides a parameter selecting device based on a service scenario, including:
a memory for storing a computer program;
a processor for executing the computer program to implement the steps of the service scenario based parameter selection method.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the parameter selection method based on the service scenario are implemented.
According to the technical scheme, the service data and the configuration parameters corresponding to the service scene identification are obtained; wherein the configuration parameters may include at least two sets of configuration parameters. The configuration parameters include a mode of analyzing the service data, and in order to understand the influence of modification of the configuration parameters on the performance of the database and not influence the operation of normal services, the configuration parameters and the service data can be used for training the performance test equipment, so that performance analysis results corresponding to at least two groups of configuration parameters are obtained. Based on the performance analysis result corresponding to each of the at least two sets of configuration parameters, the configuration parameter corresponding to the performance test device when the performance of the performance test device is better can be determined, and the configuration parameter is the configuration parameter matched with the service scene identifier. In the technical scheme, the performance test equipment is used for simulating the service scene to realize the performance test of at least two groups of configuration parameters, so that the influence of the modification of the configuration parameters on the performance of the database can be rapidly and accurately identified, and a better optimization scheme of the configuration parameters of the database is provided for a user. Under the condition of not influencing actual service, the influence of modification of the configuration parameters on the performance of the database can be quickly and accurately identified, so that the optimization of the configuration parameters of the database is intelligently provided according to different service scenes. By combining with the actual service scene, a personalized and convenient database performance optimization scheme can be provided.
Drawings
In order to more clearly illustrate the embodiments of the present application, the drawings needed for the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained by those skilled in the art without inventive effort.
Fig. 1 is a schematic view of a parameter selection scenario provided in an embodiment of the present application;
fig. 2 is a flowchart of a parameter selection method based on a service scenario according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a parameter selection apparatus based on a service scenario according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a parameter selection device based on a service scenario according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without any creative effort belong to the protection scope of the present application.
The terms "including" and "having," and any variations thereof, in the description and claims of this application and the drawings described above, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements but may include other steps or elements not expressly listed.
In order that those skilled in the art will better understand the disclosure, the following detailed description will be given with reference to the accompanying drawings.
At present, various cloud database manufacturers only provide a mode for modifying the configuration parameters of the database, and do not relate to a mode for evaluating the performance influence caused by the modified configuration parameters. For the administrator, it is difficult to clearly know whether the modification of each configuration parameter can bring actual performance improvement, so that the configuration parameter most suitable for the current service scenario cannot be selected.
Therefore, the embodiment of the application provides a method, a device, equipment and a computer-readable storage medium for selecting parameters based on a service scene, which can acquire service data and configuration parameters corresponding to a service scene identifier; the service scene identifier is data information used for indicating the type of the current service scene. The configuration parameters may include at least two sets of configuration parameters. The configuration parameters comprise a mode of analyzing the service data, and in order to detect the influence of the adjustment of the configuration parameters on the performance of the database, the configuration parameters and the service data can be used for training the performance test equipment to obtain performance analysis results corresponding to at least two groups of configuration parameters; based on the performance analysis result corresponding to each of the at least two sets of configuration parameters, the configuration parameters matched with the service scene identifier can be determined.
Fig. 1 is a schematic view of a parameter selection scenario provided in an embodiment of the present application, and fig. 1 illustrates an interaction of a cloud Database Management Platform (DMP), a cloud Relational Database (RDS), a Database performance testing tool (sysbench), and a performance testing device. DMP may provide database management related services based on cloud computing. The RDS can be a cloud relational database deployed and used by a user, and configuration parameters can be stored in the RDS. The user can modify the configuration parameters in the RDS through the user interface on the DMP, where the configuration parameters include a mode of analyzing service data, such as the maximum connection number of the system, the memory setting of the system, and the like. The performance test equipment can be used as a virtual database carried by cloud computing resources and used for simulating the performance of the database after the configuration parameters are adjusted. Database performance may include aspects such as input/output rates of the database, hit rates, user queries to the database per second, response time of the database, latency, throughput rate, number of concurrencies, and the like.
In practical application, the service scenes can be divided into two types, wherein one type is the service scene mainly based on data query performance, and the method can be applied to the fields of financial services, medical services and the like. The other type is a business scene mainly based on data storage performance, and can be applied to the fields of game service provision, health code display service provision and the like.
The corresponding service data under different service scenes are different. In a service scenario mainly based on data query performance, data stored in a database is relatively fixed, and operations on the data in the database mainly relate to reading, writing, summarizing and the like of the data. Therefore, the service data corresponding to the service scenario with the data query performance as the main point may include specific data for performing read-write operation and the corresponding read-write times, read data amount, write data amount, summary result of the data, and the like.
In a service scenario mainly based on data storage performance, the data stored in the database has relatively more changes, and the operation on the data in the database mainly relates to modification, updating and the like of the data. Therefore, the service data corresponding to the service scenario with the data storage performance as the main point may include the modified or updated specific data and the corresponding modification and update frequency thereof, and the storage location corresponding to the modified or updated specific data, and the like.
The service data can be sourced in two ways, one way can include the scene data transmitted by the DMP to the sysbench, and the other way can include the service performance parameters obtained through the stress test. Scene data refers to data corresponding to an actual service scene; the service performance parameter refers to data obtained by a stress test.
The service data includes specific data corresponding to the execution operation, and the configuration parameter includes a mode of analyzing the service data. And training the performance test equipment by using the configuration parameters and the service data to obtain performance analysis results corresponding to at least two groups of configuration parameters. The performance test equipment is used for simulating the service scene, so that the performance test of at least two sets of configuration parameters can be realized, the influence of the at least two sets of configuration parameters on the performance of the database can be rapidly and accurately identified, and a better optimization scheme of the configuration parameters of the database is provided for users.
Next, a parameter selection method based on a service scenario provided in an embodiment of the present application is described in detail. Fig. 1 is a flowchart of a method for selecting parameters based on a service scenario according to an embodiment of the present application, where the method includes:
s201: and acquiring service data and configuration parameters corresponding to the service scene identification.
Wherein the configuration parameters may include at least two sets of configuration parameters.
In the embodiment of the application, in order to realize the comprehensive analysis of the service data in the service scene, the service data of a plurality of dimensional information can be acquired. In practical application, data from two sources can be merged to serve as service data corresponding to the service scene identifier.
In a specific implementation, scene data corresponding to a service scene identifier may be collected; testing the performance of the database according to a set pressure testing mode to obtain corresponding service performance parameters; and taking the scene data and the service performance parameters as service data corresponding to the service scene identification.
The scene data may include scene data set by the user based on the actual service scene, or scene data acquired based on an operation auditing manner.
Taking a service scenario with data query performance as a main example, the scenario data set by the user based on the actual service scenario may include specific data for performing read-write operation and the corresponding read-write times, read data amount, write data amount, and summary result of the data.
The scene data obtained by the operation auditing mode may be a service performance parameter set by a manager based on an actual service scene, taking a service scene with data query performance as an example, and the scene data obtained by the operation auditing mode may include actual read-write times that can be supported by a database in unit time.
In the embodiment of the application, the RDS may obtain the scene data corresponding to the database in the actual service scene by means of operation auditing.
The service performance parameter obtained based on the pressure test may be a service performance parameter obtained by testing the performance of the database according to a set pressure test mode. The pressure test mode can comprise that a plurality of read-write operations are carried out on the database at the same time, and the maximum read-write times supported by the database are tested; simultaneously reading a large amount of data from a database, and testing the maximum read data volume which can be supported by the database in unit time; and simultaneously writing a large amount of data into the database, testing the maximum write data amount which can be supported by the database in unit time, and the like. Correspondingly, the service performance parameters obtained based on the stress test may include a maximum number of times of reading and writing, a maximum amount of data to be read, a maximum amount of data to be written, and the like.
With reference to the scene diagram shown in fig. 1, the DMP may receive scene data set by a user based on an actual service scene, receive scene data transmitted by the RDS and acquired in an operation audit-based manner, and transmit the two types of data as scene data to the database performance testing tool. In addition, the database performance testing tool can also test the performance of the database according to a set pressure testing mode to obtain the service performance parameters corresponding to the pressure testing mode, so that the scene data transmitted by the DMP and the service performance parameters obtained through the pressure testing mode are used as the final corresponding service data of the service scene identifier.
S202: and training the performance test equipment by using the configuration parameters and the service data to obtain performance analysis results corresponding to at least two groups of configuration parameters.
The performance test equipment can realize the simulation of the service scene based on the configuration parameters and the service data, so as to obtain the performance analysis results corresponding to at least two groups of configuration parameters. The performance test device may adopt a cloud host or a virtual device, and in this embodiment, the type of the performance test device is not limited.
The configuration parameters include a method for analyzing the service data, for example, a maximum connection number, a size of a buffer pool, a number of threads to be read and written, and the like, which are required to be set by the system when processing the service data. Therefore, in practical application, the service data can be input to the performance testing equipment, so that the performance testing equipment can analyze the service data according to the configuration parameters and output a performance analysis result.
The performance analysis results may include various performance indicators, such as input/output rate of the database, hit rate, user query rate per second of the database, response time of the database, latency, throughput rate, number of concurrencies, etc. under the current configuration parameters.
S203: and determining the configuration parameters matched with the service scene identification based on the performance analysis results corresponding to the at least two groups of configuration parameters.
In the embodiment of the present application, in order to compare the performance analysis results corresponding to at least two sets of configuration parameters, the performance index included in each performance analysis result may be comprehensively evaluated to obtain a comprehensive performance value. And comparing the performance values of the two performance analysis results, thereby selecting a better configuration parameter.
In the embodiment of the present application, in order to calculate the performance value corresponding to the performance analysis result, a weight corresponding to each performance index may be set. For the same performance index, the weights corresponding to different values are all different, and in practical application, the weights corresponding to different value ranges of the performance index can be set. On the basis, in order to meet the requirements of service scenes, different weights can be set for the same performance index under different service scenes. The weight corresponding to the performance index under each service scene can be presented in the form of a weight list.
Taking at least two sets of configuration parameters including a first configuration parameter and a second configuration parameter as an example, in practical application, a weight list corresponding to each performance index may be queried to determine a first performance value corresponding to a performance analysis result of the first configuration parameter; and inquiring the weight list corresponding to each performance index to determine a second performance value corresponding to the performance analysis result of the second configuration parameter.
The weight corresponding to the performance index in the current service scene can be obtained by inquiring the weight list corresponding to each performance index, and the performance value corresponding to the performance analysis result can be obtained by adding the weights corresponding to all the performance indexes.
In the embodiment of the present application, in order to distinguish between a performance value corresponding to a performance analysis result of a first configuration parameter and a performance value corresponding to a performance analysis result of a second configuration parameter, the performance value corresponding to the performance analysis result of the first configuration parameter may be referred to as a first performance value, and the performance value corresponding to the performance analysis result of the second configuration parameter may be referred to as a second performance value.
In practical application, the weight value can be set according to the superiority of the performance index. The weight may be set higher when the performance index is more superior. Therefore, after determining the first performance value weight corresponding to the performance analysis result of the first configuration parameter and the second performance value weight corresponding to the performance analysis result of the second configuration parameter, the original configuration parameter can be maintained when the first performance value is higher than or equal to the second performance value. And under the condition that the second performance value is higher than the first performance value, taking the configuration parameter of the second configuration parameter as the configuration parameter matched with the service scene identifier.
In addition to calculating the performance value corresponding to the performance analysis result, different dimension information may be divided according to the performance index included in the performance analysis result. Different dimensional information contains different types of performance indexes.
In a specific implementation, performance indexes included in each performance analysis result can be divided according to set dimension information to obtain performance indexes corresponding to different dimension information; and comparing the performance indexes corresponding to at least two groups of configuration parameters under the same dimension information to determine the configuration parameters matched with the service scene identifier.
The dividing mode of the dimension information may be set by the user based on actual requirements, and is not limited herein.
For example, the service scenario has a high requirement on the processing efficiency, and the performance indicators affecting the processing efficiency include response time, delay, throughput rate, and the number of concurrencies, so that the response time, the delay, the throughput rate, and the number of concurrencies can be used as the performance indicators included in the same dimension information. Or, the service scenario has a high requirement on the correctness of the processing result, and the correctness index affecting the processing result includes the input/output rate and the hit rate of the database, so that the input/output rate and the hit rate can be used as the performance index included in the same dimension information.
By comparing the corresponding performance indexes under the same dimension information, the influence of at least two groups of configuration parameters on the performance contained in the dimension information can be identified.
In practical application, based on which dimension information has the highest performance requirement in the current service scenario, the performance indexes corresponding to at least two sets of configuration parameters in the dimension information are compared, and assuming that the performance index of the second configuration parameter is more optimal, the second configuration parameter is used as the configuration parameter matched with the service scenario identifier.
According to the technical scheme, the service data and the configuration parameters corresponding to the service scene identification are obtained; wherein the configuration parameters may include at least two sets of configuration parameters. The configuration parameters include a mode of analyzing the service data, and in order to understand the influence of modification of the configuration parameters on the performance of the database and not influence the operation of normal services, the configuration parameters and the service data can be used for training the performance test equipment, so that performance analysis results corresponding to at least two groups of configuration parameters are obtained. Based on the performance analysis result corresponding to each of the at least two sets of configuration parameters, the configuration parameter corresponding to the performance test device when the performance of the performance test device is better can be determined, and the configuration parameter is the configuration parameter matched with the service scene identifier. In the technical scheme, the performance test equipment is used for simulating the service scene to realize the performance test of at least two groups of configuration parameters, so that the influence of the modification of the configuration parameters on the performance of the database can be rapidly and accurately identified, and a better optimization scheme of the configuration parameters of the database is provided for a user. Under the condition of not influencing actual service, the influence of modification of the configuration parameters on the performance of the database can be quickly and accurately identified, so that the optimization of the configuration parameters of the database is intelligently provided according to different service scenes. By combining with the actual service scene, a personalized and convenient database performance optimization scheme can be provided.
In practical application, due to the limitation of the database configuration item, the hardware resources corresponding to the virtual machine device are relatively fixed, and considering that the hardware resources corresponding to the virtual machine device are also factors affecting the performance of the database, in the embodiment of the application, under the condition that the performance test device adopts the virtual machine device, after the performance test device is trained by using the configuration parameters and the service data, the hardware configuration corresponding to the virtual machine device can be adjusted; and training the virtual machine equipment after the hardware configuration is adjusted by using the configuration parameters and the service data to obtain a performance analysis result corresponding to the virtual machine equipment after the hardware configuration is adjusted.
Correspondingly, the configuration parameters matched with the service scene identifiers can be determined based on the performance analysis results corresponding to the at least two sets of configuration parameters and the performance analysis results corresponding to the performance test equipment after the hardware configuration is adjusted.
The hardware configuration may include indicators of parameters such as CPU, memory, hard disk, etc.
The hardware configuration corresponding to the virtual machine equipment has a corresponding relation with the configuration items of the database, and when the performance analysis result corresponding to the performance test equipment after the hardware configuration is adjusted belongs to the optimal result, the configuration items of the database can be adjusted based on the current hardware configuration.
In the embodiment of the application, quantitative evaluation of the influence of the database configuration item on the performance can be realized by adjusting the hardware configuration corresponding to the virtual machine equipment, so that the optimization of the database configuration item is realized.
Fig. 3 is a schematic structural diagram of a parameter selection apparatus based on a service scenario according to an embodiment of the present application, including an obtaining unit 31, a training unit 32, and a determining unit 33;
an obtaining unit 31, configured to obtain service data and configuration parameters corresponding to the service scene identifier; the configuration parameters comprise at least two groups of configuration parameters;
the training unit 32 is configured to train the performance testing device by using the configuration parameters and the service data to obtain performance analysis results corresponding to at least two sets of configuration parameters;
the determining unit 33 is configured to determine, based on the performance analysis result corresponding to each of the at least two sets of configuration parameters, a configuration parameter matching the service scene identifier.
Optionally, the training unit comprises an input subunit;
and the input subunit is used for inputting the service data into the performance test equipment so that the performance test equipment can analyze the service data according to the configuration parameters and output a performance analysis result.
Optionally, the acquiring unit includes an acquiring subunit, a testing subunit and a serving subunit;
the acquisition subunit is used for acquiring scene data corresponding to the service scene;
the test subunit is used for testing the performance of the database according to a set pressure test mode so as to obtain corresponding service performance parameters;
and the sub-unit is used for using the scene data and the service performance parameter as service data corresponding to the service scene identifier.
Optionally, the determining unit includes a dividing subunit and a comparing subunit;
the dividing subunit is used for dividing the performance indexes contained in the performance analysis results according to the set dimension information to obtain the performance indexes corresponding to different dimension information;
and the comparison subunit is used for comparing the performance indexes corresponding to the at least two groups of configuration parameters under the same dimension information to determine the configuration parameters matched with the service scene identifier.
Optionally, the at least two sets of configuration parameters include a first configuration parameter and a second configuration parameter, and the determining unit includes a first querying subunit, a second querying subunit, and a serving subunit;
the first query subunit is configured to query the weight lists corresponding to the performance indicators to determine a first performance value corresponding to the performance analysis result of the first configuration parameter;
the second query subunit is configured to query the weight lists corresponding to the performance indicators to determine a second performance value corresponding to the performance analysis result of the second configuration parameter;
and the sub-unit is used for taking the second configuration parameter as the configuration parameter matched with the service scene identifier under the condition that the second performance value is higher than the first performance value.
Optionally, the performance test device is a virtual machine device; the device further comprises an adjusting unit;
the adjusting unit is used for adjusting the hardware configuration corresponding to the virtual machine equipment;
and the training unit is used for training the virtual machine equipment after the hardware configuration is adjusted by using the configuration parameters and the service data so as to obtain a performance analysis result corresponding to the virtual machine equipment after the hardware configuration is adjusted.
Optionally, the determining unit is configured to determine the configuration parameters matched with the service scene identifier based on performance analysis results corresponding to the at least two sets of configuration parameters and performance analysis results corresponding to the performance testing device after the hardware configuration is adjusted.
The description of the features in the embodiment corresponding to fig. 3 may refer to the related description of the embodiment corresponding to fig. 1, and is not repeated here.
According to the technical scheme, the service data and the configuration parameters corresponding to the service scene identification are obtained; wherein the configuration parameters may include at least two sets of configuration parameters. The configuration parameters include a mode of analyzing the service data, and in order to understand the influence of modification of the configuration parameters on the performance of the database and not influence the operation of normal services, the configuration parameters and the service data can be used for training the performance test equipment, so that performance analysis results corresponding to at least two groups of configuration parameters are obtained. Based on the performance analysis result corresponding to each of the at least two sets of configuration parameters, the configuration parameter corresponding to the performance test device when the performance of the performance test device is better can be determined, and the configuration parameter is the configuration parameter matched with the service scene identifier. In the technical scheme, the performance test equipment is used for simulating the service scene to realize the performance test of at least two groups of configuration parameters, so that the influence of the modification of the configuration parameters on the performance of the database can be rapidly and accurately identified, and a better optimization scheme of the configuration parameters of the database is provided for a user. Under the condition of not influencing actual service, the influence of modification of the configuration parameters on the performance of the database can be quickly and accurately identified, so that the optimization of the configuration parameters of the database is intelligently provided according to different service scenes. By combining with the actual service scene, a personalized and convenient database performance optimization scheme can be provided.
Fig. 4 is a structural diagram of a service scenario-based parameter selection device according to another embodiment of the present application, and as shown in fig. 4, the service scenario-based parameter selection device includes: a memory 20 for storing a computer program;
a processor 21, configured to execute a computer program to implement the steps of the service scenario based parameter selection method according to the above embodiment.
The service scene-based parameter selection device provided in this embodiment may include, but is not limited to, a smart phone, a tablet computer, a notebook computer, or a desktop computer.
The processor 21 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 21 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 21 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 21 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, the processor 21 may further include an AI (Artificial Intelligence) processor for processing a calculation operation related to machine learning.
The memory 20 may include one or more computer-readable storage media, which may be non-transitory. Memory 20 may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In this embodiment, the memory 20 is at least used for storing the following computer program 201, wherein after being loaded and executed by the processor 21, the computer program can implement the relevant steps of the parameter selection method based on the service scenario disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 20 may also include an operating system 202, data 203, and the like, and the storage manner may be a transient storage manner or a permanent storage manner. Operating system 202 may include, among others, Windows, Unix, Linux, and the like. Data 203 may include, but is not limited to, traffic data, configuration parameters, performance analysis results, and the like.
In some embodiments, the parameter selection device based on the service scenario may further include a display 22, an input/output interface 23, a communication interface 24, a power supply 25, and a communication bus 26.
Those skilled in the art will appreciate that the architecture shown in FIG. 4 does not constitute a limitation on the business scenario-based parameter selection device, and may include more or fewer components than those shown.
It is understood that, if the parameter selection method based on the service scenario in the above embodiment is implemented in the form of a software functional unit and sold or used as a stand-alone product, it may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application may be substantially or partially implemented in the form of a software product, which is stored in a storage medium and executes all or part of the steps of the methods of the embodiments of the present application, or all or part of the technical solutions. And the aforementioned storage medium includes: a U disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), an electrically erasable programmable ROM, a register, a hard disk, a removable magnetic disk, a CD-ROM, a magnetic or optical disk, and other various media capable of storing program codes.
Based on this, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of any one of the above-mentioned parameter selection methods based on the service scenario are implemented.
The functions of the functional modules of the computer-readable storage medium according to the embodiment of the present invention may be specifically implemented according to the method in the foregoing method embodiment, and the specific implementation process may refer to the related description of the foregoing method embodiment, which is not described herein again.
The method, the device, the equipment and the computer-readable storage medium for selecting the parameters based on the service scene provided by the embodiment of the application are described in detail above. The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The method, the apparatus, the device and the computer-readable storage medium for selecting parameters based on service scenarios provided by the present application are described in detail above. The principles and embodiments of the present invention are explained herein using specific examples, which are presented only to assist in understanding the method and its core concepts. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present application.
Claims (10)
1. A parameter selection method based on service scenes is characterized by comprising the following steps:
acquiring service data and configuration parameters corresponding to the service scene identification; wherein the configuration parameters comprise at least two sets of configuration parameters;
training performance test equipment by using the configuration parameters and the service data to obtain performance analysis results corresponding to at least two groups of configuration parameters;
and determining the configuration parameters matched with the service scene identification based on the performance analysis result corresponding to the at least two groups of configuration parameters.
2. The method of claim 1, wherein the training a performance testing device using the configuration parameters and the service data to obtain performance analysis results corresponding to at least two sets of configuration parameters comprises:
and inputting the service data into the performance test equipment so that the performance test equipment can analyze the service data according to the configuration parameters and output a performance analysis result.
3. The method for selecting parameters based on service scenario according to claim 1, wherein the acquiring the service data corresponding to the service scenario identifier comprises:
collecting scene data corresponding to the service scene identification;
testing the performance of the database according to a set pressure testing mode to obtain corresponding service performance parameters;
and taking the scene data and the service performance parameters as service data corresponding to the service scene identification.
4. The method of claim 1, wherein the determining the configuration parameter matching the service scene identifier based on the performance analysis result corresponding to each of the at least two sets of configuration parameters comprises:
dividing the performance indexes contained in each performance analysis result according to set dimension information to obtain performance indexes corresponding to different dimension information;
and comparing the performance indexes corresponding to at least two groups of configuration parameters under the same dimension information to determine the configuration parameters matched with the service scene identifier.
5. The method of claim 1, wherein the at least two sets of configuration parameters include a first configuration parameter and a second configuration parameter, and wherein determining the configuration parameter matching the service scene identifier based on the performance analysis result corresponding to each of the at least two sets of configuration parameters comprises:
inquiring a weight list corresponding to each performance index to determine a first performance value corresponding to a performance analysis result of the first configuration parameter;
inquiring a weight list corresponding to each performance index to determine a second performance value corresponding to the performance analysis result of the second configuration parameter;
and taking the second configuration parameter as the configuration parameter matched with the service scene identification under the condition that the second performance value is higher than the first performance value.
6. The method for selecting parameters based on service scenario according to claim 1, wherein the performance testing device is a virtual machine device; after the training of the performance testing device by using the configuration parameters and the service data, the method further comprises:
adjusting hardware configuration corresponding to the virtual machine equipment;
and training the virtual machine equipment after the hardware configuration is adjusted by using the configuration parameters and the service data to obtain a performance analysis result corresponding to the virtual machine equipment after the hardware configuration is adjusted.
7. The method of claim 6, further comprising:
and determining the configuration parameters matched with the service scene identifier based on the performance analysis results corresponding to the at least two groups of configuration parameters and the performance analysis results corresponding to the performance test equipment after the hardware configuration is adjusted.
8. A parameter selection device based on a service scene is characterized by comprising an acquisition unit, a training unit and a determination unit;
the acquiring unit is used for acquiring the service data and the configuration parameters corresponding to the service scene identification; wherein the configuration parameters comprise at least two sets of configuration parameters;
the training unit is used for training the performance test equipment by using the configuration parameters and the service data to obtain performance analysis results corresponding to at least two groups of configuration parameters;
and the determining unit is used for determining the configuration parameters matched with the service scene identifiers based on the performance analysis results corresponding to the at least two groups of configuration parameters.
9. A parameter selection device based on a service scenario is characterized by comprising:
a memory for storing a computer program;
a processor for executing said computer program to implement the steps of the service scenario based parameter selection method according to any of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method for service context based parameter selection according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111275590.5A CN114003310A (en) | 2021-10-29 | 2021-10-29 | Parameter selection method, device, equipment and medium based on service scene |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111275590.5A CN114003310A (en) | 2021-10-29 | 2021-10-29 | Parameter selection method, device, equipment and medium based on service scene |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114003310A true CN114003310A (en) | 2022-02-01 |
Family
ID=79925464
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111275590.5A Pending CN114003310A (en) | 2021-10-29 | 2021-10-29 | Parameter selection method, device, equipment and medium based on service scene |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114003310A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105022693A (en) * | 2015-08-10 | 2015-11-04 | 网易（杭州）网络有限公司 | Method and apparatus for testing performance of application |
| CN108763076A (en) * | 2018-05-22 | 2018-11-06 | 深圳乐信软件技术有限公司 | A kind of Software Automatic Testing Method, device, equipment and medium |
| CN109117370A (en) * | 2018-08-07 | 2019-01-01 | Oppo广东移动通信有限公司 | Game test method and Related product |
| CN109520744A (en) * | 2018-11-12 | 2019-03-26 | 百度在线网络技术（北京）有限公司 | The driving performance test method and device of automatic driving vehicle |
| US20200076721A1 (en) * | 2018-08-29 | 2020-03-05 | Comcast Cable Communications, Llc | Methods and systems for internet speed testing |
| CN111523825A (en) * | 2020-05-11 | 2020-08-11 | 苏交科集团股份有限公司 | Multi-dimensional-based method for evaluating long-term performance of asphalt pavement of highway |
| CN111625434A (en) * | 2020-05-08 | 2020-09-04 | 苏州浪潮智能科技有限公司 | Database OLTP benchmark performance test method, system and related components |
| CN113392607A (en) * | 2020-03-12 | 2021-09-14 | 华为技术有限公司 | Method for determining configuration parameters and related equipment |
-
2021
- 2021-10-29 CN CN202111275590.5A patent/CN114003310A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105022693A (en) * | 2015-08-10 | 2015-11-04 | 网易（杭州）网络有限公司 | Method and apparatus for testing performance of application |
| CN108763076A (en) * | 2018-05-22 | 2018-11-06 | 深圳乐信软件技术有限公司 | A kind of Software Automatic Testing Method, device, equipment and medium |
| CN109117370A (en) * | 2018-08-07 | 2019-01-01 | Oppo广东移动通信有限公司 | Game test method and Related product |
| US20200076721A1 (en) * | 2018-08-29 | 2020-03-05 | Comcast Cable Communications, Llc | Methods and systems for internet speed testing |
| CN109520744A (en) * | 2018-11-12 | 2019-03-26 | 百度在线网络技术（北京）有限公司 | The driving performance test method and device of automatic driving vehicle |
| CN113392607A (en) * | 2020-03-12 | 2021-09-14 | 华为技术有限公司 | Method for determining configuration parameters and related equipment |
| CN111625434A (en) * | 2020-05-08 | 2020-09-04 | 苏州浪潮智能科技有限公司 | Database OLTP benchmark performance test method, system and related components |
| CN111523825A (en) * | 2020-05-11 | 2020-08-11 | 苏交科集团股份有限公司 | Multi-dimensional-based method for evaluating long-term performance of asphalt pavement of highway |
Non-Patent Citations (1)
| Title |
|---|
| 庄岭;赵新建;李维;王召;籍天明;: "面向数据库云化的企业级高性能一体机性能评价模型", 计算机应用与软件, no. 05, pages 150 - 154 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI718643B (en) | Method and device for identifying abnormal groups | |
| CN110941424B (en) | Compiling parameter optimization method and device and electronic equipment | |
| CN109891508A (en) | Single cell type detection method, device, equipment and storage medium | |
| US8725461B2 (en) | Inferring effects of configuration on performance | |
| US9852244B2 (en) | Efficient waveform generation for emulation | |
| CN111460011A (en) | Page data display method and device, server and storage medium | |
| CN107293308A (en) | A kind of audio-frequency processing method and device | |
| CN110362453A (en) | Log statistic alarm method and device, terminal and storage medium | |
| CN111445304A (en) | Information recommendation method and device, computer equipment and storage medium | |
| CN103399797A (en) | Server resource allocation method and device | |
| CN109669917A (en) | A kind of Waveform storage method based on priority packet | |
| CN108897765A (en) | A kind of batch data introduction method and its system | |
| CN107885628A (en) | A kind of method of testing, device and the equipment of magnetic disc i/o performance | |
| CN110363248A (en) | The computer identification device and method of mobile crowdsourcing test report based on image | |
| CN115794570A (en) | Pressure testing method, device, equipment and computer readable storage medium | |
| US10120965B2 (en) | Waveform based reconstruction for emulation | |
| CN110543426A (en) | software performance risk detection method and device | |
| CN114003310A (en) | Parameter selection method, device, equipment and medium based on service scene | |
| CN110544166A (en) | Sample generation method, device and storage medium | |
| CN109696614B (en) | Circuit test optimization method and device | |
| CN108229572B (en) | Parameter optimization method and computing equipment | |
| CN113434507B (en) | Data textualization method, device, equipment and storage medium | |
| CN115081515A (en) | Energy efficiency evaluation model construction method and device, terminal and storage medium | |
| CN108280224A (en) | Ten thousand grades of dimension data generation methods, device, equipment and storage medium | |
| US10740521B1 (en) | System and method for localized logic simulation replay using emulated values |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |