WO2020238965A1 - Production environment performance evaluation method and apparatus, and storage medium - Google Patents

Production environment performance evaluation method and apparatus, and storage medium Download PDF

Info

Publication number
WO2020238965A1
WO2020238965A1 PCT/CN2020/092638 CN2020092638W WO2020238965A1 WO 2020238965 A1 WO2020238965 A1 WO 2020238965A1 CN 2020092638 W CN2020092638 W CN 2020092638W WO 2020238965 A1 WO2020238965 A1 WO 2020238965A1
Authority
WO
WIPO (PCT)
Prior art keywords
production environment
evaluated
performance evaluation
performance
tps
Prior art date
Application number
PCT/CN2020/092638
Other languages
French (fr)
Chinese (zh)
Inventor
安继贤
李晶
晋晓峰
盛勤
Original Assignee
深圳前海微众银行股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳前海微众银行股份有限公司 filed Critical 深圳前海微众银行股份有限公司
Publication of WO2020238965A1 publication Critical patent/WO2020238965A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3452Performance evaluation by statistical analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466Performance evaluation by tracing or monitoring
    • G06F11/3476Data logging

Definitions

  • This application relates to the technical field of financial technology (Fintech), in particular to a method, device and computer-readable storage medium for performance evaluation of a production environment.
  • the main purpose of this application is to propose a production environment performance evaluation method, device, and computer-readable storage medium, which aims to solve the technical problems of cumbersome operation procedures and low evaluation efficiency of the exemplary production environment evaluation method.
  • the performance evaluation method for the production environment includes the following steps:
  • the performance test report simultaneously displays the relevant index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the performance evaluation of the production environment.
  • the related index parameters include TPS_T (requests per second in the test environment), CC_T (total number of CPUs in the test environment), and RU_T (CPU usage percentage in the test environment), according to the relevant index parameters , Resource configuration parameters and preset calculation rules, the steps of calculating the number of requests per second of the production environment to be evaluated include:
  • the calculated value CP_PerC of each CPU is calculated, where the calculation formula of CP_PerC is:
  • CP_PerC TPS_T/(CC_T*RU_T);
  • the number of requests per second of the production environment to be evaluated is calculated.
  • the resource configuration parameters include CC_P (the number of CPUs in each server in the production environment to be evaluated), SN_P (the number of deployment servers in the production environment to be evaluated), and RT_P (the CPU in the production environment to be evaluated) Occupancy limit) and Rd (the percentage of CPU work loss of the production environment to be evaluated).
  • the step of calculating the number of requests per second of the production environment to be evaluated according to the resource configuration parameters and the CP_PerC includes:
  • TPS_P the number of requests per second TPS_P of the production environment to be evaluated is calculated, where the calculation formula of TPS_P is:
  • TPS_P CP_PerC*CC_P*SN_P*RT_P*(1-Rd).
  • the method further includes:
  • the method further includes:
  • the resource evaluation instruction is received, and the request per second threshold TPS_Y in the resource evaluation instruction is acquired;
  • the SN_P and the SN_Y determine whether it is necessary to expand or reduce the capacity of the production environment to be evaluated
  • the number of servers to be expanded is determined according to the difference between the SN_P and SN_Y.
  • the calculation formula of SN_Y is:
  • SN_Y TPS_Y/CP_PerC/CC_P-SN_P.
  • the method further includes:
  • the number of servers to be reduced is determined according to the difference between the SN_P and SN_Y.
  • the step of calculating the number of requests per second of the production environment to be evaluated according to the related index parameters, resource configuration parameters and preset calculation rules includes:
  • the relevant index parameters and resource configuration parameters are calculated according to the preset calculation rules to generate the number of requests per second of the production environment to be evaluated.
  • the present application also provides a performance evaluation device for a production environment.
  • the performance evaluation device for a production environment includes: a memory, a processor, and a memory, a processor, and a memory and a processor that are stored in the memory and run on the processor.
  • the performance evaluation program of the production environment when the performance evaluation program of the production environment is executed by the processor, the following steps are implemented:
  • the performance test report simultaneously displays the related index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the performance evaluation of the production environment.
  • the related index parameters include TPS_T (requests per second in the test environment), CC_T (total number of CPUs in the test environment), and RU_T (percentage of CPU usage in the test environment).
  • TPS_T requests per second in the test environment
  • CC_T total number of CPUs in the test environment
  • RU_T percentage of CPU usage in the test environment
  • the calculated value CP_PerC of each CPU is calculated, where the calculation formula of CP_PerC is:
  • CP_PerC TPS_T/(CC_T*RU_T);
  • the number of requests per second of the production environment to be evaluated is calculated.
  • the resource configuration parameters include CC_P (the number of CPUs in each server in the production environment to be evaluated), SN_P (the number of deployment servers in the production environment to be evaluated), and RT_P (the CPU in the production environment to be evaluated) Occupancy limit) and Rd (the percentage of work loss of the CPU in the production environment to be evaluated), the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
  • TPS_P the number of requests per second TPS_P of the production environment to be evaluated is calculated, where the calculation formula of TPS_P is:
  • TPS_P CP_PerC*CC_P*SN_P*RT_P*(1-Rd).
  • the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
  • the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
  • Receiving the resource evaluation instruction obtain the request per second threshold TPS_Y in the resource evaluation instruction
  • the SN_P and the SN_Y determine whether it is necessary to expand or reduce the capacity of the production environment to be evaluated
  • the number of servers to be expanded is determined according to the difference between the SN_P and SN_Y.
  • the calculation formula of SN_Y is:
  • SN_Y TPS_Y/CP_PerC/CC_P-SN_P.
  • the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
  • the number of servers to be reduced is determined according to the difference between the SN_P and SN_Y.
  • the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
  • the relevant index parameters and resource configuration parameters are calculated according to the preset calculation rules to generate the number of requests per second of the production environment to be evaluated.
  • the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a performance evaluation program for the production environment, and the performance evaluation program for the production environment is executed when the processor is executed. The steps of the performance evaluation method of the production environment as described above.
  • this application When receiving the system performance test request, this application obtains the relevant index parameters of the test environment to which the system belongs and the resource configuration parameters of the production environment to be evaluated; calculates according to the relevant index parameters, resource configuration parameters, and preset calculation rules The number of requests per second of the production environment to be evaluated; the performance test report simultaneously displays the relevant index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the performance evaluation of the production environment.
  • this application calculates and estimates the number of requests per second of the production environment to be evaluated through the relevant index parameters of the test environment and the resource configuration parameters of the production environment to be evaluated, and displays the performance test report of the system at the same time.
  • the number of requests per second of the production environment to be evaluated simplifies the evaluation operation process of the production environment, improves the evaluation efficiency, and solves the technical problem of the cumbersome operation process of the evaluation method of the exemplary production environment and low evaluation efficiency.
  • FIG. 1 is a schematic diagram of a device structure of a hardware operating environment involved in a solution of an embodiment of the present application
  • FIG. 2 is a schematic flowchart of the first embodiment of the performance evaluation method for the production environment of this application.
  • FIG. 1 is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present application.
  • the performance evaluation device in the production environment of the embodiment of the application may be a PC or a server device, on which a Java virtual machine runs.
  • the performance evaluation device of the production environment may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002.
  • the communication bus 1002 is used to implement connection and communication between these components.
  • the user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
  • the network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).
  • the memory 1005 may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as a magnetic disk memory.
  • the memory 1005 may also be a storage device independent of the aforementioned processor 1001.
  • FIG. 1 does not constitute a limitation on the device, and may include more or fewer components than those shown in the figure, or a combination of certain components, or different component arrangements.
  • the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a performance evaluation program of a production environment.
  • the network interface 1004 is mainly used to connect to the back-end server and communicate with the back-end server;
  • the user interface 1003 is mainly used to connect to the client (user side) and communicate with the client;
  • the processor 1001 can be used to call the performance evaluation program of the production environment stored in the memory 1005, and perform operations in the performance evaluation method of the production environment described below.
  • Fig. 2 is a schematic flowchart of a first embodiment of a performance evaluation method for a production environment of this application, and the method includes:
  • Step S10 a system performance test request is received, and relevant index parameters of the test environment to which the system belongs and resource configuration parameters of the production environment to be evaluated are obtained;
  • the performance evaluation results of the production environment are used to guide the resource deployment of the production environment of the system to be tested.
  • the performance evaluation of the production environment is performed by the operation and maintenance personnel based on the relevant index data of the tester's performance test of the system to be tested and the configuration parameters of the production environment, and then the performance evaluation based on the operation and maintenance personnel's own previous production operation and maintenance experience.
  • the performance testers after receiving the project performance test requirements, the performance testers will design performance test scenarios and performance test cases according to the project requirements, and obtain performance test results according to the use cases, and finally output a performance test result report.
  • the operation and maintenance personnel For the operation and maintenance personnel, they need to pay attention to the performance of the production environment after the project goes online.
  • the operation and maintenance personnel will evaluate the production environment based on the performance test result report output by the tester, as well as the environment deployment of the production environment, and the operation and maintenance experience To determine whether the current machine configuration meets the business volume after the project goes online, and whether the production environment is expanded. Therefore, the current performance evaluation methods of the production environment have high labor costs, complicated processes, and involve testers, operation and maintenance personnel in multiple positions, and multiple result reports.
  • this embodiment provides a performance evaluation method for the production environment.
  • the number of requests per second of the production environment to be evaluated is calculated through the relevant index parameters of the test environment and the resource configuration parameters of the production environment to be evaluated. And when the performance test report of the system is displayed, the number of requests per second of the production environment to be evaluated is also displayed, which simplifies the evaluation operation process of the production environment and improves the evaluation efficiency.
  • the relevant index parameters of the test environment of the system to be tested are acquired, where the relevant index parameters include TPS_T, CC_T, and RU_T, and TPS_T is the measured per second in the test environment
  • TPS_T is the measured per second in the test environment
  • the number of requests, CC_T is the total number of CPUs in the test environment
  • RU_T is the percentage of resource usage in the test environment.
  • CC_P is the number of CPUs in each server in the production environment to be evaluated
  • SN_P is the production environment to be evaluated
  • RT_P is the CPU occupancy limit of the production environment to be evaluated, that is, a resource usage threshold is generally set in the production environment. If this threshold is exceeded, a resource limit alarm will occur
  • Rd is the CPU of the production environment to be evaluated
  • the percentage of work loss that is, the percentage of resource loss caused by multiple servers working together in a distributed environment.
  • Step S20 Calculate the number of requests per second of the production environment to be evaluated according to the relevant index parameters, resource configuration parameters and preset calculation rules;
  • the calculation value per core of the test environment is 37
  • the number of cores per server in the production environment is 4
  • the system under test is deployed on 20 servers in the production environment
  • the CPU usage limit in the production environment is 70%
  • the distributed environment The performance loss caused by the cooperation of multiple servers is 0.05%.
  • Step S30 simultaneously displaying the relevant index parameters and the number of requests per second of the production environment to be evaluated through the performance test report, so as to guide the user to perform the performance evaluation of the production environment.
  • the performance data of the production environment can be calculated in a standardized manner, that is, the number of requests per second of the production environment to be evaluated.
  • the performance test results also includes the information about the production environment.
  • Performance calculation, and unified display in the performance test report it is convenient to guide operation and maintenance personnel in resource evaluation and capacity planning. Therefore, when the tester completes the performance test in the test environment, he can automatically calculate the performance data indicators of the production environment according to the current test data and production environment configuration, and according to certain product performance calculation methods, which are the same as the test environment performance
  • the test results are attached to the performance test report. It solves the problem that there is no set of automated methods or formulas to unite the work of testers and operation and maintenance personnel for one-stop result output.
  • this application calculates and estimates the number of requests per second of the production environment to be evaluated through the relevant index parameters of the test environment and the resource configuration parameters of the production environment to be evaluated, and displays the performance test report of the system at the same time.
  • the number of requests per second of the production environment to be evaluated simplifies the evaluation operation process of the production environment, improves the evaluation efficiency, and solves the technical problem of the cumbersome operation process of the evaluation method of the exemplary production environment and low evaluation efficiency.
  • the performance evaluation method of the production environment further includes:
  • a preset performance evaluation report template corresponding to the generation environment is obtained. Then fill in the relevant index parameters of the test environment, the resource configuration parameters of the generation environment to be evaluated, and the calculated number of requests per second TPS_P of the production environment to be evaluated according to the preset filling relationship set in the mapping table. Preset the corresponding area set in the performance evaluation report template, generate the corresponding performance evaluation report, and provide an export interface.
  • the above-mentioned data in the performance evaluation report of the value to be filled is all stored in the performance platform to facilitate subsequent reading.
  • the performance test report carrying the requests per second of the production environment to be evaluated may be displayed in feedback according to the performance evaluation report instruction.
  • the performance evaluation method of the production environment further includes:
  • the resource evaluation instruction is received, and the request per second threshold TPS_Y in the resource evaluation instruction is acquired;
  • the SN_P and the SN_Y determine whether it is necessary to expand or reduce the capacity of the production environment to be evaluated
  • the number of servers to be expanded is determined according to the difference between the SN_P and SN_Y.
  • the number of servers to be reduced is determined according to the difference between the SN_P and SN_Y.
  • the request per second threshold TPS_Y set in the resource evaluation instruction is acquired, and the request per second threshold TPS_Y is combined with the resource configuration parameters of the production environment, that is, each CPU
  • the calculated value of CP_PerC, the number of CPUs CC_P of each server in the production environment to be evaluated, the number of deployment servers SN_P in the production environment to be evaluated, and the calculation formula of the SN_Y calculate the server number threshold SN_Y, where the SN_Y
  • the SN_P and the SN_Y are compared to determine whether the current server number SN_P of the production environment reaches the server number threshold SN_Y, so as to determine whether the production environment to be evaluated needs to be expanded or reduced. If the current server number SN_P of the production environment exceeds the server number threshold SN_Y, the production environment needs to be reduced, and the number of servers to be reduced is determined according to the difference between the SN_P and SN_Y; If the current server number SN_P of the production environment is lower than the server number threshold SN_Y, the production environment needs to be expanded, and the number of servers to be expanded is determined according to the difference between the SN_P and SN_Y.
  • a fault tolerance value may be set, that is, the difference between the current server number SN_P of the production environment and the server number threshold SN_Y is within the fault tolerance value, and there is no need to adjust the resources of the production environment.
  • step S30 specifically includes:
  • the relevant index parameters and resource configuration parameters are calculated according to the preset calculation rules to generate the number of requests per second of the production environment to be evaluated.
  • the performance of the production environment can also be calculated in other ways. For example: embed the above two calculation formulas into the Execl table, after the performance test is completed, import the relevant index parameters and resource configuration parameter data into the Execl table, and calculate the number of requests per second of the production environment to be evaluated by Execl .
  • the calculation formula and related data of whether capacity expansion or contraction is required can also be imported into the Execl table, and the current server number SN_P in the production environment and the server number threshold SN_Y can be obtained through Execl calculation.
  • the application also provides a performance evaluation device for the production environment.
  • the performance evaluation device of the production environment includes a memory, a processor, and a performance evaluation program of the production environment stored on the memory and capable of running on the processor, and the performance evaluation program of the production environment is processed by the The following steps are implemented when the device is executed:
  • the performance test report simultaneously displays the relevant index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the performance evaluation of the production environment.
  • the relevant index parameters include TPS_T (the number of requests per second in the test environment), CC_T (the total number of CPUs in the test environment), and RU_T (the percentage of CPU usage in the test environment), and the performance evaluation program of the production environment is
  • TPS_T the number of requests per second in the test environment
  • CC_T the total number of CPUs in the test environment
  • RU_T the percentage of CPU usage in the test environment
  • the calculated value CP_PerC of each CPU is calculated, where the calculation formula of CP_PerC is:
  • CP_PerC TPS_T/(CC_T*RU_T);
  • the number of requests per second of the production environment to be evaluated is calculated.
  • the resource configuration parameters include CC_P (the number of CPUs of each server in the production environment to be evaluated), SN_P (the number of deployment servers in the production environment to be evaluated), and RT_P (the CPU occupation limit of the production environment to be evaluated) And Rd (the work loss percentage of the CPU in the production environment to be evaluated), when the performance evaluation program of the production environment is executed by the processor, the following steps are implemented:
  • TPS_P the number of requests per second TPS_P of the production environment to be evaluated is calculated, where the calculation formula of TPS_P is:
  • TPS_P CP_PerC*CC_P*SN_P*RT_P*(1-Rd).
  • Receiving the resource evaluation instruction obtain the request per second threshold TPS_Y in the resource evaluation instruction
  • the SN_P and the SN_Y determine whether it is necessary to expand or reduce the capacity of the production environment to be evaluated
  • the number of servers to be expanded is determined according to the difference between the SN_P and SN_Y.
  • SN_Y TPS_Y/CP_PerC/CC_P-SN_P.
  • the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
  • the number of servers to be reduced is determined according to the difference between the SN_P and SN_Y.
  • the relevant index parameters and resource configuration parameters are calculated according to the preset calculation rules to generate the number of requests per second of the production environment to be evaluated.
  • the application also provides a computer-readable storage medium.
  • the computer-readable storage medium of the present application stores the performance evaluation program of the production environment, and the performance evaluation program of the production environment is executed by the processor to realize the steps of the performance evaluation method of the production environment as described above.
  • the method implemented when the performance evaluation program of the production environment running on the processor is executed can refer to the various embodiments of the performance evaluation method of the production environment of the present application, which will not be repeated here.

Abstract

Disclosed in the present application is a production environment performance evaluation method, comprising: when a system performance test request is received, obtaining relevant index parameters of a test environment to which a system belongs and resource configuration parameters of a production environment to be evaluated; calculating the number of requests per second of the production environment according to the relevant index parameters, the resource configuration parameters, and a preset calculation rule; and displaying the relevant index parameters and the number of requests per second of the production environment at the same time by means of a performance test report so as to guide a user to evaluate the performance of the production environment.

Description

生产环境的性能评估方法、装置及存储介质Performance evaluation method, device and storage medium of production environment
本申请要求2019年5月31日申请的,申请号为201910475996.4,名称为“生产环境的性能评估方法、装置、设备及存储介质”的中国专利申请的优先权,在此将其全文引入作为参考。This application claims the priority of the Chinese patent application filed on May 31, 2019, with the application number 201910475996.4, titled "Production Environment Performance Evaluation Method, Device, Equipment, and Storage Medium", the full text of which is hereby incorporated by reference .
技术领域Technical field
本申请涉及金融科技(Fintech)技术领域,尤其涉及生产环境的性能评估方法、装置及计算机可读存储介质。This application relates to the technical field of financial technology (Fintech), in particular to a method, device and computer-readable storage medium for performance evaluation of a production environment.
背景技术Background technique
随着计算机技术的发展,越来越多的技术(大数据、分布式、区块链Blockchain、人工智能等)应用在金融领域,传统金融业正在逐步向金融科技(Fintech)转变。金融科技的系统项目日益增多,系统项目的性能测试与生成环境的性能评估需求也日益增长。目前,性能测试人员在接收到项目性能测试需求后,需要输出一份性能测试结果报告,然后运维人员会根据测试人员输出的性能测试结果报告,结合生产环境的环境部署情况以及自己的运维经验,对该生产环境的性能进行评估,从而确定当前的机器配置是否满足项目上线后的业务量。因此,示例性生产环境的评估方法不仅操作流程繁琐,而且评估效率低下。With the development of computer technology, more and more technologies (Big Data, Distributed, Blockchain, Artificial Intelligence, etc.) are applied in the financial field, and the traditional financial industry is gradually changing to Fintech. Fintech system projects are increasing, and the demand for performance testing of system projects and performance evaluation of the generation environment is also increasing. Currently, performance testers need to output a performance test result report after receiving the project performance test requirements, and then the operation and maintenance personnel will report on the performance test results output by the testers, combined with the environment deployment of the production environment and their own operation and maintenance Experience, evaluate the performance of the production environment to determine whether the current machine configuration meets the business volume after the project goes online. Therefore, the evaluation method of the exemplary production environment not only has a cumbersome operation process, but also has low evaluation efficiency.
发明概述Summary of the invention
技术问题technical problem
问题的解决方案The solution to the problem
技术解决方案Technical solutions
本申请的主要目的在于提出一种生产环境的性能评估方法、装置及计算机可读存储介质,旨在解决示例性生产环境的评估方法操作流程繁琐且评估效率低下的技术问题。The main purpose of this application is to propose a production environment performance evaluation method, device, and computer-readable storage medium, which aims to solve the technical problems of cumbersome operation procedures and low evaluation efficiency of the exemplary production environment evaluation method.
为实现上述目的,本申请提供一种生产环境的性能评估方法,所述生产环境的性能评估方法包括如下步骤:In order to achieve the above objective, the present application provides a performance evaluation method for a production environment. The performance evaluation method for the production environment includes the following steps:
接收到系统性能测试请求,获取所述系统所属测试环境的相关指标参数以及待 评估生产环境的资源配置参数;Receiving a system performance test request, obtaining relevant index parameters of the test environment to which the system belongs and resource configuration parameters of the production environment to be evaluated;
根据所述相关指标参数、资源配置参数以及预设计算规则,计算出所述待评估生产环境的每秒请求数;Calculate the number of requests per second of the production environment to be evaluated according to the relevant index parameters, resource configuration parameters, and preset calculation rules;
通过所述性能测试报告同时显示所述相关指标参数以及待评估生产环境的每秒请求数,以便指导用户进行所述生产环境的性能评估。The performance test report simultaneously displays the relevant index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the performance evaluation of the production environment.
在一实施例中,所述相关指标参数包括TPS_T(测试环境的每秒请求数)、CC_T(测试环境的CPU总数)以及RU_T(测试环境的CPU使用百分比),所述根据所述相关指标参数、资源配置参数以及预设计算规则,计算出所述待评估生产环境的每秒请求数的步骤包括:In an embodiment, the related index parameters include TPS_T (requests per second in the test environment), CC_T (total number of CPUs in the test environment), and RU_T (CPU usage percentage in the test environment), according to the relevant index parameters , Resource configuration parameters and preset calculation rules, the steps of calculating the number of requests per second of the production environment to be evaluated include:
根据所述TPS_T、CC_T以及RU_T,计算出每个CPU的计算值CP_PerC,其中,CP_PerC的计算公式为:According to the TPS_T, CC_T, and RU_T, the calculated value CP_PerC of each CPU is calculated, where the calculation formula of CP_PerC is:
CP_PerC=TPS_T/(CC_T*RU_T);CP_PerC=TPS_T/(CC_T*RU_T);
根据所述资源配置参数以及所述CP_PerC,计算出所述待评估生产环境的每秒请求数。According to the resource configuration parameter and the CP_PerC, the number of requests per second of the production environment to be evaluated is calculated.
在一实施例中,所述资源配置参数包括CC_P(待评估生产环境中每台服务器具有的CPU的个数)、SN_P(待评估生产环境的部署服务器数量)、RT_P(待评估生产环境的CPU占用限额)以及Rd(待评估生产环境的CPU的工作损耗百分比),所述根据资源配置参数以及所述CP_PerC,计算出所述待评估生产环境的每秒请求数的步骤包括:In an embodiment, the resource configuration parameters include CC_P (the number of CPUs in each server in the production environment to be evaluated), SN_P (the number of deployment servers in the production environment to be evaluated), and RT_P (the CPU in the production environment to be evaluated) Occupancy limit) and Rd (the percentage of CPU work loss of the production environment to be evaluated). The step of calculating the number of requests per second of the production environment to be evaluated according to the resource configuration parameters and the CP_PerC includes:
根据所述CP_PerC、CC_P、SN_P、RT_P以及Rd,计算出待评估生产环境的每秒请求数TPS_P,其中,TPS_P的计算公式为:According to the CP_PerC, CC_P, SN_P, RT_P and Rd, the number of requests per second TPS_P of the production environment to be evaluated is calculated, where the calculation formula of TPS_P is:
TPS_P=CP_PerC*CC_P*SN_P*RT_P*(1-Rd)。TPS_P=CP_PerC*CC_P*SN_P*RT_P*(1-Rd).
在一实施例中,所述通过所述性能测试报告同时显示所述相关指标参数以及待评估生产环境的每秒请求数,以便指导用户进行所述生产环境的性能评估的步骤之后,还包括:In an embodiment, after the performance test report simultaneously displays the relevant index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the steps of the production environment performance evaluation, the method further includes:
接收到用户操作触发的性能评估报告生成指令,获取预设性能评估报告模板;Receive a performance evaluation report generation instruction triggered by a user operation, and obtain a preset performance evaluation report template;
根据预设填写映射表,将所述相关指标参数、资源配置参数以及待评估生产环境的每秒请求数填写至所述预设性能评估报告模板的对应区域,生成所述待评 估生产环境对应的性能评估报告。Fill in the mapping table according to the preset, fill in the relevant index parameters, resource configuration parameters, and the number of requests per second of the production environment to be evaluated into the corresponding area of the preset performance evaluation report template, and generate the corresponding data for the production environment to be evaluated Performance evaluation report.
在一实施例中,所述通过所述性能测试报告同时显示所述相关指标参数以及待评估生产环境的每秒请求数,以便指导用户进行所述生产环境的性能评估的步骤之后,还包括:In one embodiment, after the performance test report simultaneously displays the relevant index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the steps of the production environment performance evaluation, the method further includes:
接收到资源评估指令,获取所述资源评估指令中的每秒请求数阈值TPS_Y;The resource evaluation instruction is received, and the request per second threshold TPS_Y in the resource evaluation instruction is acquired;
根据所述TPS_Y、CP_PerC、CC_P以及SN_P,计算服务器数量阈值SN_Y;Calculate the server quantity threshold SN_Y according to the TPS_Y, CP_PerC, CC_P and SN_P;
根据所述SN_P和所述SN_Y,判断是否需要对所述待评估生产环境进行扩容或者减容;According to the SN_P and the SN_Y, determine whether it is necessary to expand or reduce the capacity of the production environment to be evaluated;
若需要对所述待评估生产环境进行扩容,则根据所述SN_P和SN_Y的差值,确定待扩容的服务器数量。If the production environment to be evaluated needs to be expanded, the number of servers to be expanded is determined according to the difference between the SN_P and SN_Y.
在一实施例中,所述SN_Y的计算公式为:In one embodiment, the calculation formula of SN_Y is:
SN_Y=TPS_Y/CP_PerC/CC_P-SN_P。SN_Y=TPS_Y/CP_PerC/CC_P-SN_P.
在一实施例中,所述根据所述SN_P和所述SN_Y,判断是否需要对所述待评估生产环境进行扩容的步骤之后,还包括:In an embodiment, after the step of determining whether the production environment to be evaluated needs to be expanded according to the SN_P and the SN_Y, the method further includes:
若需要对所述待评估生产环境进行减容,则根据所述SN_P和SN_Y的差值,确定待减容的服务器数量。If it is necessary to reduce the capacity of the production environment to be evaluated, the number of servers to be reduced is determined according to the difference between the SN_P and SN_Y.
在一实施例中,所述根据所述相关指标参数、资源配置参数以及预设计算规则,计算出所述待评估生产环境的每秒请求数的步骤包括:In an embodiment, the step of calculating the number of requests per second of the production environment to be evaluated according to the related index parameters, resource configuration parameters and preset calculation rules includes:
将所述相关指标参数以及资源配置参数导出至表格应用;Exporting the relevant index parameters and resource configuration parameters to a table application;
在所述表格应用中,根据所述预设计算规则对所述相关指标参数以及资源配置参数进行计算,生成所述待评估生产环境的每秒请求数。In the table application, the relevant index parameters and resource configuration parameters are calculated according to the preset calculation rules to generate the number of requests per second of the production environment to be evaluated.
此外,为实现上述目的,本申请还提供一种生产环境的性能评估装置,所述生产环境的性能评估装置包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的生产环境的性能评估程序,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:In addition, in order to achieve the above objective, the present application also provides a performance evaluation device for a production environment. The performance evaluation device for a production environment includes: a memory, a processor, and a memory, a processor, and a memory and a processor that are stored in the memory and run on the processor The performance evaluation program of the production environment, when the performance evaluation program of the production environment is executed by the processor, the following steps are implemented:
接收到系统性能测试请求,获取所述系统所属测试环境的相关指标参数以及待评估生产环境的资源配置参数;Receiving a system performance test request, obtaining relevant index parameters of the test environment to which the system belongs and resource configuration parameters of the production environment to be evaluated;
根据所述相关指标参数、资源配置参数以及预设计算规则,计算出所述待评估 生产环境的每秒请求数;Calculate the number of requests per second of the production environment to be evaluated according to the relevant index parameters, resource configuration parameters, and preset calculation rules;
通过所述性能测试报告同时显示所述相关指标参数以及待评估生产环境的每秒请求数,以便指导用户进行所述生产环境的性能评估。The performance test report simultaneously displays the related index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the performance evaluation of the production environment.
在一实施例中,所述相关指标参数包括TPS_T(测试环境的每秒请求数)、CC_T(测试环境的CPU总数)以及RU_T(测试环境的CPU使用百分比),所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:In an embodiment, the related index parameters include TPS_T (requests per second in the test environment), CC_T (total number of CPUs in the test environment), and RU_T (percentage of CPU usage in the test environment). The performance evaluation program of the production environment When executed by the processor, the following steps are implemented:
根据所述TPS_T、CC_T以及RU_T,计算出每个CPU的计算值CP_PerC,其中,CP_PerC的计算公式为:According to the TPS_T, CC_T, and RU_T, the calculated value CP_PerC of each CPU is calculated, where the calculation formula of CP_PerC is:
CP_PerC=TPS_T/(CC_T*RU_T);CP_PerC=TPS_T/(CC_T*RU_T);
根据所述资源配置参数以及所述CP_PerC,计算出所述待评估生产环境的每秒请求数。According to the resource configuration parameter and the CP_PerC, the number of requests per second of the production environment to be evaluated is calculated.
在一实施例中,所述资源配置参数包括CC_P(待评估生产环境中每台服务器具有的CPU的个数)、SN_P(待评估生产环境的部署服务器数量)、RT_P(待评估生产环境的CPU占用限额)以及Rd(待评估生产环境的CPU的工作损耗百分比),所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:In an embodiment, the resource configuration parameters include CC_P (the number of CPUs in each server in the production environment to be evaluated), SN_P (the number of deployment servers in the production environment to be evaluated), and RT_P (the CPU in the production environment to be evaluated) Occupancy limit) and Rd (the percentage of work loss of the CPU in the production environment to be evaluated), the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
根据所述CP_PerC、CC_P、SN_P、RT_P以及Rd,计算出待评估生产环境的每秒请求数TPS_P,其中,TPS_P的计算公式为:According to the CP_PerC, CC_P, SN_P, RT_P, and Rd, the number of requests per second TPS_P of the production environment to be evaluated is calculated, where the calculation formula of TPS_P is:
TPS_P=CP_PerC*CC_P*SN_P*RT_P*(1-Rd)。TPS_P=CP_PerC*CC_P*SN_P*RT_P*(1-Rd).
在一实施例中,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:In an embodiment, the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
接收到用户操作触发的性能评估报告生成指令,获取预设性能评估报告模板;Receive a performance evaluation report generation instruction triggered by a user operation, and obtain a preset performance evaluation report template;
根据预设填写映射表,将所述相关指标参数、资源配置参数以及待评估生产环境的每秒请求数填写至所述预设性能评估报告模板的对应区域,生成所述待评估生产环境对应的性能评估报告。Fill in the mapping table according to the preset, fill in the relevant index parameters, resource configuration parameters, and the number of requests per second of the production environment to be evaluated into the corresponding area of the preset performance evaluation report template, and generate the corresponding data for the production environment to be evaluated Performance evaluation report.
在一实施例中,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:In an embodiment, the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
接收到资源评估指令,获取所述资源评估指令中的每秒请求数阈值TPS_Y;Receiving the resource evaluation instruction, obtain the request per second threshold TPS_Y in the resource evaluation instruction;
根据所述TPS_Y、CP_PerC、CC_P以及SN_P,计算服务器数量阈值SN_Y;Calculate the server quantity threshold SN_Y according to the TPS_Y, CP_PerC, CC_P and SN_P;
根据所述SN_P和所述SN_Y,判断是否需要对所述待评估生产环境进行扩容或者减容;According to the SN_P and the SN_Y, determine whether it is necessary to expand or reduce the capacity of the production environment to be evaluated;
若需要对所述待评估生产环境进行扩容,则根据所述SN_P和SN_Y的差值,确定待扩容的服务器数量。If the production environment to be evaluated needs to be expanded, the number of servers to be expanded is determined according to the difference between the SN_P and SN_Y.
在一实施例中,所述SN_Y的计算公式为:In one embodiment, the calculation formula of SN_Y is:
SN_Y=TPS_Y/CP_PerC/CC_P-SN_P。SN_Y=TPS_Y/CP_PerC/CC_P-SN_P.
在一实施例中,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:In an embodiment, the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
若需要对所述待评估生产环境进行减容,则根据所述SN_P和SN_Y的差值,确定待减容的服务器数量。If it is necessary to reduce the capacity of the production environment to be evaluated, the number of servers to be reduced is determined according to the difference between the SN_P and SN_Y.
在一实施例中,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:In an embodiment, the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
将所述相关指标参数以及资源配置参数导出至表格应用;Exporting the relevant index parameters and resource configuration parameters to a table application;
在所述表格应用中,根据所述预设计算规则对所述相关指标参数以及资源配置参数进行计算,生成所述待评估生产环境的每秒请求数。In the table application, the relevant index parameters and resource configuration parameters are calculated according to the preset calculation rules to generate the number of requests per second of the production environment to be evaluated.
此外,为实现上述目的,本申请还提供一种计算机可读存储介质,所述计算机可读存储介质上存储有生产环境的性能评估程序,所述生产环境的性能评估程序被处理器执行时实现如上所述的生产环境的性能评估方法的步骤。In addition, in order to achieve the above object, the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a performance evaluation program for the production environment, and the performance evaluation program for the production environment is executed when the processor is executed. The steps of the performance evaluation method of the production environment as described above.
本申请在接收到系统性能测试请求时,获取所述系统所属测试环境的相关指标参数以及待评估生产环境的资源配置参数;根据所述相关指标参数、资源配置参数以及预设计算规则,计算出所述待评估生产环境的每秒请求数;通过所述性能测试报告同时显示所述相关指标参数以及待评估生产环境的每秒请求数,以便指导用户进行所述生产环境的性能评估。通过上述方式,本申请通过测试环境的相关指标参数以及待评估生产环境的资源配置参数,计算预估出待评估生产环境的每秒请求数,并在显示系统的性能测试报告时,同时显示所述待评估生产环境的每秒请求数,简化了生产环境的评估操作流程,提高了评估效率,解决了示例性生产环境的评估方法操作流程繁琐且评估效率低下的技术问题。When receiving the system performance test request, this application obtains the relevant index parameters of the test environment to which the system belongs and the resource configuration parameters of the production environment to be evaluated; calculates according to the relevant index parameters, resource configuration parameters, and preset calculation rules The number of requests per second of the production environment to be evaluated; the performance test report simultaneously displays the relevant index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the performance evaluation of the production environment. Through the above method, this application calculates and estimates the number of requests per second of the production environment to be evaluated through the relevant index parameters of the test environment and the resource configuration parameters of the production environment to be evaluated, and displays the performance test report of the system at the same time. The number of requests per second of the production environment to be evaluated simplifies the evaluation operation process of the production environment, improves the evaluation efficiency, and solves the technical problem of the cumbersome operation process of the evaluation method of the exemplary production environment and low evaluation efficiency.
发明的有益效果The beneficial effects of the invention
对附图的简要说明Brief description of the drawings
附图说明Description of the drawings
图1是本申请实施例方案涉及的硬件运行环境的设备结构示意图;FIG. 1 is a schematic diagram of a device structure of a hardware operating environment involved in a solution of an embodiment of the present application;
图2为本申请生产环境的性能评估方法第一实施例的流程示意图。FIG. 2 is a schematic flowchart of the first embodiment of the performance evaluation method for the production environment of this application.
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization, functional characteristics, and advantages of the purpose of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
发明实施例Invention embodiment
本发明的实施方式Embodiments of the invention
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。It should be understood that the specific embodiments described here are only used to explain the application, but not to limit the application.
如图1所示,图1是本申请实施例方案涉及的硬件运行环境的设备结构示意图。As shown in FIG. 1, FIG. 1 is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present application.
本申请实施例生产环境的性能评估设备可以是PC机或服务器设备,其上运行有Java虚拟机。The performance evaluation device in the production environment of the embodiment of the application may be a PC or a server device, on which a Java virtual machine runs.
如图1所示,该生产环境的性能评估设备可以包括:处理器1001,例如CPU,网络接口1004,用户接口1003,存储器1005,通信总线1002。其中,通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard),可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。As shown in FIG. 1, the performance evaluation device of the production environment may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to implement connection and communication between these components. The user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as a magnetic disk memory. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.
本领域技术人员可以理解,图1中示出的设备结构并不构成对设备的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Those skilled in the art can understand that the structure of the device shown in FIG. 1 does not constitute a limitation on the device, and may include more or fewer components than those shown in the figure, or a combination of certain components, or different component arrangements.
如图1所示,作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及生产环境的性能评估程序。As shown in FIG. 1, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a performance evaluation program of a production environment.
在图1所示的设备中,网络接口1004主要用于连接后台服务器,与后台服务器进行数据通信;用户接口1003主要用于连接客户端(用户端),与客户端进行 数据通信;而处理器1001可以用于调用存储器1005中存储的生产环境的性能评估程序,并执行下述生产环境的性能评估方法中的操作。In the device shown in FIG. 1, the network interface 1004 is mainly used to connect to the back-end server and communicate with the back-end server; the user interface 1003 is mainly used to connect to the client (user side) and communicate with the client; and the processor 1001 can be used to call the performance evaluation program of the production environment stored in the memory 1005, and perform operations in the performance evaluation method of the production environment described below.
基于上述硬件结构,提出本申请生产环境的性能评估方法实施例。Based on the above hardware structure, an embodiment of the performance evaluation method for the production environment of the present application is proposed.
参照图2,图2为本申请生产环境的性能评估方法第一实施例的流程示意图,所述方法包括:Referring to Fig. 2, Fig. 2 is a schematic flowchart of a first embodiment of a performance evaluation method for a production environment of this application, and the method includes:
步骤S10,接收到系统性能测试请求,获取所述系统所属测试环境的相关指标参数以及待评估生产环境的资源配置参数;Step S10, a system performance test request is received, and relevant index parameters of the test environment to which the system belongs and resource configuration parameters of the production environment to be evaluated are obtained;
在现有的性能测试流程中,在测试环境中做完待测试系统的性能测试之后,不仅需要测试人员给出一份完整的性能测试报告,还需要有一份基于真实的生产环境进行配置评估的生产环境的性能评估结果,以此来指导待测试系统的生产环境的资源部署。生产环境的性能评估是由运维人员根据测试人员对待测试系统进行性能测试的相关指标数据和生产环境的配置参数,再根据运维人员自身以往的生产运维经验来进行性能评估。即性能测试人员在接到项目性能测试需求之后,会根据项目的需求来设计性能测试场景和性能测试用例,并根据用例来获取性能测试结果,最后输出一份性能测试结果报告。而对于运维人员来说,需要关注项目上线之后的生产环境性能情况,运维人员会根据测试人员输出的性能测试结果报告,以及结合生产环境的环境部署情况,以及运维经验来评估生产环境的性能,以此来确定当前的机器配置是否满足项目上线后的业务量,生产环境是否进行环境扩容。所以,目前生产环境的性能评估方法人力投入成本高、过程复杂繁琐,而且还涉及到测试人员,运维人员多个岗位的人员,同时涉及多个结果报告。因此,目前生产环境的评估方法操作流程不仅繁琐而且评估效率低下。为了解决上述问题,本实施例中提供一种生产环境的性能评估方法,通过测试环境的相关指标参数以及待评估生产环境的资源配置参数,计算预估出待评估生产环境的每秒请求数,并在显示系统的性能测试报告时,同时显示所述待评估生产环境的每秒请求数,简化了生产环境的评估操作流程,提高了评估效率。具体地,在接收到系统性能测试请求时,获取所述待测试系统所述测试环境的相关指标参数,其中,所述相关指标参数包括TPS_T、CC_T以及RU_T,TPS_T为测试环境所测的每秒请求数,CC_T为测试环境的CPU总 数,RU_T为测试环境的资源使用百分比。在测试完成之后,获取待评估生产环境的资源配置参数,其中,所述资源配置参数包括CC_P、RT_P以及Rd,CC_P为待评估生产环境中每台服务器具有的CPU的个数、SN_P为待评估生产环境的部署服务器数量,RT_P为待评估生产环境的CPU占用限额,即生产环境上一般都设置有资源的使用阈值,超过此阈值,会出现资源超限告警,Rd为待评估生产环境的CPU的工作损耗百分比,即分布式环境中多台服务器协同工作时导致的资源损耗百分比。In the existing performance test process, after the performance test of the system to be tested in the test environment, not only the tester needs to give a complete performance test report, but also a configuration evaluation based on the real production environment The performance evaluation results of the production environment are used to guide the resource deployment of the production environment of the system to be tested. The performance evaluation of the production environment is performed by the operation and maintenance personnel based on the relevant index data of the tester's performance test of the system to be tested and the configuration parameters of the production environment, and then the performance evaluation based on the operation and maintenance personnel's own previous production operation and maintenance experience. That is, after receiving the project performance test requirements, the performance testers will design performance test scenarios and performance test cases according to the project requirements, and obtain performance test results according to the use cases, and finally output a performance test result report. For the operation and maintenance personnel, they need to pay attention to the performance of the production environment after the project goes online. The operation and maintenance personnel will evaluate the production environment based on the performance test result report output by the tester, as well as the environment deployment of the production environment, and the operation and maintenance experience To determine whether the current machine configuration meets the business volume after the project goes online, and whether the production environment is expanded. Therefore, the current performance evaluation methods of the production environment have high labor costs, complicated processes, and involve testers, operation and maintenance personnel in multiple positions, and multiple result reports. Therefore, the current evaluation method operation process of the production environment is not only cumbersome but also inefficient. In order to solve the above problems, this embodiment provides a performance evaluation method for the production environment. The number of requests per second of the production environment to be evaluated is calculated through the relevant index parameters of the test environment and the resource configuration parameters of the production environment to be evaluated. And when the performance test report of the system is displayed, the number of requests per second of the production environment to be evaluated is also displayed, which simplifies the evaluation operation process of the production environment and improves the evaluation efficiency. Specifically, when a system performance test request is received, the relevant index parameters of the test environment of the system to be tested are acquired, where the relevant index parameters include TPS_T, CC_T, and RU_T, and TPS_T is the measured per second in the test environment The number of requests, CC_T is the total number of CPUs in the test environment, and RU_T is the percentage of resource usage in the test environment. After the test is completed, obtain the resource configuration parameters of the production environment to be evaluated, where the resource configuration parameters include CC_P, RT_P, and Rd. CC_P is the number of CPUs in each server in the production environment to be evaluated, and SN_P is the production environment to be evaluated The number of deployment servers in the production environment, RT_P is the CPU occupancy limit of the production environment to be evaluated, that is, a resource usage threshold is generally set in the production environment. If this threshold is exceeded, a resource limit alarm will occur, and Rd is the CPU of the production environment to be evaluated The percentage of work loss, that is, the percentage of resource loss caused by multiple servers working together in a distributed environment.
步骤S20,根据所述相关指标参数、资源配置参数以及预设计算规则,计算出所述待评估生产环境的每秒请求数;Step S20: Calculate the number of requests per second of the production environment to be evaluated according to the relevant index parameters, resource configuration parameters and preset calculation rules;
本实施例中,首先计算出每个CPU的处理性能,即每个CPU的计算值CP_PerC,其中,CP_PerC的计算公式为:CP_PerC=TPS_T/(CC_T*RU_T);In this embodiment, first calculate the processing performance of each CPU, that is, the calculated value CP_PerC of each CPU, where the calculation formula of CP_PerC is: CP_PerC=TPS_T/(CC_T*RU_T);
该公式主要根据测试环境的测试结果和资源使用情况,预估计算出每核CPU的计算值,根据测试环境所得的计算值来评估生产环境的性能。例如:测试所得的性能为1000TPS,被测试系统部署在5台服务器上,每台服务器核数(CPU)为6,测试过程中的被测试系统的CPU资源占用率平均为90%。则计算所得的CP_PerC=1000/(5*6*90%)=37。The formula mainly calculates the calculated value of each core CPU based on the test results and resource usage of the test environment, and evaluates the performance of the production environment based on the calculated value obtained from the test environment. For example: the performance obtained by the test is 1000TPS, the system under test is deployed on 5 servers, and the number of cores (CPU) of each server is 6, and the CPU resource occupancy rate of the system under test during the test is 90% on average. Then the calculated CP_PerC=1000/(5*6*90%)=37.
然后计算生产环境的每秒请求数TPS_P,进行生产环境的性能评估,其中,TPS_P的计算公式为:TPS_P=CP_PerC*CC_P*SN_P*RT_P*(1-Rd)。例如:测试环境的每核计算值为37,生产环境中每台服务器核数为4,被测试系统在生产环境上部署在20台服务器上,生产环境上CPU占用限额为70%,分布式环境中多台服务器协作导致的性能损耗为0.05%。则根据上述公式来计算生产环境的性能为TPS_P=37*4*20*70%*(1-20*0.05%)=2051(TPS)。Then calculate the number of requests per second TPS_P of the production environment, and perform the performance evaluation of the production environment, where the calculation formula of TPS_P is: TPS_P=CP_PerC*CC_P*SN_P*RT_P*(1-Rd). For example: the calculation value per core of the test environment is 37, the number of cores per server in the production environment is 4, the system under test is deployed on 20 servers in the production environment, the CPU usage limit in the production environment is 70%, and the distributed environment The performance loss caused by the cooperation of multiple servers is 0.05%. According to the above formula, the performance of the production environment is calculated as TPS_P=37*4*20*70%*(1-20*0.05%)=2051(TPS).
步骤S30,通过所述性能测试报告同时显示所述相关指标参数以及待评估生产环境的每秒请求数,以便指导用户进行所述生产环境的性能评估。Step S30, simultaneously displaying the relevant index parameters and the number of requests per second of the production environment to be evaluated through the performance test report, so as to guide the user to perform the performance evaluation of the production environment.
本实施例中,根据上述两个公式的组合,就可以规范化的计算出生产环境的性能数据,即待评估的生产环境每秒请求数,在输出性能测试结果的时候,同时包含对生产环境的性能计算,并在性能测试报告中统一进行展示,方便指导运 维人员进行资源评估和容量规划。由此测试人员在测试环境上完成性能测试的时候,即可根据当前的测试数据和生产环境配置,以及根据一定的产品性能计算方法,自动化的计算出生产环境的性能数据指标,同测试环境性能测试结果一起附在性能测试报告中。解决了目前没有一套自动化的方法或者公式,将测试人员和运维人员的工作联合起来,进行一站式的结果输出的问题。In this embodiment, based on the combination of the above two formulas, the performance data of the production environment can be calculated in a standardized manner, that is, the number of requests per second of the production environment to be evaluated. When outputting the performance test results, it also includes the information about the production environment. Performance calculation, and unified display in the performance test report, it is convenient to guide operation and maintenance personnel in resource evaluation and capacity planning. Therefore, when the tester completes the performance test in the test environment, he can automatically calculate the performance data indicators of the production environment according to the current test data and production environment configuration, and according to certain product performance calculation methods, which are the same as the test environment performance The test results are attached to the performance test report. It solves the problem that there is no set of automated methods or formulas to unite the work of testers and operation and maintenance personnel for one-stop result output.
本实施例在接收到系统性能测试请求时,获取所述系统所属测试环境的相关指标参数以及待评估生产环境的资源配置参数;根据所述相关指标参数、资源配置参数以及预设计算规则,计算出所述待评估生产环境的每秒请求数;通过所述性能测试报告同时显示所述相关指标参数以及待评估生产环境的每秒请求数,以便指导用户进行所述生产环境的性能评估。通过上述方式,本申请通过测试环境的相关指标参数以及待评估生产环境的资源配置参数,计算预估出待评估生产环境的每秒请求数,并在显示系统的性能测试报告时,同时显示所述待评估生产环境的每秒请求数,简化了生产环境的评估操作流程,提高了评估效率,解决了示例性生产环境的评估方法操作流程繁琐且评估效率低下的技术问题。In this embodiment, when a system performance test request is received, the relevant index parameters of the test environment to which the system belongs and the resource configuration parameters of the production environment to be evaluated are obtained; according to the relevant index parameters, resource configuration parameters, and preset calculation rules, calculate The number of requests per second of the production environment to be evaluated is obtained; and the related index parameters and the number of requests per second of the production environment to be evaluated are simultaneously displayed through the performance test report, so as to guide the user to perform the performance evaluation of the production environment. Through the above method, this application calculates and estimates the number of requests per second of the production environment to be evaluated through the relevant index parameters of the test environment and the resource configuration parameters of the production environment to be evaluated, and displays the performance test report of the system at the same time. The number of requests per second of the production environment to be evaluated simplifies the evaluation operation process of the production environment, improves the evaluation efficiency, and solves the technical problem of the cumbersome operation process of the evaluation method of the exemplary production environment and low evaluation efficiency.
进一步地,基于本申请生产环境的性能评估方法第一实施例,提出本申请生产环境的性能评估方法第二实施例。Further, based on the first embodiment of the performance evaluation method for the production environment of the present application, a second embodiment of the performance evaluation method for the production environment of the present application is proposed.
在本实施例中,所述生产环境的性能评估方法在步骤S30之后,还包括:In this embodiment, after step S30, the performance evaluation method of the production environment further includes:
接收到用户操作触发的性能评估报告生成指令,获取预设性能评估报告模板;Receive a performance evaluation report generation instruction triggered by a user operation, and obtain a preset performance evaluation report template;
根据预设填写映射表,将所述相关指标参数、资源配置参数以及待评估生产环境的每秒请求数填写至所述预设性能评估报告模板的对应区域,生成所述待评估生产环境对应的性能评估报告。Fill in the mapping table according to the preset, fill in the relevant index parameters, resource configuration parameters, and the number of requests per second of the production environment to be evaluated into the corresponding area of the preset performance evaluation report template, and generate the corresponding data for the production environment to be evaluated Performance evaluation report.
为了提供统一的生成环境的性能评估报告,便于相关用户的使用,本实施例中,在接收到用户操作触发的性能评估报告生成指令,即获取所述生成环境对应的预设性能评估报告模板。然后根据预设填写映射表中设定的填写关系,将所述测试环境的相关指标参数、待评估生成环境的资源配置参数以及计算得到的待评估生产环境的每秒请求数TPS_P填写值所述预设性能评估报告模板中设定的对应区域,生成对应的性能评估报告,并可提供导出接口。具体实施例中,将 待填写值性能评估报告中的上述数据均存储在性能平台中,便于后续读取。更多实施例中,若检测到用户没有特殊格式要求,可将携带所述待评估生产环境的每秒请求量的所述性能测试报告,根据所述性能评估报告指令进行反馈显示。In order to provide a unified generation environment performance evaluation report to facilitate the use of related users, in this embodiment, upon receiving a performance evaluation report generation instruction triggered by a user operation, a preset performance evaluation report template corresponding to the generation environment is obtained. Then fill in the relevant index parameters of the test environment, the resource configuration parameters of the generation environment to be evaluated, and the calculated number of requests per second TPS_P of the production environment to be evaluated according to the preset filling relationship set in the mapping table. Preset the corresponding area set in the performance evaluation report template, generate the corresponding performance evaluation report, and provide an export interface. In a specific embodiment, the above-mentioned data in the performance evaluation report of the value to be filled is all stored in the performance platform to facilitate subsequent reading. In more embodiments, if it is detected that the user does not have a special format requirement, the performance test report carrying the requests per second of the production environment to be evaluated may be displayed in feedback according to the performance evaluation report instruction.
进一步地,基于本申请生产环境的性能评估方法第一实施例,提出本申请生产环境的性能评估方法第三实施例。Further, based on the first embodiment of the performance evaluation method for the production environment of the present application, a third embodiment of the performance evaluation method for the production environment of the present application is proposed.
在本实施例中,所述生产环境的性能评估方法在步骤S30之后,还包括:In this embodiment, after step S30, the performance evaluation method of the production environment further includes:
接收到资源评估指令,获取所述资源评估指令中的每秒请求数阈值TPS_Y;The resource evaluation instruction is received, and the request per second threshold TPS_Y in the resource evaluation instruction is acquired;
根据所述TPS_Y、CP_PerC、CC_P以及SN_P,计算服务器数量阈值SN_Y;Calculate the server quantity threshold SN_Y according to the TPS_Y, CP_PerC, CC_P and SN_P;
根据所述SN_P和所述SN_Y,判断是否需要对所述待评估生产环境进行扩容或者减容;According to the SN_P and the SN_Y, determine whether it is necessary to expand or reduce the capacity of the production environment to be evaluated;
若需要对所述待评估生产环境进行扩容,则根据所述SN_P和SN_Y的差值,确定待扩容的服务器数量。If the production environment to be evaluated needs to be expanded, the number of servers to be expanded is determined according to the difference between the SN_P and SN_Y.
若需要对所述待评估生产环境进行减容,则根据所述SN_P和SN_Y的差值,确定待减容的服务器数量。If it is necessary to reduce the capacity of the production environment to be evaluated, the number of servers to be reduced is determined according to the difference between the SN_P and SN_Y.
为了进一步提供具体的生产环境评估意见,本实施例中,根据当前生产环境的TPS_P与每秒请求数阈值TPS_Y确定当前生产环境的是否需要扩容或者减容。具体地,在接收到资源评估指令时,获取所述资源评估指令中设定的每秒请求数阈值TPS_Y,根据所述每秒请求数阈值TPS_Y并结合生产环境的资源配置参数,即每个CPU的计算值CP_PerC、待评估生产环境中每台服务器具有的CPU的个数CC_P以及待评估生产环境的部署服务器数量SN_P,以及所述SN_Y的计算公式计算出服务器数量阈值SN_Y,其中,所述SN_Y的计算公式为:SN_Y=TPS_Y/C P_PerC/CC_P-SN_P。将所述SN_P和所述SN_Y进行比对,以判断所述生产环境的当前服务器数量SN_P是否达到所述服务器数量阈值SN_Y,从而判断是否需要对所述待评估生产环境进行扩容或者减容。若所述生产环境的当前服务器数量SN_P超过所述服务器数量阈值SN_Y,则需要对所述生产环境进行减容,并根据所述SN_P和SN_Y的差值,确定待减容的服务器数量;若所述生产环境的当前服务器数量SN_P低于所述服务器数量阈值SN_Y,则需要对所述生产环境进行扩容 ,并根据所述SN_P和SN_Y的差值,确定待扩容的服务器数量。具体实施例中,可以设置一个容错值,即所述生产环境的当前服务器数量SN_P与所述服务器数量阈值SN_Y的差值在容错值内,则无需对所述生产环境的资源进行调整。In order to further provide specific production environment evaluation opinions, in this embodiment, according to the current production environment TPS_P and the number of requests per second threshold TPS_Y, it is determined whether the current production environment needs to be expanded or reduced. Specifically, when the resource evaluation instruction is received, the request per second threshold TPS_Y set in the resource evaluation instruction is acquired, and the request per second threshold TPS_Y is combined with the resource configuration parameters of the production environment, that is, each CPU The calculated value of CP_PerC, the number of CPUs CC_P of each server in the production environment to be evaluated, the number of deployment servers SN_P in the production environment to be evaluated, and the calculation formula of the SN_Y calculate the server number threshold SN_Y, where the SN_Y The calculation formula for is: SN_Y=TPS_Y/C P_PerC/CC_P-SN_P. The SN_P and the SN_Y are compared to determine whether the current server number SN_P of the production environment reaches the server number threshold SN_Y, so as to determine whether the production environment to be evaluated needs to be expanded or reduced. If the current server number SN_P of the production environment exceeds the server number threshold SN_Y, the production environment needs to be reduced, and the number of servers to be reduced is determined according to the difference between the SN_P and SN_Y; If the current server number SN_P of the production environment is lower than the server number threshold SN_Y, the production environment needs to be expanded, and the number of servers to be expanded is determined according to the difference between the SN_P and SN_Y. In a specific embodiment, a fault tolerance value may be set, that is, the difference between the current server number SN_P of the production environment and the server number threshold SN_Y is within the fault tolerance value, and there is no need to adjust the resources of the production environment.
基于第一实施例和第二实施例,进一步地,所述步骤S30具体包括:Based on the first embodiment and the second embodiment, further, the step S30 specifically includes:
将所述相关指标参数以及资源配置参数导出至表格应用;Exporting the relevant index parameters and resource configuration parameters to a table application;
在所述表格应用中,根据所述预设计算规则对所述相关指标参数以及资源配置参数进行计算,生成所述待评估生产环境的每秒请求数。In the table application, the relevant index parameters and resource configuration parameters are calculated according to the preset calculation rules to generate the number of requests per second of the production environment to be evaluated.
为了提供多种计算方式,提供用户体验,本实施例中,在压测工具或者平台中,不一定需要自动计算,也可以通过其他方式来计算生产环境的性能。例如:将上述两个计算公式嵌入到Execl表格中,在性能测试完成后,将相关指标参数以及资源配置参数的数据导入到Execl表格中,通过Execl计算来得出待评估生产环境的每秒请求数。具体实施例中,还可以将是否需要进行扩容或者缩容的计算公式以及相关数据导入到Execl表格中,通过Execl计算来得出生产环境的当前服务器数量SN_P与所述服务器数量阈值SN_Y的大小情况。In order to provide multiple calculation methods and provide user experience, in this embodiment, in the stress testing tool or platform, automatic calculation is not necessarily required, and the performance of the production environment can also be calculated in other ways. For example: embed the above two calculation formulas into the Execl table, after the performance test is completed, import the relevant index parameters and resource configuration parameter data into the Execl table, and calculate the number of requests per second of the production environment to be evaluated by Execl . In a specific embodiment, the calculation formula and related data of whether capacity expansion or contraction is required can also be imported into the Execl table, and the current server number SN_P in the production environment and the server number threshold SN_Y can be obtained through Execl calculation.
本申请还提供一种生产环境的性能评估装置。所述生产环境的性能评估装置包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的生产环境的性能评估程序,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:The application also provides a performance evaluation device for the production environment. The performance evaluation device of the production environment includes a memory, a processor, and a performance evaluation program of the production environment stored on the memory and capable of running on the processor, and the performance evaluation program of the production environment is processed by the The following steps are implemented when the device is executed:
接收到系统性能测试请求,获取所述系统所属测试环境的相关指标参数以及待评估生产环境的资源配置参数;Receiving a system performance test request, obtaining relevant index parameters of the test environment to which the system belongs and resource configuration parameters of the production environment to be evaluated;
根据所述相关指标参数、资源配置参数以及预设计算规则,计算出所述待评估生产环境的每秒请求数;Calculate the number of requests per second of the production environment to be evaluated according to the relevant index parameters, resource configuration parameters, and preset calculation rules;
通过所述性能测试报告同时显示所述相关指标参数以及待评估生产环境的每秒请求数,以便指导用户进行所述生产环境的性能评估。The performance test report simultaneously displays the relevant index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the performance evaluation of the production environment.
进一步地,所述相关指标参数包括TPS_T(测试环境的每秒请求数)、CC_T(测试环境的CPU总数)以及RU_T(测试环境的CPU使用百分比),所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:Further, the relevant index parameters include TPS_T (the number of requests per second in the test environment), CC_T (the total number of CPUs in the test environment), and RU_T (the percentage of CPU usage in the test environment), and the performance evaluation program of the production environment is The processor implements the following steps when executing:
根据所述TPS_T、CC_T以及RU_T,计算出每个CPU的计算值CP_PerC,其中 ,CP_PerC的计算公式为:According to the TPS_T, CC_T and RU_T, the calculated value CP_PerC of each CPU is calculated, where the calculation formula of CP_PerC is:
CP_PerC=TPS_T/(CC_T*RU_T);CP_PerC=TPS_T/(CC_T*RU_T);
根据所述资源配置参数以及所述CP_PerC,计算出所述待评估生产环境的每秒请求数。According to the resource configuration parameter and the CP_PerC, the number of requests per second of the production environment to be evaluated is calculated.
进一步地,所述资源配置参数包括CC_P(待评估生产环境中每台服务器具有的CPU的个数)、SN_P(待评估生产环境的部署服务器数量)、RT_P(待评估生产环境的CPU占用限额)以及Rd(待评估生产环境的CPU的工作损耗百分比),所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:Further, the resource configuration parameters include CC_P (the number of CPUs of each server in the production environment to be evaluated), SN_P (the number of deployment servers in the production environment to be evaluated), and RT_P (the CPU occupation limit of the production environment to be evaluated) And Rd (the work loss percentage of the CPU in the production environment to be evaluated), when the performance evaluation program of the production environment is executed by the processor, the following steps are implemented:
根据所述CP_PerC、CC_P、SN_P、RT_P以及Rd,计算出待评估生产环境的每秒请求数TPS_P,其中,TPS_P的计算公式为:According to the CP_PerC, CC_P, SN_P, RT_P, and Rd, the number of requests per second TPS_P of the production environment to be evaluated is calculated, where the calculation formula of TPS_P is:
TPS_P=CP_PerC*CC_P*SN_P*RT_P*(1-Rd)。TPS_P=CP_PerC*CC_P*SN_P*RT_P*(1-Rd).
进一步地,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:Further, when the performance evaluation program of the production environment is executed by the processor, the following steps are implemented:
接收到用户操作触发的性能评估报告生成指令,获取预设性能评估报告模板;Receive a performance evaluation report generation instruction triggered by a user operation, and obtain a preset performance evaluation report template;
根据预设填写映射表,将所述相关指标参数、资源配置参数以及待评估生产环境的每秒请求数填写至所述预设性能评估报告模板的对应区域,生成所述待评估生产环境对应的性能评估报告。Fill in the mapping table according to the preset, fill in the relevant index parameters, resource configuration parameters, and the number of requests per second of the production environment to be evaluated into the corresponding area of the preset performance evaluation report template, and generate the corresponding data for the production environment to be evaluated Performance evaluation report.
进一步地,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:Further, when the performance evaluation program of the production environment is executed by the processor, the following steps are implemented:
接收到资源评估指令,获取所述资源评估指令中的每秒请求数阈值TPS_Y;Receiving the resource evaluation instruction, obtain the request per second threshold TPS_Y in the resource evaluation instruction;
根据所述TPS_Y、CP_PerC、CC_P以及SN_P,计算服务器数量阈值SN_Y;Calculate the server quantity threshold SN_Y according to the TPS_Y, CP_PerC, CC_P and SN_P;
根据所述SN_P和所述SN_Y,判断是否需要对所述待评估生产环境进行扩容或者减容;According to the SN_P and the SN_Y, determine whether it is necessary to expand or reduce the capacity of the production environment to be evaluated;
若需要对所述待评估生产环境进行扩容,则根据所述SN_P和SN_Y的差值,确定待扩容的服务器数量。If the production environment to be evaluated needs to be expanded, the number of servers to be expanded is determined according to the difference between the SN_P and SN_Y.
进一步地,所述SN_Y的计算公式为:Further, the calculation formula of SN_Y is:
SN_Y=TPS_Y/CP_PerC/CC_P-SN_P。SN_Y=TPS_Y/CP_PerC/CC_P-SN_P.
在一实施例中,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:In an embodiment, the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
若需要对所述待评估生产环境进行减容,则根据所述SN_P和SN_Y的差值,确 定待减容的服务器数量。If it is necessary to reduce the capacity of the production environment to be evaluated, the number of servers to be reduced is determined according to the difference between the SN_P and SN_Y.
进一步地,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:Further, when the performance evaluation program of the production environment is executed by the processor, the following steps are implemented:
将所述相关指标参数以及资源配置参数导出至表格应用;Exporting the relevant index parameters and resource configuration parameters to a table application;
在所述表格应用中,根据所述预设计算规则对所述相关指标参数以及资源配置参数进行计算,生成所述待评估生产环境的每秒请求数。In the table application, the relevant index parameters and resource configuration parameters are calculated according to the preset calculation rules to generate the number of requests per second of the production environment to be evaluated.
上述生产环境的性能评估程序所实现的方法可参照本申请生产环境的性能评估方法各个实施例,此处不再赘述。For the method implemented by the above-mentioned production environment performance evaluation program, reference may be made to the various embodiments of the production environment performance evaluation method of the present application, which will not be repeated here.
本申请还提供一种计算机可读存储介质。The application also provides a computer-readable storage medium.
本申请计算机可读存储介质上存储有生产环境的性能评估程序,所述生产环境的性能评估程序被处理器执行时实现如上所述的生产环境的性能评估方法的步骤。The computer-readable storage medium of the present application stores the performance evaluation program of the production environment, and the performance evaluation program of the production environment is executed by the processor to realize the steps of the performance evaluation method of the production environment as described above.
其中,在所述处理器上运行的生产环境的性能评估程序被执行时所实现的方法可参照本申请生产环境的性能评估方法各个实施例,此处不再赘述。Wherein, the method implemented when the performance evaluation program of the production environment running on the processor is executed can refer to the various embodiments of the performance evaluation method of the production environment of the present application, which will not be repeated here.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个......”限定的要素,并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。It should be noted that in this article, the terms "including", "including" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements not only includes those elements, It also includes other elements that are not explicitly listed, or elements inherent to the process, method, article, or system. Without more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article or system that includes the element.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the foregoing embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。 Based on this understanding, the technical solution of this application essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above. , Magnetic disks, optical disks), including several instructions to make a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the method described in each embodiment of the present application.
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本 申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only the preferred embodiments of this application, and do not limit the scope of this application. Any equivalent structure or equivalent process transformation made using the content of the description and drawings of this application, or directly or indirectly applied to other related technical fields , The same reason is included in the scope of patent protection of this application.

Claims (17)

  1. 一种生产环境的性能评估方法,其中,所述生产环境的性能评估方法包括如下步骤:A performance evaluation method for a production environment, wherein the performance evaluation method for a production environment includes the following steps:
    接收到系统性能测试请求,获取所述系统所属测试环境的相关指标参数以及待评估生产环境的资源配置参数;Receiving a system performance test request, obtaining relevant index parameters of the test environment to which the system belongs and resource configuration parameters of the production environment to be evaluated;
    根据所述相关指标参数、资源配置参数以及预设计算规则,计算出所述待评估生产环境的每秒请求数;以及Calculate the number of requests per second of the production environment to be evaluated according to the relevant index parameters, resource configuration parameters, and preset calculation rules; and
    通过所述性能测试报告同时显示所述相关指标参数以及待评估生产环境的每秒请求数,以便指导用户进行所述生产环境的性能评估。The performance test report simultaneously displays the relevant index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the performance evaluation of the production environment.
  2. 如权利要求1所述的生产环境的性能评估方法,其中,所述相关指标参数包括TPS_T(测试环境的每秒请求数)、CC_T(测试环境的CPU总数)以及RU_T(测试环境的CPU使用百分比),所述根据所述相关指标参数、资源配置参数以及预设计算规则,计算出所述待评估生产环境的每秒请求数的步骤包括:The performance evaluation method of the production environment according to claim 1, wherein the relevant index parameters include TPS_T (requests per second of the test environment), CC_T (total number of CPUs in the test environment), and RU_T (CPU usage percentage of the test environment) ), the step of calculating the number of requests per second of the production environment to be evaluated according to the relevant index parameters, resource configuration parameters and preset calculation rules includes:
    根据所述TPS_T、CC_T以及RU_T,计算出每个CPU的计算值CP_PerC,其中,CP_PerC的计算公式为:According to the TPS_T, CC_T, and RU_T, the calculated value CP_PerC of each CPU is calculated, where the calculation formula of CP_PerC is:
    CP_PerC=TPS_T/(CC_T*RU_T);以及CP_PerC=TPS_T/(CC_T*RU_T); and
    根据所述资源配置参数以及所述CP_PerC,计算出所述待评估生产环境的每秒请求数。According to the resource configuration parameter and the CP_PerC, the number of requests per second of the production environment to be evaluated is calculated.
  3. 如权利要求2所述的生产环境的性能评估方法,其中,所述资源配置参数包括CC_P(待评估生产环境中每台服务器具有的CPU的个数)、SN_P(待评估生产环境的部署服务器数量)、RT_P(待评估生产环境的CPU占用限额)以及Rd(待评估生产环境的CPU的工作损耗百分比),所述根据资源配置参数以及所述CP_PerC,计算出所述待评估生产环境的每秒请求数的步骤包括:The performance evaluation method of the production environment according to claim 2, wherein the resource configuration parameters include CC_P (the number of CPUs in each server in the production environment to be evaluated), SN_P (the number of deployment servers in the production environment to be evaluated) ), RT_P (CPU occupancy limit of the production environment to be evaluated), and Rd (percentage of CPU work loss in the production environment to be evaluated), according to the resource configuration parameters and the CP_PerC, calculate the per second of the production environment to be evaluated The steps for requesting numbers include:
    根据所述CP_PerC、CC_P、SN_P、RT_P以及Rd,计算出待评估生产环境的每秒请求数TPS_P,其中,TPS_P的计算公式为:According to the CP_PerC, CC_P, SN_P, RT_P, and Rd, the number of requests per second TPS_P of the production environment to be evaluated is calculated, where the calculation formula of TPS_P is:
    TPS_P=CP_PerC*CC_P*SN_P*RT_P*(1-Rd)。TPS_P=CP_PerC*CC_P*SN_P*RT_P*(1-Rd).
  4. 如权利要求1所述的生产环境的性能评估方法,其中,所述通过所述性能测试报告同时显示所述相关指标参数以及待评估生产环境的每秒请求数,以便指导用户进行所述生产环境的性能评估的步骤之后,还包括:The method for evaluating the performance of the production environment according to claim 1, wherein the passing of the performance test report simultaneously displays the relevant index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the production environment After the steps of performance evaluation, it also includes:
    接收到用户操作触发的性能评估报告生成指令,获取预设性能评估报告模板;以及Receive a performance evaluation report generation instruction triggered by a user operation, and obtain a preset performance evaluation report template; and
    根据预设填写映射表,将所述相关指标参数、资源配置参数以及待评估生产环境的每秒请求数填写至所述预设性能评估报告模板的对应区域,生成所述待评估生产环境对应的性能评估报告。Fill in the mapping table according to the preset, fill in the relevant index parameters, resource configuration parameters, and the number of requests per second of the production environment to be evaluated into the corresponding area of the preset performance evaluation report template, and generate the corresponding data for the production environment to be evaluated Performance evaluation report.
  5. 如权利要求1所述的生产环境的性能评估方法,其中,所述通过所述性能测试报告同时显示所述相关指标参数以及待评估生产环境的每秒请求数,以便指导用户进行所述生产环境的性能评估的步骤之后,还包括:The method for evaluating the performance of the production environment according to claim 1, wherein the passing of the performance test report simultaneously displays the relevant index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the production environment After the steps of performance evaluation, it also includes:
    接收到资源评估指令,获取所述资源评估指令中的每秒请求数阈值TPS_Y;The resource evaluation instruction is received, and the request per second threshold TPS_Y in the resource evaluation instruction is acquired;
    根据所述TPS_Y、CP_PerC、CC_P以及SN_P,计算服务器数量阈值SN_Y;Calculate the server quantity threshold SN_Y according to the TPS_Y, CP_PerC, CC_P and SN_P;
    根据所述SN_P和所述SN_Y,判断是否需要对所述待评估生产环境进行扩容或者减容;以及According to the SN_P and the SN_Y, determine whether it is necessary to expand or reduce the capacity of the production environment to be evaluated; and
    若需要对所述待评估生产环境进行扩容,则根据所述SN_P和SN_Y的差值,确定待扩容的服务器数量。If the production environment to be evaluated needs to be expanded, the number of servers to be expanded is determined according to the difference between the SN_P and SN_Y.
  6. 如权利要求5所述的生产环境的性能评估方法,其中,所述SN_Y的计算公式为:The method for evaluating the performance of the production environment according to claim 5, wherein the calculation formula of SN_Y is:
    SN_Y=TPS_Y/CP_PerC/CC_P-SN_P。SN_Y=TPS_Y/CP_PerC/CC_P-SN_P.
  7. 如权利要求5所述的生产环境的性能评估方法,其中,所述根据所述SN_P和所述SN_Y,判断是否需要对所述待评估生产环境进行扩容的步骤之后,还包括:The method for evaluating the performance of the production environment according to claim 5, wherein after the step of determining whether the production environment to be evaluated needs to be expanded according to the SN_P and the SN_Y, the method further comprises:
    若需要对所述待评估生产环境进行减容,则根据所述SN_P和SN_Y的差值,确定待减容的服务器数量。If it is necessary to reduce the capacity of the production environment to be evaluated, the number of servers to be reduced is determined according to the difference between the SN_P and SN_Y.
  8. 如权利要求1-7中任一项所述的生产环境的性能评估方法,其中,所述根据所述相关指标参数、资源配置参数以及预设计算规则,计算出所述待评估生产环境的每秒请求数的步骤包括:The method for evaluating the performance of the production environment according to any one of claims 1-7, wherein the calculation of each of the production environment to be evaluated is performed according to the relevant index parameters, resource configuration parameters, and preset calculation rules. The steps for requests per second include:
    将所述相关指标参数以及资源配置参数导出至表格应用;以及Exporting the relevant index parameters and resource configuration parameters to a table application; and
    在所述表格应用中,根据所述预设计算规则对所述相关指标参数以及资源配置参数进行计算,生成所述待评估生产环境的每秒请求数。In the table application, the relevant index parameters and resource configuration parameters are calculated according to the preset calculation rules to generate the number of requests per second of the production environment to be evaluated.
  9. 一种生产环境的性能评估装置,其中,所述生产环境的性能评估装置包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的生产环境的性能评估程序,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:A performance evaluation device for a production environment, wherein the performance evaluation device for the production environment includes a memory, a processor, and a production environment performance evaluation program stored on the memory and running on the processor, and When the performance evaluation program of the production environment is executed by the processor, the following steps are implemented:
    接收到系统性能测试请求,获取所述系统所属测试环境的相关指标参数以及待评估生产环境的资源配置参数;Receiving a system performance test request, acquiring relevant index parameters of the test environment to which the system belongs and resource configuration parameters of the production environment to be evaluated;
    根据所述相关指标参数、资源配置参数以及预设计算规则,计算出所述待评估生产环境的每秒请求数;以及Calculate the number of requests per second of the production environment to be evaluated according to the relevant index parameters, resource configuration parameters and preset calculation rules; and
    通过所述性能测试报告同时显示所述相关指标参数以及待评估生产环境的每秒请求数,以便指导用户进行所述生产环境的性能评估。The performance test report simultaneously displays the related index parameters and the number of requests per second of the production environment to be evaluated, so as to guide the user to perform the performance evaluation of the production environment.
  10. 如权利要求9所述的生产环境的性能评估装置,其中,所述相关指标参数包括TPS_T(测试环境的每秒请求数)、CC_T(测试环境的CPU总数)以及RU_T(测试环境的CPU使用百分比),所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:The performance evaluation device of the production environment according to claim 9, wherein the related index parameters include TPS_T (requests per second in the test environment), CC_T (total number of CPUs in the test environment), and RU_T (CPU usage percentage in the test environment) ), the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
    根据所述TPS_T、CC_T以及RU_T,计算出每个CPU的计算值CP_PerC,其中,CP_PerC的计算公式为:According to the TPS_T, CC_T, and RU_T, the calculated value CP_PerC of each CPU is calculated, where the calculation formula of CP_PerC is:
    CP_PerC=TPS_T/(CC_T*RU_T);以及CP_PerC=TPS_T/(CC_T*RU_T); and
    根据所述资源配置参数以及所述CP_PerC,计算出所述待评估生产 环境的每秒请求数。According to the resource configuration parameters and the CP_PerC, the number of requests per second of the production environment to be evaluated is calculated.
  11. 如权利要求10所述的生产环境的性能评估装置,其中,所述资源配置参数包括CC_P(待评估生产环境中每台服务器具有的CPU的个数)、SN_P(待评估生产环境的部署服务器数量)、RT_P(待评估生产环境的CPU占用限额)以及Rd(待评估生产环境的CPU的工作损耗百分比),所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:The performance evaluation device for a production environment according to claim 10, wherein the resource configuration parameters include CC_P (the number of CPUs in each server in the production environment to be evaluated), SN_P (the number of deployed servers in the production environment to be evaluated ), RT_P (CPU occupancy limit of the production environment to be evaluated), and Rd (percentage of CPU work loss in the production environment to be evaluated), the performance evaluation program of the production environment is executed by the processor to implement the following steps:
    根据所述CP_PerC、CC_P、SN_P、RT_P以及Rd,计算出待评估生产环境的每秒请求数TPS_P,其中,TPS_P的计算公式为:According to the CP_PerC, CC_P, SN_P, RT_P, and Rd, the number of requests per second TPS_P of the production environment to be evaluated is calculated, where the calculation formula of TPS_P is:
    TPS_P=CP_PerC*CC_P*SN_P*RT_P*(1-Rd)。TPS_P=CP_PerC*CC_P*SN_P*RT_P*(1-Rd).
  12. 如权利要求9所述的生产环境的性能评估装置,其中,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:9. The performance evaluation device of the production environment according to claim 9, wherein the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
    接收到用户操作触发的性能评估报告生成指令,获取预设性能评估报告模板;以及Receive a performance evaluation report generation instruction triggered by a user operation, and obtain a preset performance evaluation report template; and
    根据预设填写映射表,将所述相关指标参数、资源配置参数以及待评估生产环境的每秒请求数填写至所述预设性能评估报告模板的对应区域,生成所述待评估生产环境对应的性能评估报告。Fill in the mapping table according to the preset, fill in the relevant index parameters, resource configuration parameters, and the number of requests per second of the production environment to be evaluated into the corresponding area of the preset performance evaluation report template, and generate the corresponding data for the production environment to be evaluated Performance evaluation report.
  13. 如权利要求9所述的生产环境的性能评估装置,其中,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:9. The performance evaluation device of the production environment according to claim 9, wherein the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
    接收到资源评估指令,获取所述资源评估指令中的每秒请求数阈值TPS_Y;The resource evaluation instruction is received, and the request per second threshold TPS_Y in the resource evaluation instruction is acquired;
    根据所述TPS_Y、CP_PerC、CC_P以及SN_P,计算服务器数量阈值SN_Y;Calculate the server quantity threshold SN_Y according to the TPS_Y, CP_PerC, CC_P and SN_P;
    根据所述SN_P和所述SN_Y,判断是否需要对所述待评估生产环境进行扩容或者减容;以及According to the SN_P and the SN_Y, determine whether it is necessary to expand or reduce the capacity of the production environment to be evaluated; and
    若需要对所述待评估生产环境进行扩容,则根据所述SN_P和SN_Y的差值,确定待扩容的服务器数量。If the production environment to be evaluated needs to be expanded, the number of servers to be expanded is determined according to the difference between the SN_P and SN_Y.
  14. 如权利要求13所述的生产环境的性能评估装置,其中,所述SN_Y 的计算公式为:The performance evaluation device for a production environment according to claim 13, wherein the calculation formula of SN_Y is:
    SN_Y=TPS_Y/CP_PerC/CC_P-SN_P。SN_Y=TPS_Y/CP_PerC/CC_P-SN_P.
  15. 如权利要求13所述的生产环境的性能评估装置,其中,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:The performance evaluation device of the production environment according to claim 13, wherein the following steps are implemented when the performance evaluation program of the production environment is executed by the processor:
    若需要对所述待评估生产环境进行减容,则根据所述SN_P和SN_Y的差值,确定待减容的服务器数量。If it is necessary to reduce the capacity of the production environment to be evaluated, the number of servers to be reduced is determined according to the difference between the SN_P and SN_Y.
  16. 如权利要求9-15中任一项所述的生产环境的性能评估装置,其中,所述生产环境的性能评估程序被所述处理器执行时实现以下步骤:15. The performance evaluation device for a production environment according to any one of claims 9-15, wherein the following steps are implemented when the performance evaluation program for the production environment is executed by the processor:
    将所述相关指标参数以及资源配置参数导出至表格应用;以及Exporting the relevant index parameters and resource configuration parameters to a table application; and
    在所述表格应用中,根据所述预设计算规则对所述相关指标参数以及资源配置参数进行计算,生成所述待评估生产环境的每秒请求数。In the table application, the relevant index parameters and resource configuration parameters are calculated according to the preset calculation rules to generate the number of requests per second of the production environment to be evaluated.
  17. 一种计算机可读存储介质,其中,所述计算机可读存储介质上存储有生产环境的性能评估程序,所述生产环境的性能评估程序被处理器执行时实现如权利要求1至8中任一项所述的生产环境的性能评估方法的步骤。A computer-readable storage medium, wherein a performance evaluation program of a production environment is stored on the computer-readable storage medium, and when the performance evaluation program of the production environment is executed by a processor, the implementation is as in any one of claims 1 to 8. The steps of the production environment performance evaluation method described in the item.
PCT/CN2020/092638 2019-05-31 2020-05-27 Production environment performance evaluation method and apparatus, and storage medium WO2020238965A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910475996.4A CN110188027A (en) 2019-05-31 2019-05-31 Performance estimating method, device, equipment and the storage medium of production environment
CN201910475996.4 2019-05-31

Publications (1)

Publication Number Publication Date
WO2020238965A1 true WO2020238965A1 (en) 2020-12-03

Family

ID=67719780

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/092638 WO2020238965A1 (en) 2019-05-31 2020-05-27 Production environment performance evaluation method and apparatus, and storage medium

Country Status (2)

Country Link
CN (1) CN110188027A (en)
WO (1) WO2020238965A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110188027A (en) * 2019-05-31 2019-08-30 深圳前海微众银行股份有限公司 Performance estimating method, device, equipment and the storage medium of production environment
CN111666194B (en) * 2020-05-21 2022-02-08 平安科技(深圳)有限公司 Pressurization parameter self-adaptive adjusting method and device, computer equipment and storage medium
CN114090204A (en) * 2021-11-17 2022-02-25 深圳前海微众银行股份有限公司 Resource prediction method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007299212A (en) * 2006-04-28 2007-11-15 Fujitsu Ten Ltd Apparatus and method for evaluating porting of software
CN107659595A (en) * 2016-07-25 2018-02-02 阿里巴巴集团控股有限公司 A kind of method and apparatus for the ability for assessing distributed type assemblies processing specified services
CN107818045A (en) * 2017-09-29 2018-03-20 安徽四创电子股份有限公司 A kind of method for testing software of safe city
CN108848149A (en) * 2018-06-05 2018-11-20 挖财网络技术有限公司 The method and device of adaptive location HTTP service maximum processing capability
CN109660421A (en) * 2018-10-26 2019-04-19 平安科技(深圳)有限公司 Method, apparatus, server and the storage medium of flexible scheduling resource
CN110188027A (en) * 2019-05-31 2019-08-30 深圳前海微众银行股份有限公司 Performance estimating method, device, equipment and the storage medium of production environment

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107220121B (en) * 2017-05-25 2020-11-13 深信服科技股份有限公司 Sandbox environment testing method and system under NUMA architecture
CN108710576B (en) * 2018-05-30 2021-08-10 浙江工业大学 Data set expansion method based on heterogeneous migration and software defect prediction method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007299212A (en) * 2006-04-28 2007-11-15 Fujitsu Ten Ltd Apparatus and method for evaluating porting of software
CN107659595A (en) * 2016-07-25 2018-02-02 阿里巴巴集团控股有限公司 A kind of method and apparatus for the ability for assessing distributed type assemblies processing specified services
CN107818045A (en) * 2017-09-29 2018-03-20 安徽四创电子股份有限公司 A kind of method for testing software of safe city
CN108848149A (en) * 2018-06-05 2018-11-20 挖财网络技术有限公司 The method and device of adaptive location HTTP service maximum processing capability
CN109660421A (en) * 2018-10-26 2019-04-19 平安科技(深圳)有限公司 Method, apparatus, server and the storage medium of flexible scheduling resource
CN110188027A (en) * 2019-05-31 2019-08-30 深圳前海微众银行股份有限公司 Performance estimating method, device, equipment and the storage medium of production environment

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
FENG, ZHENXING ET AL.: "Non-official translation: Research on Prediction Models for Information System Performance Content", FINANCIAL COMPUTERIZING, no. 248, 15 May 2016 (2016-05-15), ISSN: 1008-0880, DOI: 20200730102850Y *
FENG, ZHENXING ET AL.: "Non-official translation: Research on Prediction Models for Information System Performance Content", FINANCIAL COMPUTERIZING, no. 248, 15 May 2016 (2016-05-15), ISSN: 1008-0880, DOI: 20200730102857X *

Also Published As

Publication number Publication date
CN110188027A (en) 2019-08-30

Similar Documents

Publication Publication Date Title
WO2020238965A1 (en) Production environment performance evaluation method and apparatus, and storage medium
CN110334021B (en) Interface test case generation method, device, equipment and storage medium
CN108628748B (en) Automatic test management method and automatic test management system
CN109451532A (en) A kind of check method and device of base station location
CN109726108B (en) Front-end code testing method, device, system and medium based on analog data
CN106067101A (en) A kind of distribution power engineering acceptance method and system
CN109491754A (en) The performance test methods and device of virtual server
CN108255707A (en) Development roles creation method, device, equipment and the storage medium of test case
CN105868956A (en) Data processing method and device
CN113965502A (en) Full link performance test method and system
CN111401722B (en) Intelligent decision method and intelligent decision system
CN111045879B (en) Method, device and storage medium for generating pressure test report
CN113656174A (en) Resource allocation method, system, computer device and storage medium
CN104021439A (en) Data center service maturity evaluation method and system
CN107038120A (en) A kind of method for testing software and equipment
CN109408304A (en) Block chain introduces test method, device, equipment and readable storage medium storing program for executing
CN108280024A (en) Traffic distribution strategy test method, device and electronic equipment
CN106535102B (en) A kind of mobile terminal locating method and mobile terminal
US7797136B2 (en) Metrics to evaluate process objects
CN115248782B (en) Automatic testing method and device and computer equipment
CN110334018A (en) A kind of big data introduction method and relevant device
CN114610372A (en) Processing method and device for review file, storage medium, processor and terminal
CN111078518B (en) Data acquisition method, terminal device and computer readable storage medium
CN114185770A (en) Method and device for generating test data, computer equipment and storage medium
CN104660428B (en) A kind of management method and device of performance data

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20812771

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20812771

Country of ref document: EP

Kind code of ref document: A1