CN107992401A - Performance test evaluation method, device, terminal device and storage medium - Google Patents
Performance test evaluation method, device, terminal device and storage medium Download PDFInfo
- Publication number
- CN107992401A CN107992401A CN201711223642.8A CN201711223642A CN107992401A CN 107992401 A CN107992401 A CN 107992401A CN 201711223642 A CN201711223642 A CN 201711223642A CN 107992401 A CN107992401 A CN 107992401A
- Authority
- CN
- China
- Prior art keywords
- performance
- test
- value
- evaluation
- indicator
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
- G06F11/3414—Workload generation, e.g. scripts, playback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3495—Performance evaluation by tracing or monitoring for systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
- H04L43/0888—Throughput
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Environmental & Geological Engineering (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses performance test evaluation method, device, terminal device and storage medium.The performance test evaluation method includes：System is tested for the property, obtains the test value of at least two performance indicators；The test value of each performance indicator is standardized using standardization transfer function, obtains the standard value of performance indicator；The standard value of at least two performance indicators is weighted using ranking operation algorithm, obtains performance test evaluation value；Default evaluation score table is inquired about based on the performance test evaluation of estimate, the corresponding evaluation score range of the performance test evaluation of estimate is determined, obtains system performance evaluation result.The performance test evaluation method can reflect the test case of system performance on the whole, so that layman can understand the test case of system performance according to system performance evaluation result.
Description
Technical field
The present invention relates to system testing field, more particularly to a kind of performance test evaluation method, device, terminal device and deposit
Storage media.
Background technology
In system development, the split system distributed is needed to be tested for the property, to test whether the system performance meets
The demand of exploitation.During current system performance test, the test value of each performance indicator is obtained respectively using performance test script, then
Compared with by test value standard value corresponding with same performance index, to determine whether the corresponding performance indicator of the system reaches
Mark.But during current system performance test, at least two performance indicators need to be tested, the survey of at least two performance indicators
Test result may be simultaneously present two kinds of situations up to standard and not up to standard, and whether be difficult to evaluate the system performance testing at this time qualified.I.e.
During current system performance test, quantification treatment can not be carried out to the test result of at least two performance indicators, so that it can be overall
Reflect the test case of the system performance.Moreover, the survey of single performance index can only be obtained during current system performance test respectively
Examination value, whether the test value is up to standard to need professional to be judged, layman is difficult to understand systematicness according to the test value
The test case of energy.
The content of the invention
The embodiment of the present invention provides a kind of performance test evaluation method, device, terminal device and storage medium, to solve to work as
During preceding system performance testing quantification treatment problem can not be carried out to the test result of at least two performance indicators.
In a first aspect, the embodiment of the present invention provides a kind of performance test evaluation method, including：
System is tested for the property, obtains the test value of at least two performance indicators；
The test value of each performance indicator is standardized using standardization transfer function, performance is obtained and refers to
Target standard value；
The standard value of at least two performance indicators is weighted using ranking operation algorithm, performance is obtained and surveys
Try evaluation of estimate；
Default evaluation score table is inquired about based on the performance test evaluation of estimate, determines that the performance test evaluation of estimate is corresponding
Score range is evaluated, obtains system performance evaluation result.
Second aspect, the embodiment of the present invention provide a kind of performance test evaluating apparatus, including：
Testing performance index value acquisition module, for being tested for the property to system, obtains at least two performance indicators
Test value；
Performance indicator standard value acquisition module, for using test of the standardization transfer function to each performance indicator
Value is standardized, and obtains the standard value of performance indicator；
Performance test evaluation of estimate acquisition module, for the mark using ranking operation algorithm at least two performance indicators
Quasi- value is weighted, and obtains performance test evaluation value；
Evaluation result acquisition module, for inquiring about default evaluation score table based on the performance test evaluation of estimate, determines institute
The corresponding evaluation score range of performance test evaluation of estimate is stated, obtains system performance evaluation result.
The third aspect, the embodiment of the present invention provide a kind of terminal device, including memory, processor and are stored in described
In memory and the computer program that can run on the processor, the processor are realized when performing the computer program
The step of performance test evaluation method.
Fourth aspect, the embodiment of the present invention provide a kind of computer-readable recording medium, the computer-readable storage medium
Matter is stored with computer program, and the computer program realizes the step of the performance test evaluation method when being executed by processor
Suddenly.
In performance test evaluation method provided in an embodiment of the present invention, device, terminal device and storage medium, using standard
Change transfer function to be standardized the test value of each performance indicator, the test value of performance indicator is converted into immeasurable
The differential other standard value of guiding principle, incalculability, fortune is weighted to realize using ranking operation algorithm to the standard value of performance indicator
Calculate.The performance test evaluation of estimate that obtains and default evaluation score table obtain after being handled based on weighting system performance evaluation as a result,
It can reflect the test case of the system performance on the whole.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention
Attached drawing to be used is needed to be briefly described, it should be apparent that, drawings in the following description are only some implementations of the present invention
Example, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these attached drawings
Obtain other attached drawings.
Fig. 1 is a flow chart of performance test evaluation method in the embodiment of the present invention 1.
Fig. 2 is mono- specific schematic diagrames of step S10 in Fig. 1.
Fig. 3 is another flow chart of performance test evaluation method in the embodiment of the present invention 1.
Fig. 4 is a functional block diagram of performance test evaluation device in the embodiment of the present invention 2.
Fig. 5 is a schematic diagram of terminal device in the embodiment of the present invention 4.
Embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is part of the embodiment of the present invention, instead of all the embodiments.Based on this hair
Embodiment in bright, other every implementations that those of ordinary skill in the art are obtained without creative efforts
Example, belongs to the scope of protection of the invention.
Embodiment 1
Fig. 1 shows the flow chart of performance test evaluation method in the present embodiment.The performance test evaluation method was applied at end
In end equipment, for testing the system performance of terminal device, tested especially by least two performance indicators,
Reflect the test case of the system performance on the whole, and quantification treatment carried out to the test result of at least two performance indicators,
To solve the problems, such as that layman can not understand the test case of system performance according to test result.As shown in Figure 1, the performance
Test evaluation method includes the following steps：
S10：System is tested for the property, obtains the test value of at least two performance indicators.
Specifically, performance test is to simulate a variety of normal, peak values and abnormal load conditions by automated test tool
To test the property indices of system.In the present embodiment, the performance indicator that system is tested for the property is included but
Unlimited cpu utilization rates in this present embodiment, memory usage, concurrent user number, database cache hit probability, operation are minimum
Configuration, hits per second, magnetic disc i/o throughput, network throughput, attempt connection number, database deadlocks, resource utilization, sound
Between seasonable, at least two of software request error rate, TPS and clicking rate.The test value of performance indicator refers to survey using automation
The concrete numerical value that trial work tool obtains after corresponding performance indicator is tested and handled.Each performance indicator can use extremely
A few automated test tool is tested, and is referred to moreover, each automated test tool can test at least one performance
Mark.
, it is necessary to be tested respectively at least two performance indicators when currently testing system performance, and to each
The test value of performance indicator is evaluated respectively, to determine whether system performance is good.For example, in the load energy of test system
Power, when can be by gradually increasing the quantity (controlling concurrent user number) of analog subscriber to observe the response of system under different loads
Between, the index such as network throughput, cpu utilization rates and memory usage, with the load performance of checking system.Correspondingly, make same
When the analog subscriber of quantity is by network throughput different system, the load of its system can be determined according to the response time of system
Performance, if network throughput is bigger, its response time is shorter.
In an embodiment, as shown in Fig. 2, step S10, is tested for the property system, at least two are obtained
The test value of performance indicator, specifically comprises the following steps：
S11：System is tested for the property, obtains the measured value of at least two performance indicators.
Wherein, the measured value of performance indicator refers to carry out performance survey to corresponding performance indicator using automated test tool
The concrete numerical value directly acquired is tried, i.e. the measured value is undressed concrete numerical value.In the present embodiment, the automatic test work
Tool includes performance test script corresponding with each performance indicator, when being such as tested for the property to response time of system, calling phase
Between the response time test script answered was tested at the beginning of the response time and the end time, the number of the response time is calculated
Value, the numerical value which then obtains for the response time, i.e., be tested for the property the response time using response time test script
The measured value of acquisition.
S12：Exceptional value judgement is carried out to the measured value of each performance indicator, is obtained in the normal range (NR) of performance indicator
Median of the measured value as performance indicator.
Wherein, the measured value progress exceptional value of performance indicator is judged to refer to the measured value by performance indicator with pre-setting
The normal range (NR) of performance indicator judged.If the measured value of performance indicator is in the normal range (NR) of performance indicator, the property
The measured value of energy index is test normal value, and the median using the measured value as performance indicator can be as the number of step S13
According to basis；If the measured value of performance indicator, not in the normal range (NR) of performance indicator, the measured value of the performance indicator is test
Exceptional value, subsequent treatment is carried out not as the median of performance indicator.
In the present embodiment, since the factor for influencing system testing not only includes system oneself factor, external environment condition is further included
Factor, external environmental factor generally comprise：Hardware, software, network, test script, Scenario Design and scene execution etc..Hardware has
Body can be server, load machine, interchanger and cable.Software is specifically as follows the preparation of database connection pool, Web server
Preparation, JVM (Java Virtual Machine, Java Virtual Machine), GC prepare (Garbage Collection preparations, i.e. rubbish
Rubbish processing is prepared) and the system preparation of itself etc..Network can include LAN and open net etc..Test script can include normal
With the setting of functional parameter, configuration of test case etc..Scenario Design can include single game scape, combine scenes, pressurization, continue when
Between, the parameter designing such as the release principle in meeting point and load machine number.
In order to avoid external environment influence, the normal range (NR) of performance indicator need to be pre-configured with based on system oneself factor, if
The measured value of performance indicator, which exceedes the normal range (NR), then proves that the measured value of performance indicator is exceptional value, determines that the exceptional value is main
It is to be influenced be subject to external environmental factor, not as the median of the performance indicator of subsequent treatment, which refers to
Target median can exclude to be in the measured value beyond performance test normal range (NR), so that the median of the performance test obtained is more
The actual conditions of system performance can be embodied so that subsequent treatment is more accurate.
When being such as tested for the property to a website, if the measured value for the network transmission speed that test obtains website is 105M,
But the theoretic maximum of network transmission speed of interchanger used in current site is 100M, but consider network transmission mistake
Loss in journey, the normal range (NR) of its network transmission speed is 0-90M, then the measured value of the network transmission speed of the website at this time
For exceptional value, need to delete the exceptional value at this time, to avoid subsequent detection to corresponding exceptional value, it may be considered that select network transmission
Speed is the interchanger of 1000M, influences system performance testing to avoid because of the external environmental factor.Correspondingly, if test obtains
The measured value of the network transmission speed of website is 65M, then the measured value of the network transmission speed, can conduct in normal range (NR)
The median of this performance indicator of network transfer speeds.
S13：The median of the corresponding performance indicator of same performance index is subjected to mean value computation, to obtain performance indicator
Test value.
In the present embodiment, institute that the same performance index that step S12 is got is got within corresponding test period
The median for having performance indicator usesMean value computation is carried out, wherein,It is to be got after calculating
Performance indicator test value, a1、a2、a3...anIt is the median of performance indicator, n is the quantity of the median of performance indicator.
In step S13, by carrying out mean value computation to the median of performance indicator, the test value of performance indicator got can be made more
It is accurate and objective, exclude the contingency of test result.
In the response time of the system of test, a test period is pre-set, during to belonging to the response in the periodic regime
Between the median of this performance indicator carry out mean value computation and draw the test value of the response time.Such as pre-set a test period
For the time range of 40s, in the time range, once, test execution number is 40 times, i.e., for test per second to the response time
The median of 40 response times is obtained, mean value calculation is carried out to this 40 medians, obtains the test of the response time
Value, the i.e. test value are the test value of this performance indicator of the response time of acquisition.
S20:The test value of each performance indicator is standardized using standardization transfer function, performance is obtained and refers to
Target standard value.
Wherein, data normalization (normalization) is by data bi-directional scaling, is allowed to fall into one small specific
Section, the unit for removing data limit, and the pure values of no magnitude are translated into, easy to not commensurate or the index of magnitude
It can be compared and weight.Specifically, can when the test value to obtaining at least two performance indicators is standardized
(Min-max normalization) transfer function is standardized using min-max and carries out conversion process, obtains at least two performances
The standard value of index.Wherein, min-max standardizes (Min-max normalization) and is also referred to as deviation standardization, refers to adopt
Linear transformation is carried out to the testing performance index value of acquisition with transfer function, result is fallen on the process of pre-set interval.This implementation
In example, after being standardized using min-max standardization transfer functions to the test value of each performance indicator, the property of acquisition
The standard value of energy index is convertible into the pure values of no magnitude so that can be compared to each other and count between any two performance indicator
Calculate.
Further, standardization transfer function isxminFor the minimum value of performance indicator, xmax
For the maximum of performance indicator, x is the test value of performance indicator, x*For the standard value of performance indicator, N is the section of pre-set interval
Scope.The maximum and minimum value of the performance indicator are pre-set concrete numerical value.It is to be appreciated that if N is 1, use
xmin-xmaxResult after standardization falls in [0,1] this interval range；If N is 10, using xmin-xmaxStandardization
Result after processing falls in [0,10] this interval range.In the present embodiment, at least two performance indicators of system into
During row test, all properties index, which is standardized, should use identical interval range, so that different performance indicators
Between can be compared and calculate.
Specifically, the homepage of a website is logged in and site information page access operates and handles data under big load condition
Ability and ability to bear performance test, which includes the test value of at least two performance indicators, i.e. concurrent user
Number, TPS, network throughput and response time, the order of magnitude and unit of each testing performance index value are different, such as obtain not
Test value with performance indicator is that concurrent user number is " 300 ", and TPS is " 6.66 times/s ", network throughput is " 700Mb/
S ", response time 5.08s.The performance test results are calculated, being can not be by varying number level and at least two performances of dimension
The test value of index is unifiedly calculated.For unified standard, need to be standardized all evaluation indexes, with the amount of elimination
Guiding principle, converts it into the differential other standard value of dimensionless, incalculability, then is analyzed and evaluated, and is conducive to draw more accurate
As a result.
S30：The standard value of at least two performance indicators is weighted using ranking operation algorithm, performance is obtained and surveys
Try evaluation of estimate.
Specifically, which obtained after standardization at least two performance indicators is weighted
Comprehensive evaluation value.Wherein, used ranking operation algorithm is：
Wherein, x1、x2、x3...xnRepresent performance
The standard value of index, W1、W2、W3...WnRepresent the weight of performance indicator,For performance test evaluation of estimate.Due at least two property
The standard value x of energy index is the concrete numerical value by standardization so that can phase between the standard value of all properties index
Mutually it is compared and calculates, basis is provided for ranking operation.Wherein, the weight of performance indicator represents each performance indicator and system is surveyed
The influence degree of test result, performance indicator is more important, its corresponding weight is bigger, illustrates the performance indicator to system test result
Influence degree it is bigger.The SLA that the weight W of performance indicator can be set by tester according to different system and framework
(Service-Level Agreement, i.e. service-level agreement) is determined；Can also be designer according to existing same type
The numerical value that the historical data of each performance indicator in project obtains after being analyzed.
In one embodiment, the homepage of website logs in and the operation of site information page access handles number under big load condition
According to ability and ability to bear performance test, performance indicator in the performance test includes concurrent user number, TPS, network and gulps down
The amount of spitting and response time, wherein each performance indicator is different to the influence degree of the performance test results, shared weight will
It is different.The weight of each performance indicator can determine according to the SLA that user provides, as user think judge the website be
During performance of uniting, concurrent user number is most important, and the response time takes second place, and is TPS again, is finally network throughput, each performance indicator
Weight be respectively set to 40%, 30%, 20% and 10%, then system can be calculated according to the standard value that gets and weight
Draw performance test evaluation of estimate.
If user without the SLA provided, the test system can according to the performance indicator in existing same type project and
Weight size is tested for the property system evaluation of result or is tested for the property according to the historical data of the test system and commented
Valency.Such as the performance of business submission system is tested, user does not provide SLA, at this time designer can according to historical data,
The weight of each performance indicator such as designed, designed concurrent user number, TPS, network throughput and response time, therefore, the processing step
The standard value for the multiple single performance indexs for needing to test in system can be weighted processing and obtain a performance test and commented
Value, can reflect the test case of the system performance on the whole.
S40：Default evaluation score table is inquired about based on performance test evaluation of estimate, determines the corresponding evaluation of performance test evaluation value
Score range, obtains system performance evaluation result.
Wherein, system performance evaluation is the result is that final overall merit for evaluation system performance.Default evaluation score value
Table includes at least two evaluation conclusions, and each evaluation result corresponds to an evaluation score range.The default evaluation score table is user
Pre-set, the score table of SLA, historical data or the existing same type project that can specifically be provided according to user is set.
As a specific default evaluation score table include it is outstanding, good, qualified and unqualified etc. five evaluation indexes,
The corresponding score range of evaluating of each evaluation index is outstanding, good, general, qualified and unqualified, corresponding evaluation point respectively
Value scope be arranged to [90,100) be divided into it is outstanding, [80,90) be divided into it is good, [70,80) be divided into it is general, [60,70) be divided into qualification,
[60,0) be divided into it is unqualified.
As shown in above-mentioned default evaluation score table, step S40 specifically comprises the following steps：Based on performance test evaluation of estimate and
Evaluation score range in default evaluation score table, determines objective appraisal score range, and objective appraisal score range is corresponding
Evaluation conclusion is as system performance evaluation result.
Specifically, first evaluation score range in performance test evaluation of estimate and default evaluation score table is contrasted, is obtained
Evaluation score range belonging to the performance test evaluation of estimate, and using the evaluation score range belonging to it as objective appraisal score value model
Enclose；Again using the corresponding evaluation conclusion of objective appraisal score range as the final system performance evaluation result for calculating and obtaining.Such as meter
Obtained performance test evaluation of estimate is 92 points, then the objective appraisal in the corresponding default evaluation score table of the system performance testing
Score range for [90,100) point, corresponding evaluation result is outstanding, it is thus determined that the system performance evaluation result is outstanding.Should
System performance evaluation result can directly reflect system performance testing situation, while easy to user to the system performance testing situation
There is understanding more directly perceived.
In an embodiment, as shown in figure 3, being tested for the property to system, further include before：
S01：Performance test instruction input by user is obtained, performance test instructs the system type for including test system to be measured.
Wherein, performance test instruction be it is input by user needs from system obtain performance indication range instruction, the property
Instruction, which can be tested, includes the system type of test system to be measured.The system that test system to be measured refers to system performance testing to be carried out.Should
System type includes but not limited to business result submission system and business datum storage system in the present embodiment, such as business result
The performance indicator of submission system includes concurrent user number, handling capacity, clicking rate and error rate.The performance of business datum storage system
Index includes response time, throughput, TPS and the resource utilization of system.This two kinds system types to be tested are different, it is corresponded to
Performance indicator it is different, determine that system type can determine the content for needing the performance indicator obtained to specifically include, allow system can
Targetedly to obtain the performance indicator of needs, the time of server process is saved, improves treatment effeciency.
S02：Based on system type, obtain includes with the corresponding ranking operation algorithm of system type, ranking operation algorithm
At least two performance indicators to be tested.
Specifically, the performance indicator that different system type to be tested is different, while different types of test system pair to be measured
The different performance index answered is also different to the influence degree of its test result, therefore the test system to be measured of different system type corresponds to
Performance indicator weight it is also different, its ranking operation algorithm also can be different.Therefore, can be according to the property got in step S02
The system type in instruction can be tested, determines corresponding ranking operation algorithm, it is to be measured which includes at least two
The weight of performance indicator and corresponding performance indicator to be tested is tried, its specific formula for calculation is as shown in step S30.
Such as two different types of systems of business result submission system and business datum storage system, wherein business result carries
The performance indicator of the performance test of friendship system includes concurrent user number, handling capacity, clicking rate and error rate, to the performance test results
The significance level of influence is followed successively by concurrent user number, handling capacity, clicking rate and error rate from high to low；Business datum storage system
The performance indicator of performance test include resource utilization, the response time of system, TPS and throughput, wherein to performance test
As a result the significance level influenced is followed successively by resource utilization, the response time of system, TPS and throughput from high to low.Not homology
System type corresponds to different performance indicators, and the significance level that each performance indicator influences test result in a system type is not
Together, corresponding weight will be different, and ranking operation algorithm also can be different.Corresponding weighting fortune is determined based on different system types
The accuracy of result treatment can be effectively improved by calculating algorithm.
The evaluation system test result needs the index obtained and corresponding weight to be not limited to the embodiment.
Further, if user provides SLA, corresponding index and weight are counted in the SLA provided according to user
Calculate, no longer perform step S01 and S02.
S03：Based on performance indicator to be tested, performance test script is obtained.
Specifically, all corresponding performance test script of each performance indicator to be tested, the performance test script are stored in clothes
It is engaged in device, after system type is determined, corresponding performance indicator to be tested also can mutually should determine that, receiving this in server treats
During test performance index, server can transfer corresponding performance test script based on the performance indicator to be tested, due to different fingers
It is different to mark computational methods, so its performance test script is also different.
In the embodiment, step S10 is specifically included：At least two performance test scripts are called to survey system
Examination, obtains the test value of at least two performance indicators respectively.
Test system to be measured provides interface, to directly invoke corresponding at least two performance test script based on performance indicator
System is tested for the property, obtains the test value of at least two performance indicators.At least two performance test scripts can be at the same time
Call, can also be called according to the same performance test script of actual test situation by multiple system performance testings.The performance test
Script, can be called at the same time, and method of calling is flexible, save the testing time.
The performance test evaluation method, obtains the measured value of at least two performance indicators, for the standard of follow-up result of calculation
True property, first removes and is not belonging to measured value in normal range (NR), the measured value in the normal range (NR) of retention property index；Then in order to
The contingency and uncertainty of the data obtained are excluded, mean value computation need to be carried out to the measured value in the normal range (NR) of performance indicator,
Obtain the test value of corresponding performance indicator.Since the order of magnitude of at least two performance indicators is different with dimension in performance test,
In order to unifiedly calculate, standardization transfer function need to be used to be standardized the test value of all properties index, eliminate number
Magnitude and dimension, change into the standard value of dimensionless and the differential other performance indicator of incalculability.Based on each performance indicator to test
As a result the difference of influence degree, is weighted processing, so as to obtain using ranking operation algorithm to the standard value of each performance indicator
It can integrally reflect the performance test evaluation of estimate of system performance.The performance test evaluation of estimate that obtains and default after being handled again based on weighting
Evaluate score table and obtain system performance evaluation as a result, the system performance evaluation result can reflect the survey of the system performance on the whole
Examination situation, the test case of system performance is understood easy to layman according to system performance evaluation result.
It is to be understood that the size of the sequence number of each step is not meant to the priority of execution sequence, each process in above-described embodiment
Execution sequence should determine that the implementation process without tackling the embodiment of the present invention forms any limit with its function and internal logic
It is fixed.
Embodiment 2
Fig. 4 shows the principle frame with the one-to-one performance test evaluating apparatus of performance test evaluation method in embodiment 1
Figure.As shown in figure 4, the performance test evaluating apparatus includes testing performance index value acquisition module 10, performance indicator standard value obtains
Modulus block 20, performance test evaluation of estimate acquisition module 30 and evaluation result acquisition module 40.Wherein, testing performance index value obtains
Module 10, performance indicator standard value acquisition module 20, performance test evaluation of estimate acquisition module 30 and evaluation result acquisition module 40
Realize that corresponding with performance test evaluation method in the embodiment step of function corresponds, to avoid repeating, the present embodiment is not
It is described in detail one by one.
Testing performance index value acquisition module 10, for being tested for the property to system, obtains at least two performance indicators
Test value.
Performance indicator standard value acquisition module 20, for the test value using standardization transfer function to each performance indicator
It is standardized, obtains the standard value of performance indicator.
Performance test evaluation of estimate acquisition module 30, for the standard using ranking operation algorithm at least two performance indicators
Value is weighted, and obtains performance test evaluation value.
Evaluation result acquisition module 40, for based on performance test evaluation of estimate and default evaluation score table, obtaining systematicness
Can evaluation result.
Preferably, standardization transfer function isxminFor the minimum value of performance indicator, xmaxFor property
Can index maximum, x be performance indicator test value, x*For the standard value of performance indicator, N is the section model of pre-set interval
Enclose.
Preferably, ranking operation algorithm isIts
In, x1、x2、x3...xnFor the standard value of performance indicator, W1、W2、W3...WnFor the weight of performance indicator,Commented for performance test
Value.
Preferably, performance test evaluating apparatus further includes performance test instruction acquiring unit 01, operation method acquiring unit
02 and performance test script acquiring unit 03.
Performance test instructs acquiring unit 01, for obtaining performance test instruction input by user, performance test instruction
Include the system type of test system to be measured.
Operation method acquiring unit 02, for based on system type, obtaining and the corresponding ranking operation of the system type
Algorithm, the ranking operation algorithm include at least two performance indicators to be tested.
Performance test script acquiring unit 03, for based on performance indicator to be tested, obtaining performance test script.
Testing performance index value acquisition module 10, for calling at least two performance test scripts to test system,
The test value of at least two performance indicators is obtained respectively.
Preferably, presetting evaluation score table includes at least two evaluation conclusions, and each evaluation result corresponds to an evaluation score value
Scope.
Evaluation result acquisition module 40, is additionally operable to based on the evaluation point in performance test evaluation of estimate and default evaluation score table
It is worth scope, objective appraisal score range is determined, using the corresponding evaluation conclusion of objective appraisal score range as system performance evaluation
As a result.
Preferably, testing performance index value acquisition module 10 includes performance indicator measured value acquiring unit 11, performance indicator
Median acquiring unit 12 and median processing unit 13.
Performance indicator measured value acquiring unit 11, for being tested for the property to system, obtains the measured value of performance indicator.
Performance indicator median acquiring unit 12, for carrying out exceptional value judgement to the measured value of each performance indicator, is obtained
Take median of the measured value in the normal range (NR) of performance indicator as performance indicator.
Median processing unit 13, based on the median of the corresponding performance indicator of same performance index is carried out average
Calculate, to obtain the test value of performance indicator.
Embodiment 3
The present embodiment provides a computer-readable recording medium, computer journey is stored with the computer-readable recording medium
Sequence, the computer program realize performance test evaluation method in embodiment 1 when being executed by processor, to avoid repeating, here not
Repeat again.Alternatively, the computer program realized when being executed by processor in embodiment 2 each module in performance test evaluation device/
The function of unit, to avoid repeating, which is not described herein again.
Embodiment 4
Fig. 5 is the schematic diagram for the terminal device that one embodiment of the invention provides.As shown in figure 5, the terminal of the embodiment is set
Standby 50 include：Processor 51, memory 52 and it is stored in the computer journey that can be run in memory 52 and on processor 51
Sequence 53.Processor 51 realizes each step of performance test evaluation method in embodiment 1 when performing computer program 53, such as schemes
Step S10 to S40 shown in 1.Alternatively, processor 51 realizes each mould in above-mentioned each device embodiment when performing computer program 53
The function of block/unit, such as the acquisition module of testing performance index value shown in Fig. 4 10, performance indicator standard value acquisition module 20, property
The function of energy test evaluation value acquisition module 30 and evaluation result acquisition module 40.
Exemplary, computer program 53 can be divided into one or more module/units, one or more mould
Block/unit is stored in memory 52, and is performed by processor 51, to complete the present invention.One or more module/units can
To be the series of computation machine programmed instruction section that can complete specific function, the instruction segment is for describing computer program 53 at end
Implementation procedure in end equipment 50.For example, computer program 53 can be divided into testing performance index value acquisition module 10, property
Can indicators standard value acquisition module 20, performance test evaluation of estimate acquisition module 30 and evaluation result acquisition module 40.
The terminal device 50 can be the computing devices such as desktop PC, notebook, palm PC and cloud server.
Terminal device may include, but be not limited only to, processor 51, memory 52.It will be understood by those skilled in the art that Fig. 5 is only
The example of terminal device 50, does not form the restriction to terminal device 50, can include components more more or fewer than diagram, or
Person combines some components, or different components, such as the terminal device can also include input-output equipment, network insertion is set
Standby, bus etc..
Alleged processor 51 can be central processing unit (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), application-specific integrated circuit
(Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor can also be any conventional processor
Deng.
Memory 52 can be the internal storage unit of terminal device 50, such as the hard disk of terminal device 50 or memory use
Rate.Memory 52 can also be the plug-in type hard disk being equipped with the External memory equipment of terminal device 50, such as terminal device 50,
Intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card (Flash
Card) etc..Further, memory 52 can also both include the internal storage unit of terminal device 50 or be set including external storage
It is standby.Memory 52 is used to store computer program and other programs and data needed for terminal device.Memory 52 can be with
For temporarily storing the data that has exported or will export.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each work(
Can unit, module division progress for example, in practical application, can be as needed and by above-mentioned function distribution by different
Functional unit, module are completed, i.e., the internal structure of described device are divided into different functional units or module, more than completion
The all or part of function of description.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units integrate in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.
If the integrated module/unit realized in the form of SFU software functional unit and as independent production marketing or
In use, it can be stored in a computer read/write memory medium.Based on such understanding, the present invention realizes above-mentioned implementation
All or part of flow in example method, can also instruct relevant hardware to complete, the meter by computer program
Calculation machine program can be stored in a computer-readable recording medium, the computer program when being executed by processor, it can be achieved that on
The step of stating each embodiment of the method.Wherein, the computer program includes computer program code, the computer program generation
Code can be source code form, object identification code form, executable file or some intermediate forms etc..The computer-readable medium
It can include：Any entity or device, recording medium, USB flash disk, mobile hard disk, the magnetic of the computer program code can be carried
Dish, CD, computer storage, read-only storage (ROM, Read-Only Memory), random access memory (RAM,
Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It is it should be noted that described
The content that computer-readable medium includes can carry out appropriate increasing according to legislation in jurisdiction and the requirement of patent practice
Subtract, such as in some jurisdictions, according to legislation and patent practice, computer-readable medium do not include be electric carrier signal and
Telecommunication signal.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although with reference to foregoing reality
Example is applied the present invention is described in detail, it will be understood by those of ordinary skill in the art that：It still can be to foregoing each
Technical solution described in embodiment is modified, or carries out equivalent substitution to which part technical characteristic；And these are changed
Or replace, the essence of appropriate technical solution is departed from the spirit and scope of various embodiments of the present invention technical solution, should all
Within protection scope of the present invention.
Claims (10)
- A kind of 1. performance test evaluation method, it is characterised in that including：System is tested for the property, obtains the test value of at least two performance indicators；The test value of each performance indicator is standardized using standardization transfer function, obtains performance indicator Standard value；The standard value of at least two performance indicators is weighted using ranking operation algorithm, performance test is obtained and comments Value；Default evaluation score table is inquired about based on the performance test evaluation of estimate, determines the corresponding evaluation of the performance test evaluation of estimate Score range, obtains system performance evaluation result.
- 2. performance test evaluation method as claimed in claim 1, it is characterised in thatIt is described standardization transfer function bexminFor the minimum value of performance indicator, xmaxFor performance indicator Maximum, x be performance indicator test value, x*For the standard value of performance indicator, N is the interval range of pre-set interval；The ranking operation algorithm isWherein, x1、x2、 x3...xnFor the standard value of performance indicator, W1、W2、W3...WnFor the weight of performance indicator,For performance test evaluation of estimate.
- 3. performance test evaluation method as claimed in claim 1, it is characterised in that be tested for the property described to system Before step, the performance test evaluation method further includes：Performance test instruction input by user is obtained, the performance test instruction includes the system type of test system to be measured；Based on the system type, obtain and the corresponding ranking operation algorithm of the system type, the ranking operation Algorithm includes at least two performance indicators to be tested；Based on the performance indicator to be tested, the performance test script is obtained；It is described that system is tested for the property, the test value of at least two performance indicators is obtained, including：Call at least two performance test scripts to test the system, obtain at least two performances respectively and refer to Target test value.
- 4. performance test evaluation method as claimed in claim 1, it is characterised in that the default evaluation score table is included at least Two evaluation conclusions, each evaluation result correspond to an evaluation score range；It is described based on the performance test evaluation of estimate and default evaluation score table, obtain system performance evaluation as a result, including：Based on the evaluation score range in the performance test evaluation of estimate and the default evaluation score table, objective appraisal point is determined It is worth scope, using the corresponding evaluation conclusion of the objective appraisal score range as the system performance evaluation result.
- 5. performance test evaluation method as claimed in claim 1, it is characterised in that it is described that system is tested for the property, obtain The test value of at least two performance indicators is taken, including：System is tested for the property, obtains the measured value of performance indicator；Exceptional value judgement is carried out to the measured value of each performance indicator, is obtained in the normal range (NR) of the performance indicator Median of the measured value as the performance indicator；The median of the corresponding performance indicator of same performance index is subjected to mean value computation, to obtain the survey of performance indicator Examination value.
- A kind of 6. performance test evaluating apparatus, it is characterised in that including：Testing performance index value acquisition module, for being tested for the property to system, obtains the test of at least two performance indicators Value；Performance indicator standard value acquisition module, for using standardization transfer function to the test value of each performance indicator into Row standardization, obtains the standard value of performance indicator；Performance test evaluation of estimate acquisition module, for the standard value using ranking operation algorithm at least two performance indicators It is weighted, obtains performance test evaluation value；Evaluation result acquisition module, for inquiring about default evaluation score table based on the performance test evaluation of estimate, determines the property Energy test evaluation is worth corresponding evaluation score range, obtains system performance evaluation result.
- 7. performance test evaluating apparatus as claimed in claim 6, it is characterised in thatIt is described standardization transfer function bexminFor the minimum value of performance indicator, xmaxFor performance indicator Maximum, x be performance indicator test value, x*For the standard value of performance indicator, N is the interval range of pre-set interval；The ranking operation algorithm isWherein, x1、x2、 x3...xnFor the standard value of performance indicator, W1、W2、W3...WnFor the weight of performance indicator,For performance test evaluation of estimate.
- 8. performance test evaluating apparatus as claimed in claim 6, it is characterised in that the performance test evaluating apparatus, is also wrapped Include：Performance test instructs acquiring unit, and for obtaining performance test instruction input by user, the performance test instruction includes The system type of test system to be measured；Operation method acquiring unit, for based on the system type, obtaining and the corresponding weighting of the system type Mathematical algorithm, the ranking operation algorithm include at least two performance indicators to be tested；Performance test script acquiring unit, for based on the performance indicator to be tested, obtaining the performance test script；The testing performance index value acquisition module, for calling at least two performance test scripts to carry out the system Test, obtains the test value of at least two performance indicators respectively.
- 9. a kind of terminal device, including memory, processor and it is stored in the memory and can be on the processor The computer program of operation, it is characterised in that the processor realizes such as claim 1 to 5 when performing the computer program The step of any one performance test evaluation method.
- 10. a kind of computer-readable recording medium, the computer-readable recording medium storage has computer program, its feature exists In realizing the performance test evaluation method as described in any one of claim 1 to 5 when the computer program is executed by processor Step.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711223642.8A CN107992401B (en) | 2017-11-29 | 2017-11-29 | Performance test evaluation method and device, terminal equipment and storage medium |
| PCT/CN2018/073613 WO2019104854A1 (en) | 2017-11-29 | 2018-01-22 | Performance test and evaluation method and apparatus, terminal device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711223642.8A CN107992401B (en) | 2017-11-29 | 2017-11-29 | Performance test evaluation method and device, terminal equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107992401A true CN107992401A (en) | 2018-05-04 |
| CN107992401B CN107992401B (en) | 2020-08-14 |
Family
ID=62034128
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711223642.8A Active CN107992401B (en) | 2017-11-29 | 2017-11-29 | Performance test evaluation method and device, terminal equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107992401B (en) |
| WO (1) | WO2019104854A1 (en) |
Cited By (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108898022A (en) * | 2018-06-22 | 2018-11-27 | 珠海市君天电子科技有限公司 | A kind of method for testing performance, device and electronic equipment |
| CN109144839A (en) * | 2018-10-09 | 2019-01-04 | 郑州云海信息技术有限公司 | The acquisition methods and device of equipment state |
| CN109327355A (en) * | 2018-10-25 | 2019-02-12 | 平安科技（深圳）有限公司 | Cloud storage system performance evaluation methodology, device and computer readable storage medium |
| CN109408399A (en) * | 2018-12-14 | 2019-03-01 | 武汉斗鱼鱼乐网络科技有限公司 | A kind of calculation power estimation method, device, equipment and storage medium |
| CN109408364A (en) * | 2018-08-28 | 2019-03-01 | 深圳壹账通智能科技有限公司 | Method for analyzing performance, device, terminal and the computer storage medium of software product |
| CN109800138A (en) * | 2018-12-18 | 2019-05-24 | 平安科技（深圳）有限公司 | A kind of cpu test method, electronic device and storage medium |
| CN110209577A (en) * | 2019-05-20 | 2019-09-06 | 深圳壹账通智能科技有限公司 | A kind of test method and device |
| CN110221953A (en) * | 2019-05-20 | 2019-09-10 | 平安普惠企业管理有限公司 | Test result analysis method, apparatus, server and storage medium |
| CN110262953A (en) * | 2019-06-21 | 2019-09-20 | 中汇信息技术（上海）有限公司 | Method for testing software system performance and computer readable storage medium |
| CN110505109A (en) * | 2018-05-17 | 2019-11-26 | 阿里巴巴集团控股有限公司 | The method, apparatus and storage medium of test macro isolation performance |
| CN110968465A (en) * | 2018-09-30 | 2020-04-07 | 北京奇虎科技有限公司 | Hardware performance test method and device |
| CN111458617A (en) * | 2020-03-19 | 2020-07-28 | 深圳供电局有限公司 | Semiconductor device reliability detection method, semiconductor device reliability detection device, computer equipment and medium |
| CN111709623A (en) * | 2020-06-04 | 2020-09-25 | 中国科学院计算机网络信息中心 | High-performance computing environment evaluation method and device, electronic equipment and storage medium |
| CN111766613A (en) * | 2020-06-11 | 2020-10-13 | Oppo广东移动通信有限公司 | GPS function testing method and device and storage medium |
| CN111813644A (en) * | 2020-07-16 | 2020-10-23 | 中国民航信息网络股份有限公司 | System performance evaluation method and device, electronic equipment and computer readable medium |
| CN111832921A (en) * | 2020-06-30 | 2020-10-27 | 佛山科学技术学院 | Industrial robot performance index evaluation equipment and method based on machine learning |
| CN111913852A (en) * | 2020-08-11 | 2020-11-10 | 中国工商银行股份有限公司 | Health management method and device for storage system |
| CN112039730A (en) * | 2020-08-31 | 2020-12-04 | 海南大学 | Performance evaluation method of encryption algorithm and storage medium |
| CN112109086A (en) * | 2020-09-03 | 2020-12-22 | 清华大学深圳国际研究生院 | Grabbing method for industrial stacked parts, terminal equipment and readable storage medium |
| CN112685295A (en) * | 2020-12-25 | 2021-04-20 | 北京达佳互联信息技术有限公司 | Data analysis method and device, electronic equipment and storage medium |
| CN113378305A (en) * | 2021-08-12 | 2021-09-10 | 深圳市城市交通规划设计研究中心股份有限公司 | Driverless trolley-based vehicle-road cooperative testing method and device |
| CN113553248A (en) * | 2021-08-12 | 2021-10-26 | 上海识装信息科技有限公司 | Application program performance evaluation method and device and storage medium |
| WO2022022717A1 (en) * | 2020-07-31 | 2022-02-03 | 中国移动通信有限公司研究院 | Test method and device |
| CN114531368A (en) * | 2020-10-31 | 2022-05-24 | 中盈优创资讯科技有限公司 | Network quality evaluation method, device and equipment |
| CN114637739A (en) * | 2022-03-22 | 2022-06-17 | 平安国际融资租赁有限公司 | Database management and control method, system, computer equipment and computer storage medium |
| CN114896142A (en) * | 2022-04-25 | 2022-08-12 | 矩阵时光数字科技有限公司 | Performance index optimization method based on JMeter |
| CN117331846A (en) * | 2023-11-30 | 2024-01-02 | 河北雄安尚世嘉科技有限公司 | Internet-based software development, operation, test and management system |
| CN117572853A (en) * | 2024-01-17 | 2024-02-20 | 中国人民解放军陆军装甲兵学院 | Magnetic field controller performance test analysis management system |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115079577B (en) * | 2022-07-22 | 2022-11-11 | 浙江中控技术股份有限公司 | Closed loop step test method and test device based on real-time control performance evaluation |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102262664A (en) * | 2011-07-26 | 2011-11-30 | 北京百度网讯科技有限公司 | Quality estimating method and quality estimating device |
| CN103279831A (en) * | 2013-06-27 | 2013-09-04 | 李岩 | Method for achieving management system for evaluating software test quality and development capacity |
| CN104077218A (en) * | 2013-03-29 | 2014-10-01 | 百度在线网络技术（北京）有限公司 | Test method and device of MapReduce distributed system |
| CN107330619A (en) * | 2017-06-30 | 2017-11-07 | 国核电力规划设计研究院有限公司 | Determine method, device and the computer-readable recording medium of comprehensive evaluation value |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101572623B (en) * | 2009-04-30 | 2011-08-31 | 上海大学 | Method for comprehensively evaluating network performance based on subjective and objective combination evaluation |
| US8285841B2 (en) * | 2010-06-07 | 2012-10-09 | Compuware Corporation | Service quality evaluator having adaptive evaluation criteria |
| CN102143507B (en) * | 2010-11-23 | 2015-04-15 | 北京中创信测科技股份有限公司 | Method and system for monitoring service quality, and analytical method and system therefor |
| CN102790699B (en) * | 2012-08-21 | 2016-09-28 | 杭州华三通信技术有限公司 | A kind of analysis method and device of network service quality |
| CN105786681B (en) * | 2016-02-18 | 2019-03-26 | 中国科学院计算技术研究所 | The server performance of data center is assessed and server updating method |
-
2017
- 2017-11-29 CN CN201711223642.8A patent/CN107992401B/en active Active
-
2018
- 2018-01-22 WO PCT/CN2018/073613 patent/WO2019104854A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102262664A (en) * | 2011-07-26 | 2011-11-30 | 北京百度网讯科技有限公司 | Quality estimating method and quality estimating device |
| CN104077218A (en) * | 2013-03-29 | 2014-10-01 | 百度在线网络技术（北京）有限公司 | Test method and device of MapReduce distributed system |
| CN103279831A (en) * | 2013-06-27 | 2013-09-04 | 李岩 | Method for achieving management system for evaluating software test quality and development capacity |
| CN107330619A (en) * | 2017-06-30 | 2017-11-07 | 国核电力规划设计研究院有限公司 | Determine method, device and the computer-readable recording medium of comprehensive evaluation value |
Cited By (39)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110505109A (en) * | 2018-05-17 | 2019-11-26 | 阿里巴巴集团控股有限公司 | The method, apparatus and storage medium of test macro isolation performance |
| CN108898022A (en) * | 2018-06-22 | 2018-11-27 | 珠海市君天电子科技有限公司 | A kind of method for testing performance, device and electronic equipment |
| CN109408364A (en) * | 2018-08-28 | 2019-03-01 | 深圳壹账通智能科技有限公司 | Method for analyzing performance, device, terminal and the computer storage medium of software product |
| CN110968465A (en) * | 2018-09-30 | 2020-04-07 | 北京奇虎科技有限公司 | Hardware performance test method and device |
| CN109144839A (en) * | 2018-10-09 | 2019-01-04 | 郑州云海信息技术有限公司 | The acquisition methods and device of equipment state |
| CN109327355A (en) * | 2018-10-25 | 2019-02-12 | 平安科技（深圳）有限公司 | Cloud storage system performance evaluation methodology, device and computer readable storage medium |
| CN109408399A (en) * | 2018-12-14 | 2019-03-01 | 武汉斗鱼鱼乐网络科技有限公司 | A kind of calculation power estimation method, device, equipment and storage medium |
| CN109408399B (en) * | 2018-12-14 | 2023-02-14 | 武汉斗鱼鱼乐网络科技有限公司 | Calculation power estimation method, device, equipment and storage medium |
| CN109800138B (en) * | 2018-12-18 | 2022-07-08 | 平安科技（深圳）有限公司 | CPU testing method, electronic device and storage medium |
| CN109800138A (en) * | 2018-12-18 | 2019-05-24 | 平安科技（深圳）有限公司 | A kind of cpu test method, electronic device and storage medium |
| CN110221953A (en) * | 2019-05-20 | 2019-09-10 | 平安普惠企业管理有限公司 | Test result analysis method, apparatus, server and storage medium |
| CN110209577A (en) * | 2019-05-20 | 2019-09-06 | 深圳壹账通智能科技有限公司 | A kind of test method and device |
| CN110262953A (en) * | 2019-06-21 | 2019-09-20 | 中汇信息技术（上海）有限公司 | Method for testing software system performance and computer readable storage medium |
| CN111458617A (en) * | 2020-03-19 | 2020-07-28 | 深圳供电局有限公司 | Semiconductor device reliability detection method, semiconductor device reliability detection device, computer equipment and medium |
| CN111709623A (en) * | 2020-06-04 | 2020-09-25 | 中国科学院计算机网络信息中心 | High-performance computing environment evaluation method and device, electronic equipment and storage medium |
| CN111766613B (en) * | 2020-06-11 | 2024-01-05 | Oppo广东移动通信有限公司 | GPS function test method and device and storage medium thereof |
| CN111766613A (en) * | 2020-06-11 | 2020-10-13 | Oppo广东移动通信有限公司 | GPS function testing method and device and storage medium |
| CN111832921A (en) * | 2020-06-30 | 2020-10-27 | 佛山科学技术学院 | Industrial robot performance index evaluation equipment and method based on machine learning |
| CN111832921B (en) * | 2020-06-30 | 2023-09-26 | 佛山科学技术学院 | Industrial robot performance index evaluation equipment and method based on machine learning |
| CN111813644B (en) * | 2020-07-16 | 2024-02-27 | 中国民航信息网络股份有限公司 | Evaluation method and device for system performance, electronic equipment and computer readable medium |
| CN111813644A (en) * | 2020-07-16 | 2020-10-23 | 中国民航信息网络股份有限公司 | System performance evaluation method and device, electronic equipment and computer readable medium |
| WO2022022717A1 (en) * | 2020-07-31 | 2022-02-03 | 中国移动通信有限公司研究院 | Test method and device |
| CN111913852A (en) * | 2020-08-11 | 2020-11-10 | 中国工商银行股份有限公司 | Health management method and device for storage system |
| CN111913852B (en) * | 2020-08-11 | 2023-08-22 | 中国工商银行股份有限公司 | Health management method and device for storage system |
| CN112039730B (en) * | 2020-08-31 | 2022-06-07 | 海南大学 | Performance evaluation method of encryption algorithm and storage medium |
| CN112039730A (en) * | 2020-08-31 | 2020-12-04 | 海南大学 | Performance evaluation method of encryption algorithm and storage medium |
| CN112109086B (en) * | 2020-09-03 | 2021-08-10 | 清华大学深圳国际研究生院 | Grabbing method for industrial stacked parts, terminal equipment and readable storage medium |
| CN112109086A (en) * | 2020-09-03 | 2020-12-22 | 清华大学深圳国际研究生院 | Grabbing method for industrial stacked parts, terminal equipment and readable storage medium |
| CN114531368A (en) * | 2020-10-31 | 2022-05-24 | 中盈优创资讯科技有限公司 | Network quality evaluation method, device and equipment |
| CN112685295A (en) * | 2020-12-25 | 2021-04-20 | 北京达佳互联信息技术有限公司 | Data analysis method and device, electronic equipment and storage medium |
| CN113553248A (en) * | 2021-08-12 | 2021-10-26 | 上海识装信息科技有限公司 | Application program performance evaluation method and device and storage medium |
| CN113378305A (en) * | 2021-08-12 | 2021-09-10 | 深圳市城市交通规划设计研究中心股份有限公司 | Driverless trolley-based vehicle-road cooperative testing method and device |
| CN114637739A (en) * | 2022-03-22 | 2022-06-17 | 平安国际融资租赁有限公司 | Database management and control method, system, computer equipment and computer storage medium |
| CN114896142A (en) * | 2022-04-25 | 2022-08-12 | 矩阵时光数字科技有限公司 | Performance index optimization method based on JMeter |
| CN114896142B (en) * | 2022-04-25 | 2024-05-07 | 矩阵时光数字科技有限公司 | JMeter-based performance index optimization method |
| CN117331846A (en) * | 2023-11-30 | 2024-01-02 | 河北雄安尚世嘉科技有限公司 | Internet-based software development, operation, test and management system |
| CN117331846B (en) * | 2023-11-30 | 2024-03-08 | 河北雄安尚世嘉科技有限公司 | Internet-based software development, operation, test and management system |
| CN117572853A (en) * | 2024-01-17 | 2024-02-20 | 中国人民解放军陆军装甲兵学院 | Magnetic field controller performance test analysis management system |
| CN117572853B (en) * | 2024-01-17 | 2024-03-15 | 中国人民解放军陆军装甲兵学院 | Magnetic field controller performance test analysis management system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107992401B (en) | 2020-08-14 |
| WO2019104854A1 (en) | 2019-06-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107992401A (en) | Performance test evaluation method, device, terminal device and storage medium | |
| CN108683530B (en) | Data analysis method and device for multi-dimensional data and storage medium | |
| WO2021208079A1 (en) | Method and apparatus for obtaining power battery life data, computer device, and medium | |
| CN108334408B (en) | Code execution method and device, terminal equipment and computer readable storage medium | |
| CN106201856A (en) | A kind of multi version performance test methods and device | |
| CN105843731B (en) | Computer system and the method for monitoring performance executed by computer system | |
| CN107346267A (en) | A kind of cpu performance optimization method and device based on NUMA architecture | |
| CN109491754A (en) | The performance test methods and device of virtual server | |
| CN109066650B (en) | Power system vulnerability assessment method and terminal equipment | |
| CN112365361A (en) | Power metering data quality physical examination method based on rule base | |
| CN109857631A (en) | Code coverage statistical method, device, equipment and storage medium based on artificial intelligence | |
| CN109117352A (en) | Server performance prediction technique and device | |
| CN109858632A (en) | A kind of method and device of threshold value | |
| CN116245422A (en) | External data quality evaluation method and device and electronic equipment | |
| CN113376564B (en) | Smart electric meter metering correction method and device based on data analysis and terminal | |
| CN113159537B (en) | Assessment method and device for new technical project of power grid and computer equipment | |
| CN112559347B (en) | Test distribution method and apparatus, device, readable medium and computer program product | |
| CN114971053A (en) | Training method and device for online prediction model of network line loss rate of low-voltage transformer area | |
| CN115372752A (en) | Fault detection method, device, electronic equipment and storage medium | |
| CN113393099A (en) | Power distribution network project group value index evaluation method and device and terminal equipment | |
| CN113516275A (en) | Power distribution network ultra-short term load prediction method and device and terminal equipment | |
| CN108073502B (en) | Test method and system thereof | |
| CN108985637A (en) | Study of Project Evaluation, device and computer readable storage medium | |
| CN115290798B (en) | Stability performance monitoring method and terminal of transformer oil chromatographic online monitoring device | |
| CN114239364B (en) | Cable-stayed bridge damage identification method and device based on improved wavelet packet energy curvature |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |