CN109388535A - A kind of storing performance testing method, device and application server - Google Patents
A kind of storing performance testing method, device and application server Download PDFInfo
- Publication number
- CN109388535A CN109388535A CN201811172484.2A CN201811172484A CN109388535A CN 109388535 A CN109388535 A CN 109388535A CN 201811172484 A CN201811172484 A CN 201811172484A CN 109388535 A CN109388535 A CN 109388535A
- Authority
- CN
- China
- Prior art keywords
- tested
- software package
- performance
- performance test
- version
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 103
- 238000011056 performance test Methods 0.000 claims abstract description 137
- 238000000034 method Methods 0.000 claims abstract description 51
- 238000004590 computer program Methods 0.000 claims description 11
- 238000009434 installation Methods 0.000 claims description 11
- 238000007619 statistical method Methods 0.000 claims description 10
- 238000013507 mapping Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 description 35
- 230000006870 function Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000003252 repetitive effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/26—Functional testing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/368—Test management for test version control, e.g. updating test cases to a new software version
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Abstract
The invention discloses a kind of storing performance testing method, device, application server and computer readable storage mediums, this method comprises: parsing test profile, obtains software package version information to be tested and pending performance test task；The corresponding software package to be tested of each version is downloaded according to software package version information to be tested；By each software package deployment to be tested to storage server；Utility testing tool executes pending performance test task to each software package to be tested, obtains the corresponding the performance test results of each software package to be tested；This method is by calling script to realize the automatic deployment of each software package to be tested and the automatic execution of pending performance test task automatically, therefore can automatic test store product different editions performance, performance test accuracy is enhanced, while reducing workload, is improved efficiency；Further, it can also realize automatic output performance comparing result, be compared automatically with the performance test results to different editions.
Description
Technical field
The present invention relates to storage equipment technical field, in particular to a kind of storing performance testing methods, device, application service
Device and computer readable storage medium.
Background technique
At present in project management process, performance test is very important a ring.With version evolution, need to verify more
The performance test results of a version.And the performance test results by multiple versions is needed to compare, it is produced to identify in time
The fluctuation of moral character energy.It is subsequent performance optimization to be proposed according to the fluctuation in time.
Since to be related to surrounding hardware more for it for storage product, test environmental turbulence is frequent, leads to different surveys
It test ring border cannot using the results of property that the result of unified test scene verifying does not have comparability and current version test
The problems such as being compared with the performance test results of previous version.Therefore, it is necessary to use same test environment verifying different editions
Performance, realize storage product different editions between performance and result difference comparison statistics.However use same test environment
Repetitive operation is more during verifying the performance of different editions, and secondly the performance test results comparison of multiple versions is also more numerous
It is trivial.
Summary of the invention
The object of the present invention is to provide method, apparatus, terminal and the computer-readable storage mediums of a kind of test of storage performance
Matter, can automatic test store product different editions performance, enhance performance test accuracy, while reducing workload, mention
High efficiency.
In order to solve the above technical problems, the present invention provides a kind of storing performance testing method, comprising:
Test profile is parsed, software package version information to be tested and pending performance test task are obtained；
The corresponding software package to be tested of each version is downloaded according to the software package version information to be tested；
By each software package deployment to be tested to storage server；
Utility testing tool executes the pending performance test task to each software package to be tested, obtains each
The corresponding the performance test results of the software package to be tested.
Optionally, by any software package deployment to be tested to storage server, comprising:
Obtain the md5 value of the software package to be tested；
Judge whether the md5 value of the software package to be tested is consistent with the md5 value of corresponding software package on archiving server；
If consistent, the software package to be tested is installed in storage server；
If inconsistent, corresponding software package to be tested is re-downloaded.
Optionally, it is described the software package to be tested is installed in storage server after, further includes:
Judge whether the software package to be tested installs success；
If it is not, will then repeat installation number adds 1, and judge whether the repetition installation number is more than threshold value；If being more than institute
Threshold value is stated, then install failure；If being less than the threshold value, execution is described to install the software to be tested in storage server
The step of packet.
Optionally, utility testing tool executes the pending performance test task to the software package to be tested,
Include:
The LUN needed is determined using the pending performance test task；
Divide the LUN in the storage server, and by the LUN mapping to corresponding application server；
Configuration paramfile file simultaneously sets Multi-client Mode for operational mode；
It executes vdbench performance test and saves vdbench test result to respective file；Wherein, the name of the file
The version number of the referred to as described software package to be tested.
Optionally, after obtaining the corresponding the performance test results of each software package to be tested, further includes:
It is for statistical analysis to the corresponding the performance test results of each software package to be tested, export each version performance difference
Data.
Optionally, for statistical analysis to the corresponding the performance test results of each software package to be tested, export each version
Performance difference data, comprising:
Summarize the corresponding the performance test results of each software package to be tested；
Each property in the performance test results of different editions is compared item by item using test scene defined in paramfile file
The undulating value of energy index, and summarize to obtain each version performance difference file；
Export each version performance difference file.
The present invention also provides a kind of storage performance test devices, comprising:
Parsing module obtains software package version information to be tested and pending performance for parsing test profile
Test assignment；
Download module, for downloading the corresponding software to be tested of each version according to the software package version information to be tested
Packet；
Deployment module is used for each software package deployment to be tested to storage server；
Performance test module executes the pending property to each software package to be tested for utility testing tool
Can test assignment, obtain the corresponding the performance test results of each software package to be tested.
Optionally, the storage performance test device further include:
Performance comparison module, for for statistical analysis to the corresponding the performance test results of each software package to be tested,
Export each version performance difference data.
The present invention also provides a kind of application servers, comprising:
Memory, for storing computer program；
Processor, the step of storing performance testing method described above is realized when for executing the computer program.
The present invention also provides a kind of computer readable storage medium, calculating is stored on the computer readable storage medium
The step of machine program, the computer program realizes storing performance testing method described above when being executed by processor.
A kind of storing performance testing method provided by the present invention, comprising: parsing test profile obtains to be tested soft
Part packet version information and pending performance test task；According to software package version information to be tested download each version it is corresponding to
Test software packet；By each software package deployment to be tested to storage server；Utility testing tool is to each software package to be tested
Pending performance test task is executed, the corresponding the performance test results of each software package to be tested are obtained.
As it can be seen that this method by script realize automatically each software package to be tested automatic deployment and pending performance test
The automatic execution of task, thus can automatic test store product different editions performance, reduction manually repeat each
The process of the performance test of version improves the efficiency of same test environment verifying different editions performance；Further, it can also realize
Automatic output performance comparing result, is compared automatically with the performance test results to different editions.The present invention also provides one
Kind storage performance test device, application server and computer readable storage medium, have above-mentioned beneficial effect, no longer superfluous herein
It states.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of invention for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is the flow chart of storing performance testing method provided by the embodiment of the present invention；
Fig. 2 is the structural block diagram of storage performance test device provided by the embodiment of the present invention；
Fig. 3 is the structural block diagram of another storage performance test device provided by the embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
In the prior art using the process of same test environment verifying different editions performance, need related technical personnel manual
The software package of current version is disposed, and executes corresponding performance test task after configuration is complete, it is complete in its performance test task
The software package of the next version of Cheng Houzai manually dispose simultaneously executes corresponding performance test task as procedure described above；It repeats
Above-mentioned whole process is performed both by completion until all versions.It can be seen that being verified in the prior art using same test environment different
Repetitive operation is more during the performance of version, and testing efficiency is low, and artificial participation can excessively reduce performance test process
Reliability.In the present embodiment can automatic test store product different editions performance, enhance performance test accuracy, together
When reduce workload, improve efficiency.The present embodiment is not defined executing subject, such as can be application server.Tool
Body is referring to FIG. 1, Fig. 1 is the flow chart of storing performance testing method provided by the embodiment of the present invention；This method may include:
S101: parsing test profile obtains software package version information to be tested and pending performance test task.
By calling script to execute each step in the present embodiment automatically in the present embodiment.The present embodiment is not to the script
Particular content be defined, can be a script and realize function whole in the present embodiment, naturally it is also possible to be according to function
Energy module divides script, such as the corresponding script of a functional module in step S101 (as specifically, by parsing
A parsing script is arranged in journey, and the parsing script is called to realize that resolving obtains software package version letter to be tested in step S101
Breath and pending performance test task；A Download Script is arranged in downloading process in step S102, calls the Download Script
It realizes in step S102 and downloads the corresponding software package to be tested of each version；It can be the corresponding script of each step)；Certainly
Be also possible to be configured according to big functional module, using whole process is divided into the process for disposing each version software packet and
The process of performance test is (as specifically, setting software deployment script obtains software package to be tested for parsing test profile
Version information and pending performance test task and according to software package version information to be tested download each version it is corresponding to
Test software packet and by each software package deployment to be tested to storage server；Performance test script is arranged to test for utility
Tool executes pending performance test task to each software package to be tested, obtains the corresponding performance test knot of each software package to be tested
Fruit).The either form of which kind of setting script, can realize the whole process of automated execution storage performance test, herein
It is not necessarily to technical staff's manual intervention in the process, i.e. realization automatic test stores product different editions performance, enhances performance survey
Accuracy is tried, while reducing workload, is improved efficiency.Automatic execution script is not limited in the present embodiment writes mode,
Such as it is write by Python (parsing scripting language).Storage product different software versions are installed using Python script automatically
(each software package to be tested is installed automatically).
The particular content in test profile is not limited in the present embodiment, at least needs to include software package version to be tested
This information and pending performance test task.Corresponding software to be tested is downloaded by software package version information to be tested
Packet.Required performance test is determined by pending performance test task.The present embodiment does not limit software package version to be tested
The data mode of information and pending performance test task, such as software package version information to be tested and pending performance are surveyed
Trial business can store in the form of a list.By calling script realization to automatically parse test profile, obtain to be tested
The process of software package version information and pending performance test task.
S102: the corresponding software package to be tested of each version is downloaded according to software package version information to be tested.
In the present embodiment by script execute automatically according to software package version information to be tested download each version it is corresponding to
The process of test software packet.But the present embodiment is not defined the specific order of downloading.Such as it can be according to be measured
Examination software package version information successively downloads corresponding software package to be tested.It is also possible to same according to software package version information to be tested
When download corresponding software package to be tested.The present embodiment is also unlimited to fix the mode for carrying the corresponding software package to be tested of each version,
It can be correspondingly arranged according to specific software package version information storage form to be tested.Such as when software package version to be tested
It is subsequent to be downloaded by traversing the software package version list to be tested respectively when this information is software package version list to be tested
The corresponding software package to be tested of version.
Certain the present embodiment is not also limited to the decision condition downloaded every time in ergodic process.Such as it can be current version
Software package to be tested downloading after the completion of the software to be tested of next version is just downloaded according to software package version list to be tested
Packet.After being also possible to the software package to be tested downloading completion of current version and having executed corresponding pending performance test task,
The software package to be tested of next version is downloaded according to software package version list to be tested.
S103: by each software package deployment to be tested to storage server.
It is executed automatically by script by the process of each software package deployment to be tested to storage server in the present embodiment.This reality
It applies example not to be defined the detailed process of deployment, as long as may be implemented successfully to install in storage server corresponding to be tested soft
Part.Since the software to be tested disposed in storage server is only the difference of version, each version it is to be measured
Trying software deployment process can be identical.The present embodiment provides a kind of specific deployment processes that is, preferably will be any to be tested soft
Part packet is deployed to storage server, may include:
Obtain the md5 value of software package to be tested；Wherein, the present embodiment can't limit the md5 for obtaining software package to be tested
The concrete mode of value.
Judge whether the md5 value of software package to be tested is consistent with the md5 value of corresponding software package on archiving server；
If consistent, software package to be tested is installed in storage server；
If inconsistent, corresponding software package to be tested is re-downloaded.
Specifically, in the present embodiment when installing software package to be tested, need to verify by md5 value first downloading to
Whether test software packet is correct, only after obtaining correct software package to be tested, can be just deployed in storage server.
When obtaining the software package to be tested of mistake, corresponding software package to be tested can be re-downloaded.Certainly it is downloaded if it exists less than just
When true software package to be tested, user can be prompted to download error, and (the present embodiment does not limit the concrete form of prompt, Yi Jiti
Show the particular content of information), allow user to recognize the detailed process of performance test in time.Certainly preferred, it is automatic to jump
The downloading for going to the software package to be tested of next version, can make whole process can automated execution complete, it is intermediate not
No manual intervention can be further realized due to causing storage performance test process cannot achieve there are some endless loop
Storage performance test, improve performance test efficiency.
Further, in order to improve the reliability for installing software package to be tested in storage server.Preferably, in storage service
Software package to be tested is installed in device can also include: later
Judge whether software package to be tested installs success；
If it is not, will then repeat installation number adds 1, and judge to repeat to install whether number is more than threshold value；If being more than threshold value,
Install failure；If being less than threshold value, the step of software package to be tested is installed in storage server is executed.
Determine whether software package to be tested installs successful mode specifically, not limiting in the present embodiment, such as can be with
Be by the version number that verifies the storage software of the corresponding installation of software package to be tested whether correctly come determine the version number to
Whether test software packet installs success.Subsequent step can be continued to execute if installing successfully, continue step after execution certainly
Can also export in the process the version software deployment success prompt information (the present embodiment does not limit the concrete form of prompt,
And the particular content of prompt information).User is allowed to recognize the detailed process of performance test in time.If not being mounted to
Function is then installed as procedure described above again.
Certainly in this process in order to avoid due to install always it is unsuccessful caused by repeat installation endless loop, this reality
The i.e. above-mentioned threshold value of number that can at most repeat installation in example by being arranged is applied, to prevent the endless loop of repetition installation.This
The specific value of the threshold value is not defined in embodiment, such as can be 3.Further, the present embodiment does not limit weight yet
The specific counting mode of number is installed again, such as can be realized by counter.Not manual intervention can be further realized
Storage performance test, improves performance test efficiency.Certainly (being more than to repeat installation number more than threshold value) can in install failure
To export the prompt information that version software deployment fails, (the present embodiment does not limit the concrete form of prompt, and prompt letter
The particular content of breath).User is allowed to recognize the detailed process of performance test in time.It says for a specific example below
A bright specific implementation process by each software package deployment to be tested to storage server:
(1) corresponding software package to be tested is downloaded from archiving server according to the version number of software package to be tested, and is uploaded
To storage server；
(2) the md5 value for verifying software package to be tested, if inconsistent with the md5 of software package corresponding on archiving server,
Reacquire the software package to be tested；
(3) it logs in storage server (Telnet storage server), executes order and carry out software deployment；
(4) whether correct the corresponding storage software version number of software package to be tested is verified；
(5) if it is correct, return to deployment success；
(6) if incorrect, software deployment failure repeats (3) step, retries 3 times and all fail, and returns to deployment failure.
S104, utility testing tool execute pending performance test task to each software package to be tested, obtain respectively to
The corresponding the performance test results of test software packet.
Each software package to be tested is executed specifically, executing utility testing tool automatically by script in the present embodiment
Pending performance test task obtains the process of the corresponding the performance test results of each software package to be tested.The present embodiment is not right
The performance testing tool of deployment is defined, as long as storage performance test assignment may be implemented.Such as pass through vdbench
(a kind of disk performance testing tool) realizes storage performance test assignment.Corresponding the present embodiment does not limit utility test
Tool executes the detailed process of pending performance test task to each software package to be tested, according to selected specific performance
Testing tool is accordingly arranged.Further, qualified call performance testing tool does not execute pending performance survey to the present embodiment
The opportunity of trial business.Such as it can be that execute its at once after the corresponding software package to be tested of a version is installed successfully corresponding
Pending performance test task.It is circuited sequentially according to software package version information to be tested according to version number and executes storage performance survey
Examination process (disposes software package to be tested and executes pending performance test task).That is a version number is corresponding
It is complete that the corresponding software package to be tested of next version number is executed again after software package completion deployment to be tested and performance test task
At deployment and performance test task.
When using vdbench as when performance testing tool, utility testing tool is to be tested soft in the present embodiment
Part packet executes pending performance test task
The LUN needed is determined using pending performance test task；
Divide LUN in storage server, and by LUN mapping to corresponding application server；
Configuration paramfile file simultaneously sets Multi-client Mode for operational mode；
It executes vdbench performance test and saves vdbench test result to respective file；Wherein, file is entitled
The version number of software package to be tested.
Wherein, the prompt that the version software storage performance is successfully tested can be exported when obtaining vdbench test result
Information (the present embodiment does not limit the concrete form of prompt and the particular content of prompt information).
Detailed process may is that (1) according to the pending performance test task in test profile, and parsing needs to prepare
LUN, log in storage server and divide LUN, and be mapped to more application servers；(2) vdbench tool is deployed to more and answers
With server, paramfile file is configured, operational mode is multi-client mode；(3) vdbench performance test is executed；(4)
Vdbench test result is saved to file, filename corresponding software version number.
Certainly in this process in order to avoid caused by due to being unable to the pending performance test task of successful execution always
The endless loop of pending performance test task is repeated, it can be by the way that the number at most repeated be arranged i.e. in the present embodiment
Threshold value is executed, to prevent the endless loop for repeating pending performance test task.Not to the execution in the present embodiment
The specific value of threshold value is defined, such as can be 3.Further, the present embodiment does not limit yet and repeats the specific of number
Counting mode, such as can be realized by counter.The storage performance test that not manual intervention can be further realized, is improved
Performance test efficiency.Certainly (being more than to repeat number more than execution threshold value) it is soft can to export the version when executing failure
(the present embodiment does not limit in the concrete form of prompt and the specific of prompt information the prompt information of part performance test failure
Hold).User is allowed to recognize the detailed process of performance test in time.Specifically, cannot when executing vdbench performance test
When obtaining vdbench test result, number will be repeated and add 1, and judge to repeat whether number is more than execution threshold value；If
More than threshold value is executed, then performance test fails；If being less than execution threshold value, repeats configuration paramfile file and incite somebody to action
Operational mode is set as Multi-client Mode；It executes vdbench performance test and saves vdbench test result to respective file
The step of.
Based on the above-mentioned technical proposal, storing performance testing method provided in an embodiment of the present invention is realized automatically by script
The automatic execution of the automatic deployment of each software package to be tested and pending performance test task, thus can automatic test deposit
Product different editions performance is stored up, the process for manually repeating the performance test of each version is reduced, improves same test wrapper
The efficiency of border verifying different editions performance.
Based on the above embodiment, in order to the basis of automatic test storage product different editions performance in the present embodiment
On, realize automatic output performance comparing result, so as to solve the test of current version in the prior art results of property cannot with it is preceding
The problem of the performance test results of one version compare.Preferably, the corresponding performance test knot of each software package to be tested is obtained
Can also include: after fruit
It is for statistical analysis to the corresponding the performance test results of each software package to be tested, export each version performance difference number
According to.
Specifically, the present embodiment provides script realize automatically by the corresponding the performance test results of each software package to be tested into
Row Macro or mass analysis, obtains whether the corresponding test result of each version of each test performance in pending performance test task deposits
It is exported in difference, and by each version performance difference data, so that user can quickly understand each version according to the output data
Between performance difference.
Not to the specific output shape of the concrete mode of statistical analysis and each version performance difference data in the present embodiment
Formula and output particular content are defined, and user can (such as emphasis marks out the survey to differ greatly with customized output form
Examination subitem).The condition of variance data output, such as the corresponding each difference in version data of a certain item test assignment even can be set
Can be exported as variance data when greater than some difference degree (such as the performance test for I/O size, only exist not
With version I/O numerical value difference be greater than I/O threshold value when, just can be defeated as variance data using the I/O numerical value of corresponding each version
Out, the difference degree being specifically calculated can also be exported certainly).It can certainly be simply by the presence of different editions for same
The corresponding test result of a test assignment is not identical, it can exports as variance data.
Specifically, when using vdbench as when performance testing tool, performance test corresponding to each software package to be tested
As a result for statistical analysis, exporting each version performance difference data can specifically include:
Summarize the corresponding the performance test results of each software package to be tested；
Each property in the performance test results of different editions is compared item by item using test scene defined in paramfile file
The undulating value of energy index, and summarize to obtain each version performance difference file；
Export each version performance difference file.
Detailed process may is that each version test result for summarizing and parsing vdbench generation；According to paramfile text
Test scene defined in part compares the difference between different editions item by item.Calculated performance undulating value (such as I/O size, bandwidth),
Export each version performance difference file.Vdbench tool is called to be tested for the property, output performance comparing result.
Based on the above-mentioned technical proposal, storing performance testing method provided in an embodiment of the present invention, this method read survey first
Configuration file is tried, the software package version information to be tested for needing to dispose and pending performance test task are obtained.It loops through
Software package version information to be tested, the deployment of corresponding software is carried out to storage server, and is executed after deployment success pending
Performance test task statisticallys analyze results of property after all versions have been performed both by pending performance test task, and output is each
Version performance difference.Therefore the present invention stores product different software versions by automatically dispose, and executes storage performance automatically
Each version results of property difference of test comparison (i.e. full process automatization execution)；And then improve storage properties of product contrast test
Efficiency reduces repeated work, improves storage software different editions performance comparison confidence level, improves product efficiency for research and development of products and mentions
For objective believable data source.
Below to storage performance test device, application server and computer-readable storage medium provided in an embodiment of the present invention
Matter is introduced, storage performance test device, application server and computer readable storage medium described below with retouch above
The storing performance testing method stated can correspond to each other reference.
Referring to FIG. 2, Fig. 2 is the structural block diagram of storage performance test device provided by the embodiment of the present invention；The device
May include:
Parsing module 100 obtains software package version information to be tested and pending property for parsing test profile
It can test assignment；
Download module 200, for downloading the corresponding software package to be tested of each version according to software package version information to be tested；
Deployment module 300 is used for each software package deployment to be tested to storage server；
Performance test module 400 executes pending performance to each software package to be tested for utility testing tool and surveys
Trial business, obtains the corresponding the performance test results of each software package to be tested.
Based on the above embodiment, deployment module 300 is specifically used for obtaining the md5 value of software package to be tested；Judge to be tested
Whether the md5 value of software package is consistent with the md5 value of corresponding software package on archiving server；If consistent, in storage server
Software package to be tested is installed；If inconsistent, corresponding software package to be tested is re-downloaded.
Based on the above embodiment, deployment module 300 is also used to sentence after installing software package to be tested in storage server
Whether the software package to be tested that breaks installs success；If it is not, will then repeat installation number adds 1, and judge to repeat to install whether number surpasses
Cross threshold value；If being more than threshold value, install failure；If being less than threshold value, software to be tested is installed in execution in storage server
The step of packet.
Based on above-mentioned any embodiment, performance test module 400 is specifically used for determining using pending performance test task
The LUN needed；Divide LUN in storage server, and by LUN mapping to corresponding application server；Configure paramfile text
Part simultaneously sets Multi-client Mode for operational mode；Execute vdbench performance test and save vdbench test result to pair
Answer file；Wherein, the version number of the entitled software package to be tested of file.
Based on above-mentioned any embodiment, referring to FIG. 3, the device can also include:
Performance comparison module 500, it is defeated for for statistical analysis to the corresponding the performance test results of each software package to be tested
Each version performance difference data out.
Based on the above embodiment, performance comparison module 500 is specifically used for summarizing the corresponding performance survey of each software package to be tested
Test result；Each property in the performance test results of different editions is compared item by item using test scene defined in paramfile file
The undulating value of energy index, and summarize to obtain each version performance difference file；Export each version performance difference file.
It should be noted that being based on above-mentioned any embodiment, described device can be to be realized based on programmable logic device
, programmable logic device includes FPGA, CPLD, single-chip microcontroller etc..These programmable logic device can be set in for servicing
In device.
The embodiment of the present invention also provides a kind of application server, comprising: memory, for storing computer program；Processing
Device, the step of storing performance testing method described in above-mentioned any embodiment is realized when for executing computer program.Such as processing
Device obtains software package version information to be tested and pending for realizing parsing test profile when executing computer program
Performance test task；The corresponding software package to be tested of each version is downloaded according to software package version information to be tested；It will be each to be tested
Software package deployment is to storage server；Utility testing tool executes pending performance test to each software package to be tested and appoints
Business, obtains the corresponding the performance test results of each software package to be tested.
The present invention also provides a kind of computer readable storage medium, computer journey is stored on computer readable storage medium
Sequence, the step of storing performance testing method described in above-mentioned any embodiment is realized when computer program is executed by processor.Such as
Parsing test profile is realized when computer program is executed by processor, and obtains software package version information to be tested and wait hold
Row performance test task；The corresponding software package to be tested of each version is downloaded according to software package version information to be tested；It will be each to be measured
Software package deployment is tried to storage server；Utility testing tool executes pending performance test to each software package to be tested and appoints
Business, obtains the corresponding the performance test results of each software package to be tested.
The computer readable storage medium may include: USB flash disk, mobile hard disk, read-only memory (Read-Only
Memory, ROM), random access memory (Random Access Memory, RAM), magnetic or disk etc. is various to deposit
Store up the medium of program code.
Each embodiment is described in a progressive manner in specification, the highlights of each of the examples are with other realities
The difference of example is applied, the same or similar parts in each embodiment may refer to each other.For device disclosed in embodiment
Speech, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, related place is referring to method part illustration
?.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure
And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and
The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These
Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond the scope of this invention.
The step of method described in conjunction with the examples disclosed in this document or algorithm, can directly be held with hardware, processor
The combination of capable software module or the two is implemented.Software module can be placed in random access memory (RAM), memory, read-only deposit
Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology
In any other form of storage medium well known in field.
Above to a kind of storing performance testing method provided by the present invention, device, application server and computer-readable
Storage medium is described in detail.Specific case used herein explains the principle of the present invention and embodiment
It states, the above description of the embodiment is only used to help understand the method for the present invention and its core ideas.It should be pointed out that for this skill
For the those of ordinary skill in art field, without departing from the principle of the present invention, several change can also be carried out to the present invention
Into and modification, these improvements and modifications also fall within the scope of protection of the claims of the present invention.
Claims (10)
1. a kind of storing performance testing method characterized by comprising
Test profile is parsed, software package version information to be tested and pending performance test task are obtained；
The corresponding software package to be tested of each version is downloaded according to the software package version information to be tested；
By each software package deployment to be tested to storage server；
Utility testing tool executes the pending performance test task to each software package to be tested, obtains each described
The corresponding the performance test results of software package to be tested.
2. storing performance testing method according to claim 1, which is characterized in that by any software package portion to be tested
It affixes one's name to storage server, comprising:
Obtain the md5 value of the software package to be tested；
Judge whether the md5 value of the software package to be tested is consistent with the md5 value of corresponding software package on archiving server；
If consistent, the software package to be tested is installed in storage server；
If inconsistent, corresponding software package to be tested is re-downloaded.
3. storing performance testing method according to claim 2, which is characterized in that described to install institute in storage server
After stating software package to be tested, further includes:
Judge whether the software package to be tested installs success；
If it is not, will then repeat installation number adds 1, and judge whether the repetition installation number is more than threshold value；If being more than the threshold
It is worth, then install failure；If being less than the threshold value, execution is described to install the software package to be tested in storage server
Step.
4. storing performance testing method according to claim 1, which is characterized in that utility testing tool to it is described to
Test software packet executes the pending performance test task, comprising:
The LUN needed is determined using the pending performance test task；
Divide the LUN in the storage server, and by the LUN mapping to corresponding application server；
Configuration paramfile file simultaneously sets Multi-client Mode for operational mode；
It executes vdbench performance test and saves vdbench test result to respective file；Wherein, the file is entitled
The version number of the software package to be tested.
5. storing performance testing method according to claim 1-4, which is characterized in that obtain each described to be tested
After the corresponding the performance test results of software package, further includes:
It is for statistical analysis to the corresponding the performance test results of each software package to be tested, export each version performance difference number
According to.
6. storing performance testing method according to claim 5, which is characterized in that corresponding to each software package to be tested
The performance test results it is for statistical analysis, export each version performance difference data, comprising:
Summarize the corresponding the performance test results of each software package to be tested；
Each performance in the performance test results of different editions is compared item by item using test scene defined in paramfile file to refer to
Target undulating value, and summarize to obtain each version performance difference file；
Export each version performance difference file.
7. a kind of storage performance test device characterized by comprising
Parsing module obtains software package version information to be tested and pending performance test for parsing test profile
Task；
Download module, for downloading the corresponding software package to be tested of each version according to the software package version information to be tested；
Deployment module is used for each software package deployment to be tested to storage server；
Performance test module executes the pending performance to each software package to be tested for utility testing tool and surveys
Trial business obtains the corresponding the performance test results of each software package to be tested.
8. storage performance test device according to claim 7, which is characterized in that further include:
Performance comparison module, for for statistical analysis, the output to the corresponding the performance test results of each software package to be tested
Each version performance difference data.
9. a kind of application server characterized by comprising
Memory, for storing computer program；
Processor realizes that storage performance as claimed in any one of claims 1 to 6 such as is tested when for executing the computer program
The step of method.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium
Program realizes such as storage performance test side as claimed in any one of claims 1 to 6 when the computer program is executed by processor
The step of method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811172484.2A CN109388535A (en) | 2018-10-09 | 2018-10-09 | A kind of storing performance testing method, device and application server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811172484.2A CN109388535A (en) | 2018-10-09 | 2018-10-09 | A kind of storing performance testing method, device and application server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109388535A true CN109388535A (en) | 2019-02-26 |
Family
ID=65426761
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811172484.2A Withdrawn CN109388535A (en) | 2018-10-09 | 2018-10-09 | A kind of storing performance testing method, device and application server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109388535A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110134574A (en) * | 2019-04-19 | 2019-08-16 | 平安普惠企业管理有限公司 | A kind of software performance testing method, system, medium and electronic equipment |
| CN110659167A (en) * | 2019-09-12 | 2020-01-07 | 苏州浪潮智能科技有限公司 | Server hardware testing method, equipment and storage medium |
| CN110765006A (en) * | 2019-10-08 | 2020-02-07 | 贝壳技术有限公司 | Flow testing method and device, computer readable storage medium and electronic device |
| CN110837455A (en) * | 2019-11-07 | 2020-02-25 | 北京宝兰德软件股份有限公司 | Script-based application configuration information acquisition method and device |
| CN111026656A (en) * | 2019-11-29 | 2020-04-17 | 浪潮商用机器有限公司 | Automatic testing system, method, equipment and storage medium for distributed storage |
| CN111797018A (en) * | 2020-07-01 | 2020-10-20 | 卡斯柯信号(北京)有限公司 | STP test environment deployment method and device |
| CN112035365A (en) * | 2020-09-01 | 2020-12-04 | 中国银行股份有限公司 | Version deployment method and device supporting multiple test environments |
| CN112164414A (en) * | 2020-09-25 | 2021-01-01 | 北京浪潮数据技术有限公司 | Method and assembly for testing stability of storage device |
| CN112256579A (en) * | 2020-10-23 | 2021-01-22 | 展讯通信（上海）有限公司 | Automatic integrated test method, device, system, equipment and medium |
| CN112346975A (en) * | 2020-11-09 | 2021-02-09 | 广州小鹏自动驾驶科技有限公司 | Automobile software evaluation device |
| CN112468355A (en) * | 2019-09-09 | 2021-03-09 | 北京奇虎科技有限公司 | IOT equipment management application testing method and device, electronic equipment and storage medium |
-
2018
- 2018-10-09 CN CN201811172484.2A patent/CN109388535A/en not_active Withdrawn
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110134574A (en) * | 2019-04-19 | 2019-08-16 | 平安普惠企业管理有限公司 | A kind of software performance testing method, system, medium and electronic equipment |
| CN112468355A (en) * | 2019-09-09 | 2021-03-09 | 北京奇虎科技有限公司 | IOT equipment management application testing method and device, electronic equipment and storage medium |
| CN112468355B (en) * | 2019-09-09 | 2024-01-19 | 北京奇虎科技有限公司 | IOT equipment management application testing method and device, electronic equipment and storage medium |
| CN110659167A (en) * | 2019-09-12 | 2020-01-07 | 苏州浪潮智能科技有限公司 | Server hardware testing method, equipment and storage medium |
| CN110765006A (en) * | 2019-10-08 | 2020-02-07 | 贝壳技术有限公司 | Flow testing method and device, computer readable storage medium and electronic device |
| CN110837455A (en) * | 2019-11-07 | 2020-02-25 | 北京宝兰德软件股份有限公司 | Script-based application configuration information acquisition method and device |
| CN110837455B (en) * | 2019-11-07 | 2023-04-14 | 北京宝兰德软件股份有限公司 | Script-based application configuration information acquisition method and device |
| CN111026656A (en) * | 2019-11-29 | 2020-04-17 | 浪潮商用机器有限公司 | Automatic testing system, method, equipment and storage medium for distributed storage |
| CN111797018A (en) * | 2020-07-01 | 2020-10-20 | 卡斯柯信号(北京)有限公司 | STP test environment deployment method and device |
| CN112035365A (en) * | 2020-09-01 | 2020-12-04 | 中国银行股份有限公司 | Version deployment method and device supporting multiple test environments |
| CN112035365B (en) * | 2020-09-01 | 2023-08-18 | 中国银行股份有限公司 | Version deployment method and device supporting multiple test environments |
| CN112164414B (en) * | 2020-09-25 | 2023-12-22 | 北京浪潮数据技术有限公司 | Method and assembly for testing stability of storage device |
| CN112164414A (en) * | 2020-09-25 | 2021-01-01 | 北京浪潮数据技术有限公司 | Method and assembly for testing stability of storage device |
| CN112256579A (en) * | 2020-10-23 | 2021-01-22 | 展讯通信（上海）有限公司 | Automatic integrated test method, device, system, equipment and medium |
| CN112346975A (en) * | 2020-11-09 | 2021-02-09 | 广州小鹏自动驾驶科技有限公司 | Automobile software evaluation device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109388535A (en) | A kind of storing performance testing method, device and application server | |
| US10872034B2 (en) | Method, device and computer program product for executing test cases | |
| US11720334B2 (en) | Inductive equivalence in machine-based instruction editing | |
| CN111124919A (en) | User interface testing method, device, equipment and storage medium | |
| CN106940695B (en) | Data source information verification method and device | |
| EP3975482A1 (en) | Quantitative network testing framework for 5g and subsequent generation networks | |
| US20200167159A1 (en) | Processor testing | |
| CN105094783A (en) | Method and device for testing Android application stability | |
| CN107329889B (en) | Method for automatically testing C compiler | |
| CN111679982A (en) | Automatic testing method for REST API (representational State transfer) interface software | |
| CN108446224B (en) | Performance analysis method of application program on mobile terminal and storage medium | |
| CN111400171B (en) | Interface testing method, system and device and readable storage medium | |
| CN107590064A (en) | A kind of application upgrade method of testing, device and system | |
| CN113721948A (en) | Database upgrading method, system and storage medium | |
| CN112084108A (en) | Test script generation method and device and related components | |
| CN101267645B (en) | Automatic test method and system for service flow software development of W base station | |
| CN115034165A (en) | Chip simulation verification method, system, equipment and storage medium | |
| CN113849484A (en) | Big data component upgrading method and device, electronic equipment and storage medium | |
| CN110674024A (en) | Electronic equipment integration test system and method thereof | |
| CN113986263A (en) | Code automation test method, device, electronic equipment and storage medium | |
| CN113377413A (en) | Software batch adaptation method based on kylin desktop operating system | |
| CN109800170B (en) | Test method, test equipment and readable storage medium based on API test platform | |
| CN112346994A (en) | Test information correlation method and device, computer equipment and storage medium | |
| CN114490413A (en) | Test data preparation method and device, storage medium and electronic equipment | |
| CN111694727A (en) | Network card firmware upgrading and downgrading test method, system, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20190226 |