CN107656860A - Performance test methods, apparatus and system - Google Patents
Performance test methods, apparatus and system Download PDFInfo
- Publication number
- CN107656860A CN107656860A CN201710972192.6A CN201710972192A CN107656860A CN 107656860 A CN107656860 A CN 107656860A CN 201710972192 A CN201710972192 A CN 201710972192A CN 107656860 A CN107656860 A CN 107656860A
- Authority
- CN
- China
- Prior art keywords
- running environment
- environment
- backup
- test
- task
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3058—Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations
Abstract
The invention discloses a kind of performance test methods, apparatus and system, wherein, method includes：The task environment information included in the test assignment received is obtained, the system running environment with the task environment information match is defined as the first running environment；When it is determined that current system running environment is with the first running environment difference, according to the default backup running environment corresponding with first running environment, current system running environment is reverted into first running environment；The test assignment is performed under first running environment, and obtains the performance test results corresponding with the test assignment.Using this programme, test assignment can be made to be run in the system environments to match, avoid influence of the factor uncorrelated to test assignment to test result, improve the reliability of test result.
Description
Technical field
The present invention relates to electronic information technical field, and in particular to a kind of performance test methods, apparatus and system.
Background technology
The performance test of product is in the life cycle of IT product, and particularly product development is basically completed issue rank
Section, tests to product to verify that product meets the process of predetermined performance requirement and target level of product quality.At present, in product
Performance test during, when often receiving the performance test task of product, directly completed in last test assignment
Run in system running environment afterwards.
But inventor has found that aforesaid way of the prior art at least exists following during the present invention is realized
Defect：In above-mentioned performance test methods, because the test environment of the performance test required by task of each product may be different, institute
The more factor unrelated with current test assignment after the completion of last test assignment, in system be present, such as last test assignment
Operation platform, plug-in unit needed for operation etc., so that test environment complicates, the operation of current test assignment is influenceed, reduced
The reliability of test result, and the real product performance index of product can not be obtained.
The content of the invention
In view of the above problems, it is proposed that the present invention so as to provide one kind overcome above mentioned problem or at least in part solve on
State performance test methods, the apparatus and system of problem.
According to an aspect of the invention, there is provided a kind of performance test methods, including：
Obtain the task environment information included in the test assignment that receives, by with the task environment information match
System running environment is defined as the first running environment；
When it is determined that current system running environment is with the first running environment difference, according to default with described first
The corresponding backup running environment of running environment, current system running environment is reverted into first running environment；
The test assignment is performed under first running environment, and obtains the performance corresponding with the test assignment
Test result.
According to another aspect of the present invention, there is provided a kind of performance testing device, including：
Acquisition module, will be with the task ring suitable for obtaining the task environment information included in the test assignment received
The system running environment that environment information matches is defined as the first running environment；
Recovery module, suitable for when it is determined that current system running environment is with the first running environment difference, according to pre-
If the backup running environment corresponding with first running environment, current system running environment is reverted to described first
Running environment；
Test module, suitable for performing the test assignment under first running environment, and obtain and appoint with the test
It is engaged in corresponding the performance test results.
According to a further aspect of the invention, there is provided a kind of Performance Test System, including：Test server, Yi Jiduo
Individual above-mentioned performance testing device；
Wherein, run parallel between multiple performance testing devices, also, each performance testing device is real machine.
According to a further aspect of the invention, there is provided a kind of electronic equipment, including：Processor, memory, communication interface
And communication bus, the processor, the memory and the communication interface complete mutual lead to by the communication bus
Letter；
The memory is used to deposit an at least executable instruction, and the executable instruction makes the computing device above-mentioned
Operated corresponding to performance test methods.
According to a further aspect of the invention, there is provided a kind of computer-readable storage medium, be stored with the storage medium
An at least executable instruction, the executable instruction make to operate corresponding to the above-mentioned performance test methods of computing device.
According to performance test methods provided by the invention, apparatus and system, wrapped by obtaining in the test assignment received
The task environment information contained, the system running environment with the task environment information match is defined as the first running environment；
When it is determined that current system running environment is with the first running environment difference, according to default with first running environment
Corresponding backup running environment, current system running environment is reverted into first running environment；In the described first fortune
The test assignment is performed under row environment, and obtains the performance test results corresponding with the test assignment.Using this programme,
Test assignment can be made to be run in the system environments to match, avoid shadow of the factor uncorrelated to test assignment to test result
Ring, improve the accuracy of the reliability of test result and the performance indications of tested product.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention,
And can be practiced according to the content of specification, and in order to allow above and other objects of the present invention, feature and advantage can
Become apparent, below especially exemplified by the embodiment of the present invention.
Brief description of the drawings
By reading the detailed description of hereafter preferred embodiment, it is various other the advantages of and benefit it is common for this area
Technical staff will be clear understanding.Accompanying drawing is only used for showing the purpose of preferred embodiment, and is not considered as to the present invention
Limitation.And in whole accompanying drawing, identical part is denoted by the same reference numerals.In the accompanying drawings：
Fig. 1 shows the schematic flow sheet of the performance test methods provided according to one embodiment of the invention；
Fig. 2 shows the schematic flow sheet of the performance test methods provided according to a further embodiment of the invention；
Fig. 3 shows the structured flowchart of the performance testing device provided according to one embodiment of the invention；
Fig. 4 shows the structured flowchart of the performance testing device provided according to a further embodiment of the invention；
Fig. 5 shows the structured flowchart of the Performance Test System provided according to one embodiment of the invention；
Fig. 6 shows the structural representation of a kind of electronic equipment provided according to one embodiment of the invention.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although the disclosure is shown in accompanying drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
Limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Completely it is communicated to those skilled in the art.
Fig. 1 shows the schematic flow sheet of the performance test methods provided according to one embodiment of the invention.Such as Fig. 1 institutes
Show, this method includes：
Step S110, the task environment information included in the test assignment received is obtained, will be with task environment information phase
The system running environment of matching is defined as the first running environment.
Wherein, to avoid influenceing the execution of test assignment with test assignment irrelevant factor, test assignment need to be accordingly
Run in system running environment.However, the system running environment needed for each test assignment there may be difference, so, for mark
System running environment needed for different test assignments, it can be that each test assignment sets corresponding task environment information, such as run
Environment numbering or running environment keyword etc..
Specifically, by obtaining the task environment information included in the test assignment received, it can know that the test is appointed
System running environment needed for business, and the system running environment with task environment information match is defined as the first operation ring
Border.Specific matched rule those skilled in the art can voluntarily be set, and the present invention does not limit.If for example, wrapped in test assignment
The task environment information contained is numbered for running environment, then the running environment numbering that basis is pre-configured with is reflected with system running environment
Firing table, the system running environment to match with running environment numbering is defined as the first running environment；Or when in test assignment
Comprising task environment information be running environment keyword, then can be by Keywords matching, will be with running environment keyword phase
The system running environment matched somebody with somebody is defined as the first running environment, if keyword is " Windows7 " and " Python ", then transports system
The operating system of row environment is Windows 7, and under be loaded with the system running environments of Python operation platforms and be defined as the first fortune
Row environment.
Step S120, when it is determined that when current system running environment and the first running environment difference, according to default with the
The corresponding backup running environment of one running environment, the first running environment is reverted to by current system running environment.
Wherein, the backup running environment corresponding with all kinds of running environment is previously provided with system, if current system
Running environment is different from the first running environment, then it is not the system operation needed for the test assignment to show current system running environment
Environment, then according to the backup running environment corresponding with the first running environment, current system running environment is reverted to first
Running environment.For example, according to the numbering of current first running environment, default backup running environment corresponding thereto is searched.
If current first running environment numbering is 2, its operating system is Win7, and under be loaded with Python operation platforms, and at 2017 5
20 divide the backup running environment of backup to number also are 2 when months 12 days 14, and its operating system is Win7, and under be loaded with Python operations
It platform, then can be operated by backup and reduction, directly recover to during 12 days 14 May in 2017 20 to divide by current system running environment
When backup running environment, so as to which current system running environment is reverted into the first running environment.
Step S130, test assignment is performed under the first running environment, and obtain the performance corresponding with test assignment and survey
Test result.
Specifically, by corresponding method of testing, corresponding test case is run under the first running environment, performs test
Task.For example, file speed, and/or the competing product speed of installation are downloaded in the installation rate of detectable product, tab switch speeds, product
Degree etc..And obtain the performance test results corresponding with test assignment.
As can be seen here, performance test methods provided by the invention, by obtaining times included in the test assignment received
Business environmental information, is defined as the first running environment by the system running environment with task environment information match；When it is determined that current
System running environment and the first running environment difference when, according to the default backup fortune corresponding with the first running environment
Row environment, current system running environment is reverted into the first running environment；Test assignment is performed under the first running environment, and
Obtain the performance test results corresponding with test assignment.Using this method, automation can be made to realize that test assignment is matching
System environments in operation, avoid influence of the factor uncorrelated to test assignment to test result, that improves test result can
By property and the accuracy of the performance indications of tested product.
Fig. 2 shows the schematic flow sheet of the performance test methods provided according to a further embodiment of the invention.Such as Fig. 2 institutes
Show, this method includes：
Step S210, it is pre-configured with multiple backup running environment corresponding with sorts of systems running environment respectively；Wherein,
Each backup running environment has corresponding backup environment mark and/or environment calls interface.
Wherein, system running environment is according to the type of operating system, and/or in the operating system of the type should
Determined with the type of software.Different OS Types, and/or the application software type in the type operating system
Difference, the then system running environment to belong to a different category.Such as, if according to the type of operating system, and the behaviour installed in the type
Make the type of the application software in system to determine system running environment, then Python is installed in Windows7 operating systems
The system of operation platform is a kind of system running environment, and MySQL operation platforms are provided with Windows7 operating systems is
Unite as another kind of system running environment.
Specifically, it is first during multiple backup running environment corresponding with sorts of systems running environment respectively are configured
Each system running environment to be backed up is first directed to respectively, determines the ambient condition of the system running environment to be backed up.Secondly,
The processing to match with the ambient condition of the system running environment to be backed up is performed for current system running environment.Most
Afterwards, backed up for the system running environment obtained after processing.Wherein, perform for current system running environment and treated with this
The processing that the ambient condition of the system running environment of backup matches includes：Fire wall is closed, user account control is closed, closes
Screen protection, installation predetermined software, keeper's identity is set and verifies, close automatically updating setting, opening system for system
Remote access is allowed to set, setting system is start self-starting state, and/or sets system to exempt from password login state.Citing
For, however, it is determined that a certain system running environment to be backed up ambient condition to be provided with Windows7 operating systems
Python operation platforms, it is with processing that it matches then：Fire wall and user account control are closed to avoid to operating system
The limitation of operation such as reinstall, and keeper's identity is set and verified, so as to obtain to operating system Type Change
Authority, current system is reinstalled as Windows7 operating systems, and Python further is installed and its expanding packet, a key are extensive
Multiple software etc..And after treatment, back-up processing is carried out to system.Python is installed so as to obtain in Windows7 operating systems
The backup running environment of operation platform.Optionally, multiple backup fortune corresponding with sorts of systems running environment respectively are being configured
In row environmental process, system running environment can be classified according to the operating system classification of sorts of systems running environment, to same
After the system running environment of one type operating system carries out back-up processing, the system running environment of another type operating system is reprocessed.
So as to when the system running environment to same type operating system carries out back-up processing, reset the type operating system first
Afterwards, the back-up processing of the system running environment of follow-up generic operating system only needs what change was installed in the type operating system
Application software, so as to improve allocative efficiency.
Further, each backup running environment has corresponding backup environment mark and/or environment calls interface.Example
Such as, can be that backup running environment sets corresponding numbering to be identified as backup environment according to the sequencing of BACKUP TIME, or
Identified the specifying information of backup running environment as backup environment, Python fortune is such as installed in Windows7 operating systems
The backup running environment of row platform, " Windows7+Python " can be identified as the backup environment of the backup running environment；Again
Or can be that each backup running environment sets corresponding environment calls interface.
Step S220, the task environment information included in the test assignment received is obtained, will be with task environment information phase
The system running environment of matching is defined as the first running environment.
Optionally, the task environment included in the test assignment received can periodically be obtained according to the default execution cycle
Information, the task environment information included in the test assignment once received is such as obtained weekly；Or when detecting new survey
When trial business is submitted (when such as getting test assignment http request message), being included in the test assignment receiving for task is obtained
Environmental information.In a word, the specific opportunity of the task environment information included in the test assignment that the present invention receives to acquisition does not do
Limit.
Wherein, task environment information specifically includes task environment parameter.The parameter value of task environment parameter can include one
It is individual, for example, task environment parameter can be corresponding with each backup environment mark；Or the parameter value of task environment parameter can
So that comprising multiple, parameters value corresponds with each backup running environment being pre-configured with respectively, optionally, task environment
The parameter value of parameter can include " operating system " parameter value, and " application software " parameter value, and " operating system " parameter value,
And OS Type and application software class in " application software " parameter value and each backup running environment for being pre-configured with
Type corresponds." operating system " parameter value such as task environment parameter is " Windows7 ", " application software " parameter value
For " Python ", then the task environment parameter correspond to pre-set Python fortune is installed in Windows7 operating systems
The backup running environment of row platform.
According to the task environment information included in test assignment, the system operation ring needed for the test assignment can be known
Border, and the system running environment with task environment information match is defined as the first running environment.For example, if task environment is joined
Several " operating system " parameter values is " Windows7 ", and " application software " parameter value is " Python ", then can determine that
The system running environment that Python operation platforms are provided with Windows7 operating systems is the first running environment.
Step S230, when it is determined that when current system running environment and the first running environment difference, it is determined that with the first operation
The corresponding backup running environment of environment backup environment mark and/or environment calls interface, according to backup environment mark and/or
Current system running environment is reverted to the first running environment by environment calls interface.
Wherein, the backup running environment corresponding with all kinds of running environment is previously provided with system, if current system
Running environment is different from the first running environment, then it is not the system operation needed for the test assignment to show current system running environment
Environment, then need current system running environment reverting to the first running environment.
Specifically, due to being provided with multiple backups corresponding with sorts of systems running environment respectively in step S210 in advance
Running environment.Current first running environment can then be matched with the backup running environment being pre-configured with, if matching is consistent
Determine that the backup running environment backup running environment corresponding with the first running environment is corresponding.If for example, in step S220
" operating system " parameter value of task environment parameter in the task environment information corresponding with the first running environment is
" Windows7 ", " application software " parameter value are " Python ", then backup running environment corresponding thereto be
The backup running environment of Python operation platforms is installed in Windows7 operating systems.
Further, it is determined that the backup environment mark and/or ring of the backup running environment corresponding with the first running environment
Border calling interface, current system running environment is reverted to by the first fortune according to backup environment mark and/or environment calls interface
Row environment.Such as, however, it is determined that backup environment be identified as " Windows7+Python ", its corresponding BACKUP TIME be 2017 5
20 divide during the moon 12 days 14, then can be operated by backup and reduction (such as One-key recovery operation), system was recovered on May 12nd, 2017
The system mode of 20 timesharing when 14, or directly invoke corresponding environment calls interface, system is recovered be to operating system
Windows7, and the system running state of Python operation platforms is installed.
Step S240, test assignment is performed under the first running environment, and obtain the performance corresponding with test assignment and survey
Test result.
Specifically, by corresponding method of testing, corresponding test data is obtained, is run under the first running environment corresponding
Test case, perform test assignment.For example, download file in the installation rate of detectable product, tab switch speeds, product
Speed, and/or the competing product speed of installation etc..And obtain the performance test results corresponding with test assignment.
Optionally, it can obtain or query task daily record, task run state is obtained according to task daily record.It is further optional
, task run progress is presented with visual means, and with pop-up, message push, and/or mail notification etc. after task terminates
Mode prompts task to complete.It is further alternative, can be in the case where meeting default task deletion rule, to test assignment
Deletion action is carried out, such as after corresponding the performance test results are obtained after task terminates, the test assignment can be deleted.
As can be seen here, performance test methods provided by the invention, by be pre-configured with it is multiple respectively with sorts of systems run
The corresponding backup running environment of environment, and the task environment information included in the test assignment received is obtained, will be with task
The system running environment that environmental information matches is defined as the first running environment；When it is determined that current system running environment with it is described
During the first running environment difference, current system running environment is recovered according to backup environment mark and/or environment calls interface
For the first running environment, current system running environment so as to rapid automatized is set to revert to the fortune that test assignment matches
Row environment；And test assignment is performed under the first running environment, the performance test results corresponding with test assignment are obtained, so as to
Influence of the factor uncorrelated to test assignment to test result can be avoided, improves the reliability and tested product of test result
Performance indications accuracy.
Fig. 3 shows the structured flowchart of the performance testing device provided according to one embodiment of the invention.As shown in figure 3,
The device includes：Acquisition module 31, recovery module 32 and test module 33.
Acquisition module 31, will be with the task suitable for obtaining the task environment information included in the test assignment received
The system running environment that environmental information matches is defined as the first running environment.
Wherein, to avoid influenceing the execution of test assignment with test assignment irrelevant factor, each test assignment is both needed in phase
Run in the system running environment answered.However, the system running environment needed for each test assignment there may be difference, so,
Can be that each test assignment sets corresponding task environment information to identify the system running environment needed for different test assignments,
Such as running environment numbering or running environment keyword.
Specifically, by obtaining the task environment information included in the test assignment received, it can know that the test is appointed
System running environment needed for business, and the system running environment with task environment information match is defined as the first operation ring
Border.Specific matched rule those skilled in the art can voluntarily be set, and the present invention does not limit.If for example, wrapped in test assignment
The task environment information contained is numbered for running environment, then the running environment numbering that basis is pre-configured with is reflected with system running environment
Firing table, the system running environment to match with running environment numbering is defined as the first running environment；Or when in test assignment
Comprising task environment information be running environment keyword, then can be by Keywords matching, will be with running environment keyword phase
The system running environment matched somebody with somebody is defined as the first running environment, if keyword is " Win7 " and " Python ", then by system operation ring
The operating system in border is Win7, and under be loaded with the system running environments of Python operation platforms and be defined as the first running environment.
Recovery module 32, suitable for when it is determined that when current system running environment and the first running environment difference, according to default
The backup running environment corresponding with the first running environment, current system running environment is reverted into the first running environment.
Wherein, the backup running environment corresponding with all kinds of running environment is previously provided with system, if current system
Running environment is different from the first running environment, then it is not the system operation needed for the test assignment to show current system running environment
Environment, then according to the backup running environment corresponding with the first running environment, current system running environment is reverted to first
Running environment.For example, according to the numbering of current first running environment, default backup running environment corresponding thereto is searched.
If current first running environment numbering is 2, its operating system is Win7, and under be loaded with Python operation platforms, and at 2017 5
20 divide the backup running environment of backup to number also are 2 when months 12 days 14, and its operating system is Win7, and under be loaded with Python operations
It platform, then can be operated by backup and reduction, directly recover to during 12 days 14 May in 2017 20 to divide by current system running environment
When backup running environment, so as to which current system running environment is reverted into the first running environment.
Test module 33, suitable for performing test assignment under the first running environment, and obtain corresponding with test assignment
The performance test results.
Specifically, by corresponding method of testing, corresponding test case is run under the first running environment, performs test
Task.For example, file speed, and/or the competing product speed of installation are downloaded in the installation rate of detectable product, tab switch speeds, product
Degree etc..And obtain the performance test results corresponding with test assignment.
As can be seen here, performance testing device provided by the invention, by obtaining times included in the test assignment received
Business environmental information, is defined as the first running environment by the system running environment with task environment information match；When it is determined that current
System running environment and the first running environment difference when, according to the default backup fortune corresponding with the first running environment
Row environment, current system running environment is reverted into the first running environment；Test assignment is performed under the first running environment, and
Obtain the performance test results corresponding with test assignment.Using the present apparatus, test assignment can be made in the system environments to match
Middle operation, influence of the factor uncorrelated to test assignment to test result is avoided, improve the reliability of test result and be tested
The accuracy of the performance indications of product.
Fig. 4 shows the structured flowchart of the performance testing device provided according to a further embodiment of the invention.Such as Fig. 4 institutes
Show, on the basis of Fig. 3 shown devices, the device also includes：Configuration module 41.
Wherein, configuration module 41 is suitable to be pre-configured with multiple backup operations corresponding with sorts of systems running environment respectively
Environment；Wherein, each backup running environment has corresponding backup environment mark and/or environment calls interface.
Wherein, system running environment is according to the type of operating system, and/or in the operating system of the type should
Determined with the type of software.
Configuration module 41 is particularly adapted to：Respectively for each system running environment to be backed up, determine that this to be backed up is
The ambient condition for running environment of uniting；The environment with the system running environment to be backed up is performed for current system running environment
The processing that state matches；Backed up for the system running environment obtained after processing.
Configuration module 41 is further adapted for：The following and system to be backed up is performed for current system running environment to transport
It is at least one in the processing operation that the ambient condition of row environment matches：
Fire wall is closed, user account control is closed, closes screen protection, installation predetermined software, keeper's identity is set
And verify, close system automatically update setting, open system allow remote access set, setting system for start self-starting
State and setting system are to exempt from password login state.
Recovery module 32 is particularly adapted to：It is determined that the backup environment mark of the backup running environment corresponding with the first running environment
Knowledge and/or environment calls interface, current system running environment is recovered according to backup environment mark and/or environment calls interface
For first running environment.
Optionally, task environment information specifically includes：Task environment parameter, wherein, the parameter value bag of task environment parameter
Include multiple, and parameters value corresponds with each backup running environment for being pre-configured with respectively.
As can be seen here, performance testing device provided by the invention, by be pre-configured with it is multiple respectively with sorts of systems run
The corresponding backup running environment of environment, and the task environment information included in the test assignment received is obtained, will be with task
The system running environment that environmental information matches is defined as the first running environment；When it is determined that current system running environment with it is described
During the first running environment difference, current system running environment is recovered according to backup environment mark and/or environment calls interface
For the first running environment, current system running environment so as to rapid automatized is set to revert to the fortune that test assignment matches
Row environment；And test assignment is performed under the first running environment, the performance test results corresponding with test assignment are obtained, so as to
Influence of the factor uncorrelated to test assignment to test result can be avoided, improves the reliability and tested product of test result
Performance indications accuracy.
Fig. 5 shows the structured flowchart of the Performance Test System provided according to one embodiment of the invention.As shown in figure 5,
The system includes test server 51 and multiple performance testing devices 52.
Wherein, run parallel between multiple performance testing devices, also, each performance testing device is real machine.
Optionally, test server 51 is suitable to, and distributes test assignment to each performance testing device, or please to database
Data are sought, and the data asked are sent to corresponding performance testing device.Specifically, each performance testing device is obtained
Running status, according to the load of each performance testing device, distribute corresponding test assignment for each performance testing device.Or
Person, when data are sent to corresponding performance testing device by default transmission channel in performance testing device running,
For performance testing device and the normal operation of test assignment.
Optionally, test server 51 is further adapted for, and receives and delete task.Specifically, test server 51 can determine
Phase or when receiving test assignment packet, receive the test assignment；And in task meet default deletion condition (such as task is complete
Into) when delete task.
Optionally, test server 51 is further adapted for, and inquires about each performance testing device running log, and monitor each
Performance testing device running status, show test assignment state in each performance testing device.And by pre- after task terminates
If alerting pattern reminded.
As can be seen here, Performance Test System provided by the invention, can by test server and multiple performance testing devices
Current system running environment with rapid automatized is set to revert to the running environment that test assignment matches；So as to avoid with
Influence of the uncorrelated factor of test assignment to test result, improves the reliability of test result and the performance indications of tested product
Accuracy.Also, by the parallel operation of multiple performance testing devices, performance test speed can be improved；And pass through each individual character
Energy test device can further improve the reliability and authenticity of the performance test results by the way of real machine.
A kind of nonvolatile computer storage media is provided according to one embodiment of the invention, the computer storage is situated between
Matter is stored with an at least executable instruction, and the performance that the computer executable instructions can perform in above-mentioned any means embodiment is surveyed
Method for testing.
Fig. 6 shows the structural representation of the electronic equipment provided according to one embodiment of the invention, of the invention specific real
Specific implementation of the example not to electronic equipment is applied to limit.
As shown in fig. 6, the electronic equipment can include：Processor (processor) 602, communication interface
(Communications Interface) 604, memory (memory) 606 and communication bus 608.
Wherein：Processor 602, communication interface 604 and memory 606 complete mutual lead to by communication bus 608
Letter.
Communication interface 604, for being communicated with the network element of miscellaneous equipment such as client or other servers etc..
Processor 602, for configuration processor 610, it can specifically perform the correlation in above-mentioned performance test methods embodiment
Step.
Specifically, program 610 can include program code, and the program code includes computer-managed instruction.
Processor 602 is probably central processor CPU, or specific integrated circuit ASIC (Application
Specific Integrated Circuit), or it is arranged to implement the integrated electricity of one or more of the embodiment of the present invention
Road.The one or more processors that electronic equipment includes, can be same type of processor, such as one or more CPU；Also may be used
To be different types of processor, such as one or more CPU and one or more ASIC.
Memory 606, for depositing program 610.Memory 606 may include high-speed RAM memory, it is also possible to also include
Nonvolatile memory (non-volatile memory), for example, at least a magnetic disk storage.
Program 610 specifically can be used for so that processor 602 performs following operation：
Obtain the task environment information included in the test assignment that receives, by with the task environment information match
System running environment is defined as the first running environment；
When it is determined that current system running environment is with the first running environment difference, according to default with described first
The corresponding backup running environment of running environment, current system running environment is reverted into first running environment；
The test assignment is performed under first running environment, and obtains the performance corresponding with the test assignment
Test result.
Program 610 specifically can be used for so that processor 602 performs following operation：
It is pre-configured with multiple backup running environment corresponding with sorts of systems running environment respectively；Wherein, each backup
Running environment has corresponding backup environment mark and/or environment calls interface；
It is determined that the backup environment mark and/or environment calls of the backup running environment corresponding with first running environment
Interface, current system running environment is reverted to described first according to backup environment mark and/or environment calls interface
Running environment.
Program 610 specifically can be used for so that processor 602 performs following operation：
Each system running environment to be backed up is directed to respectively, determines the environment shape of the system running environment to be backed up
State；
Perform what is matched with the ambient condition of the system running environment to be backed up for current system running environment
Processing；
Backed up for the system running environment obtained after processing.
Program 610 specifically can be used for so that processor 602 performs following operation：
Fire wall is closed, user account control is closed, closes screen protection, installation predetermined software, keeper's identity is set
And verify, close system automatically update setting, open system allow remote access set, setting system for start self-starting
State and setting system are to exempt from password login state.
Wherein, the task environment information specifically includes：Task environment parameter, wherein, the ginseng of the task environment parameter
Numerical value is including multiple, and parameters value corresponds with each backup running environment being pre-configured with respectively；
Wherein, the system running environment is according to the type of operating system, and/or in the operating system of the type
Application software type determine.
Algorithm and display be not inherently related to any certain computer, virtual system or miscellaneous equipment provided herein.
Various general-purpose systems can also be used together with teaching based on this.As described above, required by constructing this kind of system
Structure be obvious.In addition, the present invention is not also directed to any certain programmed language.It should be understood that it can utilize various
Programming language realizes the content of invention described herein, and the description done above to language-specific is to disclose this hair
Bright preferred forms.
In the specification that this place provides, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present invention
Example can be put into practice in the case of these no details.In some instances, known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this description.
Similarly, it will be appreciated that in order to simplify the disclosure and help to understand one or more of each inventive aspect,
Above in the description to the exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention：I.e. required guarantor
The application claims of shield features more more than the feature being expressly recited in each claim.It is more precisely, such as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following embodiment are expressly incorporated in the embodiment, wherein each claim is in itself
Separate embodiments all as the present invention.
Those skilled in the art, which are appreciated that, to be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more equipment different from the embodiment.Can be the module or list in embodiment
Member or component be combined into a module or unit or component, and can be divided into addition multiple submodule or subelement or
Sub-component.In addition at least some in such feature and/or process or unit exclude each other, it can use any
Combination is disclosed to all features disclosed in this specification (including adjoint claim, summary and accompanying drawing) and so to appoint
Where all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification (including adjoint power
Profit requires, summary and accompanying drawing) disclosed in each feature can be by providing the alternative features of identical, equivalent or similar purpose come generation
Replace.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included some features rather than further feature, but the combination of the feature of different embodiments means in of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed
One of meaning mode can use in any combination.
The all parts embodiment of the present invention can be realized with hardware, or to be run on one or more processor
Software module realize, or realized with combinations thereof.It will be understood by those of skill in the art that it can use in practice
Microprocessor or digital signal processor (DSP) come realize in performance testing device according to embodiments of the present invention some or
The some or all functions of person's whole part.The present invention is also implemented as perform method as described herein one
Divide either whole equipment or program of device (for example, computer program and computer program product).It is such to realize this hair
Bright program can store on a computer-readable medium, or can have the form of one or more signal.It is such
Signal can be downloaded from internet website and obtained, and either provided on carrier signal or provided in the form of any other.
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and ability
Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims,
Any reference symbol between bracket should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not
Element or step listed in the claims.Word "a" or "an" before element does not exclude the presence of multiple such
Element.The present invention can be by means of including the hardware of some different elements and being come by means of properly programmed computer real
It is existing.In if the unit claim of equipment for drying is listed, several in these devices can be by same hardware branch
To embody.The use of word first, second, and third does not indicate that any order.These words can be explained and run after fame
Claim.
The invention also discloses a kind of performance test methods of A1., including：
Obtain the task environment information included in the test assignment that receives, by with the task environment information match
System running environment is defined as the first running environment；
When it is determined that current system running environment is with the first running environment difference, according to default with described first
The corresponding backup running environment of running environment, current system running environment is reverted into first running environment；
The test assignment is performed under first running environment, and obtains the performance corresponding with the test assignment
Test result.
A2. the method according to A1, wherein, methods described further comprises step：Be pre-configured with it is multiple respectively with respectively
The corresponding backup running environment of class system running environment；Wherein, each backup running environment has corresponding backup environment mark
Knowledge and/or environment calls interface；
Then described the step of current system running environment is reverted into first running environment, specifically includes：
It is determined that the backup environment mark and/or environment calls of the backup running environment corresponding with first running environment
Interface, current system running environment is reverted to described first according to backup environment mark and/or environment calls interface
Running environment.
A3. the method according to A2, wherein, it is described be pre-configured with it is multiple corresponding with sorts of systems running environment respectively
Backup running environment the step of specifically include：
Each system running environment to be backed up is directed to respectively, determines the environment shape of the system running environment to be backed up
State；
Perform what is matched with the ambient condition of the system running environment to be backed up for current system running environment
Processing；
Backed up for the system running environment obtained after processing.
A4. the method according to A3, wherein, described performed for current system running environment to be backed up with this is
The step of processing that the ambient condition of system running environment matches, specifically includes at least one in following operation：
Fire wall is closed, user account control is closed, closes screen protection, installation predetermined software, keeper's identity is set
And verify, close system automatically update setting, open system allow remote access set, setting system for start self-starting
State and setting system are to exempt from password login state.
A5. according to any described methods of A2-4, wherein, the task environment information specifically includes：Task environment parameter,
Wherein, the parameter value of the task environment parameter includes multiple, and parameters value is transported with each backup being pre-configured with respectively
Row environment corresponds；
Wherein, the system running environment is according to the type of operating system, and/or in the operating system of the type
Application software type determine.
B6. a kind of performance testing device, including：
Acquisition module, will be with the task ring suitable for obtaining the task environment information included in the test assignment received
The system running environment that environment information matches is defined as the first running environment；
Recovery module, suitable for when it is determined that current system running environment is with the first running environment difference, according to pre-
If the backup running environment corresponding with first running environment, current system running environment is reverted to described first
Running environment；
Test module, suitable for performing the test assignment under first running environment, and obtain and appoint with the test
It is engaged in corresponding the performance test results.
B7. the device according to B6, wherein, further comprise：
Configuration module, suitable for being pre-configured with multiple backup running environment corresponding with sorts of systems running environment respectively；
Wherein, each backup running environment has corresponding backup environment mark and/or environment calls interface；
Then the recovery module is particularly adapted to：It is determined that the backup running environment corresponding with first running environment is standby
Part environmental labelses and/or environment calls interface, according to backup environment mark and/or environment calls interface by current system
Running environment reverts to first running environment.
B8. the device according to B7, wherein, the configuration module is particularly adapted to：
Each system running environment to be backed up is directed to respectively, determines the environment shape of the system running environment to be backed up
State；
Perform what is matched with the ambient condition of the system running environment to be backed up for current system running environment
Processing；
Backed up for the system running environment obtained after processing.
B9. the device according to B8, wherein, the configuration module is particularly adapted to：For current system running environment
Perform at least one in the processing operation that the following ambient condition with the system running environment to be backed up matches：
Fire wall is closed, user account control is closed, closes screen protection, installation predetermined software, keeper's identity is set
And verify, close system automatically update setting, open system allow remote access set, setting system for start self-starting
State and setting system are to exempt from password login state.
B10. according to any described devices of B7-9, wherein, the task environment information specifically includes：Task environment is joined
Number, wherein, the parameter value of the task environment parameter is including multiple, and each backup with being pre-configured with respectively of parameters value
Running environment corresponds；
Wherein, the system running environment is according to the type of operating system, and/or in the operating system of the type
Application software type determine.
C11. a kind of Performance Test System, including：Test server, and multiple performance tests as described in B6-9 is any
Device；
Wherein, run parallel between multiple performance testing devices, also, each performance testing device is real machine.
D12. a kind of electronic equipment, including：Processor, memory, communication interface and communication bus, the processor, institute
State memory and the communication interface and mutual communication is completed by the communication bus；
The memory is used to deposit an at least executable instruction, and the executable instruction makes the computing device such as
Operated corresponding to performance test methods any one of A1-5.
E13. a kind of computer-readable storage medium, an at least executable instruction is stored with the storage medium, it is described to hold
Row instruction makes operation corresponding to performance test methods of the computing device as any one of A1-5.
Claims (10)
1. a kind of performance test methods, including：
The task environment information included in the test assignment received is obtained, by the system with the task environment information match
Running environment is defined as the first running environment；
When it is determined that current system running environment is with the first running environment difference, according to default with the described first operation
The corresponding backup running environment of environment, current system running environment is reverted into first running environment；
The test assignment is performed under first running environment, and obtains the performance test corresponding with the test assignment
As a result.
2. according to the method for claim 1, wherein, methods described further comprises step：Be pre-configured with it is multiple respectively with
The corresponding backup running environment of sorts of systems running environment；Wherein, each backup running environment has corresponding backup environment
Mark and/or environment calls interface；
Then described the step of current system running environment is reverted into first running environment, specifically includes：
It is determined that the backup environment mark and/or environment calls of the backup running environment corresponding with first running environment connect
Mouthful, current system running environment is reverted to by first fortune according to backup environment mark and/or environment calls interface
Row environment.
3. according to the method for claim 2, wherein, it is described be pre-configured with it is multiple relative with sorts of systems running environment respectively
The step of backup running environment answered, specifically includes：
Each system running environment to be backed up is directed to respectively, determines the ambient condition of the system running environment to be backed up；
The processing to match with the ambient condition of the system running environment to be backed up is performed for current system running environment；
Backed up for the system running environment obtained after processing.
4. the method according to claim 11, wherein, it is described to be backed up with this for current system running environment execution
The step of processing that the ambient condition of system running environment matches, specifically includes at least one in following operation：
Fire wall is closed, user account control is closed, closes screen protection, installation predetermined software, keeper's identity is set and tested
Card, close system automatically update settings, open system allow remote access set, setting system for start shooting self-starting shape
State and setting system are to exempt from password login state.
5. according to any described methods of claim 2-4, wherein, the task environment information specifically includes：Task environment is joined
Number, wherein, the parameter value of the task environment parameter is including multiple, and each backup with being pre-configured with respectively of parameters value
Running environment corresponds；
Wherein, the system running environment is according to the type of operating system, and/or in the operating system of the type should
Determined with the type of software.
6. a kind of performance testing device, including：
Acquisition module, suitable for obtaining the task environment information included in the test assignment received, it will believe with the task environment
The system running environment of manner of breathing matching is defined as the first running environment；
Recovery module, suitable for when it is determined that current system running environment is with the first running environment difference, according to default
The backup running environment corresponding with first running environment, current system running environment is reverted into first operation
Environment；
Test module, suitable for performing the test assignment under first running environment, and obtain and the test assignment phase
Corresponding the performance test results.
7. device according to claim 6, wherein, further comprise：
Configuration module, suitable for being pre-configured with multiple backup running environment corresponding with sorts of systems running environment respectively；Wherein,
Each backup running environment has corresponding backup environment mark and/or environment calls interface；
Then the recovery module is particularly adapted to：It is determined that the backup ring of the backup running environment corresponding with first running environment
Border identifies and/or environment calls interface, according to backup environment mark and/or environment calls interface by current system operation
Environment restoration is first running environment.
8. a kind of Performance Test System, including：Test server, and multiple performances as described in claim 6-7 is any are surveyed
Trial assembly is put；
Wherein, run parallel between multiple performance testing devices, also, each performance testing device is real machine.
9. a kind of electronic equipment, including：Processor, memory, communication interface and communication bus, the processor, the storage
Device and the communication interface complete mutual communication by the communication bus；
The memory is used to deposit an at least executable instruction, and the executable instruction makes the computing device such as right will
Ask and operated corresponding to the performance test methods any one of 1-5.
10. a kind of computer-readable storage medium, an at least executable instruction, the executable instruction are stored with the storage medium
Make operation corresponding to performance test methods of the computing device as any one of claim 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710972192.6A CN107656860A (en) | 2017-10-18 | 2017-10-18 | Performance test methods, apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710972192.6A CN107656860A (en) | 2017-10-18 | 2017-10-18 | Performance test methods, apparatus and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107656860A true CN107656860A (en) | 2018-02-02 |
Family
ID=61119035
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710972192.6A Pending CN107656860A (en) | 2017-10-18 | 2017-10-18 | Performance test methods, apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107656860A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109376073A (en) * | 2018-09-14 | 2019-02-22 | 珠海金山网络游戏科技有限公司 | A kind of memory of test environment and restoration methods |
| CN110022260A (en) * | 2019-02-02 | 2019-07-16 | 阿里巴巴集团控股有限公司 | A kind of Cross-environment acknowledgement message processing method and system |
| CN111274140A (en) * | 2020-01-19 | 2020-06-12 | 苏州浪潮智能科技有限公司 | Device, method and server for automatic case execution site recovery |
| CN111309598A (en) * | 2020-01-19 | 2020-06-19 | 苏州浪潮智能科技有限公司 | Test case execution environment recovery method, system, terminal and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007079981A (en) * | 2005-09-14 | 2007-03-29 | Nomura Research Institute Ltd | Antedate state production method and program |
| CN101876940B (en) * | 2009-11-30 | 2011-12-28 | 飞天诚信科技股份有限公司 | Automatic test method and device |
| CN102622298A (en) * | 2012-03-02 | 2012-08-01 | 奇智软件（北京）有限公司 | Software testing system and method |
| CN103577328A (en) * | 2013-11-20 | 2014-02-12 | 北京奇虎科技有限公司 | Method and device for analyzing performance of application |
| CN105446865A (en) * | 2014-07-09 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Test method and device under multi-environment |
-
2017
- 2017-10-18 CN CN201710972192.6A patent/CN107656860A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007079981A (en) * | 2005-09-14 | 2007-03-29 | Nomura Research Institute Ltd | Antedate state production method and program |
| CN101876940B (en) * | 2009-11-30 | 2011-12-28 | 飞天诚信科技股份有限公司 | Automatic test method and device |
| CN102622298A (en) * | 2012-03-02 | 2012-08-01 | 奇智软件（北京）有限公司 | Software testing system and method |
| CN103577328A (en) * | 2013-11-20 | 2014-02-12 | 北京奇虎科技有限公司 | Method and device for analyzing performance of application |
| CN105446865A (en) * | 2014-07-09 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Test method and device under multi-environment |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109376073A (en) * | 2018-09-14 | 2019-02-22 | 珠海金山网络游戏科技有限公司 | A kind of memory of test environment and restoration methods |
| CN109376073B (en) * | 2018-09-14 | 2021-08-03 | 珠海金山网络游戏科技有限公司 | Test environment memory and recovery method |
| CN110022260A (en) * | 2019-02-02 | 2019-07-16 | 阿里巴巴集团控股有限公司 | A kind of Cross-environment acknowledgement message processing method and system |
| CN110022260B (en) * | 2019-02-02 | 2021-12-24 | 创新先进技术有限公司 | Cross-environment receipt message processing method and system |
| CN111274140A (en) * | 2020-01-19 | 2020-06-12 | 苏州浪潮智能科技有限公司 | Device, method and server for automatic case execution site recovery |
| CN111309598A (en) * | 2020-01-19 | 2020-06-19 | 苏州浪潮智能科技有限公司 | Test case execution environment recovery method, system, terminal and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107656860A (en) | Performance test methods, apparatus and system | |
| US9848277B2 (en) | High-speed application for installation on mobile devices for permitting remote configuration of such mobile devices | |
| CN107896244B (en) | Version file distribution method, client and server | |
| CN109408262B (en) | Service data processing method and related equipment | |
| CN108491322A (en) | Automated testing method, device and storage medium | |
| CN108776643B (en) | Target code merging control method and system based on version control process | |
| US9329979B2 (en) | Derivation of generalized test cases | |
| CN107729249A (en) | Browser compatibility method of testing, device, system and electronic equipment | |
| CN112084488A (en) | Application authority management method, device and system | |
| CN107147711A (en) | Application service update method and device | |
| US10929279B2 (en) | Systems and method for automated testing framework for service portal catalog | |
| CN113778442A (en) | System menu generating method, device, equipment and storage medium | |
| CN114546738A (en) | Server general test method, system, terminal and storage medium | |
| CN110489161B (en) | Version file management method and related device | |
| CN114237754A (en) | Data loading method and device, electronic equipment and storage medium | |
| CN104699554B (en) | Software repair, apparatus and system | |
| CN106603701A (en) | Method and device for sending message based on long connection platform | |
| CN109063846B (en) | Machine learning operation method, device, equipment and storage medium | |
| CN111381995A (en) | Method and device for restoring user operation and computer | |
| CN116303099A (en) | Cross-platform rapid deployment method, device, medium and equipment for automatic test environment | |
| CN114356781A (en) | Software function testing method and device | |
| CN114816449A (en) | Automatic deployment method and device | |
| CN114527993A (en) | Application deployment method, device, equipment and medium | |
| CN114328257A (en) | Automatic test case execution method and system and electronic equipment | |
| CN112748950A (en) | Software code examination method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180202 |
|
| RJ01 | Rejection of invention patent application after publication |