CN110297778A - A kind of method for testing software and software testing device - Google Patents
A kind of method for testing software and software testing device Download PDFInfo
- Publication number
- CN110297778A CN110297778A CN201910693684.0A CN201910693684A CN110297778A CN 110297778 A CN110297778 A CN 110297778A CN 201910693684 A CN201910693684 A CN 201910693684A CN 110297778 A CN110297778 A CN 110297778A
- Authority
- CN
- China
- Prior art keywords
- software
- test
- testing
- event
- under
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The present invention provides a kind of method for testing software, the test of test and memory including user interface, further include following test method: one, test being completed using the method for the test interrupted on software runing time node, two, test is completed under multitask, three, test is completed in marginal testing or limit test, four, software difference operation external environment under above-mentioned one, two, three are repeatedly completed to software the step of test, five, with probability problem test method complete software operation when occur mistake probabilistic testing.The test device run by design simulation software is realized and is tested the accurate simulation of software, improve the accuracy of the test of software stability and the correctness of software test result with above-mentioned method for testing software.
Description
Technical field
The present invention relates to software testing technology fields, and in particular to a kind of method for testing software and software testing device.
Background technique
Software test can be divided into white-box testing, Black-box Testing and the grey box testing to fall between, and many softwares are all
It is related to memory and user interface two large divisions, and this two-part quality directly influences the function, performance and user of software
Use.Product software interface cans be compared to the face such as people, and the quality at interface determines that user influences on the first of software product, good
Interface can give a kind of eyeable feeling of people, play good guiding role, while the quality at interface will directly influence
User's operates with；As in terms of memory, it may be said that memory management will be related to per a software, and a software is interior
Deposit processing quality will directly influence software function normally can realize and run in performance state it is whether good, in addition
Memory management is also the part for being easy to go wrong in software, it is easy to cause software data to cause confusion, cause software function
Confusion and entanglement.Other than the above-mentioned canonical measure run to software, the stability external world of software operation requires test usually
Ignored by the external world, same software is caused difference may to occur the case where running on different server.
Summary of the invention
(1) the technical issues of solving
In view of the deficiencies of the prior art, the present invention provides a kind of method for testing software and software testing devices, overcome existing
The deficiency of technology improves the operational efficiency of software, improves the accuracy of software test result, improves the test of software stability
Accuracy.
(2) technical solution
In order to achieve the above object, the present invention is achieved by the following technical programs:
A kind of method for testing software, the test of test and memory including user interface, further includes following test method: one, existing
Method on software runing time node using the test interrupted completes test, and two, complete test under multitask, three, critical
Test is completed in test or limit test, four, under the external environment of software difference operation above-mentioned one is repeatedly completed to software,
Two, three the step of test, five, with probability problem test method complete software operation when occur mistake probabilistic testing.
Preferably, the runing time node of the software includes that task is completed, task starts, the percentage of task completion rate
The time point that state and multitask occur or complete.
Preferably, the time point that multitask occurs or completes is divided into interval, concurrently or consecutively.
Preferably, the marginal testing or limit test include test under the conditions of operating in critical environment to software,
Operate in the test under the conditions of critical tasks and the test under faulty operation method.
Preferably, the running environment of the equipment of equipment when the critical environment condition includes software operation, such as CPU maximum work
Running environment when running environment or memory size critical point under rate.
Preferably, the probabilistic testing that the test method with probability problem includes one, goes wrong, two pairs of appearance are general
Rate problem is tested by the test case in test document, until the discovery of bug proposes, analysis is assessed, distributes solution, really
Recognize solution situation.
A kind of software testing device, including computer box are connected with peak value converter, exception on the computer box
Event generator and functional analysis device, the peak value converter are used for the affairs of each affairs when the number of users of simulation softward peak period
The affairs of software are rung when whether the response time can satisfy requirement of the client to maximum number of concurrent, certain amount user runs together
Between seasonable, test software automatically processes function, the function point when the anomalous event generator is used to simulate anomalous event
The simulated implementation of each function of the software that parser is used for and analysis.
Preferably, event input module and maximum concurrent input module simultaneously are provided on the peak value converter, it is described
Input module and maximum concurrent input module are simultaneously operable event simultaneously, and input module imitates event case to the event simultaneously
It inputs simultaneously, the maximum concurrent input module simulates the input in the case of maximum number of concurrent.
Preferably, the anomalous event includes false command action event and normal server function damage event.
Preferably, the functional analysis device can realize multiple functions while simulate.
(3) beneficial effect
The embodiment of the invention provides a kind of method for testing software and software testing devices.Have following the utility model has the advantages that by setting
The test device for counting software is realized and is tested the accurate simulation of software, improve software stability with above-mentioned method for testing software
Test accuracy and software test result correctness.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the block diagram of heretofore described method for testing software.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
The present invention provides a kind of method for testing software refering to fig. 1, and the test of test and memory including user interface is also wrapped
It includes following test method: one, test, two, multiple being completed using the method for the test interrupted on software runing time node
Business is lower to complete test, and test is completed in three, marginal testing or limit test, and four, right under the external environment of software difference operation
Software is repeatedly completed the test of the step of above-mentioned one, two, three, and five, when completing software operation with the test method of probability problem
There is the probabilistic testing of mistake.
Preferably, the runing time node of the software includes that task is completed, task starts, the percentage of task completion rate
The time point that state and multitask occur or complete.
Preferably, the time point that multitask occurs or completes is divided into interval, concurrently or consecutively.
Preferably, the marginal testing or limit test include test under the conditions of operating in critical environment to software,
Operate in the test under the conditions of critical tasks and the test under faulty operation method.
Preferably, the running environment of the equipment of equipment when the critical environment condition includes software operation, such as CPU maximum work
Running environment when running environment or memory size critical point under rate.
Preferably, the probabilistic testing that the test method with probability problem includes one, goes wrong, two pairs of appearance are general
Rate problem is tested by the test case in test document, until the discovery of bug proposes, analysis is assessed, distributes solution, really
Recognize solution situation.
A kind of software testing device, including computer box are connected with peak value converter, exception on the computer box
Event generator and functional analysis device, the peak value converter are used for the affairs of each affairs when the number of users of simulation softward peak period
The affairs of software are rung when whether the response time can satisfy requirement of the client to maximum number of concurrent, certain amount user runs together
Between seasonable, test software automatically processes function, the function point when the anomalous event generator is used to simulate anomalous event
The simulated implementation of each function of the software that parser is used for and analysis.
Preferably, event input module and maximum concurrent input module simultaneously are provided on the peak value converter, it is described
Input module and maximum concurrent input module are simultaneously operable event simultaneously, and input module imitates event case to the event simultaneously
It inputs simultaneously, the maximum concurrent input module simulates the input in the case of maximum number of concurrent.
Preferably, the anomalous event includes false command action event and normal server function damage event.
Preferably, the functional analysis device can realize multiple functions while simulate.
Embodiment:
Test is completed using the method for the test interrupted on software runing time node, for a user, in the use of product
It inevitably will appear some interruptions that fail to predict in the process, therefore the design of a software will be in view of in these
Disconnected influence, and we also just must carry out various interrupt tests to software during the test.Interrupt test is one in test
Kind commonly used test method, interrupt test are to guarantee an important means of software function and performance, in actual test in
It is disconnected to test some problems being all easily found in software.
By simulating some abnormal conditions (such as server powers off suddenly, network interruption, server hard disc insufficient space etc.),
Whether verifying software program has the mechanism of automatically processing, to ensure that software operates normally or restore fortune when these situations occur
Row..If HA(automated disaster recovery software) it is available, other surveys can be executed exclusively for these automatic protection softwares
Examination, to verify them whether can effectively trigger protection measure.
Test is completed under multitask, multitask test is also the one aspect that must take into account in software test procedure,
In multitask test, it is easy to occur it is some crash, certain functions such as can not normally realize at the situations.We are carrying out multitask
Not only to be held when test these functions can normally realize also to see either with or without some other problem occur.
Test is completed in marginal testing or limit test, it is well known that the number of users of software peak period can be verified each
Whether the transaction response time of affairs can satisfy requirement (by peak value convert) of the client to maximum number of concurrent.In this pressure
Under power, whether the performance indicator of software is still in range of normal value.Whether software function can cause bad anti-because of such pressure
It answers (such as: delay machine, exception error rate raising etc.).
Ramp up incremental design:
If there is 75 concurrent users, then the software has 1,500 registration users, and 5%-7% is used to refer to as concurrent user
Value.In general, the design of boost motor is completed by every 15 seconds 5 people of loading.This value refers mainly to the performance of compressor, and
Recommendation is run multiple times.Actual loaded mode is measured by affairs percent of pass and error rate.
Ramp Up incremental design target:
The position for finding out pressurization software performance bottleneck, the opportunity for catching performance inflection point to occur, refer generally to clicking rate and handling capacity,
The comprehensive descision that CPU, memory use.Simulate peak service condition, such as morning log in, come off duty backed off after random, pay out wages when information software
Deng.
Another limit emulation can be regarded as under surge pressure while clicking the limit operation index of transaction operation, together
When discharge all user in operation.
Complete occur the probabilistic testing of mistake when software operation with the test method of probability problem, probability problem is one
A troublesome problem, but exactly the presence of this problem affects the performance of our products, justs think, software is working
During occur crashing suddenly or the phenomenon that restarting will allow user to have what kind of impression!The production small for one is flat
Fortunately, if arriving aerospace, financial system greatly, if occurring such problems in operation, it will be how after one
Fruit.Disaster!
The number of users in peak period when known software is run, the frequency etc. of each transaction.Design comprehensive test scene.It is surveying
The case where when examination, each scene will be run together according to a certain number of people, and analog subscriber uses the several years.And dduring test
Whether the performance indicator of monitoring software can keep normal value at such pressures.Whether the response time trade with the testing time
And fluctuate or increase, whether software will appear shutdown, the abnormal conditions such as application program suspension dduring test.
According to above-mentioned test, the position of performance inflection point is appeared under each transaction conditions, with determine stability test and
Hair amount.It is final concurrent according to actual test server (compressor, apps server, data server performance) estimation
Number of users.
It is tested by original bill example or micro-judgment there are the modules of problem or doubtful hidden danger to carry out validation test in software
Demonstrate,prove whether these modules also occur that identical performance issue.It goes wrong for example, software control motor swings module operation, just
This part program can be recalled to test, see whether the problem of software executes.
By testing above or user's practical operation, discovery or suspect in software there are performance issue, needs to pass through response
Test scene is reappeared or is defined.If it is possible, the code or module of performance issue can be caused with Direct Recognition.This test
Mainly by the scene to go wrong in test script scene, discovery and detection instrument can be added, such as opens Tivoli
Can monitor, open HeapDump output, Linux monitoring resource order etc., and manual test is carried out in scene operational process
It assists.
Finally assessment is the dependence test for obtaining software Key Performance Indicator point.It is primarily directed to not have in advance
Specific expected test result, but need specific to obtain by test (such as transaction response time, maximum concurrent user number)
Performance indicator under pressure scene.
The assessment transaction response time: test activity is executed to obtain the response time of affairs under specified pressure.Pass through simulation
The pressure value or expecting pressure value of known client's peak value obtain response time of transaction under such pressure.
The maximum concurrent user number of affairs a: test activity is assessed, it can be in specific software environment to obtain affairs
The maximum concurrent user number of receiving.By simulation true environment or directly using true environment, enterprise is had evaluated in this environment
Under the maximum concurrent user number that is able to bear.Level threshold value needs pre-defined (for example, response time, CPU usage, memory
Utilization rate, peak value clicking rate, peak throughput etc.).
Assess the maximum concurrent user number of software: test activity is to obtain the maximum concurrent user that entire software can bear
Number.By the utilization rate and frequency of each main modular of preparatory analysis project, define the ratio of affairs in Integrated scenario, and with than
Example mode distributes the quantity of the concurrent user of each affairs.Simulation true environment is directly existed using true environment to assess software
The maximum quantity for the concurrent user being able to bear under this environment.Predefining level threshold value, (between responding, CPU usage is interior
Occupancy is deposited, clicking rate peak value has occurred, throughput peaks etc. has occurred).Value standard is based on regular (the minimum concurrent transaction of bucket
It is the number of concurrent of entire software).
Assess influence of the disparate databases data volume to performance: test is compared in the test for disparate databases data volume
As a result, simultaneously influence of the data volume of each table to affairs performance in analytical database.Software long-play can be predefined
Hidden danger that may be present when afterwards or certain module needs mass data.
The above assessment may serve to the interface reasonability of test software and call the reasonability of memory.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although with reference to the foregoing embodiments
Invention is explained in detail, those skilled in the art should understand that: it still can be to aforementioned each implementation
Technical solution documented by example is modified or equivalent replacement of some of the technical features；And these modification or
Replacement, the spirit and scope for technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution.
Claims (10)
1. a kind of method for testing software, it is characterised in that: the test of test and memory including user interface further includes following survey
Method for testing: one, the method on software runing time node using the test interrupted completes test, and two, complete under multitask
Test, three, marginal testing or limit test complete test, four, under the external environment of software difference operation to software repeatedly
The test for the step of completing above-mentioned one, two, three, five, with probability problem test method complete software operation when there is mistake
Probabilistic testing.
2. method for testing software as described in claim 1 and software testing device, it is characterised in that: when the operation of the software
Intermediate node include task complete, task start, the percentage number state of task completion rate and multitask occur or complete when
Between point.
3. method for testing software as described in claim 1 and software testing device are it is characterized by: multitask generation or complete
At time point be divided into interval, concurrently or consecutively.
4. method for testing software as described in claim 1 and software testing device, it is characterised in that: the marginal testing or
Limit test include test under the conditions of operating in critical environment to software, operate in test under the conditions of critical tasks and
Test under faulty operation method.
5. method for testing software as claimed in claim 4 and software testing device, it is characterised in that: the critical environment condition
The running environment of equipment when including software operation, fortune when such as running environment or memory size critical point under CPU maximum power
Row environment.
6. method for testing software as described in claim 1 and software testing device, it is characterised in that: described to use probability problem
The test method probabilistic testing that includes one, go wrong, two pairs of probability of occurrence problems pass through the test case in test document
It is tested, until the discovery of bug proposes, analysis assessment, distribution solves, confirmation solves situation.
7. a kind of software testing device, it is characterised in that: including computer box, peak value is connected on the computer box and is turned
Parallel operation, anomalous event generator and functional analysis device, the peak value converter are used for each when the number of users of simulation softward peak period
It is soft when whether the transaction response time of affairs can satisfy requirement of the client to maximum number of concurrent, certain amount user runs together
The transaction response time of part, what the anomalous event generator was used for test software when simulating anomalous event automatically processes function,
The simulated implementation for each function of software that the functional analysis device is used for and analysis.
8. software testing device as claimed in claim 7, it is characterised in that: be provided with event simultaneously on the peak value converter
Input module and maximum concurrent input module, input module and maximum concurrent input module are simultaneously operable the event simultaneously,
Input module imitation event case inputs the event simultaneously simultaneously, and the maximum concurrent input module simulates maximum number of concurrent feelings
Input under condition.
9. software testing device as claimed in claim 7, it is characterised in that: the anomalous event includes false command operation thing
Part and normal server function damage event.
10. software testing device as claimed in claim 7, it is characterised in that: the functional analysis device can realize multiple functions
It simulates simultaneously.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910693684.0A CN110297778A (en) | 2019-07-30 | 2019-07-30 | A kind of method for testing software and software testing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910693684.0A CN110297778A (en) | 2019-07-30 | 2019-07-30 | A kind of method for testing software and software testing device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110297778A true CN110297778A (en) | 2019-10-01 |
Family
ID=68032175
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910693684.0A Withdrawn CN110297778A (en) | 2019-07-30 | 2019-07-30 | A kind of method for testing software and software testing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110297778A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116048049A (en) * | 2023-01-18 | 2023-05-02 | 重庆长安汽车股份有限公司 | Diagnostic optimization method, device, equipment and medium for automobile ECU software system |
| CN116450512A (en) * | 2023-04-11 | 2023-07-18 | 深圳市蓝鲸智联科技有限公司 | Software testing method and software testing device |
-
2019
- 2019-07-30 CN CN201910693684.0A patent/CN110297778A/en not_active Withdrawn
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116048049A (en) * | 2023-01-18 | 2023-05-02 | 重庆长安汽车股份有限公司 | Diagnostic optimization method, device, equipment and medium for automobile ECU software system |
| CN116048049B (en) * | 2023-01-18 | 2024-05-14 | 重庆长安汽车股份有限公司 | Diagnostic optimization method, device, equipment and medium for automobile ECU software system |
| CN116450512A (en) * | 2023-04-11 | 2023-07-18 | 深圳市蓝鲸智联科技有限公司 | Software testing method and software testing device |
| CN116450512B (en) * | 2023-04-11 | 2024-03-29 | 深圳市蓝鲸智联科技股份有限公司 | Software testing method and software testing device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7093238B2 (en) | Automated software testing and validation system | |
| Kiciman et al. | Detecting application-level failures in component-based internet services | |
| US5303166A (en) | Method and system for automated network benchmark performance analysis | |
| CN112052172B (en) | Rapid test method and device for third-party channel and electronic equipment | |
| CN112395177A (en) | Interactive processing method, device and equipment of service data and storage medium | |
| CN105045574A (en) | Software key function identification method based on complex network fault propagation | |
| CN111679977B (en) | Method, equipment and storage medium for testing exact project unit based on Jest | |
| CN109783260A (en) | Intelligent IT whole process O&M method, apparatus, equipment and readable storage medium storing program for executing | |
| CN110765189A (en) | Exception management method and system for Internet products | |
| CN110297778A (en) | A kind of method for testing software and software testing device | |
| EP3734460B1 (en) | Probabilistic software testing via dynamic graphs | |
| CN111459809A (en) | Software testing method based on rapid demand version iteration | |
| CN101098259A (en) | Automatized test method and system for implementing large data impact | |
| CN114036034A (en) | Performance test method applied to real-time streaming computation | |
| CN113961465A (en) | Method, device and program product for processing reproduction of program crash scene | |
| CN111639022A (en) | Transaction testing method and device, storage medium and electronic device | |
| CN117056218A (en) | Test management method, platform, medium and equipment | |
| CN116860624A (en) | Automatic performance test method based on Jmeter | |
| CN114637685A (en) | Performance test method, device, equipment and medium of application program in bank system | |
| CN112905445B (en) | Log-based test method, device and computer system | |
| CN113590440A (en) | Pressure testing method, device, equipment and medium for bank core system | |
| Kuhn et al. | Advanced combinatorial test methods for system reliability | |
| CN102982231A (en) | Quantitative calculation method for software confidence level | |
| CN110362464A (en) | Software analysis method and equipment | |
| Khan et al. | Smoke testing of web application based on ALM tool |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20191001 |