CN107992405A - application software testing method and device - Google Patents
application software testing method and device Download PDFInfo
- Publication number
- CN107992405A CN107992405A CN201610954519.2A CN201610954519A CN107992405A CN 107992405 A CN107992405 A CN 107992405A CN 201610954519 A CN201610954519 A CN 201610954519A CN 107992405 A CN107992405 A CN 107992405A
- Authority
- CN
- China
- Prior art keywords
- application software
- test
- tested
- output valve
- software system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000013522 software testing Methods 0.000 title claims abstract description 35
- 238000012360 testing method Methods 0.000 claims abstract description 246
- 230000002159 abnormal effect Effects 0.000 claims abstract description 45
- 230000008569 process Effects 0.000 claims description 13
- 238000005259 measurement Methods 0.000 abstract description 2
- 241001269238 Data Species 0.000 description 4
- 230000015556 catabolic process Effects 0.000 description 4
- 238000005457 optimization Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a kind of application software testing method and apparatus, belong to technical field of measurement and test.This method includes：The reasonable interval of the test output valve of tested application software system is obtained, the reasonable interval is analyzed to obtain according to the test output valve for repeatedly carrying out automatic test to being tested application software system；Tested application software system is tested using acquired reasonable interval；Judge whether the tested application software system is abnormal according to test result.Thus, it is possible to quickly judge whether tested application software system is abnormal.
Description
Technical field
The present invention relates to technical field of measurement and test, more particularly to application software testing method and device.
Background technology
When carrying out tracing management to another application software using a kind of application software, two kinds of application software one being related to
Kind is known as tracking system, and another kind is known as tracked system.Tracked system is made of many modules (such as micro services).Namely
Say, tracking system is used for tracked system into line trace, to manage the function of tracked system modules.
When being tested for the application software system being made of the tracking system and tracked system, due to by with
The internal module source code and mutual call relation of track system are unknown, problem is encountered that to being traced a certain of system
A module is tested, when such as testing the called number in some period of some module, except user initiates in itself
Calling to cause the call number of the module to increase outer, if the tracked several function modules of internal system some or certain are also being adjusted
With the module, then call number increase is also resulted in.Obtained call number be two types call number and.Testing
When one disturbance of input, obtained result is not but the superposition of the result of multiple disturbances as caused by this individually disturbance,
It is independent one disturbance caused by the result is that obtain less than.
For example it is assumed that being traced the X services of system in test application software systems, user inputs a value A0, it is expected to obtain
Output valve R must be returned0.But due to when the application software works normally, there is other services, such as Y services, Z are serviced,
This X service to be tested is being called, the input of wherein Y services is Y0, the input of Z services is Z0, cause the test output valve obtained
R is input value A0、Y0、Z0It is coefficient as a result, being not directly available R0.Due at different moments, being called at the same time in application software
The quantity of service and frequency of X services are all unknowable, and the output valve R for causing to obtain every time is nor fixed value.
Therefore, the existing mode tested application software system is surveyed because can not get caused by individually disturbance
Test result, it is impossible to rapidly judge whether test result is normal, abnormal cause can not be quickly found out when test result is abnormal.
The content of the invention
In view of this, it is an object of the invention to provide a kind of application software testing method and device, to solve at least one
A above-mentioned technical problem.
To achieve the above object, the present invention provides a kind of application software testing method, and the method comprising the steps of：Obtain tested
The reasonable interval of the test output valve of application software system, the reasonable interval is according to repeatedly to tested application software system progress
The test output valve of automatic test is analyzed to obtain；Tested application software system is surveyed using acquired reasonable interval
Examination；Judge whether the tested application software system is abnormal according to test result.
Alternatively, the basis repeatedly analyzes the test output valve for being tested application software system progress automatic test
Process to the reasonable interval specifically includes：The time interval and number of automatic test are set；Every between the set time
Every carrying out automatic test to the tested application software system and obtain test output valve, until reaching set number；
The reasonable interval is obtained according to the test output valve.
Alternatively, described the step of obtaining reasonable interval according to the test output valve, specifically includes：Count described automatic
Change the value range for multiple test output valves that test obtains；Discrete point is removed from the value range；Discrete point will be removed
Value range afterwards is determined as the reasonable interval.
Alternatively, described the step of being tested using acquired reasonable interval tested application software system, is specifically wrapped
Include：The tested application software system is tested, obtains the test output valve of this test；Judge the test output valve
Whether fall in the range of the reasonable interval；When it is described test output valve fall when in the range of the reasonable interval, determine
This time is to pass through to the test result of the tested application software system；When the test output valve is not in the scope of reasonable interval
When interior, it is not pass through to the test result of the tested application software system to determine this time.
Alternatively, this method further includes step：When judging that the tested application software system is abnormal, with reference to institute
State the application software in tested application software system version updating whether occurs and judge abnormal cause.
To achieve the above object, the present invention also proposes a kind of application software testing device, which includes：Acquiring unit,
Reasonable interval for the test output valve for obtaining tested application software system, the reasonable interval is according to repeatedly to tested application
The test output valve that software systems carry out automatic test is analyzed to obtain；Test cell, for using acquired reasonable interval
Tested application software system is tested；And judging unit, for judging the tested application software system according to test result
Whether system is abnormal.
Alternatively, which further includes：Setting unit, for setting the time interval and number of automatic test；It is described
Test cell is additionally operable to every set time interval, is carried out automatic test to the tested application software system and is surveyed
Output valve is tried, until reaching set number；Analytic unit, for obtaining the Reasonable area according to the test output valve
Between.
Alternatively, the analytic unit is specifically included according to the process that the test output valve obtains reasonable interval：Statistics
The value range for multiple test output valves that the automatic test obtains；Discrete point is removed from the value range；It will go
Except the value range after discrete point is determined as the reasonable interval.
Alternatively, the mistake that the reasonable interval acquired in the test cell use is tested being tested application software system
Journey specifically includes：The tested application software system is tested, obtains the test output valve of this test；Judge the survey
Whether examination output valve falls in the range of the reasonable interval；When the test output valve falls in the range of the reasonable interval
When, it is to pass through to the test result of the tested application software system to determine this time；When the test output valve is not in Reasonable area
Between in the range of when, determine this time to the test result of the tested application software system not pass through.
Alternatively, the judging unit is additionally operable to when judging that the tested application software system is abnormal, with reference to
Whether the application software in the tested application software system, which occurs version updating, judges abnormal cause.
Application software testing method and device proposed by the present invention, the Reasonable area of test output valve is obtained by repeatedly testing
Between, then judged subsequently to being tested the testing whether by and then judging tested of application software system according to the reasonable interval
Whether application software system is abnormal and abnormal cause.
Its advantage is mainly reflected in following two aspects：To tracking system in itself for, regression test can be used as
A kind of mode, after in itself version updating occurs for tracking system, by testing whether output valve falls in the range of reasonable interval
It can verify whether the version updating exception occurs；If application software (tracking system) is used for managing another money application software (quilt
Tracking system), for tracked system, when tracking system does not update, if test output valve does not fall within reasonable interval
In the range of, then may determine that is tracked system there occurs update abnormal or failure occurs.Furthermore it is also possible to combine tracking system
Other following functions in system, find specific abnormal position in tracked system, and then to fix a breakdown or optimization system
Data are provided to support.
Brief description of the drawings
Fig. 1 is a kind of environment architecture figure for the application software testing device for realizing each embodiment of the present invention.
Fig. 2 is the schematic diagram of call relation between a kind of micro services in the present invention.
Fig. 3 is a kind of module diagram for application software testing device that first embodiment of the invention proposes.
Fig. 4 is a kind of flow chart for application software testing method that second embodiment of the invention proposes.
Fig. 5 is a kind of flow chart for application software testing method that third embodiment of the invention proposes.
Fig. 6 is a kind of flow chart for application software testing method that fourth embodiment of the invention proposes.
Fig. 7 is the specific refined flow chart of the step S602 in Fig. 6.
Fig. 8 is the specific refined flow chart of the step S604 in Fig. 6.
Fig. 9 is the specific refined flow chart of the step S608 and S610 in Fig. 6.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Embodiment
In order to make technical problems, technical solutions and advantages to be solved clearer, clear, tie below
Drawings and examples are closed, the present invention will be described in further detail.It should be appreciated that specific embodiment described herein is only
To explain the present invention, it is not intended to limit the present invention.
As shown in Figure 1, to realize a kind of environment architecture of application software testing device 100 of each embodiment of the present invention
Figure.The application software testing device 100 is deployed in server or other suitable hardware structures.
The application software testing device 100 is used to test tested application software system 120.Tested application software
System 120 can be the public system of an application software or multiple application software composition.In the present embodiment, institute
Stating tested application software system 120 includes tracking system 122 and tracked system 124, and the tracked system 124 includes multiple
Micro services 126.
During application software testing device 100 tests tested application software system 120, system is traced
Mutual calling is also likely to be present between the multiple micro services 126 inside 124.
By taking 126 call relations of micro services shown in Fig. 2 as an example, in tracked system 124, micro services A is except can be with
It is outer by client call execution, it can also be called by micro services B and micro services C, micro services A can also call database, client
End, micro services B and micro services C cannot directly invoke database, and need to call database by micro services A and return the result.
First embodiment
As shown in figure 3, first embodiment of the invention proposes a kind of application software testing device 100.
In the present embodiment, the application software testing device 100 includes setting unit 102, test cell 104, analysis
Unit 106, acquiring unit 108 and judging unit 110.
The setting unit 102 is used to set the time interval that automatic test is carried out to being tested application software system 120
And number.
For example, the time interval of the automatic test is arranged to 15 minutes, number is arranged to 10,000 times.
The test cell 104 is used for every set time interval, and the tested application software system 120 is carried out certainly
Dynamicization tests and obtains test output valve, until reaching set number.
The analytic unit 106 is used to obtain the reasonable interval according to the test output valve.
Specifically, test cell 104 carries out automatic test to tested application software system 120 every time, can obtain one
A test output valve, analytic unit 106 obtains a large amount of test output Value Datas from multiple automatic test, then to output valve
Data are analyzed, and obtain the reasonable interval of test output Value Data.
The detailed process that analytic unit 106 obtains the reasonable interval includes：Count the automatic test obtain it is more
The value range of a test output valve；Discrete point is removed from the value range；Value range after removal discrete point is true
It is set to the reasonable interval.The discrete point is substantially different from the abnormal number of most of test output valve in the value range
According to.
For example, by having carried out 20000 automatic tests to tested application software system 120,20000 tests are obtained
Output valve.To this 20000 test output Data-Statistics value ranges, discovery wherein has 19998 in the range of [4,7], also has 2
A test output valve is respectively 14 and 16.Above-mentioned 2 tests output valve 14 and 16 is discrete point, it is necessary to from the value range
Middle removal.After discrete point 14 and 16 are removed, obtained value range [4,7] is the tested application software system 120
Test the corresponding reasonable interval of output valve.
The acquiring unit 108 is used for the reasonable interval for obtaining the test output valve of tested application software system 120.
Specifically, the reasonable interval that analytic unit 106 obtains can be saved in database storage region, when follow-up
When needing to test tested application software system 120, acquiring unit 108 obtains the tested application software from the database
120 corresponding reasonable interval of system.
The test cell 104 is also used for acquired reasonable interval and tested application software system 120 is surveyed
Examination.
Specifically, test cell 104 tests the tested application software system 120, obtains the survey of this test
Try output valve.Then judge whether the test output valve falls in the range of the reasonable interval.When the test output valve
Fall when in the range of the reasonable interval, test cell 104 determines test of this time to the tested application software system 120
As a result it is to pass through.When the test output valve is not when in the range of reasonable interval, test cell 104 determines this time to the quilt
The test result for surveying application software system 120 is not pass through.
The judging unit 110 is different for judging whether the tested application software system 120 occurs according to test result
Often.
Specifically, when this test result be by when, judging unit 110 judges the tested application software system not
It is abnormal.When the result of this test is obstructed out-of-date, it is different that judging unit 110 judges that the tested application software system occurs
Often.
Further, the judging unit 110, which is additionally operable to work as, judges that the tested application software system 120 is abnormal
When, judge abnormal cause with reference to whether the application software in the tested application software system 120 occurs version updating.
Specifically, whether the application software occurs whether version updating can occur version more including tracking system 122
Newly, it is traced whether system 124 occurs version updating.When version updating occurs for tracking system 122, the abnormal cause may
It is 122 version updating exception of tracking system or breaks down.When version updating does not occur for tracking system 122 and tracked system
During 124 generation version updating, the abnormal cause is probably tracked 124 version updating exception of system or breaks down.In addition,
Other following functions in tracking system 122 are can be combined with, find specific abnormal position in tracked system 124, into
And for fix a breakdown or optimization system provide data support.
Second embodiment
As shown in figure 4, second embodiment of the invention proposes a kind of application software testing method.The method comprising the steps of：
S400, obtains the reasonable interval of the test output valve of tested application software system.
Specifically, the reasonable interval is exported according to the test that automatic test is repeatedly carried out to being tested application software system
Value analysis obtains.A large amount of test output Value Datas are obtained i.e. from multiple automatic test, then output Value Data is divided
Analysis, obtains the reasonable interval of test output Value Data.The definite needs of the reasonable interval do substantial amounts of automatic test to obtain
, the execution number of the present embodiment is at least more than 10,000 times.It is described when sampling number (automatic test number) is enough
Reasonable interval also gets over approaching to reality value.For example, having carried out 20000 automatic tests to tested application software system, obtain
There are 19998 in the range of [4,7] in test output valve, then it represents that be [4,7] the test output of the tested application software system
It is worth corresponding reasonable interval.
S402, tests tested application software system using acquired reasonable interval.
Specifically, after the reasonable interval is got, tested application software system can accordingly be tested, is obtained
The test output valve of this test, then judges whether the test output valve falls in the range of the reasonable interval.Work as institute
State test output valve and fall when in the range of the reasonable interval, to determine test knot of this time to the tested application software system
Fruit is to pass through.When it is described test output valve not when in the range of reasonable interval, determine this time to the tested application software system
The test result of system is not pass through.
S404, judges whether the tested application software system is abnormal according to test result.
Specifically, when this test result be by when, judge the tested application software system no exceptions.When
The result of this test is obstructed out-of-date, judges that the tested application software system is abnormal.
3rd embodiment
As shown in figure 5, third embodiment of the invention proposes a kind of application software testing method.This method passes through repeatedly to quilt
Survey application software system carry out automatic test, obtain test output valve reasonable interval, then according to the reasonable interval come pair
Subsequently tested application software system is tested.
S500, the reasonable interval of test output valve is obtained by multiple automatic test.
Specifically, the time interval and number of automatic test can be set, according to set time interval to tested
Application software system carries out automatic test, until reaching set number.Big measure is obtained from multiple automatic test
Examination output Value Data, then analyzes output Value Data, obtains the reasonable interval of test output Value Data.The Reasonable area
Between definite needs do substantial amounts of automatic test to obtain, the execution number of the present embodiment is at least more than 10,000 times.Work as sampling
When number (automatic test number) is enough, the reasonable interval also gets over approaching to reality value.
In the present embodiment, the test output valve is the tested micro services of some being tested in application software system pre-
The called number fixed time in section.It is worth noting that, in other embodiments, the test output valve can also be other
The output result of test event.
S502, tests tested application software system, judges that this time tests whether to pass through according to the reasonable interval.
Specifically, obtain the call number of tested micro services for the first time in first time point, then initiate once to the quilt
The calling of micrometer service, the call number of the tested micro services, the tune that will be got twice are obtained at the second time point for the second time
Destination file is write with number.Calculate second of call number obtained and the difference of the call number obtained for the first time
Value, the difference is the test output valve of this test.When the difference falls when in the range of the reasonable interval, judge
This time is to pass through to the test result for being tested micro services.When the difference is not when in the range of the reasonable interval, judge
This time is not pass through to the test result for being tested micro services.
S504, tests whether by judging whether the tested application software system is abnormal according to this time.
Specifically, when this test result be by when, judge the tested application software system no exceptions.When
The result of this test is obstructed out-of-date, judges that the tested application software system is abnormal.
Further, this method further includes step：
Whether S506, when judging to be abnormal, occur version with reference to the application software in tested application software system
Renewal judges abnormal cause.
In the present embodiment, the application software in the tested application software system includes tracking system and tracked system
System.Therefore, whether the application software occurs whether version updating can occur version updating, tracked system including tracking system
Whether system occurs version updating.When tracking system occur version updating when, the abnormal cause be probably tracking system version more
New exception breaks down.When version updating does not occur for tracking system and version updating occurs for tracked system, the exception
Reason is probably tracked system version update abnormal or breaks down.Furthermore it is also possible to reference in tracking system other with
Track function, finds specific abnormal position in tracked system, and then to fix a breakdown or optimization system provides data and supports.
Fourth embodiment
As shown in fig. 6, fourth embodiment of the invention proposes a kind of application software testing method, including obtain reasonable interval
Process and the process tested using the reasonable interval.
This method comprises the following steps：
S600, sets the time interval and number of automatic test.
For example, the time interval of the automatic test is arranged to 15 minutes, number is arranged to 10,000 times.
S602, every set time interval, automatic test is carried out to tested application software system, set until reaching
The number put.
For example, as shown in fig.7, specific refined flow chart for the step S602.The flow includes step：
S700, sets the time interval and number of automatic test.
S702, judges the time interval set by current whether reach.If so, then perform step S704.If it is not, then continue
Wait.
S704, carries out an automatic test to tested application software system, obtains test output valve.
S706, judges whether the number of automatic test reaches set number.If so, then flow terminates.If it is not, then
The step S702 is returned, automatic test next time is performed after waiting set time interval.
Fig. 6, step S604 are returned to, reasonable interval is obtained according to the test output valve of the automatic test of set number.
Specifically, automatic test is carried out to tested application software system every time, a test output valve can be obtained, from
A large amount of test output Value Datas are obtained in multiple automatic test, then output Value Data is analyzed, obtain test output
The reasonable interval of Value Data.
Micro services are tested by some in tested application software system of the test output valve within a predetermined period of time
Called number exemplified by.By the analysis to a large amount of test output Value Datas, can obtain in almost identical period Δ t
It is interior, the reasonable interval [a, b] of call number.Wherein, a is the reasonable value lower limit of output valve, and b is on the reasonable value of output valve
Limit, such as [4,7].Due to reasons such as network delays, it can only ensure that each interlude section Δ t is about the same.According to
Test result, the difference of Δ t is very small, this small difference will not cause substantial amounts of call number to produce, therefore will not
Influence test data accuracy.The definite needs of the reasonable interval do substantial amounts of automatic test to obtain, the present embodiment
Number is performed at least more than 10,000 times.When sampling number (automatic test number) is enough, the reasonable interval is also more forced
Nearly actual value.
As shown in fig.8, the specific refined flow chart for the step S604.The flow includes step：
S800, counts the value range for multiple test output valves that the automatic test obtains.
For example, by having carried out 20000 automatic tests to tested application software system, it is defeated to obtain 20000 tests
Go out value.To this 20000 test output Data-Statistics value ranges, discovery wherein has 19998 in the range of [4,7], also has 2
It is respectively 14 and 16 to test output valve.
S802, discrete point is removed from the value range.
Specifically, the discrete point is substantially different from the abnormal number of most of test output valve in the value range
According to.For example, above-mentioned 2 tests output valve 14 and 16 as discrete point from the value range, it is necessary to remove.
S804, is determined as the reasonable interval by the value range after removal discrete point.
Specifically, from the value range for multiple test output valves that the automatic test obtains remove discrete point it
Afterwards, the remaining corresponding reasonable interval of test output valve for being this and being tested application software system.For example, above-mentioned value range is gone
After discrete point 14 and 16, obtained value range [4,7] is the test output valve correspondence of the tested application software system
Reasonable interval.
Above-mentioned steps S600-S604 is the process for obtaining reasonable interval, using the reasonable interval, can subsequently carried out
Whether fallen in the range of the reasonable interval according to test output valve during application software testing, judgement tests whether to pass through.That is,
Further, the application software testing method further includes the process tested using the reasonable interval, which specifically wraps
Include step：
S608, test is performed to tested application software system.
In the present embodiment, the test output valve is the tested micro services of some being tested in application software system pre-
The called number fixed time in section.It is worth noting that, in other embodiments, the test output valve can also be other
The output result of test event.
Specifically, obtain the call number of tested micro services for the first time in first time point, then initiate once to the quilt
The calling of micrometer service, the call number of the tested micro services, the tune that will be got twice are obtained at the second time point for the second time
Destination file is write with number.It is t in the time for example, for the micro services A in Fig. 21When obtain micro services A's for the first time
Called number statistics is calls_before, is then initiated once to the calling of micro services A.It is t when the time2(t2>t1) when,
Second of called number statistics for obtaining micro services A is calls_after, by calls_before and calls_after numbers
According to writing destination file.
S610, judges that this time tests whether to pass through according to the reasonable interval.
Specifically, second of call number obtained and the difference of the call number obtained for the first time are calculated, is
The test output valve of this test.When the difference falls when in the range of the reasonable interval, judge this time to this by micrometer
The test result of service is to pass through.When the difference is not when in the range of the reasonable interval, judge this time to this by micrometer
The test result of service is not pass through.For example, it is assumed that the reasonable of the test output valve that automatic test obtains is carried out to micro services A
Section is [Δ callsmin, Δ callsmax], when the value of Δ calls=calls_after-calls_before fall it is reasonable at this
When in the range of section, this test passes through, and when the value of Δ calls is not when in the range of the reasonable interval, this test is not
Pass through.
It is the specific refined flow chart of the step S608 and S610 refering to described in Fig. 9.The flow includes step：
S900, the call number of tested micro services is obtained in first time point for the first time.
S902, initiates once to be tested this calling of micro services.
S904, the call number of the tested micro services is obtained at the second time point for the second time.
S906, destination file is write by the call number got twice.
S908, calculates second of call number obtained and the difference of the call number obtained for the first time.
S910, judges whether the difference falls in the range of reasonable interval.If so, then perform step S912.If it is not, then
Perform step S914.
S912, it is to pass through to the test result for being tested micro services to determine this time.
S914, it is not pass through to the test result for being tested micro services to determine this time.
Fig. 6, step S612 are returned to, is tested whether according to this time by judging whether the tested application software system is sent out
It is raw abnormal.
Specifically, when this test result be by when, judge the tested application software system no exceptions.When
The result of this test is obstructed out-of-date, judges that the tested application software system is abnormal.
Whether S614, when judging to be abnormal, occur version with reference to the application software in tested application software system
Renewal judges abnormal cause.
In the present embodiment, the application software in the tested application software system includes tracking system and tracked system
System.Therefore, whether the application software occurs whether version updating can occur version updating, tracked system including tracking system
Whether system occurs version updating.When tracking system occur version updating when, the abnormal cause be probably tracking system version more
New exception breaks down.When version updating does not occur for tracking system and version updating occurs for tracked system, the exception
Reason is probably tracked system version update abnormal or breaks down.
For example, tracking system is APM (Application Performance Management, application performance management) system
System, tracked system is EMS (Element Management System, Element management system) system, by repeatedly testing
The reasonable interval arrived is [4,7].
In exception call scene one, system normal use is traced, not more new version, it is assumed that developer changes tracking system
The code of system, the fresh code being incorporated into is problematic, and except tested micro services A, other micro services are all tracked less than then client
Hold to the call number of micro services A is each increase by 1.Test client calls micro services A output Value Data twice, obtains
Output valve be 2, not in the range of reasonable interval [4,7], but fall on the left side of reasonable interval.From this it can be concluded that
To tracking system in itself for, application software testing method proposed by the present invention can as one kind of regression testing method, when
After the renewal of tracking system iteration itself, more new version function can be verified.
In exception call scene two, micro services A is uninterruptedly called in other module endless loops.Test client calls micro services
The output Value Data of A, obtained output valve are 64 and 69, are not fallen within the range of reasonable interval [4,7], but fall in the conjunction
Manage the right in section.It is hereby achieved that conclusion, when tracking system is not changed in itself, if test output valve is not fallen within
In the range of reasonable interval, then may determine that it is that tracked system is changed.
And for example, tracking system is APM systems, to alert micro services system as tracked system, under normal circumstances, inquiry
Once, then user adds 1 to history alarm to the call number of micro services fm-history.That is, test output valve is reasonable
Section is fixed value, i.e. [1,1].
Under exception call scene, it is assumed that the version updating of alarm micro services system introduces problem, as there is module in inside
(or service) calls query history alarm micro services incessantly.Test client calls the output of query history alarm micro services
Value Data, obtained output valve are 12 and 14, are not fallen within the range of reasonable interval [1,1], but fall in the reasonable interval
The right.
Therefore, the chief value of this method is embodied in following two aspects：To tracking system in itself for, can be used as back
Return a kind of mode of test, after in itself version updating occurs for tracking system, by testing whether output valve falls in reasonable interval
In the range of can verify whether the version updating exception occurs；If application software (tracking system) is used for managing another money using soft
Part (tracked system), for tracked system, when tracking system does not update, if test output valve is not fallen within rationally
In interval range, then may determine that is tracked system there occurs update abnormal or failure occurs.With reference to tracked system
Other following functions, such as the track record module of call stack, the specific abnormal position that can find tracked system (goes out event
Barrier module), so for fix a breakdown or optimization system provide data support.
It should be noted that herein, term " comprising ", "comprising" or its any other variant are intended to non-row
His property includes, so that process, method, article or device including a series of elements not only include those key elements, and
And other elements that are not explicitly listed are further included, or further include as this process, method, article or device institute inherently
Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this
Also there are other identical element in the process of key element, method, article or device.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to realized by hardware, but very much
In the case of the former be more preferably embodiment.Based on such understanding, technical scheme is substantially in other words to existing
The part that technology contributes can be embodied in the form of software product, which is stored in a storage
In medium (such as ROM/RAM, magnetic disc, CD), including some instructions are used so that a station terminal equipment (can be mobile phone, calculate
Machine, server, air conditioner, or network equipment etc.) perform method described in each embodiment of the present invention.
Above by reference to the preferred embodiment of the present invention has been illustrated, not thereby limit to the interest field of the present invention.On
State that sequence number of the embodiment of the present invention is for illustration only, do not represent the quality of embodiment.Patrolled in addition, though showing in flow charts
Order is collected, but in some cases, can be with the steps shown or described are performed in an order that is different from the one herein.
Those skilled in the art do not depart from the scope of the present invention and essence, can have a variety of flexible programs to realize the present invention,
It can be used for another embodiment for example as the feature of one embodiment and obtain another embodiment.All technologies with the present invention
The all any modification, equivalent and improvement made within design, should all be within the interest field of the present invention.
Claims (10)
1. a kind of application software testing method, the method comprising the steps of：
The reasonable interval of the test output valve of tested application software system is obtained, the reasonable interval is according to repeatedly to tested application
The test output valve that software systems carry out automatic test is analyzed to obtain；
Tested application software system is tested using acquired reasonable interval；
Judge whether the tested application software system is abnormal according to test result.
2. application software testing method according to claim 1, it is characterised in that the basis is repeatedly soft to tested application
The process that the test output valve of part system progress automatic test analyzes to obtain the reasonable interval specifically includes：
The time interval and number of automatic test are set；
Every set time interval, automatic test is carried out to the tested application software system and obtains test output valve,
Until reaching set number；
The reasonable interval is obtained according to the test output valve.
3. application software testing method according to claim 2, it is characterised in that described to be obtained according to the test output valve
The step of obtaining reasonable interval specifically includes：
Count the value range for multiple test output valves that the automatic test obtains；
Discrete point is removed from the value range；
Value range after removal discrete point is determined as the reasonable interval.
4. application software testing method according to claim 1, it is characterised in that described to use acquired reasonable interval
The step of testing tested application software system specifically includes：
The tested application software system is tested, obtains the test output valve of this test；
Judge whether the test output valve falls in the range of the reasonable interval；
When it is described test output valve fall when in the range of the reasonable interval, determine this time to the tested application software system
Test result to pass through；
When it is described test output valve not when in the range of reasonable interval, determine survey of this time to the tested application software system
Test result is not pass through.
5. application software testing method according to claim 1, it is characterised in that this method further includes step：
It is soft with reference to the application in the tested application software system when judging that the tested application software system is abnormal
Whether part, which occurs version updating, judges abnormal cause.
6. a kind of application software testing device, it is characterised in that the device includes：
Acquiring unit, the reasonable interval of the test output valve for obtaining tested application software system, the reasonable interval according to
The test output valve that automatic test is repeatedly carried out to being tested application software system is analyzed to obtain；
Test cell, for being tested using acquired reasonable interval tested application software system；And
Judging unit, for judging whether the tested application software system is abnormal according to test result.
7. application software testing device according to claim 6, it is characterised in that the device further includes：
Setting unit, for setting the time interval and number of automatic test；
The test cell is additionally operable to every set time interval, and automatic test is carried out to the tested application software system
And test output valve is obtained, until reaching set number；
Analytic unit, for obtaining the reasonable interval according to the test output valve.
8. application software testing device according to claim 7, it is characterised in that the analytic unit is according to the test
The process that output valve obtains reasonable interval specifically includes：
Count the value range for multiple test output valves that the automatic test obtains；
Discrete point is removed from the value range；
Value range after removal discrete point is determined as the reasonable interval.
9. application software testing device according to claim 6, it is characterised in that acquired in the test cell use
Reasonable interval is specifically included to being tested the process that application software system is tested：
The tested application software system is tested, obtains the test output valve of this test；
Judge whether the test output valve falls in the range of the reasonable interval；
When it is described test output valve fall when in the range of the reasonable interval, determine this time to the tested application software system
Test result to pass through；
When it is described test output valve not when in the range of reasonable interval, determine survey of this time to the tested application software system
Test result is not pass through.
10. application software testing device according to claim 6, it is characterised in that the judging unit, which is additionally operable to work as, to be sentenced
Break when the tested application software system and being abnormal, whether sent out with reference to the application software in the tested application software system
Raw version updating judges abnormal cause.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610954519.2A CN107992405A (en) | 2016-10-27 | 2016-10-27 | application software testing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610954519.2A CN107992405A (en) | 2016-10-27 | 2016-10-27 | application software testing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107992405A true CN107992405A (en) | 2018-05-04 |
Family
ID=62028559
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610954519.2A Pending CN107992405A (en) | 2016-10-27 | 2016-10-27 | application software testing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107992405A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20220391305A1 (en) * | 2020-09-22 | 2022-12-08 | Sap Se | Vendor assisted customer individualized testing |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040143819A1 (en) * | 2003-01-10 | 2004-07-22 | National Cheng Kung University | Generic software testing system and mechanism |
| CN1983209A (en) * | 2005-12-14 | 2007-06-20 | 中兴通讯股份有限公司 | System and method for automatically testing software unit |
| CN101699410A (en) * | 2009-11-11 | 2010-04-28 | 中兴通讯股份有限公司 | Single plate hardware fault detection method and device |
| CN101742087A (en) * | 2008-11-05 | 2010-06-16 | 索尼株式会社 | Data processing method and apparatus |
| CN102004688A (en) * | 2009-08-28 | 2011-04-06 | 上海杉达学院 | Boundary value testing method of Web application software |
| CN102662828A (en) * | 2012-03-14 | 2012-09-12 | 浪潮(北京)电子信息产业有限公司 | A method and device for achieving software automatic testing |
| CN103077114A (en) * | 2012-12-27 | 2013-05-01 | 武汉烽火富华电气有限责任公司 | Automatic testing method based on communication protocol of temperature measuring device |
| US20130283099A1 (en) * | 2012-04-23 | 2013-10-24 | Hon Hai Precision Industry Co., Ltd. | System and method for tesing stability of server |
| JP2015011378A (en) * | 2013-06-26 | 2015-01-19 | 株式会社デンソー | Test result display device and test result display program |
-
2016
- 2016-10-27 CN CN201610954519.2A patent/CN107992405A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040143819A1 (en) * | 2003-01-10 | 2004-07-22 | National Cheng Kung University | Generic software testing system and mechanism |
| CN1983209A (en) * | 2005-12-14 | 2007-06-20 | 中兴通讯股份有限公司 | System and method for automatically testing software unit |
| CN101742087A (en) * | 2008-11-05 | 2010-06-16 | 索尼株式会社 | Data processing method and apparatus |
| CN102004688A (en) * | 2009-08-28 | 2011-04-06 | 上海杉达学院 | Boundary value testing method of Web application software |
| CN101699410A (en) * | 2009-11-11 | 2010-04-28 | 中兴通讯股份有限公司 | Single plate hardware fault detection method and device |
| CN102662828A (en) * | 2012-03-14 | 2012-09-12 | 浪潮(北京)电子信息产业有限公司 | A method and device for achieving software automatic testing |
| US20130283099A1 (en) * | 2012-04-23 | 2013-10-24 | Hon Hai Precision Industry Co., Ltd. | System and method for tesing stability of server |
| CN103377115A (en) * | 2012-04-23 | 2013-10-30 | 鸿富锦精密工业（深圳）有限公司 | System event log management system and system event log management method |
| CN103077114A (en) * | 2012-12-27 | 2013-05-01 | 武汉烽火富华电气有限责任公司 | Automatic testing method based on communication protocol of temperature measuring device |
| JP2015011378A (en) * | 2013-06-26 | 2015-01-19 | 株式会社デンソー | Test result display device and test result display program |
Non-Patent Citations (1)
| Title |
|---|
| 段海军: ""航空电子设备自动测试系统的软件架构设计"", 《计算机测量与控制》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20220391305A1 (en) * | 2020-09-22 | 2022-12-08 | Sap Se | Vendor assisted customer individualized testing |
| US11734160B2 (en) * | 2020-09-22 | 2023-08-22 | Sap Se | Vendor assisted customer individualized testing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103577907B (en) | A kind of continuous integrating method of testing and system | |
| CN106102164B (en) | A kind of method and apparatus of determining access point position | |
| US8059788B2 (en) | Telephone software testing system and method | |
| EP1622306A2 (en) | Event and dependency based failure identification management system and method | |
| CN107908543A (en) | Applied program testing method, device, computer equipment and storage medium | |
| Dalal et al. | Some graphical aids for deciding when to stop testing software | |
| CN107273281A (en) | Service interface test method, system based on code change | |
| JP2003161761A (en) | Electronic test apparatus and method for displaying data point value of electronic test | |
| CN106569943A (en) | Hardware testing method and hardware testing system for equipment | |
| CN110389890B (en) | Updating and maintaining method and device for public use case library and computer equipment | |
| CN1804648B (en) | Incremental generation of calibration factors for automated test equipment | |
| CN107992405A (en) | application software testing method and device | |
| CN111897737B (en) | Missing detection method and device for program test of micro-service system | |
| CN106294106A (en) | The method of testing of Web application system and device | |
| CN105319480B (en) | Line diagnosis method and device | |
| CN114138581B (en) | Mainboard test method and system | |
| CN109597744A (en) | Data unusual fluctuation analysis method and device | |
| CN109491900A (en) | Interface test method, device, electronic equipment and computer readable storage medium | |
| CN1167117C (en) | Method and device for testing integrated circuit | |
| KR101403685B1 (en) | System and method for relating between failed component and performance criteria of manintenance rule by using component database of functional importance determination of nuclear power plant | |
| CN108513310A (en) | Virtual road measuring method and device | |
| CN114285756B (en) | Service call dependency analysis method and related device | |
| CN110413516B (en) | Method and device for identifying slow SQL codes and electronic equipment | |
| CN113377399A (en) | Non-stop system drilling verification method and device | |
| KR20050118192A (en) | Method and apparatus for testing a product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200617 Address after: 518057 Zhongxing building, A3-01, A3-02, Nanshan District hi tech Industrial Park, Shenzhen, Guangdong Applicant after: Shenzhen ZTE Technical Service Co.,Ltd. Address before: 518000 Zhongxing building, science and technology south road, Nanshan District hi tech Industrial Park, Guangdong, Shenzhen Applicant before: ZTE Corp. |
|
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180504 |