CN109977017A - A kind of system performance testing case screening method and system - Google Patents
A kind of system performance testing case screening method and system Download PDFInfo
- Publication number
- CN109977017A CN109977017A CN201910244606.2A CN201910244606A CN109977017A CN 109977017 A CN109977017 A CN 109977017A CN 201910244606 A CN201910244606 A CN 201910244606A CN 109977017 A CN109977017 A CN 109977017A
- Authority
- CN
- China
- Prior art keywords
- module
- index
- region
- screening
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
Abstract
The invention discloses a kind of system performance testing case screening methods, comprising: obtains system performance fault-signal；System progress multi-layer is gradually divided and successively each level is screened to obtain problem module；Problem module is screened by presetting method, obtains test case.The present invention carries out level one by one to system by function and divides, form tree, test the minimum unit in the tree combed, find out test case by classifying to system, especially distributed system.Difficulty of test is reduced, testing time is reduced, improves testing efficiency.
Description
Technical field
The present invention relates to system information analysis field, in particular to a kind of system energy-absorbing test case screening method and system.
Background technique
With the development of internet technology, internet device is intended to complication and diversification, the information of Internet enterprises
Change system also gradually develop by the direction of Based on Distributed, high-performance and hardware and software platform.Performance is to evaluate a Xiang Chong of distributed system
Want the major criterion of index and the enterprise consideration when carrying out informatization.Performance test is inherently from test case
Set in choose a part of test case and tested, excavate the principal element for influencing system performance, then system done
Out corresponding modification, adjust with it is perfect.Since the input domain scale of distributed system is big, complexity is high, thinks efficiently to select
Test case is very difficult.Therefore, the key of performance test is while choosing test case as few as possible, as far as possible
The performance deficiency of more exposure systems.How to choose test case just becomes particularly important.
Test case selection method commonly used in the prior art includes choosing method, equivalence class classifying method, boundary values manually
And cause effect graph.But often there is drawbacks for these methods, such as: there are subjectivities for manual constituency method by force, it is biggish blind to refuel
Mesh and uncertain problem；It is determining that equivalence class classifying method has that equivalence relation is difficult to；There is lack for boundary values
Fall into the lower problem of monitoring efficiency；There is the dependences of condition and result to be difficult to the problems such as determining for cause effect graph.
Summary of the invention
(1) goal of the invention
The object of the present invention is to provide a kind of system performance testing case screening method and system, by system, especially
Distributed system is classified, and is carried out level one by one to system by function and is divided, tree is formed, to the tree-shaped knot combed
Minimum unit in structure is tested, and test case is found out.Difficulty of test is reduced, testing efficiency is improved.
(2) technical solution
To solve the above problems, the first aspect of the present invention provides a kind of system performance testing case screening method, comprising:
Obtain system performance fault-signal；System progress multi-layer is gradually divided and successively each level is screened
To problem module；Problem module is screened by presetting method, obtains test case.
Further, system progress multi-layer is gradually divided and successively each level is screened to obtain problem module
Step includes:
System is divided into hardware, software and service sub-system region, based on fault-signal to respectively to region progress
Screening, obtains suspicious region；Suspicious region is divided into multiple functional modules, and functional module is screened, obtains problem
Module.
Further, system is divided into hardware, software and service sub-system region, based on fault-signal to right respectively
The step of region is screened, and suspicious region is obtained include:
Obtain the index parameter in each region；Judge that fault-signal whether there is with index parameter and is overlapped section, if so,
For suspicious region, if it is not, being then non-suspicious region.
Further, system is divided into hardware, software and service sub-system region, based on fault-signal to right respectively
The step of region is screened, and suspicious region is obtained include:
Index parameter includes service index, inquiry index and/processing index.
Service index, the inquiry index of software area and/or the processing in service sub-system region for obtaining hardware area refer to
Mark；Judge fault-signal and service index with the presence or absence of being overlapped section, if so, be the first suspicious region, if it is not, be then it is non-can
With region；Judge that fault-signal whether there is with inquiry index and be overlapped section, if so, being the second suspicious region, if it is not, being then
It is non-can be with region；And/or judge that fault-signal whether there is with processing index and be overlapped section, if so, be third suspicious region,
If it is not, then for it is non-can be with region.
Further, suspicious region is divided into multiple functional modules, and functional module is screened, obtain problem mould
The step of block includes:
First suspicious region includes at least one first functional module, and the corresponding use of each first functional module refers to
Mark；Second suspicious region includes at least one second functional module, and each second functional module corresponding one inquires index；Third
Suspicious region includes at least one third functional module, and each third functional module corresponding one handles index.
Obtain service index corresponding with each functional module, the inquiry index of software area and/or processing index；Judgement weight
The service index in section is closed whether in first threshold section, if so, being first problem module, if it is not, being then non-problems mould
Block；The inquiry index being overlapped in section is judged whether in second threshold section, if so, being Second Problem module, if it is not, being then
Non-problems module.And/or the processing index being overlapped in section is judged whether in third threshold interval, if so, being third problem
Module, if it is not, being then non-problems module.
Further, problem module is screened by presetting method, the step of obtaining test case includes:
Judge whether each problem module is minimum level unit, if so, to each node in it by presetting method into
Row screening, obtains test case；It divides and screened accordingly until forming minimum level list if it is not, then continuing level
Position.Wherein, minimum level unit is the unit that can not carry out level division.
Further, the step of being screened by presetting method to problem module, obtained test case further includes extracting each problem
The node intersected in module only carries out primary screening, screens to other nodes, obtains test case.
Another aspect provides a kind of system performance testing example screening systems, comprising:
Warning module, for obtaining system performance fault-signal and sending；First processing module, for system to be carried out layer
Grade gradually divides and successively screens to obtain problem module to each level；And Second processing module, for being pressed to problem module
Presetting method screening, obtains test case.
Further, first processing module is also used to for system to be divided into hardware, software and service sub-system region, base
In fault-signal to screening respectively to region, suspicious region is obtained；And for suspicious region to be divided into multiple functions
Module, and functional module is screened, obtain problem module.
Further, first processing module includes: the first communication unit, for obtaining the index parameter in each region；The
One processing unit is overlapped section for judging that fault-signal whether there is with index parameter, if so, be suspicious region, if it is not,
It is then non-suspicious region.
Further, index parameter includes service index, inquiry index and/processing index.
First communication unit is also used to obtain the service index of hardware area, the inquiry index of software area and/or business
The processing index in subsystem region；First processing units are also used to judge that fault-signal whether there is with service index and are overlapped area
Between, if so, be the first suspicious region, if it is not, then for it is non-can be with region；It is also used to judge fault-signal and whether inquires index
In the presence of be overlapped section, if so, be the second suspicious region, if it is not, then for it is non-can be with region；And/or for judging fault-signal
With processing index with the presence or absence of being overlapped section, if so, be third suspicious region, if it is not, be then it is non-can be with region.
Further, the first suspicious region includes at least one first functional module, and each first functional module is corresponding
One service index；Second suspicious region includes at least one second functional module, and each second functional module corresponding one is inquired
Index；Third suspicious region includes at least one third functional module, and each third functional module corresponding one handles index.
Second communication unit is also used to obtain the inquiry index of service index corresponding with each functional module, software area
And/or processing index；Whether the second processing unit is also used to judge the service index being overlapped in section in first threshold section
In first threshold range, if so, being first problem module, if it is not, being then non-problems module；It is also used to judge to be overlapped in section
Inquiry index whether within the scope of the second threshold in second threshold section, if so, be Second Problem module, if it is not, being then
Non-problems module；And/or for judge be overlapped section in processing index whether third threshold interval third threshold range
It is interior, if so, being third problem module, if it is not, being then non-problems module.
Further, Second processing module further include: third processing unit, for judging whether each problem module is most
Small level unit obtains test case if so, screening to each node in it by presetting method；If it is not, then continuing
Level is divided and screened accordingly until forming minimum level unit；Minimum level unit is that can not carry out level division
Unit.
Further, Second processing module further includes fourth processing unit, is intersected in each problem module for extracting
Node only carries out primary screening, screens to other nodes, obtains test case.
Technical solution brief summary
The present invention is to carry out level one by one to system by function by classifying to system, especially distributed system
It divides, forms tree, beta pruning is carried out on the minor matters of non-influence in the tree combed, to the tree combed
In play the minor matters of influence, select its minimum node and tested, find out test case.
(3) beneficial effect
It does not need to screen each part in each region in system one by one, need to only say the node of the problem part combed
It is tested, reduces test quantity, improves testing efficiency.The influence for thinking the subjective factor chosen is avoided, is reduced
The blindness and uncertainty of test improve the logic and accuracy rate of test；Hierarchical classification acts on minimum unit, keeps away
Exempt from that monitoring efficiency is low and dependence is difficult to determining problem, to reduce difficulty of test.
Detailed description of the invention
Fig. 1 is system performance testing case screening method flow chart；
Fig. 2 is the multiple level division methods flow charts of system；
Fig. 3 carries out the method flow diagram of suspicious region screening to system；
Fig. 4 is the method flow diagram for carrying out suspicious region screening in another embodiment to system；
Method flow diagram of the Fig. 5 to the problem module screening in the suspicious region of system；
Fig. 6 is method flow diagram of another embodiment to the problem module screening in the suspicious region of system；
The method flow diagram that test case screens in the problem of Fig. 7 is to system module；
Fig. 8 is second embodiment system performance testing example screening system structure and connection relationship signal according to the present invention
Figure.
Appended drawing reference:
100: warning module；101: communication module；200: first processing module；201: the first communication units；202: the first
Processing unit；203: the second communication units；204: the second processing unit；300: Second processing module；301: third processing unit；
302: fourth processing unit；303: third communication module.
Specific embodiment
In order to make the objectives, technical solutions and advantages of the present invention clearer, With reference to embodiment and join
According to attached drawing, the present invention is described in more detail.It should be understood that these descriptions are merely illustrative, and it is not intended to limit this hair
Bright range.In addition, in the following description, descriptions of well-known structures and technologies are omitted, to avoid this is unnecessarily obscured
The concept of invention.
Obviously, described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on the present invention
In embodiment, every other implementation obtained by those of ordinary skill in the art without making creative efforts
Example, shall fall within the protection scope of the present invention.
In the description of the present invention, it should be noted that term " first ", " second ", " third " are used for description purposes only,
It is not understood to indicate or imply relative importance.
As long as in addition, the non-structure each other of technical characteristic involved in invention described below different embodiments
It can be combined with each other at conflict.
Referring to Fig. 1, Fig. 1 is system performance testing case screening method flow chart.
According to a kind of system performance testing case screening method that one embodiment of the application provides, as shown in Figure 1, comprising:
S1: system performance fault-signal is obtained.
S2: system progress level is gradually divided and successively each level is screened to obtain problem module.
S3: problem module is screened by presetting method, obtains test case.
Wherein S1, S2, S3 are only preferably to distinguish step, do not represent work between each step in proper order.
By above-mentioned combing step, tree is formed, screening is diffused in conjunction with presetting method, can effectively find
Influence the test case of distributed system performance；Difficulty of test can be reduced, testing time is reduced.Wherein, presetting method includes but not
It is limited to Fibonacci method and dichotomy.
Referring to Fig. 2, Fig. 2 is the multiple level division methods flow charts of system.
In an alternative embodiment, as shown in Fig. 2, step S2 includes:
S21: being divided into hardware, software and service sub-system region for system, based on fault-signal to respectively to region
It is screened, obtains suspicious region.
S22: suspicious region is divided into multiple functional modules, and functional module is screened, obtains problem module.Its
In, hardware area can be divided into CPU, memory, disk, the modules such as network interface card.Software area can be divided into database MySQL, memory
Database Redis, message queue kafka etc. modules.Service sub-system region can be divided into web operation system module, rpc business
System module, business base layer support system module.But be not limited to it is above-mentioned enumerate, can specifically be reset according to test item.
Referring to Fig. 3, Fig. 3 carries out the method flow diagram of suspicious region screening to system.
In an alternative embodiment, as shown in figure 3, step S21 includes:
S211: the index parameter in each region is obtained.
S212: judging that fault-signal whether there is with index parameter and be overlapped section section, if so, be suspicious region, if
It is no, then it is non-suspicious region.
Fault-signal is typically all to pass through monitoring warning system, or by collector journal, the modes such as order are obtained.Hardware
The fault-signal of system, obtains generally by monitoring warning system, for example CPU usage is absolutely, memory usage hundred
/ hundred, it is all that monitoring alarm can monitor.Software failure signal, such as mysql excessive, monitoring alarm of inquiring quantity slowly
It can monitor, if not provided, the order or log acquisition of mysql itself can also be passed through.Operation system fault-signal, such as
Single request handles overlong time, generally by log acquisition.
Referring to Fig. 4, Fig. 4 is the method flow diagram for carrying out suspicious region screening in another embodiment to system.
In another alternative embodiment, index parameter includes service index, inquiry index and/processing index, such as Fig. 4 institute
Show, step S21 further include:
S211 ': the service index of hardware area, the inquiry index of software area and/or service sub-system region are obtained
Handle index.
S212 ': judging that fault-signal whether there is with service index and be overlapped section, if so, be the first suspicious region, if
It is no, then for it is non-can be with region.
S213 ': judging that fault-signal whether there is with inquiry index and be overlapped section, if so, be the second suspicious region, if
It is no, then for it is non-can be with region.And/or
S214 ': judging that fault-signal whether there is with processing index and be overlapped section, if so, be third suspicious region, if
It is no, then for it is non-can be with region.
Wherein service index can for CPU usage, memory usage, disk I/O throughput, network interface card transmission rate etc., but
It is without being limited thereto.When fault-signal be CPU usage, memory usage, disk I/O throughput, network interface card transmission rate any one
When, it is believed that it is that hardware area goes wrong.No longer citing repeats below.
Inquiry index can inquire quantity slowly for MySqL, Redis executes rate, the untreated message number of kafka.Processing
Index can be the false request quantity of illegal state code, the slow number of requests of rpc operation system or the business of web operation system
The data transmission period etc. of base layer support system,
Referring to Fig. 5, method flow diagram of the Fig. 5 to the problem module screening in the suspicious region of system.
One it is optional be in embodiment, each suspicious region includes at least one functional module, as shown in figure 5, step S22
Include:
S221: index parameter corresponding with each functional module is obtained.
S222: each index parameter value is judged respectively whether in the threshold range of the functional module, if so, being problem
Module, if it is not, being then non-problems module.
Referring to Fig. 6, Fig. 6 is method flow of another embodiment to the problem module screening in the suspicious region of system
Figure.
In an alternative embodiment, the first suspicious region includes at least one first functional module, each first function mould
The corresponding service index of block；Second suspicious region includes at least one second functional module, and each second functional module is corresponding
One inquiry index；Third suspicious region includes at least one third functional module, at each third functional module corresponding one
Manage index；As shown in fig. 6, step S22 includes:
S221 ': service index corresponding with each functional module, the inquiry index of software area and/or processing index are obtained.
S222 ': the service index being overlapped in section is judged whether in first threshold section, if so, being first problem mould
Block, if it is not, being then non-problems module.First threshold section can be a point value, or an interval value, such as percent
Hundred, 90%-100%, can also be using the disk upper limit or the network interface card transmission upper limit etc. as the reference standard in first threshold section.Its
In, the coincidence section in this step is located at first can be with region.
S223 ': the inquiry index being overlapped in section is judged whether in second threshold section, if so, being Second Problem mould
Block, if it is not, being then non-problems module.Second threshold section can may be an interval value for a point value, for example, 50-
100,5000 etc., but it is not limited to above-mentioned enumerate.
And/or
S224 ': the processing index being overlapped in section is judged whether in third threshold interval, if so, being third problem mould
Block, if it is not, being then non-problems module.Third threshold value can be point value, or interval value；It is non-such as in web service part
Method status code 500, it is considered that be caused by server end service code mistake.The number of requests that status code is 500, can recognize
To be third threshold value.Or such as in rpc operation system, generally each system is called inside enterprises, due to being all clothes
Network Communication in business device, and server performance is relatively good, so speed generally will not be slow, if it exceeds certain time, such as
0.1-0.5s, then it is assumed that rpc is requested slow, is the failure for needing to solve, then 0.1-0.5s is third threshold interval.For another example industry
The data transmission period for base layer support system of being engaged in is too long.Business bottom data support system is each operation system periodic transmission in upper layer
Data, such as more than three minutes, are considered problematic substantially if transmission time is too long.Three minutes therein are then third
Threshold interval.
Referring to Fig. 7, the method flow diagram that test case screens in the problem of Fig. 7 is to system module.
In an alternative embodiment, as shown in fig. 7, step S3 includes:
S31: judge whether each problem module is minimum level unit, if so, thening follow the steps S32: to each in it
Node is screened by presetting method, obtains test case.
S33: it divides and screened accordingly until forming minimum level unit if it is not, then continuing level.
Minimum level unit is the unit that can not carry out level division.
In an alternative embodiment, as shown in fig. 7, step S3 further include:
S34: extracting the node intersected in each problem module and only carry out primary screening, screens, is surveyed to other nodes
Try example.
In the present embodiment, be illustrated for continuing to divide to software area: background is that network transfer speeds are shadows
An important factor for acoustic system performance.Network bandwidth is the important configuration parameters of network transfer speeds, if the processing speed of system
It is then to improve network bandwidth, the processing speed of system can correspondingly increase since network transfer speeds are excessively slow and too late expected.It is resonable
In the case of thinking, the two should be that equal proportion improves.In this project, the speed of network bandwidth is determined by the configuration of network software
's.Network software is cisco network assistant (Cisco Network Assistant).In software in the following, dividing has operating system
Software, network software, database software etc..Third layer divides below network software to be had, network transfer speeds, network delay,
Each influence factor such as network packet loss rate.4th layer has network bandwidth below network transfer speeds.According to prevailing condition, network
The range of bandwidth is in the range of 100MB-16GB/S.Therefore, using dichotomy, the test case for the network bandwidth selected is chosen for
100MB/S、200MB/S、400MB/S、800MB/S、1.6GB/S、3.2GB/S、6.4GB/S、12.8GB/S、16GB/S。
Test result shows still to be basically unchanged with the raising of network bandwidth, system performance, is maintained at low level.Therefore
It is believed that network bandwidth is not the bottleneck of system processing speed.
Sample two: project background: enterprise is that certain project builds distributed system A, discovery system processing speed after the completion of building
Degree is too late expected, only estimates the 10% of performance.Then test case is selected, is tested for the property.
Sample background: in distributed system A, often accessed data are stored using memory database Redis, by
It can faster, so system access speed can be improved compared to traditional database in the access speed of memory database.In Redis data
In library, there is a configuration to be called individual data example size, refer to the size of individual data example in Redis.If necessary
The data of storage are greater than the setting, then can be split into more parts.For example, the size of setting individual data example is configured to 1KB.
Then when the data for needing to store are 3KB, 3 parts of storages can be divided into.If the size setting of individual data example is excessive, can lead
Cause the waste of memory space.If the size of individual data example is too small, it is excessive to will lead to data fragmentation, also influences performance.
Detailed process: the method proposed according to patent constructs tree.First layer is root node, and the second layer is divided into firmly
Part, software and business.In software in the following, dividing has operating system software, network software, database software etc..Third layer is in number
There are mysql software, each influence factor such as redis software according to dividing below library software.4th layer has below redis software
Redis memory size, redis example number, redis individual data example size etc..According to prevailing condition, redis is individually real
The range of example size is in the range of 1KB-1MB.Therefore, using dichotomy, the test for the individual data example size selected is used
Example is chosen for 1KB, 2KB, 4KB, 8KB, 16KB, 32KB, 64KB, 128KB, 256KB, 512KB, 1MB.
Test result shows the raising with individual data example size, and the performance of system is first increased and reduced afterwards.In 64KB
When, redis performance reaches highest.The processing speed of system is dimensioned to raising when 1KB compared to individual data example at this time
10%.But individual data example size is not still the bottleneck place of system processing speed.
It should be noted that the step of being related in the above embodiments of the present application serial number not indicates to execute sequence to step
Restriction, wherein the step of with reversed order or can be performed simultaneously.In addition, threshold interval involved in the application is not solid
Definite value can be adjusted according to specific Enterprise Project.Given above illustrates shown in sample.
Since a kind of system performance testing example screening system is the corollary equipment for executing system performance testing case screening method,
In conjunction with the description to system performance testing case screening method, no longer go to live in the household of one's in-laws on getting married to the embodiment of system performance testing example screening system
It states.
Each embodiment of the application system performance testing example screening system please refers to Fig. 8 understanding, and Fig. 8 is according to the present invention
Second embodiment system performance testing example screening system structure and connection relationship diagram
A kind of system performance testing example screening system provided according to another embodiment of the application, which is characterized in that packet
It includes:
Warning module 100, for obtaining system performance fault-signal and sending.Communication is additionally provided in warning module 100
Module 101, for sending the fault-signal.
First processing module 200 is asked for gradually dividing and successively screening to each level system progress level
Inscribe module.
Second processing module 300 obtains test case for screening to problem module by presetting method.
In an alternative embodiment, first processing module 200 is also used to for system being divided into hardware, software and business
System realm obtains suspicious region based on fault-signal to screening respectively to region；And for suspicious region to be divided
For multiple functional modules, and functional module is screened, obtains problem module.
In an alternative embodiment, first processing module 200 includes:
First communication unit 201, for obtaining the index parameter in each region.
First processing units 202, for judging whether fault-signal and index parameter are overlapped section existing, if so,
For suspicious region, if it is not, being then non-suspicious region.
In an alternative embodiment, index parameter includes service index, inquiry index and/processing index.
First communication unit 201, be also used to obtain the service index of hardware area, the inquiry index of software area and/or
The processing index in service sub-system region；
First processing units 202, be also used to judge fault-signal and service index with the presence or absence of being overlapped section, if so,
For the first suspicious region, if it is not, then for it is non-can be with region；It is also used to judge that fault-signal whether there is with inquiry index and is overlapped area
Between, if so, be the second suspicious region, if it is not, then for it is non-can be with region；And/or for judging fault-signal and processing index
With the presence or absence of be overlapped section, if so, be third suspicious region, if it is not, then for it is non-can be with region.
In an alternative embodiment, each suspicious region includes at least one functional module；First processing module 200 is wrapped
It includes:
Second communication unit 203, for obtaining index parameter corresponding with each functional module；
The second processing unit 204, for judge respectively each index parameter value whether the functional module threshold range
It is interior, if so, being problem module, if it is not, being then non-problems module.
In an alternative embodiment, the first suspicious region includes at least one first functional module, each first function mould
The corresponding service index of block；Second suspicious region includes at least one second functional module, and each second functional module is corresponding
One inquiry index；Third suspicious region includes at least one third functional module, at each third functional module corresponding one
Manage index.
Second communication unit 203, for obtaining the inquiry index of service index corresponding with each functional module, software area
And/or processing index；The second processing unit 204, for judge the service index being overlapped in section whether in first threshold section,
If so, being first problem module, if it is not, being then non-problems module；Whether it is also used to judge the inquiry index being overlapped in section
In second threshold section, if so, being Second Problem module, if it is not, being then non-problems module；And/or for judging to be overlapped area
Whether interior processing index is in third threshold interval, if so, being third problem module, if it is not, being then non-problems module.
In an alternative embodiment, Second processing module 300 further include:
Third processing unit 301, for judging whether each problem module is minimum level unit, if so, in it
Each node screened by presetting method, obtain test case；It divides and is screened accordingly if it is not, then continuing level
Until forming minimum level unit；
Minimum level unit is the unit that can not carry out level division.
In an alternative embodiment, Second processing module 300 further include:
Fourth processing unit 302 only carries out primary screening for extracting the node intersected in each problem module, to other
Node screening, obtains test case.It should be noted that Second processing module further includes third communication module 303, for that will screen
Obtained test case is reported to external system.
The present invention is directed to protect a kind of system performance testing case screening method and system.By being especially distributed to system
Formula system is classified, and is carried out level one by one to system by function and is divided, tree is formed, in the tree combed
The minor matters of non-influence carry out beta pruning, to the minor matters for playing influence in the tree combed, select its minimum node into
Row test, finds out test case.It does not need to screen each part in each region in system one by one, the problem that need to will have only combed
Partial node is tested, and is reduced test quantity, is improved testing efficiency.Avoid the shadow for thinking the subjective factor chosen
It rings, reduces the blindness and uncertainty of test, improve the logic and accuracy rate of test；Hierarchical classification acts on most
Subsection, avoids that monitoring efficiency is low and dependence is difficult to determining problem, to reduce difficulty of test.
It should be understood that above-mentioned specific embodiment of the invention is used only for exemplary illustration or explains of the invention
Principle, but not to limit the present invention.Therefore, that is done without departing from the spirit and scope of the present invention is any
Modification, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.In addition, appended claims purport of the present invention
Covering the whole variations fallen into attached claim scope and boundary or this range and the equivalent form on boundary and is repairing
Change example.
Claims (14)
1. a kind of system performance testing case screening method characterized by comprising
Obtain system performance fault-signal；
System progress multi-layer is gradually divided and successively each level is screened to obtain problem module；
Described problem module is screened by presetting method, obtains test case.
2. screening technique according to claim 1, wherein gradually divide and successively right system progress multi-layer
Each level screens the step of obtaining problem module and includes:
The system is divided into hardware, software and service sub-system region, based on the fault-signal to respectively to described
Region is screened, and suspicious region is obtained；
The suspicious region is divided into multiple functional modules, and the functional module is screened, obtains problem module.
3. screening technique according to claim 2, wherein the system is divided into hardware, software and business subsystem
System region includes: to the step of screening to the region respectively, obtain suspicious region based on the fault-signal
Obtain the index parameter in each region；
Judge that the fault-signal whether there is with index parameter and be overlapped section, if so, being suspicious region, if it is not, being then non-
Suspicious region.
4. screening technique according to claim 3, wherein the system is divided into hardware, software and business subsystem
System region includes: to the step of screening to the region respectively, obtain suspicious region based on the fault-signal
The index parameter includes service index, inquiry index and/processing index；
Obtain service index, the inquiry index of software area and/or the processing index in service sub-system region of hardware area；
Judge that the fault-signal whether there is with the service index and is overlapped section, if so, be the first suspicious region, if
It is no, then for it is non-can be with region；
Judge that the fault-signal whether there is with the inquiry index and is overlapped section, if so, be the second suspicious region, if
It is no, then for it is non-can be with region；And/or
Judge that the fault-signal whether there is with the processing index and is overlapped section, if so, be third suspicious region, if
It is no, then for it is non-can be with region.
5. screening technique according to claim 4, wherein the suspicious region is divided into multiple functional modules, and right
The step of functional module is screened, obtains problem module include:
First suspicious region includes at least one first functional module, and the corresponding use of each first functional module refers to
Mark；
Second suspicious region includes at least one second functional module, and each second functional module corresponding one, which is inquired, to be referred to
Mark；
The third suspicious region includes at least one third functional module, and each third functional module corresponding one, which is handled, to be referred to
Mark；
Obtain service index corresponding with each functional module, the inquiry index of software area and/or processing index；
Judge it is described coincidence section in service index whether in first threshold section, if so, be first problem module, if
It is no, then it is non-problems module；
Judge it is described coincidence section in inquiry index whether in second threshold section, if so, be Second Problem module, if
It is no, then it is non-problems module；And/or
Judge it is described coincidence section in processing index whether in third threshold interval, if so, be third problem module, if
It is no, then it is non-problems module.
6. screening technique according to claim 1, wherein screen, tested by presetting method to described problem module
Example the step of include:
Judge whether each described problem module is minimum level unit, if so, to each node in it by presetting method into
Row screening, obtains test case；
It divides and screened accordingly until forming minimum level unit if it is not, then continuing level；
The minimum level unit is the unit that can not carry out level division.
7. screening technique according to claim 6, wherein screen, tested by presetting method to described problem module
The step of example further include:
It extracts the node intersected in each described problem module and only carries out primary screening, other nodes are screened, test case is obtained.
8. a kind of system performance testing example screening system characterized by comprising
Warning module, for obtaining system performance fault-signal and sending；
First processing module, for gradually dividing system progress multi-layer and successively being screened to each level
To problem module；
Second processing module obtains test case for screening to described problem module by presetting method.
9. screening system according to claim 8, wherein the first processing module is also used to for the system being divided into
Hardware, software and service sub-system region are obtained suspicious based on the fault-signal to screening respectively to the region
Region；And for the suspicious region to be divided into multiple functional modules, and the functional module is screened, is asked
Inscribe module.
10. screening system according to claim 9, wherein the first processing module includes:
First communication unit, for obtaining the index parameter in each region；
First processing units are overlapped section for judging that the fault-signal whether there is with index parameter, if so, being suspicious
Region, if it is not, being then non-suspicious region.
11. screening system according to claim 10, wherein
The index parameter includes service index, inquiry index and/processing index；
First communication unit is also used to obtain the service index of hardware area, the inquiry index of software area and/or business subsystem
The processing index in system region；
First processing units, be also used to judge the fault-signal and the service index with the presence or absence of being overlapped section, if so,
For the first suspicious region, if it is not, then for it is non-can be with region；It is also used to judge whether the fault-signal is deposited with the inquiry index
Be overlapped section, if so, be the second suspicious region, if it is not, then for it is non-can be with region；And/or for judging the failure letter
Number with the processing index with the presence or absence of being overlapped section, if so, be third suspicious region, if it is not, be then it is non-can be with region.
12. screening system according to claim 11, wherein
First suspicious region includes at least one first functional module, and the corresponding use of each first functional module refers to
Mark；
Second suspicious region includes at least one second functional module, and each second functional module corresponding one, which is inquired, to be referred to
Mark；
The third suspicious region includes at least one third functional module, and each third functional module corresponding one, which is handled, to be referred to
Mark；
Second communication unit is also used to obtain the inquiry index of service index corresponding with each functional module, software area
And/or processing index；
Described the second processing unit, be also used to judge it is described coincidence section in service index whether in first threshold section, if
Being is then first problem module, if it is not, being then non-problems module；Being also used to judge the inquiry index in the coincidence section is
It is no in second threshold section, if so, be Second Problem module, if it is not, then be non-problems module；And/or it is described for judging
The processing index in section is overlapped whether in third threshold interval, if so, being third problem module, if it is not, being then non-problems
Module.
13. screening system according to claim 8, wherein the Second processing module further include:
Third processing unit, for judging whether each described problem module is minimum level unit, if so, to each in it
Node is screened by presetting method, obtains test case；If it is not, then continue level divide and carry out accordingly screen until
Form minimum level unit；
The minimum level unit is the unit that can not carry out level division.
14. screening system according to claim 13, wherein the Second processing module further include:
Fourth processing unit only carries out primary screening for extracting the node intersected in each described problem module, to other sections
Point screening, obtains test case.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910244606.2A CN109977017B (en) | 2019-03-28 | 2019-03-28 | System performance test case screening method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910244606.2A CN109977017B (en) | 2019-03-28 | 2019-03-28 | System performance test case screening method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109977017A true CN109977017A (en) | 2019-07-05 |
| CN109977017B CN109977017B (en) | 2022-09-02 |
Family
ID=67081346
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910244606.2A Active CN109977017B (en) | 2019-03-28 | 2019-03-28 | System performance test case screening method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109977017B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102928738A (en) * | 2012-10-31 | 2013-02-13 | 辽宁省电力有限公司沈阳供电公司 | Dynamic layer diagnostic device and method of smart power grid fault |
| CN105335291A (en) * | 2015-11-12 | 2016-02-17 | 浪潮电子信息产业股份有限公司 | Software security test case design method |
| CN105930268A (en) * | 2016-04-19 | 2016-09-07 | 努比亚技术有限公司 | Tree-based black-box test case generation method and system |
| US20170060728A1 (en) * | 2015-08-24 | 2017-03-02 | Bank Of America Corporation | Program Lifecycle Testing |
| CN106970880A (en) * | 2017-04-28 | 2017-07-21 | 中国科学院软件研究所 | A kind of distributed automatization method for testing software and system |
| CN107491395A (en) * | 2017-09-06 | 2017-12-19 | 郑州云海信息技术有限公司 | A kind of self-defined test case framework application method |
| US20170371768A1 (en) * | 2016-06-23 | 2017-12-28 | International Business Machines Corporation | System and method for detecting and alerting unexpected behavior of software applications |
| CN107704392A (en) * | 2017-09-30 | 2018-02-16 | 华为技术有限公司 | The processing method and server of a kind of test case |
| US20180067843A1 (en) * | 2016-09-08 | 2018-03-08 | International Business Machines Corporation | Measuring and optimizing test resources and test coverage effectiveness through run time customer profiling and analytics |
| CN109308252A (en) * | 2017-07-27 | 2019-02-05 | 中国移动通信集团浙江有限公司 | A kind of fault location processing method and processing device |
-
2019
- 2019-03-28 CN CN201910244606.2A patent/CN109977017B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102928738A (en) * | 2012-10-31 | 2013-02-13 | 辽宁省电力有限公司沈阳供电公司 | Dynamic layer diagnostic device and method of smart power grid fault |
| US20170060728A1 (en) * | 2015-08-24 | 2017-03-02 | Bank Of America Corporation | Program Lifecycle Testing |
| CN105335291A (en) * | 2015-11-12 | 2016-02-17 | 浪潮电子信息产业股份有限公司 | Software security test case design method |
| CN105930268A (en) * | 2016-04-19 | 2016-09-07 | 努比亚技术有限公司 | Tree-based black-box test case generation method and system |
| US20170371768A1 (en) * | 2016-06-23 | 2017-12-28 | International Business Machines Corporation | System and method for detecting and alerting unexpected behavior of software applications |
| US20180067843A1 (en) * | 2016-09-08 | 2018-03-08 | International Business Machines Corporation | Measuring and optimizing test resources and test coverage effectiveness through run time customer profiling and analytics |
| CN106970880A (en) * | 2017-04-28 | 2017-07-21 | 中国科学院软件研究所 | A kind of distributed automatization method for testing software and system |
| CN109308252A (en) * | 2017-07-27 | 2019-02-05 | 中国移动通信集团浙江有限公司 | A kind of fault location processing method and processing device |
| CN107491395A (en) * | 2017-09-06 | 2017-12-19 | 郑州云海信息技术有限公司 | A kind of self-defined test case framework application method |
| CN107704392A (en) * | 2017-09-30 | 2018-02-16 | 华为技术有限公司 | The processing method and server of a kind of test case |
Non-Patent Citations (2)
| Title |
|---|
| FRANK HOFFMANN 等: "Genetic programming for model selection of TSK-fuzzy systems", 《INFORMATION SCIENCES》 * |
| 李庆云等: "基于多层匹配筛选的Web服务发现模型的研究", 《计算机应用与软件》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109977017B (en) | 2022-09-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8938719B2 (en) | System and method for performance assurance of applications | |
| US9558196B2 (en) | Automatic correlation of dynamic system events within computing devices | |
| EP1058886B1 (en) | System and method for optimizing performance monitoring of complex information technology systems | |
| CN102254120B (en) | Method, system and relevant device for detecting malicious codes | |
| CN106886485B (en) | System capacity analysis and prediction method and device | |
| US20150347273A1 (en) | Deploying Trace Objectives Using Cost Analyses | |
| US20150301920A1 (en) | Optimization analysis using similar frequencies | |
| US20150081836A1 (en) | Profile-based lifecycle management for data storage servers | |
| CN108595306B (en) | Service performance testing method for mixed cloud | |
| CN106033469B (en) | The foreseeable method and system of the high efficiency of structuralized query for big data | |
| WO2007057423A2 (en) | System and method for proactive impact analysis of policy-based storage systems | |
| US11675682B2 (en) | Agent profiler to monitor activities and performance of software agents | |
| CN110188543A (en) | White list library, white list program library update method and industrial control system | |
| CN102035697A (en) | Concurrent connections performance testing system and method for file system | |
| WO2023207689A1 (en) | Change risk assessment method and apparatus, and storage medium | |
| US8782641B2 (en) | Tuning of work to meet performance goal | |
| CN113391913A (en) | Distributed scheduling method and device based on prediction | |
| CN109839910A (en) | Control device, control method and computer readable storage medium | |
| CN106708727B (en) | Distributed virus characteristic sample verification method and system | |
| US8850407B2 (en) | Test script generation | |
| CN104735063B (en) | A kind of safe evaluating method for cloud infrastructure | |
| CN112612587B (en) | Spark platform dynamic resource allocation method for flow analysis | |
| CN106899436A (en) | A kind of cloud platform failure predication diagnostic system | |
| Yoon et al. | DBSeer: Pain-free database administration through workload intelligence | |
| CN111913937B (en) | Database operation and maintenance method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |