CN104850494B - A kind of method and apparatus for memory system testing - Google Patents
A kind of method and apparatus for memory system testing Download PDFInfo
- Publication number
- CN104850494B CN104850494B CN201510213852.3A CN201510213852A CN104850494B CN 104850494 B CN104850494 B CN 104850494B CN 201510213852 A CN201510213852 A CN 201510213852A CN 104850494 B CN104850494 B CN 104850494B
- Authority
- CN
- China
- Prior art keywords
- test
- case
- preferred
- storage system
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The object of the present invention is to provide a kind of method and apparatus for memory system testing.Test equipment obtains one or more test cases, according to test case, the one or more preferred test cases of generation, wherein, the test data or test statement of system vulnerability of the test case with that can trigger the storage system are associated；Then, according to the preferred test case, the storage system is tested.Compared with prior art, it is of the invention mainly to utilize test case associated with the test data or test statement of the system vulnerability that trigger the storage system, to generate one or more preferred test cases, and storage system is tested using the preferred test case, so as to generate more Validity Test data by automating, existing test is strengthened, efficiently, high covering ground test system under test (SUT), so that test is more comprehensively perfect, and system vulnerability is triggered faster, improve the testing efficiency and test quality of storage system.
Description
Technical field
The present invention relates to field of computer technology more particularly to a kind of technologies for memory system testing.
Background technology
Currently, the realization of storage system API respectively has difference used by the country, and some storage systems use class SQL syntax,
Some storage systems then change storage operation using all kinds of self-defined grammers to define such as additions and deletions.And for the survey of storage system
Examination especially for the test of the storage system of independent development, is then directed to the design of tested storage system by tester mostly
Document, engineer and writes test case.However, carrying out the test of storage system using manual method, there is largely ask
Topic：
1. engineer and memory system testing use-case is write, it is not only of high cost, and also the quantity for writing test case has
Limit, it is impossible to fully be tested storage system.
2. the test case of manual compiling is not easy to extend and safeguard.If storage system changes syntactic definition or some letters
Single logic, test case originally need the cost modified very big, almost rewrite.
3. since different testers understands it is to be not quite similar for the border of data type, the test on some borders can
It can meeting test leakage.
4. the test of existing storage system lacks a kind of effective self feed back mode to enhance the validity of test data.
Accordingly, it is considered to drawbacks described above, existing memory system testing method is difficult to cover the efficient height of storage system progress
The test of lid, so as to influence the testing efficiency of storage system and test result.
The content of the invention
The object of the present invention is to provide a kind of method and apparatus for memory system testing.
According to an aspect of the invention, there is provided a kind of method for memory system testing, wherein, this method bag
It includes：
A obtains one or more test cases, wherein, the test case and the system that the storage system can be triggered
The test data or test statement of loophole are associated；
B is according to the test case, the one or more preferred test cases of generation；
Wherein, this method further includes：
- according to the preferred test case, the storage system is tested.
According to another aspect of the present invention, a kind of test equipment for memory system testing is additionally provided, wherein, this sets
It is standby to include：
Acquisition device, for obtaining one or more test cases, wherein, the test case is with that can trigger described deposit
The test data or test statement of the system vulnerability of storage system are associated；
Generating means, for according to the test case, the one or more preferred test cases of generation；
Wherein, which further includes：
Test device, for according to the preferred test case, testing the storage system.
Compared with prior art, the present invention mainly utilizes and the test number for the system vulnerability that can trigger the storage system
According to or the associated test case of test statement, to generate one or more preferred test cases, and utilize the preferred test
Use-case tests storage system, and so as to generate more Validity Test data by automating, existing test is carried out
Strengthen, efficiently, high covering ground test system under test (SUT) so that test is more comprehensively perfect, and triggers system vulnerability faster, carries
The high testing efficiency and test quality of storage system.
Moreover, the present invention can also be surveyed according to test case to determine that one or more of described test case is preferred
The factor is tried, then according to the preferred test factor, the one or more preferred test cases of generation；It is possible to further by one
A or multiple preferred test factors are combined with other test cases, with the one or more preferred test cases of generation and/
Or be combined two or more preferred test factors, with the one or more preferred test cases of generation；So as to by more
Kind mode, fast and effeciently generates preferred test case using outstanding test data or execution model so that preferred test is used
Example is more perfect, can trigger system vulnerability faster, improve the testing efficiency and test quality of storage system.
Moreover, the present invention can also screen one or more candidate's test cases, to obtain one or more survey
Example on probation；Further, can also be generated and the storage description information phase according to the storage description information of the storage system
Corresponding one or more test data, then according to the test data, generation and corresponding one of the test data
Or multiple candidate's test cases；So as to automatically generate comprehensive complete test data, and a variety of data boundaries are covered (such as storage system
System physical block data boundary) and abnormal data, and all kinds of storage system mainstreams operation test data auto generations are realized, easily
It safeguards, easily extension, high efficiency, high covering.
Moreover, the present invention can also be according to one or more test results of the storage system, with reference to the test knot
The preferred test case of one or more corresponding to fruit, determines the test report information corresponding to the test result；Further
Ground, the test relevant information that can be combined in the test process of the preferred test case also generate test report information；From
And based on the test process and test result of a variety of preferred test cases, the possibility for causing system vulnerability is divided automatically
Analysis to draw the data for the problem of being likely to occur or model, reduces and manually investigates lengthy and tedious, the faster original for judging system vulnerability
Cause improves the testing efficiency and test quality of storage system.
Description of the drawings
By reading the detailed description made to non-limiting example made with reference to the following drawings, of the invention is other
Feature, objects and advantages will become more apparent upon：
Fig. 1 shows a kind of test equipment schematic diagram for memory system testing of one side according to the present invention；
Fig. 2 shows that a kind of test equipment for memory system testing in accordance with a preferred embodiment of the present invention is illustrated
Figure；
Fig. 3 shows a kind of method flow diagram for memory system testing according to a further aspect of the present invention；
Fig. 4 shows a kind of method flow diagram for memory system testing in accordance with a preferred embodiment of the present invention.
The same or similar reference numeral represents the same or similar component in attached drawing.
Specific embodiment
It should be mentioned that some exemplary embodiments are described as before exemplary embodiment is discussed in greater detail
The processing described as flow chart or method.Although operations are described as the processing of order by flow chart, therein to be permitted
Multioperation can be implemented concurrently, concomitantly or simultaneously.In addition, the order of operations can be rearranged.When it
The processing can be terminated when operation is completed, it is also possible to have the additional step being not included in attached drawing.The processing
It can correspond to method, function, regulation, subroutine, subprogram etc..
" test equipment " described in the present invention includes but not limited to arbitrary computer equipment.It is alleged within a context
" computer equipment " also referred to as " computer ", refers to perform numerical computations by running preset program or instruction and/or patrol
The intelligent electronic device of the predetermined process processes such as calculating is collected, processor and memory can be included, is being deposited by processor execution
The survival to prestore in reservoir instructs to perform predetermined process process or performs predetermined process by hardware such as ASIC, FPGA, DSP
It process or is realized by said two devices combination.Computer equipment includes but not limited to server, PC, notebook electricity
Brain, tablet computer, smart mobile phone etc..
The computer equipment includes user equipment and the network equipment.Wherein, the user equipment includes but not limited to electricity
Brain, smart mobile phone, PDA etc.；The network equipment includes but not limited to single network server, multiple network servers form
Server group or the cloud being made of a large amount of computers or network server based on cloud computing (Cloud Computing), wherein,
Cloud computing is one kind of Distributed Calculation, a super virtual computer being made of the computer collection of a group loose couplings.Its
In, the computer equipment can isolated operation realize the present invention, also can access network and by with other calculating in network
The present invention is realized in the interactive operation of machine equipment.Wherein, the network residing for the computer equipment include but not limited to internet,
Wide area network, Metropolitan Area Network (MAN), LAN, VPN network etc..
It should be noted that the user equipment, the network equipment and network etc. are only for example, other are existing or from now on may be used
The computer equipment or network that can occur such as are applicable to the present invention, should also be included within the scope of the present invention, and to draw
It is incorporated herein with mode.
Concrete structure and function detail disclosed herein are only representative, and are for describing showing for the present invention
The purpose of example property embodiment.But the present invention can be implemented by many alternative forms, and be not interpreted as
It is limited only by the embodiments set forth herein.
Although it should be appreciated that may have been used term " first ", " second " etc. herein to describe unit,
But these units should not be limited by these terms.The use of these items is only for by a unit and another unit
It distinguishes.For example, in the case of the scope without departing substantially from exemplary embodiment, it is single that first module can be referred to as second
Member, and similarly second unit can be referred to as first module.Term "and/or" used herein above include one of them or
The arbitrary and all combination of more listed associated items.
Term used herein above is not intended to limit exemplary embodiment just for the sake of description specific embodiment.Unless
Context clearly refers else, otherwise singulative used herein above "one", " one " also attempt to include plural number.Should also
When understanding, term " comprising " and/or "comprising" used herein above provide stated feature, integer, step, operation,
The presence of unit and/or component, and do not preclude the presence or addition of other one or more features, integer, step, operation, unit,
Component and/or its combination.
It should further be mentioned that in some replaces realization modes, the function/action being previously mentioned can be according to different from attached
The order indicated in figure occurs.For example, depending on involved function/action, the two width figures shown in succession actually may be used
Substantially simultaneously to perform or can perform in a reverse order sometimes.
The present invention is described in further detail below in conjunction with the accompanying drawings.
Fig. 1 shows a kind of test equipment schematic diagram for memory system testing of one side according to the present invention；Wherein,
The test equipment includes acquisition device 1, generating means 2, test device 3.Specifically, the acquisition device 1 obtain one or
Multiple test cases, wherein, the test data of system vulnerability of the test case with the storage system can be triggered or survey
Examination sentence is associated；The generating means 2 are according to the test case, the one or more preferred test cases of generation；The survey
Trial assembly puts 3 according to the preferred test case, and the storage system is tested.
Here, the storage system includes traditional keyword database (such as MySQL) or distributed memory system/distribution
Formula database.
The acquisition device 1 obtains one or more test cases, wherein, the test case is with that can trigger described deposit
The test data or test statement of the system vulnerability of storage system are associated.
Specifically, the acquisition device 1 is with storage system by directly interacting, and is provided with to obtain the storage system
Test case or the third party device with being capable of providing various test cases interact, to obtain the survey that the equipment is provided
Example on probation.
Wherein, the test data or test statement of system vulnerability of the test case with the storage system can be triggered
It is associated：I.e. described test case includes that the system vulnerability of the storage system can be triggered, so as to cause the test of system bugs
Use-case；The system vulnerability of the storage system may be triggered by also including, but the test of system bugs is not triggered in practical operation
Use-case, test case such as comprising typical boundary value or comprising such as conditional statement, judge the complexity such as sentence and/or Do statement
The test case of the test statement of logic.
Preferably, the test case includes following at least any one, i.e., is comprising can trigger the storage system
The test case of the test data of system loophole, the test for performing model comprising the system vulnerability that can trigger the storage system
The test case of use-case, the boundary value comprising the storage system and/or exceptional value.
Here, those skilled in the art will be understood that each test case include test data with perform model (or
Make test model), the test data indicates concrete numerical value used by test every time, is included in the execution model multiple
Test statement, it is described perform model indicate the test according to testing procedure, test operation or testing process etc..
Therefore, in the storage system or third party device, the acquisition or generation of test case include following any way：
1. after candidate's test case is performed, candidate's test case of system vulnerability will be triggered as the test case；It 2. will
The actual case of system vulnerability is triggered in the storage system actual motion as test case；3. the storage system border will be included
The use-case of value or exceptional value is as the test case；4. by the condition test sentence comprising the storage system and/or judge to survey
The use-case of sentence is tried as the test case.Wherein, above-mentioned candidate's test case or test case are that can trigger or can
The use-case of storage system (i.e. system under test (SUT)) system vulnerability can be triggered, the test that includes for triggering the system vulnerability is used
Test data and/or execution model (test statement) in example.
The generating means 2 are according to the test case, the one or more preferred test cases of generation.
Specifically, the generating means 2 are according to the test case, by by the test data in the test case
And/or perform model combination is rearranged in the test case or by the test data in the test case and/or
Model is performed to be combined with other candidate's test cases (such as the not yet test case of triggering system vulnerability), with generate one or
Multiple preferred test cases.
The test device 3 tests the storage system according to the preferred test case.
Preferably, the test equipment includes reporting device (not shown), wherein, the reporting device is according to the storage
One or more test results of system, the preferred test case of one or more with reference to corresponding to the test result, determine
Test report information corresponding to the test result.
Specifically, the reporting device analyzes one or more preferred test cases with corresponding test result,
Such as the multiple preferred test case with corresponding test result is counted, is sorted out, so that it is determined that the test result
Corresponding test report information.Wherein, including but not limited in the test report information can such as to cause system vulnerability
The analysis of energy property, analysis obtains being likely to occur the data of problem or analysis obtains being likely to occur execution model of problem etc..
If for example, there are two preferred test case A and B, preferably test case A includes test data X with performing model Y,
It is preferred that test case B includes test data X with performing model Z, the preferably test result of test case A is triggering system vulnerability,
It is preferred that the test result of test case B is do not trigger system vulnerability, then it is believed that triggering system vulnerability be " execution model Y " or
" test data X and the combination for performing model Y ".
It is highly preferred that the reporting device can obtain the related letter of test in the test process of the preferred test case
Breath；According to one or more test results of the storage system, the one or more with reference to corresponding to the test result is excellent
Test case and the test relevant information are selected, determines the test report information corresponding to the test result.
Specifically, the reporting device can be obtained or by monitoring in real time with being capable of providing test relevant information
Equipment such as interacts at the modes, obtains the test relevant information in the test process of the preferred test case；Wherein, the test
Relevant information such as network configuration information, network real time information, storage system hardware or software configuration information, storage system hardware/
Software use state information etc..
Then, the reporting device is on the basis of the test result and preferred test case, with reference to the test phase
Information is closed, by analyzing the modes such as the test data in test process in real time, determines the test report corresponding to the test result
Accuse information.
For example, after upper example, if the test result of the preferred test case A is triggering system vulnerability, the report dress
Put the network real-time status that can be analyzed during the preferred test case A is tested, if network occur shaking etc. it is abnormal,
" network jitter " can then be also served as to the content in the test report information；Alternatively, the reporting device can also monitor
Storage system hardware/software use state information in test process, can if system loading is abnormal when performing a certain operation
Think that triggering system vulnerability is " performing model Y " or is accurately further " a certain operation for performing model Y ".
Preferably, the acquisition device 1 can screen one or more candidate's test cases, with obtain one or
Multiple test cases, wherein, the test data of system vulnerability of the test case with the storage system can be triggered or survey
Examination sentence is associated.
Specifically, the acquisition device 1 is with storage system by directly interacting, and is provided with to obtain the storage system
Candidate's test case (such as the storage system in test or during system operation acquired in or generation use-case) or with that can carry
It interacts for the third party device of various candidate's test cases, to obtain candidate's test case that the equipment is provided.Here, institute
It states candidate's test case and includes but not limited to arbitrary test case, can trigger system vulnerability including various or system cannot be triggered
The test case of loophole.
Then, the acquisition device 1 screens candidate's test case, by can in above-mentioned candidate's test case
System vulnerability is triggered in test or candidate's test use of system vulnerability (such as comprising boundary value or exceptional value) may be triggered
Example, as the test case.
Wherein, the test data or test statement of system vulnerability of the test case with the storage system can be triggered
It is associated：I.e. described test case includes that the system vulnerability of the storage system can be triggered, so as to cause the test of system bugs
Use-case；The system vulnerability of the storage system may be triggered by also including, but the test of system bugs is not triggered in practical operation
Use-case, test case such as comprising typical boundary value or comprising such as conditional statement, judge the complexity such as sentence and/or Do statement
The test case of the test statement of logic.
It is highly preferred that the test equipment further includes data generating device (not shown) and candidate's use-case generating means (not
It shows)；Wherein, according to the storage description information of the storage system, generation and the storage describe the data generating device
The corresponding one or more test datas of information；Candidate's use-case generating means are according to the test data, generation and institute
State the corresponding one or more candidate's test cases of test data.
Specifically, the data generating device obtains the storage description information of the storage system, here, the storage is retouched
Information is stated including but not limited to the attribute information of different storage organizations (such as table, class, field), such as in the storage system not
With the attribute information of different field in table；The attribute information is included such as value type, value range, storage byte-sized limit
System, boundary information, the data volume etc. of required generation.
Then, the data generating device generates opposite with the storage description information according to the storage description information
The one or more test datas answered；Wherein, the test data includes normal value, exceptional value and boundary value.Here, the survey
Trying the generation quantity of data can generate according to default setting or other specified set, such as fully intermeshing or specific arrangement.
For example, the data generating device generates data according to the attribute of each field in the storage system, if should
Attribute is " normal (normal) ", then generates normal data, and normal data include normal boundary value：Min, min+1,
Max-1, max, since most systems have special logic for 0 processing, if 0 between min and max, 0 is also
One normal boundary value.In addition to above-mentioned normal border, then this section is being just from min+2 to max-2 for random generation
Regular data.If field does not have customized border, then min and max is the border of the data type (type) of the field, such as
The min of uint8 is that 0, max is 255.If field has customized border, min and max are customized values.If attribute
For " pure border (pureboundary) ", then represent and only generate normal boundary data.
If the attribute is " abnormal (abnormal) ", generation pure anomaly data are represented, include the boundary value max+1 of exception,
min-1.For some storage systems, the maximum storage byte-sized (size) or block size of record are conditional, the numbers
The data based on block size border can also be generated according to generating means.
Then, candidate's use-case generating means are according to the test data, by being based on system default setting or user
The test data is combined by the execution model template or test case template provided with the template, with generation and institute
State the corresponding one or more candidate's test cases of test data.
Wherein, the syntax format of each operation defined in the template, such as class SQL syntax or other self-defined languages
Method；In the execution model template or test case template, such as increase including one or more, delete, look into, change storage system and commonly use
Operation or its combination, further, can also include such as conditional statement, judge the complex logics such as sentence and/or Do statement
Test statement.
Therefore, when changing the grammer of candidate's test case, it can directly modify to the template, then utilize
Candidate's use-case generating means are repaiied with generating multiple candidate's test cases so as to avoid to whole candidate's test cases
Change.
It is highly preferred that candidate's use-case generating means can generate and the test data according to the test data
Corresponding one or more candidate test case, wherein, the test case include it is one or more perform operate and
Corresponding checked operation is operated with each perform.
Specifically, during candidate's test case is generated, candidate's use-case generating means can be each
A execution corresponding checked operation of operation setting.It is wherein, described to perform operation including such as increasing, deleting, looking into, changing fundamental operation,
And such as conditional statement, the operation for judging sentence and/or Do statement complex logic.
For example, for same data item, when often performing once insertion, update or delete operation to the data item, all
Calculate the correct result of the data item each field after corresponding operating is performed；Then, add in practical operation result with
The inquiry operation of result of calculation, so as to which above two operation be compared, so as to fulfill checked operation.
For the inquiry operation of same data item, it (for example is to be based on for certain field that it is regular, which to may be inserted into a batch,
Some ascending numerical) data, so as to generation simple queries operation or complex query operation (such as conditional inquiry behaviour
Make) when, being clear that return to how many record, and checked operation is realized by comparing.
Fig. 2 shows that a kind of test equipment for memory system testing in accordance with a preferred embodiment of the present invention is illustrated
Figure；Wherein, the test equipment includes acquisition device 1 ', generating means 2 ', test device 3 ', wherein, the generating means 2 '
Including factor specifying unit 21 ' and use-case generation unit 22 '.Specifically, the acquisition device 1 ' obtains one or more tests
Use-case, wherein, the test data or test statement phase of system vulnerability of the test case with the storage system can be triggered
Association；The factor specifying unit 21 ' determines that one or more of described test case is preferred and surveys according to the test case
Try the factor；The use-case generation unit 22 ' is according to the preferred test factor, the one or more preferred test cases of generation；Institute
Test device 3 ' is stated according to the preferred test case, the storage system is tested.
Wherein, the acquisition device 1 ' of the test equipment, test device 3 ' be identical with corresponding intrument shown in Fig. 1 or phase
Seemingly, therefore details are not described herein, and is incorporated herein by reference.
The factor specifying unit 21 ' determines that one or more of the test case is excellent according to the test case
Select test factor.
Specifically, the test case is split or is divided according to the test case by the factor specifying unit 21 '
Solution, so as to using part or all of test data, test statement or the execution model in the test case as the preferred survey
Try the factor.Preferably, if learning certain part in the test case, such as test data or execution model trigger system leakage
Hole, then using trigger the system vulnerability test data or perform model as the preferred test factor.
Herein, it is preferable that the preferred test factor includes following at least any one：
One or more test datas employed in the-test case；
One or more employed in the-test case perform models.
For example, the factor specifying unit 21 ' extracts some test data in the test case as institute
State preferred test factor, alternatively, using whole test datas in the test case extract as the preferred test because
Son, alternatively, whole test statements (model being performed, not comprising test data) in the test case are extracted conduct
The preferred test factor, alternatively, extracting the partial test sentence in the test case as the preferred test
The factor.
The use-case generation unit 22 ' is according to the preferred test factor, the one or more preferred test cases of generation.
Specifically, the use-case generation unit 22 ' is using the preferred test factor as the base for generating preferred test case
The preferred test factor and any other element for generating test case are combined by this element, with generation one or
Multiple preferred test cases.
For example, when the preferred test factor is test data, it can be by the preferred test factor and other execution moulds
Type is combined, to generate preferred test case；It if, can be by the preferred survey when the preferred test factor is performs model
The examination factor is combined with other test datas, to generate preferred test case；If when the preferred test factor is test statement
When, then the preferred test factor can be inserted into other test cases or be combined with other test cases, to generate preferred survey
Example on probation.
Preferably, the use-case generation unit 22 ' can be used for following at least any one：
- be combined one or more preferred test factors with other test cases, it is one or more excellent with generation
Select test case；If for example, the preferred test factor is test data Z, another test case is by test data z with performing mould
Type k is formed, then replaces the test data z using the preferred test factor Z, so as to which the test case generated (be wrapped
It includes test data Z and is used as the preferred test case with performing model k).Here, " other test cases " includes but unlimited
In preferred test case or not preferred test case.
- be combined two or more preferred test factors, with the one or more preferred test cases of generation；Example
Such as, if the preferred test factor includes test data p1, test data p2, test data p3, execution model q1, execution model
Q2, perform model q3, then can by the combination { p1, p2, p3 } of the test data with perform model combination { q1, q2, q3 } into
Row permutation and combination performs the arbitrary one or more groups of combinations generated as the preferred test case, such as test data p1+
Model q1, test data p1+ perform model q2, and test data p1+ performs model q3, and test data p2+ performs model q1, test
Data p2+ performs model q2, and test data p2+ performs model q3, and test data p3+ performs model q1, and test data p3+ is performed
Model q2, test data p3+ perform model q3 etc..
If here, those skilled in the art will be understood that the newly-generated preferred test case triggers system vulnerability,
Then it is still retained as preferred test case, it, can be by it from preferred test case if not triggering system vulnerability
It is deleted, so as to continuous iteration, to generate outstanding test case.
Fig. 3 shows a kind of method flow diagram for memory system testing according to a further aspect of the present invention.Specifically,
In step sl, the test equipment obtains one or more test cases, wherein, the test case is described with that can trigger
The test data or test statement of the system vulnerability of storage system are associated；In step s 2, the test equipment is according to
Test case, the one or more preferred test cases of generation；In step s3, the test equipment is used according to the preferred test
Example, tests the storage system.
Here, the storage system includes traditional keyword database (such as MySQL) or distributed memory system/distribution
Formula database.
In step sl, the test equipment obtains one or more test cases, wherein, the test case with can
The test data or test statement for triggering the system vulnerability of the storage system are associated.
Specifically, in step sl, the test equipment with storage system by directly interacting, to obtain the storage system
The there is provided test case of system or the third party device with being capable of providing various test cases interact, to obtain the equipment
The test case provided.
Wherein, the test data or test statement of system vulnerability of the test case with the storage system can be triggered
It is associated：I.e. described test case includes that the system vulnerability of the storage system can be triggered, so as to cause the test of system bugs
Use-case；The system vulnerability of the storage system may be triggered by also including, but the test of system bugs is not triggered in practical operation
Use-case, test case such as comprising typical boundary value or comprising such as conditional statement, judge the complexity such as sentence and/or Do statement
The test case of the test statement of logic.
Preferably, the test case includes following at least any one, i.e., is comprising can trigger the storage system
The test case of the test data of system loophole, the test for performing model comprising the system vulnerability that can trigger the storage system
The test case of use-case, the boundary value comprising the storage system and/or exceptional value.
Here, those skilled in the art will be understood that each test case include test data with perform model (or
Make test model), the test data indicates concrete numerical value used by test every time, is included in the execution model multiple
Test statement, it is described perform model indicate the test according to testing procedure, test operation or testing process etc..
Therefore, in the storage system or third party device, the acquisition or generation of test case include following any way：
1. after candidate's test case is performed, candidate's test case of system vulnerability will be triggered as the test case；It 2. will
The actual case of system vulnerability is triggered in the storage system actual motion as test case；3. the storage system border will be included
The use-case of value or exceptional value is as the test case；4. by the condition test sentence comprising the storage system and/or judge to survey
The use-case of sentence is tried as the test case.Wherein, above-mentioned candidate's test case or test case are that can trigger or can
The use-case of storage system (i.e. system under test (SUT)) system vulnerability can be triggered, the test that includes for triggering the system vulnerability is used
Test data and/or execution model (test statement) in example.
In step s 2, the test equipment is according to the test case, the one or more preferred test cases of generation.
Specifically, in step s 2, the test equipment is according to the test case, by will be in the test case
It test data and/or performs model and combination is rearranged in the test case or by the test in the test case
Data and/or execution model are combined with other candidate's test cases (test case for such as not yet triggering system vulnerability), with
The one or more preferred test cases of generation.
In step s3, the test equipment tests the storage system according to the preferred test case.
Preferably, the method includes the steps S4 (not shown), wherein, in step s 4, the test equipment is according to institute
One or more test results of storage system are stated, the preferred test of the one or more with reference to corresponding to the test result is used
Example, determines the test report information corresponding to the test result.
Specifically, in step s 4, the test equipment ties one or more preferred test cases with corresponding test
Fruit is analyzed, such as the multiple preferred test case with corresponding test result is counted, is sorted out, so that it is determined that institute
State the test report information corresponding to test result.Wherein, include but not limited in the test report information such as to causing to be
Probability analysis, the analysis of system loophole obtain being likely to occur the data of problem or analysis obtains being likely to occur the execution of problem
Model etc..
If for example, there are two preferred test case A and B, preferably test case A includes test data X with performing model Y,
It is preferred that test case B includes test data X with performing model Z, the preferably test result of test case A is triggering system vulnerability,
It is preferred that the test result of test case B is do not trigger system vulnerability, then it is believed that triggering system vulnerability be " execution model Y " or
" test data X and the combination for performing model Y ".
It is highly preferred that in step s 4, the test equipment can be obtained in the test process of the preferred test case
Test relevant information；According to one or more test results of the storage system, with reference to corresponding to the test result
One or more preferably test case and the test relevant informations determine the test report letter corresponding to the test result
Breath.
Specifically, in step s 4, the test equipment can be obtained or by monitoring in real time with being capable of providing test
The equipment of relevant information such as interacts at the modes, obtains the test relevant information in the test process of the preferred test case；Its
In, test relevant information such as network configuration information, network real time information, storage system hardware or the software configuration information are deposited
Storage system hardware/software use state information etc..
Then, in step s 4, the test equipment is on the basis of the test result and preferred test case, with reference to
The test relevant information by analyzing the modes such as the test data in test process in real time, determines that the test result institute is right
The test report information answered.
For example, after upper example, if the test result of the preferred test case A is triggering system vulnerability, in step s 4,
The test equipment can analyze the network real-time status during the preferred test case A is tested, if network occurs
Shake etc. is abnormal, then " network jitter " can be also served as to the content in the test report information；Alternatively, in step s 4, institute
Storage system hardware/software use state information during the test can also be monitored by stating test equipment, if a certain performing
System loading exception during operation is then believed that triggering system vulnerability is " performing model Y " or is accurately further " to perform mould
The a certain operation of type Y ".
Preferably, in step sl, the test equipment can screen one or more candidate's test cases, with
One or more test cases are obtained, wherein, the survey of system vulnerability of the test case with the storage system can be triggered
Examination data or test statement are associated.
Specifically, in step sl, the test equipment with storage system by directly interacting, to obtain the storage system
The there is provided candidate's test case of system (such as the storage system in test or during system operation acquired in or generation use-case) or
Person interacts with being capable of providing the third party device of various candidate's test cases, and the candidate provided with obtaining the equipment, which tests, to be used
Example.Here, candidate's test case includes but not limited to arbitrary test case, including the various system vulnerabilities or not of can triggering
The test case of system vulnerability can be triggered.
Then, in step sl, the test equipment screens candidate's test case, and above-mentioned candidate is tested
System vulnerability can be triggered in use-case in test or may trigger the time of system vulnerability (such as comprising boundary value or exceptional value)
Test case is selected, as the test case.
Wherein, the test data or test statement of system vulnerability of the test case with the storage system can be triggered
It is associated：I.e. described test case includes that the system vulnerability of the storage system can be triggered, so as to cause the test of system bugs
Use-case；The system vulnerability of the storage system may be triggered by also including, but the test of system bugs is not triggered in practical operation
Use-case, test case such as comprising typical boundary value or comprising such as conditional statement, judge the complexity such as sentence and/or Do statement
The test case of the test statement of logic.
It is highly preferred that the method further includes step S5 (not shown) and step S6 (not shown)；Wherein, in step S5
In, for the test equipment according to the storage description information of the storage system, generation and the storage description information are corresponding
One or more test datas；In step s 6, the test equipment is according to the test data, generation and the test data
Corresponding one or more candidate's test case.
Specifically, in step s 5, the test equipment obtains the storage description information of the storage system, here, institute
Storage description information is stated including but not limited to the attribute information of different storage organizations (such as table, class, field), such as the storage
In system in different tables different field attribute information；The attribute information is included such as value type, value range, storage byte
Size limitation, boundary information, the data volume etc. of required generation.
Then, in step s 5, the test equipment is according to the storage description information, generation and the storage description letter
The corresponding one or more test datas of manner of breathing；Wherein, the test data includes normal value, exceptional value and boundary value.Here,
The generation quantity of the test data can be generated according to default setting or other specified set, such as fully intermeshing or specific arrangement
Deng.
For example, in step s 5, the test equipment generates number according to the attribute of each field in the storage system
According to if the attribute is " normal (normal) ", generating normal data, normal data include normal boundary value：Min,
Min+1, max-1, max, since most systems have special logic for 0 processing, if 0 between min and max,
Then 0 is also a normal boundary value.In addition to above-mentioned normal border, then random generation this area from min+2 to max-2
Between normal data.If field does not have customized border, then min and max is the data type (type) of the field
Border, if the min of uint8 is that 0, max is 255.If field has customized border, min and max are customized values.
If attribute is " pure border (pureboundary) ", represents and only generate normal boundary data.
If the attribute is " abnormal (abnormal) ", generation pure anomaly data are represented, include the boundary value max+1 of exception,
min-1.For some storage systems, the maximum storage byte-sized (size) or block size of record are conditional, the surveys
Examination equipment can also generate the data based on block size border.
Then, in step s 6, the test equipment sets or uses by being based on system default according to the test data
The test data is combined by the execution model template or test case template that family is provided with the template, with generation with
The corresponding one or more candidate's test cases of the test data.
Wherein, the syntax format of each operation defined in the template, such as class SQL syntax or other self-defined languages
Method；In the execution model template or test case template, such as increase including one or more, delete, look into, change storage system and commonly use
Operation or its combination, further, can also include such as conditional statement, judge the complex logics such as sentence and/or Do statement
Test statement.
Therefore, when changing the grammer of candidate's test case, it can directly modify to the template, then utilize
Candidate's use-case generating means are repaiied with generating multiple candidate's test cases so as to avoid to whole candidate's test cases
Change.
It is highly preferred that in step s 6, the test equipment can generate and the test number according to the test data
According to corresponding one or more candidate's test cases, wherein, the test case include it is one or more perform operate with
And operate corresponding checked operation with each perform.
Specifically, during candidate's test case is generated, the test equipment can be that each performs behaviour
Make to set corresponding checked operation.Wherein, it is described to perform operation including such as increasing, deleting, looking into, changing fundamental operation and such as item
Part sentence, the operation for judging the complex logics such as sentence and/or Do statement.
For example, for same data item, when often performing once insertion, update or delete operation to the data item, all
Calculate the correct result of the data item each field after corresponding operating is performed；Then, add in practical operation result with
The inquiry operation of result of calculation, so as to which above two operation be compared, so as to fulfill checked operation.
For the inquiry operation of same data item, it (for example is to be based on for certain field that it is regular, which to may be inserted into a batch,
Some ascending numerical) data, so as to generation simple queries operation or complex query operation (such as conditional inquiry behaviour
Make) when, being clear that return to how many record, and checked operation is realized by comparing.
Fig. 4 shows a kind of method flow diagram for memory system testing in accordance with a preferred embodiment of the present invention.Tool
Body, in step S1 ', the test equipment obtains one or more test cases, wherein, the test case is with that can touch
The test data or test statement for the system vulnerability for sending out storage system described are associated；In step S21 ', the test equipment
According to the test case, the preferred test factor of one or more of the test case is determined；It is described in step S22 '
Test equipment is according to the preferred test factor, the one or more preferred test cases of generation；In step S3 ', the test
Equipment tests the storage system according to the preferred test case.
Wherein, it is same or similar to correspond to step with shown in Fig. 3 by the step S1 ' of the test equipment, step S3 ', therefore
This is repeated no more, and is incorporated herein by reference.
In step S21 ', the test equipment according to the test case, determine one in the test case or
Multiple preferred test factors.
Specifically, in step S21 ', the test equipment tears the test case open according to the test case
Divide or decompose, thus using part or all of test data, test statement or the execution model in the test case as described in
It is preferred that test factor.Preferably, if learning certain part in the test case, such as test data or execution model trigger
System vulnerability, then using trigger the system vulnerability test data or perform model as the preferred test factor.
Herein, it is preferable that the preferred test factor includes following at least any one：
One or more test datas employed in the-test case；
One or more employed in the-test case perform models.
For example, in step S21 ', the test equipment extracts some test data in the test case
As the preferred test factor, alternatively, extracting whole test datas in the test case as described preferred
Test factor, alternatively, whole test statements (model being performed, not comprising test data) in the test case are extracted
It is used as the preferred test factor, alternatively, extracting the partial test sentence in the test case as described excellent
Select test factor.
In step S22 ', the test equipment generates one or more preferred tests according to the preferred test factor
Use-case.
Specifically, in step S22 ', the test equipment is used the preferred test factor as the preferred test of generation
The basic element of example, the preferred test factor and any other element for generating test case are combined, with generation
One or more preferred test cases.
For example, when the preferred test factor is test data, it can be by the preferred test factor and other execution moulds
Type is combined, to generate preferred test case；It if, can be by the preferred survey when the preferred test factor is performs model
The examination factor is combined with other test datas, to generate preferred test case；If when the preferred test factor is test statement
When, then the preferred test factor can be inserted into other test cases or be combined with other test cases, to generate preferred survey
Example on probation.
Preferably, in step S22 ', the test equipment can be used for following at least any one：
- be combined one or more preferred test factors with other test cases, it is one or more excellent with generation
Select test case；If for example, the preferred test factor is test data Z, another test case is by test data z with performing mould
Type k is formed, then replaces the test data z using the preferred test factor Z, so as to which the test case generated (be wrapped
It includes test data Z and is used as the preferred test case with performing model k).Here, " other test cases " includes but unlimited
In preferred test case or not preferred test case.
- be combined two or more preferred test factors, with the one or more preferred test cases of generation；Example
Such as, if the preferred test factor includes test data p1, test data p2, test data p3, execution model q1, execution model
Q2, perform model q3, then can by the combination { p1, p2, p3 } of the test data with perform model combination { q1, q2, q3 } into
Row permutation and combination performs the arbitrary one or more groups of combinations generated as the preferred test case, such as test data p1+
Model q1, test data p1+ perform model q2, and test data p1+ performs model q3, and test data p2+ performs model q1, test
Data p2+ performs model q2, and test data p2+ performs model q3, and test data p3+ performs model q1, and test data p3+ is performed
Model q2, test data p3+ perform model q3 etc..
If here, those skilled in the art will be understood that the newly-generated preferred test case triggers system vulnerability,
Then it is still retained as preferred test case, it, can be by it from preferred test case if not triggering system vulnerability
It is deleted, so as to continuous iteration, to generate outstanding test case.
It should be noted that the present invention can be carried out in the assembly of software and/or software and hardware, for example, can adopt
With application-specific integrated circuit (ASIC), general purpose computer or any other realized similar to hardware device.In one embodiment
In, software program of the invention can perform to realize steps described above or function by processor.Similarly, it is of the invention
Software program can be stored in computer readable recording medium storing program for performing (including relevant data structure), for example, RAM memory,
Magnetic or optical driver or floppy disc and similar devices.In addition, hardware can be used to realize in some steps or function of the present invention, example
Such as, as the circuit for coordinating to perform each step or function with processor.
In addition, the part of the present invention can be applied to computer program product, such as computer program instructions, when its quilt
When computer performs, by the operation of the computer, the method according to the invention and/or technical solution can be called or provided.
And the program instruction of the method for the present invention is called, it is possibly stored in fixed or moveable recording medium and/or passes through
Broadcast or the data flow in other signal bearing medias and be transmitted and/or be stored according to described program instruction operation
In the working storage of computer equipment.Here, including a device according to one embodiment of present invention, which includes using
Memory in storage computer program instructions and processor for executing program instructions, wherein, when the computer program refers to
When order is performed by the processor, method and/or skill of the device operation based on foregoing multiple embodiments according to the present invention are triggered
Art scheme.
It is obvious to a person skilled in the art that the invention is not restricted to the details of above-mentioned exemplary embodiment, Er Qie
In the case of without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter
From the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended power
Profit requirement rather than above description limit, it is intended that all by what is fallen within the meaning and scope of the equivalent requirements of the claims
Variation includes within the present invention.Any reference numeral in claim should not be considered as to the involved claim of limitation.This
Outside, it is clear that one word of " comprising " is not excluded for other units or step, and odd number is not excluded for plural number.That is stated in device claim is multiple
Unit or device can also be realized by a unit or device by software or hardware.The first, the second grade words are used for table
Show title, and do not represent any particular order.
Although front is specifically shown and describes exemplary embodiment, it will be understood to those of skill in the art that
It is that in the case of the spirit and scope without departing substantially from claims, can be varied from terms of its form and details.Here
Sought protection illustrates in the dependent claims.These of each embodiment are defined in following number clause
With other aspects：
1. a kind of method for memory system testing, wherein, this method includes：
A obtains one or more test cases, wherein, the test case and the system that the storage system can be triggered
The test data or test statement of loophole are associated；
B is according to the test case, the one or more preferred test cases of generation；
Wherein, this method further includes：
- according to the preferred test case, the storage system is tested.
2. according to the method described in clause 1, wherein, the test case includes following at least any one：
The test case of-the test data comprising the system vulnerability that can trigger the storage system；
The test case of-execution the model comprising the system vulnerability that can trigger the storage system；
The test case of-the boundary value comprising the storage system and/or exceptional value.
3. the method according to clause 1 or 2, wherein, the step b includes：
- according to the test case, determine the preferred test factor of one or more of the test case；
B1 is according to the preferred test factor, the one or more preferred test cases of generation.
4. according to the method described in clause 3, wherein, the preferred test factor includes following at least any one：
One or more test datas employed in the-test case；
One or more employed in the-test case perform models.
5. the method according to clause 3 or 4, wherein, the step b1 includes following at least any one：
- be combined one or more preferred test factors with other test cases, it is one or more excellent with generation
Select test case；
- be combined two or more preferred test factors, with the one or more preferred test cases of generation.
6. according to the method described in clause 1, wherein, the step a includes：
- one or more candidate's test cases are screened, to obtain one or more test cases, wherein, it is described
The test data or test statement of system vulnerability of the test case with that can trigger the storage system are associated.
7. according to the method described in clause 6, wherein, this method further includes：
X1 according to the storage description information of the storage system, generation it is corresponding with the storage description information one or
Multiple test datas；
X2 is according to the test data, generation and the corresponding one or more candidate's test cases of the test data.
8. according to the method described in clause 7, wherein, the step x2 includes：
- according to the test data, generation and the corresponding one or more candidate's test cases of the test data,
In, the test case includes one or more perform and operates and operate corresponding checked operation with each perform.
9. the method according to any one of clause 1 to 8, wherein, this method further includes：
R according to one or more test results of the storage system, one with reference to corresponding to the test result or
Multiple preferred test cases determine the test report information corresponding to the test result.
10. according to the method described in clause 9, wherein, the step r includes：
Test relevant information in the test process of-acquisition preferred test case；
- according to one or more test results of the storage system, one with reference to corresponding to the test result or
Multiple preferred test cases and the test relevant information, determine the test report information corresponding to the test result.
11. the method according to any one of clause 1 to 9, wherein, the storage system is distributed memory system.
12. a kind of test equipment for memory system testing, wherein, which includes：
Acquisition device, for obtaining one or more test cases, wherein, the test case is with that can trigger described deposit
The test data or test statement of the system vulnerability of storage system are associated；
Generating means, for according to the test case, the one or more preferred test cases of generation；
Wherein, which further includes：
Test device, for according to the preferred test case, testing the storage system.
13. according to the test equipment described in clause 12, wherein, the test case includes following at least any one：
The test case of-the test data comprising the system vulnerability that can trigger the storage system；
The test case of-execution the model comprising the system vulnerability that can trigger the storage system；
The test case of-the boundary value comprising the storage system and/or exceptional value.
14. the test equipment according to clause 12 or 13, wherein, the generating means include：
Factor specifying unit, for according to the test case, determining that one or more of described test case is preferred
Test factor；
Use-case generation unit, for according to the preferred test factor, the one or more preferred test cases of generation.
15. according to the test equipment described in clause 14, wherein, the preferred test factor includes following at least any one：
One or more test datas employed in the-test case；
One or more employed in the-test case perform models.
16. the test equipment according to clause 14 or 15, wherein, the use-case generation unit is for following at least any
：
- be combined one or more preferred test factors with other test cases, it is one or more excellent with generation
Select test case；
- be combined two or more preferred test factors, with the one or more preferred test cases of generation.
17. according to the test equipment described in clause 12, wherein, the acquisition device is used for：
- one or more candidate's test cases are screened, to obtain one or more test cases, wherein, it is described
The test data or test statement of system vulnerability of the test case with that can trigger the storage system are associated.
18. according to the test equipment described in clause 17, wherein, which further includes：
Data generating device, for the storage description information according to the storage system, generation and the storage description letter
The corresponding one or more test datas of manner of breathing；
Candidate's use-case generating means, for according to the test data, generation and corresponding one of the test data
Or multiple candidate's test cases.
19. according to the test equipment described in clause 18, wherein, candidate's use-case generating means are used for：
- according to the test data, generation and the corresponding one or more candidate's test cases of the test data,
In, the test case includes one or more perform and operates and operate corresponding checked operation with each perform.
20. the test equipment according to any one of clause 12 to 19, wherein, which further includes：
Reporting device, for one or more test results according to the storage system, with reference to the test result institute
The corresponding preferred test case of one or more, determines the test report information corresponding to the test result.
21. according to the test equipment described in clause 20, wherein, the reporting device is used for：
Test relevant information in the test process of-acquisition preferred test case；
- according to one or more test results of the storage system, one with reference to corresponding to the test result or
Multiple preferred test cases and the test relevant information, determine the test report information corresponding to the test result.
22. the test equipment according to any one of clause 12 to 21, wherein, the storage system is distributed storage
System.
Claims (14)
1. a kind of method for memory system testing, wherein, this method includes：
X1 is generated and the storage corresponding one or more of description information according to the storage description information of the storage system
Test data；
X2 is according to the test data, generation and the corresponding one or more candidate's test cases of the test data；
A screens one or more candidate's test cases, to obtain one or more test cases, wherein, it is described
The test data or test statement of system vulnerability of the test case with that can trigger the storage system are associated；
B is according to the test case, the one or more preferred test cases of generation；
Wherein, this method further includes：
- according to the preferred test case, the storage system is tested.
2. according to the method described in claim 1, wherein, the test case includes following at least any one：
The test case of-the test data comprising the system vulnerability that can trigger the storage system；
The test case of-execution the model comprising the system vulnerability that can trigger the storage system；
The test case of-the boundary value comprising the storage system and/or exceptional value.
3. according to the method described in claim 1, wherein, the step b includes：
- according to the test case, determine the preferred test factor of one or more of the test case；
B1 is according to the preferred test factor, the one or more preferred test cases of generation；
Wherein, the preferred test factor includes following at least any one：
One or more test datas employed in the-test case；
One or more employed in the-test case perform models；
One or more test statements employed in the-test case.
4. according to the method described in claim 3, wherein, the step b1 includes following at least any one：
- be combined one or more preferred test factors with other test cases, with the one or more preferred surveys of generation
Example on probation；
- be combined two or more preferred test factors, with the one or more preferred test cases of generation.
5. according to the method described in claim 1, wherein, the step x2 includes：
- according to the test data, generation and the corresponding one or more candidate's test cases of the test data, wherein,
The test case includes one or more perform and operates and operate corresponding checked operation with each perform.
6. the method according to any one of claims 1 to 5, wherein, this method further includes：
R is according to one or more test results of the storage system, with reference to the one or more corresponding to the test result
It is preferred that test case, determines the test report information corresponding to the test result.
7. according to the method described in claim 6, wherein, the step r includes：
Test relevant information in the test process of-acquisition preferred test case；
- according to one or more test results of the storage system, with reference to the one or more corresponding to the test result
It is preferred that test case and the test relevant information, determine the test report information corresponding to the test result.
8. a kind of test equipment for memory system testing, wherein, which includes：
Data generating device, for the storage description information according to the storage system, generation and the storage description information phase
Corresponding one or more test data；
Candidate's use-case generating means, for according to the test data, generation and corresponding one or more of the test data
A candidate's test case；
Acquisition device for being screened to one or more candidate's test cases, is used with obtaining one or more tests
Example, wherein, the test data or test statement of system vulnerability of the test case to that can trigger the storage system are related
Connection；
Generating means, for according to the test case, the one or more preferred test cases of generation；
Wherein, which further includes：
Test device, for according to the preferred test case, testing the storage system.
9. test equipment according to claim 8, wherein, the test case includes following at least any one：
The test case of-the test data comprising the system vulnerability that can trigger the storage system；
The test case of-execution the model comprising the system vulnerability that can trigger the storage system；
The test case of-the boundary value comprising the storage system and/or exceptional value.
10. test equipment according to claim 8, wherein, the generating means include：
Factor specifying unit, for according to the test case, determining that one or more of described test case is preferred and testing
The factor；
Use-case generation unit, for according to the preferred test factor, the one or more preferred test cases of generation；
Wherein, the preferred test factor includes following at least any one：
One or more test datas employed in the-test case；
One or more employed in the-test case perform models；
One or more test statements employed in the-test case.
11. test equipment according to claim 10, wherein, the use-case generation unit is for following at least any one：
- be combined one or more preferred test factors with other test cases, with the one or more preferred surveys of generation
Example on probation；
- be combined two or more preferred test factors, with the one or more preferred test cases of generation.
12. test equipment according to claim 8, wherein, candidate's use-case generating means are used for：
- according to the test data, generation and the corresponding one or more candidate's test cases of the test data, wherein,
The test case includes one or more perform and operates and operate corresponding checked operation with each perform.
13. the test equipment according to any one of claim 8 to 12, wherein, which further includes：
Reporting device, for one or more test results according to the storage system, with reference to corresponding to the test result
The preferred test cases of one or more, determine the test report information corresponding to the test result.
14. test equipment according to claim 13, wherein, the reporting device is used for：
Test relevant information in the test process of-acquisition preferred test case；
- according to one or more test results of the storage system, with reference to the one or more corresponding to the test result
It is preferred that test case and the test relevant information, determine the test report information corresponding to the test result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510213852.3A CN104850494B (en) | 2015-04-29 | 2015-04-29 | A kind of method and apparatus for memory system testing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510213852.3A CN104850494B (en) | 2015-04-29 | 2015-04-29 | A kind of method and apparatus for memory system testing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104850494A CN104850494A (en) | 2015-08-19 |
| CN104850494B true CN104850494B (en) | 2018-05-25 |
Family
ID=53850147
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510213852.3A Active CN104850494B (en) | 2015-04-29 | 2015-04-29 | A kind of method and apparatus for memory system testing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104850494B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106653092A (en) * | 2017-01-05 | 2017-05-10 | 上海剑桥科技股份有限公司 | Processing method and processing system of DDR (Double Data Rate) test waveform data file |
| CN107451056B (en) * | 2017-07-31 | 2020-11-10 | 深圳乐信软件技术有限公司 | Method and device for monitoring interface test result |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1622022A1 (en) * | 2004-07-22 | 2006-02-01 | Siemens Aktiengesellschaft | Automatic generation of test cases |
| CN101984416A (en) * | 2010-11-02 | 2011-03-09 | 中兴通讯股份有限公司 | Method and device for generating test case |
| CN102004691A (en) * | 2010-11-12 | 2011-04-06 | 中兴通讯股份有限公司 | Method and system for executing test case |
| CN103853652A (en) * | 2012-11-29 | 2014-06-11 | 百度在线网络技术（北京）有限公司 | Test case generation method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5107131B2 (en) * | 2008-04-28 | 2012-12-26 | 株式会社東芝 | Test case generation device, generation method thereof, and program for test case generation |
-
2015
- 2015-04-29 CN CN201510213852.3A patent/CN104850494B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1622022A1 (en) * | 2004-07-22 | 2006-02-01 | Siemens Aktiengesellschaft | Automatic generation of test cases |
| CN101984416A (en) * | 2010-11-02 | 2011-03-09 | 中兴通讯股份有限公司 | Method and device for generating test case |
| CN102004691A (en) * | 2010-11-12 | 2011-04-06 | 中兴通讯股份有限公司 | Method and system for executing test case |
| CN103853652A (en) * | 2012-11-29 | 2014-06-11 | 百度在线网络技术（北京）有限公司 | Test case generation method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104850494A (en) | 2015-08-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9613074B2 (en) | Data generation for performance evaluation | |
| US10354002B2 (en) | Interaction relationship building and explorer for dashboard | |
| US8640110B2 (en) | Business object service simulation | |
| US10713152B2 (en) | Automated path generator for optimized application testing | |
| US20140058789A1 (en) | Process model generation and weak-spot analysis from plain event logs | |
| EP2207106A2 (en) | Complex relational database extraction system and method with respective based dynamic data modeling | |
| US20080189308A1 (en) | Apparatus and Methods for Displaying and Determining Dependency Relationships Among Subsystems in a Computer Software System | |
| US20120297364A1 (en) | Augmented design structure matrix visualizations for software system analysis | |
| Popić et al. | Data generators: a short survey of techniques and use cases with focus on testing | |
| CN109753286A (en) | A method of the code method based on functional label counts its call number | |
| Telea et al. | Visual software analytics for the build optimization of large-scale software systems | |
| CN108089982A (en) | Test method, device, electronic equipment and computer readable storage medium | |
| Teodorov et al. | Past‐Free [ze] reachability analysis: reaching further with DAG‐directed exhaustive state‐space analysis | |
| CN104850494B (en) | A kind of method and apparatus for memory system testing | |
| Badreddin et al. | Exploring a model-oriented and executable syntax for UML attributes | |
| CN107729349B (en) | Method and device for automatically generating feature data set based on metadata | |
| CN101930401B (en) | Detection object-based software vulnerability model detection method | |
| Konur | Towards Light‐Weight Probabilistic Model Checking | |
| CN114840251A (en) | Script processing method, terminal, storage medium and program product | |
| Hawick | Fluent interfaces and domain-specific languages for graph generation and network analysis calculations | |
| Falchi | IT tools for the management of multi—Representation geographical information | |
| Kruse | Enhanced test case generation with the classification tree method | |
| CN110598148A (en) | Page operation behavior unifying method based on H5 and related equipment | |
| Trabelsi et al. | A new test suite reduction approach based on hypergraph minimal transversal mining | |
| CN104978264B (en) | The smart dynamic modulation of picture library in configuration software |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |