CN103944778B - A kind of distributed event injection device based on combined test collection - Google Patents
A kind of distributed event injection device based on combined test collection Download PDFInfo
- Publication number
- CN103944778B CN103944778B CN201410125856.1A CN201410125856A CN103944778B CN 103944778 B CN103944778 B CN 103944778B CN 201410125856 A CN201410125856 A CN 201410125856A CN 103944778 B CN103944778 B CN 103944778B
- Authority
- CN
- China
- Prior art keywords
- event
- injection
- state
- combined test
- injector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000002347 injection Methods 0.000 title claims abstract description 178
- 239000007924 injection Substances 0.000 title claims abstract description 178
- 238000012360 testing method Methods 0.000 title claims abstract description 97
- 230000002159 abnormal effect Effects 0.000 claims description 16
- 238000004458 analytical method Methods 0.000 claims description 12
- 238000003556 assay Methods 0.000 claims description 11
- 238000012544 monitoring process Methods 0.000 claims description 5
- 230000004888 barrier function Effects 0.000 claims description 2
- 230000005540 biological transmission Effects 0.000 claims description 2
- 238000000034 method Methods 0.000 abstract description 21
- 238000013461 design Methods 0.000 abstract description 4
- 230000008901 benefit Effects 0.000 abstract description 3
- 238000004088 simulation Methods 0.000 description 16
- 238000011156 evaluation Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000011160 research Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 230000009897 systematic effect Effects 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 1
- 239000010931 gold Substances 0.000 description 1
- 229910052737 gold Inorganic materials 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000010977 jade Substances 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Abstract
A kind of distributed event injection device based on combined test collection the present invention relates to be directed to MATLAB software system.The present invention includes controller, combined test collection generation module, event injection module and state analyzing module.The present invention is in event injection technique, take into full account the Distributed Design structure that nowadays computer system is generally used, take into full account that different target unit is suitable for injection into different type failure and the in various degree problem of load, the distributed event injection mode based on combined test collection is introduced, more flexible, efficient event injection is realized.Therefore the present invention have the advantages that applied widely, resource consumption is few, event injection mode is flexible, with strong points, with customizability.Distributed Fault-Tolerance System is can be widely applied to, especially in the availability test and appraisal of special tolerant system.
Description
Technical field
A kind of distributed event injection device based on combined test collection the present invention relates to be directed to MATLAB software system.
Background technology
With the development of computer technology, MATLAB software systematic difference field is more and more wider, and tolerant system sets
Meter is also increasingly complicated with test and appraisal problem encountered.For traditional hardware and software failure, the test and appraisal of computer system availability are general
Realized using fault filling method.However, at some in particular cases, such as the unplanned property failure of system, workload are notable
Increase or the work of long-time saturation etc. can all cause the non-faulting class event such as machine of delaying, and then bring availability to decline, traditional event
Barrier injection technique can not meet the availability test and appraisal demand of MATLAB software system.Therefore, extension conventional failure injection skill
Art, it is considered to the availability impact factor outside failure, proposes a kind of thing of the application-oriented levels such as combination failure injection, pressure test
Part injection technique.Event injection technique refers to inject event by goal systems, while observation and recovery system are to being injected
The reaction of event is simultaneously analyzed to recovery information, so as to provide the process about result to tester.
At present, the research both at home and abroad for event injection is still less.Existing patent mainly includes：1）" based on event injection
Computer network dependability evaluation device（200620020624.0）”.The patent be based on event injection technique, for
Different stage fault tolerant mechanism, the problem in terms of various network events, major concern network security is injected to goal systems.It is main suitable
For to simple target system injection network correlation type event, not considering the Special use environment of distributed system, do not have more
The problems such as being related to the combination event of different target unit in goal systems to inject or apply load in various degree.2）A kind of " script
Injection event-handling method and system（200710303986.X）”.The patent proposes that system is received from script and injects detecting system
The script event of output, detects whether there is XSS attack behavior and with quantized versions output result, with patent application model of the present invention
Enclose, it is different using method.3）" automatic intelligent single-particle fault injector（200510111494.1）" be directed to
Space radiation environment is simulated when HDL is emulated or the medium situation of interface communication, and " Event-controlled is applied to
error injection system(5008885)”、“Single-event transient injection simulation
Method for high-frequency circuits (CN2013113637620130418) " is used with patent of the present invention
Method or range of application are different.Existing document relates generally to the credibility based on event injection, reliability, security and software
Debugging and robustness problems, are first to propose event model or evaluation and test model, for different target Systematic selection corresponding event class
Type realizes that concurrent event injects, the correlation properties index of final evaluation and test goal systems or software.But do not surveyed using combination
Examination diversity method, combination event injection or the different degrees of load of applying of different target unit in goal systems etc. is not accounted for more and is asked
Topic（Including " Kang Jia are based on the research of the dependability evaluation instrument of event injection and realize [D] Harbin Institute of Technology 2007 ",
" Liu Yu nanmus is based on the design of the reliability evaluating method of event injection and realizes [D] Harbin Institute of Technology 2009 ", " face state
Flat is based on the research of the security evaluating method of event injection and realizes [D] Harbin Institute of Technology 2009 ", " yellow Yongping, often
Roc flies, Guo Kai, and the kind of gold and jade is based on the software debugging method of event injection mechanism and realizes [J] Jilin University journal（Engineering
Version）(09) " and " Zhang Dawei is based on application oriented software robustness evaluation and test [D] Harbin industry of event injection .2012
University 2009 "）.
From the above analysis, the deficiency of the research of event injection at this stage is mainly：1）Based on a fixed event note
Enter all goal systems of set pair and inject unified event, consumption is big, easily causes the wasting of resources；2）Distributed object is not accounted for
Different target unit is suitable for injection into different type failure or in various degree load in system, i.e., injection mode is dumb, specific aim
It is not strong；3）The customizability of event injection mode is not strong, is not suitable for the personalized index of test and appraisal.It is therefore proposed that one kind is directed to
Distributed system, is very important with the event method for implanting that combined test mode set is realized, its benefit is to be capable of achieving more
Specific aim, more flexibly, efficient event injection.
The content of the invention
Each object element in goal systems is had more with the injection of combined test mode set it is an object of the invention to realize
Targetedly event, has reached flexible, efficient implementation event and has injected, and then obtained the purpose of computer system availability, energy
Enough for the distributed event based on combined test collection that the test and appraisal of MATLAB software system provide efficient analyze data injects dress
Put.
The object of the present invention is achieved like this：
The present invention includes controller, combined test collection generation module, event injection module and state analyzing module；
Controller control combination test set generation module receives user instruction and generates combined test collection parameter list；
Combined test collection generation module includes scanner and event model storehouse, and scanner receives user instruction, scans target
System, analysis return including the scanning result including all fragile vertex types, it is determined that injection event type；Wrap in event model storehouse
Include the fault type that fault model word bank and pressure model word bank two parts fault model word bank include be based on hardware, software or
The failure of simulated implementation, pressure model word bank is responsible for output pressure load parameter, and scanner sends to fault model word bank and obtains
The request of fault type parameter is injected, the fault type parameter list for returning is received, scanner sends to pressure model word bank and obtains
The request of load generation mode and parameter is taken, the output loading parameter list for returning is received；Scanner is clear by fault type parameter
Single and output loading parameter list merges, and generates combined test collection parameter list；Controller is to the event in event injection module
Injector sends combined test collection generation module and completes signal, and combined test collection parameter list is finally sent to each thing by scanner
The event injection engine of part injector, entry event injection module；
Event injection module includes the set of event injector and state monitor, and the set of event injector is injected including event
Device 1, event injector 2 ..., event injector N1, wherein N1 are positive integer, and each event injector draws comprising event injection
Hold up with event inject list, distributed object element set include object element 1, object element 2 ..., object element N2, its
Middle N2 is positive integer；Under control of the controller, when combined test collection generation module completion signal is received, each event injector is received
Combined test collection parameter list that scanner sends simultaneously is stored in injection engine, and the combined test collection parameter that will be injected in engine is clear
Present event injector injection event type in single list with injection matches, and injection event type is determined after matching and to target
Unit implements event injection, and after the completion of injection, combined test collection parameter list is sent to state monitor by event injector,
Controller sends event injection and completes signal to state monitor；Signal, state monitor monitoring are completed when event injection is received
Event injector injects success or not, and injection state set should include " success ", " failure " and "abnormal", and will injection state letter
Breath is sent to controller, if injection state is " success ", event injection module task is completed, and controller is to state analyzing module
In state acquisition device send event injection module and complete signal, be prepared to enter into state analyzing module；If injection state is " mistake
Lose " or "abnormal", controller needs control scanner to send combined test collection parameter list to each event injector again, again
Implementation event is injected, and until event injection module Mission Success is completed, finally enters state analyzing module；
State analyzing module includes state acquisition device, interpretation of result device and result display, under control of the controller, works as shape
State collector receives event injection module and completes signal, and state acquisition device gathers the response shape after each object element injection event
State information, the responsive state information aggregate of object element should include " correct ", " mistake ", "abnormal" and " time-out ", and will respond
Status information is sent to interpretation of result device and result display；
Under control of the controller, interpretation of result device to the responsive state information that state acquisition device sends integrate and divided
Analysis, increases according to the dramatically increasing of cpu busy percentage, the quick consumption of memory headroom, memory usage percentage or system delay
Situation, using Fuzzy AHP, in interval [0,1], the availability of assay goal systems or each object element,
（0.75,1] it is on " availability is good ",（0.5,0.75] it is on " availability is general ",（0.25,0.5 it is " availability on]
It is poor ", it is " availability is extremely low " four ranks on [0,0.25], finally this assay result and data foundation are sent to
As a result display；Under control of the controller, the data that as a result display reception state collector and interpretation of result device send, show
Show the responsive state information of object element after event injection, including " correct ", " mistake ", "abnormal" and " time-out ", display target
The assay result and data foundation of system or each object element, generation printed report feed back to user.
The beneficial effects of the invention are as follows：
The present invention is on the basis of Failure Injection Technique, it is also contemplated that the application layer non-faulting class of other infringement system availabilities
Event, introduces pressure load, and simulation cycle is repeatedly injected event or simulation increases the situations such as workload.Skill is injected in event
In art, the Distributed Design structure that nowadays computer system is generally used is taken into full account, take into full account that different target unit is suitable to
Injection different type failure and the in various degree problem of load, introduce the distributed event injection mode based on combined test collection,
Realize more flexible, efficient event injection.Therefore the present invention has that applied widely, resource consumption is few, event injection mode
Flexibly, it is with strong points, there is customizability.Distributed Fault-Tolerance System is can be widely applied to, especially special fault-tolerant system
In the availability test and appraisal of system.
Brief description of the drawings
Fig. 1 is based on the distributed event injection device function structure chart of combined test collection；
Fig. 2 is based on event injection module workflow diagram in the distributed event injection device of combined test collection；
Fig. 3 is based on the distributed event injection device specific implementation illustration of combined test collection.
Specific embodiment
1-3 is described further to the present invention below in conjunction with the accompanying drawings.
Event injection device based on combined test collection of the present invention, on the basis of direct fault location, it is also contemplated that its
He damages the application layer non-faulting class event of system availability, such as pressure load.The present apparatus is realized to each in goal systems
Object element has more targetedly event with the injection of combined test mode set, has reached flexible, efficient implementation event injection, enters
And the purpose of computer system availability is obtained, efficient analyze data can be provided for the test and appraisal of MATLAB software system.
Present event injection device includes 4 main modulars, is respectively controller, combined test collection generation module, event note
Enter module and state analyzing module.Function structure chart is shown in accompanying drawing 1.
1st, controller
It is responsible for control combination test set generation module to receive user instruction and generate combined test collection parameter list, event note
Enter module reception combined test collection parameter list to inject and export responsive state information to implement event, state analyzing module is received
Responsive state information and analyze, feedback event injection and availability evaluation result to user whole process.
2nd, combined test collection generation module
Combined test collection generation module includes scanner and event model storehouse.
Scanner receives user instruction first, scans goal systems, it is determined that the object element of the event of implementation injection,
Scanning object element, return should include all fragile vertex types of system scanning result, post analysis scanning result
To determine injection event type, finally export combined test collection parameter list and be sent to event injection module.
Event model storehouse includes fault model word bank and pressure model word bank two parts.The failure that fault model word bank is included
Type can be failure based on hardware, software or simulated implementation etc..Pressure model word bank is responsible for output pressure load parameter, tool
It is repeated cyclically injection two kinds of pressing creation patterns of event schema and simulation output system workload pattern, if necessary two kinds
Mode of operation can be carried out simultaneously.
Under control of the controller, combined test collection generation module workflow：（1）Scanner receives user instruction, scanning
Goal systems, analysis return including the scanning result including all fragile vertex types, so that it is determined that injection event type；（2）
Scanner sends the request for obtaining injection fault type parameter to fault model word bank, receives the fault type parameter for returning clear
It is single.Meanwhile, scanner sends the request for obtaining load generation mode and parameter to pressure model word bank, receives the output for returning and bears
Carry parameter list；（3）Scanner merges fault type parameter list and output loading parameter list, generation combined test collection ginseng
Number inventory；（4）Controller sends combined test collection generation module and completes signal to the event injector in event injection module, sweeps
The last event injection engine that combined test collection parameter list is sent to each event injector of device is retouched, event injection is prepared to enter into
Module.
Generation on output loading parameter, two kinds of pressing creation patterns of pressure model word bank are as follows：
（1）It is repeated cyclically injection event schema
Event injector is repeated cyclically the same event of injection to its corresponding object element of combined test collection respectively
Event, cycle Period.
（2）Simulation output system workload pattern
1. simulated target system worked well state, writes load reference program PROGRAM, is run on each object element
Program PROGRAM, write or imprinting program PROGRAM perform script Script, respectively on each object element reset；2. create
The pressure test scene scenario of output system workload is intended in modeling, and virtual work mission script Script is imported into field
Scape.Scenario parameters include the horizontal Load of load pressure for each object element.The horizontal key element of its load pressure includes program
PROGRAM performs iterations Iteration, iteration free time IterationFree, program PROGRAM and performs operation
Simulation think time IterationThink；3. operating pressure test scene scenario, completes output and is directed to each object element
The horizontal Load of load pressure.
3rd, event injection module
Event injection module includes the set of event injector and state monitor.Wherein, event injector set includes thing
Part injector 1, event injector 2 ..., event injector N1, wherein N1 are positive integer.Each event injector includes event
Injection engine and event injection list.Additionally, distributed object element set includes object element 1, object element 2 ..., mesh
Mark unit N2, wherein N2 are positive integer.
Under control of the controller, when combined test collection generation module completion signal is received, each event injector receives scanning
Combined test collection parameter list that device sends simultaneously is stored in injection engine, then the combined test collection parameter list that will be injected in engine
Match with the present event injector injection event type in injection list, injection event type is determined after matching and to target list
First implementation event injection.After the completion of injection, combined test collection parameter list is sent to state monitor by event injector, control
Device processed sends event injection and completes signal to state monitor.
Signal, state monitor monitoring event injector injection success or not are completed when event injection is received.Injection state
Set should include " success ", " failure " and "abnormal", and injection status information is sent into controller.If injection state for " into
Work(", then event injection module task completion, controller sends event injection module to the state acquisition device in state analyzing module
Signal is completed, state analyzing module is prepared to enter into；If injection state is " failure " or "abnormal", controller needs to control scanner
Again combined test collection parameter list is sent to each event injector, is again carried out event injection, circulated according to this, until event note
Enter module design task to successfully complete, finally enter state analyzing module.
4th, state analyzing module
State analyzing module includes state acquisition device, interpretation of result device and result display.
Under control of the controller, signal is completed when state acquisition device receives event injection module, the collection of state acquisition device is each
Responsive state information after object element injection event, the responsive state information aggregate of object element should include " correct ", " mistake
By mistake ", "abnormal" and " time-out " etc..And by responsive state information transmission to interpretation of result device and result display.
Under control of the controller, interpretation of result device to the responsive state information that state acquisition device sends integrate and divided
Analysis, and increased according to the dramatically increasing of cpu busy percentage, the quick consumption of memory headroom, memory usage percentage or system delay
Plus situations such as, using Fuzzy AHP, in interval [0,1], assay goal systems or each object element it is available
Property,（0.75,1] it is on " availability is good ",（0.5,0.75] it is on " availability is general ",（0.25,0.5 it is on]
" availability is poor ", is " availability is extremely low " four ranks on [0,0.25], finally by this assay result and data according to
According to being sent to result display.
Under control of the controller, the data that as a result display reception state collector and interpretation of result device send, display
The responsive state information of object element after event injection, including " correct ", " mistake ", "abnormal" and " time-out ", display target system
The assay result and data foundation of system or each object element.Finally, generation printed report feeds back to user.
The present invention is using the distributed event injection device based on combined test collection come the availability of evaluation system, and it is right to test and assess
As mainly for distributed computer tolerant system.The present embodiment is described in detail using present event injection device to four
Program PROGRAM is carried out with combined test mode set injection event, acquisition system in the distributed system of Fedora system simulations
The assessment process of availability.Thus the applications such as the availability test and appraisal of other Distributed Fault-Tolerance Systems be may extend into upper.
Present event injection device includes 4 main modulars, is respectively controller, combined test collection generation module, event note
Enter module and state analyzing module.
First, installed on four computers and similarly configure Fedora systems, be respectively FM1, FM2, FM3 and FM4, simulation
4 distributed object units 1,2,3,4 of goal systems, same program PROGRAM is run on four computers simultaneously, its
Basic function is：（1）When perceive the system due to injection event causes cpu busy percentage too high when, independently limit and reduce this
Virtual machine cpu busy percentage；（2）When perceiving the system because injection event causes memory usage too high or internal memory free space
When too small, dynamic assigning memory space reduces memory usage to meet system worked well demand；（3）This program can lead to
Cross order line terminal（terminal）The cpu busy percentage, memory usage, the idle sky of internal memory of the system are shown and refreshed in real time
Between, allocated memory headroom account for the information such as the percentage of the total internal memory of system.（4）Program PROGRAM is simultaneously as load reference
Program, used as the carrier to each object element output loading pressure, simulation system is because of workload increase etc. caused by fault-tolerant
Situation.
1st, controller and combined test collection generation module
Controller is responsible for control combination test set generation module and receives user instruction and generate combined test collection parameter list,
Event injection module receives combined test collection parameter list and injects and export responsive state information to implement event, state analysis mould
Block receive responsive state information and analyze, feedback event injection and availability evaluation result to user whole process.Combination is surveyed
Examination collection generation module includes scanner and event model storehouse.Event model storehouse includes fault model word bank and pressure model again
Storehouse.The fault type that fault model word bank is included can be failure based on hardware, software or simulated implementation etc..Pressure model
Output pressure load parameter is responsible in storehouse, and event schema and simulation output system workload pattern two are injected with being repeated cyclically
Pressing creation pattern is planted, two kinds of mode of operations can be carried out simultaneously if necessary.
（1）Scanner receives user instruction first, scans goal systems, and what analysis was returned exists including all fragile vertex types
Interior scanning result with determine inject event type.
（2）Scanner sends the request of injection fault type parameter needed for obtaining to fault model word bank, receives what is returned
Fault type parameter list.Correspondence FM1, FM2, FM3 and FM4, event injection object is respectively cpu busy percentage Ecpu1、Ecpu2, and
Memory usage Ememory1、Ememory2, i.e., to computer system FM1, FM2 injects particularly for occupancy cpu busy percentage simultaneously（CPU
Consumption-type）The event of type（Program）Eventcpu, to computer system FM3, FM4 injects empty particularly for committed memory simultaneously
Between（Memory consumption type）The event of type（Program）Eventmemory。
Meanwhile, scanner sends the request for obtaining load generation mode and parameter to pressure model word bank, receives what is returned
Output loading parameter list.Load generation includes being repeated cyclically the two kinds of work of injection event and simulation output system workload
Pattern.
When 1. using injection event schema is repeated cyclically
Setting is repeatedly injected the cycle of event, and correspondence four Fedora system FM1, FM2, FM3 and FM4 set thing respectively
Part injection length is spaced（Cycle）It is Periodcpu1=1s、Periodcpu2=2s、Periodmem1=1s、Periodmem2=2s。
When 2. using simulation output system workload pattern
First, write or imprinting load reference program PROGRAM perform script Script, due to four Fedora systems
Identical program PROGRAM is run simultaneously, therefore four Fedora systems FM1, FM2, FM3 and FM4 are also suitable same program
Operation script Script is performed, for task of resetting；
Secondly, the pressure test scene of simulation output system workload is created（scenario）, script Script is led
Enter scene.Scenario parameters are included respectively for four load pressure levels of computer system FM1, FM2, FM3 and FM4
Loadcpu1、Loadcpu2、Loadmem1And Loadmem2.Wherein the horizontal key element of each load pressure includes that program PROGRAM execution changes
Generation number Iterationcpu1、Iterationcpu2、Iterationmem1And Iterationmem2, iteration free time
IterationFreecpu1、IterationFreecpu2、IterationFreemem1And IterationFreemem2, program
PROGRAM performs the simulation think time IterationThink of operationcpu1、IterationThinkcpu2、
IterationThinkmem1And IterationThinkmem2。
（3）Scanner merges fault type parameter list and output loading parameter list, generates combined test collection
Parameter list.
（4）Controller sends combined test collection generation module and completes signal to the event injector in event injection module,
Scanner is last to inject engine by the event that combined test collection parameter list is sent to each event injector, is prepared to enter into event note
Enter module.
2nd, event injection module
Event injection module includes the set of event injector and state monitor.Event injector set bag in the present embodiment
Include event injector 1,2,3,4.Four event injectors 1,2,3,4 are directed to FM1, FM2, FM3 and FM4, i.e. object element respectively
1、2、3、4.In each event injector engine and event injection list are injected comprising event.Under control of the controller, when receiving
Combined test collection generation module completes signal, and the combined test collection parameter list that each event injector receiver-scanner sends is simultaneously
Injection engine is stored in, then the combined test collection parameter list that will be injected in engine injects with the present event injector in injection list
Event type matches, and injection event type is determined after matching and implements event injection to object element.After the completion of injection, thing
Combined test collection parameter list is sent to state monitor by part injector, and controller sends event and injected to state monitor
Into signal.
Injection event class in combined test collection parameter list and injection list of the event injector in injection engine
The matching result of type implements the event injection to object element, state monitor monitoring event injection result.
（1）According to fault type parameter list, for the test object E of Fedora systems FM1, FM2cpu1、Ecpu2, in thing
The event for taking cpu busy percentage type is stored in part injector 1 and event injector 2（Program）Eventcpu；For Fedora systems
The test object E of system FM3, FM4memory1、Ememory2, committed memory space is stored in event injector 3 and event injector 4
The event of type（Program）Eventmemory；
（2）At the T1 moment, event injector 1 and event injector 2 inject event to Fedora systems FM1 and FM2（Journey
Sequence）Eventcpu；At the T2 moment, event injector 3 and event injector 4 inject event to Fedora systems FM3 and FM4（Journey
Sequence）Eventmemory；
Meanwhile, according to output loading parameter list, output loading.
When 1. using injection event schema is repeated cyclically
Event injector 1 is every time cycle Periodcpu1Event Event is repeatedly injected to FM1cpuOnce；Event is injected
Device 2 is every time cycle Periodcpu2Event Event is repeatedly injected to FM2cpuOnce；Event injector 3 is every the time cycle
Periodmem1Event Event is repeatedly injected to FM3memoryOnce；Event injector 4 is every time cycle Periodmem2To FM4
It is repeatedly injected event EventmemoryOnce.
When 2. using simulation output system workload pattern
Run the pressure test scene of simulation output system workload（scenario）, respectively for four Fedora systems
System FM1, FM2, FM3 and FM4 output loading stress level Loadcpu1、Loadcpu2、Loadmem1And Loadmem2。
（3）Signal, state monitor monitoring event injector injection success or not are completed when event injection is received.Injection shape
State set should include " success ", " failure " and "abnormal", and injection status information is sent into controller.If injection state is
" success ", then event injection module task completion, controller sends event and injects to the state acquisition device in state analyzing module
Module completes signal, is prepared to enter into state analyzing module；If injection state is " failure " or "abnormal", controller needs control to sweep
Retouch to think highly of and newly send combined test collection parameter list to each event injector, be again carried out event injection, circulate according to this, until thing
Part injection module Mission Success is completed, and finally enters state analyzing module.
3rd, state analyzing module
State analyzing module includes state acquisition device, interpretation of result device and result display.
（1）Under control of the controller, signal, the collection of state acquisition device are completed when state acquisition device receives event injection module
Four Fedora systems FM1, FM2, FM3 and FM4 the responsive state information of program PROGRAM and each after injection event
The data variation information of Fedora system CPUs utilization rate or memory usage, the responsive state information of FM1, FM2, FM3 and FM4
Set includes that " correct ", " mistake ", "abnormal" and " time-out ", and the responsive state information that will be collected are sent to result through integration
Analyzer and result display；
（2）Under control of the controller, interpretation of result device is integrated to the responsive state information that state acquisition device sends
Analysis, and according to the dramatically increasing of cpu busy percentage, the quick consumption of memory headroom, memory usage percentage or system delay
Situations such as increase, analyze the program PROGRAM run in four Fedora systems and can also after through present apparatus injection event
Complete function（1）、（2）With（3）.Using Fuzzy AHP, in interval [0,1], four Fedora systems of assay
Availability,（0.75,1] it is on " availability is good ",（0.5,0.75] it is on " availability is general ",（0.25,0.5]
Upper is " availability is poor ", is " availability is extremely low " four ranks on [0,0.25], finally by this assay result sum
Result display is sent to according to foundation；
（3）Under control of the controller, the data that as a result display reception state collector and interpretation of result device send, show
Show four responsive state information of Fedora systems after event injection, including " correct ", " mistake ", "abnormal" and " time-out ", it is aobvious
Show four Fedora network analyses evaluation results and data foundation.Finally, generation printed report feeds back to user.
A kind of distributed event injection device based on combined test collection proposed by the invention, by load pressure and failure
Injection technique is combined together, using based on combined test mode set, can more flexibly, be efficiently completed distributed fault-tolerance system
System availability test and appraisal.With applied widely, resource consumption it is few, event injection mode is flexible, with strong points, with customizability
The advantages of.Distributed Fault-Tolerance System is can be widely applied to, especially in the availability test and appraisal of special tolerant system.
Claims (1)
1. a kind of distributed event injection device based on combined test collection, including controller, combined test collection generation module, thing
Part injection module and state analyzing module, it is characterised in that：
Controller control combination test set generation module receives user instruction and generates combined test collection parameter list；
Combined test collection generation module includes scanner and event model storehouse, and scanner receives user instruction, scans goal systems,
Analysis return including the scanning result including all fragile vertex types, it is determined that injection event type；Event model storehouse includes event
Barrier model word bank and pressure model word bank two parts；The fault type that fault model word bank is included is based on hardware, software or mould
Intend the failure realized, pressure model word bank is responsible for output pressure load parameter, and scanner sends to fault model word bank and obtains note
Enter the request of fault type parameter, receive the fault type parameter list for returning, scanner sends to pressure model word bank and obtains
The request of load generation mode and parameter, receives the output loading parameter list for returning；Scanner is by fault type parameter list
Merge with output loading parameter list, generate combined test collection parameter list；Controller is noted to the event in event injection module
Enter device and send combined test collection generation module completion signal, combined test collection parameter list is finally sent to each event by scanner
The event injection engine of injector, entry event injection module；
Event injection module includes the set of event injector and state monitor, and the set of event injector includes event injector 1,
Event injector 2 ..., event injector N1, wherein N1 are positive integer, each event injector comprising event injection engine and
Event injects list, and distributed object element set includes object element 1, object element 2 ..., wherein object element N2, N2
It is positive integer；Under control of the controller, when combined test collection generation module completion signal is received, each event injector receives scanning
Combined test collection parameter list that device sends simultaneously is stored in injection engine, the combined test collection parameter list that will be injected in engine with
Present event injector injection event type in event injection list matches, and injection event type is determined after matching and to target
Unit implements event injection, and after the completion of injection, combined test collection parameter list is sent to state monitor by event injector,
Controller sends event injection and completes signal to state monitor；Signal, state monitor monitoring are completed when event injection is received
Event injector injects success or not, and injection state set should include " success ", " failure " and "abnormal", and will injection state letter
Breath is sent to controller, if injection state is " success ", event injection module task is completed, and controller is to state analyzing module
In state acquisition device send event injection module and complete signal, be prepared to enter into state analyzing module；If injection state is " mistake
Lose " or "abnormal", controller needs control scanner to send combined test collection parameter list to each event injector again, again
Implementation event is injected, and until event injection module Mission Success is completed, finally enters state analyzing module；
State analyzing module includes state acquisition device, interpretation of result device and result display, under control of the controller, when state is adopted
Storage receives event injection module and completes signal, and state acquisition device gathers the responsive state letter after each object element injection event
Breath, the responsive state information aggregate of object element should include " correct ", " mistake ", "abnormal" and " time-out ", and by responsive state
Information transmission is to interpretation of result device and result display；
Under control of the controller, interpretation of result device carries out confluence analysis, root to the responsive state information that state acquisition device sends
Increase situation according to the dramatically increasing of cpu busy percentage, the quick consumption of memory headroom, memory usage percentage or system delay,
Using Fuzzy AHP, in interval [0,1], the availability of assay goal systems or each object element,
(0.75,1] on be " availability is good ", (0.5,0.75] on be " availability is general ", (0.25,0.5] on be " availability
It is poor ", it is " availability is extremely low " four ranks on [0,0.25], finally this assay result and data foundation are sent to
As a result display；Under control of the controller, the data that as a result display reception state collector and interpretation of result device send, show
Show the responsive state information of object element after event injection, including " correct ", " mistake ", "abnormal" and " time-out ", display target
The assay result and data foundation of system or each object element, generation printed report feed back to user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410125856.1A CN103944778B (en) | 2014-03-31 | 2014-03-31 | A kind of distributed event injection device based on combined test collection |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410125856.1A CN103944778B (en) | 2014-03-31 | 2014-03-31 | A kind of distributed event injection device based on combined test collection |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103944778A CN103944778A (en) | 2014-07-23 |
| CN103944778B true CN103944778B (en) | 2017-06-20 |
Family
ID=51192271
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410125856.1A Expired - Fee Related CN103944778B (en) | 2014-03-31 | 2014-03-31 | A kind of distributed event injection device based on combined test collection |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103944778B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106201689B (en) * | 2016-07-07 | 2019-10-18 | 哈尔滨工程大学 | A kind of more queue events injection devices and method with timing control |
| CN106227605B (en) * | 2016-07-26 | 2019-10-18 | 北京北森云计算股份有限公司 | A kind of the dynamic micro services expansion method and device of multilingual cloud compiling |
| CN108268365B (en) * | 2016-12-30 | 2020-12-18 | 腾讯科技（深圳）有限公司 | Abnormal task injection method, device and system |
| CN108763039B (en) * | 2018-04-02 | 2021-09-21 | 创新先进技术有限公司 | Service fault simulation method, device and equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN2894106Y (en) * | 2006-04-19 | 2007-04-25 | 哈尔滨工程大学 | Computer network credibility estimating device based on event implanting |
| CN101187952A (en) * | 2007-12-14 | 2008-05-28 | 哈尔滨工程大学 | A simulation judgment method for survival capability of network information system |
| CN101471781A (en) * | 2007-12-24 | 2009-07-01 | 北京启明星辰信息技术股份有限公司 | Method and system for processing script injection event |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8756569B2 (en) * | 2007-12-17 | 2014-06-17 | International Business Machines Corporation | Deterministic pseudo-random fault event recordation and injection tool |
-
2014
- 2014-03-31 CN CN201410125856.1A patent/CN103944778B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN2894106Y (en) * | 2006-04-19 | 2007-04-25 | 哈尔滨工程大学 | Computer network credibility estimating device based on event implanting |
| CN101187952A (en) * | 2007-12-14 | 2008-05-28 | 哈尔滨工程大学 | A simulation judgment method for survival capability of network information system |
| CN101471781A (en) * | 2007-12-24 | 2009-07-01 | 北京启明星辰信息技术股份有限公司 | Method and system for processing script injection event |
Non-Patent Citations (2)
| Title |
|---|
| 《分布式系统中服务可生存性的定量分析》;郭渊博 等;《同济大学学报》;20021031;第30卷(第10期);第1190-1193页 * |
| 《基于模糊层次分析的网络服务级安全态势评价方法》;刘磊 等;《计算机应用》;20090930;第29卷(第9期);第2327-2331页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103944778A (en) | 2014-07-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Kuhn et al. | Practical combinatorial testing: Beyond pairwise | |
| CN103150228B (en) | Synthesizable pseudorandom verification method and device for high-speed buffer memory | |
| CN103150238B (en) | A kind of service request processing method, simulated performance method of testing and device | |
| CN103944778B (en) | A kind of distributed event injection device based on combined test collection | |
| CN101556551B (en) | Hardware acquisition system and method for equipment failure log | |
| CN108376221A (en) | A kind of software system security verification and appraisal procedure based on AADL model extensions | |
| US20090248390A1 (en) | Trace debugging in a hardware emulation environment | |
| CN104518924A (en) | Automatic testing and result comparison method and system | |
| CN103019921A (en) | Operating system fault tolerance testing system and method based on fault injection | |
| CN102479123A (en) | System and method for testing chip operating system (COS) | |
| CN104731698A (en) | Abnormal test case automatic generation processing method and device based on automatic tests | |
| CN107547261A (en) | Cloud platform performance test methods and device | |
| CN105589928A (en) | Simulation testing method for distributed data processing system | |
| Saluja et al. | Optimized approach for antipattern detection in service computing architecture | |
| CN103399813B (en) | A kind of embedded system off-line trace analysis method based on Trace information | |
| CN117077588A (en) | Hardware acceleration simulation debugging system | |
| CN102929778A (en) | Control method for parallel tests on multi-core array and after-silicon verification system | |
| Guan et al. | Chaser: An enhanced fault injection tool for tracing soft errors in mpi applications | |
| Thomm et al. | Automated application of fault tolerance mechanisms in a component-based system | |
| Baier et al. | Waiting for locks: How long does it usually take? | |
| CN114385258A (en) | Automatic testing method and device, electronic equipment and storage medium | |
| US8024168B2 (en) | Detecting X state transitions and storing compressed debug information | |
| CN110928705B (en) | Communication characteristic analysis method and system for high-performance computing application | |
| CN113704040A (en) | Microprocessor memory reliability testing method | |
| CN100426253C (en) | Test method of a database depended software unit |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170620 |