CN1519703B - Computer multithreading test system capable of being combined and linked as well as its method - Google Patents
Computer multithreading test system capable of being combined and linked as well as its method Download PDFInfo
- Publication number
- CN1519703B CN1519703B CN 03101905 CN03101905A CN1519703B CN 1519703 B CN1519703 B CN 1519703B CN 03101905 CN03101905 CN 03101905 CN 03101905 A CN03101905 A CN 03101905A CN 1519703 B CN1519703 B CN 1519703B
- Authority
- CN
- China
- Prior art keywords
- test item
- test
- module
- item
- multithreading
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The system includes module of testing item, multithreading interface module and testing platform. When testing, module of testing item selected by user is loaded to obtain configuration parameters set by user such as number of multithread wanted to open. Then, configured parameters are corrected in the multithreading interface, and transferred to corresponding module of testing item. Based on number of multithread set by user, multithreading mechanism in operating system is called from templates in order for each selected testing item to open corresponding number of thread. Testing procedures as thread functions for each testing item are called and testing procedures are carried out in parallel.
Description
Technical field
The present invention relates to a kind of computer testing system and method, the particularly a kind of test macro and method that can articulate respectively the test module combination in any.
Background technology
For the test of computing machine on production line, there are many kinds of methods to adopt at present, all be at different test events usually, design different testing algorithms and finish test, but can be divided into two classes generally, a class is unit test, a class is integrated testability.
The unit test method, be to test at a certain specific features of computing machine, but owing to do not isolate between each component models of counter, it is the system of a complexity, therefore the weak point of this method of testing is to demonstrate the quality of a certain performance pointer of this computing machine, and has often ignored the concurrency and the harmony of counter.The integrated testability method has overcome this shortcoming, situation according to all modules to be measured of whole computing machine, design different testing algorithms respectively, with all modular algorithms concurrent testing simultaneously as a whole, test result is exactly the overall performance performance of this computing machine again.
Though the integrated testability method can be checked the overall performance of computing machine, can't understand the performance quality of each concrete test component, because it is all parts to be considered as a whole and the method for testing of carrying out.That is to say that if the complete machine performance is not good, the integrated testability method can not tell that at all we are the influences which parts causes.This is because the complete machine performance depends on system coordination, if (as the I/O) in a certain respect of system becomes bottleneck, will influence the performance of other test component, that is to say, cause the reason of same complete machine performance to vary, this just makes test result can not react relation and the performance between counter complete machine and each parts complete, accurate, fully.
In addition, the integrated testability method needs multi-threaded parallel, but in program development process, owing to write the understanding difference of the programmer of different test item modules to multithreading, different problems may appear, not only the development time long, and make troubles for later maintenance.
Summary of the invention
The objective of the invention is to for a kind of computing machine multithreading test macro and method thereof that articulates capable of being combined that provide is provided, to carry out the independent assortment test through the test item module of dividing, and can open number of threads arbitrarily, increase or eliminating correlative factor are to the influence of certain test item, to obtain more accurate test result.
The invention provides a kind of computing machine multithreading test macro that articulates capable of being combined, the test item module independent assortment of dividing is carried out the computing power test, comprise the test item module, in order to carry out concrete test item test process; The multithreading interface module, in order to opening a plurality of threads, and the test process that calls each test item module is a thread function; And test platform, in order to loading and management testing item module, and control the test process of each thread by the multithreading interface.
The present invention also provides a kind of computing machine multithread testing method that articulates capable of being combined, at first loads the test item module that the user selects; Then, obtain the configuration parameter that the user sets, comprising the Thread Count of desire unlatching; This configuration parameter is collected in the multithreading interface, and be passed to corresponding test item module; According to the Thread Count that the user sets, call operation system multi-thread mechanism is opened the thread of respective numbers for each selected test item in template; The test process that calls each test item then is as the thread function concurrent testing.
The present invention compared with prior art has following beneficial functional:
1, articulates by flexible selection, can revise, make test result more accurate test environment in the test process and influence factor to test item.
2, by opening the multithreading test arbitrarily, can grasp test pressure flexibly.If only select a test item to open a thread, be exactly common unit test pattern, if select a plurality of test items and open a plurality of threads, then be exactly pressure test, the big I of pressure is set arbitrarily.
3, according to the test report between the same test item, can compare, the performance data of test item module is provided.
Description of drawings
Fig. 1 is the computing machine multithreading test macro Organization Chart that articulates capable of being combined of the present invention;
Fig. 2 is the computing machine multithread testing method process flow diagram that articulates capable of being combined of the present invention.
Wherein, description of reference numerals is as follows:
101 test item modules 1
102 test item modules 2
103 test item module N
200 multithreading interface modules
300 test platforms
The Thread Count that step 204 is set according to the user, call operation system multi-thread mechanism is opened the thread of respective numbers for each selected test item in template
Embodiment
As shown in Figure 1, be the computing machine multithreading test macro Organization Chart that articulates capable of being combined of the present invention, it comprises: test item module 101,102,103, multithreading interface module 200 and test platform 300.
Wherein, test item module 101,102,103 is in order to carry out concrete test item test process; Multithreading interface module 200 is in order to opening a plurality of threads, and the test process that calls each test item module is a thread function; Test platform 300 is in order to load and management testing item module, and the test process by each thread of multithreading interface 200 control, it can comprise test item administration module, test item configuration module and mistake and log management module, wherein, the test item administration module is used for loading, management testing item module, and safeguard its lifetime that the test item administration module is externally acted on behalf of the visit of other module to test item by unified interface specification Dynamic Recognition, loading test item; The test item configuration module is acted on behalf of the management maintenance of test item modules configured and configuration file by the test item administration module; Mistake and log management module are acted on behalf of the output of test item daily record and error message and the management of file thereof by the test item administration module, when the test item assembly testing, test platform can also comprise the test dispatching module, and it carries out the management and running of multithreading test to the test item module by the test item administration module.
Each test item all has a unique sign, is provided voluntarily according to the characteristic of itself by test item, and the Sequential Seek with hard disk (HardDisk) is that example illustrates it below:
The Sequential Seek test item sign (ID) of HardDisk: " Computer.Hard Disk.0.Sequential Seek "; In like manner, floppy disk (Floppy Disk) test item ID: " computer.FloppyDisk.FD Test ".
For convenience of description, we can be interpreted as test item ID by three parts and form: " device name ", " device numbering " and " content measurement title "." device name " as " System Hard Disk.HD1.Sequential Seek " is " System Hard Disk ", and " device numbering " is " 0 ", and " test name " is " Sequential Seek ".
Wherein, this partly belongs to option " device numbering ", it at be the situation that on a machine, may have a plurality of same type equipment, for example on a machine several hard disks (its number may come from the result of detection of dynamic, or user's setting) can be arranged.
With the test item module that contains Computer.Hard Disk.0.Sequential Seek is example, and its content that should have comprises: the interface (voidTest (Configuration cfg)) of identification interface (bool is Inventec Test Item ()), the OS (DWORD get Support Os ()) that can support, the interface (LPCTSTR get TestId ()) of obtaining test I D, the interface (get Diag UI ()) of obtaining configuration interface, execution test action etc.
The present invention has realized the dynamic combined of test item module is articulated by providing general, unified interface for test item (existing with the dynamic module form), so the interface of test item also is important some, and a kind of concrete example is as described below:
Configuration interface: be used for the test parameter of configuration testing item self, characteristic, style or the like details is by test item self decision, and platform only provides the viewing area for it, comprising:
Obtain configuration interface: getConfigurationUI (),
Configuration file: setConfiguration () is set,
Preserve configuration file: save ();
Test execution interface: comprising:
The execution body of test action: launchTest (),
Common interface: comprising:
Obtain the operating system (OS) that test item is supported: getSupportOS (),
Row interface does not in the drawings also have, but is not limited to:
After get the overall situation and set: getGlobalSetting (),
Output journal: writeLog (),
Output error message: writeError (),
Testing progress is upgraded: updateProgress ().
In test process, when test errors, test item can call getPlatform () interface and obtain the cover service interface that the test item administration module in the test platform 300 provides, for example writeError (LPCTSTR err), writeLog (LPCTSTR log) wait output information, are finished by mistake in the test platform 300 and log management module for wrong, daily record meeting.
See also Fig. 2, be the computing machine multithread testing method that articulates capable of being combined of the present invention, at first load the test item module (step 201) that the user selects; Then, obtain the configuration parameter that the user sets, comprising the Thread Count (step 202) of desire unlatching; This configuration parameter is collected in the multithreading interface, and be passed to corresponding test item module (step 203); According to the Thread Count that the user sets, call operation system multi-thread mechanism is opened the thread (step 204) of respective numbers for each selected test item in template; And then the test process that calls each test item is as thread function concurrent testing (step 205).
In the above-mentioned loading procedure,, load one of them test item according to user's selection, and verify the identify label of this test item,, then abandon and attempt loading next test item if should sign undesirable at first by retrieval test item storing directory; Simultaneously, verify whether this test item supports current operating system,, then abandon and attempt loading next test item, then, obtain and put in order the relevant information of this test item if do not support; Then, check the test item that whether also has the user's selection that does not load in the storing directory, if having then loading once more.
Above-mentioned this configuration parameter is collected in the multithreading interface, and be passed to the step of corresponding test item module, be the test item module of selecting according to the user, generate the multithreading interface of respective amount and communicate respectively with each test item by the multithreading interface module.
The realization of multithreading interface module has utilized the multi-thread mechanism of operating system, for each test item has been opened a plurality of threads; Utilized mould plate technique, only need call one section template code just can realize a plurality of functions.In addition, also can utilize grand technology, for different situations are set different operating paths.
For example, in the time of the testing hard disk performance, we can mark off test module according to the test pointer, and then it comprises:
1, disk processing time %Disk Time;
2, disk processing queue length Physical Disk AVG, Disk Queue, PhysicalDisk AVG, Disk Queue Length;
3, disk deal with data amount Avg.Disk Bytes/Transfer; And
4, disk tracking number of times Avg.Disk sec/Transfer.
We also can mark off test module according to influence factor, and for example relevant influence factor can be: the CPU processing speed.
When the test module of hard disk performance pointer and influence factor cpu test module combinations and articulate when testing, on the server of many CPU, need to distribute and open thread, and formulate the CPU of each thread operation according to the CPU number of server.And the multithreading interface routine is connected to the appropriate section of test item module, so that by the multithreading interface test item is intercomed mutually with test platform.Also definable AFFINITYMASK is grand realizes distributing thread to arrive the functional macro of corresponding CPU.
After articulating influence factor test, also can test and do not articulate influence factor and test once more, if the performance of twice test is all good, illustrate that then test event is functional, if once better and another time is relatively poor, then analyze reason wherein, change other influence factor and test once more.
The above is preferred embodiment of the present invention only, is not the practical range that is used for limiting this creation; Be that all equivalences of doing according to claim of the present invention change and modification, be all claim of the present invention and contain.
Claims (4)
1. a computing machine multithreading test macro that articulates capable of being combined carries out the computing power test with the test item module independent assortment of dividing, and it is characterized in that, comprising:
The test item module is in order to carry out concrete test item test process;
The multithreading interface module, in order to opening a plurality of threads, and the test process that calls each test item module is a thread function; And
Test platform, in order to load and management testing item module, and control the test process of each thread by the multithreading interface, this test platform comprises test item administration module, test item configuration module and mistake and log management module, wherein, this test item administration module is used for loading, managing this test item module, and safeguards its lifetime, this test item administration module is externally acted on behalf of the visit of other module to test item by unified interface specification Dynamic Recognition, loading test item; The test item configuration module is acted on behalf of the management maintenance of test item modules configured and configuration file by the test item administration module; This mistake and log management module are acted on behalf of the output of test item daily record and error message and the management of file thereof by this test item administration module, when the test item assembly testing, this test platform can also comprise the test dispatching module, and it carries out the management and running of multithreading test to this test item module by this test item administration module.
2. a computing machine multithread testing method that articulates capable of being combined is that the test item module independent assortment that will divide carries out the computing power test, it is characterized in that, comprising:
Load the test item module that the user selects, in the above-mentioned loading procedure, at first by retrieval test item storing directory, selection according to the user loads one of them test item, and verify the identify label of this test item, if should sign undesirable, then abandon and attempt loading next test item; Simultaneously, verify whether this test item supports current operating system,, then abandon and attempt loading next test item, then, obtain and put in order the relevant information of this test item if do not support; Then, check the test item that whether also has the user's selection that does not load in the storing directory, if having then loading once more;
Obtain the configuration parameter that the user sets, Thread Count comprising the desire unlatching, above-mentioned this configuration parameter is collected in the multithreading interface, and be passed to the step of corresponding test item module, be the test item module of selecting according to the user, generate the multithreading interface of respective amount and communicate respectively with each test item by the multithreading interface module;
This configuration parameter is collected in the multithreading interface, and be passed to corresponding test item module;
According to the Thread Count that the user sets, call operation system multi-thread mechanism is opened the thread of respective numbers for each selected test item in template, more comprises the step of utilizing macro definition to set different operating paths for different situations; And
The test process that calls each test item is as the thread function concurrent testing.
3. the computing machine multithread testing method that articulates capable of being combined as claimed in claim 2 is characterized in that, the test item module of this division is to divide really according to the test pointer.
4. the computing machine multithread testing method that articulates capable of being combined as claimed in claim 2 is characterized in that, the test item module of this division is divided according to the reciprocal influence relation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 03101905 CN1519703B (en) | 2003-01-23 | 2003-01-23 | Computer multithreading test system capable of being combined and linked as well as its method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 03101905 CN1519703B (en) | 2003-01-23 | 2003-01-23 | Computer multithreading test system capable of being combined and linked as well as its method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1519703A CN1519703A (en) | 2004-08-11 |
| CN1519703B true CN1519703B (en) | 2010-05-05 |
Family
ID=34281503
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 03101905 Expired - Fee Related CN1519703B (en) | 2003-01-23 | 2003-01-23 | Computer multithreading test system capable of being combined and linked as well as its method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1519703B (en) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100367040C (en) * | 2004-08-18 | 2008-02-06 | 华为技术有限公司 | Testing method for radio-frequency product |
| JP4140917B2 (en) * | 2005-12-26 | 2008-08-27 | インターナショナル・ビジネス・マシーンズ・コーポレーション | Verification work support system and method |
| CN101685420B (en) * | 2008-09-24 | 2013-06-12 | 中兴通讯股份有限公司 | Multithreading debugging method and device |
| CN102169455A (en) * | 2010-02-26 | 2011-08-31 | 国际商业机器公司 | Debugging method and system for software performance test |
| CN102681903B (en) * | 2011-03-15 | 2014-11-26 | 深圳光启高等理工研究院 | Data processing method |
| CN102929778B (en) * | 2012-10-30 | 2015-11-18 | 无锡江南计算技术研究所 | Verification system after the control method of concurrent testing and silicon on many core arrays |
| CN104216829B (en) * | 2014-08-29 | 2017-09-19 | 福建联迪商用设备有限公司 | A kind of method and system of flush bonding module concurrent test |
| CN104850480B (en) * | 2015-05-18 | 2017-08-18 | 曙光信息产业(北京)有限公司 | The method and device of high density storage server hard disk performance test |
| CN107197475A (en) * | 2016-03-14 | 2017-09-22 | 重庆邮电大学 | A kind of sensing node identifier resolution method of testing and system based on multithreading |
| CN107908485B (en) * | 2017-10-26 | 2020-08-04 | 中国平安人寿保险股份有限公司 | Interface parameter transmission method, device, equipment and computer readable storage medium |
| CN109062750A (en) * | 2018-09-13 | 2018-12-21 | 国家海洋环境预报中心 | A kind of high-performance computer test macro |
| CN112578259B (en) * | 2019-09-29 | 2022-06-10 | 北京君正集成电路股份有限公司 | Thread scheduling method with data space setting |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6247121B1 (en) * | 1997-12-16 | 2001-06-12 | Intel Corporation | Multithreading processor with thread predictor |
| CN1338680A (en) * | 2000-08-15 | 2002-03-06 | 国际商业机器公司 | In site protection against lost line in multi-line parallel processor |
| CN1356634A (en) * | 2000-12-06 | 2002-07-03 | 无敌科技(西安)有限公司 | Method and device for automatically recording and reproducing operation path on simulator |
-
2003
- 2003-01-23 CN CN 03101905 patent/CN1519703B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6247121B1 (en) * | 1997-12-16 | 2001-06-12 | Intel Corporation | Multithreading processor with thread predictor |
| CN1338680A (en) * | 2000-08-15 | 2002-03-06 | 国际商业机器公司 | In site protection against lost line in multi-line parallel processor |
| CN1356634A (en) * | 2000-12-06 | 2002-07-03 | 无敌科技(西安)有限公司 | Method and device for automatically recording and reproducing operation path on simulator |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1519703A (en) | 2004-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6182245B1 (en) | Software test case client/server system and method | |
| CN1519703B (en) | Computer multithreading test system capable of being combined and linked as well as its method | |
| US7716254B2 (en) | System for modeling architecture for business systems and methods thereof | |
| US9037915B2 (en) | Analysis of tests of software programs based on classification of failed test cases | |
| US6539500B1 (en) | System and method for tracing | |
| US8799854B2 (en) | Reusing software development assets | |
| US20070038890A1 (en) | Configurable system and methods for writing and executing test components | |
| US20040103380A1 (en) | System and method for automated electronic device design | |
| US20130159977A1 (en) | Open kernel trace aggregation | |
| CN101393535B (en) | Method and system for associating event and assembly while working | |
| US20070150587A1 (en) | Method and apparatus for populating a software catalog with automated use signature generation | |
| Mahmood et al. | A survey of component based system quality assurance and assessment | |
| CN114691403A (en) | Server fault diagnosis method and device, electronic equipment and storage medium | |
| Bausch et al. | Bioopera: Cluster-aware computing | |
| CN104123104B (en) | Daily record control system and method | |
| CN102023919A (en) | Integrated test method and system | |
| CN111752806A (en) | Method for acquiring IO (input/output) indexes of virtual disk in cloud environment | |
| Dal Cin | Extending UML towards a Useful OO-Language for Modeling Dependability Features. | |
| CN109032930A (en) | System detection method and device | |
| Rover et al. | Software tools for complex distributed systems: Toward integrated tool environments | |
| US7139744B2 (en) | Reorganizing data in log files for data tracking management | |
| Davis | System testing: Implications of requirements specifications | |
| Gan | Software performance testing | |
| Singh et al. | Exploring problems and solutions in estimating testing effort for non functional requirement | |
| US20030145300A1 (en) | Layout tracking solutions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100505 Termination date: 20130123 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |