CN102243610A - Operating system test method and test system - Google Patents

Operating system test method and test system Download PDF

Info

Publication number
CN102243610A
CN102243610A CN2011102263578A CN201110226357A CN102243610A CN 102243610 A CN102243610 A CN 102243610A CN 2011102263578 A CN2011102263578 A CN 2011102263578A CN 201110226357 A CN201110226357 A CN 201110226357A CN 102243610 A CN102243610 A CN 102243610A
Authority
CN
China
Prior art keywords
operating system
system server
application system
test
application
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2011102263578A
Other languages
Chinese (zh)
Inventor
卢建刚
谢善益
梁晓兵
陈炯聪
周伊琳
胡亚平
邓大为
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GUANGDONG CENTER OF ELECTRIC DISPATCHING AND TRANSFORMING
Electric Power Research Institute of Guangdong Power Grid Co Ltd
Original Assignee
GUANGDONG CENTER OF ELECTRIC DISPATCHING AND TRANSFORMING
Electric Power Research Institute of Guangdong Power Grid Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GUANGDONG CENTER OF ELECTRIC DISPATCHING AND TRANSFORMING, Electric Power Research Institute of Guangdong Power Grid Co Ltd filed Critical GUANGDONG CENTER OF ELECTRIC DISPATCHING AND TRANSFORMING
Priority to CN2011102263578A priority Critical patent/CN102243610A/en
Publication of CN102243610A publication Critical patent/CN102243610A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Debugging And Monitoring (AREA)

Abstract

The invention provides an operating system test method and test system. The method comprises the following steps of: setting test point types to be tested, wherein each test point type comprises function indexes, performance indexes and availability; and respectively testing the test point types, and recording test results of all the test point types. According the scheme in the invention, function and performance of an operating system can be comprehensively tested, the functions and performances of the operating systems of different manufactures can be conveniently compared, and type of the operating system can be conveniently selected.

Description

Operating system testing method and test macro
Technical field
The present invention relates to a kind of operating system testing method and a kind of operating system testing system.
Background technology
Operating system is the kernel software of computer system, it is the platform that all application software play a role, the runnability that the performance of operating system is directly connected to each software when moving in operating system, external operating system manufacturer is by long market operation, occupied market, domestic operating system has all obtained very big progress on the theory and practice time, yet, the operating system of producer's Development and Production that each are different is had nothing in common with each other, the information data type that is comprised is also inequality, thereby also can't be directly the different operating system of variant producer be compared, can't do assessment and carry out type selecting the function and the performance of the different operating system of variant producer.
Summary of the invention
At above-mentioned problems of the prior art, the object of the present invention is to provide a kind of operating system testing method and operating system testing system, it can be tested the function and the performance of operating system all sidedly, is convenient to the assessment of comparing of the function of the different operating system of variant producer and performance.
For achieving the above object, the present invention by the following technical solutions:
A kind of operating system testing method comprises step:
Set the test point type that needs test, this test point type comprises functional parameter, performance index;
Above-mentioned test point type is tested the test result that record is tested each test point type respectively.
A kind of operating system testing system, comprise: the first application system server that is connected with operating system to be measured, the second application system server, the test data generator that is connected with the first application system server, the second application system server, on the first application system server first kind dispatch automated system is installed, the second class dispatch automated system is installed on the second application system server.
According to the invention described above scheme, it is by setting the test point type that need test, and operating system is tested according to these test point types, because the test point type that sets is to estimate the big event of operating system, the operating system of variant manufacturer production is tested according to identical test point type, thereby not only can test the function and the performance of operating system all sidedly, also be convenient to the function and the performance of the operating system of variant producer are compared, be convenient to type selecting operating system.
Description of drawings
Fig. 1 is the schematic flow sheet of operating system testing method embodiment of the present invention;
Fig. 2 is the structural representation of operating system testing system embodiment of the present invention;
Fig. 3 is a structural representation of using test macro of the present invention in the concrete example.
Embodiment
Below in the mode of specific embodiment, the present invention program is described in detail.
Referring to shown in Figure 1, be the schematic flow sheet of operating system testing method embodiment of the present invention, it comprises step:
Step S101: set the test point type that needs test, this test point type comprises functional parameter, performance index, enters step S102;
Step S102: above-mentioned test point type is tested the test result that record is tested each test point type respectively.
According to the invention described above scheme, it is by setting the test point type that need test, and operating system is tested according to these test point types, because the test point type that sets is to estimate the big event of operating system, the operating system of variant manufacturer production is tested according to identical test point type, thereby not only can test the function and the performance of operating system all sidedly, also be convenient to the function and the performance of the operating system of variant producer are compared, be convenient to type selecting operating system.
Below with in the concrete example, carry out illustrated in greater detail respectively at the test process of variant test point type.
With the test point type is that functional parameter is an example, and the test process of functional parameter is comprised test to basic function, high availability, security, ease for use, manageability, standard compliance.
With the basic function is example, can be the test that comprises following content to the test of basic function: but all mutual switching between mutual switching, non-root user and the root user between login system, the non-root user, switchings of system operation level of all administrators.Concrete test mode can be to carry out corresponding operation at operating system to test.
With the high availability is example, can comprise the test of high availability: Journaling File System is replied fast, two-node cluster hot backup function, disk redundancy support, the redundant tenability of network interface card, disk array card redundancy, storage multipath function, network interface card redundancy feature (for example 4 network card bindings become 2 network interface cards), network card status monitoring function;
With the security is example, can comprise the test of security: whether detect (for example detection of GB GB/T/20272 level Four) by national standard;
Above-mentioned test to ease for use can comprise: automatically the carry CD, automatically unload CD, automatically the carry USB flash disk, unload USB flash disk automatically;
Above-mentioned test to manageability can comprise: complete unified configuration and monitoring management function and man-machine interface are provided, can realize unified supervision such as system saving electricity, application and process and control; Can be with expression such as form, figure mode analytic statistics system performance, for example CPU meets, Internet resources, process resource, EMS memory occupation situation, disk take situation etc.; Can monitor that the computer equipment in can recognition system and the fault and the fault type of the network equipment are also reported to equipment state; Can monitor and control all; Possess system's operation, performance monitoring, with fault diagnosis and restore funcitons.
Above-mentioned test to performance index can comprise: to the test of UnixBench performance, LTP performance.
UnixBench is a performance testing tool based on early stage BYTE UNIX Benchmarks, be the performance test software of a unique host (Dedicated Host) and virtual unique host (VPS), operating system tested by this testing software based on the Unix/Linux system.
And LTP (Linux Test Project) is the system testing external member of the test Linux robustness of cooperations such as SGI, IBM and OSDL, and it is based on the combination that the resource utilization ratio statistics has been developed a test, for system provides enough pressure.Use the LTP protos test suite PROTOS operating system to be carried out the test of ultra-long time, focus on the working load of test subscriber's environmental correclation, comprising: memory pressure, I/O pressure, NFA pressure, mathematical operation pressure, pipeline pressure, system call pressure, network pressure or the like.And test result carried out record.
Except the test of above-mentioned each performance to operating system, the present invention program can also test the availability of operating system.Test for the availability to operating system, the present invention program provides a kind of test structure.Referring to shown in Figure 2, be the synoptic diagram of the test macro in the embodiment of this test structure.
Test macro as shown in Figure 2, include the first application system server, the second application system server that are connected with operating system to be measured, the test data generator that is connected with the first application system server, the second application system server, on the first application system server first kind dispatch automated system is installed, the second class dispatch automated system is installed on the second application system server.Can connect by switch, Ethernet between test data generator, the first application system server, the second application system server.
In shown in Figure 2, operating system to be measured can be first operating system or second operating system, respectively first operating system, second operating system are tested.In addition, also can be when operation, simultaneously first operating system, second operating system to be tested, with convenient the availability of first operating system, second operating system is compared.By using a plurality of operating systems, but the network interconnection intercommunity between each operating system of simultaneous verification.
As shown in Figure 2, this test macro can also include relational database, this relational database is connected with the first application system server, the second application system server, when operating system is tested, by the operation of marriage relation database operating system is carried out integration test with convenient.In addition, can also include the relational database disk array storage that is connected with relational database, so that better carry out integrative test.Can be connected by fiber optic network between the storage of relational database and relational database disk array, for example optical fiber switch.
As shown in Figure 2, this test macro can also include the time series data storehouse, this time series data storehouse is connected with test data generator, the first application system server, the second application system server, so that when operating system is tested, can carry out integration test to operating system in conjunction with operation to the time series data storehouse.In addition, can also include the time series disk array storage that is connected with the time series data storehouse, so that better carry out integrative test.Can be connected by fiber optic network between the storage of time series data storehouse and time series disk array, for example optical fiber switch.
Operate on the operating system and test by relational database, the time series data storehouse that will insert, can Test Operating System to the compatibility of these basic softwares.
During test, insert operating system to be measured, the test data generator produces corresponding emulated data, the emulated data here can comprise total gauge point number, factory's station quantity, delta data or the like, by first operating system, second operating system is via the first application system server, the second application system server executable operations, make operating system be in running status, and move the Preset Time section continuously, for example 48 hours, 72 hours, 96 hours or other time period, and be recorded in relevant information or data in during this period of time the operational process, the number of stoppages for example, fault type or the like, thereby not only can test stability that simultaneously can Test Operating System long-term operation under high strength pressure to the availability of operating system.
Wherein, above-mentioned test data generator can be provided with many, that is, each test data generator can send the emulated data of respective number respectively, thereby these many test data generators can produce needed huge emulated data together.Counting with overall measurement is 600,000 to be example, and 6 test data generators then can be set, and each test data generator can send 100,000 number of test points.Certainly, according to actual needs, the test data generator of other numbers and the number of test points that each test data generator sends can be set also.
In addition, under the enough powerful situation of the processing power of equipment, the above-mentioned first application system server can be arranged on the equipment, in order to improve under the powerful inadequately situation of the processing power of handling operational efficiency or equipment, it can be the function of carrying out this first application system server by a plurality of different equipment jointly, for variant equipment, can be connected with first operating system, second operating system respectively.Correspondingly, under the enough powerful situation of the processing power of equipment, the above-mentioned second application system server also can be arranged on the equipment, in order to improve under the powerful inadequately situation of the processing power of handling operational efficiency or equipment, it can be the function of carrying out this second application system server by a plurality of different equipment jointly, for variant equipment, can be connected with the 3rd operating system, the 4th operating system respectively.
In addition, the above-mentioned first application system server, the second application system server, relational database, test data generator can be the virtual first application system server, the virtual second application system server, virtual relational database, the virtual test data generators that adopts Intel Virtualization Technology.By the combined with virtual technology, but simultaneous verification operating system can be used with virtualization software.
Above-mentioned test macro can be connected with time series data library backup, relation data library backup simultaneously, and time series data storehouse, relational database move with the form of two-node cluster hot backup.Simultaneously, this test macro can insert dissimilar operating system simultaneously, test respectively at different operating system, thereby can conveniently test comparison to the function and the performance of each operating system, because the residing environmental facies of each operating system together, thereby can selection function and the better operating system of performance, operating system is carried out type selecting.
Use the test macro of the invention described above, not only can test, can also use this test macro simultaneously above-mentioned each function and the performance of operating system to be measured are tested the availability of operating system to be measured.
As shown in Figure 3, show the configuration diagram of the test macro of the present invention program in a concrete example, in the diagram, be with two type operating systems to be measured be provided with respectively being installed in compare on the different equipment test describe.
In shown in Figure 3, be to be to continue and protect that application system server, the first application system server are separately positioned on three equipment with the second application system server, each equipment is connected corresponding operating system respectively and PTimeDB, SOPHIC RTDB are that the time series data storehouse describes in Nanjing for amassing into electronic application server, the second application system server with the first application system server.In shown in Figure 3, the storage of relational database disk array, the storage of time series disk array are respectively the disk arrays of 10TB.Need to prove that shown in Figure 3 only is detailed description to a concrete example, the framework shown in Fig. 3 can not constitute the qualification to the present invention program.In shown in Figure 3, historical deposit system, front-end system, real-time system, item service etc. are operating system to be measured.
As shown in Figure 3, the data source of testing, can be to send with Millisecond by the test data generator, also can be sending of the first application system server, the second application system server, the data source that data source that the first application system server, the second application system server send and test data generator send exports time series data storehouse, relational database to, and concrete generation is sent mode and do not repeated them here.The data source here can be the Millisecond data source.
According to the invention described above scheme, can comprehensively test operating system to be measured, comprise usability testing, functional test and performance test.In addition, when carrying out usability testing, can use true application system server to test, adopt the test data generator to send emulated data, thereby can in test, find issuable variety of issue in the operating system process to be tested.In addition, be to have set the sufficiently long test duration availability is tested, stability that more can Test Operating System long-time running under high strength pressure.
Above-described embodiment of the present invention only is the detailed description to better embodiment of the present invention, does not constitute the qualification to protection domain of the present invention.Any modification of being done within the spirit and principles in the present invention, be equal to and replace and improvement etc., all should be included within the claim protection domain of the present invention.

Claims (10)

1. an operating system testing method is characterized in that, comprises step:
Set the test point type that needs test, this test point type comprises functional parameter, performance index;
Above-mentioned test point type is tested the test result that record is tested each test point type respectively.
2. operating system testing method according to claim 1 is characterized in that, also comprises step: build true/simulation application environment, the availability of operating system is tested.
3. operating system testing method according to claim 2, it is characterized in that, described true/the simulation application environment comprises: the first application system server that is connected with operating system to be measured, the second application system server, the test data generator that is connected with the first application system server, the second application system server, on the first application system server first kind dispatch automated system is installed, the second class dispatch automated system is installed on the second application system server.
4. according to claim 1 or 2 or 3 described operating system testing methods, it is characterized in that:
Described functional parameter comprises basic function, high availability, security, ease for use, manageability;
Described basic function comprises: but all mutual switching between mutual switching, non-root user and the root user between login system, the non-root user, switchings of system operation level of all administrators; Described high availability comprises: Journaling File System answer fast, two-node cluster hot backup, disk redundancy support, the redundant support of network interface card, disk array card redundancy, storage multipath, network interface card redundancy, network card status monitoring function; Described security comprises: detect by national standard; Described ease for use comprises: automatically the carry CD, automatically unload CD, automatically the carry USB flash disk, unload USB flash disk automatically; Described manageability comprises: complete unified configuration and monitoring management function and man-machine interface, with expression mode analytic statistics system performances such as form, figures, the computer equipment in the energy recognition system and the fault and the fault type of the network equipment are also reported, can monitor and control all processes, possess system's operation, performance monitoring, with fault diagnosis and restore funcitons;
And/or
Described performance index comprise: UnixBench performance, LTP performance.
5. operating system testing system, it is characterized in that, comprise: the first application system server that is connected with operating system to be measured, the second application system server, the test data generator that is connected with the first application system server, the second application system server, on the first application system server first kind dispatch automated system is installed, the second class dispatch automated system is installed on the second application system server.
6. operating system testing according to claim 5 system is characterized in that, also comprises:
The relational database that is connected with the first application system server, the second application system server;
Perhaps
The relational database that is connected with the first application system server, the second application system server, and the relational database disk array that is connected with relational database storage.
7. operating system testing according to claim 5 system is characterized in that, also comprises:
The time series data storehouse that is connected with the first application system server, the second application system server, test data generator;
Perhaps
The time series data storehouse that is connected with the first application system server, the second application system server, test data generator, and the time series disk array that is connected with time series data storehouse storage.
8. according to claim 5 or 6 or 7 described operating system testing systems, it is characterized in that described test data generator comprises more than two.
9. according to claim 5 or 6 or 7 described operating system testing systems, it is characterized in that the described first application system server is the virtual application system server, the described second application system server is the virtual application system server.
10. according to claim 5 or 6 or 7 described operating system testing systems, it is characterized in that:
The described first application system server is arranged on two equipment at least, the described second application system server is arranged on two equipment at least, described first operating system is arranged on two equipment at least, and described second operating system is arranged on two equipment at least.
And/or
Be connected by switch between described test data generator, the first application system server, the second application system server, relational database and the time series data storehouse, is connected by fiber optic network between the storage of relational database and relational database disk array, the time series data storehouse be connected by fiber optic network between the time series disk array is stored.
CN2011102263578A 2011-08-09 2011-08-09 Operating system test method and test system Pending CN102243610A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011102263578A CN102243610A (en) 2011-08-09 2011-08-09 Operating system test method and test system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011102263578A CN102243610A (en) 2011-08-09 2011-08-09 Operating system test method and test system

Publications (1)

Publication Number Publication Date
CN102243610A true CN102243610A (en) 2011-11-16

Family

ID=44961677

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011102263578A Pending CN102243610A (en) 2011-08-09 2011-08-09 Operating system test method and test system

Country Status (1)

Country Link
CN (1) CN102243610A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102541739A (en) * 2011-12-31 2012-07-04 曙光信息产业股份有限公司 Test method and device of Linux operating system
CN103116539A (en) * 2012-02-15 2013-05-22 无锡江南计算技术研究所 Performance loss testing method and device of fine-grained virtual system
CN104484270A (en) * 2014-12-05 2015-04-01 中国航空工业集团公司第六三一研究所 Method for verifying airborne embedded operating system software
CN104503872A (en) * 2014-12-04 2015-04-08 安一恒通(北京)科技有限公司 Method and device for testing system performance of terminal equipment
CN110147398A (en) * 2019-04-25 2019-08-20 北京字节跳动网络技术有限公司 A kind of data processing method, device, medium and electronic equipment
CN112559255A (en) * 2020-12-25 2021-03-26 广州鼎甲计算机科技有限公司 Method, system, device and storage medium for testing file mount recovery

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070083630A1 (en) * 2005-09-27 2007-04-12 Bea Systems, Inc. System and method for performance testing framework
CN101789002A (en) * 2010-01-22 2010-07-28 浪潮(北京)电子信息产业有限公司 Database compatibility test device and method for server
CN101883019A (en) * 2010-03-15 2010-11-10 浪潮电子信息产业股份有限公司 Test method for verifying video application of storage server
CN101887465A (en) * 2010-07-30 2010-11-17 南开大学 Method for evaluating pure XML engine of relational database system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070083630A1 (en) * 2005-09-27 2007-04-12 Bea Systems, Inc. System and method for performance testing framework
CN101789002A (en) * 2010-01-22 2010-07-28 浪潮(北京)电子信息产业有限公司 Database compatibility test device and method for server
CN101883019A (en) * 2010-03-15 2010-11-10 浪潮电子信息产业股份有限公司 Test method for verifying video application of storage server
CN101887465A (en) * 2010-07-30 2010-11-17 南开大学 Method for evaluating pure XML engine of relational database system

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102541739A (en) * 2011-12-31 2012-07-04 曙光信息产业股份有限公司 Test method and device of Linux operating system
CN102541739B (en) * 2011-12-31 2016-01-13 曙光信息产业股份有限公司 The method of testing of (SuSE) Linux OS and device
CN103116539A (en) * 2012-02-15 2013-05-22 无锡江南计算技术研究所 Performance loss testing method and device of fine-grained virtual system
CN104503872A (en) * 2014-12-04 2015-04-08 安一恒通(北京)科技有限公司 Method and device for testing system performance of terminal equipment
CN104503872B (en) * 2014-12-04 2018-05-18 安一恒通(北京)科技有限公司 terminal device system performance testing method and device
CN104484270A (en) * 2014-12-05 2015-04-01 中国航空工业集团公司第六三一研究所 Method for verifying airborne embedded operating system software
CN110147398A (en) * 2019-04-25 2019-08-20 北京字节跳动网络技术有限公司 A kind of data processing method, device, medium and electronic equipment
CN110147398B (en) * 2019-04-25 2020-05-15 北京字节跳动网络技术有限公司 Data processing method, device, medium and electronic equipment
CN112559255A (en) * 2020-12-25 2021-03-26 广州鼎甲计算机科技有限公司 Method, system, device and storage medium for testing file mount recovery
CN112559255B (en) * 2020-12-25 2021-08-31 广州鼎甲计算机科技有限公司 Method, system, device and storage medium for testing file mount recovery

Similar Documents

Publication Publication Date Title
CN102243610A (en) Operating system test method and test system
CN106445755B (en) A kind of server automated test method of whole machine cabinet
CN103502942A (en) Virtual machine administration device, virtual machine administration method, and program thereof
CN103955510A (en) Massive electricity marketing data integration method uploaded by ETL cloud platform
CN102323499A (en) Method for automatically testing relay protection equipment
CN104281130A (en) Hydroelectric equipment monitoring and fault diagnosis system based on big data technology
CN102033798A (en) Method for simulating intelligent electronic device IEC61850/MMS (Microsoft media server) server
CN105243004A (en) Failure resource detection method and apparatus
CN103364650A (en) Testing system and testing method
CN111400154A (en) Performance test method and related device for solid state disk
CN102254036A (en) Time sequence database testing method and system
CN103368771A (en) Collecting method and device for fault site information of multi-node server system
CN102608497A (en) Power failure diagnosis method and device
CN101776915B (en) Cross-platform station automatic monitoring system testing method based on concurrency simulating tools
CN107818106B (en) Big data offline calculation data quality verification method and device
CN105868287B (en) Multi-source data-based WAMS application system data integration method
CN110308358B (en) Power distribution automation terminal testing method and device
CN106383861A (en) Data synchronization method and apparatus used for databases
Popović et al. A novel cloud-based advanced distribution management system solution
CN110377958B (en) Physical simulation system and method for power information of microgrid group/virtual power supply group
CN110716875A (en) Concurrency test method based on feedback mechanism in domestic office environment
US9092508B1 (en) Overseeing data storage equipment power usage via local collection of power consumption data and remote evaluation and reporting of performance
CN105868441B (en) Multi-source data-based WAMS application system data integration test platform
CN112445660B (en) Test method for performance balance problem of shared storage array
CN103544196A (en) BigBase high-throughput big data online analysis software and hardware all-in-one machine

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20111116