CN105786689A - Automatic testing method and system for efficacy of Linux server of ARM - Google Patents

Automatic testing method and system for efficacy of Linux server of ARM Download PDF

Info

Publication number
CN105786689A
CN105786689A CN201410817184.0A CN201410817184A CN105786689A CN 105786689 A CN105786689 A CN 105786689A CN 201410817184 A CN201410817184 A CN 201410817184A CN 105786689 A CN105786689 A CN 105786689A
Authority
CN
China
Prior art keywords
test program
arm
linux server
source code
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410817184.0A
Other languages
Chinese (zh)
Other versions
CN105786689B (en
Inventor
刘子扬
林君平
魏廷箕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kunda Computer Technology Kunshan Co Ltd
Mitac International Corp
Original Assignee
Kunda Computer Technology Kunshan Co Ltd
Mitac International Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kunda Computer Technology Kunshan Co Ltd, Mitac International Corp filed Critical Kunda Computer Technology Kunshan Co Ltd
Priority to CN201410817184.0A priority Critical patent/CN105786689B/en
Publication of CN105786689A publication Critical patent/CN105786689A/en
Application granted granted Critical
Publication of CN105786689B publication Critical patent/CN105786689B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Debugging And Monitoring (AREA)
  • Test And Diagnosis Of Digital Computers (AREA)

Abstract

The present invention provides an automatic testing method and system for efficacy of a Linux server of an ARM. The method comprises the following steps: a. presetting original codes of a plurality types of efficacy testing programs built in a Linux server of an ARM; b. according to the original codes of the plurality types of efficacy testing programs contained in the Linux server of the ARM, generating a dialog list by using a dialog suite, and providing a testing program corresponding to to-be-tested content selected by a user; c. acquiring information of a hardware apparatus of the Linux server of the ARM; d. performing cross compilation according the original codes of the efficacy testing programs and the hardware information to obtain a testing program of the Linux server of the ARM; e. according to a preset number of times, cyclically executing the compiled testing program; and f. generating a testing result report of the compiled testing program. By means of the above steps, the method is capable of automating execution of the efficacy testing program applicable to the Linux system on the Linux server of the ARM.

Description

The usefulness automatic test approach of the Linux server of ARM and system thereof
Technical field
The present invention is usefulness automatic test approach and the system thereof of the Linux server of a kind of ARM.
Background technology
In a computer, usefulness (benchmark) refers to that, when executive program, batch processing or other operation, thereby the relative performance (performance) of evaluation object is wanted in assessment.Computer usefulness typically can with computer system at the appointed time with use under conditions of resource, the quantity of completed work represents." well " of computer usefulness potentially includes one or several in following items: 1. the utilization rate of quick response time 2. high-throughput (processing the speed of work) 3. resource.4. the data compression of the high availability 5. quick (or high compression rate) of computer system or application program and decompress 6. high bandwidths or quickly data transmission period scientist Arnold Allen proposes: " usefulness " mentioned in " computer usefulness " word in fact with the usefulness one mentioned under other situations, its usefulness refers to that " it is how good that the work that it should be to be completed can be accomplished by computer?」.And protos test suite PROTOS is a kind of software type, different test programs may be comprised, its objective is the correctness of assessment system.Many different effect test programs are had now on linux system, and with the Linux Benchmark Suite on the software kit such as Source forge website of effect test, or the Phoronix Test Suite on Phoronix website, the external member of this two sets effect test program is all to be widely used on linux system.If Ubuntu Linux Server when making Ubuntu Linux Server certification to tester table, Phoronix Test Suite will be used as one of which test event.And based on ARM(Advanced RISC Machines) Linux server on, the compatibility of above-mentioned several external member may come into question, although being all to use at linux system, but some program to use may following difficulty on the machine of ARM base: 1. may need cross compile, source code just has an opportunity to use on the machine of ARM framework after may needing first to use emulator cross compile before compiling on ARM framework.2. the configuration file case of software does not support that ARM framework is also possible to the difference designed ARM system SOC (system on chip, System on Chip/SoC) according to different manufacturers, and has incompatible part in compiling yet.
In view of this, the present invention provides usefulness automatic test approach and the system thereof of the Linux server of a kind of ARM, the execution automatization of its effect test program in the Linux server of ARM, linux system can being suitable for, it is to avoid test program applies the incompatibility in the Linux server of ARM.
Summary of the invention
Present invention is primarily targeted at usefulness automatic test approach and the system thereof of the Linux server that a kind of ARM is provided, the execution automatization of its effect test program in the Linux server of ARM, linux system can being suitable for, it is to avoid test program applies the incompatibility in the Linux server of ARM.
Another object of the present invention is to provide the usefulness automatic test approach of the Linux server of a kind of ARM, it provides user or the usefulness automatic test approach of one Linux server of developer, the method contains the user interface providing a dialog mode (dialog), and one allow that extra paying adds source code or program code to promote the mode of the execution efficiency of program code, to strengthen the execution of this effect test program.Therefore, the usefulness automatic test approach of the Linux server that developer or user can pass through the present invention import testing tool easily, cross compile will not be needed again or have the puzzlements such as change software set, it is possible to by the execution automatization of the effect test program that linux system is suitable for.For reaching above-mentioned purpose, the present invention provides the usefulness automatic test approach of the Linux server of a kind of ARM, and it comprises the following steps:
A. the source code of the built-in multiple effect test program of the Linux server of described ARM is preset;
B. according to the source code of multiple effect test program contained in the Linux server of described ARM, dialog external member is utilized to produce a dialog list, the test program that the content of user selection needs test is corresponding is provided, reaches catechetical guiding and install;
C. the information of the hardware unit of Linux server of described ARM own is obtained;
D. the source code of the effect test program that user selects is taken out, and the information of the hardware unit of acquired Linux server, source code and hardware information according to above-mentioned effect test program carry out cross compile, are compiled into the test program of Linux server based on described ARM;
E. according to the number of times preset, circulation performs the test program being compiled into;And
F. the test result report of the test program that execution is compiled into is produced.
Preferably, between step a and b, the effect test program source code that scanning User Defined adds is comprised the steps of further.
Preferably in described step b, the source code of multiple effect test program contained in the Linux server of described ARM comprises the source code of described default built-in multiple effect test program and the source code of the effect test program of described User Defined addition.
The present invention also provides for the usefulness Auto-Test System of the Linux server of a kind of ARM, for performing above-mentioned usefulness automatic test approach, it is characterised in that including:
One arranges module, and it is for presetting the source code of the built-in multiple effect test program of the Linux server of described ARM;
One selects module, it is connected with the described module that arranges, the source code of multiple effect test program contained in the Linux server according to described ARM, dialog external member is utilized to produce a dialog list, the test program that the content of user selection needs test is corresponding is provided, reaches catechetical guiding and install;
One data obtaining module, it is for obtaining the information of the hardware unit of Linux server of described ARM own;
One collector, it arranges module with described and described data obtaining module is connected, for taking out the source code of the effect test program that user selects, and the information of the hardware unit of acquired Linux server, source code and hardware information according to above-mentioned effect test program carry out cross compile, are compiled into the test program of the Linux server being applicable to described ARM;
One performs module, and it is connected with described collector, and for according to the number of times preset, circulation performs the test program being compiled into;And
One report generating module, it is connected to produce the test result report of the test program that execution is compiled into described execution module.
Preferably, the usefulness Auto-Test System of the Linux server of ARM of the present invention, it farther includes one scan module, and described scan module is connected with described selection module and described collector, for scanning the effect test program source code that User Defined adds.
Preferably, the source code of contained in described server multiple effect test program comprises the source code of described default built-in multiple effect test program and the source code of the effect test program of described User Defined addition.
Compared with prior art, the usefulness automatic test approach of the Linux server of the ARM of the present invention, source code and hardware information according to effect test program carry out cross compile, it is compiled into the test program of the Linux server being applicable to described ARM, and produce result after repeatedly circulating this compiler of execution, reach the execution automatization of the effect test program being suitable for by linux system in the Linux server of ARM whereby, it is to avoid test program applies the beneficial effect of the incompatibility in the Linux server of ARM.Wherein, in user interface part, the present invention utilizes dialog external member to produce a dialog list, it is provided that user selects to need the test program corresponding to content of test, reaches catechetical guiding and installs, thereby reaches automatic test.In addition, user can customize increases extra effect test program, the effect test program source code added by scanning User Defined, finally compile out the test program of the Linux server needing to be applicable to ARM, it is source code due to add, therefore user is easily modified, it is possible in response to expansion in the future and variation demand.
[accompanying drawing explanation]
Fig. 1 is the flow chart of steps of the usefulness automatic test approach of the Linux server of a kind of ARM of the present invention.
Fig. 2 is the functional-block diagram of the usefulness Auto-Test System of the Linux server of a kind of ARM of the present invention.
[detailed description of the invention]
Refer to shown in Fig. 1, the usefulness automatic test approach of the Linux server of a kind of ARM, it is adaptable to the Linux server of an ARM, comprise the steps of
Step 100: preset the source code of the built-in multiple effect test program of Linux server of described ARM, in this step, described built-in test program mostly is in effect test program on the market, the selection source of test program is to account for three kinds of Linux release that rate is higher, Red Hat Enterprise Linux, Suse Linux Enterprise with reference to city Server, Ubuntu Server, is the reference source selected for the test program in the certification software of these three kinds of versions.
Step 200: the effect test program source code that scanning User Defined adds, in this step, test program such as lmbench, dhrystone, Bonnie, Bonnie++, Coremark, Stream etc. that User Defined adds, the test program stored can increase voluntarily.
Step 300: according to the source code of multiple effect test program contained in the Linux server of described ARM, dialog external member is utilized to produce a dialog list, the test program that the content of user selection needs test is corresponding is provided, reach catechetical guiding to install, in this step, the source code of the effect test program that User Defined adds in source code that the source code of contained in described server multiple effect test program comprises the built-in multiple effect test program preset in step 100 and step 200.Step 400: obtain the information of the hardware unit of Linux server of described ARM own, comprise the core number of CPU, frequency, the size of DIMM capacity, wait this type of information.
Step 500: take out the source code of the effect test program that user selects, and the information of the hardware unit of acquired Linux server, source code and hardware information according to above-mentioned effect test program carry out cross compile, are compiled into the test program of the Linux server being applicable to described ARM.
Step 600: according to default number of times, circulation performs the test program being compiled into, and in this step, the test program being compiled into will be performed by circulation until reaching default number of times.
Step 700: produce the test result report of the test program that execution is compiled into.
Incorporated by reference to refering to shown in Fig. 1 and Fig. 2, the usefulness Auto-Test System of the Linux server of a kind of ARM of the present invention, for performing the usefulness automatic test approach shown in Fig. 1, and include: one arranges module 10, one scan module 20, selection module 30, data obtaining module 40, collector 50, execution module 60 and report generating module 70.
Described module 10 is set, it is for presetting the source code of the built-in multiple effect test program of the Linux server of described ARM, described built-in test program mostly is in effect test program on the market, the selection source of test program is to account for three kinds of Linux release that rate is higher, Red Hat Enterprise Linux, Suse Linux Enterprise with reference to city Server, Ubuntu Server, is the reference source selected for the test program in the certification software of these three kinds of versions.
Described scan module 20, it is for scanning the effect test program source code that User Defined adds, in this step, test program such as lmbench, dhrystone, Bonnie, Bonnie++, Coremark, Stream etc. that User Defined adds, the test program stored can increase voluntarily.It is noted that be source code due to add herein, therefore user is easily modified, it is possible in response to expansion in the future and variation demand.
Described selection module 30, it arranges module 10 with described and described scan module 20 is connected, the source code of multiple effect test program contained in the Linux server according to described ARM, dialog external member is utilized to produce a dialog list, the test program that the content of user selection needs test is corresponding is provided, reach catechetical guiding to install, in this step, the source code of multiple effect test program contained in described server comprises the source code of described default built-in multiple effect test program and the source code of the effect test program of described User Defined addition.
Described data obtaining module 40, it, for obtaining the information of the hardware unit of Linux server of described ARM own, comprises the core number of CPU, frequency, the size of DIMM capacity, waits this type of information.
Described collector 50, it is connected with described module 10, one scan module 20 and the described data obtaining module of arranging, for taking out the source code of the effect test program that user selects, and the information of the hardware unit of acquired Linux server, source code and hardware information according to above-mentioned effect test program carry out cross compile, are compiled into the test program of the Linux server being applicable to described ARM.
Described execution module 60, it is connected with described collector 50, and for according to the number of times preset, circulating the test program performing to be compiled into, the test program being compiled into is performed being circulated by described execution module 60 until arriving the number of times preset.
Described report generating module 70, it is connected to produce the test result report of the test program that execution is compiled into described execution module 60.
In sum, the various embodiments described above and diagram are only the preferred embodiments of the invention, but can not with the scope of restriction present invention enforcement, the equalization change the most generally made according to scope of the present invention patent with modify, all should be covered by the present invention within the scope of the patent.

Claims (6)

1. the usefulness automatic test approach of the Linux server of an ARM, it is adaptable to the Linux server of an ARM, comprises the steps of
A. the source code of the built-in multiple effect test program of the Linux server of described ARM is preset;
B. according to the source code of multiple effect test program contained in the Linux server of described ARM, dialog external member is utilized to produce a dialog list, the test program that the content of user selection needs test is corresponding is provided, reaches catechetical guiding and install;
C. the information of the hardware unit of Linux server of described ARM own is obtained;
D. the source code of the effect test program that user selects is taken out, and the information of the hardware unit of acquired Linux server, source code and hardware information according to above-mentioned effect test program carry out cross compile, are compiled into the test program of the Linux server being applicable to described ARM;
E. according to the number of times preset, circulation performs the test program being compiled into;And
F. the test result report of the test program that execution is compiled into is produced.
The usefulness automatic test approach of the Linux server of ARM the most according to claim 1, it is characterised in that comprise the steps of the effect test program source code that scanning User Defined adds between step a and b further.
The usefulness automatic test approach of the Linux server of ARM the most according to claim 2, it is characterized in that, in described step b, the source code of multiple effect test program contained in the Linux server of described ARM comprises the source code of described default built-in multiple effect test program and the source code of the effect test program of described User Defined addition.
4. a usefulness Auto-Test System for the Linux server of ARM, for performing the usefulness automatic test approach described in claim 1, it is characterised in that including:
One arranges module, and it is for presetting the source code of the built-in multiple effect test program of the Linux server of described ARM;
One selects module, it is connected with the described module that arranges, the source code of multiple effect test program contained in the Linux server according to described ARM, dialog external member is utilized to produce a dialog list, the test program that the content of user selection needs test is corresponding is provided, reaches catechetical guiding and install;
One data obtaining module, it is for obtaining the information of the hardware unit of Linux server of described ARM own;
One collector, it arranges module with described and described data obtaining module is connected, for taking out the source code of the effect test program that user selects, and the information of the hardware unit of acquired Linux server, source code and hardware information according to above-mentioned effect test program carry out cross compile, are compiled into the test program of the Linux server of ARM;
One performs module, and it is connected with described collector, and for according to the number of times preset, circulation performs the test program being compiled into;And
One report generating module, it is connected to produce the test result report of the test program that execution is compiled into described execution module.
The usefulness Auto-Test System of the Linux server of the most according to claim 4 kind of ARM, it is characterized in that farther including one scan module, described scan module is connected with described selection module and described collector, for scanning the effect test program source code that User Defined adds.
The usefulness Auto-Test System of the Linux server of the most according to claim 5 kind of ARM, it is characterized in that, the source code of multiple effect test program contained in described server comprises the source code of described default built-in multiple effect test program and the source code of the effect test program of described User Defined addition.
CN201410817184.0A 2014-12-24 2014-12-24 The efficiency automatic test approach and its system of the Linux server of ARM Expired - Fee Related CN105786689B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410817184.0A CN105786689B (en) 2014-12-24 2014-12-24 The efficiency automatic test approach and its system of the Linux server of ARM

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410817184.0A CN105786689B (en) 2014-12-24 2014-12-24 The efficiency automatic test approach and its system of the Linux server of ARM

Publications (2)

Publication Number Publication Date
CN105786689A true CN105786689A (en) 2016-07-20
CN105786689B CN105786689B (en) 2018-09-18

Family

ID=56378380

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410817184.0A Expired - Fee Related CN105786689B (en) 2014-12-24 2014-12-24 The efficiency automatic test approach and its system of the Linux server of ARM

Country Status (1)

Country Link
CN (1) CN105786689B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090228241A1 (en) * 2008-03-07 2009-09-10 Inventec Corporation System testing method through subsystem performance-based generator
CN101533366A (en) * 2009-03-09 2009-09-16 浪潮电子信息产业股份有限公司 Method for acquiring and analyzing performance data of server
CN103455132A (en) * 2013-08-20 2013-12-18 西安电子科技大学 Embedded system power consumption estimation method based on hardware performance counter
CN104035850A (en) * 2014-07-02 2014-09-10 浪潮电子信息产业股份有限公司 Verification method for memory bandwidth and pressure gradual-change parallelism

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090228241A1 (en) * 2008-03-07 2009-09-10 Inventec Corporation System testing method through subsystem performance-based generator
CN101533366A (en) * 2009-03-09 2009-09-16 浪潮电子信息产业股份有限公司 Method for acquiring and analyzing performance data of server
CN103455132A (en) * 2013-08-20 2013-12-18 西安电子科技大学 Embedded system power consumption estimation method based on hardware performance counter
CN104035850A (en) * 2014-07-02 2014-09-10 浪潮电子信息产业股份有限公司 Verification method for memory bandwidth and pressure gradual-change parallelism

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
TONYHO: "ARM Linux Benchmark的评测方法", 《TONYHO.GITHUB.IO/ARM LINUX BENCHMARK.HTML》 *

Also Published As

Publication number Publication date
CN105786689B (en) 2018-09-18

Similar Documents

Publication Publication Date Title
US10635576B2 (en) Branch coverage guided symbolic execution for hybrid fuzz testing of software binaries
US9081586B2 (en) Systems and methods for customizing optimization/transformation/ processing strategies
CN103049371A (en) Testing method and testing device of Android application programs
CN102662836B (en) Evaluation system and method for virtual machine
US9645911B2 (en) System and method for debugging firmware/software by generating trace data
CN103235759A (en) Method and device for generating test cases
US11120521B2 (en) Techniques for graphics processing unit profiling using binary instrumentation
CN111579959A (en) Chip verification method, device and storage medium
CN107329889B (en) Method for automatically testing C compiler
US20150331787A1 (en) Software verification
CN106649111A (en) Method and device for running test cases
CN111158656A (en) Method and device for generating test codes based on fruit tree method
US10528691B1 (en) Method and system for automated selection of a subset of plurality of validation tests
CN110032407B (en) Method and device for improving parallel performance of CPU (Central processing Unit) and electronic equipment
Ruprecht et al. Automatic feature selection in large-scale system-software product lines
CN105786689A (en) Automatic testing method and system for efficacy of Linux server of ARM
CN106951236B (en) Plug-in development method and device
CN112560393B (en) Comparison verification method and device of EDA software tool
CN108334313A (en) Continuous integrating method, apparatus and code management system for large-scale SOC research and development
CN115034165A (en) Chip simulation verification method, system, equipment and storage medium
CN115034164A (en) Verification method, electronic device, and storage medium
CN112527584A (en) Software efficiency improving method and system based on script compiling and data acquisition
KR20120072133A (en) Apparatus and method for software static testing
JP6776914B2 (en) Parallelization method, parallelization tool
TW201316194A (en) System and method for outputting measurement codes

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180918

Termination date: 20191224