CN112650678A - Jenkins-based automatic test system and method for audio and video accelerator card product - Google Patents

Jenkins-based automatic test system and method for audio and video accelerator card product Download PDF

Info

Publication number
CN112650678A
CN112650678A CN202011556249.2A CN202011556249A CN112650678A CN 112650678 A CN112650678 A CN 112650678A CN 202011556249 A CN202011556249 A CN 202011556249A CN 112650678 A CN112650678 A CN 112650678A
Authority
CN
China
Prior art keywords
test
jenkins
tool
tested
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011556249.2A
Other languages
Chinese (zh)
Other versions
CN112650678B (en
Inventor
王晨晖
吴冬冬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Ruixin High Throughput Technology Co ltd
Original Assignee
Beijing Ruixin High Throughput Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Ruixin High Throughput Technology Co ltd filed Critical Beijing Ruixin High Throughput Technology Co ltd
Priority to CN202011556249.2A priority Critical patent/CN112650678B/en
Publication of CN112650678A publication Critical patent/CN112650678A/en
Application granted granted Critical
Publication of CN112650678B publication Critical patent/CN112650678B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3688Test management for test execution, e.g. scheduling of test suites
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention discloses a Jenkins-based automatic test system and method for audio and video accelerator card products, wherein the method comprises the following steps: s1: deploying a Jenkins tool on a test PC, and downloading an installation package of an audio/video acceleration card from the remote database to a test server through a BvSshServer tool; s2: the test server installs the driver to the corresponding accelerator card to be tested, and establishes communication between the test server and the corresponding accelerator card to be tested through PCIE; s3: selecting test contents and parameters on a test PC through a user interface of a Jenkins tool, and starting test execution; s4: the test server drives the corresponding to-be-tested accelerator card to automatically execute a test task, a Jenkins tool automatically counts test execution conditions, and results are compared to generate a test report; s5: and the Jenkins tool calls an Email Extension plug-in to automatically send the generated test report to preset related personnel through an Email.

Description

Jenkins-based automatic test system and method for audio and video accelerator card product
Technical Field
The invention relates to the field of software testing, in particular to a Jenkins-based automatic testing system and method for an audio and video accelerator card product.
Background
With the rapid development of the mobile internet and the internet of things, the browsing and downloading amount of the network audio and video of people is also rapidly increased, the audio and video accelerator card as a hardware accelerator has been widely applied to the field of audio and video processing, but the test on the aspects of the functions, the performance, the stability and the like of the audio and video accelerator card product still needs a large amount of manual participation, the test human resource investment is large, and the test efficiency is low, so that an automatic test scheme capable of being carried out efficiently is needed.
Disclosure of Invention
In order to solve the defects of the prior art, the invention provides an automatic test system and method for an audio and video accelerator card product, which are used for realizing automatic test on the audio and video accelerator card through a Jenkins tool and a Python script, so that the workload of manual participation is reduced, and the test efficiency is improved.
In order to achieve the above object, the present invention provides an automated audio/video accelerator card product testing system based on Jenkins, which comprises:
the test server comprises a gigabit network port and a plurality of PCIE slots;
the test PC is connected with the gigabit network port of the test server through a network cable;
the remote database is connected with the test PC and comprises an installation package of the audio and video accelerator card, wherein the installation package is software, and the version of the software is updated regularly or irregularly;
and each to-be-tested accelerator card is inserted into any vacant PCIE slot of the test server.
In an embodiment of the present invention, the CPU of the test server is FT2000 based on ARM architecture, and the operating system of the test server is Linux Kylin 4.4.58-aarch 64.
In an embodiment of the present invention, the test PC is a computer with an operating system of Windows, and includes a previously installed BvSshServer tool.
In order to achieve the purpose, the invention also provides an automatic audio and video accelerator card product testing method based on Jenkins, which comprises the following steps:
s1: deploying a Jenkins tool on a test PC, and downloading an installation package of an audio/video acceleration card from a remote database to a test server through a BvSshServer tool;
s2: the test server installs the driver to the corresponding accelerator card to be tested, and establishes communication between the test server and the corresponding accelerator card to be tested through PCIE;
s3: selecting test contents and parameters on a test PC through a user interface of a Jenkins tool, and starting test execution;
s4: the test server drives the corresponding to-be-tested accelerator card to automatically execute a test task, a Jenkins tool automatically counts test execution conditions, and results are compared to generate a test report;
s5: and the Jenkins tool calls an Email Extension plug-in to automatically send the generated test report to preset related personnel through an Email.
In an embodiment of the present invention, step S1 further includes update detection of the installation package, specifically: if the installation package is updated on the remote database, the test PC automatically downloads the new installation package and installs the new installation package on the test server.
In an embodiment of the present invention, the step S3 of selecting the test content and the parameters through the user interface of the Jenkins tool specifically includes: selecting a test type, inputting the position of a folder where test data is located, and carrying out parameterization construction through an operation command.
In an embodiment of the present invention, the test types include: function test, performance test and stability test.
In an embodiment of the present invention, the specific process of automatically counting the test execution condition by the Jenkins tool in step S4, comparing the results, and generating the test report includes:
s41: recording the execution process of the test into a test log by a Jenkins tool;
s42: reading effective information in the test log into EXCEL through a Python script;
s43: automatically comparing an actual result of test execution with an expected result through a Python script, and calculating data information needing to be counted;
s44: and generating a test report according to the comparison and calculated result in a preset format.
In an embodiment of the present invention, the test report in S44 includes: test environment information, software version information, tester information and test result information.
In an embodiment of the present invention, the testing method further includes performing a test of the multi-card concurrent task by modifying the number of the test-configured accelerator cards to be tested, specifically:
selecting a plurality of acceleration cards to be tested on a user interface of a Jenkins tool and configuring the acceleration cards;
after the Jenkins tool starts a test task, test data distribution and load balancing are automatically carried out by inquiring the number of idle channels of each acceleration card to be tested.
Compared with the prior art, the method and the device have the advantages that the audio and video acceleration card is automatically tested in a software and hardware combined mode, the automation rate and the test efficiency of test execution are improved, the test result is generated through automatic calculation and comparison, the result statistical efficiency and the accuracy are improved, and the investment of human resources is saved by reducing the manual participation in the test process.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
FIG. 1 is a system architecture diagram according to an embodiment of the present invention;
FIG. 2 is a schematic view of a parameter setting interface according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating a test report according to an embodiment of the present invention.
Description of reference numerals: 10-testing a PC machine; 20-a test server; 21-PCIE slot; 22-gigabit ports; 30-a remote database; 40-Accelerator card to be tested.
Detailed Description
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.
Fig. 1 is a schematic diagram of a system architecture according to an embodiment of the present invention, and as shown in fig. 1, the present invention provides an automated audio/video accelerator card product testing system based on Jenkins (Jenkins is an open-source continuous integration tool), which includes:
a test server (20) comprising a gigabit network port (22) and a plurality of PCIE slots (21);
a test PC (personal computer) machine (10) connected with the gigabit network port (22) of the test server (20) through the network cable;
the remote database (30) is connected with the test PC (10), and the remote database (30) comprises an installation package of the audio/video acceleration card, wherein the installation package is software, and the version of the software is updated regularly or irregularly;
and a plurality of accelerator cards (40) to be tested, wherein each accelerator card (40) to be tested is inserted into any one of the vacant PCIE (high speed serial computer extended bus standard) slots (21) of the test server (20).
In the embodiment, the CPU (central processing unit) of the test server (20) is an FT2000 (processor chip) based on an arm (advanced RISC machine) architecture, and the operating system of the test server is Linux Kylin 4.4.58-aach 64.
In this embodiment, the test PC (10) is a computer with a Windows operating system, and includes a previously installed BvSshServer tool, which is a tool for implementing SSH communication between Linux and Windows.
The invention also provides an automatic testing method of the audio and video accelerator card product based on Jenkins, which comprises the following steps:
s1: deploying a Jenkins tool on a test PC (10), and downloading an installation package of an audio/video accelerator card from a remote database (30) to a test server (20) through a BvSshServer tool;
s2: the test server (20) installs the driver to the corresponding accelerator card (40) to be tested, and establishes communication between the test server (20) and the corresponding accelerator card (40) to be tested through PCIE;
s3: selecting test contents and parameters on a test PC (10) through a user interface of a Jenkins tool, and starting test execution;
s4: the test server (20) drives the corresponding accelerator card (40) to be tested to automatically execute a test task, a Jenkins tool automatically counts test execution conditions, and a result comparison is performed to generate a test report;
s5: and the Jenkins tool calls an Email Extension plug-in to automatically send the generated test report to preset related personnel through an Email.
In an embodiment of the present invention, step S1 further includes update detection of the installation package, specifically: if the installation package on the remote database (30) is updated, the test PC (10) automatically downloads the new installation package and installs it on the test server (20).
Fig. 2 is a schematic view of a parameter setting interface according to an embodiment of the present invention, as shown in fig. 2, in this embodiment, the step S3 specifically includes selecting test contents and parameters through a user interface of a Jenkins tool: selecting different Test types (Test _ type), inputting the positions (Input _ dir) of folders where the Test data are positioned, and carrying out parameterization construction through a running command (Run _ param).
In an embodiment of the present invention, the test types include: functional test, performance test, stability test, and the like.
In an embodiment of the present invention, the specific process of automatically counting the test execution condition by the Jenkins tool in step S4, comparing the results, and generating the test report includes:
s41: recording the execution process of the test into a test log by a Jenkins tool;
s42: reading effective information in the test log into EXCEL (form) through Python script;
s43: automatically comparing an actual result of test execution with an expected result through a Python script, and calculating data information needing to be counted;
s44: and generating a test report according to the comparison and calculated result in a preset format.
Fig. 3 is a schematic diagram of a test report according to an embodiment of the present invention, as shown in fig. 3, in the embodiment, the test report in S44 includes: test environment information (host, cpu, mem, test time, test command), software version information (software version), tester information (tester), and test result information (test result), etc.
In an embodiment of the present invention, the testing method further includes performing a multi-card concurrent task test by modifying the number of the test-configured accelerator cards (40) to be tested, specifically:
selecting and configuring a plurality of acceleration cards (40) to be tested on a user interface of a Jenkins tool;
after the Jenkins tool starts a test task, test data distribution and load balancing are automatically carried out by inquiring the number of idle channels of each acceleration card to be tested, so that the test of concurrent tasks is realized.
The method and the device automatically test the audio and video acceleration card in a software and hardware combined mode, improve the automation rate and the test efficiency of test execution, generate the test result through automatic calculation and comparison, improve the result statistical efficiency and the accuracy, and save the investment of human resources by reducing the manual participation in the test process.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. The utility model provides an audio frequency and video accelerator card product automated test system based on Jenkins which characterized in that includes:
the test server comprises a gigabit network port and a plurality of PCIE slots;
the test PC is connected with the gigabit network port of the test server through a network cable;
the remote database is connected with the test PC and comprises an installation package of the audio and video acceleration card, wherein the installation package is software, and the version of the software is updated regularly or irregularly;
and each to-be-tested accelerator card is inserted into any vacant PCIE slot of the test server.
2. The automated test system of claim 1, wherein the CPU of the test server is an FT2000 based on ARM architecture, and the operating system of the test server is Linux Kylin 4.4.58-aarch 64.
3. The automated test system of claim 1, wherein the test PC is a computer with an operating system of Windows and includes a pre-installed BvSshServer tool.
4. An automatic audio and video accelerator card product testing method based on Jenkins is executed by any automatic testing system of claims 1-3, and is characterized by comprising the following steps:
s1: deploying a Jenkins tool on the test PC, and downloading an installation package of an audio/video acceleration card from the remote database to a test server through a BvSshServer tool;
s2: the test server installs the driver to the corresponding accelerator card to be tested, and establishes communication between the test server and the corresponding accelerator card to be tested through PCIE;
s3: selecting test contents and parameters on the test PC through a user interface of a Jenkins tool, and starting test execution;
s4: the test server drives the corresponding to-be-tested accelerator card to automatically execute a test task, the Jenkins tool automatically counts test execution conditions, and a test report is generated by comparing results;
s5: and the Jenkins tool calls an Email Extension plug-in to automatically send the generated test report to preset related personnel through an Email.
5. The automated testing method according to claim 4, wherein step S1 further comprises update detection of the installation package, specifically: and if the installation package on the remote database is updated, the test PC automatically downloads the new installation package and installs the new installation package on the test server.
6. The automated testing method of claim 4, wherein the step S3 of selecting the test content and parameters through the user interface of the Jenkins tool specifically comprises: selecting a test type, inputting the position of a folder where test data is located, and carrying out parameterization construction through an operation command.
7. The automated testing method of claim 6, wherein the test type comprises: function test, performance test and stability test.
8. The automated testing method of claim 4, wherein the Jenkins tool automatically counts the test execution conditions in step S4, and the specific process of comparing the results and generating the test report includes:
s41: the Jenkins tool records the execution process of the test into a test log;
s42: reading effective information in the test log into EXCEL through a Python script;
s43: automatically comparing an actual result of test execution with an expected result through a Python script, and calculating data information needing to be counted;
s44: and generating a test report according to the comparison and calculated result in a preset format.
9. The automated testing method of claim 8, wherein the test report in S44 comprises: test environment information, software version information, tester information and test result information.
10. The automated testing method according to claim 4, further comprising performing a multi-card concurrent task test by modifying the number of test-configured accelerator cards to be tested, specifically:
selecting and configuring a plurality of acceleration cards to be tested on a user interface of the Jenkins tool;
after the Jenkins tool starts a test task, the number of idle channels of each acceleration card to be tested is inquired to automatically distribute test data and balance load.
CN202011556249.2A 2020-12-24 2020-12-24 Jenkins-based audio and video acceleration card product automatic test system and method Active CN112650678B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011556249.2A CN112650678B (en) 2020-12-24 2020-12-24 Jenkins-based audio and video acceleration card product automatic test system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011556249.2A CN112650678B (en) 2020-12-24 2020-12-24 Jenkins-based audio and video acceleration card product automatic test system and method

Publications (2)

Publication Number Publication Date
CN112650678A true CN112650678A (en) 2021-04-13
CN112650678B CN112650678B (en) 2024-04-19

Family

ID=75362733

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011556249.2A Active CN112650678B (en) 2020-12-24 2020-12-24 Jenkins-based audio and video acceleration card product automatic test system and method

Country Status (1)

Country Link
CN (1) CN112650678B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113760761A (en) * 2021-09-07 2021-12-07 上海金仕达软件科技有限公司 Automatic testing method and device based on software and hardware stock market system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070090657A (en) * 2006-03-03 2007-09-06 에스케이 텔레콤주식회사 Systen for providing a mobile present and a method the same
CN105260281A (en) * 2015-09-11 2016-01-20 浪潮电子信息产业股份有限公司 Iozone based PCIE SSD card performance test method
CN109460367A (en) * 2018-11-16 2019-03-12 四川长虹电器股份有限公司 Method based on the sustainable integrated automation performance test of Jmeter
CN111858197A (en) * 2020-06-15 2020-10-30 詹毕旺 Device, system and method for supporting multiple SSD tests

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070090657A (en) * 2006-03-03 2007-09-06 에스케이 텔레콤주식회사 Systen for providing a mobile present and a method the same
CN105260281A (en) * 2015-09-11 2016-01-20 浪潮电子信息产业股份有限公司 Iozone based PCIE SSD card performance test method
CN109460367A (en) * 2018-11-16 2019-03-12 四川长虹电器股份有限公司 Method based on the sustainable integrated automation performance test of Jmeter
CN111858197A (en) * 2020-06-15 2020-10-30 詹毕旺 Device, system and method for supporting multiple SSD tests

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
今从晚向: "5分钟学习用Python写测试报告—openpyxl应用", 《HTTPS://ZHUANLAN.ZHIHU.COM/P/76880658?UTM_ID=0》, pages 1 - 7 *
光阴8023: "Jenkins的并发构建", 《HTTPS://WWW.CNBLOGS.COM/WANGXU01/ARTICLES/11103572.HTML》, pages 1 - 3 *
刘博等: "一种基于Jenkins的嵌入式软件持续集成方法", 《铁道机车车辆》, no. 06, 31 December 2018 (2018-12-31), pages 14 - 16 *
小鱿鱼GUN神: "python将测试结果写入excel", 《HTTPS://WWW.JIANSHU.COM/P/29B821D1BFFC》, pages 1 - 4 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113760761A (en) * 2021-09-07 2021-12-07 上海金仕达软件科技有限公司 Automatic testing method and device based on software and hardware stock market system

Also Published As

Publication number Publication date
CN112650678B (en) 2024-04-19

Similar Documents

Publication Publication Date Title
CN108600029B (en) Configuration file updating method and device, terminal equipment and storage medium
CN109740222B (en) Testing device and system for automobile networking scene
CN106919485B (en) System based on hardware testing tool configured on server
CN109933509A (en) A kind of method and apparatus for realizing automatic test defect management
CN111752581A (en) Distributed system upgrading method and device and computer system
CN112506619A (en) Job processing method, apparatus, electronic device, storage medium, and program product
CN111625404A (en) Method for testing NVMe hard disk based on Jenkins, system storage medium and electronic equipment
CN110569154B (en) Chip interface function testing method, system, terminal and storage medium
CN112650678B (en) Jenkins-based audio and video acceleration card product automatic test system and method
CN112269697B (en) Equipment storage performance testing method, system and related device
CN105224453A (en) The automatic test approach of system compatibility and device
CN110442059B (en) Controlled equipment expanding method and device and control equipment
CN111610965A (en) Standard SDK (software development kit) making method and device of access control platform
CN115904388A (en) Application program protocol analysis method, device, equipment and storage medium
CN116149808A (en) Robot flow automatic management system and method
CN115113890A (en) Automatic deployment method, system, equipment and medium of terminal software
CN115391204A (en) Test method and device for automatic driving service, electronic equipment and storage medium
CN111679885B (en) Method, device, medium and electronic equipment for determining virtual machine drift
CN111538542B (en) System configuration method and related device
CN114171107A (en) Detection method, device, equipment and storage medium for VPD information of solid state disk
CN112463480A (en) ARM architecture-based pressure test method, system, terminal and storage medium
CN112215587B (en) Method, device and system for automatically executing business process interaction tasks by multiple devices
CN116136813B (en) Method, device and storage medium for simulating adaptive multi-model avionics signals
CN113298538B (en) Customer service data processing method and device
CN116737513B (en) Computer hardware information acquisition method, system and computer equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Room 711c, 7 / F, block a, building 1, yard 19, Ronghua Middle Road, Beijing Economic and Technological Development Zone, Daxing District, Beijing 102600

Applicant after: Beijing Zhongke Flux Technology Co.,Ltd.

Address before: Room 711c, 7 / F, block a, building 1, yard 19, Ronghua Middle Road, Beijing Economic and Technological Development Zone, Daxing District, Beijing 102600

Applicant before: Beijing Ruixin high throughput technology Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant