WO2021227690A1 - Automatic testing system and method for robot, and build server and storage medium - Google Patents

Automatic testing system and method for robot, and build server and storage medium Download PDF

Info

Publication number
WO2021227690A1
WO2021227690A1 PCT/CN2021/084562 CN2021084562W WO2021227690A1 WO 2021227690 A1 WO2021227690 A1 WO 2021227690A1 CN 2021084562 W CN2021084562 W CN 2021084562W WO 2021227690 A1 WO2021227690 A1 WO 2021227690A1
Authority
WO
WIPO (PCT)
Prior art keywords
test
server
robot
construction
automated
Prior art date
Application number
PCT/CN2021/084562
Other languages
French (fr)
Chinese (zh)
Inventor
杨志钦
潘乐
虞坤霖
Original Assignee
炬星科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 炬星科技(深圳)有限公司 filed Critical 炬星科技(深圳)有限公司
Publication of WO2021227690A1 publication Critical patent/WO2021227690A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3684Test management for test design, e.g. generating new test cases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3664Environments for testing or debugging software
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3688Test management for test execution, e.g. scheduling of test suites
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3692Test management for test results analysis

Definitions

  • the embodiment of the present invention belongs to the field of robotics technology, and in particular relates to a robot automated test system, method, construction server, and computer-readable storage medium.
  • the embodiments of the present invention provide a robot automated test system, method, construction server, and computer-readable storage medium to solve the limitations of the above-mentioned existing robot test methods, and the software cannot be used in the entire robot software system. Fully test the functional characteristics of the tester; and, the need for manual participation, resulting in low test efficiency, and the entire test process will consume a lot of energy for testers.
  • the first aspect of the embodiments of the present invention provides a robot automated test system, which includes a code management server, a build server, and an over-the-air download (Over the Air, an OTA server), a test server and a robot, where the build server includes:
  • the construction unit is set to compile and package the project test code uploaded by the code management server according to a pre-configured construction rule to generate a corresponding construction, the construction includes a test script, a test object, a test suite, and a test list;
  • the first deployment unit is configured to send the structure to the OTA server, so that the OTA server uses the structure to upgrade the robot software;
  • the second deployment unit is configured to send the construction to the test server so that the test server executes the test script after the robot upgrade is completed, and gradually calls the corresponding test suite pair according to the test list
  • the test objects in the robot perform automated tests, and the test results fed back by the robot are summarized and uploaded to the construction server;
  • the test result processing unit is configured to perform judgment analysis on the test result, return the judgment analysis result to the code management server, and output and display the judgment analysis result at the same time.
  • test object is the full-platform software in the robot software system
  • the first deployment unit is specifically configured to: send the structure to the OTA server, so that the OTA server uses the structure to upgrade the robot in full;
  • the second deployment unit is specifically configured to send the structure to the test server, so that the test server executes the test script after the robot upgrade is completed, and gradually calls the corresponding test script according to the test list.
  • the test suite performs a full amount of automated testing on the robot, and summarizes the test results fed back by the robot and uploads it to the construction server.
  • test object is an incremental software module related to the project test code
  • the first deployment unit is specifically configured to send the structure to the OTA server, so that the OTA server uses the structure to incrementally upgrade the robot;
  • the second deployment unit is specifically configured to send the structure to the test server, so that the test server executes the test script after the robot upgrade is completed, and gradually calls the corresponding test script according to the test list.
  • the test suite performs incremental automated testing on the robot, and summarizes the test results fed back by the robot and uploads it to the construction server.
  • the construction server further includes:
  • the distributed cluster management unit is configured to construct a robot cluster environment that can execute test suites concurrently, and trigger the robot cluster to execute tests concurrently according to the construction generated by the construction unit.
  • a second aspect of the embodiments of the present invention provides a robot automated test method, which is applied to the robot automated test system described in any one of the above, and the robot automated test method includes using a build server to perform the following steps:
  • test server executes the test script, and gradually calls the corresponding test suite according to the test list to automate the test objects in the robot Test, and upload the test results fed back by the robot to the build server after aggregating them;
  • test result uploaded by the test server is received, the test result is judged and analyzed, the judgment and analysis result is returned to the code management server, and the judgment and analysis result is output and displayed.
  • test object is the full-platform software in the robot software system
  • the construction server After the construction server sends the construction to the OTA server, triggering the OTA server to use the construction to upgrade the robot in full;
  • the construction server After the construction server sends the construction to the test server, it triggers the test server to execute the test script after the robot upgrade is completed, and gradually calls the corresponding test suite to perform the test on the robot according to the test list. Fully automated testing, and the test results fed back by the robot are summarized and uploaded to the construction server.
  • test object is an incremental software module related to the project test code
  • the construction server After the construction server sends the construction to the OTA server, it triggers the OTA server to use the construction to incrementally upgrade the robot;
  • the construction server After the construction server sends the construction to the test server, it triggers the test server to execute the test script after the robot upgrade is completed, and gradually calls the corresponding test suite to the test server according to the test list.
  • the robot performs incremental automated testing, and summarizes the test results fed back by the robot and uploads the result to the construction server.
  • the method further includes using the construction server to perform the following steps:
  • the third aspect of the embodiments of the present invention provides a construction server, which is applied to a robot automated test system, the robot automated test system further includes a code management server, an OTA server, a test server, and a robot; wherein, the construction server includes: a memory , A processor, and a computer program stored in the memory and capable of running on the processor, and when the processor executes the computer program, the steps of the robot automated testing method according to any one of the second aspects are implemented .
  • a fourth aspect of the embodiments of the present invention provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it implements the robot described in any one of the above-mentioned second aspects. Automated test method steps.
  • the construction server is used to compile and package the project test code uploaded by the code management server to generate the corresponding construction, and the construction includes Test scripts, test objects, test suites, and test lists; then, send the construction to the OTA server, so that the OTA server uses the construction to upgrade the robot software; at the same time, the construction After the upgrade of the robot is completed, the test server executes the test script, and gradually calls the corresponding test suite according to the test list to automatically test the test objects in the robot, The test results fed back by the robot are summarized and uploaded to the construction server; finally, the test result is judged and analyzed, the judgment analysis result is returned to the code management server, and the judgment analysis result is performed at the same time.
  • Output display which can realize the whole process of robot automation test without manual participation, improve test efficiency and save labor cost; in addition, because the test object is constructed by the construction server according to the pre-configured construction rules, the project test code is constructed Yes, it can be the full-platform software in the robot, or it can be the software module associated with the project test code, which can avoid the limitations of manual testing, and can determine the functions of the software in the entire robot software system. The characteristics are fully tested.
  • Fig. 1 is a structural block diagram of a robot automated test system provided in the first embodiment of the present invention.
  • Fig. 2 is a schematic diagram of the structure of a server constructed in the robot automated test system provided by the first embodiment of the present invention.
  • Fig. 3 is a schematic diagram of a specific implementation process of the robot automated test method provided in the second embodiment of the present invention.
  • Fig. 4 is a schematic structural diagram of a construction server provided in the third embodiment of the present invention.
  • Fig. 1 is a schematic structural diagram of a robot automated test system provided in the first embodiment of the present invention. For ease of description, only the parts related to this embodiment are shown.
  • the robot automated test system includes a code management server 1, a construction server 2, an OTA server 3, a test server 4, and a robot 5.
  • the construction server 2 includes:
  • the construction unit 21 is configured to compile and package the project test code uploaded by the code management server 1 with a pre-configured construction rule to generate a corresponding construction.
  • the construction includes a test script, a test object, a test suite, and a test list;
  • the first deployment unit 22 is configured to send the structure to the OTA server 3, so that the OTA server 3 uses the structure to upgrade the robot 5 software;
  • the second deployment unit 23 is configured to send the structure to the test server 4, so that after the robot 5 is upgraded, the test server 4 gradually calls the corresponding test suite to the test list according to the test list.
  • the test objects in the robot 5 perform automated tests, and the test results fed back by the robot 5 are summarized and uploaded to the construction server 2;
  • the test result processing unit 24 is configured to perform judgment analysis on the test result, return the judgment analysis result to the code management server 1, and output and display the judgment analysis result at the same time.
  • the test object in the structure may be the full-platform software of the robot 5, or may be an incremental software module related to the project test code, which is constructed by the construction unit 21 according to a pre-configured construction rule.
  • a project test code patch is submitted to the build server 2 corresponding to the compiled building.
  • the test may be larger than the build compiled by its own project, and the test object contains larger than the build compiled by the project test code itself. Things. E.g:
  • the structure includes at least one test suite, and each test suite includes: initial configuration firmware setup.sh, clear configuration firmware teardown.sh, and at least one test case case; wherein, steup.sh is before the test script Execute to complete the preparatory work, such as: import test input, close or open the service, etc.; teardown.sh, execute after the test script, complete the finishing work, such as recycling system resources, closing or opening services, etc.
  • the test list in the structure is set to describe the test type and test sequence relationship of the test case, where the test type and sequence are configured when the test engineer writes the test script code, and the automated test is based on the test type and test sequence defined in the test list.
  • the test sequence is tested step by step.
  • the test types include automatic smoke test, function test, and performance test, and the test sequence is performed in sequence according to the automatic smoke test and the performance test of the function test set.
  • test object in the structure is the full-platform software in the robot 5 software system
  • the first deployment unit 22 is specifically configured to send the structure to the OTA server 3, so that the OTA server 3 uses the structure to upgrade the robot 5 in full;
  • the second deployment unit 23 is specifically configured to send the structure to the test server 4, so that the test server 4 gradually calls the corresponding test suite according to the test list after the upgrade of the robot 5 is completed. Fully automated testing is performed on the robot 5, and the test results fed back by the robot 5 are summarized and uploaded to the construction server 2.
  • the OTA server 3 after the OTA server 3 receives the structure, it generates a full upgrade of the robot 5 according to the structure and the latest version of the robot 5 software system stored in the OTA server 3 Software upgrade package, and deliver the full software upgrade package to the robot 5. After receiving the full software upgrade package, the robot 5 uses the full software upgrade package to perform a full upgrade, and after the upgrade is completed The corresponding notification information is sent to the test server 4.
  • test server 4 after the test server 4 receives the upgrade completion notification message sent by the robot 5, it triggers the execution of the test script, and starts to gradually call the corresponding test suite to perform the test on the robot 5 according to the test list. Fully automated testing, while collecting various software test results fed back by the robot 5, and after generating a report of the various software test results, the report is fed back to the construction server 2.
  • the test object is an incremental software module related to the project test code
  • the first deployment unit 22 is specifically configured to send the structure to the OTA server 3, so that the OTA server 3 uses the structure to incrementally upgrade the robot 5;
  • the second deployment unit 23 is specifically configured to send the structure to the test server 4, so that the test server 4 gradually calls the corresponding test suite according to the test list after the upgrade of the robot 5 is completed. Perform incremental automated testing on the robot 5, and upload the test results fed back by the robot 5 to the construction server 2 after aggregating them.
  • the OTA server 3 will associate the construction with the latest version of the software system related to the construction.
  • the software modules are compared to generate an incremental software upgrade package for upgrading the robot 5, and then the incremental software upgrade package is issued to the robot 5, so that the robot 5 performs an incremental upgrade according to the incremental software upgrade package, and After the upgrade is completed, notification information is sent to the test server 4.
  • test server 4 after the test server 4 receives the notification message of the completion of the upgrade sent by the robot 5, it triggers the execution of the test script, and starts to gradually call the corresponding test suite to perform the test on the robot 5 according to the test list.
  • incremental test at the same time, various incremental software test results fed back by the robot 5 are collected, and after each incremental software test result is generated in a report, the report is fed back to the construction server 2.
  • the construction server 2 further includes:
  • the distributed cluster management unit 25 is configured to construct a cluster environment of robots 5 that can execute test suites concurrently, and trigger the clusters of robots 5 to execute tests concurrently according to the construction generated by the construction unit 21.
  • the distributed integrated management unit 25 uses Selenium Grid implements a build server 2 build to trigger multiple machines to execute tests concurrently.
  • Selenium Grid is essentially a graphical user interface that can execute concurrently (Graphical User Interface) Interface, GUI) test case cluster of test execution machines, using HUB (master node) and Node (slave node) modes, Selenium Hub is used to manage the registration information and status information of each Selenium Node, and when receiving remote clients After the test call request of the end code, the request command is forwarded to Selenium that meets the requirements Node execution.
  • HUB master node
  • Node slave node
  • the robot automated test system uses the build server 2 to compile and package the project test code uploaded by the code management server 1 to generate a corresponding building.
  • the building includes a test script and a test object. , Test suite and test list; then, send the structure to the OTA server 3, so that the OTA server 3 uses the structure to upgrade the robot 5; at the same time, send the structure
  • the test server 4 executes the test script after the upgrade of the robot 5 is completed, and gradually calls the corresponding test suite according to the test list to automate the test objects in the robot 5 Test and upload the test results fed back by the robot 5 to the construction server 2; finally, the test result is judged and analyzed, and the judgment and analysis result is returned to the code management server 1, and at the same time
  • the judgment and analysis results are output and displayed, so that the entire process of robotic automated testing can be realized without manual participation, which improves testing efficiency and saves labor costs; in addition, because the test object is tested by the construction server 2 according to the pre-con
  • FIG. 2 is a schematic diagram of a specific implementation process of the robot automated testing method provided by the second embodiment of the present invention.
  • the execution body of the method is the construction server 2 in the system shown in FIG. 1.
  • the robot automated test method provided in this embodiment includes:
  • Step S301 receiving the project test code uploaded by the code management server 1, and compiling and packaging the project test code according to the pre-configured construction rules to generate a corresponding building, the building including a test object, a test suite, and a test list;
  • Step S302 sending the structure to the OTA server 3, so that the OTA server 3 uses the structure to upgrade the software of the robot 5; at the same time,
  • Step S303 Send the structure to the test server 4, so that after the robot 5 is upgraded, the test server 4 gradually calls the corresponding test suite according to the test list to perform the test on the test objects in the robot 5 Automate testing, and upload the test results fed back by the robot 5 to the construction server 2 after aggregating them;
  • Step S304 Receive the test result uploaded by the test server 4, perform judgment analysis on the test result, return the judgment analysis result to the code management server 1, and output and display the judgment analysis result.
  • the test object is the full-platform software in the robot 5 software system; after the construction server 2 sends the construction to the OTA server 3, it triggers the OTA server 3 to use The building upgrades the robot 5 in full; after the building server 2 sends the building to the test server 4, the test server 4 is triggered to complete the upgrade of the robot 5 according to the test list
  • the corresponding test suite is gradually called to perform a full automated test on the robot 5, and the test results fed back by the robot 5 are summarized and uploaded to the construction server 2.
  • the test object is an incremental software module related to the project test code; after the construction server 2 sends the construction to the OTA server 3, the OTA is triggered The server 3 uses the construction to incrementally upgrade the robot 5; after the construction server 2 sends the construction to the test server 4, the test server 4 is triggered after the robot 5 is upgraded.
  • the test list gradually call the corresponding test suite to perform an incremental automated test on the robot 5, and upload the test results fed back by the robot 5 to the construction server 2 after aggregating.
  • the robot automated test method further includes using the construction server 2 to execute the following steps: constructing a robot 5 cluster environment that can execute test suites concurrently, and triggering the robot 5 cluster to execute tests concurrently according to the construction.
  • FIG. 3 is a schematic structural diagram of the construction server 2 provided in the third embodiment of the present invention. For ease of description, only the parts related to this embodiment are shown.
  • the construction server 2 provided in this embodiment is applied to a robot automated test system, and the robot automated test system further includes a code management server 1, an OTA server 3, a test server 4, and a robot 5; wherein, the construction The server 2 includes: a memory 27, a processor 26, and a computer program 28 that is stored in the memory 27 and can run on the processor 26.
  • the processor 26 executes the computer program 28, the above-mentioned embodiment is implemented Steps of any one of the robot automated testing methods.
  • the fourth embodiment of the present invention provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the automated test of the robot as described in any one of the above-mentioned embodiment two is realized Method steps.
  • the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may consist of several physical components.
  • the components are executed cooperatively.
  • Some physical components or all physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit .
  • a processor such as a central processing unit, a digital signal processor, or a microprocessor
  • Such software may be distributed on a computer-readable medium, and the computer-readable medium may include a computer storage medium (or a non-transitory medium) and a communication medium (or a transitory medium).
  • computer storage medium includes volatile and nonvolatile implementations in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data).
  • Information such as computer-readable instructions, data structures, program modules, or other data.
  • Computer storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or Any other medium used to store desired information and that can be accessed by a computer.
  • communication media usually contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as carrier waves or other transmission mechanisms, and may include any information delivery media. .
  • the construction server is used to compile and package the project test code uploaded by the code management server to generate the corresponding construction.
  • the test script is executed, and the corresponding test suite is gradually invoked according to the test list to perform automated tests on the test objects in the robot, and the test results fed back by the robot are summarized and uploaded to the build server; and finally , And then judge and analyze the test result, return the judgment and analysis result to the code management server, and output and display the judgment and analysis result at the same time, so as to realize the robot automation test of the whole process without manual participation, which improves Testing efficiency saves labor costs; in addition, since the test object is constructed by the build server according to the pre-configured construction rules, it can be the full platform software in the robot, or

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

An automatic testing system and method for a robot, and a build server and a storage medium. The method comprises using a build server to execute the following steps: compiling and packaging test codes uploaded by a code management server to generate a corresponding construct, wherein the construct comprises a test script, a test object, test suites and a test list (S301); sending the construct to an OTA server, so that the OTA server uses the construct to upgrade software of a robot (S302); sending the construct to a test server, so that after the robot is upgraded, the test server calls a corresponding test suite step by step according to the test list to automatically test the test object in the robot, and uploads a test result to the build server (S303); and determining and analyzing the test result, returning a determination and analysis result to the code management server, and outputting and displaying the determination and analysis result (S304). The method can realize automatic testing of a robot, which improves the testing efficiency, saves on labor costs, and can also avoid the limitations of manual testing.

Description

机器人自动化测试系统、方法、构建服务器及存储介质Robot automated test system, method, construction server and storage medium 技术领域Technical field
本发明实施例属于机器人技术领域,尤其涉及一种机器人自动化测试系统、方法、构建服务器及计算机可读存储介质。The embodiment of the present invention belongs to the field of robotics technology, and in particular relates to a robot automated test system, method, construction server, and computer-readable storage medium.
背景技术Background technique
目前机器人在出厂测试时往往是由机器人厂商的软件开发测试工程师手动对机器人软件系统中的各个软件逐一进行功能测试,这种测试方式存在局限性,无法就该软件在整个机器人软件系统中所具备的功能特性进行全面测试,其次,这种测试方式需要由软件开发测试工程师参与进行,测试效率低下,整个测试过程将耗费测试人员大量的精力。At present, when robots are tested at the factory, the software development and test engineers of the robot manufacturers often manually test the functions of each software in the robot software system one by one. This testing method has limitations and cannot be used in the entire robot software system. The functional characteristics of the tester are fully tested. Secondly, this test method requires the participation of software development and test engineers, and the test efficiency is low, and the entire test process will consume a lot of effort by the testers.
技术问题technical problem
有鉴于此,本发明实施例提供了一种机器人自动化测试系统、方法、构建服务器及计算机可读存储介质,以解决上述现有的机器人测试方式存在局限性,无法就该软件在整个机器人软件系统中所具备的功能特性进行全面测试;以及,需要人工参与,导致测试效率低下,整个测试过程将耗费测试人员大量的精力问题。In view of this, the embodiments of the present invention provide a robot automated test system, method, construction server, and computer-readable storage medium to solve the limitations of the above-mentioned existing robot test methods, and the software cannot be used in the entire robot software system. Fully test the functional characteristics of the tester; and, the need for manual participation, resulting in low test efficiency, and the entire test process will consume a lot of energy for testers.
技术解决方案Technical solutions
本发明实施例的第一方面提供一种机器人自动化测试系统,该测试系统包括代码管理服务器、构建服务器、空中下载(Over the Air ,OTA服务器)、测试服务器以及机器人,其中所述构建服务器包括:The first aspect of the embodiments of the present invention provides a robot automated test system, which includes a code management server, a build server, and an over-the-air download (Over the Air, an OTA server), a test server and a robot, where the build server includes:
构建单元,设置为根据预先配置的构建规则对所述代码管理服务器上传的项目测试代码进行编译打包生成对应的构建物,所述构建物包括测试脚本、测试对象、测试套件及测试清单;The construction unit is set to compile and package the project test code uploaded by the code management server according to a pre-configured construction rule to generate a corresponding construction, the construction includes a test script, a test object, a test suite, and a test list;
第一部署单元,设置为将所述构建物发送至所述OTA服务器,使所述OTA服务器利用所述构建物对所述机器人进行软件升级;The first deployment unit is configured to send the structure to the OTA server, so that the OTA server uses the structure to upgrade the robot software;
第二部署单元,设置为将所述构建物发送至所述测试服务器,使所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人内的测试对象进行自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器;The second deployment unit is configured to send the construction to the test server so that the test server executes the test script after the robot upgrade is completed, and gradually calls the corresponding test suite pair according to the test list The test objects in the robot perform automated tests, and the test results fed back by the robot are summarized and uploaded to the construction server;
测试结果处理单元,设置为对所述测试结果进行判断分析,将判断分析结果返回至所述代码管理服务器,同时对所述判断分析结果进行输出显示。The test result processing unit is configured to perform judgment analysis on the test result, return the judgment analysis result to the code management server, and output and display the judgment analysis result at the same time.
其中,所述测试对象为所述机器人软件系统内的全平台软件;Wherein, the test object is the full-platform software in the robot software system;
所述第一部署单元具体设置为:将所述构建物发送至所述OTA服务器,使所述OTA服务器利用所述构建物对所述机器人进行全量升级;The first deployment unit is specifically configured to: send the structure to the OTA server, so that the OTA server uses the structure to upgrade the robot in full;
所述第二部署单元具体设置为:将所述构建物发送至所述测试服务器,使所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人进行全量自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器。The second deployment unit is specifically configured to send the structure to the test server, so that the test server executes the test script after the robot upgrade is completed, and gradually calls the corresponding test script according to the test list. The test suite performs a full amount of automated testing on the robot, and summarizes the test results fed back by the robot and uploads it to the construction server.
其中,所述测试对象为与所述项目测试代码相关的增量软件模块;Wherein, the test object is an incremental software module related to the project test code;
所述第一部署单元具体设置为:将所述构建物发送至所述OTA服务器,使所述OTA服务器利用所述构建物对所述机器人进行增量升级;The first deployment unit is specifically configured to send the structure to the OTA server, so that the OTA server uses the structure to incrementally upgrade the robot;
所述第二部署单元具体设置为:将所述构建物发送至所述测试服务器,使所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人进行增量自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器。The second deployment unit is specifically configured to send the structure to the test server, so that the test server executes the test script after the robot upgrade is completed, and gradually calls the corresponding test script according to the test list. The test suite performs incremental automated testing on the robot, and summarizes the test results fed back by the robot and uploads it to the construction server.
其中,所述构建服务器还包括:Wherein, the construction server further includes:
分布式集群管理单元,设置为构建可以并发执行测试套件的机器人集群环境,并根据所述构建单元生成的构建物触发所述机器人集群并发执行测试。The distributed cluster management unit is configured to construct a robot cluster environment that can execute test suites concurrently, and trigger the robot cluster to execute tests concurrently according to the construction generated by the construction unit.
本发明实施例的第二方面提供一种机器人自动化测试方法,应用于上述任一项所述的机器人自动化测试系统,所述机器人自动化测试方法包括采用构建服务器执行以下步骤:A second aspect of the embodiments of the present invention provides a robot automated test method, which is applied to the robot automated test system described in any one of the above, and the robot automated test method includes using a build server to perform the following steps:
接收代码管理服务器上传的项目测试代码,根据预先配置的构建规则对所述项目测试代码进行编译打包生成对应的构建物,所述构建物包括测试脚本、测试对象、测试套件及测试清单;Receiving the project test code uploaded by the code management server, and compiling and packaging the project test code according to the pre-configured construction rules to generate a corresponding building, the building including a test script, a test object, a test suite, and a test list;
将所述构建物发送至所述OTA服务器,使所述OTA服务器利用所述构建物对所述机器人进行软件升级;同时,Send the structure to the OTA server, so that the OTA server uses the structure to upgrade the robot's software; at the same time,
将所述构建物发送至测试服务器,使所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人内的测试对象进行自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器;Send the building to the test server, so that after the robot upgrade is completed, the test server executes the test script, and gradually calls the corresponding test suite according to the test list to automate the test objects in the robot Test, and upload the test results fed back by the robot to the build server after aggregating them;
接收所述测试服务器上传的测试结果,对所述测试结果进行判断分析,将判断分析结果返回至所述代码管理服务器,同时对所述判断分析结果进行输出显示。The test result uploaded by the test server is received, the test result is judged and analyzed, the judgment and analysis result is returned to the code management server, and the judgment and analysis result is output and displayed.
其中,所述测试对象为所述机器人软件系统内的全平台软件;Wherein, the test object is the full-platform software in the robot software system;
所述构建服务器将所述构建物发送至所述OTA服务器后,触发所述OTA服务器利用所述构建物对所述机器人进行全量升级;After the construction server sends the construction to the OTA server, triggering the OTA server to use the construction to upgrade the robot in full;
所述构建服务器将所述构建物发送至测试服务器后,触发所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人进行全量自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器。After the construction server sends the construction to the test server, it triggers the test server to execute the test script after the robot upgrade is completed, and gradually calls the corresponding test suite to perform the test on the robot according to the test list. Fully automated testing, and the test results fed back by the robot are summarized and uploaded to the construction server.
其中,所述测试对象为与所述项目测试代码相关的增量软件模块;Wherein, the test object is an incremental software module related to the project test code;
所述构建服务器将将所述构建物发送至所述OTA服务器后,触发所述OTA服务器利用所述构建物对所述机器人进行增量升级;After the construction server sends the construction to the OTA server, it triggers the OTA server to use the construction to incrementally upgrade the robot;
所述构建服务器将将所述构建物发送至所述测试服务器后,触发所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人进行增量自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器。After the construction server sends the construction to the test server, it triggers the test server to execute the test script after the robot upgrade is completed, and gradually calls the corresponding test suite to the test server according to the test list. The robot performs incremental automated testing, and summarizes the test results fed back by the robot and uploads the result to the construction server.
其中,所述方法还包括采用所述构建服务器执行以下步骤:Wherein, the method further includes using the construction server to perform the following steps:
构建可以并发执行测试套件的机器人集群环境,并根据构建物触发所述机器人集群并发执行测试。Construct a robot cluster environment that can execute test suites concurrently, and trigger the robot cluster to execute tests concurrently according to the construction.
本发明实施例的第三方面提供一种构建服务器,应用于机器人自动化测试系统,所述机器人自动化测试系统还包括代码管理服务器、OTA服务器、测试服务器以及机器人;其中,所述构建服务器包括:存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如上述第二方面任一项所述机器人自动化测试方法的步骤。The third aspect of the embodiments of the present invention provides a construction server, which is applied to a robot automated test system, the robot automated test system further includes a code management server, an OTA server, a test server, and a robot; wherein, the construction server includes: a memory , A processor, and a computer program stored in the memory and capable of running on the processor, and when the processor executes the computer program, the steps of the robot automated testing method according to any one of the second aspects are implemented .
本发明实施例的第四方面提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时实现如上述第二方面任一项所述机器人自动化测试方法的步骤。A fourth aspect of the embodiments of the present invention provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it implements the robot described in any one of the above-mentioned second aspects. Automated test method steps.
有益效果Beneficial effect
本发明实施提供的机器人自动化测试系统、方法、构建服务器及计算机可读存储介质,由于采用构建服务器对所述代码管理服务器上传的项目测试代码进行编译打包生成对应的构建物,所述构建物包括测试脚本,测试对象、测试套件及测试清单;然后,将所述构建物发送至所述OTA服务器,使所述OTA服务器利用所述构建物对所述机器人进行软件升级;同时,将所述构建物发送至所述测试服务器,使所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人内的测试对象进行自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器;最后,再对所述测试结果进行判断分析,将判断分析结果返回至所述代码管理服务器,同时对所述判断分析结果进行输出显示,从而可以实现全流程的机器人自动化测试,无需人工参与,提高了测试效率,节省了人力成本;此外,由于测试对象是由构建服务器根据预先配置的构建规则对所述项目测试代码进行构建的,其即可以为机器人内的全平台软件,也可以为与项目测试代码相关联的软件模块,这样可以避免手动测试存在的局限性,可以就该软件在整个机器人软件系统中所具备的功能特性进行全面测试。According to the robot automated test system, method, construction server and computer-readable storage medium provided by the implementation of the present invention, the construction server is used to compile and package the project test code uploaded by the code management server to generate the corresponding construction, and the construction includes Test scripts, test objects, test suites, and test lists; then, send the construction to the OTA server, so that the OTA server uses the construction to upgrade the robot software; at the same time, the construction After the upgrade of the robot is completed, the test server executes the test script, and gradually calls the corresponding test suite according to the test list to automatically test the test objects in the robot, The test results fed back by the robot are summarized and uploaded to the construction server; finally, the test result is judged and analyzed, the judgment analysis result is returned to the code management server, and the judgment analysis result is performed at the same time. Output display, which can realize the whole process of robot automation test without manual participation, improve test efficiency and save labor cost; in addition, because the test object is constructed by the construction server according to the pre-configured construction rules, the project test code is constructed Yes, it can be the full-platform software in the robot, or it can be the software module associated with the project test code, which can avoid the limitations of manual testing, and can determine the functions of the software in the entire robot software system. The characteristics are fully tested.
附图说明Description of the drawings
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly describe the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are merely of the present invention. For some embodiments, for those of ordinary skill in the art, other drawings may be obtained based on these drawings without creative labor.
图1是本发明实施例一提供的机器人自动化测试系统的结构框图。Fig. 1 is a structural block diagram of a robot automated test system provided in the first embodiment of the present invention.
图2是本发明实施例一提供的机器人自动化测试系统中构建服务器的结构示意图。Fig. 2 is a schematic diagram of the structure of a server constructed in the robot automated test system provided by the first embodiment of the present invention.
图3是本发明实施例二提供的机器人自动化测试方法的具体实现流程示意图。Fig. 3 is a schematic diagram of a specific implementation process of the robot automated test method provided in the second embodiment of the present invention.
图4是本发明实施例三提供的构建服务器的结构示意图。Fig. 4 is a schematic structural diagram of a construction server provided in the third embodiment of the present invention.
本发明的实施方式Embodiments of the present invention
以下描述中,为了说明而不是为了限定,提出了诸如特定系统结构、技术之类的具体细节,以便透彻理解本发明实施例。然而,本领域的技术人员应当清楚,在没有这些具体细节的其它实施例中也可以实现本发明。在其它情况中,省略对众所周知的系统、装置、电路以及方法的详细说明,以免不必要的细节妨碍本发明的描述。In the following description, for the purpose of illustration rather than limitation, specific details such as a specific system structure and technology are proposed for a thorough understanding of the embodiments of the present invention. However, it should be clear to those skilled in the art that the present invention can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from obstructing the description of the present invention.
为了说明本发明所述的技术方案,下面通过具体实施例来进行说明。In order to illustrate the technical solutions of the present invention, specific embodiments are used for description below.
图1是本发明实施例一提供的机器人自动化测试系统的结构示意图。为了便于说明仅仅示出了与本实施例相关的部分。Fig. 1 is a schematic structural diagram of a robot automated test system provided in the first embodiment of the present invention. For ease of description, only the parts related to this embodiment are shown.
参见图1所示,本实施例提供的机器人自动化测试系统包括代码管理服务器1、构建服务器2、OTA服务器3、测试服务器4以及机器人5,其中所述构建服务器2包括:As shown in FIG. 1, the robot automated test system provided by this embodiment includes a code management server 1, a construction server 2, an OTA server 3, a test server 4, and a robot 5. The construction server 2 includes:
构建单元21,设置为预先配置的构建规则对所述代码管理服务器1上传的项目测试代码进行编译打包生成对应的构建物,所述构建物包括测试脚本,测试对象、测试套件及测试清单;The construction unit 21 is configured to compile and package the project test code uploaded by the code management server 1 with a pre-configured construction rule to generate a corresponding construction. The construction includes a test script, a test object, a test suite, and a test list;
第一部署单元22,设置为将所述构建物发送至所述OTA服务器3,使所述OTA服务器3利用所述构建物对所述机器人5进行软件升级;The first deployment unit 22 is configured to send the structure to the OTA server 3, so that the OTA server 3 uses the structure to upgrade the robot 5 software;
第二部署单元23,设置为将所述构建物发送至所述测试服务器4,使所述测试服务器4在所述机器人5升级完成后,依据所述测试清单逐步调用对应的测试套件对所述机器人5内的测试对象进行自动化测试,并将所述机器人5反馈的测试结果汇总后上传至所述构建服务器2;The second deployment unit 23 is configured to send the structure to the test server 4, so that after the robot 5 is upgraded, the test server 4 gradually calls the corresponding test suite to the test list according to the test list. The test objects in the robot 5 perform automated tests, and the test results fed back by the robot 5 are summarized and uploaded to the construction server 2;
测试结果处理单元24,设置为对所述测试结果进行判断分析,将判断分析结果返回至所述代码管理服务器1,同时对所述判断分析结果进行输出显示。The test result processing unit 24 is configured to perform judgment analysis on the test result, return the judgment analysis result to the code management server 1, and output and display the judgment analysis result at the same time.
其中,所述构建物中的测试对象可以为机器人5全平台软件,也可以为与项目测试代码相关的增量软件模块,其由构建单元21根据预先配置的构建规则构建得到。在本实施例中,一个项目测试代码patch提交构建服务器2对应编译出来的构建物,实际上测试可能大于本身工程编译出来的构建物,测试对象包含就会大于项目测试代码本身工程编译出来的构建物。例如:Wherein, the test object in the structure may be the full-platform software of the robot 5, or may be an incremental software module related to the project test code, which is constructed by the construction unit 21 according to a pre-configured construction rule. In this embodiment, a project test code patch is submitted to the build server 2 corresponding to the compiled building. In fact, the test may be larger than the build compiled by its own project, and the test object contains larger than the build compiled by the project test code itself. Things. E.g:
假设rs/system/sensors_data_streamer 目录下发生变动,自动化测试实际上期望拿出来该patch编译出的navigation_skill作冒烟测试或者功能;Assuming that there is a change in the rs/system/sensors_data_streamer directory, the automated test actually expects the navigation_skill compiled by the patch to be used as a smoke test or function;
假设android/nerve发生了变动,我们需要把使用到nerve的custom_ui与 android_map_builder一起进行打包测试。Assuming that android/nerve has changed, we need to use the custom_ui of nerve with Android_map_builder is packaged and tested together.
其中,所述构建物中包括至少一个测试套件,每个测试套件均包括:初始化配置固件setup.sh、清除配置固件teardown.sh及至少一个测试用例case;其中,steup.sh,在测试脚本之前执行,完成准备工作,例如:测试输入导入、关闭或打开服务等;teardown.sh,在测试脚本之后执行,完成收尾工作,例如回收系统资源、关闭或打开服务等。Wherein, the structure includes at least one test suite, and each test suite includes: initial configuration firmware setup.sh, clear configuration firmware teardown.sh, and at least one test case case; wherein, steup.sh is before the test script Execute to complete the preparatory work, such as: import test input, close or open the service, etc.; teardown.sh, execute after the test script, complete the finishing work, such as recycling system resources, closing or opening services, etc.
其中,所述构建物中的测试清单,设置为描述测试用例的测试类型以及测试顺序关系,其中测试类型及顺序由测试工程师编写测试脚本代码时配置,自动化测试依照测试清单中定义的测试类型及测试顺序逐步测试。优选的,在一较佳实现示例中,测试类型包括自动冒烟测试、功能测试及性能测试,测试顺序依照自动冒烟测试、功能测试集性能测试依次进行。Wherein, the test list in the structure is set to describe the test type and test sequence relationship of the test case, where the test type and sequence are configured when the test engineer writes the test script code, and the automated test is based on the test type and test sequence defined in the test list. The test sequence is tested step by step. Preferably, in a preferred implementation example, the test types include automatic smoke test, function test, and performance test, and the test sequence is performed in sequence according to the automatic smoke test and the performance test of the function test set.
优选的,在一具体实现示例中,所述构建物中的测试对象为所述机器人5软件系统内的全平台软件;Preferably, in a specific implementation example, the test object in the structure is the full-platform software in the robot 5 software system;
所述第一部署单元22具体设置为:将所述构建物发送至所述OTA服务器3,使所述OTA服务器3利用所述构建物对所述机器人5进行全量升级;The first deployment unit 22 is specifically configured to send the structure to the OTA server 3, so that the OTA server 3 uses the structure to upgrade the robot 5 in full;
所述第二部署单元23具体设置为:将所述构建物发送至所述测试服务器4,使所述测试服务器4在所述机器人5升级完成后,依据所述测试清单逐步调用对应的测试套件对所述机器人5进行全量自动化测试,并将所述机器人5反馈的测试结果汇总后上传至所述构建服务器2。The second deployment unit 23 is specifically configured to send the structure to the test server 4, so that the test server 4 gradually calls the corresponding test suite according to the test list after the upgrade of the robot 5 is completed. Fully automated testing is performed on the robot 5, and the test results fed back by the robot 5 are summarized and uploaded to the construction server 2.
在本实现示例中,所述OTA服务器3在接收到所述构建物后,根据所述构建物和所述OTA服务器3中存储的最新版本的机器人5软件系统生成对机器人5进行全量升级的全量软件升级包,并将所述全量软件升级包下发至所述机器人5,所述机器人5接收到所述全量软件升级包后,利用所述全量软件升级包进行全量升级,并在升级完成后向所述测试服务器4发送对应的通知信息。In this implementation example, after the OTA server 3 receives the structure, it generates a full upgrade of the robot 5 according to the structure and the latest version of the robot 5 software system stored in the OTA server 3 Software upgrade package, and deliver the full software upgrade package to the robot 5. After receiving the full software upgrade package, the robot 5 uses the full software upgrade package to perform a full upgrade, and after the upgrade is completed The corresponding notification information is sent to the test server 4.
在本实现示例中,所述测试服务器4在接收到所述机器人5发送的升级完成的通知消息后,触发执行测试脚本,开始依据所述测试清单逐步调用对应的测试套件对所述机器人5进行全量自动化测试,同时会收集所述机器人5反馈的各项软件测试结果,并将各项软件测试结果生成报表后,将所述报表反馈至所述构建服务器2。In this implementation example, after the test server 4 receives the upgrade completion notification message sent by the robot 5, it triggers the execution of the test script, and starts to gradually call the corresponding test suite to perform the test on the robot 5 according to the test list. Fully automated testing, while collecting various software test results fed back by the robot 5, and after generating a report of the various software test results, the report is fed back to the construction server 2.
优选的,在另一具体实现示例中,所述测试对象为与所述项目测试代码相关的增量软件模块;Preferably, in another specific implementation example, the test object is an incremental software module related to the project test code;
所述第一部署单元22具体设置为:将所述构建物发送至所述OTA服务器3,使所述OTA服务器3利用所述构建物对所述机器人5进行增量升级;The first deployment unit 22 is specifically configured to send the structure to the OTA server 3, so that the OTA server 3 uses the structure to incrementally upgrade the robot 5;
所述第二部署单元23具体设置为:将所述构建物发送至所述测试服务器4,使所述测试服务器4在所述机器人5升级完成后,依据所述测试清单逐步调用对应的测试套件对所述机器人5进行增量自动化测试,并将所述机器人5反馈的测试结果汇总后上传至所述构建服务器2。The second deployment unit 23 is specifically configured to send the structure to the test server 4, so that the test server 4 gradually calls the corresponding test suite according to the test list after the upgrade of the robot 5 is completed. Perform incremental automated testing on the robot 5, and upload the test results fed back by the robot 5 to the construction server 2 after aggregating them.
在本实现示例中,所述构建服务器2在将所述构建物发送至所述OTA服务器3后,所述OTA服务器3会将所述构建物与最新版本的软件系统中与该构建物相关的软件模块进行比对,生成对机器人5进行升级的增量软件升级包,然后将增量软件升级包下发至机器人5,使机器人5根据所述增量软件升级包进行增量升级,并在升级完成后向所述测试服务器4发送通知信息。In this implementation example, after the construction server 2 sends the construction to the OTA server 3, the OTA server 3 will associate the construction with the latest version of the software system related to the construction. The software modules are compared to generate an incremental software upgrade package for upgrading the robot 5, and then the incremental software upgrade package is issued to the robot 5, so that the robot 5 performs an incremental upgrade according to the incremental software upgrade package, and After the upgrade is completed, notification information is sent to the test server 4.
在本实现示例中,所述测试服务器4在接收到所述机器人5发送的升级完成的通知信息后,触发执行测试脚本,开始依据所述测试清单逐步调用对应的测试套件对所述机器人5进行增量测试,同时会收集所述机器人5反馈的各项增量软件测试结果,并将各项增量软件测试结果生成报表后,将所述报表反馈至所述构建服务器2。In this implementation example, after the test server 4 receives the notification message of the completion of the upgrade sent by the robot 5, it triggers the execution of the test script, and starts to gradually call the corresponding test suite to perform the test on the robot 5 according to the test list. In the incremental test, at the same time, various incremental software test results fed back by the robot 5 are collected, and after each incremental software test result is generated in a report, the report is fed back to the construction server 2.
优选的,所述构建服务器2还包括:Preferably, the construction server 2 further includes:
分布式集群管理单元25,设置为构建可以并发执行测试套件的机器人5集群环境,并根据所述构建单元21生成的构建物触发所述机器人5集群并发执行测试。The distributed cluster management unit 25 is configured to construct a cluster environment of robots 5 that can execute test suites concurrently, and trigger the clusters of robots 5 to execute tests concurrently according to the construction generated by the construction unit 21.
在本实施例中,所述分布式集成管理单元25利用Selenium Grid实现一个构建服务器2构建触发多机并发执行测试。Selenium Grid本质上是一种可以并发执行图形用户界面(Graphical User Interface,GUI)测试用例的测试执行机的集群,采用的是HUB(主节点)和Node(从节点)模式, Selenium Hub用来管理各个Selenium Node的注册信息和状态信息,并且在接收到远程客户端代码的测试调用请求后,并把请求命令转发给符合要求的Selenium Node执行.我们利用这样的架构,就可以使多台机器人5同时并发执行测试用例,大大提高了测试效率。In this embodiment, the distributed integrated management unit 25 uses Selenium Grid implements a build server 2 build to trigger multiple machines to execute tests concurrently. Selenium Grid is essentially a graphical user interface that can execute concurrently (Graphical User Interface) Interface, GUI) test case cluster of test execution machines, using HUB (master node) and Node (slave node) modes, Selenium Hub is used to manage the registration information and status information of each Selenium Node, and when receiving remote clients After the test call request of the end code, the request command is forwarded to Selenium that meets the requirements Node execution. Using this architecture, we can enable multiple robots 5 to execute test cases concurrently at the same time, which greatly improves test efficiency.
以上可以看出,本实施例提供的机器人自动化测试系统由于采用构建服务器2对所述代码管理服务器1上传的项目测试代码进行编译打包生成对应的构建物,所述构建物包括测试脚本,测试对象、测试套件及测试清单;然后,将所述构建物发送至所述OTA服务器3,使所述OTA服务器3利用所述构建物对所述机器人5进行软件升级;同时,将所述构建物发送至所述测试服务器4,使所述测试服务器4在所述机器人5升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人5内的测试对象进行自动化测试,并将所述机器人5反馈的测试结果汇总后上传至所述构建服务器2;最后,再对所述测试结果进行判断分析,将判断分析结果返回至所述代码管理服务器1,同时对所述判断分析结果进行输出显示,从而可以实现全流程的机器人自动化测试,无需人工参与,提高了测试效率,节省了人力成本;此外,由于测试对象是由构建服务器2根据预先配置的构建规则对所述项目测试代码进行构建的,其即可以为机器人5内的全平台软件,也可以为与项目测试代码相关联的软件模块,这样可以避免手动测试存在的局限性,可以就该软件在整个机器人5软件系统中所具备的功能特性进行全面测试。It can be seen from the above that the robot automated test system provided by this embodiment uses the build server 2 to compile and package the project test code uploaded by the code management server 1 to generate a corresponding building. The building includes a test script and a test object. , Test suite and test list; then, send the structure to the OTA server 3, so that the OTA server 3 uses the structure to upgrade the robot 5; at the same time, send the structure To the test server 4, the test server 4 executes the test script after the upgrade of the robot 5 is completed, and gradually calls the corresponding test suite according to the test list to automate the test objects in the robot 5 Test and upload the test results fed back by the robot 5 to the construction server 2; finally, the test result is judged and analyzed, and the judgment and analysis result is returned to the code management server 1, and at the same time The judgment and analysis results are output and displayed, so that the entire process of robotic automated testing can be realized without manual participation, which improves testing efficiency and saves labor costs; in addition, because the test object is tested by the construction server 2 according to the pre-configured construction rules The project test code can be constructed as the full-platform software in the robot 5, or it can be a software module associated with the project test code. This can avoid the limitations of manual testing, and the software can be used in the entire robot. 5 The functional characteristics of the software system are fully tested.
实施例二Example two
图2是本发明实施例二提供的机器人自动化测试方法的具体实现流程示意图,该方法的执行主体为图1所示系统中的构建服务器2。参见图2所示,本实施例提供的机器人自动化测试方法包括:FIG. 2 is a schematic diagram of a specific implementation process of the robot automated testing method provided by the second embodiment of the present invention. The execution body of the method is the construction server 2 in the system shown in FIG. 1. As shown in Fig. 2, the robot automated test method provided in this embodiment includes:
步骤S301,接收代码管理服务器1上传的项目测试代码,根据预先配置的构建规则对所述项目测试代码进行编译打包生成对应的构建物,所述构建物包括测试对象、测试套件及测试清单;Step S301, receiving the project test code uploaded by the code management server 1, and compiling and packaging the project test code according to the pre-configured construction rules to generate a corresponding building, the building including a test object, a test suite, and a test list;
步骤S302,将所述构建物发送至所述OTA服务器3,使所述OTA服务器3利用所述构建物对所述机器人5进行软件升级;同时,Step S302, sending the structure to the OTA server 3, so that the OTA server 3 uses the structure to upgrade the software of the robot 5; at the same time,
步骤S303,将所述构建物发送至测试服务器4,使所述测试服务器4在所述机器人5升级完成后,依据所述测试清单逐步调用对应的测试套件对所述机器人5内的测试对象进行自动化测试,并将所述机器人5反馈的测试结果汇总后上传至所述构建服务器2;Step S303: Send the structure to the test server 4, so that after the robot 5 is upgraded, the test server 4 gradually calls the corresponding test suite according to the test list to perform the test on the test objects in the robot 5 Automate testing, and upload the test results fed back by the robot 5 to the construction server 2 after aggregating them;
步骤S304,接收所述测试服务器4上传的测试结果,对所述测试结果进行判断分析,将判断分析结果返回至所述代码管理服务器1,同时对所述判断分析结果进行输出显示。Step S304: Receive the test result uploaded by the test server 4, perform judgment analysis on the test result, return the judgment analysis result to the code management server 1, and output and display the judgment analysis result.
在一具体实现示例中,所述测试对象为所述机器人5软件系统内的全平台软件;所述构建服务器2将所述构建物发送至所述OTA服务器3后,触发所述OTA服务器3利用所述构建物对所述机器人5进行全量升级;所述构建服务器2将所述构建物发送至测试服务器4后,触发所述测试服务器4在所述机器人5升级完成后,依据所述测试清单逐步调用对应的测试套件对所述机器人5进行全量自动化测试,并将所述机器人5反馈的测试结果汇总后上传至所述构建服务器2。In a specific implementation example, the test object is the full-platform software in the robot 5 software system; after the construction server 2 sends the construction to the OTA server 3, it triggers the OTA server 3 to use The building upgrades the robot 5 in full; after the building server 2 sends the building to the test server 4, the test server 4 is triggered to complete the upgrade of the robot 5 according to the test list The corresponding test suite is gradually called to perform a full automated test on the robot 5, and the test results fed back by the robot 5 are summarized and uploaded to the construction server 2.
在另一具体实现示例中,所述测试对象为与所述项目测试代码相关的增量软件模块;所述构建服务器2将将所述构建物发送至所述OTA服务器3后,触发所述OTA服务器3利用所述构建物对所述机器人5进行增量升级;所述构建服务器2将所述构建物发送至所述测试服务器4后,触发所述测试服务器4在所述机器人5升级完成后,依据所述测试清单逐步调用对应的测试套件对所述机器人5进行增量自动化测试,并将所述机器人5反馈的测试结果汇总后上传至所述构建服务器2。In another specific implementation example, the test object is an incremental software module related to the project test code; after the construction server 2 sends the construction to the OTA server 3, the OTA is triggered The server 3 uses the construction to incrementally upgrade the robot 5; after the construction server 2 sends the construction to the test server 4, the test server 4 is triggered after the robot 5 is upgraded. , According to the test list, gradually call the corresponding test suite to perform an incremental automated test on the robot 5, and upload the test results fed back by the robot 5 to the construction server 2 after aggregating.
优选的,所述机器人自动化测试方法还包括采用所述构建服务器2执行以下步骤:构建可以并发执行测试套件的机器人5集群环境,并根据构建物触发所述机器人5集群并发执行测试。Preferably, the robot automated test method further includes using the construction server 2 to execute the following steps: constructing a robot 5 cluster environment that can execute test suites concurrently, and triggering the robot 5 cluster to execute tests concurrently according to the construction.
需要说明的是,本实施例提供的上述方法中的各个步骤,由于与本发明实施例一提供的机器人自动化测试系统基于同一构思,其带来的技术效果与实施例一相同,具体内容可参见系统实施例一中的叙述,此处不再赘述。It should be noted that each step in the above method provided in this embodiment is based on the same concept as the robot automated test system provided in the first embodiment of the present invention, and the technical effects brought by it are the same as those in the first embodiment. For details, please refer to The description in the first embodiment of the system will not be repeated here.
此外,应理解,上述实施例中各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本发明实施例的实施过程构成任何限定。In addition, it should be understood that the size of the sequence number of each step in the above embodiment does not mean the order of execution. The execution sequence of each process should be determined by its function and inherent logic, and should not constitute any implementation process of the embodiment of the present invention. limited.
实施例三Example three
图3是本发明实施例三提供的构建服务器2的结构示意图。为了便于说明仅仅示出了与本实施例相关的部分。FIG. 3 is a schematic structural diagram of the construction server 2 provided in the third embodiment of the present invention. For ease of description, only the parts related to this embodiment are shown.
参见图3所示,本实施例提供的构建服务器2应用于机器人自动化测试系统,所述机器人自动化测试系统还包括代码管理服务器1、OTA服务器3、测试服务器4以及机器人5;其中,所述构建服务器2包括:存储器27、处理器26以及存储在所述存储器27中并可在所述处理器26上运行的计算机程序28,所述处理器26执行所述计算机程序28时实现如上述实施例二中任一项所述机器人自动化测试方法的步骤。Referring to FIG. 3, the construction server 2 provided in this embodiment is applied to a robot automated test system, and the robot automated test system further includes a code management server 1, an OTA server 3, a test server 4, and a robot 5; wherein, the construction The server 2 includes: a memory 27, a processor 26, and a computer program 28 that is stored in the memory 27 and can run on the processor 26. When the processor 26 executes the computer program 28, the above-mentioned embodiment is implemented Steps of any one of the robot automated testing methods.
需要说明的是,本发明实施例提供的上述构建服务器2中的各个单元,由于与本发明方法实施例基于同一构思,其带来的技术效果与本发明方法实施例相同,具体内容可参见本发明方法实施例中的叙述,此处不再赘述。It should be noted that the various units in the foregoing construction server 2 provided in the embodiment of the present invention are based on the same concept as the method embodiment of the present invention, and the technical effects brought by it are the same as those of the method embodiment of the present invention. For details, please refer to this The description in the embodiment of the inventive method will not be repeated here.
实施例四Example four
本发明实施例四提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时实现如上述实施例二中任一项所述机器人自动化测试方法的步骤。The fourth embodiment of the present invention provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the automated test of the robot as described in any one of the above-mentioned embodiment two is realized Method steps.
需要说明的是,本发明实施例提供的上述计算机可读存储介质由于与本发明方法实施例基于同一构思,其带来的技术效果与本发明方法实施例相同,具体内容可参见本发明方法实施例中的叙述,此处不再赘述。It should be noted that the above-mentioned computer-readable storage medium provided by the embodiment of the present invention is based on the same concept as the method embodiment of the present invention, and its technical effects are the same as those of the method embodiment of the present invention. For details, please refer to the method implementation of the present invention. The description in the example will not be repeated here.
本领域普通技术人员可以理解,上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。A person of ordinary skill in the art can understand that all or some of the steps, functional modules/units in the system, and apparatus in the methods disclosed above can be implemented as software, firmware, hardware, and appropriate combinations thereof.
在硬件实施方式中,在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分;例如,一个物理组件可以具有多个功能,或者一个功能或步骤可以由若干物理组件合作执行。某些物理组件或所有物理组件可以被实施为由处理器,如中央处理器、数字信号处理器或微处理器执行的软件,或者被实施为硬件,或者被实施为集成电路,如专用集成电路。这样的软件可以分布在计算机可读介质上,计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的,术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外,本领域普通技术人员公知的是,通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据,并且可包括任何信息递送介质。In the hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may consist of several physical components. The components are executed cooperatively. Some physical components or all physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit . Such software may be distributed on a computer-readable medium, and the computer-readable medium may include a computer storage medium (or a non-transitory medium) and a communication medium (or a transitory medium). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and nonvolatile implementations in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Sexual, removable and non-removable media. Computer storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or Any other medium used to store desired information and that can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media usually contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as carrier waves or other transmission mechanisms, and may include any information delivery media. .
以上参照附图说明了本发明的优选实施例,并非因此局限本发明的权利范围。本领域技术人员不脱离本发明的范围和实质内所作的任何修改、等同替换和改进,均应在本发明的权利范围之内。The preferred embodiments of the present invention are described above with reference to the accompanying drawings, and the scope of rights of the present invention is not limited thereby. Any modification, equivalent replacement and improvement made by those skilled in the art without departing from the scope and essence of the present invention shall fall within the scope of the right of the present invention.
工业实用性Industrial applicability
本发明实施提供的机器人自动化测试系统、方法、构建服务器及计算机可读存储介质,由于采用构建服务器对所述代码管理服务器上传的项目测试代码进行编译打包生成对应的构建物,将所述构建物发送至所述OTA服务器,使所述OTA服务器利用所述构建物对所述机器人进行软件升级;同时,将所述构建物发送至所述测试服务器,使所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人内的测试对象进行自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器;最后,再对所述测试结果进行判断分析,将判断分析结果返回至所述代码管理服务器,同时对所述判断分析结果进行输出显示,从而可以实现全流程的机器人自动化测试,无需人工参与,提高了测试效率,节省了人力成本;此外,由于测试对象是由构建服务器根据预先配置的构建规则对所述项目测试代码进行构建的,其即可以为机器人内的全平台软件,也可以为与项目测试代码相关联的软件模块,这样可以避免手动测试存在的局限性,可以就该软件在整个机器人软件系统中所具备的功能特性进行全面测试。因此,具有工业实用性。According to the robot automated test system, method, construction server and computer-readable storage medium provided by the implementation of the present invention, the construction server is used to compile and package the project test code uploaded by the code management server to generate the corresponding construction. Send to the OTA server to enable the OTA server to use the building to upgrade the robot's software; at the same time, send the building to the test server so that the test server is upgraded on the robot After that, the test script is executed, and the corresponding test suite is gradually invoked according to the test list to perform automated tests on the test objects in the robot, and the test results fed back by the robot are summarized and uploaded to the build server; and finally , And then judge and analyze the test result, return the judgment and analysis result to the code management server, and output and display the judgment and analysis result at the same time, so as to realize the robot automation test of the whole process without manual participation, which improves Testing efficiency saves labor costs; in addition, since the test object is constructed by the build server according to the pre-configured construction rules, it can be the full platform software in the robot, or it can be used for project testing. The software module associated with the code can avoid the limitations of manual testing, and can conduct a comprehensive test on the functional characteristics of the software in the entire robot software system. Therefore, it has industrial applicability.

Claims (10)

  1. 一种机器人自动化测试系统,包括代码管理服务器、构建服务器、OTA服务器、测试服务器以及机器人,其中所述构建服务器包括:A robot automated test system includes a code management server, a build server, an OTA server, a test server, and a robot, wherein the build server includes:
    构建单元,设置为根据预先配置的构建规则对所述代码管理服务器上传的项目测试代码进行编译打包生成对应的构建物,所述构建物包括测试脚本、测试对象、测试套件及测试清单;The construction unit is set to compile and package the project test code uploaded by the code management server according to a pre-configured construction rule to generate a corresponding construction, the construction includes a test script, a test object, a test suite, and a test list;
    第一部署单元,设置为将所述构建物发送至所述OTA服务器,使所述OTA服务器利用所述构建物对所述机器人进行软件升级;The first deployment unit is configured to send the structure to the OTA server, so that the OTA server uses the structure to upgrade the robot software;
    第二部署单元,设置为将所述构建物发送至所述测试服务器,使所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人内的测试对象进行自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器;The second deployment unit is configured to send the construction to the test server so that the test server executes the test script after the robot upgrade is completed, and gradually calls the corresponding test suite pair according to the test list The test objects in the robot perform automated tests, and the test results fed back by the robot are summarized and uploaded to the construction server;
    测试结果处理单元,设置为对所述测试结果进行判断分析,将判断分析结果返回至所述代码管理服务器,同时对所述判断分析结果进行输出显示。The test result processing unit is configured to perform judgment analysis on the test result, return the judgment analysis result to the code management server, and output and display the judgment analysis result at the same time.
  2. 如权利要求1所述的机器人自动化测试系统,其中,所述测试对象为所述机器人软件系统内的全平台软件;4. The robot automated test system according to claim 1, wherein the test object is a full-platform software in the robot software system;
    所述第一部署单元具体设置为:将所述构建物发送至所述OTA服务器,使所述OTA服务器利用所述构建物对所述机器人进行全量升级;The first deployment unit is specifically configured to: send the structure to the OTA server, so that the OTA server uses the structure to upgrade the robot in full;
    所述第二部署单元具体设置为:将所述构建物发送至所述测试服务器,使所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人进行全量自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器。The second deployment unit is specifically configured to send the structure to the test server, so that the test server executes the test script after the robot upgrade is completed, and gradually calls the corresponding test script according to the test list. The test suite performs a full amount of automated testing on the robot, and summarizes the test results fed back by the robot and uploads it to the construction server.
  3. 如权利要求1所述的机器人自动化测试系统,其中,所述测试对象为与所述项目测试代码相关的增量软件模块;The robot automated test system according to claim 1, wherein the test object is an incremental software module related to the project test code;
    所述第一部署单元具体设置为:将所述构建物发送至所述OTA服务器,使所述OTA服务器利用所述构建物对所述机器人进行增量升级;The first deployment unit is specifically configured to send the structure to the OTA server, so that the OTA server uses the structure to incrementally upgrade the robot;
    所述第二部署单元具体设置为:将所述构建物发送至所述测试服务器,使所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人进行增量自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器。The second deployment unit is specifically configured to send the structure to the test server, so that the test server executes the test script after the robot upgrade is completed, and gradually calls the corresponding test script according to the test list. The test suite performs incremental automated testing on the robot, and summarizes the test results fed back by the robot and uploads it to the construction server.
  4. 如权利要求1所述的机器人自动化测试系统,其中,所述构建服务器还包括:5. The robot automated test system according to claim 1, wherein the construction server further comprises:
    分布式集群管理单元,设置为构建可以并发执行测试套件的机器人集群环境,并根据所述构建单元生成的构建物触发所述机器人集群并发执行测试。The distributed cluster management unit is configured to construct a robot cluster environment that can execute test suites concurrently, and trigger the robot cluster to execute tests concurrently according to the construction generated by the construction unit.
  5. 一种机器人自动化测试方法,应用于如权利要求1~4任一项所述的机器人自动化测试系统,包括采用构建服务器执行以下步骤:A robot automated test method, applied to the robot automated test system according to any one of claims 1 to 4, includes using a build server to perform the following steps:
    接收代码管理服务器上传的项目测试代码,根据预先配置的构建规则对所述项目测试代码进行编译打包生成对应的构建物,所述构建物包括测试脚本、测试对象、测试套件及测试清单;Receiving the project test code uploaded by the code management server, and compiling and packaging the project test code according to the pre-configured construction rules to generate a corresponding building, the building including a test script, a test object, a test suite, and a test list;
    将所述构建物发送至所述OTA服务器,使所述OTA服务器利用所述构建物对所述机器人进行软件升级;同时,Send the structure to the OTA server, so that the OTA server uses the structure to upgrade the robot's software; at the same time,
    将所述构建物发送至测试服务器,使所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人内的测试对象进行自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器;Send the structure to the test server, so that after the robot upgrade is completed, the test server executes the test script, and gradually calls the corresponding test suite according to the test list to automate the test objects in the robot Test, and upload the test results fed back by the robot to the build server after aggregating them;
    接收所述测试服务器上传的测试结果,对所述测试结果进行判断分析,将判断分析结果返回至所述代码管理服务器,同时对所述判断分析结果进行输出显示。The test result uploaded by the test server is received, the test result is judged and analyzed, the judgment and analysis result is returned to the code management server, and the judgment and analysis result is output and displayed.
  6. 如权利要求5所述的自动化测试方法,其中,所述测试对象为所述机器人软件系统内的全平台软件;5. The automated test method according to claim 5, wherein the test object is a full-platform software in the robot software system;
    所述构建服务器将所述构建物发送至所述OTA服务器后,触发所述OTA服务器利用所述构建物对所述机器人进行全量升级;After the construction server sends the construction to the OTA server, triggering the OTA server to use the construction to upgrade the robot in full;
    所述构建服务器将所述构建物发送至测试服务器后,触发所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人进行全量自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器。After the construction server sends the construction to the test server, it triggers the test server to execute the test script after the robot upgrade is completed, and gradually calls the corresponding test suite to perform the test on the robot according to the test list. Fully automated testing, and the test results fed back by the robot are summarized and uploaded to the construction server.
  7. 如权利要求5所述的自动化测试方法,其中,所述测试对象为与所述项目测试代码相关的增量软件模块;5. The automated test method according to claim 5, wherein the test object is an incremental software module related to the project test code;
    所述构建服务器将将所述构建物发送至所述OTA服务器后,触发所述OTA服务器利用所述构建物对所述机器人进行增量升级;After the construction server sends the construction to the OTA server, it triggers the OTA server to use the construction to incrementally upgrade the robot;
    所述构建服务器将所述构建物发送至所述测试服务器后,触发所述测试服务器在所述机器人升级完成后,执行所述测试脚本,依据所述测试清单逐步调用对应的测试套件对所述机器人进行增量自动化测试,并将所述机器人反馈的测试结果汇总后上传至所述构建服务器。After the construction server sends the construction to the test server, it triggers the test server to execute the test script after the robot upgrade is completed, and gradually calls the corresponding test suite to the test server according to the test list. The robot performs incremental automated testing, and uploads the test results fed back by the robot to the construction server after aggregating them.
  8. 如权利要求5所述的机器人自动化测试方法,其中,所述方法还包括采用所述构建服务器执行以下步骤:5. The robot automated testing method according to claim 5, wherein the method further comprises using the construction server to perform the following steps:
    构建可以并发执行测试套件的机器人集群环境,并根据构建物触发所述机器人集群并发执行测试。Construct a robot cluster environment that can execute test suites concurrently, and trigger the robot cluster to execute tests concurrently according to the construction.
  9. 一种构建服务器,应用于机器人自动化测试系统,所述机器人自动化测试系统还包括代码管理服务器、OTA服务器、测试服务器以及机器人;其中,所述构建服务器包括:存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如权利要求5至8任一项所述机器人自动化测试方法的步骤。A construction server, applied to a robot automated test system, the robot automated test system further includes a code management server, an OTA server, a test server, and a robot; wherein, the construction server includes: a memory, a processor, and a memory stored in the memory A computer program that can be run on the processor, and the processor implements the steps of the robot automated testing method according to any one of claims 5 to 8 when the processor executes the computer program.
  10. 一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求5至8任一项所述机器人自动化测试方法的步骤。A computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the robot automated test method according to any one of claims 5 to 8 are realized.
PCT/CN2021/084562 2020-05-14 2021-03-31 Automatic testing system and method for robot, and build server and storage medium WO2021227690A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010406366.4 2020-05-14
CN202010406366.4A CN111309636B (en) 2020-05-14 2020-05-14 Robot automation test system, method, construction server and storage medium

Publications (1)

Publication Number Publication Date
WO2021227690A1 true WO2021227690A1 (en) 2021-11-18

Family

ID=71162796

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/084562 WO2021227690A1 (en) 2020-05-14 2021-03-31 Automatic testing system and method for robot, and build server and storage medium

Country Status (2)

Country Link
CN (1) CN111309636B (en)
WO (1) WO2021227690A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116089282A (en) * 2023-01-03 2023-05-09 广州汽车集团股份有限公司 Automobile automatic test method and device, electronic equipment and storage medium

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111309636B (en) * 2020-05-14 2020-09-08 炬星科技(深圳)有限公司 Robot automation test system, method, construction server and storage medium
CN112256586A (en) * 2020-11-03 2021-01-22 中国建设银行股份有限公司 Automatic testing method and device
CN113127370A (en) * 2021-05-14 2021-07-16 中国工商银行股份有限公司 Report system smoking test method, RPA robot and system
CN113406897B (en) * 2021-06-23 2023-03-31 国网智能科技股份有限公司 Automatic simulation test system and method for inspection robot

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110307860A1 (en) * 2010-06-09 2011-12-15 Hong Seong Park Simulation-based interface testing automation system and method for robot software components
CN109885499A (en) * 2019-02-27 2019-06-14 弗徕威智能机器人科技(上海)有限公司 A kind of robot automation's test macro and test method
CN109976779A (en) * 2017-12-27 2019-07-05 深圳市优必选科技有限公司 Robot software's online upgrading dissemination method, device, equipment and storage medium
CN110096425A (en) * 2018-12-10 2019-08-06 厦门市美亚柏科信息股份有限公司 A kind of automated testing method based on QT development mode, device and storage medium
CN110837388A (en) * 2020-01-09 2020-02-25 炬星科技(深圳)有限公司 Software upgrading method of robot, upgrading server, robot and storage medium
CN111309636A (en) * 2020-05-14 2020-06-19 炬星科技(深圳)有限公司 Robot automation test system, method, construction server and storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101339532B (en) * 2007-07-06 2012-09-05 中国银联股份有限公司 Web application system automatized test method and apparatus
US9703679B2 (en) * 2013-03-14 2017-07-11 International Business Machines Corporation Probationary software tests
KR20170115742A (en) * 2016-04-08 2017-10-18 한국전자통신연구원 Apparatus and method for interoperability testing of robot software
US10476679B2 (en) * 2017-11-14 2019-11-12 INTEGRITY Security Services, Inc. Systems, methods, and devices for multi-stage provisioning and multi-tenant operation for a security credential management system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110307860A1 (en) * 2010-06-09 2011-12-15 Hong Seong Park Simulation-based interface testing automation system and method for robot software components
CN109976779A (en) * 2017-12-27 2019-07-05 深圳市优必选科技有限公司 Robot software's online upgrading dissemination method, device, equipment and storage medium
CN110096425A (en) * 2018-12-10 2019-08-06 厦门市美亚柏科信息股份有限公司 A kind of automated testing method based on QT development mode, device and storage medium
CN109885499A (en) * 2019-02-27 2019-06-14 弗徕威智能机器人科技(上海)有限公司 A kind of robot automation's test macro and test method
CN110837388A (en) * 2020-01-09 2020-02-25 炬星科技(深圳)有限公司 Software upgrading method of robot, upgrading server, robot and storage medium
CN111309636A (en) * 2020-05-14 2020-06-19 炬星科技(深圳)有限公司 Robot automation test system, method, construction server and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116089282A (en) * 2023-01-03 2023-05-09 广州汽车集团股份有限公司 Automobile automatic test method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN111309636B (en) 2020-09-08
CN111309636A (en) 2020-06-19

Similar Documents

Publication Publication Date Title
WO2021227690A1 (en) Automatic testing system and method for robot, and build server and storage medium
CN107273286B (en) Scene automatic test platform and method for task application
WO2021238006A1 (en) Artificial intelligence chip verification
US10067863B1 (en) Feature targeting of test automation lab machines
CN107302476B (en) Automatic testing method and system for testing asynchronous interactive system
CN109885480B (en) Automatic interface compatibility testing method and device based on debugging bridge
US20180322037A1 (en) Impersonation in test automation
CN110678850B (en) Automated device test classification system and technique
JP2021500686A (en) Code module selection for device design
US11636016B2 (en) Cloud simulation and validation system
WO2018209958A1 (en) Upgradable file upgrading method, set top box and storage medium
CN112783793B (en) Automatic interface test system and method
CN111858336B (en) Automatic software testing method and system
CN112631919A (en) Comparison test method and device, computer equipment and storage medium
CN117170803A (en) Method for generating signal-creation operating system pipeline, electronic equipment and storage medium
CN116257438A (en) Updating method of interface test case and related equipment
US20180123899A1 (en) Technology agnostic network simulation
US20180123900A1 (en) Scenario driven, technology agnostic network simulation
CN117041111A (en) Vehicle cloud function test method and device, electronic equipment and storage medium
CN115454851A (en) Interface regression testing method and device, storage medium and electronic device
CN113986263A (en) Code automation test method, device, electronic equipment and storage medium
CA3144852A1 (en) Automatic generation of integrated test procedures using system test procedures
CN114385493A (en) Performance test method and device, electronic equipment and storage medium
CN114091687A (en) Method and device for automatic delivery and deployment of machine learning model
CN113722235A (en) Automatic testing method and device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21803473

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 110423)

122 Ep: pct application non-entry in european phase

Ref document number: 21803473

Country of ref document: EP

Kind code of ref document: A1