WO2018120965A1 - Procédé et dispositif de test automatique, et support d'information lisible par ordinateur - Google Patents

Procédé et dispositif de test automatique, et support d'information lisible par ordinateur Download PDF

Info

Publication number
WO2018120965A1
WO2018120965A1 PCT/CN2017/105011 CN2017105011W WO2018120965A1 WO 2018120965 A1 WO2018120965 A1 WO 2018120965A1 CN 2017105011 W CN2017105011 W CN 2017105011W WO 2018120965 A1 WO2018120965 A1 WO 2018120965A1
Authority
WO
WIPO (PCT)
Prior art keywords
software
modified
code
test execution
automated test
Prior art date
Application number
PCT/CN2017/105011
Other languages
English (en)
Chinese (zh)
Inventor
孙锦程
Original Assignee
上海壹账通金融科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 上海壹账通金融科技有限公司 filed Critical 上海壹账通金融科技有限公司
Publication of WO2018120965A1 publication Critical patent/WO2018120965A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing

Definitions

  • the present invention relates to the field of computer technologies, and in particular, to an automated test method, a computer readable storage medium, and an apparatus.
  • the main object of the present invention is to provide an automated test method, computer readable storage medium and device, which aim to improve the efficiency and cost of automated testing.
  • the present invention provides an automated test method, the method comprising the following steps:
  • test execution script If the software code of the software system is modified, the modified software code is found, and the automation associated with the found modified software code is determined according to the associated data of the pre-saved software code and the automated test execution script. Test execution script;
  • the determined individual automated test execution scripts are run in the software system after the software code is modified, and a test report is generated.
  • the method further comprises:
  • the code is the software code that is invoked during the running of the automated test execution script
  • the determining each of the automatics is run in the software system after the software code is modified Before testing the execution script and generating the test report, it also includes:
  • a reminder message is generated to remind the user to add a corresponding automated test execution script for the modified software code.
  • the step of analyzing whether the software code of the software system is modified in real time or timing during the running of the software system comprises:
  • the software modification log of the software system is analyzed in real time or periodically to analyze whether the software code of the software system is modified; the modification includes adding a new code, modifying a code, or deleting a code.
  • the test report includes list information of an automated test execution script in which a test error occurs, and/or error type information of the test error.
  • the present invention also provides an automated testing device, the automated testing device comprising:
  • a first analysis module configured to analyze whether the software code of the software system is modified in real time or timing during the running of the software system
  • a determining module configured to: if the software code of the software system is modified, find the modified software code, and determine and modify the modified software according to the associated data of the pre-saved software code and the automated test execution script An automated test execution script associated with the code;
  • the test module is configured to run the determined individual automated test execution scripts in the software system after the software code is modified, and generate a test report.
  • the automated testing device further comprises:
  • a recording module configured to run each of the automated test execution scripts corresponding to the software system one by one, and analyze and record the software code associated with the automated test execution script during an automated test execution script running, the automated test execution
  • the software code associated with the script is the software code that is invoked during the running of the automated test execution script
  • a save module that holds the associated data of the software code and the automated test execution script.
  • the automated testing device further comprises:
  • a second analysis module configured to analyze whether an automated test execution script associated with the modified software code is determined
  • the reminder module is configured to generate a reminder message if there is no automated test execution script associated with the modified software code to remind the user to add a corresponding automated test execution script for the modified software code.
  • the first analysis module is further configured to:
  • the software modification log of the software system is analyzed in real time or periodically to analyze whether the software code of the software system is modified; the modification includes adding a new code, modifying a code, or deleting a code.
  • the test report includes a list of automated test execution scripts in which a test error has occurred Information, and/or, error type information for testing errors.
  • the present invention also provides a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements the steps of the automated test method and apparatus described above.
  • the automated test method, the computer readable storage medium and the device provided by the invention determine the software to be modified through the associated data of the pre-stored software code and the automated test execution script when the software code of the software system is modified.
  • the code is associated with an automated test execution script and runs the determined automated test execution scripts in the software system after the software code is modified to generate a test report. Since it is only necessary to determine the automated test execution script associated with the modified software code and execute the determined automated test execution script to complete the test without running all automated test execution scripts on the software system after the code is modified. Improves test efficiency and makes it easier to find test errors, saving manpower and material resources.
  • FIG. 1 is a schematic flow chart of a first embodiment of an automated test method according to the present invention.
  • FIG. 2 is a schematic flow chart of a second embodiment of an automated test method according to the present invention.
  • FIG. 3 is a schematic flow chart of a third embodiment of an automated test method according to the present invention.
  • FIG. 4 is a schematic diagram of functional modules of a first embodiment of an automated test apparatus according to the present invention.
  • FIG. 5 is a schematic diagram of functional modules of a second embodiment of an automated test apparatus according to the present invention.
  • FIG. 6 is a schematic diagram of functional modules of a third embodiment of an automated test apparatus according to the present invention.
  • the present invention provides an automated test method.
  • FIG. 1 is a schematic flow chart of a first embodiment of an automated test method according to the present invention.
  • the automated test method comprises:
  • Step S10 During the running of the software system, analyze whether the software code of the software system is modified in real time or periodically;
  • the system log information is retrieved in real time or periodically, and the software modification log of the software system is extracted from the system log information to analyze whether the software code of the software system is modified.
  • a software modification information collection module may be pre-configured on the software system, and the information acquisition module is modified by the software to detect and record detailed information of each software code modification in real time or periodically, such as modifying. Type, modification time, modification party identity information, etc., and use the detected software modification information for more detailed analysis to determine whether the software code of the software system should be identified as being modified. For example, it may be preset that after the set time period or the set high level developer modifies the software code of the software system, the software system is not required to be automatically tested, and then the information acquisition module is modified by the software. It also records that the software code of the software system has been modified by the high-level developer in the set time period or setting, and the software code identified as the software system is not modified, which is more flexible and practical.
  • Step S20 If the software code of the software system is modified, the modified software code is found, and the associated software code is determined according to the associated data of the pre-saved software code and the automated test execution script. Connected automated test execution scripts;
  • the modified software code is also the software code of the software system.
  • the associated data of the software code and the automated test execution script may be an analysis of the software code of the software system and each of the automated test execution scripts in advance, and find an automated test execution script corresponding to each piece of software code of the software system, and Save the association.
  • the associated data of the software code and the automated test execution script may also be obtained from the cloud server, for example, the software code provided by the same software system as the software system may be directly obtained from the cloud server and the associated test data of the automated test execution script;
  • the cloud server obtains the associated data of the software code provided by the software system identical or similar to the software system and the automated test execution script, and compares and selects the data of the most accurate software code and the automated test execution script, which is not limited herein. .
  • Step S30 running the determined various automated test execution scripts in the software system after the software code is modified, and generating a test report.
  • the determined individual automated test execution scripts may be run in the software system after the software code is modified to modify the software code.
  • the system performs automated testing, that is, using the automated test execution script associated with the original software code before modification, to automatically test the software system whose code has been modified to test the modified software system and before the modification.
  • the original software code has the same or similar modified content in terms of content, function, function, etc., whether there is any incompatibility, mismatch, etc., and generates a test report.
  • the test report includes list information of an automated test execution script in which a test error occurs, and/or error type information of the test error, including but not limited to an H5 page exception, a system crash, and the like.
  • the automated test execution script associated with the modified software code is determined by the pre-stored software code and the associated data of the automated test execution script, and the software code is The modified automated test execution scripts are run in the modified software system to generate test reports. Since it is only necessary to determine the automated test execution script associated with the modified software code and execute the determined automated test execution script to complete the test without running all automated test execution scripts on the software system after the code is modified. Improves test efficiency and makes it easier to find test errors, saving manpower and material resources.
  • the second embodiment of the present invention provides an automated test method. Based on the foregoing embodiment, before the step S10, the method further includes:
  • Step S40 running each of the automated test execution scripts corresponding to the software system one by one, and analyzing and recording the software code associated with the automated test execution script during an automated test execution script running process, wherein the automated test execution script is related to the automated test execution script
  • the associated software code is the software code that is invoked during the running of the automated test execution script
  • step S50 the associated data of the software code and the automated test execution script is saved.
  • each of the automated test execution scripts corresponding to the software system is run one by one, and during an automated test execution script running process, the software code associated with the automated test execution script is analyzed and recorded,
  • the software code associated with the automated test execution script refers to the software code that is invoked during the execution of the automated test execution script.
  • the third embodiment of the present invention provides an automated test method. Based on the foregoing embodiment, before the step S30, the method further includes:
  • Step S60 analyzing whether an automated test execution script associated with the modified software code is determined
  • step S70 is executed to generate reminder information to remind the user to add a corresponding automated test execution script for the modified software code.
  • the automated test execution script associated with the modified software code when the automated test execution script associated with the modified software code is determined, if the automated test execution script associated with the modified software code is not found, the modified software code is not previously associated with the relevant The automated test execution script or the modified software code is new code, there is no automated test execution script associated with it, and the developer is required to manually add automated test execution scripts. Then generating reminder information such as pop-up information on the interface, or sending reminder information to a predetermined terminal, such as a developer's mobile phone, to remind the developer to manually write a script for the modified software code or to retrieve an existing script. Add the corresponding automated test execution script to enable more comprehensive automated testing of the software system with the modified software code.
  • the invention further provides an automated test device.
  • FIG. 4 is a schematic diagram of functional modules of a first embodiment of an automated test apparatus according to the present invention.
  • the automated test device comprises:
  • the first analysis module 01 is configured to analyze whether the software code of the software system is modified in real time or timing during the running of the software system;
  • the system log information is retrieved in real time or periodically, and the software modification log of the software system is extracted from the system log information to analyze whether the software code of the software system is modified.
  • a software modification information collection module may be pre-configured on the software system, and the information acquisition module is modified by the software to detect and record detailed information of each software code modification in real time or periodically, such as modifying. Type, modification time, modification party identity information, etc., and use the detected software modification information for more detailed analysis to determine whether the software code of the software system should be identified as being modified. For example, it may be preset that after the set time period or the set high level developer modifies the software code of the software system, the software system is not required to be automatically tested, and then the information acquisition module is modified by the software. It also records that the software code of the software system has been modified by the high-level developer in the set time period or setting, and the software code identified as the software system is not modified, which is more flexible and practical.
  • the determining module 02 is configured to: if the software code of the software system is modified, find the modified software code, and determine and modify the modified software according to the associated data of the pre-saved software code and the automated test execution script. An automated test execution script associated with the software code;
  • the modified software code is also the software code of the software system.
  • the associated data of the software code and the automated test execution script may be an analysis of the software code of the software system and each of the automated test execution scripts in advance, and find an automated test execution script corresponding to each piece of software code of the software system, and Save the association.
  • the associated data of the software code and the automated test execution script may also be obtained from the cloud server, for example, the software code provided by the same software system as the software system may be directly obtained from the cloud server and the associated test data of the automated test execution script;
  • the cloud server obtains the associated data of the software code provided by the software system identical or similar to the software system and the automated test execution script, and compares and selects the data of the most accurate software code and the automated test execution script, which is not limited herein. .
  • test module 03 configured to run the determined each in the software system after the software code is modified Automate test execution scripts and generate test reports.
  • the determined individual automated test execution scripts may be run in the software system after the software code is modified to modify the software code.
  • the system performs automated testing, that is, using the automated test execution script associated with the original software code before modification, to automatically test the software system whose code has been modified to test the modified software system and before the modification.
  • the original software code has the same or similar modified content in terms of content, function, function, etc., whether there is any incompatibility, mismatch, etc., and generates a test report.
  • the test report includes list information of an automated test execution script in which a test error occurs, and/or error type information of the test error, including but not limited to an H5 page exception, a system crash, and the like.
  • the automated test execution script associated with the modified software code is determined by the pre-stored software code and the associated data of the automated test execution script, and the software code is The modified automated test execution scripts are run in the modified software system to generate test reports. Since it is only necessary to determine the automated test execution script associated with the modified software code and execute the determined automated test execution script to complete the test without running all automated test execution scripts on the software system after the code is modified. Improves test efficiency and makes it easier to find test errors, saving manpower and material resources.
  • the second embodiment of the present invention provides an automated testing device. Based on the foregoing embodiments, the method further includes:
  • the recording module 04 is configured to run each of the automated test execution scripts corresponding to the software system one by one, and analyze and record the software code associated with the automated test execution script during an automated test execution script operation, and the automated test
  • the software code associated with the execution script is the software code that is invoked during the running of the automated test execution script
  • the saving module 05 is used to save the associated data of the software code and the automated test execution script.
  • each of the automated test execution scripts corresponding to the software system is run one by one, and during an automated test execution script running process, the software code associated with the automated test execution script is analyzed and recorded,
  • the software code associated with the automated test execution script refers to the software code that is invoked during the execution of the automated test execution script.
  • the third embodiment of the present invention provides an automatic testing device. Based on the foregoing embodiments, the method further includes:
  • a second analysis module 06 configured to analyze whether an automated test execution script associated with the modified software code is determined
  • Reminder module 07 for automated test execution if not associated with the modified software code
  • the script generates a reminder message to remind the user to add a corresponding automated test execution script for the modified software code.
  • the automated test execution script associated with the modified software code when the automated test execution script associated with the modified software code is determined, if the automated test execution script associated with the modified software code is not found, the modified software code is not previously associated with the relevant The automated test execution script or the modified software code is new code, there is no automated test execution script associated with it, and the developer is required to manually add automated test execution scripts. Then generating reminder information such as pop-up information on the interface, or sending reminder information to a predetermined terminal, such as a developer's mobile phone, to remind the developer to manually write a script for the modified software code or to retrieve an existing script. Add the corresponding automated test execution script to enable more comprehensive automated testing of the software system with the modified software code.
  • the present invention also provides a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements the automated test method and apparatus of the various embodiments described above step.
  • the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and can also be implemented by hardware, but in many cases, the former is A better implementation.
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk,
  • the optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the methods described in various embodiments of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

L'invention concerne un procédé et un dispositif de test automatique. Le procédé comprend les étapes suivantes : pendant le fonctionnement d'un système logiciel, analyser si un code logiciel du système logiciel est modifié en temps réel ou régulièrement (S10); s'il est analysé que le code logiciel du système logiciel est modifié, trouver le code logiciel modifié, et déterminer un script d'exécution de test automatique associé au code logiciel modifié trouvé conformément à des données associées pré-stockées entre le code logiciel et le script d'exécution de test automatique (S20); et exécuter chaque script d'exécution de test automatique déterminé dans le système logiciel avec le code logiciel modifié, et générer un rapport de test (S30). Le procédé mentionné ci-dessus améliore l'efficacité de test, facilite la découverte d'une erreur de test et économise de la main d'œuvre et des ressources matérielles.
PCT/CN2017/105011 2016-12-30 2017-09-30 Procédé et dispositif de test automatique, et support d'information lisible par ordinateur WO2018120965A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201611261210.1A CN106776339B (zh) 2016-12-30 2016-12-30 自动化测试方法及装置
CN201611261210.1 2016-12-30

Publications (1)

Publication Number Publication Date
WO2018120965A1 true WO2018120965A1 (fr) 2018-07-05

Family

ID=58954929

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/105011 WO2018120965A1 (fr) 2016-12-30 2017-09-30 Procédé et dispositif de test automatique, et support d'information lisible par ordinateur

Country Status (2)

Country Link
CN (1) CN106776339B (fr)
WO (1) WO2018120965A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110515852A (zh) * 2019-08-30 2019-11-29 北京浪潮数据技术有限公司 一种基于敏捷开发的应用更新测试方法及相关装置
CN111367555A (zh) * 2020-03-23 2020-07-03 北京字节跳动网络技术有限公司 断言的方法、装置、电子设备及计算机可读介质
CN112925716A (zh) * 2021-03-19 2021-06-08 广东好太太智能家居有限公司 一种可视化图像的测试方法、设备及存储介质

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106776339B (zh) * 2016-12-30 2018-07-24 深圳壹账通智能科技有限公司 自动化测试方法及装置
CN107992424A (zh) * 2017-12-15 2018-05-04 平安科技（深圳）有限公司 自动化测试分析方法、应用服务器及计算机可读存储介质
CN108427639B (zh) * 2018-01-24 2021-05-07 深圳壹账通智能科技有限公司 自动化测试方法、应用服务器及计算机可读存储介质
CN108681504A (zh) * 2018-04-13 2018-10-19 深圳壹账通智能科技有限公司 自动化测试方法、测试服务器及计算机可读存储介质
CN111581103A (zh) * 2020-05-11 2020-08-25 成都库珀区块链科技有限公司 一种数据检测的方法及相关装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100192128A1 (en) * 2009-01-27 2010-07-29 Honeywell International Inc. System and methods of using test points and signal overrides in requirements-based test generation
CN102521700A (zh) * 2011-12-13 2012-06-27 广东电网公司信息中心 电网信息化评测快速测试系统
CN103186463A (zh) * 2011-12-30 2013-07-03 阿里巴巴集团控股有限公司 确定软件的测试范围的方法和系统
US20140181591A1 (en) * 2012-12-20 2014-06-26 Microsoft Corporation Test strategy for profile-guided code execution optimizers
CN105260303A (zh) * 2015-10-10 2016-01-20 浪潮电子信息产业股份有限公司 一种基于自动化测试的敏捷测试方案
CN106776339A (zh) * 2016-12-30 2017-05-31 上海亿账通互联网科技有限公司 自动化测试方法及装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100192128A1 (en) * 2009-01-27 2010-07-29 Honeywell International Inc. System and methods of using test points and signal overrides in requirements-based test generation
CN102521700A (zh) * 2011-12-13 2012-06-27 广东电网公司信息中心 电网信息化评测快速测试系统
CN103186463A (zh) * 2011-12-30 2013-07-03 阿里巴巴集团控股有限公司 确定软件的测试范围的方法和系统
US20140181591A1 (en) * 2012-12-20 2014-06-26 Microsoft Corporation Test strategy for profile-guided code execution optimizers
CN105260303A (zh) * 2015-10-10 2016-01-20 浪潮电子信息产业股份有限公司 一种基于自动化测试的敏捷测试方案
CN106776339A (zh) * 2016-12-30 2017-05-31 上海亿账通互联网科技有限公司 自动化测试方法及装置

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110515852A (zh) * 2019-08-30 2019-11-29 北京浪潮数据技术有限公司 一种基于敏捷开发的应用更新测试方法及相关装置
CN111367555A (zh) * 2020-03-23 2020-07-03 北京字节跳动网络技术有限公司 断言的方法、装置、电子设备及计算机可读介质
CN111367555B (zh) * 2020-03-23 2023-08-08 抖音视界有限公司 断言的方法、装置、电子设备及计算机可读介质
CN112925716A (zh) * 2021-03-19 2021-06-08 广东好太太智能家居有限公司 一种可视化图像的测试方法、设备及存储介质
CN112925716B (zh) * 2021-03-19 2024-01-23 广东好太太智能家居有限公司 一种可视化图像的测试方法、设备及存储介质

Also Published As

Publication number Publication date
CN106776339B (zh) 2018-07-24
CN106776339A (zh) 2017-05-31

Similar Documents

Publication Publication Date Title
WO2018120965A1 (fr) Procédé et dispositif de test automatique, et support d'information lisible par ordinateur
WO2018010552A1 (fr) Procédé et dispositif de test
US9824002B2 (en) Tracking of code base and defect diagnostic coupling with automated triage
CN110362480A (zh) 客户端埋点测试方法、装置、设备及存储介质
CN106951369B (zh) 一种联调测试的管理方法及装置
US9396092B1 (en) Software testing with feedback acquisition
US10089109B2 (en) System and method for evaluating human resources in a software development environment
WO2019227708A1 (fr) Appareil et procédé de débogage en ligne pour jeu d'essai et support de stockage lisible par ordinateur
CN108923997B (zh) 一种基于python的云服务节点自动测试方法及装置
CN108509344B (zh) 日切跑批测试方法、设备及可读存储介质
CN111274154A (zh) 一种自动化测试的方法、装置、设备及存储介质
US20180357143A1 (en) Testing computing devices
CN113448862B (zh) 软件版本测试方法、装置及计算机设备
CN110297767B (zh) 测试用例自动执行方法、装置、设备及存储介质
US9286195B2 (en) Derivation of generalized test cases
CN109522181B (zh) 一种分布式存储系统的性能测试方法、装置和设备
CN111198811A (zh) 一种页面自动化测试的方法、装置、电子设备及存储介质
US11422917B2 (en) Deriving software application dependency trees for white-box testing
CN106557419B (zh) 程序的测试方法及装置
US9886374B1 (en) Virtual device farm for software testing
WO2019005294A1 (fr) Rétablissement d'application suite à une erreur
CN117493188A (zh) 接口测试方法及装置、电子设备及存储介质
CN116431522A (zh) 一种低代码对象存储网关自动化测试方法及系统
CN112069073A (zh) 测试用例的管理方法、终端和存储介质
CN116719736A (zh) 一种用于测试软件界面的测试用例生成方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17888801

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17888801

Country of ref document: EP

Kind code of ref document: A1