CN105405221A - Method and device for automated test - Google Patents

Method and device for automated test Download PDF

Info

Publication number
CN105405221A
CN105405221A CN201510713264.6A CN201510713264A CN105405221A CN 105405221 A CN105405221 A CN 105405221A CN 201510713264 A CN201510713264 A CN 201510713264A CN 105405221 A CN105405221 A CN 105405221A
Authority
CN
China
Prior art keywords
self
service
test
test case
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510713264.6A
Other languages
Chinese (zh)
Inventor
于涛
王一军
王磊
周洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Yihua Computer Co Ltd
Shenzhen Yihua Time Technology Co Ltd
Shenzhen Yihua Financial Intelligent Research Institute
Original Assignee
Shenzhen Yihua Computer Co Ltd
Shenzhen Yihua Time Technology Co Ltd
Shenzhen Yihua Financial Intelligent Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Yihua Computer Co Ltd, Shenzhen Yihua Time Technology Co Ltd, Shenzhen Yihua Financial Intelligent Research Institute filed Critical Shenzhen Yihua Computer Co Ltd
Priority to CN201510713264.6A priority Critical patent/CN105405221A/en
Publication of CN105405221A publication Critical patent/CN105405221A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07FCOIN-FREED OR LIKE APPARATUS
    • G07F19/00Complete banking systems; Coded card-freed arrangements adapted for dispensing or receiving monies or the like and posting such transactions to existing accounts, e.g. automatic teller machines
    • G07F19/20Automatic teller machines [ATMs]
    • G07F19/209Monitoring, auditing or diagnose of functioning of ATMs

Landscapes

  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Cash Registers Or Receiving Machines (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

Embodiments of the invention disclose a method and a device for automated tests. The method comprises: obtaining operation data of a self-service device in a preset region; according to a data automated generation test case, sending the test case to the self-service device, so that the self-service device performs an automated test according to the test case, the test case comprising testing test information corresponding to at least a business type; obtaining a result of the automated test, and generating a test report. In the method, data in different application scenarios is obtained from an actual used environment, and a set of automated test system is used to perform dynamic and intelligently adjusted tests after the self-service device is produced. Thus, real situation in practical use environment is simulated as much as possible, and accuracy and pertinence are improved. Since artificial intervention is reduced, a process of manual data analysis is reduced, so as to preferably ensure product quality of the self-service device.

Description

Automatic testing method and device
Technical Field
The embodiment of the invention relates to the technical field of self-service terminal equipment, in particular to an automatic testing method and device.
Background
At present, in the automatic test of self-service terminal equipment, the test can be carried out only according to the service specified in a test script file compiled in advance. I.e. generally only mechanically repetitive operations can be performed, such as: after a certain service process (also called a service scene) is recorded or set, the test is performed according to the original process. For the ATM, if the execution scenario originally set is: inquiry, withdrawal, transfer and encryption change, and only the action is executed according to the established flow during subsequent playback.
Such a test scenario is inconsistent with the scenario actually executed on the actual operating environment of the actual self-service device. That is, in the actual operating environment of the self-service device, it is impossible for each cardholder to operate according to the established flow. But the business processes of withdrawal, deposit, transfer, password change, inquiry and the like are random, and the parameters of each business such as the withdrawal amount are not fixed and unchangeable. The set scene is used for carrying out pressure (aging) test, and the scene similar to the actual operation environment of the self-service equipment cannot be accurately simulated, so that the result obtained under the test environment is inconsistent with the result obtained under the actual operation environment of the self-service equipment, and even great difference can be generated to influence the test effect.
In addition, the functions are not exactly the same for different ATM models. For example, the recycling model can perform deposit, cardless deposit, etc., while the teller model does not. Therefore, if a certain business processing flow is fixed, it is obviously not suitable for different businesses on different models.
Moreover, if some cases with abnormal service processing are to be executed, branches in the program not only have normal service flow branches, but also have branches with abnormal processing, the executed probabilities of the branches are very different, and how to fully ensure the pressure test of the flow branches by using limited test resources and test time, that is, during the pressure test, each branch in the program is tested with the probability that the program is executed in normal operation, so that the test quality is ensured to the maximum extent in the limited test time, and the test cost is saved.
Disclosure of Invention
The embodiment of the invention aims to provide an automatic testing method and device, and aims to solve the problem of combining the test of a self-service terminal with an actual operating environment.
To achieve the purpose, the embodiment of the invention adopts the following technical scheme:
in a first aspect, a method of automated testing, the method comprising:
acquiring running data of self-service equipment in a preset area;
automatically generating a test case according to the data, and sending the test case to the self-service equipment so that the self-service equipment performs automatic testing according to the test case, wherein the test case comprises test information corresponding to at least one service type;
and acquiring a result after the automatic test and generating a test report.
Preferably, the acquiring data of the self-service device running in the preset area includes:
acquiring data of business operation of the self-service equipment through network transmission, wherein the data comprises action instructions triggered by a user on the self-service equipment, parameters corresponding to the action instructions and interval time among the action instructions; or,
acquiring data of business operation of the self-service equipment encrypted according to a preset rule through a mobile storage medium; or,
and extracting data stored in different formats when the self-service equipment of different transaction types performs business operation, wherein the different transaction types comprise only withdrawal, only deposit or deposit and withdrawal integration, and the different formats comprise logs, texts, databases or preset specific formats.
Preferably, the sending the test case to the self-service device includes:
judging the service types to be tested, which are included in the test cases, wherein the service types comprise deposit, withdrawal, transfer, inquiry or password change, and the test cases comprise test cases formed by combining at least one service type;
sending the test case to self-service equipment executing the service type;
and carrying out simulation test according to the acquired data corresponding to the service type and the test case input by the user.
Preferably, after acquiring the data of the self-service device running in the preset area, the method further includes:
and when the user uses the self-service terminal to carry out service operation, recording the service type and the card number information and/or the serial number information corresponding to the service type.
Preferably, the method further comprises:
and storing the test cases suitable for the self-service equipment of different transaction types in a public test case library according to a preset storage method.
Preferably, after the automatically generating a test case according to the data and sending the test case to the self-service device, the method further includes:
after testing a test case on the self-service terminal, randomly selecting another test case from the test case library for testing;
the random selection of another test case from the test case library for testing comprises:
judging the transaction type of the self-service terminal, wherein the transaction type comprises withdrawal only, deposit only or deposit and withdrawal integration;
and selecting a test case which can be used for the self-service terminal from the test case library according to a preset algorithm according to the transaction type.
Preferably, the selecting, according to the transaction type, one test case available for the self-service terminal from the test case library according to a preset algorithm includes:
sending test information for testing a single pre-stored service type to the self-service terminal according to a preset single module operation mode;
the method further comprises the following steps:
and if the test result of testing the single pre-stored service type and the correct test result on the self-service terminal exceed the preset threshold value, sending prompt information to a tester.
Preferably, the selecting, according to the transaction type, one test case available for the self-service terminal from the test case library according to a preset algorithm includes:
receiving data of business operation of a user on self-service equipment with the same transaction type as that of the self-service equipment to be tested according to a preset completely consistent operation mode, wherein the data comprises action instructions triggered by the user on the self-service equipment, parameters corresponding to the action instructions and interval time among the action instructions; sending the data to the self-service equipment to be tested, and comparing a first data result of the data running on the self-service equipment to be tested with a second data result of the data running on the self-service equipment with the same transaction type as that of the self-service equipment to be tested; if the difference value between the first data result and the second data result exceeds a preset threshold value, sending prompt information to a tester; or,
acquiring the probability of carrying out various different business operations and the probability of association among the businesses of the self-service equipment under the actual use environment according to a preset fuzzy matching mode; acquiring a service type with the maximum probability associated with the service type of the last test according to the service type of the last test and the probability associated between the services; sending the test case comprising the service type with the maximum probability associated with the last tested service type to the self-service terminal; or,
acquiring preset conditions of the self-service terminal to be tested according to a preset reference set operation mode, wherein the preset conditions comprise the service types to be tested of the self-service terminal to be tested; sending test information of a single service type matched with the preset conditions to the self-service terminal to be tested; or, under the condition that the service type with the maximum probability associated with the service type of the previous test is obtained, further judging whether the service type with the maximum probability associated with the service type of the previous test matches the preset condition, if so, sending a test case including the service type with the maximum probability associated with the service type of the previous test to the self-service terminal; if not, acquiring a service type with the next ranked probability value associated with the last tested service type; or,
randomly selecting a test case which can be used for the self-service terminal from the test case library according to a preset random adjustment operation mode and the transaction type; if a preset problem occurs when the randomly selected test case runs on the self-service terminal to be tested, the probability of the randomly selected test case is improved; or,
and selecting a preset single module operation mode, a completely consistent operation mode, a fuzzy matching mode, a reference setting operation mode or a random adjustment operation mode according to a preset sequence or according to a random mode to select a test case which can be used for the self-service terminal.
In a second aspect, an apparatus for automated testing, the apparatus comprising:
the system comprises a first acquisition module, a second acquisition module and a control module, wherein the first acquisition module is used for acquiring the running data of the self-service equipment in a preset area;
the sending module is used for automatically generating a test case according to the data and sending the test case to the self-service equipment so that the self-service equipment can automatically test according to the test case, and the test case comprises test information corresponding to at least one service type;
and the second acquisition module is used for acquiring the result after the automatic test and generating a test report.
Preferably, the first obtaining module includes:
the self-service equipment comprises a first acquisition unit, a second acquisition unit and a processing unit, wherein the first acquisition unit is used for acquiring data of business operation of the self-service equipment through network transmission, and the data comprises action instructions triggered by a user on the self-service equipment, parameters corresponding to the action instructions and interval time among the action instructions; or,
the second acquisition unit is used for acquiring data of business operation of the self-service equipment encrypted according to a preset rule through a mobile storage medium; or,
the extraction unit is used for extracting data stored in different formats when self-service equipment of different transaction types performs business operations, wherein the different transaction types comprise only withdrawal, only deposit or deposit and withdrawal, and the different formats comprise logs, texts, databases or preset specific formats.
Preferably, the sending module includes:
the judging unit is used for judging the service types to be tested, which are included in the test cases, wherein the service types comprise deposit, withdrawal, transfer, inquiry or encryption change, and the test cases comprise test cases formed by combining at least one service type;
the sending unit is used for sending the test case to self-service equipment executing the service type;
and the testing unit is used for carrying out simulation testing according to the acquired data which is input by the user and corresponds to the service type and the testing case.
Preferably, the apparatus further comprises:
and the recording module is used for recording the service type and the card number information and/or the serial number information corresponding to the service type when the user uses the self-service terminal to perform service operation.
Preferably, the apparatus further comprises:
and the storage module is used for storing the test cases suitable for the self-service equipment of different transaction types in a public test case library according to a preset storage method.
Preferably, the apparatus further comprises:
the self-service terminal is used for testing one test case, and then randomly selecting another test case from the test case library to test;
the selection module comprises:
the judging unit is used for judging the transaction type of the self-service terminal, and the transaction type comprises only withdrawal, only deposit or deposit and withdrawal integration;
and the selection unit is used for selecting one test case which can be used for the self-service terminal from the test case library according to a preset algorithm according to the transaction type.
Preferably, the selection unit is configured to:
sending test information for testing a single pre-stored service type to the self-service terminal according to a preset single module operation mode;
the device further comprises:
and the sending module is used for sending prompt information to a tester if the test result of testing the single pre-stored service type and the correct test result on the self-service terminal exceed a preset threshold value.
Preferably, the selection unit is configured to:
receiving data of business operation of a user on self-service equipment with the same transaction type as that of the self-service equipment to be tested according to a preset completely consistent operation mode, wherein the data comprises action instructions triggered by the user on the self-service equipment, parameters corresponding to the action instructions and interval time among the action instructions; sending the data to the self-service equipment to be tested, and comparing a first data result of the data running on the self-service equipment to be tested with a second data result of the data running on the self-service equipment with the same transaction type as that of the self-service equipment to be tested; if the difference value between the first data result and the second data result exceeds a preset threshold value, sending prompt information to a tester; or,
acquiring the probability of carrying out various different business operations and the probability of association among the businesses of the self-service equipment under the actual use environment according to a preset fuzzy matching mode; acquiring a service type with the maximum probability associated with the service type of the last test according to the service type of the last test and the probability associated between the services; sending the test case comprising the service type with the maximum probability associated with the last tested service type to the self-service terminal; or,
acquiring preset conditions of the self-service terminal to be tested according to a preset reference set operation mode, wherein the preset conditions comprise the service types to be tested of the self-service terminal to be tested; sending test information of a single service type matched with the preset conditions to the self-service terminal to be tested; or, under the condition that the service type with the maximum probability associated with the service type of the previous test is obtained, further judging whether the service type with the maximum probability associated with the service type of the previous test matches the preset condition, if so, sending a test case including the service type with the maximum probability associated with the service type of the previous test to the self-service terminal; if not, acquiring a service type with the next ranked probability value associated with the last tested service type; or,
randomly selecting a test case which can be used for the self-service terminal from the test case library according to a preset random adjustment operation mode and the transaction type; if a preset problem occurs when the randomly selected test case runs on the self-service terminal to be tested, the probability of the randomly selected test case is improved; or,
and selecting a preset single module operation mode, a completely consistent operation mode, a fuzzy matching mode, a reference setting operation mode or a random adjustment operation mode according to a preset sequence or according to a random mode to select a test case which can be used for the self-service terminal.
The method comprises the steps of acquiring running data of the self-service equipment in a preset area; automatically generating a test case according to the data, and sending the test case to the self-service equipment so that the self-service equipment performs automatic testing according to the test case, wherein the test case comprises test information corresponding to at least one service type; the method comprises the steps of obtaining results after automatic testing, generating a test report, obtaining data under different application scenes from an actual use environment, and carrying out dynamic and intelligent adjustment testing by using a set of automatic testing system after self-service equipment is produced, so that the real situation under the actual use environment is simulated as much as possible, and the accuracy and pertinence of the testing are improved. And because manual intervention is reduced, the process of manually analyzing data is reduced, and the product quality of the self-service equipment is better guaranteed.
Drawings
FIG. 1 is a schematic flow chart diagram of a first embodiment of a method for automated testing in accordance with an embodiment of the present invention;
FIG. 2 is a flow chart of a second embodiment of a method for automated testing in accordance with an embodiment of the present invention;
FIG. 3 is a flow chart of a third embodiment of a method for automated testing in accordance with an embodiment of the present invention;
FIG. 4 is a flow chart illustrating a fourth embodiment of a method for automated testing in accordance with an embodiment of the present invention;
FIG. 5 is a transition state diagram provided by an embodiment of the present invention;
FIG. 6 is a functional block diagram of an apparatus for automated testing according to an embodiment of the present invention;
fig. 7 is a functional block diagram of a first obtaining module 601 according to an embodiment of the present invention;
FIG. 8 is a functional block diagram of a sending module according to an embodiment of the present invention;
FIG. 9 is a functional block diagram of an apparatus for automated testing according to an embodiment of the present invention;
FIG. 10 is a functional block diagram of an apparatus for automated testing according to an embodiment of the present invention;
FIG. 11 is a functional block diagram of an apparatus for automated testing according to an embodiment of the present invention;
fig. 12 is a functional block diagram of the selecting module 606 according to an embodiment of the present invention.
Detailed Description
The embodiments of the present invention will be described in further detail with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of and not restrictive on the broad invention. It should be further noted that, for convenience of description, only some structures, not all structures, relating to the embodiments of the present invention are shown in the drawings.
Example one
Referring to fig. 1, fig. 1 is a schematic flow chart of a first embodiment of an automated testing method according to an embodiment of the present invention.
In one embodiment, the method for automated testing includes:
step 101, acquiring running data of self-service equipment in a preset area;
preferably, the acquiring data of the self-service device running in the preset area includes:
acquiring data of business operation of the self-service equipment through network transmission, wherein the data comprises action instructions triggered by a user on the self-service equipment, parameters corresponding to the action instructions and interval time among the action instructions; or,
acquiring data of business operation of the self-service equipment encrypted according to a preset rule through a mobile storage medium; or,
specifically, data of the self-service equipment running in an actual running environment is collected, so that the reality and the effectiveness of the data are ensured, and typical application scenes (namely specific places) are collected during data collection, wherein the typical application scenes comprise supermarkets, markets, communities, schools and the like;
the data of the self-service equipment running in the actual running environment of the self-service equipment is collected, namely, various signals input by a user are acquired in the execution process of the respective self-service equipment, namely, self-service parameters received by the running system are acquired, and the parameters comprise action parameters of interaction with the self-service equipment when the user inserts/takes a card, inputs a key, takes/puts a bank note, takes a receipt and the like and the interval time of each parameter when the user carries out self-service.
Further, in step 101, data acquisition processing is performed on the self-service device, the data acquisition system works in a device running mode, and when a certain transaction is completed, relevant data is automatically recorded. When the self-service equipment meets the condition that the resource information and the hardware information of the self-service equipment are consistent with one of the machine information under the test environment, the automatic triggering data acquisition function is used for acquiring data, and the specific triggering mechanism comprises:
1a) when the self-service equipment detects that the mobile storage medium is accessed, the collected data are automatically named according to a certain rule after being encrypted and sent to the mobile storage medium.
1b) And after receiving legal control information sent by the front-end system or the monitoring system, the self-service equipment automatically transmits the acquired data to a specified test server.
And extracting data stored in different formats when the self-service equipment of different transaction types performs business operation, wherein the different transaction types comprise only withdrawal, only deposit or deposit and withdrawal integration, and the different formats comprise logs, texts, databases or preset specific formats.
Specifically, further, in step 101, the collected self-service device data information is analyzed and processed, and a specific processing mode and mechanism include:
2a) the method can process file data types with different formats, including log files, text files and database files, and files with certain specific formats.
2b) The data processing conditions can be set, and the content required by the user can be screened through combination of the conditions, such as different transaction types.
The combination of conditions herein refers to the following but is not limited to: the transaction type of the collected data, if the software to be tested does not have or provide or open the transaction, the collection of the data is abandoned; if two machines of a certain network are a deposit machine and a cash dispenser respectively, the data of the two machines are collected together and used as a test case of the software to be tested of the circulating all-in-one machine which distributes the network.
2c) The data information which is newly added can be automatically analyzed and processed, the processed data can be backed up and filed, the whole process is automatically completed, and manual intervention is not needed.
The analysis processing here refers to the consistency processing of the format of the acquired data, extracting uniform information content, and storing the information content in the database.
102, automatically generating a test case according to the data, and sending the test case to the self-service equipment so that the self-service equipment performs automatic testing according to the test case, wherein the test case comprises test information corresponding to at least one service type;
preferably, the sending the test case to the self-service device includes:
judging the service types to be tested, which are included in the test cases, wherein the service types comprise deposit, withdrawal, transfer, inquiry or password change, and the test cases comprise test cases formed by combining at least one service type;
sending the test case to self-service equipment executing the service type;
and carrying out simulation test according to the acquired data corresponding to the service type and the test case input by the user.
Specifically, extracting a test case in a test library, and judging the service type of the test case;
3a) executing the test case on self-service equipment provided with software to be tested capable of providing the service type, and performing simulation input on user input parameters and time intervals thereof in the process of executing the test case so as to obtain the most real test effect;
3b) and summarizing and counting the execution results of all the self-service equipment executing the test case to obtain the test report content of the test case.
And 103, acquiring the result after the automatic test and generating a test report.
Specifically, the generation of the single self-service equipment automatic test report or the generation of the batch self-service equipment automatic test report can be realized.
After the self-service equipment completes all preset test cases, the test report subsystem starts to process data collection and processing, the self-service equipment test report subsystem can generate a single self-service equipment test report according to relevant templates and settings, and sends information to a test responsible person or transmits the information to a data acquisition server according to set conditions so as to provide data for batch test reports.
After the test report of the single self-service equipment is generated and data are transmitted to the designated data acquisition server, the batch test report subsystem processes data information on all the single self-service equipment, generates a final report of all the self-service equipment in the current batch after automatic testing, and automatically transmits the final report to relevant personnel for reference in a mail mode.
The method comprises the steps of acquiring running data of the self-service equipment in a preset area; automatically generating a test case according to the data, and sending the test case to the self-service equipment so that the self-service equipment performs automatic testing according to the test case, wherein the test case comprises test information corresponding to at least one service type; the method comprises the steps of obtaining results after automatic testing, generating a test report, obtaining data under different application scenes from an actual use environment, and carrying out dynamic and intelligent adjustment testing by using a set of automatic testing system after self-service equipment is produced, so that the real situation under the actual use environment is simulated as much as possible, and the accuracy and pertinence of the testing are improved. And because manual intervention is reduced, the process of manually analyzing data is reduced, and the product quality of the self-service equipment is better guaranteed.
Example two
Referring to fig. 2, fig. 2 is a flowchart illustrating a second embodiment of the automated testing method according to the embodiment of the present invention.
On the basis of the first embodiment, after the data of the self-service device operation in the preset area is acquired, the method further includes:
and 104, recording the service type and the card number information and/or the serial number information corresponding to the service type when the user uses the self-service terminal to perform service operation.
Specifically, the automatic testing system of the self-service equipment starts to record mark information, wherein the mark information is service information such as card number part information and serial number information which can identify service characteristics of each time and is recorded by the service system of the self-service equipment when a user using the self-service equipment performs service operation, so that data information related to the service can be conveniently and rapidly searched and searched in data stored in the automatic testing system of the self-service equipment, and the service can be conveniently subjected to statistical analysis and summary work.
EXAMPLE III
Referring to fig. 3, fig. 3 is a flow chart illustrating a third embodiment of the method for automated testing according to the embodiment of the present invention.
On the basis of the first embodiment, the method further comprises:
and 105, storing the test cases suitable for the self-service equipment of different transaction types in a public test case library according to a preset storage method.
Specifically, a case or a case sequence can be randomly extracted from a test case library of the model to be tested according to whether the model is a circular machine, a machine is only taken or stored, and the actual operation condition is close to.
The case sequence refers to a case group formed by a group of services which are acquired in an operating environment and are sequentially carried out by deposit, withdrawal, account transfer, inquiry, secret change and the like.
If the machine type is a circulating machine type, the transaction test of withdrawing money and depositing money can be provided at the same time; if the machine type is the machine type only, only a withdrawal transaction test is provided, and a deposit transaction test is shielded; if the machine type is deposit-only type, only deposit transaction is provided and the withdrawal transaction test is shielded.
Of course, the above three models can provide other services such as encryption, inquiry, transfer, etc. in addition to depositing and withdrawing, as long as the model has and opens the services.
Selecting test cases or test case sequences of various services corresponding to the machine type according to the machine type to form a test case library of the machine type; the test cases or test case sequences suitable for all the machine types can be put into a public test case library.
Example four
Referring to fig. 4, fig. 4 is a flowchart illustrating a fourth embodiment of the method for automated testing according to the embodiment of the present invention.
On the basis of the first embodiment, after the automatically generating a test case according to the data and sending the test case to the self-service device, the method further includes:
after testing a test case on the self-service terminal, randomly selecting another test case from the test case library for testing;
the random selection of another test case from the test case library for testing comprises:
judging the transaction type of the self-service terminal, wherein the transaction type comprises withdrawal only, deposit only or deposit and withdrawal integration;
and selecting a test case which can be used for the self-service terminal from the test case library according to a preset algorithm according to the transaction type.
Preferably, the selecting, according to the transaction type, one test case available for the self-service terminal from the test case library according to a preset algorithm includes:
sending test information for testing a single pre-stored service type to the self-service terminal according to a preset single module operation mode;
the method further comprises the following steps:
and if the test result of testing the single pre-stored service type and the correct test result on the self-service terminal exceed the preset threshold value, sending prompt information to a tester.
Specifically, in this mode, the individual modules are first subjected to a basic pressure test to ensure that each individual module is stable and reliable. In order to improve the execution efficiency, the tests of the single modules can be simultaneously and concurrently carried out, and the single modules do not interfere with each other. I.e. the test result of one module does not affect the test result of another module. When a certain module has a fault, other modules can also normally operate.
The running times of each module, the running result of each time and the proportion of the test passing execution are stored according to a certain format and are stored to a data acquisition server. After the single operation mode of the data acquisition server in the batch is finished, namely the test of each module on the self-service equipment is finished, the data analysis subsystem is started, and the data analysis subsystem automatically processes the acquired data. When a certain group of data or a certain index exceeds a set standard range, alarm information is automatically given to relevant personnel for analysis.
In this mode, batch defects of a certain product or a certain module can be easily found. When the function of the module has problems, the functional test cases in the test case library are detected; when the stability of the module has problems, the module may fail in sequence under the pressure test environment of a single operation mode, so that the problems can be quickly found and detected in the mode.
Preferably, the selecting, according to the transaction type, one test case available for the self-service terminal from the test case library according to a preset algorithm includes:
receiving data of business operation of a user on self-service equipment with the same transaction type as that of the self-service equipment to be tested according to a preset completely consistent operation mode, wherein the data comprises action instructions triggered by the user on the self-service equipment, parameters corresponding to the action instructions and interval time among the action instructions; sending the data to the self-service equipment to be tested, and comparing a first data result of the data running on the self-service equipment to be tested with a second data result of the data running on the self-service equipment with the same transaction type as that of the self-service equipment to be tested; if the difference value between the first data result and the second data result exceeds a preset threshold value, sending prompt information to a tester; or,
specifically, the complete consistency means that the test environment simulates the running environment, including the information and speed input by the user. If a user withdraws money from a certain self-service device, the card inserting action is not only received by the self-service device where the user is located, but also transmitted to the test platform, so that the self-service device on the test platform immediately receives a card inserting command.
In the mode, the method is mainly used for simulating and testing the use condition of the customer self-service equipment in the actual operation environment. For example, when a certain accidental problem occurs in the actual operation environment of the self-service equipment and cannot be reproduced, the real data of the client self-service equipment in the actual operation environment is acquired and processed by the data analysis subsystem, and then the automatic test is executed in the mode after the relevant data information is acquired.
In this mode, modification processing of various data is required. For example, before each transaction, card data information used by a simulation customer needs to be used, and the transaction type and the amount selected by the customer need to be simulated in the operation process; after the transaction is finished, the card data information needs to be changed again to simulate the operation of the next customer. In this mode, since the automated testing system has closely and completely simulated all operations in the actual operating environment of the self-service device, the occurrence probability of accidental and difficult-to-reproduce problems can be improved. In addition, the probability of problem recurrence can be greatly improved by using the mode to carry out simulation on batch equipment. The detailed operation log is recorded in the whole testing process, so that necessary data support is provided for solving the analysis problem.
Acquiring the probability of carrying out various different business operations and the probability of association among the businesses of the self-service equipment under the actual use environment according to a preset fuzzy matching mode; acquiring a service type with the maximum probability associated with the service type of the last test according to the service type of the last test and the probability associated between the services; sending the test case comprising the service type with the maximum probability associated with the last tested service type to the self-service terminal; or,
specifically, the number and the proportion of different transaction types are calculated according to data in an actual use environment, and the test of the corresponding proportion is randomly carried out during the test.
The first case is the probability of what service is executed when the user has executed one service and then executes the next service in the actual operating environment of the self-service device. For example, in school, after a user executes a withdrawal service, the next service executed with a 95% probability is to inquire balance, the withdrawal is continued with a 2% probability, and the card withdrawal is finished with a 3% probability.
The second case is the probability of entering the next state when the self-service device is in one state, as a finite state machine. If the self-service equipment is already in the state of sending the bank notes to the bank note outlet to wait for the user to take the bank notes, the next state is the state of successfully taking the bank note self-service equipment printing slip by the user with a probability of 90 percent, the state of successfully recycling the bank notes by the self-service equipment due to the fact that the user does not take the bank notes after overtime occurs with a probability of 7 percent, and the state of failing to recycle the bank notes by the self-service equipment due to the fact that the user does not take the bank notes after overtime occurs with a probability of 3 percent.
In order to be able to simulate this probability, the test of the self-service device software is more likely to match the statistical probability in the actual operating environment, so the test trend of the self-service device must be quantified. The test is not so much as to waste the test cost as follows: in the original state transformation of the 90% probability trend, the actual trend only appears 10% in the test, and the actual trend is seriously deviated from the actual trend, so that the expected test effect cannot be obtained.
Firstly, data of the self-service equipment operating environment are automatically collected and automatically analyzed and processed.
The method comprises the steps of collecting relevant information of an environment in which software to be tested is to be put into operation, such as user service information (such as service types of users, sequence characteristics of user-executed services, time distribution of user-executed services and the like) of the environment, input information of the users in a service process and time intervals among input actions.
Second, for each test case, a state transition diagram is constructed. When a step is executed, if various routes can be selected subsequently, one route is randomly selected for execution, and the route can be selected according to the use probability of actual operation so as to be closer to the actual operation.
For example, referring to fig. 5, fig. 5 is a transition state diagram provided by an embodiment of the present invention.
The route is as follows: a- > B (10%), A- > C (30%), A- > D (40%), A- > E (20%).
Where the test is performed to point a, using a probabilistic approach to select whether to perform B, C, D or E.
The self-service device is a finite state and ABCDE is but one state of the finite state machine. For example, ATM executes withdrawal from the initial "wait for user to insert card" state, to the "accept user card, read card data" state, and enters the "wait for user to enter password" state. . . . . And so on.
The self-service equipment executes an instruction issued by software in any stable state, and switches to another state (including a previous state), and specifically enters into which state a probabilistic event is zombie. As shown in the above figure, the probability that the self-service device switches to the state B after executing one instruction in the state a is 10%.
Again, a subsequent transaction is selected based on a given or set probability.
After the point A is executed, the principle of selecting the next execution point is selected according to the existing probability, but the principle of randomness is also required to be followed during the selection, namely the selection mode of the next execution point is random again on the basis of the probability. After a particular transaction is selected, the automated testing subsystem will then obtain the relevant data required for that transaction to perform the test.
Finally, the next point enters the processing of the mode.
If the automated testing subsystem of the self-service equipment completes the test of the point B, the entering mode of the next point needs to be recalculated, and the recalculated value is adjusted again on the basis of the second time. For example, in the upper panel, B- > A (10%), B- > B (10%), B- > C (20%), B- > D (30%), B- > E (30%).
At this time, after the execution of the point B is completed, the probability of selecting the next execution point again is changed, and meanwhile, the point B is operated to repeat the execution of the point B again after the execution is completed, under the condition of equal probability, such as B- > a and B-B, and B-D and B-E in this step, the next execution point needs to be selected according to a specified sequencing order or a random order, at this time, the probability of the unselected route is increased, and the probability of the selected route is decreased.
Acquiring preset conditions of the self-service terminal to be tested according to a preset reference set operation mode, wherein the preset conditions comprise the service types to be tested of the self-service terminal to be tested; sending test information of a single service type matched with the preset conditions to the self-service terminal to be tested; or, under the condition that the service type with the maximum probability associated with the service type of the previous test is obtained, further judging whether the service type with the maximum probability associated with the service type of the previous test matches the preset condition, if so, sending a test case including the service type with the maximum probability associated with the service type of the previous test to the self-service terminal; if not, acquiring a service type with the next ranked probability value associated with the last tested service type; or,
in particular, in some special cases, for example, some noncash transactions need not be performed on all devices in a batch, but rather only on a machine. In this case, the conditions may be artificially set, for example, the ratio of each transaction, or the mask of a particular transaction.
In this mode, the automated test execution subsystem will preferentially use the set conditions. And under the condition of meeting the set conditions, extracting the test cases from the test case library for testing according to the acquired and processed data and the obtained data information and probability. For the transaction class which is already shielded, the statistical probability value is set to be null, but the probability values of other transaction types are kept unchanged. If the transaction probability values are given, the given probability value is used as a standard. But the order of their execution points is still subject to the value of the data analysis subsystem.
Randomly selecting a test case which can be used for the self-service terminal from the test case library according to a preset random adjustment operation mode and the transaction type; if a preset problem occurs when the randomly selected test case runs on the self-service terminal to be tested, the probability of the randomly selected test case is improved; or,
specifically, in this mode, all the service types and the execution sequence of each service are completely random; in addition, in the process of random test, the adjustment is dynamically carried out according to the result in the actual test running process. For example, when a certain transaction type or a certain test case fails, even if the original proportion of the transaction or the case is low, the automatic test system automatically increases the execution proportion of the service or the case due to a fault or failure, so as to test whether the same situation occurs in other self-service devices more specifically.
In this mode, if a certain service or case passes the test, even if the original occupied ratio is higher, the ratio of re-execution of the service or case can be slowly reduced under the condition that the execution is smoothly passed. After a certain period of stable operation, automatically recovering to the original execution proportion; when a fault occurs, the execution probability of the service or case is rapidly improved.
In the mode, dynamic intelligent adjustment can be flexibly carried out according to real-time execution results of services and cases, and automatic testing can be carried out more pertinently, so that more intelligent automatic testing is realized.
And selecting a preset single module operation mode, a completely consistent operation mode, a fuzzy matching mode, a reference setting operation mode or a random adjustment operation mode according to a preset sequence or according to a random mode to select a test case which can be used for the self-service terminal.
Specifically, the operation modes may be selected according to a certain sequence or in a random manner and executed through a preset operation mode. In addition, the results in the actual execution process can be analyzed according to the preset operation results, and different operation modes are intelligently selected in a priority mode, so that more active strategy selection is realized.
EXAMPLE five
Referring to fig. 6, fig. 6 is a functional block diagram of an apparatus for automated testing according to an embodiment of the present invention.
In a fifth embodiment, the apparatus for automated testing comprises:
a first obtaining module 601, configured to obtain data of operation of a self-service device in a preset area;
preferably, referring to fig. 7, fig. 7 is a functional module schematic diagram of the first obtaining module 601 according to the embodiment of the present invention. The first obtaining module 601 includes:
a first obtaining unit 701, configured to obtain data of a service operation performed by the self-service device through network transmission, where the data includes an action instruction triggered by a user on the self-service device, a parameter corresponding to the action instruction, and an interval time between various action instructions; or,
a second obtaining unit 702, configured to obtain, through a mobile storage medium, data of performing a service operation on the self-service device encrypted according to a preset rule; or,
specifically, data of the self-service equipment running in an actual running environment is collected, so that the reality and the effectiveness of the data are ensured, and typical application scenes (namely specific places) are collected during data collection, wherein the typical application scenes comprise supermarkets, markets, communities, schools and the like;
the data of the self-service equipment running in the actual running environment of the self-service equipment is collected, namely, various signals input by a user are acquired in the execution process of the respective self-service equipment, namely, self-service parameters received by the running system are acquired, and the parameters comprise action parameters of interaction with the self-service equipment when the user inserts/takes a card, inputs a key, takes/puts a bank note, takes a receipt and the like and the interval time of each parameter when the user carries out self-service.
Furthermore, the self-service equipment is subjected to data acquisition and processing, the data acquisition system works in an equipment operation mode, and relevant data can be automatically recorded after a certain transaction is completed. When the self-service equipment meets the condition that the resource information and the hardware information of the self-service equipment are consistent with one of the machine information under the test environment, the automatic triggering data acquisition function is used for acquiring data, and the specific triggering mechanism comprises:
1a) when the self-service equipment detects that the mobile storage medium is accessed, the collected data are automatically named according to a certain rule after being encrypted and sent to the mobile storage medium.
1b) And after receiving legal control information sent by the front-end system or the monitoring system, the self-service equipment automatically transmits the acquired data to a specified test server.
And extracting data stored in different formats when the self-service equipment of different transaction types performs business operation, wherein the different transaction types comprise only withdrawal, only deposit or deposit and withdrawal integration, and the different formats comprise logs, texts, databases or preset specific formats.
The extracting unit 703 is configured to extract data stored in different formats when the self-service device of different transaction types performs business operations, where the different transaction types include only withdrawal, only deposit, or deposit and withdraw, and the different formats include logs, texts, databases, or preset specific formats.
Specifically, further, the collected self-service device data information is analyzed and processed, and the specific processing mode and mechanism include:
2a) the method can process file data types with different formats, including log files, text files, database files and files with certain specific formats;
2b) the data processing conditions can be set, and the content required by the user can be screened through combination of the conditions, such as different transaction types.
The combination of conditions herein refers to the following but is not limited to: the transaction type of the collected data, if the software to be tested does not have or provide or open the transaction, the collection of the data is abandoned; if two machines of a certain network are a deposit machine and a cash dispenser respectively, the data of the two machines are collected together and used as a test case of the software to be tested of the circulating all-in-one machine which distributes the network.
2c) The data information which is newly added can be automatically analyzed and processed, the processed data can be backed up and filed, the whole process is automatically completed, and manual intervention is not needed.
The analysis processing here refers to the consistency processing of the format of the acquired data, extracting uniform information content, and storing the information content in the database.
A sending module 602, configured to automatically generate a test case according to the data, and send the test case to the self-service device, so that the self-service device performs an automatic test according to the test case, where the test case includes test information corresponding to at least one service type to be tested;
preferably, referring to fig. 8, fig. 8 is a functional module diagram of a sending module according to an embodiment of the present invention.
The sending module 602 includes:
the judging unit 801 is configured to judge the service types to be tested included in the test case, where the service types include deposit, withdrawal, transfer, inquiry, or encryption, and the test case includes a test case formed by combining at least one service type;
a sending unit 802, configured to send the test case to a self-service device that executes the service type;
and the testing unit 803 is configured to perform a simulation test according to the obtained data corresponding to the service type and the test case, which are input by the user.
Specifically, extracting a test case in a test library, and judging the service type of the test case;
3a) executing the test case on self-service equipment provided with software to be tested capable of providing the service type, and performing simulation input on user input parameters and time intervals thereof in the process of executing the test case so as to obtain the most real test effect;
3b) and summarizing and counting the execution results of all the self-service equipment executing the test case to obtain the test report content of the test case.
A second obtaining module 603, configured to obtain a result after the automated test, and generate a test report.
Specifically, the generation of the single self-service equipment automatic test report or the generation of the batch self-service equipment automatic test report can be realized.
After the self-service equipment completes all preset test cases, the test report subsystem starts to process data collection and processing, the self-service equipment test report subsystem can generate a single self-service equipment test report according to relevant templates and settings, and sends information to a test responsible person or transmits the information to a data acquisition server according to set conditions so as to provide data for batch test reports.
After the test report of the single self-service equipment is generated and data are transmitted to the designated data acquisition server, the batch test report subsystem processes data information on all the single self-service equipment, generates a final report of all the self-service equipment in the current batch after automatic testing, and automatically transmits the final report to relevant personnel for reference in a mail mode.
The method comprises the steps of acquiring running data of the self-service equipment in a preset area; automatically generating a test case according to the data, and sending the test case to the self-service equipment so that the self-service equipment performs automatic testing according to the test case, wherein the test case comprises test information corresponding to at least one service type; the method comprises the steps of obtaining results after automatic testing, generating a test report, obtaining data under different application scenes from an actual use environment, and carrying out dynamic and intelligent adjustment testing by using a set of automatic testing system after self-service equipment is produced, so that the real situation under the actual use environment is simulated as much as possible, and the accuracy and pertinence of the testing are improved. And because manual intervention is reduced, the process of manually analyzing data is reduced, and the product quality of the self-service equipment is better guaranteed.
EXAMPLE six
Referring to fig. 9, fig. 9 is a functional block diagram of an apparatus for automated testing according to an embodiment of the present invention.
On the basis of the fifth embodiment, the apparatus further includes:
a recording module 604, configured to record a service type and card number information and/or serial number information corresponding to the service type when the user uses the self-service terminal to perform a service operation.
Specifically, the automatic testing system of the self-service equipment starts to record mark information, wherein the mark information is service information such as card number part information and serial number information which can identify service characteristics of each time and is recorded by the service system of the self-service equipment when a user using the self-service equipment performs service operation, so that data information related to the service can be conveniently and rapidly searched and searched in data stored in the automatic testing system of the self-service equipment, and the service can be conveniently subjected to statistical analysis and summary work.
EXAMPLE seven
Referring to fig. 10, fig. 10 is a functional block diagram of an apparatus for automated testing according to an embodiment of the present invention.
On the basis of the fifth embodiment, the apparatus further includes:
the storage module 605 is configured to store the test cases applicable to the self-service devices of different transaction types in the public test case library according to a preset storage method.
Specifically, a case or a case sequence can be randomly extracted from a test case library of the model to be tested according to whether the model is a circular machine, a machine is only taken or stored, and the actual operation condition is close to.
The case sequence refers to a case group formed by a group of services which are acquired in an operating environment and are sequentially carried out by deposit, withdrawal, account transfer, inquiry, secret change and the like.
If the machine type is a circulating machine type, the transaction test of withdrawing money and depositing money can be provided at the same time; if the machine type is the machine type only, only a withdrawal transaction test is provided, and a deposit transaction test is shielded; if the machine type is deposit-only type, only deposit transaction is provided and the withdrawal transaction test is shielded.
Of course, the above three models can provide other services such as encryption, inquiry, transfer, etc. in addition to depositing and withdrawing, as long as the model has and opens the services.
Selecting test cases or test case sequences of various services corresponding to the machine type according to the machine type to form a test case library of the machine type; the test cases or test case sequences suitable for all the machine types can be put into a public test case library.
Example eight
Referring to fig. 11, fig. 11 is a functional block diagram of an apparatus for automated testing according to an embodiment of the present invention.
On the basis of the fifth embodiment, the apparatus further includes:
a selecting module 606, configured to randomly select another test case from the test case library for testing after testing one test case on the self-service terminal;
referring preferably to fig. 12, fig. 12 is a functional block diagram of a selection module 606 according to an embodiment of the present invention. The selecting module 606 includes:
a judging unit 1201, configured to judge a transaction type of the self-service terminal, where the transaction type includes withdrawal only, deposit only, or deposit and withdrawal integrated;
a selecting unit 1202, configured to select, according to the transaction type, one test case that can be used for the self-service terminal from the test case library according to a preset algorithm.
Preferably, the selection unit is configured to:
sending test information for testing a single pre-stored service type to the self-service terminal according to a preset single module operation mode;
the device further comprises:
and the sending module is used for sending prompt information to a tester if the test result of testing the single pre-stored service type and the correct test result on the self-service terminal exceed a preset threshold value.
Specifically, in this mode, the individual modules are first subjected to a basic pressure test to ensure that each individual module is stable and reliable. In order to improve the execution efficiency, the tests of the single modules can be simultaneously and concurrently carried out, and the single modules do not interfere with each other. I.e. the test result of one module does not affect the test result of another module. When a certain module has a fault, other modules can also normally operate.
The running times of each module, the running result of each time and the proportion of the test passing execution are stored according to a certain format and are stored to a data acquisition server. After the single operation mode of the data acquisition server in the batch is finished, namely the test of each module on the self-service equipment is finished, the data analysis subsystem is started, and the data analysis subsystem automatically processes the acquired data. When a certain group of data or a certain index exceeds a set standard range, alarm information is automatically given to relevant personnel for analysis.
In this mode, batch defects of a certain product or a certain module can be easily found. When the function of the module has problems, the functional test cases in the test case library are detected; when the stability of the module has problems, the module may fail in sequence under the pressure test environment of a single operation mode, so that the problems can be quickly found and detected in the mode.
Preferably, the selection unit is configured to:
receiving data of business operation of a user on self-service equipment with the same transaction type as that of the self-service equipment to be tested according to a preset completely consistent operation mode, wherein the data comprises action instructions triggered by the user on the self-service equipment, parameters corresponding to the action instructions and interval time among the action instructions; sending the data to the self-service equipment to be tested, and comparing a first data result of the data running on the self-service equipment to be tested with a second data result of the data running on the self-service equipment with the same transaction type as that of the self-service equipment to be tested; if the difference value between the first data result and the second data result exceeds a preset threshold value, sending prompt information to a tester; or,
specifically, the complete consistency means that the test environment simulates the running environment, including the information and speed input by the user. If a user withdraws money from a certain self-service device, the card inserting action is not only received by the self-service device where the user is located, but also transmitted to the test platform, so that the self-service device on the test platform immediately receives a card inserting command.
In the mode, the method is mainly used for simulating and testing the use condition of the customer self-service equipment in the actual operation environment. For example, when a certain accidental problem occurs in the actual operation environment of the self-service equipment and cannot be reproduced, the real data of the client self-service equipment in the actual operation environment is acquired and processed by the data analysis subsystem, and then the automatic test is executed in the mode after the relevant data information is acquired.
In this mode, modification processing of various data is required. For example, before each transaction, card data information used by a simulation customer needs to be used, and the transaction type and the amount selected by the customer need to be simulated in the operation process; after the transaction is finished, the card data information needs to be changed again to simulate the operation of the next customer. In this mode, since the automated testing system has closely and completely simulated all operations in the actual operating environment of the self-service device, the occurrence probability of accidental and difficult-to-reproduce problems can be improved. In addition, the probability of problem recurrence can be greatly improved by using the mode to carry out simulation on batch equipment. The detailed operation log is recorded in the whole testing process, so that necessary data support is provided for solving the analysis problem.
Acquiring the probability of carrying out various different business operations and the probability of association among the businesses of the self-service equipment under the actual use environment according to a preset fuzzy matching mode; acquiring a service type with the maximum probability associated with the service type of the last test according to the service type of the last test and the probability associated between the services; sending the test case comprising the service type with the maximum probability associated with the last tested service type to the self-service terminal; or,
specifically, the number and the proportion of different transaction types are calculated according to data in an actual use environment, and the test of the corresponding proportion is randomly carried out during the test.
The first case is the probability of what service is executed when the user has executed one service and then executes the next service in the actual operating environment of the self-service device. For example, in school, after a user executes a withdrawal service, the next service executed with a 95% probability is to inquire balance, the withdrawal is continued with a 2% probability, and the card withdrawal is finished with a 3% probability.
The second case is the probability of entering the next state when the self-service device is in one state, as a finite state machine. If the self-service equipment is already in the state of sending the bank notes to the bank note outlet to wait for the user to take the bank notes, the next state is the state of successfully taking the bank note self-service equipment printing slip by the user with a probability of 90 percent, the state of successfully recycling the bank notes by the self-service equipment due to the fact that the user does not take the bank notes after overtime occurs with a probability of 7 percent, and the state of failing to recycle the bank notes by the self-service equipment due to the fact that the user does not take the bank notes after overtime occurs with a probability of 3 percent.
In order to be able to simulate this probability, the test of the self-service device software is more likely to match the statistical probability in the actual operating environment, so the test trend of the self-service device must be quantified. The test is not so much as to waste the test cost as follows: in the original state transformation of the 90% probability trend, the actual trend only appears 10% in the test, and the actual trend is seriously deviated from the actual trend, so that the expected test effect cannot be obtained.
Firstly, data of the self-service equipment operating environment are automatically collected and automatically analyzed and processed.
The method comprises the steps of collecting relevant information of an environment in which software to be tested is to be put into operation, such as user service information (such as service types of users, sequence characteristics of user-executed services, time distribution of user-executed services and the like) of the environment, input information of the users in a service process and time intervals among input actions.
Second, for each test case, a state transition diagram is constructed. When a step is executed, if various routes can be selected subsequently, one route is randomly selected for execution, and the route can be selected according to the use probability of actual operation so as to be closer to the actual operation.
For example, referring to fig. 5, fig. 5 is a transition state diagram provided by an embodiment of the present invention.
The route is as follows: a- > B (10%), A- > C (30%), A- > D (40%), A- > E (20%).
Where the test is performed to point a, using a probabilistic approach to select whether to perform B, C, D or E.
The self-service device is a finite state and ABCDE is but one state of the finite state machine. For example, ATM executes withdrawal from the initial "wait for user to insert card" state, to the "accept user card, read card data" state, and enters the "wait for user to enter password" state. . . . . And so on.
The self-service equipment executes an instruction issued by software in any stable state, and switches to another state (including a previous state), and specifically enters into which state a probabilistic event is zombie. As shown in the above figure, the probability that the self-service device switches to the state B after executing one instruction in the state a is 10%.
Again, a subsequent transaction is selected based on a given or set probability.
After the point A is executed, the principle of selecting the next execution point is selected according to the existing probability, but the principle of randomness is also required to be followed during the selection, namely the selection mode of the next execution point is random again on the basis of the probability. After a particular transaction is selected, the automated testing subsystem will then obtain the relevant data required for that transaction to perform the test.
Finally, the next point enters the processing of the mode.
If the automated testing subsystem of the self-service equipment completes the test of the point B, the entering mode of the next point needs to be recalculated, and the recalculated value is adjusted again on the basis of the second time. For example, in the upper panel, B- > A (10%), B- > B (10%), B- > C (20%), B- > D (30%), B- > E (30%).
At this time, after the execution of the point B is completed, the probability of selecting the next execution point again is changed, and meanwhile, the point B is operated to repeat the execution of the point B again after the execution is completed, under the condition of equal probability, such as B- > a and B-B, and B-D and B-E in this step, the next execution point needs to be selected according to a specified sequencing order or a random order, at this time, the probability of the unselected route is increased, and the probability of the selected route is decreased.
Acquiring preset conditions of the self-service terminal to be tested according to a preset reference set operation mode, wherein the preset conditions comprise the service types to be tested of the self-service terminal to be tested; sending test information of a single service type matched with the preset conditions to the self-service terminal to be tested; or, under the condition that the service type with the maximum probability associated with the service type of the previous test is obtained, further judging whether the service type with the maximum probability associated with the service type of the previous test matches the preset condition, if so, sending a test case including the service type with the maximum probability associated with the service type of the previous test to the self-service terminal; if not, acquiring a service type with the next ranked probability value associated with the last tested service type; or,
in particular, in some special cases, for example, some noncash transactions need not be performed on all devices in a batch, but rather only on a machine. In this case, the conditions may be artificially set, for example, the ratio of each transaction, or the mask of a particular transaction.
In this mode, the automated test execution subsystem will preferentially use the set conditions. And under the condition of meeting the set conditions, extracting the test cases from the test case library for testing according to the acquired and processed data and the obtained data information and probability. For the transaction class which is already shielded, the statistical probability value is set to be null, but the probability values of other transaction types are kept unchanged. If the transaction probability values are given, the given probability value is used as a standard. But the order of their execution points is still subject to the value of the data analysis subsystem.
Randomly selecting a test case which can be used for the self-service terminal from the test case library according to a preset random adjustment operation mode and the transaction type; if a preset problem occurs when the randomly selected test case runs on the self-service terminal to be tested, the probability of the randomly selected test case is improved; or,
specifically, in this mode, all the service types and the execution sequence of each service are completely random; in addition, in the process of random test, the adjustment is dynamically carried out according to the result in the actual test running process. For example, when a certain transaction type or a certain test case fails, even if the original proportion of the transaction or the case is low, the automatic test system automatically increases the execution proportion of the service or the case due to a fault or failure, so as to test whether the same situation occurs in other self-service devices more specifically.
In this mode, if a certain service or case passes the test, even if the original occupied ratio is higher, the ratio of re-execution of the service or case can be slowly reduced under the condition that the execution is smoothly passed. After a certain period of stable operation, automatically recovering to the original execution proportion; when a fault occurs, the execution probability of the service or case is rapidly improved.
In the mode, dynamic intelligent adjustment can be flexibly carried out according to real-time execution results of services and cases, and automatic testing can be carried out more pertinently, so that more intelligent automatic testing is realized.
And selecting a preset single module operation mode, a completely consistent operation mode, a fuzzy matching mode, a reference setting operation mode or a random adjustment operation mode according to a preset sequence or according to a random mode to select a test case which can be used for the self-service terminal.
Specifically, the operation modes may be selected according to a certain sequence or in a random manner and executed through a preset operation mode. In addition, the results in the actual execution process can be analyzed according to the preset operation results, and different operation modes are intelligently selected in a priority mode, so that more active strategy selection is realized.
The technical principle of the embodiment of the present invention is described above in conjunction with the specific embodiments. The description is only intended to explain the principles of embodiments of the invention and should not be taken in any way as limiting the scope of the embodiments of the invention. Based on the explanations herein, those skilled in the art will be able to conceive of other embodiments of the present invention without inventive step, and these embodiments will fall within the scope of the present invention.

Claims (16)

1. A method of automated testing, the method comprising:
acquiring running data of self-service equipment in a preset area;
automatically generating a test case according to the data, and sending the test case to the self-service equipment so that the self-service equipment performs automatic testing according to the test case, wherein the test case comprises test information corresponding to at least one service type;
and acquiring a result after the automatic test and generating a test report.
2. The method of claim 1, wherein the obtaining data of self-service device operation in a preset area comprises:
acquiring data of business operation of the self-service equipment through network transmission, wherein the data comprises action instructions triggered by a user on the self-service equipment, parameters corresponding to the action instructions and interval time among the action instructions; or,
acquiring data of business operation of the self-service equipment encrypted according to a preset rule through a mobile storage medium; or,
and extracting data stored in different formats when the self-service equipment of different transaction types performs business operation, wherein the different transaction types comprise only withdrawal, only deposit or deposit and withdrawal integration, and the different formats comprise logs, texts, databases or preset specific formats.
3. The method of claim 1, wherein the sending the test case to the self-service device comprises:
judging the service types to be tested, which are included in the test cases, wherein the service types comprise deposit, withdrawal, transfer, inquiry or password change, and the test cases comprise test cases formed by combining at least one service type;
sending the test case to self-service equipment executing the service type;
and carrying out simulation test according to the acquired data corresponding to the service type and the test case input by the user.
4. The method of any one of claims 1 to 3, wherein after acquiring data of self-service device operation within a preset area, further comprising:
and when the user uses the self-service terminal to carry out service operation, recording the service type and the card number information and/or the serial number information corresponding to the service type.
5. A method according to any one of claims 1 to 3, characterized in that the method further comprises:
and storing the test cases suitable for the self-service equipment of different transaction types in a public test case library according to a preset storage method.
6. The method of any one of claims 1 to 3, wherein after automatically generating a test case according to the data and sending the test case to the self-service device, the method further comprises:
after testing a test case on the self-service terminal, randomly selecting another test case from the test case library for testing;
the random selection of another test case from the test case library for testing comprises:
judging the transaction type of the self-service terminal, wherein the transaction type comprises withdrawal only, deposit only or deposit and withdrawal integration;
and selecting a test case which can be used for the self-service terminal from the test case library according to a preset algorithm according to the transaction type.
7. The method of claim 6, wherein selecting a test case from the test case library according to a preset algorithm according to the transaction type, which is available for the self-service terminal, comprises:
sending test information for testing a single pre-stored service type to the self-service terminal according to a preset single module operation mode;
the method further comprises the following steps:
and if the test result of testing the single pre-stored service type and the correct test result on the self-service terminal exceed the preset threshold value, sending prompt information to a tester.
8. The method of claim 6, wherein selecting a test case from the test case library according to a preset algorithm according to the transaction type, which is available for the self-service terminal, comprises:
receiving data of business operation of a user on self-service equipment with the same transaction type as that of the self-service equipment to be tested according to a preset completely consistent operation mode, wherein the data comprises action instructions triggered by the user on the self-service equipment, parameters corresponding to the action instructions and interval time among the action instructions; sending the data to the self-service equipment to be tested, and comparing a first data result of the data running on the self-service equipment to be tested with a second data result of the data running on the self-service equipment with the same transaction type as that of the self-service equipment to be tested; if the difference value between the first data result and the second data result exceeds a preset threshold value, sending prompt information to a tester; or,
acquiring the probability of carrying out various different business operations and the probability of association among the businesses of the self-service equipment under the actual use environment according to a preset fuzzy matching mode; acquiring a service type with the maximum probability associated with the service type of the last test according to the service type of the last test and the probability associated between the services; sending the test case comprising the service type with the maximum probability associated with the last tested service type to the self-service terminal; or,
acquiring preset conditions of the self-service terminal to be tested according to a preset reference set operation mode, wherein the preset conditions comprise the service types to be tested of the self-service terminal to be tested; sending test information of a single service type matched with the preset conditions to the self-service terminal to be tested; or, under the condition that the service type with the maximum probability associated with the service type of the previous test is obtained, further judging whether the service type with the maximum probability associated with the service type of the previous test matches the preset condition, if so, sending a test case including the service type with the maximum probability associated with the service type of the previous test to the self-service terminal; if not, acquiring a service type with the next ranked probability value associated with the last tested service type; or,
randomly selecting a test case which can be used for the self-service terminal from the test case library according to a preset random adjustment operation mode and the transaction type; if a preset problem occurs when the randomly selected test case runs on the self-service terminal to be tested, the probability of the randomly selected test case is improved; or,
and selecting a preset single module operation mode, a completely consistent operation mode, a fuzzy matching mode, a reference setting operation mode or a random adjustment operation mode according to a preset sequence or according to a random mode to select a test case which can be used for the self-service terminal.
9. An apparatus for automated testing, the apparatus comprising:
the system comprises a first acquisition module, a second acquisition module and a control module, wherein the first acquisition module is used for acquiring the running data of the self-service equipment in a preset area;
the sending module is used for automatically generating a test case according to the data and sending the test case to the self-service equipment so that the self-service equipment can automatically test according to the test case, and the test case comprises test information corresponding to at least one service type;
and the second acquisition module is used for acquiring the result after the automatic test and generating a test report.
10. The apparatus of claim 9, wherein the first obtaining module comprises:
the self-service equipment comprises a first acquisition unit, a second acquisition unit and a processing unit, wherein the first acquisition unit is used for acquiring data of business operation of the self-service equipment through network transmission, and the data comprises action instructions triggered by a user on the self-service equipment, parameters corresponding to the action instructions and interval time among the action instructions; or,
the second acquisition unit is used for acquiring data of business operation of the self-service equipment encrypted according to a preset rule through a mobile storage medium; or,
the extraction unit is used for extracting data stored in different formats when self-service equipment of different transaction types performs business operations, wherein the different transaction types comprise only withdrawal, only deposit or deposit and withdrawal, and the different formats comprise logs, texts, databases or preset specific formats.
11. The apparatus of claim 9, wherein the sending module comprises:
the judging unit is used for judging the service types to be tested, which are included in the test cases, wherein the service types comprise deposit, withdrawal, transfer, inquiry or encryption change, and the test cases comprise test cases formed by combining at least one service type;
the sending unit is used for sending the test case to self-service equipment executing the service type;
and the testing unit is used for carrying out simulation testing according to the acquired data which is input by the user and corresponds to the service type and the testing case.
12. The apparatus of any one of claims 9 to 11, further comprising:
and the recording module is used for recording the service type and the card number information and/or the serial number information corresponding to the service type when the user uses the self-service terminal to perform service operation.
13. The apparatus of any one of claims 9 to 11, further comprising:
and the storage module is used for storing the test cases suitable for the self-service equipment of different transaction types in a public test case library according to a preset storage method.
14. The apparatus of any one of claims 9 to 11, further comprising:
the self-service terminal is used for testing one test case, and then randomly selecting another test case from the test case library to test;
the selection module comprises:
the judging unit is used for judging the transaction type of the self-service terminal, and the transaction type comprises only withdrawal, only deposit or deposit and withdrawal integration;
and the selection unit is used for selecting one test case which can be used for the self-service terminal from the test case library according to a preset algorithm according to the transaction type.
15. The apparatus according to claim 14, wherein the selecting unit is configured to:
sending test information for testing a single pre-stored service type to the self-service terminal according to a preset single module operation mode;
the device further comprises:
and the sending module is used for sending prompt information to a tester if the test result of testing the single pre-stored service type and the correct test result on the self-service terminal exceed a preset threshold value.
16. The apparatus according to claim 14, wherein the selecting unit is configured to:
receiving data of business operation of a user on self-service equipment with the same transaction type as that of the self-service equipment to be tested according to a preset completely consistent operation mode, wherein the data comprises action instructions triggered by the user on the self-service equipment, parameters corresponding to the action instructions and interval time among the action instructions; sending the data to the self-service equipment to be tested, and comparing a first data result of the data running on the self-service equipment to be tested with a second data result of the data running on the self-service equipment with the same transaction type as that of the self-service equipment to be tested; if the difference value between the first data result and the second data result exceeds a preset threshold value, sending prompt information to a tester; or,
acquiring the probability of carrying out various different business operations and the probability of association among the businesses of the self-service equipment under the actual use environment according to a preset fuzzy matching mode; acquiring a service type with the maximum probability associated with the service type of the last test according to the service type of the last test and the probability associated between the services; sending the test case comprising the service type with the maximum probability associated with the last tested service type to the self-service terminal; or,
acquiring preset conditions of the self-service terminal to be tested according to a preset reference set operation mode, wherein the preset conditions comprise the service types to be tested of the self-service terminal to be tested; sending test information of a single service type matched with the preset conditions to the self-service terminal to be tested; or, under the condition that the service type with the maximum probability associated with the service type of the previous test is obtained, further judging whether the service type with the maximum probability associated with the service type of the previous test matches the preset condition, if so, sending a test case including the service type with the maximum probability associated with the service type of the previous test to the self-service terminal; if not, acquiring a service type with the next ranked probability value associated with the last tested service type; or,
randomly selecting a test case which can be used for the self-service terminal from the test case library according to a preset random adjustment operation mode and the transaction type; if a preset problem occurs when the randomly selected test case runs on the self-service terminal to be tested, the probability of the randomly selected test case is improved; or,
and selecting a preset single module operation mode, a completely consistent operation mode, a fuzzy matching mode, a reference setting operation mode or a random adjustment operation mode according to a preset sequence or according to a random mode to select a test case which can be used for the self-service terminal.
CN201510713264.6A 2015-10-28 2015-10-28 Method and device for automated test Pending CN105405221A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510713264.6A CN105405221A (en) 2015-10-28 2015-10-28 Method and device for automated test

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510713264.6A CN105405221A (en) 2015-10-28 2015-10-28 Method and device for automated test

Publications (1)

Publication Number Publication Date
CN105405221A true CN105405221A (en) 2016-03-16

Family

ID=55470685

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510713264.6A Pending CN105405221A (en) 2015-10-28 2015-10-28 Method and device for automated test

Country Status (1)

Country Link
CN (1) CN105405221A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106204042A (en) * 2016-07-20 2016-12-07 深圳怡化电脑股份有限公司 The processing method of a kind of self-aided terminal business sensitive information and system
CN107454124A (en) * 2016-05-31 2017-12-08 阿里巴巴集团控股有限公司 Equipment automatization method and device
CN108268372A (en) * 2017-07-24 2018-07-10 深圳壹账通智能科技有限公司 Mock test processing methods, device, storage medium and computer equipment
CN109324968A (en) * 2018-09-26 2019-02-12 北京奇艺世纪科技有限公司 A kind of system detection method and device
CN109766272A (en) * 2018-12-26 2019-05-17 深圳壹账通智能科技有限公司 Test method, device, terminal and the storage medium of self-service withdrawal application software
CN111435227A (en) * 2018-12-25 2020-07-21 中移(杭州)信息技术有限公司 Smart home equipment testing method, device, equipment and medium
CN111865726A (en) * 2020-07-29 2020-10-30 中国工商银行股份有限公司 Service message testing method, device, computer system and storage medium
CN111984545A (en) * 2020-09-24 2020-11-24 北京百度网讯科技有限公司 Method and device for testing stability of detection unit, electronic equipment and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101377759A (en) * 2008-08-26 2009-03-04 中国工商银行股份有限公司 Automatic interface test system
CN102184135A (en) * 2011-04-19 2011-09-14 中国工商银行股份有限公司 Instruction script based test method and system in bank system
US20110321127A1 (en) * 2001-01-19 2011-12-29 C-Sam, Inc. Transactional services
CN102937932A (en) * 2011-08-16 2013-02-20 中国银联股份有限公司 Automated testing device and method of integrated heterogeneous testing tool
CN104461863A (en) * 2014-10-29 2015-03-25 中国建设银行股份有限公司 Service system testing method, device and system
CN104572433A (en) * 2013-10-29 2015-04-29 中国银联股份有限公司 Method and device for testing financial information system
CN104866424A (en) * 2015-05-22 2015-08-26 国云科技股份有限公司 Method for designing software test cases based on scenario analysis

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110321127A1 (en) * 2001-01-19 2011-12-29 C-Sam, Inc. Transactional services
CN101377759A (en) * 2008-08-26 2009-03-04 中国工商银行股份有限公司 Automatic interface test system
CN102184135A (en) * 2011-04-19 2011-09-14 中国工商银行股份有限公司 Instruction script based test method and system in bank system
CN102937932A (en) * 2011-08-16 2013-02-20 中国银联股份有限公司 Automated testing device and method of integrated heterogeneous testing tool
CN104572433A (en) * 2013-10-29 2015-04-29 中国银联股份有限公司 Method and device for testing financial information system
CN104461863A (en) * 2014-10-29 2015-03-25 中国建设银行股份有限公司 Service system testing method, device and system
CN104866424A (en) * 2015-05-22 2015-08-26 国云科技股份有限公司 Method for designing software test cases based on scenario analysis

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107454124B (en) * 2016-05-31 2020-11-03 创新先进技术有限公司 Equipment automation method and device
CN107454124A (en) * 2016-05-31 2017-12-08 阿里巴巴集团控股有限公司 Equipment automatization method and device
CN106204042B (en) * 2016-07-20 2019-12-10 深圳怡化电脑股份有限公司 method and system for processing service sensitive information of self-service terminal
CN106204042A (en) * 2016-07-20 2016-12-07 深圳怡化电脑股份有限公司 The processing method of a kind of self-aided terminal business sensitive information and system
CN108268372A (en) * 2017-07-24 2018-07-10 深圳壹账通智能科技有限公司 Mock test processing methods, device, storage medium and computer equipment
CN109324968A (en) * 2018-09-26 2019-02-12 北京奇艺世纪科技有限公司 A kind of system detection method and device
CN109324968B (en) * 2018-09-26 2022-03-04 北京奇艺世纪科技有限公司 System testing method and device
CN111435227A (en) * 2018-12-25 2020-07-21 中移(杭州)信息技术有限公司 Smart home equipment testing method, device, equipment and medium
CN111435227B (en) * 2018-12-25 2023-07-21 中移(杭州)信息技术有限公司 Smart home equipment testing method, device, equipment and medium
CN109766272A (en) * 2018-12-26 2019-05-17 深圳壹账通智能科技有限公司 Test method, device, terminal and the storage medium of self-service withdrawal application software
CN111865726A (en) * 2020-07-29 2020-10-30 中国工商银行股份有限公司 Service message testing method, device, computer system and storage medium
CN111984545A (en) * 2020-09-24 2020-11-24 北京百度网讯科技有限公司 Method and device for testing stability of detection unit, electronic equipment and storage medium
CN111984545B (en) * 2020-09-24 2023-07-28 北京百度网讯科技有限公司 Method and device for testing stability of detection unit, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN105405221A (en) Method and device for automated test
CN112650688B (en) Automated regression testing method, associated device and computer program product
CN110245077A (en) A kind of response method and equipment of program exception
CN111160329A (en) Root cause analysis method and device
CN105374131A (en) Method and device for automatic testing
CN111752833B (en) Software quality system approval method, device, server and storage medium
CN105405220A (en) Method and device for automated test
CN110716843B (en) System fault analysis processing method and device, storage medium and electronic equipment
CN111708712A (en) User behavior test case generation method, flow playback method and electronic equipment
CN109617755B (en) Acceptance method and device of access system
CN112882957B (en) Test task validity checking method and device
CN114691903A (en) Intelligent course testing method and system, electronic equipment and storage medium
CN113900955A (en) Automatic testing method, device, equipment and storage medium
KR101684016B1 (en) Apparatus for processing a plurality of logging policy and method thereof
CN113220594B (en) Automatic test method, device, equipment and storage medium
CN111786991B (en) Block chain-based platform authentication login method and related device
CN117009381A (en) Problem list tracking method, device, electronic equipment and storage medium
CN116340187B (en) Rule engine migration test method and device, electronic equipment and storage medium
CN113238963A (en) Test report generation method, device, equipment, storage medium and program product
CN116434043A (en) Image processing method, device, equipment and storage medium
CN117371018A (en) Desensitizing method, device and system for transaction data
CN115203707A (en) Automated payment vulnerability detection system and method
CN113157498A (en) Disaster recovery system verification method and device
CN116881159A (en) Program fault processing method, device, equipment and storage medium
CN115309644A (en) Method and device for testing query page

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160316

RJ01 Rejection of invention patent application after publication