CN117499268A

CN117499268A - System test method, device, equipment and storage medium

Info

Publication number: CN117499268A
Application number: CN202310636517.9A
Authority: CN
Inventors: 向瑞曾; 蒋宁; 杨锋; 杨砚; 吴海英; 刘磊
Original assignee: Mashang Xiaofei Finance Co Ltd
Current assignee: Mashang Xiaofei Finance Co Ltd
Priority date: 2023-05-31
Filing date: 2023-05-31
Publication date: 2024-02-02

Abstract

The application provides a system testing method, a device, equipment, a computer program product and a storage medium, wherein the method comprises the following steps: responding to a system test request for a function to be tested in a voice response system, and acquiring test configuration information of the function to be tested; determining a test flow of the function to be tested according to the test configuration information, wherein the test flow of the function to be tested comprises at least one node; determining a test operation corresponding to each node; according to the node sequence among the at least one node in the test flow, test operation corresponding to each node is sequentially executed, and a test result of the corresponding node is obtained; the test result of the at least one node is sent to the display end of the voice response system, so that the display end can display the test result, and the voice response system can be automatically tested.

Description

System test method, device, equipment and storage medium

Technical Field

The present disclosure relates to the field of system testing technologies, and in particular, to a system testing method, device, equipment, and storage medium.

Background

In the related art, with the popularization of computer technology and the rapid development of mobile internet, a large number of enterprises have a strong demand for constructing call centers. The interactive voice response system (IVR, interactive Voice Response) is an important component of the call center, and by using the voice response system, the user can obtain information service all the day and night, and further the service quality can be improved. The voice response system has strong functions, and a user can complete a telephone service request by using the interactive response system based on the voice response system; the voice response system can interact with the user through an automatic flow to complete the functions of simple and clear inquiry, consultation, business handling and the like, and the whole business process is quick, clear, simple and low in cost. However, in the related art, the voice response system cannot be automatically tested, and meanwhile, a user of the voice response system cannot quickly determine whether the configuration of the voice response system is wrong, so that the problem that the voice response system cannot be accurately adjusted in time may exist, and therefore, the related art cannot guarantee the smooth operation of the voice response system.

Disclosure of Invention

In view of the foregoing, embodiments of the present application provide a system testing method, apparatus, device, computer program product, and storage medium, which not only can implement efficient testing of a voice response system; the method can also enable the user of the voice response system to quickly learn the test result of each node, and adjust the voice response system by using the test result of each node so as to ensure the normal operation of the voice response system.

The technical scheme of the embodiment of the application is realized as follows:

the embodiment of the application provides a system testing method, which comprises the following steps:

responding to a system test request for a function to be tested in a voice response system, and acquiring test configuration information of the function to be tested;

determining a test flow of the function to be tested according to the test configuration information, wherein the test flow of the function to be tested comprises at least one node;

determining a test operation corresponding to each node;

according to the node sequence among the at least one node in the test flow, test operation corresponding to each node is sequentially executed, and a test result of the corresponding node is obtained;

and sending the test result of the at least one node to a display end of the voice response system so as to display the test result through the display end.

The embodiment of the application also provides a system testing device, which comprises:

the information transmission module is used for responding to a system test request for a function to be tested in the voice response system and acquiring test configuration information of the function to be tested;

the information processing module is used for determining a test flow of the function to be tested according to the test configuration information, and the test flow of the function to be tested comprises at least one node;

the information processing module is further used for determining a test operation corresponding to each node;

the test module is used for sequentially executing the test operation corresponding to each node according to the node sequence among the at least one node in the test flow, so as to obtain the test result of the corresponding node;

the information transmission module is further configured to send a test result of the at least one node to a display end of the voice response system, so that the test result is displayed through the display end.

In some embodiments, the system test request includes a version of the test configuration information;

the information transmission module is further configured to obtain test configuration information of the function to be tested corresponding to the version from a preset configuration information base.

In some embodiments, the information processing module is further configured to search a node arrangement sequence of a test procedure of the function to be tested according to the test configuration information;

the information processing module is further used for determining each node in the test flow of the function to be tested according to the node arrangement sequence of the test flow of the function to be tested;

the information processing module is further used for determining a start node and an end node in each node in the test flow;

the information processing module is further configured to determine at least one breakpoint in each node in the test flow, where the breakpoint is a node with a breakpoint identifier, and is configured to send a test result of the breakpoint to a display end of the voice response system;

the information processing module is further configured to connect the start node, the breakpoint, the node other than the breakpoint, and the end node in series to obtain a test flow of the function to be tested.

In some embodiments, the information processing module is further configured to obtain a node type identifier of each of the nodes;

the information processing module is further used for determining the node type of each node according to the node type identifier;

The information processing module is further used for searching a preset test operation content table according to the node type of each node to obtain test operation corresponding to the node type of each node.

In some embodiments, the test module is further configured to initialize test data of all nodes in the test flow to obtain initialized test data;

the test module is further used for executing the test operation corresponding to the start node according to the initialization test data matched with the test operation corresponding to the start node to obtain a test result of the start node; the starting node is the first node in the test flow;

the test module is further used for acquiring a test result of an N-1 node adjacent to and before the N node aiming at the N node in the plurality of nodes;

the test module is further used for executing test operation corresponding to the Nth node according to the test result of the N-1 th node to obtain the test result of the Nth node; n is an integer greater than 1.

In some embodiments, the function to be tested comprises a speaking function of a voice response system;

The test module is further configured to obtain an execution condition of a voice operation test operation corresponding to at least one first type node under the condition of testing a voice operation function of the voice response system, where the first type node is a node for testing the voice operation function of the voice response system;

and the test module is further used for traversing the plurality of nodes, if the Nth node is the first type node, executing the session test operation corresponding to the Nth node according to the test result of the N-1 th node and the execution condition of the session test operation corresponding to the Nth node, and obtaining the session test result of the Nth node.

In some embodiments, the function to be tested comprises an audio function of a voice response system;

the test module is further configured to obtain an execution condition of an audio test operation corresponding to at least one second class node under the condition of testing an audio function of the voice response system, where the second class node is a node for testing the audio function of the voice response system;

and the test module is further used for traversing the plurality of nodes, and if the Nth node is the second class node, executing the audio test operation corresponding to the Nth node according to the test result of the N-1 th node and the execution condition of the audio test operation corresponding to the Nth node to obtain the audio test result of the Nth node.

In some embodiments, the function to be tested comprises an interface function of a voice response system;

the test module is further configured to obtain an execution condition of a node test operation corresponding to at least one third class node under the condition that an interface function of the voice response system is tested, where the third class node is a node for testing the interface function of the voice response system;

and the test module is further used for traversing the plurality of nodes, and if the Nth node is the third class node, executing the node test operation corresponding to the Nth node according to the test result of the N-1 th node and the execution condition of the node test operation corresponding to the Nth node to obtain the node test result of the Nth node.

In some embodiments, the information transmission module is further configured to send a test result of the node to a display end of the voice response system when the test result of the node characterizes that the test is passed;

the information processing module is further used for acquiring node information of the node, repairing suggestions and repairing schemes of the test result under the condition that the test result of the node represents that the test fails;

The information transmission module is further configured to send node information of the node, a test result of the node, a repair suggestion and a repair scheme of the test result to a display end of the voice response system.

In some embodiments, the information processing module is further configured to obtain test data of the node and execution conditions of a test operation;

the information processing module is also used for detecting the correctness of the test data of the node to obtain a detection result of the test data;

the information processing module is further used for detecting correctness of the execution conditions of the nodes to obtain detection results of the execution conditions;

the information processing module is further used for determining a repair proposal and a repair scheme of the test result according to the detection result of the test data and the detection result of the execution condition.

In some embodiments, the information processing module is further configured to determine, as a target node, a node adjacent to and before the assertion node in the test flow if any of the nodes is the assertion node;

the information processing module is further used for acquiring target test data of the target node and target execution conditions of target test operation of the target node;

The information processing module is further used for detecting the branch configuration logic of the target node according to the target test data of the target node and the target execution conditions to obtain a branch configuration logic detection result;

the information processing module is further configured to determine a modification scheme of the branch configuration logic of the target node according to a detection result of the branch configuration logic, so as to modify the branch configuration logic of the target node through the modification scheme of the branch configuration logic of the target node.

The embodiment of the application also provides electronic equipment, which comprises:

a memory for storing executable instructions;

and the processor is used for realizing the system testing method of the preamble when running the executable instructions stored in the memory.

The embodiment of the application also provides a computer readable storage medium which stores executable instructions, and is characterized in that the executable instructions realize the system testing method of the preamble when being executed by a processor.

The embodiment of the application also provides a computer program product, which comprises a computer program or instructions, and is characterized in that the computer program or instructions realize the system testing method of the preamble when being executed by a processor.

The embodiment of the application has the following beneficial effects:

1) According to the method and the device, a test flow of a function to be tested is determined according to test configuration information, so that test operation corresponding to each node is sequentially executed according to the node sequence between at least one node in the test flow, and a test result of the corresponding node is obtained; therefore, different functions to be tested in the voice response system can be efficiently and accurately tested, accurate test results are obtained, the accuracy of the functions to be tested in the voice response system is ensured, and automatic testing of the voice response system can be realized.

2) The test result of at least one node is sent to the display end of the voice response system, so that the test result can be displayed through the display end, a user of the voice response system can timely acquire the test result, the voice response system can be adjusted by using the test result of each node, and the normal operation of the voice response system is ensured.

Drawings

Fig. 1 is a schematic view of a usage scenario of a system testing method according to an embodiment of the present application;

FIG. 2 is a schematic flow chart of an alternative system testing method according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram illustrating a configuration effect of test configuration information of a function to be tested in an embodiment of the present application;

fig. 4 is a schematic configuration effect diagram of test configuration information of a function to be tested in the embodiment of the present application;

FIG. 5 is a schematic flow chart of an alternative system testing method according to an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of an alternative configuration of the session information in an embodiment of the present application;

FIG. 7 is a schematic diagram of another alternative configuration of the session information in an embodiment of the present application;

FIG. 8 is a schematic diagram of yet another alternative configuration of the session information in an embodiment of the present application;

FIG. 9 is a schematic diagram illustrating the operation of the voice response system according to the embodiment of the present application;

FIG. 10 is a schematic flow chart of another alternative system testing method according to an embodiment of the present disclosure;

FIG. 11 is a schematic flow chart of another alternative system testing method according to an embodiment of the present disclosure;

fig. 12 is a schematic structural diagram of an electronic device for performing a system test method according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the present application will be described in further detail with reference to the accompanying drawings, and the described embodiments should not be construed as limiting the present application, and all other embodiments obtained by those skilled in the art without making any inventive effort are within the scope of the present application.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is to be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments and can be combined with one another without conflict.

Before describing embodiments of the present application in further detail, the terms and terminology involved in the embodiments of the present application will be described first, and the terms and terminology involved in the embodiments of the present application are suitable for the following explanation.

1) In response to a condition or state that is used to represent the condition or state upon which the performed operation depends, the performed operation or operations may be in real-time or with a set delay if the condition or state upon which it is dependent is satisfied; without being specifically described, there is no limitation in execution of the sequential flow of operations performed.

2) Call Center (Call Center): places where contacts and transactions are interacted with by telephone, such as services, sales, emergency events, etc., may also include manual services, self-service, etc.

3) And (3) intelligent test: by running the process in real time, process configuration personnel are helped to diagnose and solve errors in configuration, so that configuration efficiency and quality are improved.

4) Access number: a called number; calling number: a calling number.

5) Free switch: a cross-platform open source telephone exchange platform has strong scalability. In the embodiment of the application, the method can be responsible for providing route and interconnection communication for audio, text or any other form of media, and providing self-service voice response service and intelligent robot service; providing APIs and APPs to computer telephony integration (Computer Telecommunication Integration, CTI) middleware calls (e.g., make a call, bridge a channel, hang up a call, etc.); sending ESL event to CTI to complete automatic call distribution (Automatic Call Distribution, ACD), agent state switching, data report statistics, etc.

6) A voice response system: the customer can enter the IVR service center by calling the enterprise hotline number through the telephone, and the customer can listen to the mobile phone entertainment product according to the operation prompt in the voice response system, and can play the related information according to the input content. And further realize the handling of some simple services or guide the client to transfer to the manual seat. On the other hand, the pressure of the artificial seat can be reduced to a certain extent.

7) CTI middleware: the system is mainly communicated with freeswitch, IVR and a seat workbench, receives ESL events (such as channel_ANSER, channel_BRIDGE and the like) from a fresh system to switch the seat states, counts data reports, and sends related websocket messages to inform the seat workbench to switch the seat turntable. Receive custom ESL events (e.g., find agent, enter IVR) from IVR, etc. to perform seat ACD, etc.

8) Agent (Agent): the seat or seat representative or artificial seat is generally composed of a seat computer, seat software, seat headset, service personnel and the like. The call center seat realizes the relevant control function through seat software and hardware equipment so as to achieve the purpose of customer service.

9) Skill set: one skill set may include at least one agent, and illustratively, non-passing skill sets may be classified according to service type, for example, in the case of a bank call system, credit card services and savings card services may correspond to different skill sets, respectively, so that voice calls for different services may be received through agents of different skill sets.

10 VOS gateway): one end of the relevance component is connected with the call center system, and the other end is connected with the operator line, which is independent of the call center system, is a bridge for establishing communication between the call center system and the PSTN network and is mainly responsible for line management and call routing strategy configuration. Operator gateway: the system is used for interfacing with various large operator lines, and is a link for establishing communication between a call center and a PSTN network.

The inventor finds that in the research process, although the important component of the call center of the interactive voice response system provided in the related technology can realize that the user can use the interactive voice response system based on the voice response system to complete the telephone service request, the related technology cannot test the voice response system, and meanwhile, the user of the voice response system cannot quickly know whether the configuration of the voice response system is wrong, so that the smooth operation of the voice response system cannot be ensured.

In order to solve the above-mentioned drawbacks of the related art, the present application provides a system testing method, referring to fig. 1, fig. 1 is a schematic view of a usage scenario of the system testing method provided in the embodiment of the present application, and an electronic device 100 may include two different types of terminals or electronic devices, namely, a terminal 10-1 and a terminal 10-2, and a target object may be selected according to a usage requirement. The terminals 10-1 and 10-2 are provided with programs capable of performing voice information interaction with the interactive voice response system, for example, a call program.

The terminal 10-1 and the terminal 10-2 are connected to the server 200 through the network 300, the network 300 may be a communication network provided by a wide area network, a local area network and a telecom operator, or any combination of the three, and communication data transmission is realized by using a wireless link or a wired link, wherein an interactive voice response system can be deployed in the server 200, and the interactive voice response system can provide a powerful telephone automatic service function, which is mainly applied to a customer service Call Center (Call Center) of an enterprise. The system guides the user to reach a specific path of consultation by providing a function of carrying out menu navigation for the client and through a voice menu and a key menu. For example, financial institutions use voice response systems to enable automated financial services promotion and sales of financial products to reduce labor costs; the financial institution may also use the voice response system to automatically provide prompt services such as borrowing and repayment notification, and default risk notification, to provide accurate information notification services to the user. Because the telephone traffic of the call center is very large and high concurrency exists, in order to ensure long-time stable operation of the voice response system, accurate test of all functions to be tested in the voice response system is required, and reliability and accuracy of the functions to be tested in the voice response system after being on line are ensured.

Referring to fig. 2, fig. 2 is an optional flowchart of a system testing method provided by the embodiment of the present application, where the embodiment of the present application may be implemented in combination with Cloud technology (Cloud technology) refers to a hosting technology that unifies serial resources such as hardware, software, and networks in a wide area network or a local area network, so as to implement calculation, storage, processing, and sharing of data, and may also be understood as a generic term of network technology, information technology, integration technology, management platform technology, application technology, and the like applied based on a Cloud computing business model. Background services of technical network systems require a large amount of computing and storage resources, such as video websites, picture websites and more portal websites, so cloud technologies need to be supported by cloud computing.

It should be noted that cloud computing is a computing mode, which distributes computing tasks on a resource pool formed by a large number of computers, so that various application systems can acquire computing power, storage space and information service as required. The network that provides the resources is referred to as the "cloud". Resources in the cloud are infinitely expandable in the sense of users, and can be acquired at any time, used as needed, expanded at any time and paid for use as needed. As a basic capability provider of cloud computing, a cloud computing resource pool platform, referred to as a cloud platform for short, is generally called infrastructure as a service (IaaS, infrastructureasa Service), and multiple types of virtual resources are deployed in the resource pool for external clients to select for use. The cloud computing resource pool mainly comprises: computing devices (which may be virtualized machines, including operating systems), storage devices, and network devices. And giving different operation rights to the target object subjected to data processing through the cloud server.

Cloud storage (cloud storage) is a new concept that extends and develops in the concept of cloud computing, and a distributed cloud storage system (hereinafter referred to as a storage system for short) refers to a storage system that integrates a large number of storage devices (storage devices are also referred to as storage nodes) of various types in a network to work cooperatively through application software or application interfaces through functions such as cluster application, grid technology, and a distributed storage file system, so as to provide data storage and service access functions for the outside. In the related art, the storage method of the storage system is as follows: when creating logical volumes, each logical volume is allocated a physical storage space, which may be a disk composition of a certain storage device or of several storage devices. The client stores data on a certain logical volume, that is, the data is stored on a file system, the file system divides the data into a plurality of parts, each part is an object, the object not only contains the data but also contains additional information such as a data Identification (ID) and the like, the file system writes each object into a physical storage space of the logical volume, the file system records storage position information of each object, and from the condition that the client requests to access the data, the file system can enable the client to access the data according to the storage position information of each object. The process of allocating physical storage space for the logical volume by the storage system specifically includes: physical storage space is divided into stripes in advance according to the set of capacity measures for objects stored on a logical volume (which measures tend to have a large margin with respect to the capacity of the object actually to be stored) and redundant array of independent disks (RAID, redundant Array of Independent Disk), and a logical volume can be understood as a stripe, whereby physical storage space is allocated for the logical volume. By executing the system test method provided by the application, the test results of the corresponding nodes can be stored in the cloud server, so that the test results can be conveniently checked, and meanwhile, the repair suggestions and repair schemes of the test results can be stored in the cloud server, so that a user of the voice response system can conveniently and remotely control the voice response system through data in the cloud server.

It will be understood that the execution body of the steps shown in fig. 2 may be implemented by a terminal or a server running a system testing device, or may be implemented by a terminal and a server cooperatively, or may be implemented by a cloud server or a cloud server cluster cooperatively, where the server implementation is illustrated as an example, and specifically includes the following steps:

step 201: and responding to a system test request for the function to be tested in the voice response system, and acquiring test configuration information of the function to be tested.

In some embodiments, the function to be tested in the voice response system can be flexibly adjusted according to the use environment of the voice response system, so as to meet the requirement of the use environment of the voice response system, for example: when the function to be tested is a voice function, the suitability of voice information configured by the voice response system can be detected; when the financial product is recommended, waiting conversation information corresponding to the target object grade can be obtained according to the target object grade corresponding to the seat. For example, if the target object level is level 1, obtaining a waiting conversation 1 corresponding to the target object level 1; and if the target object grade is grade 2, acquiring a waiting conversation 2 corresponding to the target object grade 2, wherein the conversation content of the waiting conversation 1 is different from that of the waiting conversation 2.

In some embodiments, the system test request includes a version of test configuration information, the test configuration information of the function to be tested corresponding to the version may be obtained from a preset configuration information base, referring to fig. 3, fig. 3 is a schematic configuration effect diagram of the test configuration information of the function to be tested in the embodiment of the present application, and as shown in fig. 3, the test configuration information may be configured in advance by a tester of the voice response system, and may be stored in a server running the voice response system or a cloud server connected to the voice response system. For example, in the test of the speaking information and the voice information, the configuration of the test flow may be performed in the configuration manner shown in fig. 3, that is, the corresponding test flow is configured as follows: step 301, variable assignment; step 302, playing back; step 303, obtaining a test result.

In some embodiments, as shown in fig. 3, when the test configuration information may be configured in advance by a tester of the voice response system, a corresponding control component may also be set, where the control components are respectively: the control component 304 is configured to trigger a next node, and the control component 305 is configured to trigger a next breakpoint, and the control component 306 is configured to issue a test ending control instruction, and to perform a test operation indicated by a node corresponding to the corresponding control component after the corresponding control component is triggered.

Referring to fig. 4, fig. 4 is a schematic configuration effect diagram of test configuration information of a function to be tested in the embodiment of the present application, as shown in fig. 4, in a variable assignment stage, different initial values may be given to variables according to different functions to be tested in an area 401, for example, in a test of speech information and voice information, corresponding speech information and voice information need to be selected for an access number and a calling number of a voice response system to talk with corresponding access number users and calling number users, where a communication channel established by a terminal of an access number and the voice response system may be a first calling channel, and by the configuration shown in fig. 4, at least one channel variable may be obtained in the first calling channel, where the channel variable may include an access number (destination_number); the communication channel established by the terminal of the calling number and the voice response system may be the first calling channel.

In some embodiments, the communication channel established by the terminal of the calling number and the voice response system may be a second call channel, and through the configuration shown in fig. 4, at least one channel variable may be acquired in the second call channel, where the channel variable may include the calling number (caller_id_number)).

In some embodiments, in the variable assignment stage, according to the function to be tested, the coding mode of the variable may be adjusted in the area 402, the classification mode of the variable may be adjusted in the area 403, the description information of the variable may be adjusted in the area 404, and the processor of the configuration information may record in the area 405.

Step 202: and determining a test flow of the function to be tested according to the test configuration information, wherein the test flow of the function to be tested comprises at least one node.

In some embodiments, determining a test flow of a function to be tested according to test configuration information may be implemented by:

firstly, according to the test configuration information, inquiring a plurality of nodes in a test flow of the function to be tested; for example: the function to be tested is a speaking function, and at this time, according to the test configuration information, a plurality of nodes in a test flow of the function to be tested are queried as follows: playback node, playback receiving node, write channel variable node, and special skill group node. The method for determining the nodes in the test flow of the speaking function according to the node arrangement sequence comprises the following steps: in the nodes a, b, c, d, a (playback node), b (playback receiving node), c (write channel variable node), d (special skill group node), and play speech information.

Then, determining the node positions of a start node, an end node and each other node in the test flow in the plurality of nodes; the other nodes are nodes except the starting node and the ending node, and the number of the other nodes is at least one; in combination with the above embodiment, the node a is a start node in the session functional test flow, and the node d is an end node in the session functional test flow.

In some embodiments, at least one breakpoint is determined in at least one other node, where a "breakpoint" is a node specified by a tester and having a breakpoint identifier, where at least one breakpoint may be set in all nodes in the test flow, and when node a is a non-breakpoint, a test result of node a may not be sent to a display end of the voice response system, and when node a is set as a breakpoint, a test result of node a will be forced to be sent to the display end of the voice response system.

In some embodiments, in the case that any node is a breakpoint, the test result of the corresponding node needs to be sent to the display end of the voice response system; the breakpoint is a node with a breakpoint mark and is used for sending a test result of the breakpoint to a display end of the voice response system; in combination with the above embodiment, the test result of the node c (write channel variable node) and the test result of the node d (special skill set node, performing the playing of the speech information) are sent to the display end of the speech response system, and if the user performing the test wishes to display the test result of the node b in the display end of the speech response system, the node b is set as a breakpoint; if the user who performs the test wishes to display the test result of the node a in the display end of the voice response system, the node a is set as a breakpoint, and the method of setting the node as the breakpoint is not particularly limited in the application.

And finally, connecting the plurality of nodes in series according to the node positions of the starting node, the breakpoint, the other nodes and the ending node to form a test flow of the function to be tested. In combination with the above embodiment, when the function to be tested is a voice function, the nodes in the test flow are a (playback node), b (playback receiving node), c (write channel variable node, showing the value written by the front end), d (special skill set node, executing voice information playing) in sequence.

Step 203: and determining the corresponding test operation of each node.

In some embodiments, determining the test operation corresponding to each node may be implemented by:

acquiring a node type identifier of each node; determining the node type of each node according to the node type identification; searching a preset test operation content table according to the node type of each node to obtain a test operation corresponding to the node type of each node. The voice response system is characterized in that the types of functions to be tested of the voice response system are limited, so that the test operation of the test nodes required by all the functions to be tested of the voice response system can be summarized to a preset test operation content table, and the preset test operation content table is stored in a server for deploying the voice response system or a cloud server connected with the voice response system.

In some embodiments, the functionality to be tested of the voice response system may be: the speech function test, the voice function test and the interface function test are examples, and the types of the related nodes can include: playback node, playback receiving node, interface calling system node, reading channel variable node, writing channel variable node, variable assignment node, service time node, working time node, hash shunting node, display shunting judgment result, white list shunting node and special skill group node.

The test operation corresponding to each node type includes:

1. playback node: broadcasting a section of audio configured by the current node, and judging whether the audio is continuously played; 2. playback and number receiving nodes: playing a section of audio configured by the current node, inputting a desired number on a page, judging whether the audio is continuously played, and judging whether the input number is received; 3. interface call is node: displaying the called result and the written parameters, judging whether the calling can be performed or not, and judging whether the input parameters are received or not; 4. read channel variable node: inputting data to be read into a page, and judging whether the data can be read; 5. write channel variable node: the value to be written is displayed. Judging whether the corresponding value can be written or not; 6. variable assignment node: displaying an object to be assigned and a specific value, and judging whether corresponding information can be displayed or not; 7. service time node: displaying the judging result, judging whether the judging result can be obtained or not; 8. operating time node: displaying the judging result, judging whether the judging result can be obtained or not; 9. hash shunting node: displaying the result of the shunt judgment, judging whether the shunt judgment can be executed or not; 10. white list splitting node: displaying a shunt judgment result, and judging that a judgment result can be obtained is received; 11. special skill group node: displaying the skill group name, playing the transfer phone and playing the transfer waiting sound, judging whether the skill group name can be displayed, and judging whether the phone information and the transfer waiting sound can be continuously played.

Step 204: and according to the node sequence among at least one node in the test flow, sequentially executing the test operation corresponding to each node to obtain the test result of the corresponding node.

In some embodiments, in the case that there is only one node in the test flow, the test operation corresponding to the node is executed, so that the test result of the node can be obtained, for example: and only one variable assignment node is arranged in the test flow and is used for performing assignment on all variables in the test of the voice response system, and at the moment, the variable assignment operation corresponding to the node is performed to obtain the test result of the node (namely, the assignment result of all variables in the test of the voice response system).

In some embodiments, when the test flow includes a plurality of nodes, the test result of the corresponding node is obtained, which may be implemented by the following manner:

initializing test data of all nodes in the test flow to obtain initialized test data; according to the initialization test data matched with the test operation corresponding to the starting node, executing the test operation corresponding to the starting node to obtain a test result of the starting node; the start node is the first node in the test flow; aiming at an Nth node in a plurality of nodes, acquiring a test result of an N-1 th node which is adjacent to the Nth node and is positioned in front of the Nth node; according to the test result of the N-1 th node, executing the test operation corresponding to the N-th node to obtain the test result of the N-th node; n is an integer greater than 1. For example: when the function to be tested is a speaking function, the nodes in the test flow are a (playback node), b (playback receiving node), c (write channel variable node, showing the value written by the front end), d (special skill group node) in sequence, and the speaking information playing is executed; the test data of all nodes in the test flow can be derived from the pre-configured speaking information and voice information, and the pre-configured speaking information and voice information of all nodes a, b, c, d in the test flow are initialized to obtain initialized speaking information and voice information; the test operation of the node a is to play voice information welcome to the call XXXX, manual consultation selection is 1, self-service processing selection is 2", the node b is used as the 2 nd node in 4 nodes, the test operation corresponding to the 2 nd node b is required to be executed according to the test result of the 1 st node a, and the test result of the 2 nd node b is obtained, namely if the voice information welcome to the call XXXX, manual consultation selection is 1, self-service processing selection is 2, and normal playback can be performed, the test operation corresponding to the 2 nd node b is executed; if the voice message is welcome to the electricity XXXX, the manual consultation selection is pressed 1, the self-service processing selection is pressed 2, and normal playback cannot be performed, and the test operation corresponding to the 2 nd node b is paused.

In some embodiments, the node c is used as the 3 rd node in the 4 th nodes, the test operation corresponding to the 3 rd node c is required to be executed according to the test result of the 2 nd node b, the test result of the 3 rd node c is obtained, the test operation of the node b is "select key information, select the service provided for you"; i.e. if a selection instruction of key 1 or a selection instruction of key 2 is received, a test operation corresponding to node c of 3 is performed.

In order to better illustrate the testing process of the nth node in the testing method provided by the application, the following describes the testing process of the nth node by taking a speech function test, a voice function test and an interface function test as examples.

Referring to fig. 5, fig. 5 is an optional flowchart of a system testing method provided in the embodiment of the present application, where it may be understood that an execution body of the steps shown in fig. 5 may be implemented by a terminal or a server running a system testing device, or may be implemented by a terminal and a server cooperatively, or may be implemented by a cloud server or a cloud server cluster cooperatively, which is illustrated by taking a server implementation as an example, and specifically includes the following steps:

Step 501: under the condition of testing the voice operation function of the voice response system, the execution condition of the voice operation test operation corresponding to at least one first type node is obtained, wherein the first type node is used for testing the voice operation function of the voice response system.

In some embodiments, through the processing of step 501, an execution condition of a session test operation corresponding to at least one first class node is obtained. For example, in the case where the number of the first type nodes is 1, the execution condition of the obtained session test operation may be: the talk information "i am phone channel supports business handling and complaint advice, please say that the service to be provided for you can be played in its entirety". In the case that the number of the first class nodes is 2, the execution condition of the obtained session test operation may be: 1) Find the payroll date of the user, 2) play the ticket information in its entirety "whether a balance needs to be queried" or "please select a service category".

In some embodiments, the function to be tested includes a voice response system voice function, referring to fig. 6, fig. 6 is an optional configuration schematic diagram of voice information in the embodiment of the present application, as shown in fig. 6, a number of the voice information may be configured in a region 601, contents of the voice information may be configured in a region 602, classification of the voice information may be configured in a region 603, a tester of the voice information may be configured in a region 604, and a test time of the voice information may be recorded in a region 605.

Different pieces of speaking information can be configured according to the identification of the speaking information, and the speaking information of the recommended service is played for the user by taking the application of the voice response system to the service recommendation environment as an example. That is, if the users are different, the recommended services may be different in terms of the speaking information. As an example, when determining that user a pays 10 days a month using the query interface of the voice response system, user a calls into the voice response system on 10 days 1 month, and the speaking information of the recommended service is: whether a balance need to be queried. Determining that a user B sends wages 11 days per month by utilizing a query interface of the voice response system, and calling the voice response system by the user B on 1 month and 10 days, wherein the speaking information of recommended services is as follows: whether a financial product needs to be purchased.

In some embodiments, in order to improve the service processing efficiency of the voice response system and reduce the error probability of the speaking information, the speaking information of the same recommended service of different users may be unified, for example: determining 10 days per month wages of the users A and B by utilizing a query interface of the voice response system, and calling the voice response system by the users A and B on 10 days per month of 1 month, wherein the speaking information of recommended services is as follows: the user is your own, whether the balance needs to be queried.

In some embodiments, when the first recommended service session information is not further instructed by the user or the user instructs other services to respond, the next recommended service session information may be played to the user, where the session test execution condition in the node is that session information is played at least twice in succession.

Step 502: traversing the plurality of nodes, if the Nth node is the first type node, executing the session test operation corresponding to the Nth node according to the test result of the N-1 th node and the execution condition of the session test operation corresponding to the Nth node, and obtaining the session test result of the Nth node.

In some embodiments, by traversing a plurality of nodes in the test flow, determining that the node that needs to perform the session function test is node N, and because the test operation of node N needs to depend on the test result of node N-1, according to the test result of node N-1 and the execution condition of the session test operation corresponding to node N, the session test operation corresponding to node N is performed, so that the test result of node N, that is, the test result of session test, can be obtained.

In some embodiments, in step 502, when the function to be tested is a voice function, the nodes in the test flow are a (playback node), b (playback receiving node), c (write channel variable node, showing the value written by the front end), d (special skill set node, performing voice information playing); in some embodiments, the node d is the 4 th node of the 4 th nodes, and according to the test result of the 3 rd node c, a speaking test operation corresponding to the 4 th node d is required to be executed, so as to obtain the test result of the 4 th node d, and the test operation of the node c is "input a selection instruction, and selects a service provided for you"; if a key selection instruction is received, performing a voice test operation corresponding to the 4 th node, playing voice information, and determining that the test result of the node d passes the voice function test under the condition that the voice information can be smoothly played, or determining that the test result of the node d fails the voice function test under the condition that the voice information cannot be smoothly played and at least one time of blocking occurs.

Step 503: under the condition of testing the audio function of the voice response system, the execution condition of the audio test operation corresponding to at least one second type node is obtained, wherein the second type node is a node for testing the audio function of the voice response system.

In some embodiments, the processing of step 503 obtains the execution condition of the audio test operation corresponding to the at least one second class node. For example, in the case where the number of the second class nodes is 1, the execution condition of the acquired audio test operation may be: the audio information "functional description of english version" can be played completely.

In some embodiments, in the case that the number of the second class nodes is 2, the execution condition of the acquired audio test operation may be: 1) Searching the number attribution of the calling account of the voice response system, and 2) completely playing the function description (such as English version function description or Japanese version function description) corresponding to the number attribution.

In some embodiments, the functions to be tested include an audio function of a voice response system, referring to fig. 7, fig. 7 is a schematic diagram of another alternative configuration of audio information in the embodiment of the present application, as shown in fig. 7, a number of the audio information may be configured in a region 701, a content of the audio information may be configured in a region 702, a classification of the audio information may be configured in a region 703, a tester of the audio information may be configured in a region 704, and a test time of the audio information may be recorded in a region 705.

As shown in fig. 7, different audio information may be configured according to the identification of the audio information, and taking the application of the voice response system to the service recommendation environment as an example, the audio information of the recommended service is played for the user. That is, the number attribution of the calling number of the voice response system is different, and the audio information of the recommended service may be different. As one example, with the audio information configuration shown in fig. 7, audio information of different languages (including, but not limited to, english, mandarin, cantonese, japanese) may be selected.

Step 504: traversing the plurality of nodes, if the Nth node is the second class node, executing the audio test operation corresponding to the Nth node according to the test result of the N-1 th node and the execution condition of the audio test operation corresponding to the Nth node, and obtaining the audio test result of the Nth node.

In some embodiments, by traversing a plurality of nodes in the test flow, determining that the node that needs to perform the audio function test is node N, and because the test operation of node N needs to depend on the test result of node N-1, executing the audio test operation corresponding to the nth node according to the test result of the nth node and the execution condition of the audio test operation corresponding to the nth node can obtain the test result of the nth node, that is, the test result of the audio test, where the execution condition of the audio test operation may include at least three cases:

1) And the audio information in the test data is smoothly played without blocking.

2) When playing the audio information in the test data, no voice error of the corresponding language occurs, for example: chinese mispronounces and English words mispronounces.

3) No word order error of the corresponding language occurs when playing the audio information in the test data, for example: inverted sentences of Chinese (inconvenient for users to understand), tense errors of English sentences.

In some embodiments, in step 504, when the function to be tested is an audio function, the nodes in the test flow are a (playback node), b (playback receiving node), c (write channel variable node, showing the value written by the front end), d (special skill set node), and playing audio information in sequence; in some embodiments, the node d is the 4 th node of the 4 th nodes, and according to the test result of the 3 rd node c, an audio test operation corresponding to the 4 th node d is required to be executed, so as to obtain the test result of the 4 th node d, and the test operation of the node c is "input a selection instruction, and selects a service provided for you"; if a key selection instruction is received, executing the audio test operation corresponding to the 4 th node, and playing the audio information.

Step 505: under the condition of testing the interface function of the voice response system, the execution condition of the node testing operation corresponding to at least one third type of node is obtained, wherein the third type of node is used for testing the interface function of the voice response system.

In some embodiments, the processing of step 505 obtains the execution condition of the session testing operation corresponding to the at least one third class node. Examples may include:

in the case where the number of the third class nodes is 1, the execution condition of the acquired interface test operation may be: the normal call interface 1 inquires about the payroll date of the calling number user (vip user, without obtaining user identification) of the voice response system to make a corresponding speaking information recommendation.

In some embodiments, in the case that the number of the second class nodes is 2, the execution condition of the acquired interface test operation may be: 1) Searching the user identification of the calling account number of the voice response system, 2) normally calling the interface 1 to inquire the wage issue date (the common user needs to acquire the user identification) of the calling number user of the voice response system. In some embodiments, the function to be tested includes an interface function of the voice response system, referring to fig. 8, fig. 8 is a schematic diagram of still another alternative configuration of interface information in the embodiment of the present application, as shown in fig. 8, a number of audio information may be configured in a region 801, an interface name may be configured in a region 802, an interface path may be configured in a region 803, a tester of interface information may be configured in a region 805, and a test time of interface information may be recorded in a region 806.

In some embodiments, as shown in fig. 8, different interface information may be configured according to the identification of the interface information, and taking the application of the voice response system to the service recommendation environment as an example, the interface information of the recommended service is played for the user. That is, if the number attribution of the calling number of the voice response system is different, interface information used for the recommended service may be different. As one example, with the interface information configuration shown in fig. 8, different types of user information query interface information (including, but not limited to, the user account information query interface, the user identity information query interface shown in fig. 8) may be selected.

Step 506: traversing the plurality of nodes, if the Nth node is a third class node, executing the node test operation corresponding to the Nth node according to the test result of the N-1 th node and the execution condition of the node test operation corresponding to the Nth node, and obtaining the node test result of the Nth node.

In some embodiments, by traversing a plurality of nodes in the test flow, determining that a node that needs to perform an interface function test is node N, and because the test operation of node N needs to depend on the test result of node N-1, executing the interface test operation corresponding to the nth node according to the test result of the nth node and the execution condition of the interface test operation corresponding to the nth node, the test result of the nth node, that is, the test result of the interface test, may be obtained, where the execution condition of the interface test operation may include at least three cases:

1) And (3) carrying out an interface response accuracy test, and accurately calling the interface by utilizing interface information in the test data.

2) The interface responds to the comprehensive test, and user information matched with the access number of the voice response system can be obtained through the interface information in the test data.

3) Interface response speed test, through the interface information in the test data, can realize that the interface is accurately called within a preset interface time threshold (preferably 100 ms), and avoid the influence of overlong response time on the use feeling of a voice response system.

In some embodiments, in step 506, when the function to be tested is an interface function, the nodes in the test flow are a (playback node), b (playback receiving node), c (write channel variable node, showing the value written by the front end), d (interface call system node, executing interface call); in some embodiments, the node d is the 4 th node of the 4 th nodes, and according to the test result of the 3 rd node c, an interface test operation corresponding to the 4 th node d is required to be executed, so as to obtain the test result of the 4 th node d, and the test operation of the node c is "input a selection instruction, and selects a service provided for you"; and if a key selection instruction is received, executing the interface test operation corresponding to the 4 th node, and selecting a corresponding interface for calling.

After the test results of the corresponding nodes are obtained through steps 201-204, in order to facilitate the voice response system tester to quickly obtain the test results of the corresponding nodes, the test results of the corresponding nodes need to be displayed to the tester in time through step 205.

Step 205: and sending the test result of at least one node to a display end of the voice response system so as to realize the display of the test result through the display end.

In some embodiments, when the test result of the node indicates that the test passes, the test result of the node may be sent to the display end of the voice response system, so that a tester may learn the test result of the node in time and execute a corresponding tested function of the voice response system that passes the test.

In some embodiments, in the case that the test result of the node indicates that the test fails, node information of the node, repair suggestions of the test result and repair schemes may be obtained; and sending the node information of the node, the test result of the node, the repair suggestion of the test result and the repair scheme to a display end of the voice response system. Therefore, a tester can timely acquire the test result of the node, and at least one repair scheme is selected to repair the corresponding node according to the repair suggestion until the test result of the corresponding node indicates that the test fails.

In some embodiments, obtaining repair suggestions and repair plans for test results may be accomplished by: acquiring test data of a node and execution conditions of test operation; and carrying out correctness detection on the test data of the nodes to obtain a detection result of the test data. For example, in the case that the function to be tested is a voice function, the nodes in the test flow are a (playback node), b (playback receiving node), c (write channel variable node, showing the value written by the front end), d (special skill set node, performing voice information playing) in sequence; the test data for all nodes in the test flow may be derived from preconfigured speech information and voice information. The preset speaking information is "(access number) hello," error configuration is "(call number) hello", and then the detection result of the test data is that the test data is wrong.

In some embodiments, correctness detection is performed on the execution conditions of the nodes to obtain detection results of the execution conditions; for example: when the function to be tested is a speaking function, the nodes in the test flow are a (playback node), b (playback receiving node), c (write channel variable node, showing the value written by the front end), d (special skill group node) in sequence, and the speaking information playing is executed; the test data for all nodes in the test flow may be derived from preconfigured speech information and voice information. The preset speaking information of the node d is "(access number) hello"; the preset execution condition of the node d is play when the voice response system is accessed; by detecting the correctness of the execution condition of the node, the execution condition of the node d is determined to be played before the voice response system is accessed, and the detection result of the execution condition is obtained as an error occurrence of the execution condition.

In some embodiments, a repair suggestion and a repair scheme for the test result are determined according to the test result of the test data and the test result of the execution condition, wherein, in combination with the above embodiments, the repair suggestion and the repair scheme for the test result include at least one of: 1) Modifying the test data and reserving the execution conditions; 2) Test data is reserved, and execution conditions are modified; 3) The test data is modified and the execution conditions are modified.

In some embodiments, in order to make the test efficiency of the system test method provided by the application faster and the test result more accurate, an assertion node may be set in a plurality of nodes in the test flow, and according to the assertion node, whether the system test passes through the node or not is judged, and the complex test flow is rapidly analyzed. If any node is an assertion node, determining a node adjacent to the assertion node and positioned in front of the assertion node in the test flow as a target node; acquiring target test data of a target node and target execution conditions of target test operation of the target node; detecting the branch configuration logic of the target node according to the target test data and the target execution condition of the target node to obtain a branch configuration logic detection result; and determining a branch configuration logic modification scheme of the target node according to the detection result of the branch configuration logic so as to modify the branch configuration logic of the target node through the branch configuration logic modification scheme of the target node. For example, when the function to be tested is a voice function 1, the nodes in the test flow are a1 (playback node), b1 (playback receiving node), c1 (write channel variable node, showing the value written by the front end), d (special skill group node, executing voice information playing) in sequence; when the function to be tested is the voice function 2, the nodes in the test flow are a2 (playback node), b2 (playback receiving node), c2 (write channel variable node, display the value written by the front end), d (special skill group node, execute voice information playing), at this time, the node d is an assertion node, when the system test method provided by the application is executed, the node c1 of the function to be tested is the voice function 1 and the node c2 of the function to be tested is the voice function 2 are not passed through the node d, the branch configuration logic of the target node c1 is detected according to the target test data and the target execution condition of the target node c1, a corresponding branch configuration logic detection result is obtained, and the branch configuration logic of the target node c2 is detected according to the target test data and the target execution condition of the target node c2, so as to obtain a corresponding branch configuration logic detection result.

In some embodiments, in the case that the target node c2 is determined to have an error, the modification scheme of the branch configuration logic of the target node c2 is determined according to the detection result of the branch configuration logic of the target node c 2. And under the condition that the target node c1 is not wrong, the detection result of the branch configuration logic of the node b1 (the node a1 is searched when the node b1 is correct) can be continuously searched, and the modification scheme of the branch configuration logic of the node b1 is determined. Therefore, the test accuracy of the voice response system can be further improved.

In order to better illustrate the execution process of the system test method provided by the application, the following describes the processing process of the system test method provided by the application by taking a voice test, a speaking test and an interface test of a voice response system as examples.

Referring to fig. 9, fig. 9 is a schematic diagram illustrating a working process of a voice response system according to an embodiment of the present application, where when the voice response system shown in fig. 9 is used, a client may listen to a mobile phone entertainment product according to an operation prompt in the voice response system, or play related information according to input content. And further realize the handling of some simple services or guide the client to transfer to the manual seat. On the other hand, the pressure of the artificial seat can be reduced to a certain extent. In the related art, the voice response system cannot be tested, and meanwhile, a user of the voice response system cannot quickly know whether the configuration of the voice response system is wrong, so that the smooth operation of the voice response system cannot be ensured. To implement the voice response system shown in fig. 9, components of the voice response system that may be used include: ivr-Engine, freeswitch, ivr-manager, operator gateway, acts specifically as follows: 1) ivr-Manager: as the back end of the voice response system, receiving the version configuration of the IVR configuration tool and the release configuration of the access number by the user and intelligently debugging the IVR; 2) ivr-engine: the method is used for receiving the call of the Freeswitch and executing the test operation of the corresponding node (such as the audio which needs to be played in interactive response with the user aiming at the initialization flow corresponding to the access number after the call number is powered on); calculating according to the access number and the call number transferred during the invoking of the Freeswitch to obtain a node of a certain test flow needing to be initialized; 3) Freeswitch: a cross-platform open source telephone switching platform that can be responsible for providing routing and interconnection communications for audio, text, or any other form of media in a voice response system, as well as providing self-service IVR services; 4) Operator gateway: the system is used for interfacing with various large operator lines, and is used for establishing communication connection between a call center and a PSTN network.

In order to overcome the above-mentioned drawbacks, check and check the result and content of each power-on configuration in the function to be tested (for example, whether the playback content is correct, whether the input and output parameters of the interface call reach the own expectations, whether the judgment of the service time and the working time is correct, whether the conversation operation, the audio and the skill set in the skill set node are normal or not), and find and repair the wrong configuration and faults in time (including code errors, network connection problems, parameter configuration errors, poor audio effects, poor conversation operation content, etc.), see fig. 10, fig. 10 is another optional flowchart of the system test method provided in the embodiment of the present application, where it can be understood that the execution subject of the steps shown in fig. 10 may be implemented by the terminal or the server running the system test device alone, or may be implemented by the terminal and the server cooperatively, or by the cloud server cooperatively implemented, and here, by taking the server implementation as an example, the following steps are specifically included:

step 1001: and carrying out service configuration of the voice response system.

In some embodiments, when configuring the service of the voice response system, a test version of the voice response system may be created to perform the test of the corresponding function to be tested, for example, the voice test, the speaking test and the interface test of the voice response system, which is specifically limited in this application.

Step 1002: triggering the intelligent test process of the voice response system.

In some embodiments, when an intelligent test process of the voice response system is triggered, breakpoint setting needs to be performed first, and because not every node in the voice test, the speech test and the interface test of the voice response system will send the test result of the corresponding node to the display end of the voice response system, the breakpoint can be set on the node needing to be broken through instruction information and stored in the test process, so as to obtain the test result of the corresponding node which the tester hopes to obtain.

In some embodiments, in combination with the test configuration information setting process shown in the foregoing embodiments, a tester inputs a call number and an access number, a display end (abbreviated as front end) of a voice response system sends a test request to a back end (i.e., ivr-manager, abbreviated as back end) of the voice response system, after the back end of the voice response system receives the test request, the process is executed according to a start node of a main process, and in the case of executing the node with a breakpoint mark, the back end returns content executed by the corresponding node and actual values of all process variables during execution to the front end, and then the front end displays content of the current node during execution and displays real-time data of the process variables. The user can then view the test results of the corresponding node in real time.

In some embodiments, as shown in fig. 3, there are three control components below the test page, respectively: the next node, the next breakpoint, and the test is ended. After the control component of the next node is triggered, under the condition that the node needs to return a test result, the front end can call the back end through the test instruction to execute the test operation of the next node, and the back end can continue to run and return the content executed by the next node and the actual values of all the flow variables to the front end.

In some embodiments, as shown in fig. 3, if the "next breakpoint" control component is triggered, the front end invokes the back end to execute the next breakpoint, and the back end continues to execute operations in the test node until the next breakpoint marked node is found, and then returns what the corresponding node executed, as well as the actual values of all flow variables. If not, the back end returns the test result of the corresponding node of the front end after the test flow is executed.

In some embodiments, as shown in FIG. 3, if the "end test" control component is triggered. The front end will exit the test mode and end the corresponding test flow.

In some embodiments, in response to a test instruction sent by the front end, the back end will first initialize data for all flow variables of the test flow. Then, the test instructions in the corresponding nodes are sequentially executed according to the node sequence of the test flow, and under the condition that the test instructions are executed to the breakpoint type nodes, the test results of the corresponding nodes can be sent to the front end, the test results of the corresponding nodes are stored in the database in real time, and a task identifier (task id) is sent to the front end.

In some embodiments, in the case where "next node" or "next breakpoint" shown in fig. 3 is triggered, the front end will carry the task id returned before, and the test result of the current node, and send it to the back end. The back end queries the ending node of the last test according to the task id, then continues the test until the next breakpoint or the next node needing to return the test result is available, and then continues to store the test result of the corresponding node to the database and returns to the front end for a new task id.

In some embodiments, in order to ensure the privacy of the test data, the backend may delete all the test results stored in the database in the current test process in a full amount when the test is ended or the process is running. In some embodiments, the test results may also be deleted periodically, e.g., automatically when a time threshold is exceeded (the time threshold is preferably 24 hours).

In some embodiments, the functionality to be tested of the voice response system is: the speech function test, the voice function test and the interface function test are taken as examples, and the related node types comprise: playback node, playback receiving node, interface calling system node, reading channel variable node, writing channel variable node, variable assignment node, service time node, working time node, hash shunting node, display shunting judgment result, white list shunting node and special skill group node.

In some embodiments, the test operation of the different types of nodes includes at least one of:

1. playback node: playing a section of audio configured by the current node. 2. Playback and number receiving nodes: a piece of audio of the current node configuration is played and a desired number can be entered on the page. 3. Interface call is node: the results after invocation and the entries are displayed. 4. Read channel variable node: data to be read can be input into a page, and the variable nodes of 5 and a writing channel are as follows: the value to be written is displayed. 6. Variable assignment node: the object to be assigned and the specific value are displayed. 7. Service time node: and displaying the judging result. 8. Operating time node: and displaying the judging result. 9. Hash shunting node: and displaying the shunt judgment result. 10. White list splitting node: and displaying the shunt judgment result. 11. Special skill group node: and displaying the name of the skill group, playing the transfer operation and playing the transfer waiting sound.

Step 1003: and displaying the result of the intelligent test of the voice response system.

In some embodiments, when the time-out result of each node or breakpoint is presented, if the test result characterizes the test as being incorrect, the error reporting is performed. The content of the front-end corresponding error and the advice for the node configuration will be returned. Specifically, because each node needs to run or perform the test data of condition judgment, some nodes are necessary and can judge that if the condition of configuration judgment is not performed or the test data of a type of function to be tested is different in the running process, the cause of error of the test result of the corresponding node can be determined.

In some embodiments, the decision logic for the test operation of the different types of nodes includes at least one of:

1. playback node: it is determined whether a conversation is configured (no prompt requires a conversation to be configured), but no audio is configured for the conversation (prompt uploads the audio corresponding to the conversation, or configures the corresponding tts). 2. Playback and number receiving nodes: it is determined whether to configure the session, and whether to configure the range and number of inputtable values (if not, it is not suggested that no configuration is performed), and the received user value is assigned to a variable (if not, it is suggested that no value-receiving variable is configured). 3. Interface call is node: it will determine the assignment of the calling interface (no then hint needs to be set with parameters) and if the call fails (hint interface address error or configuration error). 4. Service time node: it is determined whether to configure the service time determination range and time (if not, it is indicated that time determination logic is required). 5. Operating time node: it is determined whether to configure the working time determination range and time (if not, it is indicated that time determination logic is required). 6. Hash shunting node: and judging the hash calculated value (the hash calculated value is not prompted to be configured), and the split ratio (the hash split ratio is not prompted to be configured). 7. Special skill group node: it is determined whether a conversation is configured (if no conversation is configured), but no audio is configured (if a conversation is uploaded, or if a corresponding tts is configured), it is determined whether a skill set is configured (if a skill set is configured).

In order to make the test efficiency of the system test method faster and the test result more accurate, the assertion node can be set in a plurality of nodes of the test flow, and whether the system test passes through the node or not is judged according to the assertion node, so that the complex test flow is rapidly analyzed. Referring to fig. 11, fig. 11 is a further optional flowchart of a system testing method provided in the embodiment of the present application, where it may be understood that an execution body of the steps shown in fig. 11 may be implemented by a terminal or a server running a system testing device, or may be implemented by a terminal and a server cooperatively, or may be implemented by a cloud server or a cloud server cluster cooperatively, which is illustrated by taking a server implementation as an example, and specifically includes the following steps:

step 1101: an assertion node is determined.

For example, when the function to be tested is a voice function 1, the nodes in the test flow are a1 (playback node), b1 (playback receiving node), c1 (write channel variable node, showing the value written by the front end), d (special skill group node, executing voice information playing) in sequence; when the function to be tested is the speech function 2, the nodes in the test flow are a2 (playback node), b2 (playback receiving node), c2 (write channel variable node, showing the value written by the front end), d (special skill group node, executing speech information playing), and the node d is an assertion node.

Step 1102: and judging whether the test flow passes the assertion node or not.

In some embodiments, when the system testing method provided by the application is executed, the parent node of the node d can be determined to have a test error without passing through the node d.

Step 1103: if the node does not pass through the assertion, at least one node adjacent to the assertion and positioned in front of the assertion is determined to be the node to be judged according to the test flow.

Step 1104: after obtaining the node to be judged, detecting whether the parent node exists in the node to be judged, if so, returning to the execution step 1102, otherwise, executing the step 1105.

Step 1105: one or more nodes closest to the predicate node are determined to be target nodes.

The one or more nodes closest to the asserted node are used as target nodes, so that the nodes in the test flow of the complex structure can be rapidly positioned, and the nodes with test failure can be determined.

Step 1106: judging whether the target node runs to other branch nodes in the test flow, and if so, determining that the node sequence is wrongly configured.

In some embodiments, if the target node runs to other branch nodes in the test flow, the current node may be prompted that a node order configuration error may occur, e.g., the correct node order a, b, c, d is configured as a, b, d, c; if the target node does not run to other branch nodes in the test flow, the target node is prompted that the test data configuration error possibly exists or the on-hook occurs.

Step 1107: and the indication display end displays a plurality of nodes which can be configured with errors and sends the reasons that the corresponding nodes can have testing errors.

In some embodiments, the cause of the test error includes at least one of:

configuration logic type errors: 1) Configuration error-branch determination error, 2) configuration error-determination type error; other types of errors: 3) Node hang-up occurs, 4) configuration error-node configuration error.

Step 1004: and adjusting the service configuration according to the result of the intelligent test of the voice response system.

Referring to fig. 12, fig. 12 is a schematic structural diagram of an electronic device for performing a system testing method provided in the present application according to an embodiment of the present application, and the electronic device 100 shown in fig. 12 includes: at least one processor 410, a memory 450, at least one network interface 420, and a user interface 430. The various components in the electronic device 100 are coupled together by a bus system 440. It is understood that the bus system 440 is used to enable connected communication between these components. The bus system 440 includes a power bus, a control bus, and a status signal bus in addition to the data bus. But for clarity of illustration the various buses are labeled as bus system 440 in fig. 12.

The processor 410 may be an integrated circuit chip having signal processing capabilities such as a general purpose processor, such as a microprocessor or any conventional processor, a digital signal processor (Digital Signal Processor, DSP), or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or the like.

The user interface 430 includes one or more output devices 431, including one or more speakers and/or one or more visual displays, that enable presentation of the media content. The user interface 430 also includes one or more input devices 432, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

Memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid state memory, hard drives, optical drives, and the like. Memory 450 optionally includes one or more storage devices physically remote from processor 410.

Memory 450 includes volatile memory or nonvolatile memory, and may also include both volatile and nonvolatile memory. The non-volatile Memory may be a Read Only Memory (ROM) and the volatile Memory may be a random access Memory (Random Access Memory, RAM). The memory 450 described in the embodiments herein is intended to comprise any suitable type of memory.

In some embodiments, memory 450 is capable of storing data to support various operations, examples of which include programs, modules and data structures, or subsets or supersets thereof, as exemplified below.

An operating system 451 including system programs, e.g., framework layer, core library layer, driver layer, etc., for handling various basic system services and performing hardware-related tasks, for implementing various basic services and handling hardware-based tasks;

a network communication module 452 for accessing other electronic devices via one or more (wired or wireless) network interfaces 420, the exemplary network interface 420 comprising: bluetooth, wireless compatibility authentication (WiFi), universal Serial Bus (USB), etc.;

a presentation module 453 for enabling presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 431 (e.g., a display screen, speakers, etc.) associated with the user interface 430;

an input processing module 454 for detecting one or more user inputs or interactions from one of the one or more input devices 432 and translating the detected inputs or interactions.

In some embodiments, the apparatus provided in the embodiments of the present application may be implemented in software, and fig. 12 shows a system testing apparatus 455 stored in a memory 450, which may be software in the form of a program, a plug-in, or the like, including the following software modules: information transmission module 4551, information processing module 4552, test module 4553, which are logical, and thus may be combined or split further according to the functions implemented. The functions of the respective modules will be described hereinafter.

The information transmission module 4551 is configured to obtain test configuration information of a function to be tested in response to a system test request for the function to be tested in the voice response system;

the information processing module 4552 is configured to determine a test flow of a function to be tested according to the test configuration information, where the test flow of the function to be tested includes at least one node;

the information processing module 4552 is further configured to determine a test operation corresponding to each node;

the test module 4553 is configured to sequentially execute a test operation corresponding to each node according to a node sequence between at least one node in the test flow, so as to obtain a test result of the corresponding node;

the information transmission module 4551 is further configured to send the test result of at least one node to a display end of the voice response system, so as to display the test result through the display end.

the information transmission module 4551 is further configured to obtain test configuration information of the function to be tested corresponding to the version from a preset configuration information base.

In some embodiments, the information processing module 4552 is further configured to query a plurality of nodes in the test flow of the function to be tested according to the test configuration information;

the information processing module 4552 is further configured to determine, among the plurality of nodes, a node position of a start node, an end node, and each other node in the test flow; the other nodes are nodes except the starting node and the ending node, and the number of the other nodes is at least one;

the information processing module 4552 is further configured to determine at least one breakpoint in at least one other node, where the breakpoint is a node with a breakpoint identifier; under the condition that any node is a breakpoint, a test result of the corresponding node needs to be sent to a display end of the voice response system;

the information processing module 4552 is further configured to serially connect the plurality of nodes according to the node positions of the start node, the breakpoint, the other nodes, and the end node, to form a test flow of the function to be tested.

In some embodiments, the information processing module 4552 is further configured to obtain a node type identifier of each node;

the information processing module 4552 is further configured to determine a node type of each node according to the node type identifier;

the information processing module 4552 is further configured to search a preset test operation content table according to the node type of each node, to obtain a test operation corresponding to the node type of each node.

In some embodiments, the test module 4553 is further configured to initialize test data of all nodes in the test flow to obtain initialized test data;

the test module 4553 is further configured to execute a test operation corresponding to the start node according to the initialization test data that matches the test operation corresponding to the start node, to obtain a test result of the start node; the start node is the first node in the test flow;

the test module 4553 is further configured to obtain, for an nth node of the plurality of nodes, a test result of an nth-1 st node adjacent to and before the nth node;

the test module 4553 is further configured to execute a test operation corresponding to the nth node according to the test result of the nth-1 th node, to obtain the test result of the nth node; n is an integer greater than 1.

the test module 4553 is further configured to obtain an execution condition of a voice test operation corresponding to at least one first type node when testing the voice function of the voice response system, where the first type node is a node for testing the voice function of the voice response system;

the test module 4553 is further configured to traverse the plurality of nodes, and if the nth node is a first type node, execute the session test operation corresponding to the nth node according to the test result of the N-1 th node and the execution condition of the session test operation corresponding to the nth node, to obtain the session test result of the nth node.

the test module 4553 is further configured to obtain an execution condition of an audio test operation corresponding to at least one second class node when testing the audio function of the voice response system, where the second class node is a node for testing the audio function of the voice response system;

the test module 4553 is further configured to traverse the plurality of nodes, and if the nth node is the second class node, execute the audio test operation corresponding to the nth node according to the test result of the N-1 th node and the execution condition of the audio test operation corresponding to the nth node, to obtain the audio test result of the nth node.

the test module 4553 is further configured to obtain an execution condition of a node test operation corresponding to at least one third type node when testing an interface function of the voice response system, where the third type node is a node for testing the interface function of the voice response system;

the test module 4553 is further configured to traverse the plurality of nodes, and if the nth node is a third class node, execute the node test operation corresponding to the nth node according to the test result of the nth-1 node and the execution condition of the node test operation corresponding to the nth node, to obtain the node test result of the nth node.

In some embodiments, the information transmission module 4551 is further configured to send the test result of the node to the display end of the voice response system when the test result of the node indicates that the test is passed;

the information processing module 4552 is further configured to obtain node information of the node, a repair suggestion of the test result, and a repair scheme when the test result of the node indicates that the test fails;

the information transmission module 4551 is further configured to send node information of the node, a test result of the node, a repair suggestion of the test result, and a repair scheme to a display end of the voice response system.

In some embodiments, the information processing module 4552 is further configured to obtain test data of the node and an execution condition of the test operation;

the information processing module 4552 is further configured to perform correctness detection on the test data of the node, to obtain a detection result of the test data;

the information processing module 4552 is further configured to perform correctness detection on the execution condition of the node, to obtain a detection result of the execution condition;

the information processing module 4552 is further configured to determine a repair suggestion and a repair scheme of the test result according to the test result of the test data and the test result of the execution condition.

In some embodiments, the information processing module 4552 is further configured to determine, as the target node, a node adjacent to and before the assertion node in the test flow if any node is the assertion node;

the information processing module 4552 is further configured to obtain target test data of the target node and a target execution condition of a target test operation of the target node;

the information processing module 4552 is further configured to detect a branch configuration logic of the target node according to the target test data and the target execution condition of the target node, to obtain a branch configuration logic detection result;

The information processing module 4552 is further configured to determine a modification scheme of the branch configuration logic of the target node according to the detection result of the branch configuration logic, so as to modify the branch configuration logic of the target node according to the modification scheme of the branch configuration logic of the target node.

a memory for storing executable instructions;

According to the electronic device shown in fig. 12, in one aspect of the present application, there is also provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The computer instructions are read from the computer-readable storage medium by a processor of a computer device, which executes the computer instructions, causing the computer device to perform the different embodiments and combinations of embodiments provided in various alternative implementations of the system testing methods provided herein.

The foregoing is illustrative only and is not intended to limit the scope of the present application, and any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the present application are intended to be included within the scope of the present application.

Claims

1. A system testing method, the method comprising:

determining a test operation corresponding to each node;

2. The method of claim 1, wherein the system test request includes a version of test configuration information;

The obtaining the test configuration information of the function to be tested includes:

and acquiring test configuration information of the function to be tested corresponding to the version from a preset configuration information base.

3. The method of claim 1, wherein the determining the test flow of the function under test according to the test configuration information comprises:

inquiring a plurality of nodes in a test flow of the function to be tested according to the test configuration information;

determining node positions of a start node, an end node and each other node in the test flow among the plurality of nodes; the other nodes are nodes except the starting node and the ending node, and the number of the other nodes is at least one;

determining at least one breakpoint in at least one other node, wherein the breakpoint is a node with a breakpoint identification; under the condition that any node is a breakpoint, a test result of the corresponding node needs to be sent to a display end of the voice response system;

and connecting the plurality of nodes in series according to the node positions of the starting node, the breakpoint, the other nodes and the ending node to form a test flow of the function to be tested.

4. The method of claim 1, wherein said determining a test operation corresponding to each of said nodes comprises:

acquiring a node type identifier of each node;

determining the node type of each node according to the node type identifier;

searching a preset test operation content table according to the node type of each node to obtain a test operation corresponding to the node type of each node.

5. The method of claim 1, wherein the test flow comprises a plurality of nodes; the step of sequentially executing the test operation corresponding to each node according to the node sequence among the at least one node in the test flow to obtain the test result of the corresponding node comprises the following steps:

initializing test data of all nodes in the test flow to obtain initialized test data;

executing the test operation corresponding to the starting node according to the initialization test data matched with the test operation corresponding to the starting node to obtain a test result of the starting node; the starting node is the first node in the test flow;

aiming at an Nth node in the plurality of nodes, acquiring a test result of an N-1 th node which is adjacent to the Nth node and is positioned in front of the Nth node;

According to the test result of the N-1 th node, executing the test operation corresponding to the N-th node to obtain the test result of the N-th node; n is an integer greater than 1.

6. The method of claim 5, wherein the function to be tested comprises a speaking function of a voice response system; and executing the test operation corresponding to the Nth node according to the test result of the N-1 th node to obtain the test result of the Nth node, wherein the test result comprises the following steps:

under the condition of testing the voice operation function of the voice response system, acquiring the execution condition of the voice operation test operation corresponding to at least one first type node, wherein the first type node is used for testing the voice operation function of the voice response system;

traversing the plurality of nodes, and if the Nth node is the first type node, executing the session test operation corresponding to the Nth node according to the test result of the N-1 th node and the execution condition of the session test operation corresponding to the Nth node to obtain the session test result of the Nth node;

under the condition of testing the audio function of the voice response system, acquiring an execution condition of an audio test operation corresponding to at least one second type node, wherein the second type node is a node for testing the audio function of the voice response system;

Traversing the plurality of nodes, and if the Nth node is the second class node, executing the audio test operation corresponding to the Nth node according to the test result of the N-1 th node and the execution condition of the audio test operation corresponding to the Nth node to obtain the audio test result of the Nth node;

under the condition of testing the interface function of the voice response system, acquiring the execution condition of node testing operation corresponding to at least one third type of node, wherein the third type of node is used for testing the interface function of the voice response system;

traversing the plurality of nodes, and if the Nth node is the third class node, executing the node test operation corresponding to the Nth node according to the test result of the N-1 th node and the execution condition of the node test operation corresponding to the Nth node to obtain the node test result of the Nth node.

7. The method according to any one of claims 1 to 6, wherein the sending the test result to the display end of the voice response system includes:

under the condition that the test result of the node represents that the test passes, the test result of the node is sent to a display end of the voice response system;

Under the condition that the test result of the node represents that the test fails, node information of the node, a repair suggestion and a repair scheme of the test result are obtained;

and sending the node information of the node, the test result of the node, the repair suggestion and the repair scheme of the test result to a display end of the voice response system.

8. The method of claim 7, wherein obtaining repair suggestions and repair plans for the test results comprises:

acquiring test data of the node and execution conditions of test operation;

performing correctness detection on the test data of the nodes to obtain detection results of the test data;

performing correctness detection on the execution conditions of the nodes to obtain detection results of the execution conditions;

and determining a repair proposal and a repair scheme of the test result according to the detection result of the test data and the detection result of the execution condition.

9. The method of claim 8, wherein the plurality of nodes comprises an asserting node; the method further comprises the steps of:

if any node is an assertion node, determining a node adjacent to the assertion node and positioned in front of the assertion node in the test flow as a target node;

Acquiring target test data of the target node and target execution conditions of target test operation of the target node;

detecting the branch configuration logic of the target node according to the target test data of the target node and the target execution condition to obtain a branch configuration logic detection result;

and determining a branch configuration logic modification scheme of the target node according to the branch configuration logic detection result so as to modify the branch configuration logic of the target node through the branch configuration logic modification scheme of the target node.

10. A system testing apparatus, the apparatus comprising:

11. An electronic device, the electronic device comprising:

a memory for storing executable instructions;

a processor for implementing the system test method of any one of claims 1 to 9 when executing executable instructions stored in said memory.

12. A computer readable storage medium storing executable instructions which when executed by a processor implement the system testing method of any one of claims 1 to 9.