CN113110997A - Test method, device and equipment - Google Patents
Test method, device and equipment Download PDFInfo
- Publication number
- CN113110997A CN113110997A CN202110439929.4A CN202110439929A CN113110997A CN 113110997 A CN113110997 A CN 113110997A CN 202110439929 A CN202110439929 A CN 202110439929A CN 113110997 A CN113110997 A CN 113110997A
- Authority
- CN
- China
- Prior art keywords
- test
- tested
- voice stream
- result
- response content
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010998 test method Methods 0.000 title description 7
- 238000012360 testing method Methods 0.000 claims abstract description 290
- 230000004044 response Effects 0.000 claims abstract description 61
- 238000000034 method Methods 0.000 claims abstract description 41
- 238000012795 verification Methods 0.000 claims abstract description 38
- 230000003993 interaction Effects 0.000 claims abstract description 17
- 230000015654 memory Effects 0.000 claims description 19
- 238000013473 artificial intelligence Methods 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 9
- 230000004048 modification Effects 0.000 description 8
- 238000012986 modification Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 7
- 238000006243 chemical reaction Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000001960 triggered effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000000750 progressive effect Effects 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- 108010001267 Protein Subunits Proteins 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 229910021389 graphene Inorganic materials 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000013522 software testing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
- G06F16/3329—Natural language query formulation or dialogue systems
Abstract
The embodiment of the specification provides a testing method, a testing device and testing equipment, which can be used in the field of artificial intelligence. The method is applied to an automatic test system, wherein a test case containing a context relation of a test scene is stored in the automatic test system, and the method comprises the following steps: receiving a first voice stream broadcasted by a tested system; acquiring a first expected test result and first response content from the test case; checking the first voice stream and the first expected test result, and recording a checking result; sending the first response content to the tested system; the first response content is used for enabling the system to be tested to carry out the next round of interaction; judging whether the context in the test case is tested; and acquiring all verification results under the condition that the test is finished. By utilizing the embodiment of the specification, the automatic test of the intelligent customer service robot can be realized, and the test efficiency is improved.
Description
Technical Field
The present application relates to the field of artificial intelligence technologies, and in particular, to a testing method, device, and apparatus.
Background
With the continuous development of science and technology, the use of intelligent customer service robots is becoming more and more common in various industries. However, the intelligent customer service robot needs to be tested before delivery for use so that it can meet the business requirements.
In the prior art, the test of the intelligent customer service robot is mainly implemented by that a tester submits an outbound task in the intelligent customer service robot for a certain service scene, and then the intelligent customer service robot dials a telephone to interact with the tester. This kind of mode can only rely on the manual work to go on, when needs test a large amount of intelligent customer service robot, does not have sufficient manpower to come the conversation simultaneously to can't carry out the pressure test, make efficiency of software testing lower.
Therefore, there is a need for a solution to the above technical problems.
Disclosure of Invention
The embodiment of the specification provides a testing method, a testing device and testing equipment, which can realize automatic testing of an intelligent customer service robot and improve testing efficiency.
The test method, the test device and the test equipment provided by the specification are realized in the following modes.
A testing method is applied to an automatic testing system, wherein a testing case containing a context relation of a testing scene is stored in the automatic testing system, and the method comprises the following steps: receiving a first voice stream broadcasted by a tested system; acquiring a first expected test result and first response content from the test case; checking the first voice stream and the first expected test result, and recording a checking result; sending the first response content to the tested system; the first response content is used for enabling the system to be tested to carry out the next round of interaction; judging whether the context in the test case is tested; and acquiring all verification results under the condition that the test is finished.
A test apparatus, comprising: the receiving module is used for receiving a first voice stream broadcasted by the tested system; the first obtaining module is used for obtaining a first expected test result and first response content from the test case; the verification module is used for verifying the first voice stream and the first expected test result and recording a verification result; the sending module is used for sending the first response content to the tested system; the first response content is used for enabling the system to be tested to carry out the next round of interaction; the judging module is used for judging whether the test of the context in the test case is finished; and the second acquisition module is used for acquiring all the verification results under the condition that the test is finished.
A test device comprising at least one processor and a memory storing computer executable instructions which when executed by the processor implement the steps of any one of the method embodiments of the present specification.
A computer readable storage medium having stored thereon computer instructions which, when executed, implement the steps of any one of the method embodiments in the present specification.
The specification provides a test method, a test device and test equipment. In some embodiments, the voice stream broadcasted by the system under test may be received, the expected test result and the response content may be obtained from the test case, and then the voice stream and the expected test result may be verified, and the verification result may be recorded. Further, the response content can be sent to the system under test, so that the system under test performs the next round of interaction according to the response content until the context in the test case is tested, and all the verification results are obtained. Because the automatic testing system based on the voice flow is built, the automatic testing of the intelligent customer service voice robot system containing the context relation is realized, the labor input can be reduced, and the testing efficiency is improved. By adopting the implementation scheme provided by the specification, the automatic test of the intelligent customer service robot can be realized, and the test efficiency is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the specification, are incorporated in and constitute a part of this specification, and are not intended to limit the specification. In the drawings:
FIG. 1 is a schematic flow chart diagram illustrating one embodiment of a testing method provided herein;
FIG. 2 is a schematic diagram of one embodiment of a test method provided herein;
FIG. 3 is a block diagram of one embodiment of a test apparatus provided herein;
fig. 4 is a block diagram of a hardware structure of an embodiment of a test server provided in the present specification.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only a part of the embodiments in the present specification, and not all of the embodiments. All other embodiments that can be obtained by a person skilled in the art on the basis of one or more embodiments of the present description without inventive step shall fall within the scope of protection of the embodiments of the present description.
The following describes an embodiment of the present disclosure with a specific application scenario as an example. Specifically, fig. 1 is a schematic flow chart of an embodiment of a testing method provided in this specification. Although the present specification provides the method steps or apparatus structures as shown in the following examples or figures, more or less steps or modules may be included in the method or apparatus structures based on conventional or non-inventive efforts.
One embodiment provided by the present specification can be applied to a client, a server, and the like. The client may include a terminal device, such as a smart phone, a tablet computer, and the like. The server may include a single computer device, or may include a server cluster formed by a plurality of servers, or a server structure of a distributed system, and the like.
It should be noted that the following description of the embodiments does not limit the technical solutions in other extensible application scenarios based on the present specification. Specifically, as shown in fig. 1, an embodiment of a testing method provided in this specification may be applied to an automatic testing system, where a testing case containing a context relationship of a testing scenario is stored in the automatic testing system. The method may include the following steps.
S0: and receiving a first voice stream broadcasted by the tested system.
The tested system can be an intelligent customer service voice robot and a system needing to test voice functions.
In some embodiments, before the automated test system receives the first voice stream broadcasted by the system under test, a task creation request may be sent to the system under test, so that the system under test starts a call task.
In some implementation scenarios, the automated testing system may be triggered to send a task creation request to the system under test in an automatic or manual manner. For example, in some implementation scenarios, a test time may be set in the automated test system in advance, so that the automated test system may be automatically triggered to send a task creation request to the system under test when the test time is reached. In other implementation scenarios, the automated testing system may be manually triggered to send a task creation request to the system under test by a tester clicking a preset button on the automated testing system. Of course, the above description is only an exemplary illustration, and the manner of triggering the automatic test system to send the task creation request to the system under test is not limited to the above example, and other modifications may be made by those skilled in the art within the spirit of the present application, but all that can be achieved by the system is covered by the scope of the present application as long as the achieved functions and effects are the same as or similar to the present application.
In some implementation scenarios, after receiving a task creation request sent by an automated testing system, a system under test may start a call task and broadcast a voice stream to the automated testing system. For example, in some implementation scenarios, the automated testing system may send a task creation request to the voice robot under test according to the test case, initiate a call task, and then the voice robot broadcasts a voice stream according to a preset logic.
In some implementation scenarios, the system under test may send a task creation request to the automatic test system, where the task creation request includes a first voice stream broadcasted by the system under test.
In some implementations, the first voice stream may be intrinsic to the system under test and may not be embodied in the test case. For example, for an outbound task, the call will be announced first, such as "do you be xxx? ", at this time," is you xxx? "may be understood as the first voice stream. Of course, the above description is only exemplary, the first voice stream is not limited to the above examples, and other modifications are possible for those skilled in the art in light of the technical spirit of the present application, and all that can be achieved is intended to be covered by the scope of the present application as long as the achieved functions and effects are the same as or similar to the present application.
S2: and acquiring a first expected test result and first response content from the test case.
In this embodiment of the present specification, after receiving the first voice stream broadcasted by the system under test, the first expected test result and the first response content may be obtained from the test case. The expected test result may be used to verify whether the received voice stream is accurate, that is, whether the voice stream broadcasted by the system under test is accurate. In some implementation scenarios, verifying whether the received voice stream is accurate may include verifying whether the information content meets a preset condition, verifying whether the logical skip meets a preset rule, and the like. The preset condition may include whether the similarity of the information content reaches a preset value, such as 85% or 90%. The preset rule may include whether the logical jump satisfies a preset logical order, etc. The answer content may be used to bring the system under test into the next round of interaction.
In some embodiments, the automated testing system stores a testing case containing a context relationship of a testing scenario in advance. In some implementation scenarios, since the tester is aware of each scenario process in the system under test, the tester can prepare different coverage cases for different processes (or scenarios) before testing the system under test, and then store them in the automated testing system in advance. The coverage cases prepared by different processes (or scenarios) can be understood as test cases containing the context of the test scenario. It should be noted that each set of test cases is understood to be a case of a tested scenario of the tested system, and the automated test system may take one answer (i.e. response content) and one expected test result from each test case when receiving one sentence (i.e. voice stream) of the tested system.
For example, in some implementation scenarios, the first voice stream received by the automated testing system is a question 1, the first expected test result obtained from the test case is an expected test result 1, and the first response content is an answer 1, at this time, the expected test result 1 may be used to verify whether the question 1 broadcast by the tested system is accurate, and the answer 1 may be used to subsequently interact with the tested system.
In some embodiments, the automated test system may obtain the first expected test result and the first response content from the test case according to a logical sequence of context in the test case. Of course, the above description is only exemplary, and the manner of obtaining the first expected test result and the first response content is not limited to the above examples, and other modifications may be made by those skilled in the art within the spirit of the present application, and all the functions and effects that are achieved by the present application are covered by the protection scope of the present application.
S4: and checking the first voice stream and the first expected test result, and recording a checking result.
In some embodiments, after obtaining the first expected test result and the first response content from the test case, the first voice stream and the first expected test result may be verified and the verification result may be recorded. The check result may include whether the information content meets a preset condition, whether the logical jump meets a preset rule, and the like.
In some embodiments, the verifying the first voice stream and the first expected test result and recording the verification result may include: converting the first voice stream into a first text; and checking the first text and the first expected test result, and recording a checking result.
In some implementations, since the expected test result obtained from the test case is stored as text information, the received voice stream may be converted into text by voice recognition before being checked with the received voice stream, and then the converted text may be compared with the expected test result. In some implementation scenarios, after receiving the voice stream sent by the system under test, the voice stream may be converted into a text by a voice recognition method, and then the expected test result and the response content are obtained from the test case accordingly.
In some embodiments, the verifying the first text and the first expected test result and recording the verification result may include: comparing whether the logic jump of the first text and the first expected test result meets a preset rule; and comparing whether the content included in the first text and the first expected test result meets a preset condition.
In some implementation scenarios, comparing whether the logic jumps of the first text and the first expected test result satisfy the preset rule may determine whether the logic jumps satisfy the preset rule by obtaining corresponding logic structures and comparing whether the logic structures are consistent. The preset rule may be set according to an actual scene, and this specification does not limit this.
In some implementation scenarios, comparing whether the content included in the first text and the first expected test result satisfies a preset condition may be performed by calculating a similarity between the first text and the first expected test result, and then determining whether the similarity satisfies the preset condition. The preset condition may be a preset similarity, such as 85% or 90%, which is not limited in this specification. Of course, the above description is only exemplary, and the way of checking the first text and the first expected test result is not limited to the above examples, and other modifications are possible for those skilled in the art in light of the technical spirit of the present application, and all that can be included in the scope of the present application as long as the function and effect achieved by the present application are the same as or similar to those of the present application.
In some embodiments, when the content included in the first text and the first expected test result meets the preset condition, it may be stated that the content broadcasted by the system under test is relatively accurate, at this time, the recorded verification result may be that the content broadcasted by the first voice stream is accurate, otherwise, it may be that the content broadcasted by the system under test is not accurate, and the recorded verification result may be that the content broadcasted by the first voice stream is not accurate. When the logical skip of the first text and the first expected test result meets the preset rule, it can be said that the content broadcasted by the tested system meets the preset skip logic, and at this time, the recorded verification result may be that the first voice stream meets the logical skip, otherwise, the recorded verification result may be that the first voice stream does not meet the logical skip. It is to be understood that the above description is only exemplary, the recording manner of the verification result is not limited to the above examples, and other modifications may be made by those skilled in the art within the spirit of the present application, but the scope of the present application should be covered as long as the achieved function and effect are the same or similar to the present application.
S6: sending the first response content to the tested system; and the first response content is used for enabling the system to be tested to carry out the next round of interaction.
In this embodiment of the present specification, after the first voice stream is verified and the first expected test result is recorded, the first response content may be sent to the system under test, so that the system under test performs a next round of interaction.
In some embodiments, before sending the first response content to the system under test, the first response content may be converted into a first response voice stream, and then the first response voice stream is sent to the system under test.
In order to improve the interaction efficiency, in some implementation scenarios, before sending the response content to the system under test, the response content may be converted into a voice stream and then sent to the system under test.
In some implementation scenarios, the automated testing system may include a voice conversion module, so that the response content may be converted into a voice stream by the voice conversion module and then sent to the system under test.
S8: and judging whether the context in the test case is tested.
S10: and acquiring all verification results under the condition that the test is finished.
In some embodiments, after the first response content is sent to the system under test, it may be determined whether the context in the test case has been tested.
In some embodiments, all verification results may be obtained in the event that the test is determined to be complete.
In some embodiments, in the case that it is determined that the test is not completed, the steps S0-S8 may be repeatedly performed until the context of the entire test case is completely tested, and all the verification results are obtained.
For example, in some implementation scenarios, in a case that it is determined that the test is not completed, a second voice stream broadcasted by the system under test may be received; correspondingly, a second expected test result and a second response content can be obtained from the test case; verifying the second voice stream and the second expected test result, and recording a verification result; sending the second response content to the tested system; the second response content is used for enabling the system to be tested to carry out the next round of interaction; judging whether the context in the test case is tested; and acquiring all verification results under the condition that the test is finished.
In some embodiments, after obtaining all the verification results, statistics may be performed on all the verification results to obtain a test result of the system under test in the scene.
In some embodiments, after obtaining all the verification results, a request for checking the test results may also be received; and displaying the test result.
In some embodiments, after the test result is displayed, the tester can check the test result, so as to ensure the test accuracy.
In the embodiment of the specification, an automatic test system can be built based on a container technology, so that large-scale concurrency can be supported, and pressure test (simultaneously carrying out a large number of concurrent interactions, such as hundreds or thousands) on the intelligent customer service voice robot system is realized.
The embodiment of the specification can effectively perform large-scale pressure test based on voice flow.
In the embodiment of the specification, the automatic test system and the tested system are interacted through voice streams, and mutual interference does not exist between different conversations, so that the problem of mutual interference of multi-way conversation sounds in a voice interaction mode can be solved, and preconditions are provided for multi-way concurrence.
In the embodiment of the specification, an automatic test system is built based on a containerization technology, a plurality of systems can be conveniently and rapidly deployed, and the pressure test of the intelligent customer service voice robot system is realized.
It is to be understood that the foregoing is only exemplary, and the embodiments of the present disclosure are not limited to the above examples, and other modifications may be made by those skilled in the art within the spirit of the present disclosure, and the scope of the present disclosure is intended to be covered by the claims as long as the functions and effects achieved by the embodiments are the same as or similar to the present disclosure.
The following description is provided for the above test method in a specific implementation scenario, however, it should be noted that this specific example is only for better illustration of the present application, and should not be construed as an unlimited limitation to the present application. The automatic testing device based on voice flow can be understood as an automatic testing system, and the tested system can be an intelligent customer service voice robot. The automatic test device based on the voice stream can comprise a test case base, a voice conversion module, a voice recognition module and a test result collection module. The test case library is used for storing coverage cases (test cases) in different scenes, the voice conversion module can be used for converting response contents into voice streams, the voice recognition module can be used for converting the voice streams into texts, and the test result collection module can be used for recording verification results. The automatic testing device based on the voice flow can be built based on a container technology, and large-scale concurrency is supported, so that the pressure test of the intelligent customer service voice robot is realized. As shown in fig. 2, fig. 2 is a schematic diagram of a specific embodiment of a testing method provided in this specification, and this embodiment may specifically include the following steps.
S101: the tester imports an automated test case containing the context.
S102: the automatic test device based on the voice stream leads the cases into a test case library.
S103: the automatic testing device based on the voice flow sends a task creation request to the intelligent customer service voice robot according to the testing case, and starts a calling task.
S104: the intelligent customer service voice robot broadcasts voice flow according to preset logic.
S105: the automatic testing device based on the voice stream calls a voice recognition module to convert the received voice stream into text.
S106: the voice stream-based automatic testing device takes out the response content and the expected testing result in the testing case from the testing case.
S107: the voice stream-based automatic testing device compares the recognized characters with an expected testing result and stores the comparison result into a testing result collection module.
S108: and the voice stream-based automatic testing device calls a voice conversion module to convert the response content in the test case into the voice stream.
S109: and the automatic testing device based on the voice flow reports the converted voice flow to the intelligent customer service voice robot.
S110: steps S101-S109 are repeated until the entire test context is over, and all comparison results are obtained.
In this embodiment, after obtaining all comparison results (also called verification results), the tester can check and check the comparison results.
In the above embodiment, the automated testing system sends a task creation request to the intelligent customer service voice robot according to the test case to initiate a call task. In some implementation scenarios, the intelligent customer service voice robot may also send a task creation request to the automated testing system, and start a call task, where the task creation request includes that the intelligent customer service voice robot broadcasts a voice stream according to a preset logic, the automated testing system may obtain a test case corresponding to the scenario after receiving the task creation request, further, the automated testing system may call the voice recognition module to convert the received voice stream into a text, take out a response content and an expected test result from the test case, compare the recognized text with the expected test result, and store the comparison result in the test result collection module, and finally call the voice conversion module to convert the response content in the test case into a voice stream and report the voice stream to the intelligent customer service voice robot until the whole test context is over, all comparison results were obtained.
From the above description, it can be seen that, in the embodiment of the present application, the voice stream broadcasted by the system under test can be received, the expected test result and the response content are obtained from the test case, then the voice stream and the expected test result are verified, and the verification result is recorded. Further, the response content can be sent to the system under test, so that the system under test performs the next round of interaction according to the response content until the context in the test case is tested, and all the verification results are obtained. Because the automatic testing system based on the voice flow is built, the automatic testing of the intelligent customer service voice robot system containing the context relation is realized, the labor input can be reduced, and the testing efficiency is improved.
In the present specification, each embodiment of the method is described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from other embodiments. Reference is made to the description of the method embodiments.
Based on the above-mentioned testing method, one or more embodiments of the present specification further provide a testing apparatus. The apparatus may include systems (including distributed systems), software (applications), modules, components, servers, clients, etc. that use the methods described in the embodiments of the present specification in conjunction with any necessary apparatus to implement the hardware. Based on the same innovative conception, embodiments of the present specification provide an apparatus as described in the following embodiments. Since the implementation scheme of the apparatus for solving the problem is similar to that of the method, the specific implementation of the apparatus in the embodiment of the present specification may refer to the implementation of the foregoing method, and repeated details are not repeated. As used hereinafter, the term "unit" or "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Specifically, fig. 3 is a schematic block diagram of an embodiment of a testing apparatus provided in this specification, and as shown in fig. 3, the testing apparatus provided in this specification may include: the system comprises a receiving module 120, a first obtaining module 122, a checking module 124, a sending module 126, a judging module 128 and a second obtaining module 130.
The receiving module 120 may be configured to receive a first voice stream broadcasted by the system under test;
a first obtaining module 122, configured to obtain a first expected test result and a first response content from the test case;
a checking module 124, configured to check the first voice stream and the first expected test result, and record a check result;
a sending module 126, configured to send the first response content to the system under test; the first response content is used for enabling the system to be tested to carry out the next round of interaction;
a determining module 128, configured to determine whether the context in the test case is tested;
the second obtaining module 130 may be configured to obtain all verification results when the test is completed.
It should be noted that the above-mentioned description of the apparatus according to the method embodiment may also include other embodiments, and specific implementation manners may refer to the description of the related method embodiment, which is not described herein again.
The present specification also provides an embodiment of a test apparatus comprising a processor and a memory for storing processor-executable instructions, which when executed by the processor, implement steps comprising: receiving a first voice stream broadcasted by a tested system; acquiring a first expected test result and first response content from the test case; checking the first voice stream and the first expected test result, and recording a checking result; sending the first response content to the tested system; the first response content is used for enabling the system to be tested to carry out the next round of interaction; judging whether the context in the test case is tested; and acquiring all verification results under the condition that the test is finished.
It should be noted that the above-mentioned apparatuses may also include other embodiments according to the description of the method or apparatus embodiments. The specific implementation manner may refer to the description of the related method embodiment, and is not described in detail herein.
The method embodiments provided in the present specification may be executed in a mobile terminal, a computer terminal, a server or a similar computing device. Taking an example of the test server running on a server, fig. 4 is a block diagram of a hardware structure of an embodiment of a test server provided in this specification, where the server may be a test apparatus or a test device in the above embodiment. As shown in fig. 4, the server 10 may include one or more (only one shown) processors 100 (the processors 100 may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA, etc.), a memory 200 for storing data, and a transmission module 300 for communication functions. It will be understood by those skilled in the art that the structure shown in fig. 4 is only an illustration and is not intended to limit the structure of the electronic device. For example, the server 10 may also include more or fewer components than shown in FIG. 4, and may also include other processing hardware, such as a database or multi-level cache, a GPU, or have a different configuration than shown in FIG. 4, for example.
The memory 200 may be used to store software programs and modules of application software, such as program instructions/modules corresponding to the test method in the embodiments of the present specification, and the processor 100 executes various functional applications and data processing by executing the software programs and modules stored in the memory 200. Memory 200 may include high speed random access memory and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, memory 200 may further include memory located remotely from processor 100, which may be connected to a computer terminal through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission module 300 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal. In one example, the transmission module 300 includes a Network adapter (NIC) that can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission module 300 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The method or apparatus provided by the present specification and described in the foregoing embodiments may implement service logic through a computer program and record the service logic on a storage medium, where the storage medium may be read and executed by a computer, so as to implement the effect of the solution described in the embodiments of the present specification. The storage medium may include a physical device for storing information, and typically, the information is digitized and then stored using an electrical, magnetic, or optical media. The storage medium may include: devices that store information using electrical energy, such as various types of memory, e.g., RAM, ROM, etc.; devices that store information using magnetic energy, such as hard disks, floppy disks, tapes, core memories, bubble memories, and usb disks; devices that store information optically, such as CDs or DVDs. Of course, there are other ways of storing media that can be read, such as quantum memory, graphene memory, and so forth.
The embodiments of the testing method or apparatus provided in this specification may be implemented in a computer by a processor executing corresponding program instructions, for example, implemented in a PC end using a c + + language of a windows operating system, implemented in a linux system, or implemented in an intelligent terminal using, for example, android and iOS system programming languages, implemented in processing logic based on a quantum computer, and the like.
It should be noted that descriptions of the apparatus, the device, and the system described above according to the related method embodiments may also include other embodiments, and specific implementations may refer to descriptions of corresponding method embodiments, which are not described in detail herein.
The embodiments in the present application are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the hardware + program class embodiment, since it is substantially similar to the method embodiment, the description is simple, and the relevant points can be referred to the partial description of the method embodiment.
For convenience of description, the above devices are described as being divided into various modules by functions, and are described separately. Of course, when implementing one or more of the present description, the functions of some modules may be implemented in one or more software and/or hardware, or the modules implementing the same functions may be implemented by a plurality of sub-modules or sub-units, etc.
The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus, devices, systems according to embodiments of the invention. It will be understood that the implementation can be by computer program instructions which can be provided to a processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
As will be appreciated by one skilled in the art, one or more embodiments of the present description may be provided as a method, system, or computer program product. Accordingly, one or more embodiments of the present description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects.
The above description is merely exemplary of one or more embodiments of the present disclosure and is not intended to limit the scope of one or more embodiments of the present disclosure. Various modifications and alterations to one or more embodiments described herein will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims.
Claims (10)
1. A testing method is applied to an automatic testing system, wherein a testing case containing a context relationship of a testing scene is stored in the automatic testing system, and the method comprises the following steps:
receiving a first voice stream broadcasted by a tested system;
acquiring a first expected test result and first response content from the test case;
checking the first voice stream and the first expected test result, and recording a checking result;
sending the first response content to the tested system; the first response content is used for enabling the system to be tested to carry out the next round of interaction;
judging whether the context in the test case is tested;
and acquiring all verification results under the condition that the test is finished.
2. The method according to claim 1, wherein before receiving the first voice stream broadcasted by the system under test, the method comprises:
and sending a task creation request to the tested system so that the tested system starts a calling task.
3. The method according to claim 1, wherein the verifying the first voice stream with the first expected test result and recording a verification result comprises:
converting the first voice stream into a first text;
and checking the first text and the first expected test result, and recording a checking result.
4. The method of claim 3, wherein said verifying said first text against said first expected test result and recording a verification result comprises:
comparing whether the logic jump of the first text and the first expected test result meets a preset rule;
and comparing whether the content included in the first text and the first expected test result meets a preset condition.
5. The method of claim 1, wherein before sending the first response content to the system under test, comprising:
converting the first response content into a first response voice stream;
and sending the first response voice stream to the tested system.
6. The method of claim 1, wherein the determining whether the context in the test case has been tested further comprises:
receiving a second voice stream broadcasted by the tested system under the condition that the test is not finished;
correspondingly, a second expected test result and second response content are obtained from the test case; verifying the second voice stream and the second expected test result, and recording a verification result; sending the second response content to the tested system; the second response content is used for enabling the system to be tested to carry out the next round of interaction; judging whether the context in the test case is tested; and acquiring all verification results under the condition that the test is finished.
7. The method according to claim 1 or 6, wherein after obtaining all the verification results, the method further comprises:
receiving a request for viewing a test result;
and displaying the test result.
8. A test apparatus, comprising:
the receiving module is used for receiving a first voice stream broadcasted by the tested system;
the first obtaining module is used for obtaining a first expected test result and first response content from the test case;
the verification module is used for verifying the first voice stream and the first expected test result and recording a verification result;
the sending module is used for sending the first response content to the tested system; the first response content is used for enabling the system to be tested to carry out the next round of interaction;
the judging module is used for judging whether the test of the context in the test case is finished;
and the second acquisition module is used for acquiring all the verification results under the condition that the test is finished.
9. A test device comprising at least one processor and a memory storing computer-executable instructions that when executed by the processor implement the steps of the method of any one of claims 1 to 7.
10. A computer-readable storage medium having stored thereon computer instructions which, when executed, implement the steps of the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110439929.4A CN113110997A (en) | 2021-04-23 | 2021-04-23 | Test method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110439929.4A CN113110997A (en) | 2021-04-23 | 2021-04-23 | Test method, device and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113110997A true CN113110997A (en) | 2021-07-13 |
Family
ID=76719804
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110439929.4A Pending CN113110997A (en) | 2021-04-23 | 2021-04-23 | Test method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113110997A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113836010A (en) * | 2021-09-14 | 2021-12-24 | 招商银行股份有限公司 | Voice intelligent customer service automatic testing method, system and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108228468A (en) * | 2018-02-12 | 2018-06-29 | 腾讯科技（深圳）有限公司 | A kind of test method, device, test equipment and storage medium |
| CN108614770A (en) * | 2018-04-09 | 2018-10-02 | 中国工商银行股份有限公司 | Automatic test asserts method, apparatus, storage medium and equipment |
| CN111177005A (en) * | 2019-12-31 | 2020-05-19 | 中国银行股份有限公司 | Service application testing method, device, server and storage medium |
| CN111274131A (en) * | 2020-01-17 | 2020-06-12 | 北京达佳互联信息技术有限公司 | Interface testing method and device, electronic equipment and storage medium |
| CN112261214A (en) * | 2020-10-21 | 2021-01-22 | 广东商路信息科技有限公司 | Network voice communication automatic test method and system |
-
2021
- 2021-04-23 CN CN202110439929.4A patent/CN113110997A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108228468A (en) * | 2018-02-12 | 2018-06-29 | 腾讯科技（深圳）有限公司 | A kind of test method, device, test equipment and storage medium |
| CN108614770A (en) * | 2018-04-09 | 2018-10-02 | 中国工商银行股份有限公司 | Automatic test asserts method, apparatus, storage medium and equipment |
| CN111177005A (en) * | 2019-12-31 | 2020-05-19 | 中国银行股份有限公司 | Service application testing method, device, server and storage medium |
| CN111274131A (en) * | 2020-01-17 | 2020-06-12 | 北京达佳互联信息技术有限公司 | Interface testing method and device, electronic equipment and storage medium |
| CN112261214A (en) * | 2020-10-21 | 2021-01-22 | 广东商路信息科技有限公司 | Network voice communication automatic test method and system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113836010A (en) * | 2021-09-14 | 2021-12-24 | 招商银行股份有限公司 | Voice intelligent customer service automatic testing method, system and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107329861B (en) | Multi-interface testing method and device | |
| CN111159049B (en) | Automatic interface testing method and system | |
| CN105303112B (en) | The detection method and device of component call loophole | |
| CN107294808A (en) | The methods, devices and systems of interface testing | |
| US20180376335A1 (en) | Method and device for realizing wireless access point connection authentication | |
| CN105389160A (en) | Information issuing method and device | |
| CN103501503A (en) | Network problem analyzing method and network problem analyzing device | |
| CN105338564B (en) | A kind of client adaptation method, client, server and system | |
| CN104639498A (en) | Fingerprint matching method, device and system | |
| CN103246606A (en) | Method and system for testing performances of ESB (enterprises service bus) platform | |
| CN103986788A (en) | Data fetching method and device of OTT (over the top) application | |
| CN106331060B (en) | WIFI-based deployment and control method and system | |
| CN114003451B (en) | Interface testing method, device, system and medium | |
| CN113110997A (en) | Test method, device and equipment | |
| CN105760300B (en) | A kind of automated testing method and test macro of STK/UTK business | |
| CN112235124B (en) | Method and device for configuring pico-cell, storage medium and electronic device | |
| CN111563037B (en) | Test optimization method and device based on test questions, storage medium and terminal | |
| CN114500348B (en) | CDN gateway testing method and system | |
| CN113934552A (en) | Method and device for determining function code, storage medium and electronic device | |
| CN110347597B (en) | Interface testing method and device of picture server, storage medium and mobile terminal | |
| CN113452533B (en) | Charging self-inspection and self-healing method and device, computer equipment and storage medium | |
| CN110769248A (en) | Set top box testing method and device and electronic equipment | |
| CN109741805A (en) | PDF reports method and device, storage medium and the electronic device automatically generated | |
| CN113434417B (en) | Regression testing method and device for loopholes, storage medium and electronic device | |
| CN109412931A (en) | The method, apparatus and terminal device of knowledge question are carried out in the way of instant messaging |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |