CN114333766A

CN114333766A - Voice performance testing method, device, system, equipment and storage medium

Info

Publication number: CN114333766A
Application number: CN202011056106.5A
Authority: CN
Inventors: 张慧; 王宁
Original assignee: Volkswagen Mobvoi Beijing Information Technology Co Ltd
Current assignee: Volkswagen Mobvoi Beijing Information Technology Co Ltd
Priority date: 2020-09-29
Filing date: 2020-09-29
Publication date: 2022-04-12

Abstract

The embodiment of the invention discloses a method, a device, a system, equipment and a storage medium for testing voice performance. The method comprises the following steps: test data are obtained through the test data uploading interface and sent to the data storage module; acquiring voice performance test task information through a test task configuration interface, and sending the voice performance test task information to a test execution module corresponding to the test execution module configuration information so that the test execution module performs voice performance test based on the voice performance test task information; the voice performance test task information comprises a task name, test data configuration information, test object configuration information, test interface configuration information and/or test execution module configuration information. The embodiment of the invention can complete the flows of uploading test data, configuring voice performance test task information, managing and displaying test results and the like in an interface interaction mode, is simple and convenient to operate, improves the test efficiency and reduces the test difficulty.

Description

Voice performance testing method, device, system, equipment and storage medium

Technical Field

The embodiment of the invention relates to the technical field of computers, in particular to a method, a device, a system, equipment and a storage medium for testing voice performance.

Background

Products such as intelligent terminals, such as smart phones and intelligent sound equipment, are changing day by day, and with the development of scientific technology and the continuous improvement of user service requirements, more and more intelligent terminals with a voice recognition function and a semantic understanding function appear on the market.

In the related art, the method for testing the voice recognition function and the semantic understanding function of the intelligent terminal generally includes: and calling a voice recognition interface or a semantic understanding interface of the intelligent terminal by using the unified test audio or test text for each intelligent terminal to obtain a voice recognition result or a semantic recognition result of the intelligent terminal.

The test mode of the related technology can test the voice recognition function and the semantic understanding function of the intelligent terminal in batch, but the test method is fixed and cannot be flexibly adjusted.

Disclosure of Invention

Embodiments of the present invention provide a method, an apparatus, a system, a device, and a storage medium for testing voice performance, which can make a voice performance testing manner more flexible, and improve efficiency and usability of voice performance testing.

In a first aspect, an embodiment of the present invention further provides a method for testing voice performance, including:

test data are obtained through a test data uploading interface and are sent to a data storage module;

acquiring voice performance test task information through a test task configuration interface, and sending the voice performance test task information to a test execution module corresponding to the test execution module configuration information so that the test execution module performs a voice performance test based on the voice performance test task information;

the voice performance test task information comprises a task name, test data configuration information, test object configuration information, test interface configuration information and/or test execution module configuration information.

In a second aspect, an embodiment of the present invention further provides a method for testing voice performance, including:

when receiving voice performance test task information sent by an information interaction module, acquiring target test data corresponding to the voice performance test task information from a data storage module according to test data configuration information in the voice performance test task information;

calling a to-be-tested interface of a to-be-tested terminal device corresponding to the voice performance test task information according to test object configuration information and test interface configuration information in the voice performance test task information, sending the target test data to the to-be-tested terminal device corresponding to the voice performance test task information, and acquiring a voice recognition result or a semantic understanding result fed back by the to-be-tested terminal device corresponding to the voice performance test task information;

and generating a voice recognition test result or a semantic understanding test result according to the voice recognition result or the semantic understanding result and the task name, and sending the voice recognition test result or the semantic understanding test result to the data storage module.

In a third aspect, an embodiment of the present invention further provides a device for testing voice performance, including:

the test data transmitting unit is used for acquiring test data through a test data uploading interface and transmitting the test data to the data storage module;

the task information sending unit is used for obtaining voice performance test task information through a test task configuration interface and sending the voice performance test task information to a test execution module corresponding to the test execution module configuration information so that the test execution module performs voice performance test based on the voice performance test task information;

In a fourth aspect, an embodiment of the present invention further provides a device for testing voice performance, including:

the test data acquisition unit is used for acquiring target test data corresponding to the voice performance test task information from the data storage module according to test data configuration information in the voice performance test task information when receiving the voice performance test task information sent by the information interaction module;

a feedback result obtaining unit, configured to call a to-be-tested interface of a to-be-tested terminal device corresponding to the voice performance test task information according to test object configuration information and test interface configuration information in the voice performance test task information, send the target test data to the to-be-tested terminal device corresponding to the voice performance test task information, and obtain a voice recognition result or a semantic understanding result fed back by the to-be-tested terminal device corresponding to the voice performance test task information;

and the test result sending unit is used for generating a voice recognition test result or a semantic understanding test result according to the voice recognition result or the semantic understanding result and the task name and sending the voice recognition test result or the semantic understanding test result to the data storage module.

In a fifth aspect, an embodiment of the present invention provides a voice performance testing system, including:

the system comprises an information interaction module, a data storage module, at least two test execution modules and at least two terminal devices to be tested;

the information interaction module is used for acquiring test data through a test data uploading interface and sending the test data to the data storage module; acquiring voice performance test task information through a test task configuration interface, and sending the voice performance test task information to a test execution module corresponding to the test execution module configuration information, wherein the voice performance test task information comprises a task name, test data configuration information, test object configuration information, test interface configuration information and/or test execution module configuration information; the data storage module is used for receiving the test data and storing the test data; storing the voice recognition test result or the semantic understanding test result sent by each test execution module;

each test execution module is used for acquiring target test data corresponding to the voice performance test task information from the data storage module according to test data configuration information in the voice performance test task information when the voice performance test task information sent by the information interaction module is received; calling a to-be-tested interface of a to-be-tested terminal device corresponding to the voice performance test task information according to test object configuration information and test interface configuration information in the voice performance test task information, sending the target test data to the to-be-tested terminal device corresponding to the voice performance test task information, and acquiring a voice recognition result or a semantic understanding result fed back by the to-be-tested terminal device corresponding to the voice performance test task information; generating a voice recognition test result or a semantic understanding test result according to the voice recognition result or the semantic understanding result and the task name, and sending the voice recognition test result or the semantic understanding test result to the data storage module;

and each terminal device to be tested is used for carrying out voice recognition or semantic understanding on the target test data when receiving the target test data corresponding to the voice performance test task information, and generating a voice recognition result or a semantic understanding result to feed back to the corresponding test execution module.

In a sixth aspect, an embodiment of the present invention further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the voice performance testing method according to the embodiment of the present invention.

In a seventh aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the voice performance testing method according to the embodiment of the present invention.

According to the technical scheme of the embodiment of the invention, the test data is acquired through the test data uploading interface, the voice performance test task information is acquired through the test task configuration interface, the processes of uploading the test data, configuring the voice performance test task information and the like can be completed in an interface interaction mode, the operation is simple and convenient, the efficiency of voice performance test is improved, the difficulty of voice performance test is reduced, and a user without programming language base can also perform voice performance automatic test by using simple interface interaction based on the voice performance test system.

Drawings

Fig. 1 is a schematic structural diagram of a voice performance testing system according to an embodiment of the present invention.

Fig. 2 is a flowchart of a voice performance testing method according to a second embodiment of the present invention.

Fig. 3 is a flowchart of a voice performance testing method according to a third embodiment of the present invention.

Fig. 4 is a schematic structural diagram of a speech performance testing apparatus according to a fourth embodiment of the present invention.

Fig. 5 is a schematic structural diagram of a speech performance testing apparatus according to a fifth embodiment of the present invention.

Fig. 6 is a schematic structural diagram of a computer device according to a sixth embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention.

It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.

Example one

Fig. 1 is a schematic structural diagram of a voice performance testing system according to an embodiment of the present invention. The embodiment of the invention can be suitable for testing the voice recognition function or the semantic understanding function of the terminal equipment. As shown in fig. 1, the voice performance testing system may specifically include: the information interaction module 101, the data storage module 102, at least two test execution modules 103, and at least two terminal devices 104 to be tested, the structure and function of which will be described below.

The information interaction module 101 is configured to obtain test data through a test data uploading interface, and send the test data to the data storage module 102; acquiring voice performance test task information through a test task configuration interface, and sending the voice performance test task information to a test execution module 103 corresponding to the test execution module configuration information, wherein the voice performance test task information comprises a task name, test data configuration information, test object configuration information, test interface configuration information and/or test execution module configuration information.

The data storage module 102 is configured to receive the test data and store the test data; and storing the voice recognition test result or the semantic understanding test result sent by each test execution module 103.

Each test execution module 103 is configured to, when receiving the voice performance test task information sent by the information interaction module 101, obtain target test data corresponding to the voice performance test task information from the data storage module 102 according to test data configuration information in the voice performance test task information; calling a to-be-tested interface of the to-be-tested terminal device 104 corresponding to the voice performance test task information according to the test object configuration information and the test interface configuration information in the voice performance test task information, sending the target test data to the to-be-tested terminal device 104 corresponding to the voice performance test task information, and acquiring a voice recognition result or a semantic understanding result fed back by the to-be-tested terminal device 104 corresponding to the voice performance test task information; and generating a voice recognition test result or a semantic understanding test result according to the voice recognition result or the semantic understanding result and the task name, and sending the voice recognition test result or the semantic understanding test result to the data storage module 102.

Each terminal device to be tested 104 is configured to, when receiving target test data corresponding to the voice performance test task information, perform voice recognition or semantic understanding on the target test data, generate a voice recognition result or a semantic understanding result, and feed the voice recognition result or the semantic understanding result back to the corresponding test execution module 103. Specifically, the information interaction module 101 obtains test data through a test data uploading interface, and sends the test data to the data storage module 102. The data storage module 102 receives the test data and stores the test data. The information interaction module 101 acquires voice performance test task information through a test task configuration interface, and sends the voice performance test task information to the test execution module 103 corresponding to the test execution module configuration information, where the voice performance test task information includes a task name, test data configuration information, test object configuration information, test interface configuration information, and/or test execution module configuration information.

When receiving the voice performance test task information sent by the information interaction module 101, the test execution module 103 corresponding to the test execution module configuration information acquires target test data corresponding to the voice performance test task information from the data storage module 102 according to test data configuration information in the voice performance test task information. Then, the test execution module 103 corresponding to the test execution module configuration information calls an interface to be tested of the terminal device to be tested 104 corresponding to the voice performance test task information according to the test object configuration information and the test interface configuration information in the voice performance test task information, sends the target test data to the terminal device to be tested 104 corresponding to the voice performance test task information, and obtains a voice recognition result or a semantic understanding result fed back by the terminal device to be tested 104 corresponding to the voice performance test task information. When receiving the target test data corresponding to the voice performance test task information, the terminal device to be tested 104 corresponding to the voice performance test task information performs voice recognition or semantic understanding on the target test data, generates a voice recognition result or a semantic understanding result, and feeds the voice recognition result or the semantic understanding result back to the corresponding test execution module 103.

The test execution module 103 corresponding to the test execution module configuration information generates a voice recognition test result or a semantic understanding test result according to the voice recognition result or the semantic understanding result and the task name, and sends the voice recognition test result or the semantic understanding test result to the data storage module 102. The data storage module 102 stores the speech recognition test result or the semantic understanding test result sent by the test execution module 103 corresponding to the test execution module configuration information.

Optionally, the information interaction module 101 is further configured to, when a test result query request carrying the task name is obtained through a test result display interface, obtain a speech recognition test result or a semantic understanding test result corresponding to the task name from the data storage module 102, and display the speech recognition test result or the semantic understanding test result corresponding to the task name through the test result display interface.

When the information interaction module 101 obtains a test result query request carrying the task name through a test result display interface, the voice recognition test result or the semantic understanding test result corresponding to the task name is obtained from the data storage module 102, and the voice recognition test result or the semantic understanding test result corresponding to the task name is displayed through the test result display interface.

Optionally, the information interaction module 101 is a server. The test data uploading interface is used for uploading test data. The test data uploading interface can be displayed in the form of a web page. The user can directly access the test data uploading interface provided by the information interaction module 101, upload the test data through the test data uploading interface, and upload the test data to the data storage module 102 of the voice performance test system.

Optionally, the test data uploading interface includes a test data directory and an uploading control; the acquiring test data through the test data uploading interface and sending the test data to the data storage module 102 includes: acquiring test data identification information selected by a user in the test data directory; acquiring test data corresponding to the test data identification information in a preset test database; after the click operation of the user on the uploading control is detected, the test data corresponding to the test data identification information is sent to the data storage module 102.

Optionally, the test data directory includes test data identification information of a plurality of items of test data. Each item of test data has corresponding test data identification information. The test data identification information is used for distinguishing various test data. The preset test database stores a plurality of items of test data. Each item of test data includes test audio, test text, an expected speech recognition result corresponding to the test audio, and/or an expected semantic understanding result corresponding to the test text. The test audio is audio for testing a voice recognition function. The expected speech recognition result corresponding to the test audio is text corresponding to the sentence in the test audio. The test text is text for testing the semantic understanding function. The expected semantic understanding result corresponding to the test text is an operation that the user contained in the test text wants to perform.

Optionally, the upload control is a control for inputting a test data upload instruction. The test data upload instruction is an instruction for sending the test data corresponding to the test data identification information to the data storage module 102.

Specifically, the user opens a test data uploading interface provided by the information interaction module 101, selects test data identification information of a certain item of test data to be uploaded in the test data directory, and then clicks the uploading control. The information interaction module 101 acquires test data identification information selected by a user in the test data directory, then acquires test data corresponding to the test data identification information in a preset test database, and sends the test data corresponding to the test data identification information to the data storage module 102 after detecting a click operation of the user on the uploading control.

Optionally, the data storage module 102 is a server. The data storage module 102 receives the test data and stores the test data in a database. The data storage module 102 receives the speech recognition test result or the semantic understanding test result sent by each test execution module 103, and stores the speech recognition test result or the semantic understanding test result in the database.

Optionally, the test task configuration interface is an interface for configuring the voice performance test task information. The voice performance test task information is information for performing a voice performance test. One piece of voice performance test task information corresponds to one piece of voice performance test task. The test execution module 103 may execute the voice performance test task according to the voice performance test task information, and test the voice recognition function or semantic understanding function of the specified terminal device 104 to be tested. The test task configuration interface may be presented in the form of a web page. The user can directly access the test task configuration interface provided by the information interaction module 101, and perform configuration of the voice performance test task information through the test task configuration interface. The voice performance test task information comprises a task name, test data configuration information, test object configuration information, test interface configuration information and/or test execution module configuration information.

Optionally, the test task configuration interface includes: a task name configuration area, a test data configuration area, a test object configuration area, a test interface configuration area, a test execution module configuration area and/or a configuration completion control; the acquiring of the voice performance test task information through the test task configuration interface and the sending of the voice performance test task information to the test execution module 103 corresponding to the test execution module configuration information includes: acquiring a task name input by a user in the task name configuration area as a task name; and/or acquiring test data category information input or selected by a user in the test data configuration area as test data configuration information; and/or acquiring a test object input or selected by a user in the test object configuration area as test object configuration information; and/or acquiring an interface address and an access parameter of a to-be-tested interface of the to-be-tested terminal equipment, which are input by a user in the test interface configuration area, as test interface configuration information; and/or acquiring the identification information of the test execution module input or selected by the user in the test execution module configuration area as the configuration information of the test execution module; and/or after the clicking operation of the configuration completion control by the user is detected, sending the voice performance test task information formed by the task name, the test data configuration information, the test object configuration information, the test interface configuration information and/or the test execution module configuration information to the test execution module 103 corresponding to the test execution module configuration information.

Optionally, the task name configuration area is an interface area for inputting a task name. The user can input a custom task name in the task name configuration area. Usually, different speech performance test task information contains different task names. The task name may be used to distinguish between different voice performance testing task information.

Optionally, the test data configuration area is an interface area for inputting test data configuration information. The user may enter or select test data category information in the test data configuration area. The test data category information is audio or text. The test data category information input or selected by the user is the test data configuration information input or selected by the user. If the test data category information input or selected by the user in the test data configuration area is audio, it indicates that when the voice performance test task corresponding to the voice performance test task information is executed, the voice recognition function of the specified terminal device 104 to be tested needs to be tested according to the test audio in the test data and the expected voice recognition result corresponding to the test audio. If the test data category information input or selected by the user in the test data configuration area is a text, it indicates that when the voice performance test task corresponding to the voice performance test task information is executed, the semantic understanding function of the specified terminal device to be tested 104 needs to be tested according to the test text in the test data and the expected semantic understanding result corresponding to the test text.

Optionally, the test object configuration area is an interface area for inputting test object configuration information. The user may enter or select a test object in the test object configuration area. The test object is speech recognition or semantic understanding. The test object input or selected by the user is the test object configuration information input or selected by the user. If the test object input or selected by the user in the test object configuration area is voice recognition, the voice performance test task corresponding to the voice performance test task information is used for testing the voice recognition function. If the test object input or selected by the user in the test object configuration area is semantic understanding, the voice performance test task corresponding to the voice performance test task information is indicated to test the semantic understanding function.

Optionally, the test interface configuration area is an interface area for inputting test interface configuration information. The user can input the interface address and the access parameter of the interface to be tested of the terminal device to be tested 104 needing to perform the voice performance test in the test interface configuration area. The interface address and the access parameter of the interface to be tested of the terminal device to be tested 104, which needs to perform the voice performance test, input by the user are the test interface configuration information input by the user. The interface to be tested is a voice recognition interface or a semantic understanding interface. If the voice performance testing task is to test the voice recognition function, the user inputs the interface address and the access parameter of the voice recognition interface of the terminal device to be tested 104, which needs to be tested for the voice recognition function, in the testing interface configuration area. If the voice performance testing task is to test the semantic understanding function, the user inputs the interface address and the access parameter of the semantic understanding interface of the terminal device to be tested 104 which needs to be tested for the semantic understanding function in the testing interface configuration area.

Optionally, the test execution module configuration area is an interface area of the test execution module 103, which is used for determining to execute the voice performance test task corresponding to the voice performance test task information. The test execution module configuration area includes the test execution module identification information and the operating state of each test execution module 103. Each test execution module 103 has corresponding test execution module identification information. The test execution module identification information is used to distinguish the test execution modules 103. The working state includes idle and in task execution. The test execution module 103 whose operating state is idle does not execute the voice performance test task. The test execution module 103 in the working state is executing the voice performance test task according to the received voice performance test task information. The user may select, in the test execution module configuration area, the test execution module identification information of the test execution module 103 whose operating state is idle. Therefore, the abnormal test result caused by the simultaneous execution of a plurality of voice performance test tasks by the same test execution module 103 can be avoided, and the efficiency of the voice performance test can be improved.

The test execution module 103 corresponding to the test execution module identification information selected by the user is the test execution module 103 corresponding to the test execution module configuration information, and is the test execution module 103 executing the voice performance test task corresponding to the voice performance test task information.

Optionally, the configuration completion control is a control for inputting a configuration completion instruction. The configuration completion instruction is an instruction for determining that the configuration of the voice performance test task information is completed.

Specifically, a user opens a test task configuration interface provided by the information interaction module 101, and inputs a task name in the task name configuration area; inputting or selecting test data category information in the test data configuration area; inputting or selecting a test object in the test object configuration area; inputting an interface address and an access parameter of a to-be-tested interface of the to-be-tested terminal equipment needing voice performance testing in the testing interface configuration area; selecting the test execution module identification information of the test execution module 103 with an idle working state in the test execution module configuration area, and then clicking the configuration completion control. The information interaction module 101 obtains the task name input by the user in the task name configuration area as the task name. The information interaction module 101 obtains the test data category information input or selected by the user in the test data configuration area as the test data configuration information. The information interaction module 101 obtains the test object input or selected by the user in the test object configuration area as the test object configuration information. The information interaction module 101 obtains an interface address and an access parameter of a to-be-tested interface of the to-be-tested terminal device, which are input by a user in the test interface configuration area, as test interface configuration information. The information interaction module 101 obtains the test execution module identification information input or selected by the user in the test execution module configuration area as the test execution module configuration information. After detecting the click operation of the configuration completion control by the user, the information interaction module 101 sends the voice performance test task information composed of the task name, the test data configuration information, the test object configuration information, the test interface configuration information, and/or the test execution module configuration information to the test execution module 103 corresponding to the test execution module configuration information, thereby sending the voice performance test task information to the test execution module 103 selected by the user.

Optionally, the information interaction module 101 may further provide a plurality of configured voice performance test task information to the user through the test task configuration interface. And selecting one piece of voice performance test task information on the test task configuration interface by the user. The information interaction module 101 sends the voice performance test task information to the test execution module 103 corresponding to the test execution module configuration information in the voice performance test task information.

Optionally, each test execution module 103 is a server. The terminal device to be tested 104 is a terminal device with a voice recognition function and a semantic understanding function. If one of the test execution modules 103 receives the voice performance test task information, it indicates that the test execution module 103 is the test execution module 103 selected by the user and needing to execute the voice performance test task corresponding to the voice performance test task information. When receiving the voice performance test task information sent by the information interaction module 101, the test execution module 103 acquires target test data corresponding to the voice performance test task information from the data storage module 102 according to test data configuration information in the voice performance test task information. Then, according to the test object configuration information and the test interface configuration information in the voice performance test task information, calling an interface to be tested of the terminal device to be tested 104 corresponding to the voice performance test task information, sending the target test data to the terminal device to be tested 104 corresponding to the voice performance test task information, and obtaining a voice recognition result or a semantic understanding result fed back by the terminal device to be tested 104 corresponding to the voice performance test task information. And finally, generating a voice recognition test result or a semantic understanding test result according to the voice recognition result or the semantic understanding result and the task name, and sending the voice recognition test result or the semantic understanding test result to the data storage module 102.

In a specific example, the test execution module 103 receives that the test data configuration information in the voice performance test task information is an audio frequency, the test object configuration information is voice recognition, and the test interface configuration information includes an interface address and an access parameter of a voice recognition interface of the terminal device to be tested 104 corresponding to the voice performance test task information. The interface address and the access parameter of the voice recognition interface of the terminal device to be tested 104 corresponding to the voice performance test task information are the interface address and the access parameter of the voice recognition interface of the terminal device to be tested 104 that needs to perform the voice recognition function test. The test execution module 103 obtains a test audio and an expected voice recognition result corresponding to the test audio from the data storage module 102 according to the audio, and determines the test audio as target test data corresponding to the voice performance test task information. Then, the test execution module 103 calls the voice recognition interface of the terminal device to be tested corresponding to the voice performance test task information according to the voice recognition, and the interface address and the access parameter of the voice recognition interface of the terminal device to be tested 104 corresponding to the voice performance test task information, sends the test audio to the terminal device to be tested 104 corresponding to the voice performance test task information, and obtains a voice recognition result fed back by the terminal device to be tested 104 corresponding to the voice performance test task information. When receiving the test audio, the terminal device 104 to be tested corresponding to the voice performance test task information performs voice Recognition on the test audio by using an Automatic Speech Recognition (ASR) technology to obtain a voice Recognition result of the test audio, and feeds the voice Recognition result back to the corresponding test execution module 103, i.e., feeds the voice Recognition result back to the test execution module 103 that sends the test audio. The voice recognition result is a text corresponding to a sentence in the test audio recognized by the terminal device 104 to be tested.

Optionally, the test execution module 103 obtains a voice recognition result fed back by the terminal device to be tested 104 corresponding to the voice performance test task information, and sends a voice recognition test result formed by a task name and the voice recognition result to the data storage module 102.

Optionally, the test execution module 103 obtains a voice recognition result fed back by the terminal device to be tested 104 corresponding to the voice performance test task information, calculates a similarity between the voice recognition result and an expected voice recognition result, and then sends the voice recognition test result formed by the task name, the voice recognition result, and the similarity between the voice recognition result and the expected voice recognition result to the data storage module 102.

In another specific example, the test execution module 103 receives that the test data configuration information in the voice performance test task information is a text, the test object configuration information is semantic understanding, and the test interface configuration information includes an interface address and an access parameter of a semantic understanding interface of the terminal device to be tested 104 corresponding to the voice performance test task information. The interface address and the access parameter of the semantic understanding interface of the terminal device to be tested 104 corresponding to the voice performance testing task information are the interface address and the access parameter of the semantic understanding interface of the terminal device to be tested 104 that needs to perform the semantic understanding function test. The test execution module 103 obtains a test text and an expected semantic understanding result corresponding to the test text from the data storage module 102 according to the text, and determines the test text as target test data corresponding to the voice performance test task information. Then, the test execution module 103 calls the semantic understanding interface of the terminal device to be tested 104 corresponding to the voice performance test task information according to the semantic understanding, and the interface address and the access parameter of the semantic understanding interface of the terminal device to be tested 104 corresponding to the voice performance test task information, sends the test text to the terminal device to be tested 104 corresponding to the voice performance test task information, and obtains a semantic understanding result fed back by the terminal device to be tested 104 corresponding to the voice performance test task information.

When receiving the test text, the terminal device to be tested 104 corresponding to the voice performance test task information performs semantic Understanding on the test text by using a Natural Language Understanding (NLU) technology to obtain a semantic Understanding result of the test text, and feeds the semantic Understanding result back to the corresponding test execution module 103, that is, feeds the semantic Understanding result back to the test execution module 103 that sends the test text.

Optionally, the test execution module 103 obtains a semantic understanding result fed back by the terminal device to be tested 104 corresponding to the voice performance test task information, and sends a semantic understanding test result formed by a task name and the semantic understanding result to the data storage module 102.

Optionally, the test execution module 103 obtains a semantic understanding result fed back by the terminal device to be tested 104 corresponding to the voice performance test task information, calculates a similarity between the semantic understanding result and an expected semantic understanding result, and then sends a semantic understanding test result formed by a task name, the semantic understanding result, and the similarity between the semantic understanding result and the expected semantic understanding result to the data storage module 102.

Optionally, the test result display interface includes a task name input area, a query control, and/or a test result display area. The task name input area is an interface area for inputting a task name. The query control is used for generating a test result query request carrying the task name according to the task name in the task name input area. The test result query request is used for requesting to query the voice recognition test result or the semantic understanding test result containing the specified task name. The test result display area is an interface area for displaying a voice recognition test result or a semantic understanding test result.

Specifically, the user may input a task name included in the speech recognition test result or the semantic understanding test result to be queried in the task name input area, and then click the query control. The information interaction module 101 obtains a test result query request carrying a task name generated by a query control according to the task name in the task name input area, and obtains a voice recognition test result or a semantic understanding test result corresponding to the task name from the data storage module 102. And the voice recognition test result or the semantic understanding test result corresponding to the task name is the voice recognition test result or the semantic understanding test result containing the specified task name. Then, the information interaction module 101 displays the speech recognition test result or the semantic understanding test result corresponding to the task name in the test result display area, so that the user can browse the speech recognition test result or the semantic understanding test result corresponding to the task name in the test result display area.

Optionally, before obtaining the speech recognition test result or the semantic understanding test result corresponding to the task name from the data storage module, the method further includes: and authenticating the test result query request according to the authentication information corresponding to the task name.

Optionally, authentication information corresponding to each task name is preset. The authentication information is information for performing authentication. The authentication information may be a key.

Specifically, the user inputs the task name and the authentication information included in the voice recognition test result or the semantic understanding test result to be queried in the task name input area, and then clicks the query control. The information interaction module 101 obtains a test result query request which is generated by the query control according to the task name and the authentication information in the task name input area and carries the task name and the authentication information, authenticates the test result query request according to the authentication information corresponding to the task name, and judges whether the authentication information in the test result query request is the authentication information corresponding to the task name. If the authentication information in the test result query request is the authentication information corresponding to the task name, acquiring a voice recognition test result or a semantic understanding test result corresponding to the task name from the data storage module 102, and displaying the voice recognition test result or the semantic understanding test result corresponding to the task name in a test result display area. And if the authentication information in the test result query request is not the authentication information corresponding to the task name, displaying query permission prompt information in a test result display area. The inquiry authority prompt information is used for informing the user: and if the authentication fails, inquiring a voice recognition test result or a semantic understanding test result corresponding to the task name without permission.

Optionally, the user configures a mailbox corresponding to the task name in a test task configuration interface provided by the information interaction module 101. The data storage module 102 receives the voice recognition test result or the semantic understanding test result sent by the test execution module 103, stores the voice recognition test result or the semantic understanding test result in the database, and then sends the voice recognition test result or the semantic understanding test result to the mailbox corresponding to the task name included in the voice recognition test result or the semantic understanding test result.

The embodiment of the invention provides a voice performance test system, which is characterized in that test data are acquired through a test data uploading interface through an information interaction module, and the test data are sent to a data storage module for storage; the information interaction module acquires voice performance test task information through the test task configuration interface and sends the voice performance test task information to the test execution module corresponding to the test execution module configuration information, so that the test execution module corresponding to the test execution module configuration information acquires target test data corresponding to the voice performance test task information from the data storage module according to test data configuration information in the voice performance test task information, calls a to-be-tested interface of the to-be-tested terminal equipment corresponding to the voice performance test task information according to test object configuration information and test interface configuration information in the voice performance test task information, sends the target test data to the to-be-tested terminal equipment corresponding to the voice performance test task information, and acquires a voice recognition result or semantic understanding result fed back by the to-be-tested terminal equipment corresponding to the voice performance test task information, generating a voice recognition test result or a semantic understanding test result according to the voice recognition result or the semantic understanding result and the task name, and sending the voice recognition test result or the semantic understanding test result to a data storage module for storage; when the information interaction module obtains a test result query request carrying the task name through the test result display interface, the voice recognition test result or the semantic understanding test result corresponding to the task name is obtained from the data storage module, the voice recognition test result or the semantic understanding test result corresponding to the task name is displayed through the test result display interface, the voice performance test automation process can be integrated, the processes of test data uploading, voice performance test task information configuration and the like are completed in an interface interaction mode, the operation is simple and convenient, the efficiency of voice performance test is improved, the difficulty of voice performance test is reduced, and a user without programming language base can also perform the voice performance automation test through a simple interface interaction based on the voice performance test system.

Example two

Fig. 2 is a flowchart of a voice performance testing method according to a second embodiment of the present invention. The embodiment of the invention can be suitable for testing the voice recognition function or the semantic understanding function of the terminal equipment. The method can be applied to the information interaction module in the voice performance test system provided by the embodiment of the invention. As shown in fig. 2, the method of this embodiment specifically includes:

step 201, obtaining test data through a test data uploading interface, and sending the test data to a data storage module.

Optionally, the information interaction module is a server. The test data uploading interface is used for uploading test data. The test data uploading interface can be displayed in the form of a web page. The user can directly access the test data uploading interface provided by the information interaction module, upload the test data through the test data uploading interface and upload the test data to the data storage module of the voice performance test system.

Optionally, the test data uploading interface includes a test data directory and an uploading control; the test data is obtained through the test data uploading interface and is sent to the data storage module, and the method comprises the following steps: acquiring test data identification information selected by a user in the test data directory; acquiring test data corresponding to the test data identification information in a preset test database; and after the clicking operation of the user on the uploading control is detected, sending the test data corresponding to the test data identification information to a data storage module.

Optionally, the upload control is a control for inputting a test data upload instruction. The test data uploading instruction is an instruction for sending the test data corresponding to the test data identification information to the data storage module.

Specifically, the user opens a test data uploading interface provided by the information interaction module, selects test data identification information of a certain item of test data to be uploaded in the test data directory, and then clicks the uploading control. The information interaction module acquires test data identification information selected by a user in the test data directory, then acquires test data corresponding to the test data identification information in a preset test database, and sends the test data corresponding to the test data identification information to the data storage module after detecting the click operation of the user on the uploading control.

Step 202, obtaining voice performance test task information through a test task configuration interface, and sending the voice performance test task information to a test execution module corresponding to the test execution module configuration information, so that the test execution module performs a voice performance test based on the voice performance test task information.

Optionally, the test task configuration interface is an interface for configuring the voice performance test task information. The voice performance test task information is information for performing a voice performance test. One piece of voice performance test task information corresponds to one piece of voice performance test task. The test execution module can execute the voice performance test task according to the voice performance test task information and test the voice recognition function or semantic understanding function of the appointed terminal equipment to be tested. The test task configuration interface may be presented in the form of a web page. The user can directly access the test task configuration interface provided by the information interaction module, and the voice performance test task information is configured through the test task configuration interface. The voice performance test task information comprises a task name, test data configuration information, test object configuration information, test interface configuration information and/or test execution module configuration information.

Optionally, the test task configuration interface includes: a task name configuration area, a test data configuration area, a test object configuration area, a test interface configuration area, a test execution module configuration area and/or a configuration completion control; the method for acquiring the voice performance test task information through the test task configuration interface and sending the voice performance test task information to the test execution module corresponding to the test execution module configuration information comprises the following steps: acquiring a task name input by a user in the task name configuration area as a task name; and/or acquiring test data category information input or selected by a user in the test data configuration area as test data configuration information; and/or acquiring a test object input or selected by a user in the test object configuration area as test object configuration information; and/or acquiring an interface address and an access parameter of a to-be-tested interface of the to-be-tested terminal equipment, which are input by a user in the test interface configuration area, as test interface configuration information; and/or acquiring the identification information of the test execution module input or selected by the user in the test execution module configuration area as the configuration information of the test execution module; and/or after the clicking operation of the configuration completion control by the user is detected, sending the voice performance test task information formed by the task name, the test data configuration information, the test object configuration information, the test interface configuration information and/or the test execution module configuration information to the test execution module corresponding to the test execution module configuration information.

Optionally, the test data configuration area is an interface area for inputting test data configuration information. The user may enter or select test data category information in the test data configuration area. The test data category information is audio or text. The test data category information input or selected by the user is the test data configuration information input or selected by the user. If the test data category information input or selected by the user in the test data configuration area is audio, it indicates that when the voice performance test task corresponding to the voice performance test task information is executed, the voice recognition function of the specified terminal device to be tested needs to be tested according to the test audio in the test data and the expected voice recognition result corresponding to the test audio. If the test data category information input or selected by the user in the test data configuration area is a text, it indicates that when the voice performance test task corresponding to the voice performance test task information is executed, the semantic understanding function of the specified terminal device to be tested needs to be tested according to the test text in the test data and the expected semantic understanding result corresponding to the test text.

Optionally, the test interface configuration area is an interface area for inputting test interface configuration information. The user can input the interface address and the access parameter of the interface to be tested of the terminal device to be tested, which needs to perform the voice performance test, in the test interface configuration area. The interface address and the access parameter of the interface to be tested of the terminal equipment to be tested, which is required to perform the voice performance test and is input by the user, are the test interface configuration information input by the user. The interface to be tested is a voice recognition interface or a semantic understanding interface. If the voice performance testing task is to test the voice recognition function, the user inputs the interface address and the access parameter of the voice recognition interface of the terminal device to be tested, which needs to be tested the voice recognition function, in the testing interface configuration area. If the voice performance testing task is to test the semantic understanding function, the user inputs the interface address and the access parameter of the semantic understanding interface of the terminal equipment to be tested, which needs to test the semantic understanding function, in the testing interface configuration area.

Optionally, the test execution module configuration area is an interface area of the test execution module for determining to execute the voice performance test task corresponding to the voice performance test task information. The test execution module configuration area comprises the test execution module identification information and the working state of each test execution module. Each test execution module has corresponding test execution module identification information. The test execution module identification information is used for distinguishing each test execution module. The working state includes idle and in task execution. The test execution module with the working state of idle does not execute the voice performance test task. And the working state is that the test execution module in task execution executes the voice performance test task according to the received voice performance test task information. The user can select the test execution module identification information of a test execution module with an idle working state in the test execution module configuration area. Therefore, the abnormal test result caused by the fact that the same test execution module executes a plurality of voice performance test tasks at the same time can be avoided, and the efficiency of voice performance test can be improved.

The test execution module corresponding to the test execution module identification information selected by the user is the test execution module corresponding to the test execution module configuration information, and is the test execution module for executing the voice performance test task corresponding to the voice performance test task information.

Specifically, a user opens a test task configuration interface provided by an information interaction module, and inputs a task name in a task name configuration area; inputting or selecting test data category information in the test data configuration area; inputting or selecting a test object in the test object configuration area; inputting an interface address and an access parameter of a to-be-tested interface of the to-be-tested terminal equipment needing voice performance testing in the testing interface configuration area; and selecting the identification information of the test execution module with an idle working state in the configuration area of the test execution module, and then clicking the configuration completion control. And the information interaction module acquires the task name input by the user in the task name configuration area as the task name. And the information interaction module acquires the test data type information input or selected by the user in the test data configuration area as the test data configuration information. And the information interaction module acquires the test object input or selected by the user in the test object configuration area as the test object configuration information. And the information interaction module acquires the interface address and the access parameter of the to-be-tested interface of the to-be-tested terminal equipment, which are input by a user in the test interface configuration area, and the interface address and the access parameter are used as test interface configuration information. And the information interaction module acquires the identification information of the test execution module input or selected by the user in the configuration area of the test execution module as the configuration information of the test execution module. After detecting the clicking operation of the configuration completion control by the user, the information interaction module sends the voice performance test task information formed by the task name, the test data configuration information, the test object configuration information, the test interface configuration information and/or the test execution module configuration information to the test execution module corresponding to the test execution module configuration information, so that the voice performance test task information is sent to the test execution module selected by the user.

Optionally, the information interaction module may further provide a plurality of configured voice performance test task information to the user through the test task configuration interface. And selecting one piece of voice performance test task information on the test task configuration interface by the user. And the information interaction module sends the voice performance test task information to a test execution module corresponding to the test execution module configuration information in the voice performance test task information.

Optionally, the performing module performs the voice performance test based on the voice performance test task information, including: when receiving voice performance test task information sent by an information interaction module, acquiring target test data corresponding to the voice performance test task information from a data storage module according to test data configuration information in the voice performance test task information; calling a to-be-tested interface of a to-be-tested terminal device corresponding to the voice performance test task information according to test object configuration information and test interface configuration information in the voice performance test task information, sending the target test data to the to-be-tested terminal device corresponding to the voice performance test task information, and acquiring a voice recognition result or a semantic understanding result fed back by the to-be-tested terminal device corresponding to the voice performance test task information; and generating a voice recognition test result or a semantic understanding test result according to the voice recognition result or the semantic understanding result and the task name, and sending the voice recognition test result or the semantic understanding test result to the data storage module.

Optionally, the voice performance testing method further includes: and when a test result query request carrying the task name is acquired through a test result display interface, acquiring a voice recognition test result or a semantic understanding test result corresponding to the task name from the data storage module, and displaying the voice recognition test result or the semantic understanding test result corresponding to the task name through the test result display interface.

Specifically, the user may input a task name included in the speech recognition test result or the semantic understanding test result to be queried in the task name input area, and then click the query control. The information interaction module acquires a test result query request which is generated by the query control according to the task name in the task name input area and carries the task name, and acquires a voice recognition test result or a semantic understanding test result corresponding to the task name from the data storage module. And the voice recognition test result or the semantic understanding test result corresponding to the task name is the voice recognition test result or the semantic understanding test result containing the specified task name. And then the information interaction module displays the voice recognition test result or the semantic understanding test result corresponding to the task name in a test result display area, so that a user can browse the voice recognition test result or the semantic understanding test result corresponding to the task name in the test result display area.

Specifically, the user inputs the task name and the authentication information included in the voice recognition test result or the semantic understanding test result to be queried in the task name input area, and then clicks the query control. The information interaction module acquires a test result query request which is generated by the query control and carries the task name and the authentication information according to the task name and the authentication information in the task name input area, authenticates the test result query request according to the authentication information corresponding to the task name, and judges whether the authentication information in the test result query request is the authentication information corresponding to the task name. And if the authentication information in the test result query request is the authentication information corresponding to the task name, acquiring a voice recognition test result or a semantic understanding test result corresponding to the task name from the data storage module, and displaying the voice recognition test result or the semantic understanding test result corresponding to the task name in a test result display area. And if the authentication information in the test result query request is not the authentication information corresponding to the task name, displaying query permission prompt information in a test result display area. The inquiry authority prompt information is used for informing the user: and if the authentication fails, inquiring a voice recognition test result or a semantic understanding test result corresponding to the task name without permission.

The embodiment of the invention provides a voice performance testing method, which is characterized in that test data are obtained through a test data uploading interface, voice performance testing task information are obtained through a testing task configuration interface, and the processes of uploading the test data, configuring the voice performance testing task information and the like can be completed in an interface interaction mode.

EXAMPLE III

Fig. 3 is a flowchart of a voice performance testing method according to a third embodiment of the present invention. The embodiment of the invention can be suitable for testing the voice recognition function or the semantic understanding function of the terminal equipment. The method can be applied to the test execution module in the voice performance test system provided by the above embodiment of the invention. As shown in fig. 3, the method of this embodiment specifically includes:

step 301, when receiving the voice performance test task information sent by the information interaction module, obtaining target test data corresponding to the voice performance test task information from a data storage module according to test data configuration information in the voice performance test task information.

Optionally, each test execution module is a server. The terminal equipment to be tested is terminal equipment with a voice recognition function and a semantic understanding function. And if one test execution module receives the voice performance test task information, the test execution module is a test execution module which is selected by the user and needs to execute the voice performance test task corresponding to the voice performance test task information.

Optionally, the test data includes test audio, test text, an expected speech recognition result corresponding to the test audio, and/or an expected semantic understanding result corresponding to the test text.

Optionally, the test data configuration information is audio, the test object configuration information is voice recognition, and the test interface configuration information includes an interface address and an access parameter of a voice recognition interface of the terminal device to be tested, which correspond to the voice performance test task information; the acquiring, from the data storage module, target test data corresponding to the voice performance test task information according to the test data configuration information in the voice performance test task information includes: according to the audio, acquiring a test audio and an expected voice recognition result corresponding to the test audio from the data storage module; and determining the test audio as target test data corresponding to the voice performance test task information.

Optionally, the test data configuration information is a text, the test object configuration information is semantic understanding, and the test interface configuration information includes an interface address and an access parameter of a semantic understanding interface of the terminal device to be tested, which correspond to the voice performance test task information; the acquiring, from the data storage module, target test data corresponding to the voice performance test task information according to the test data configuration information in the voice performance test task information includes: according to the text, obtaining a test text and an expected semantic understanding result corresponding to the test text from the data storage module; and determining the test text as target test data corresponding to the voice performance test task information.

Step 302, according to the test object configuration information and the test interface configuration information in the voice performance test task information, calling an interface to be tested of the terminal device to be tested corresponding to the voice performance test task information, sending the target test data to the terminal device to be tested corresponding to the voice performance test task information, and obtaining a voice recognition result or a semantic understanding result fed back by the terminal device to be tested corresponding to the voice performance test task information.

Optionally, the test data configuration information is audio, the test object configuration information is voice recognition, and the test interface configuration information includes an interface address and an access parameter of a voice recognition interface of the terminal device to be tested, which correspond to the voice performance test task information; the method for obtaining the voice recognition result or the semantic understanding result fed back by the terminal equipment to be tested corresponding to the voice performance test task information comprises the following steps of calling an interface to be tested of the terminal equipment to be tested corresponding to the voice performance test task information according to the test object configuration information and the test interface configuration information in the voice performance test task information, sending the target test data to the terminal equipment to be tested corresponding to the voice performance test task information, and obtaining the voice recognition result or the semantic understanding result fed back by the terminal equipment to be tested corresponding to the voice performance test task information, wherein the interface to be tested comprises: calling a voice recognition interface of the terminal equipment to be tested corresponding to the voice performance test task information according to the voice recognition and the interface address and the access parameter of the voice recognition interface of the terminal equipment to be tested corresponding to the voice performance test task information, sending the test audio to the terminal equipment to be tested corresponding to the voice performance test task information, and acquiring a voice recognition result fed back by the terminal equipment to be tested corresponding to the voice performance test task information.

Optionally, the test data configuration information is a text, the test object configuration information is semantic understanding, and the test interface configuration information includes an interface address and an access parameter of a semantic understanding interface of the terminal device to be tested, which correspond to the voice performance test task information; the method for obtaining the voice recognition result or the semantic understanding result fed back by the terminal equipment to be tested corresponding to the voice performance test task information comprises the following steps of calling an interface to be tested of the terminal equipment to be tested corresponding to the voice performance test task information according to the test object configuration information and the test interface configuration information in the voice performance test task information, sending the target test data to the terminal equipment to be tested corresponding to the voice performance test task information, and obtaining the voice recognition result or the semantic understanding result fed back by the terminal equipment to be tested corresponding to the voice performance test task information, wherein the interface to be tested comprises: calling a semantic understanding interface of the terminal equipment to be tested corresponding to the voice performance test task information according to the semantic understanding and the interface address and the access parameter of the semantic understanding interface of the terminal equipment to be tested corresponding to the voice performance test task information, sending the test text to the terminal equipment to be tested corresponding to the voice performance test task information, and acquiring a semantic understanding result fed back by the terminal equipment to be tested corresponding to the voice performance test task information.

Step 303, generating a voice recognition test result or a semantic understanding test result according to the voice recognition result or the semantic understanding result and the task name, and sending the voice recognition test result or the semantic understanding test result to the data storage module.

Optionally, the test execution module obtains a voice recognition result fed back by the terminal device to be tested corresponding to the voice performance test task information, and sends a voice recognition test result composed of a task name and the voice recognition result to the data storage module.

Optionally, the test execution module obtains a voice recognition result fed back by the terminal device to be tested corresponding to the voice performance test task information, calculates a similarity between the voice recognition result and an expected voice recognition result, and then sends the voice recognition test result composed of the task name, the voice recognition result, and the similarity between the voice recognition result and the expected voice recognition result to the data storage module.

Optionally, the test execution module obtains a semantic understanding result fed back by the terminal device to be tested corresponding to the voice performance test task information, and sends the semantic understanding test result formed by the task name and the semantic understanding result to the data storage module.

Optionally, the test execution module obtains a semantic understanding result fed back by the terminal device to be tested corresponding to the voice performance test task information, calculates a similarity between the semantic understanding result and an expected semantic understanding result, and then sends the semantic understanding test result composed of the task name, the semantic understanding result, and the similarity between the semantic understanding result and the expected semantic understanding result to the data storage module.

The embodiment of the invention provides a voice performance testing method, which comprises the steps of acquiring target testing data corresponding to voice performance testing task information from a data storage module through a testing execution module according to testing data configuration information in the voice performance testing task information, calling a to-be-tested interface of a to-be-tested terminal device corresponding to the voice performance testing task information according to testing object configuration information and testing interface configuration information in the voice performance testing task information, sending the target testing data to the to-be-tested terminal device corresponding to the voice performance testing task information, acquiring a voice recognition result or a semantic understanding result fed back by the to-be-tested terminal device corresponding to the voice performance testing task information, generating the voice recognition testing result or the semantic understanding testing result according to the voice recognition result or the semantic understanding result and a task name, sending the voice recognition testing result or the semantic understanding testing result to the data storage module for storage, the voice recognition function or the semantic understanding function of the terminal equipment to be tested can be automatically tested according to the test data acquired through the test data uploading interface and the voice performance test task information acquired through the test task configuration interface.

Example four

Fig. 4 is a schematic structural diagram of a speech performance testing apparatus according to a fourth embodiment of the present invention. The device may be configured in the information interaction module in the voice performance test system provided in the above embodiment of the present invention. As shown in fig. 4, the apparatus includes: a test data transmission unit 401 and a task information transmission unit 402.

The test data sending unit 401 is configured to obtain test data through a test data uploading interface, and send the test data to a data storage module; a task information sending unit 402, configured to obtain voice performance test task information through a test task configuration interface, and send the voice performance test task information to a test execution module corresponding to the test execution module configuration information, so that the test execution module performs a voice performance test based on the voice performance test task information; the voice performance test task information comprises a task name, test data configuration information, test object configuration information, test interface configuration information and/or test execution module configuration information.

The embodiment of the invention provides a voice performance testing device, which acquires test data through a test data uploading interface and acquires voice performance testing task information through a testing task configuration interface, can complete the processes of uploading the test data, configuring the voice performance testing task information and the like in an interface interaction mode, is simple and convenient to operate, improves the efficiency of voice performance testing, reduces the difficulty of voice performance testing, and enables users without programming language bases to perform voice performance automatic testing through simple interface interaction based on a voice performance testing system.

In an optional implementation manner of the embodiment of the present invention, optionally, the voice performance testing apparatus further includes: and the test result query unit is used for acquiring a voice recognition test result or a semantic understanding test result corresponding to the task name from the data storage module when a test result query request carrying the task name is acquired through a test result display interface, and displaying the voice recognition test result or the semantic understanding test result corresponding to the task name through the test result display interface.

In an optional implementation manner of the embodiment of the present invention, optionally, the test data upload interface includes a test data directory and an upload control; the test data transmission unit 401 includes: the identification information acquisition subunit is used for acquiring the test data identification information selected by the user in the test data catalog; the test data acquisition subunit is used for acquiring test data corresponding to the test data identification information in a preset test database; and the test data sending subunit is used for sending the test data corresponding to the test data identification information to a data storage module after detecting the click operation of the user on the uploading control.

In an optional implementation manner of the embodiment of the present invention, optionally, the test task configuration interface includes: a task name configuration area, a test data configuration area, a test object configuration area, a test interface configuration area, a test execution module configuration area and/or a configuration completion control; the task information sending unit 402 includes: the first acquiring subunit is used for acquiring the task name input by the user in the task name configuration area as the task name; and/or the second acquiring subunit is used for acquiring the test data category information input or selected by the user in the test data configuration area as the test data configuration information; and/or, a third obtaining subunit, configured to obtain a test object input or selected by a user in the test object configuration area, as test object configuration information; and/or, a fourth obtaining subunit, configured to obtain, as test interface configuration information, an interface address and an access parameter of a to-be-tested interface of the to-be-tested terminal device, which are input by a user in the test interface configuration area; and/or, a fifth obtaining subunit, configured to obtain, as test execution module configuration information, test execution module identification information input or selected by a user in the test execution module configuration area; and/or the task information sending subunit is configured to send, after detecting that the user clicks the configuration completion control, the voice performance test task information formed by the task name, the test data configuration information, the test object configuration information, the test interface configuration information, and/or the test execution module configuration information to the test execution module corresponding to the test execution module configuration information.

In an optional implementation manner of the embodiment of the present invention, optionally, the voice performance testing apparatus further includes: and the authentication unit is used for authenticating the test result query request according to the authentication information corresponding to the task name.

With regard to the apparatus in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment of the voice performance testing method, and will not be elaborated here.

EXAMPLE five

Fig. 5 is a schematic structural diagram of a speech performance testing apparatus according to a fifth embodiment of the present invention. The device may be configured in the test execution module in the voice performance test system provided in the above embodiment of the present invention. As shown in fig. 5, the apparatus includes: a test data acquisition unit 501, a feedback result acquisition unit 502, and a test result transmission unit 503.

The test data acquiring unit 501 is configured to, when receiving voice performance test task information sent by an information interaction module, acquire target test data corresponding to the voice performance test task information from a data storage module according to test data configuration information in the voice performance test task information; a feedback result obtaining unit 502, configured to call a to-be-tested interface of a to-be-tested terminal device corresponding to the voice performance test task information according to test object configuration information and test interface configuration information in the voice performance test task information, send the target test data to the to-be-tested terminal device corresponding to the voice performance test task information, and obtain a voice recognition result or a semantic understanding result fed back by the to-be-tested terminal device corresponding to the voice performance test task information; a test result sending unit 503, configured to generate a voice recognition test result or a semantic understanding test result according to the voice recognition result or the semantic understanding result and the task name, and send the voice recognition test result or the semantic understanding test result to the data storage module.

The embodiment of the invention provides a voice performance testing device, which acquires target testing data corresponding to voice performance testing task information from a data storage module through a testing execution module according to testing data configuration information in the voice performance testing task information, calls a to-be-tested interface of a to-be-tested terminal device corresponding to the voice performance testing task information according to testing object configuration information and testing interface configuration information in the voice performance testing task information, sends the target testing data to the to-be-tested terminal device corresponding to the voice performance testing task information, acquires a voice recognition result or a semantic understanding result fed back by the to-be-tested terminal device corresponding to the voice performance testing task information, generates a voice recognition testing result or a semantic understanding testing result according to the voice recognition result or the semantic understanding result and a task name, and sends the voice recognition testing result or the semantic understanding testing result to the data storage module for storage, the voice recognition function or the semantic understanding function of the terminal equipment to be tested can be automatically tested according to the test data acquired through the test data uploading interface and the voice performance test task information acquired through the test task configuration interface.

In an optional implementation manner of the embodiment of the present invention, optionally, the test data includes a test audio, a test text, an expected speech recognition result corresponding to the test audio, and/or an expected semantic understanding result corresponding to the test text.

In an optional implementation manner of the embodiment of the present invention, optionally, the test data configuration information is audio, the test object configuration information is voice recognition, and the test interface configuration information includes an interface address and an access parameter of a voice recognition interface of the terminal device to be tested, which correspond to the voice performance test task information; the test data acquisition unit 501 includes: the audio acquisition subunit is used for acquiring a test audio and an expected voice recognition result corresponding to the test audio from the data storage module according to the audio; and the audio determining subunit is used for determining the test audio as the target test data corresponding to the voice performance test task information.

In an optional implementation manner of the embodiment of the present invention, optionally, the feedback result obtaining unit 502 includes: and the voice recognition result acquisition subunit is used for calling the voice recognition interface of the terminal equipment to be tested corresponding to the voice performance test task information according to the voice recognition and the interface address and the access parameter of the voice recognition interface of the terminal equipment to be tested corresponding to the voice performance test task information, sending the test audio to the terminal equipment to be tested corresponding to the voice performance test task information, and acquiring a voice recognition result fed back by the terminal equipment to be tested corresponding to the voice performance test task information.

In an optional implementation manner of the embodiment of the present invention, optionally, the test data configuration information is a text, the test object configuration information is semantic understanding, and the test interface configuration information includes an interface address and an access parameter of a semantic understanding interface of the terminal device to be tested, which correspond to the voice performance test task information; the test data acquisition unit 501 includes: the text acquisition subunit is used for acquiring a test text and an expected semantic understanding result corresponding to the test text from the data storage module according to the text; and the text determining subunit is used for determining the test text as the target test data corresponding to the voice performance test task information.

In an optional implementation manner of the embodiment of the present invention, optionally, the feedback result obtaining unit 502 includes: and the semantic understanding result acquiring subunit is used for calling the semantic understanding interface of the terminal equipment to be tested corresponding to the voice performance testing task information according to the semantic understanding and the interface address and the access parameter of the semantic understanding interface of the terminal equipment to be tested corresponding to the voice performance testing task information, sending the testing text to the terminal equipment to be tested corresponding to the voice performance testing task information, and acquiring a semantic understanding result fed back by the terminal equipment to be tested corresponding to the voice performance testing task information.

EXAMPLE six

Fig. 6 is a schematic structural diagram of a computer device according to a sixth embodiment of the present invention. FIG. 6 illustrates a block diagram of an exemplary computer device 12 suitable for use in implementing embodiments of the present invention. The computer device 12 shown in FIG. 6 is only an example and should not bring any limitations to the functionality or scope of use of embodiments of the present invention.

As shown in FIG. 6, computer device 12 is in the form of a general purpose computing device. The components of computer device 12 may include, but are not limited to: one or more processors 16, a memory 28, and a bus 18 that connects the various system components (including the memory 28 and the processors 16).

Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

Computer device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer device 12 and includes both volatile and nonvolatile media, removable and non-removable media.

The memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)30 and/or cache memory 32. Computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 6, and commonly referred to as a "hard drive"). Although not shown in FIG. 6, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.

A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application clients, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.

Computer device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with computer device 12, and/or with any devices (e.g., network card, modem, etc.) that enable computer device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, computer device 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via network adapter 20. As shown in FIG. 6, the network adapter 20 communicates with the other modules of the computer device 12 via the bus 18. It should be appreciated that although not shown in FIG. 6, other hardware and/or software modules may be used in conjunction with computer device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

The processor 16 executes various functional applications and data processing by running the program stored in the memory 28, so as to implement the voice performance testing method provided by the embodiment of the present invention: test data are obtained through a test data uploading interface and are sent to a data storage module; acquiring voice performance test task information through a test task configuration interface, and sending the voice performance test task information to a test execution module corresponding to the test execution module configuration information so that the test execution module performs a voice performance test based on the voice performance test task information; the voice performance test task information comprises a task name, test data configuration information, test object configuration information, test interface configuration information and test execution module configuration information.

Or, implementing the voice performance test method provided by the embodiment of the invention: when receiving voice performance test task information sent by an information interaction module, acquiring target test data corresponding to the voice performance test task information from a data storage module according to test data configuration information in the voice performance test task information; calling a to-be-tested interface of a to-be-tested terminal device corresponding to the voice performance test task information according to test object configuration information and test interface configuration information in the voice performance test task information, sending the target test data to the to-be-tested terminal device corresponding to the voice performance test task information, and acquiring a voice recognition result or a semantic understanding result fed back by the to-be-tested terminal device corresponding to the voice performance test task information; and generating a voice recognition test result or a semantic understanding test result according to the voice recognition result or the semantic understanding result and the task name, and sending the voice recognition test result or the semantic understanding test result to the data storage module.

EXAMPLE seven

The seventh embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where when the computer program is executed by a processor, the method for testing voice performance provided by the embodiment of the present invention is implemented: test data are obtained through a test data uploading interface and are sent to a data storage module; acquiring voice performance test task information through a test task configuration interface, and sending the voice performance test task information to a test execution module corresponding to the test execution module configuration information so that the test execution module performs a voice performance test based on the voice performance test task information; the voice performance test task information comprises a task name, test data configuration information, test object configuration information, test interface configuration information and test execution module configuration information.

Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an information delivery system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an information handling system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or computer device. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A method for testing speech performance, the method comprising:

2. The method of claim 1, further comprising:

and when a test result query request carrying the task name is acquired through a test result display interface, acquiring a voice recognition test result or a semantic understanding test result corresponding to the task name from the data storage module, and displaying the voice recognition test result or the semantic understanding test result corresponding to the task name through the test result display interface.

3. The method of claim 1, wherein the test data upload interface comprises a test data directory and/or an upload control;

the test data is obtained through the test data uploading interface and is sent to the data storage module, and the method comprises the following steps:

acquiring test data identification information selected by a user in the test data directory;

acquiring test data corresponding to the test data identification information in a preset test database;

and after the clicking operation of the user on the uploading control is detected, sending the test data corresponding to the test data identification information to a data storage module.

4. The method of claim 1, wherein the test task configuration interface comprises: a task name configuration area, a test data configuration area, a test object configuration area, a test interface configuration area, a test execution module configuration area and/or a configuration completion control;

the method for acquiring the voice performance test task information through the test task configuration interface and sending the voice performance test task information to the test execution module corresponding to the test execution module configuration information comprises the following steps:

acquiring a task name input by a user in the task name configuration area as a task name;

and/or acquiring test data category information input or selected by a user in the test data configuration area as test data configuration information;

and/or acquiring a test object input or selected by a user in the test object configuration area as test object configuration information;

and/or acquiring an interface address and an access parameter of a to-be-tested interface of the to-be-tested terminal equipment, which are input by a user in the test interface configuration area, as test interface configuration information;

and/or acquiring the identification information of the test execution module input or selected by the user in the test execution module configuration area as the configuration information of the test execution module;

and/or after the clicking operation of the configuration completion control by the user is detected, sending the voice performance test task information formed by the task name, the test data configuration information, the test object configuration information, the test interface configuration information and/or the test execution module configuration information to the test execution module corresponding to the test execution module configuration information.

5. The method of claim 2, further comprising, prior to retrieving the speech recognition test result or semantic understanding test result corresponding to the task name from the data storage module:

and authenticating the test result query request according to the authentication information corresponding to the task name.

6. A method for testing speech performance, the method comprising:

7. The method of claim 6, wherein test data comprises test audio, test text, expected speech recognition results corresponding to the test audio, and/or expected semantic understanding results corresponding to the test text.

8. The method according to claim 7, wherein the test data configuration information is audio, the test object configuration information is voice recognition, and the test interface configuration information includes an interface address and an access parameter of a voice recognition interface of the terminal device to be tested corresponding to the voice performance test task information;

the acquiring, from the data storage module, target test data corresponding to the voice performance test task information according to the test data configuration information in the voice performance test task information includes:

according to the audio, acquiring a test audio and an expected voice recognition result corresponding to the test audio from the data storage module;

and determining the test audio as target test data corresponding to the voice performance test task information.

9. The method according to claim 8, wherein the calling an interface to be tested of a terminal device to be tested corresponding to the voice performance test task information according to test object configuration information and test interface configuration information in the voice performance test task information, sending the target test data to the terminal device to be tested corresponding to the voice performance test task information, and obtaining a voice recognition result or a semantic understanding result fed back by the terminal device to be tested corresponding to the voice performance test task information comprises:

calling a voice recognition interface of the terminal equipment to be tested corresponding to the voice performance test task information according to the voice recognition and the interface address and the access parameter of the voice recognition interface of the terminal equipment to be tested corresponding to the voice performance test task information, sending the test audio to the terminal equipment to be tested corresponding to the voice performance test task information, and acquiring a voice recognition result fed back by the terminal equipment to be tested corresponding to the voice performance test task information.

10. The method according to claim 7, wherein the test data configuration information is a text, the test object configuration information is semantic understanding, and the test interface configuration information includes an interface address and an access parameter of a semantic understanding interface of the terminal device to be tested corresponding to the voice performance test task information;

according to the text, obtaining a test text and an expected semantic understanding result corresponding to the test text from the data storage module;

and determining the test text as target test data corresponding to the voice performance test task information.

11. The method according to claim 10, wherein the calling an interface to be tested of a terminal device to be tested corresponding to the voice performance test task information according to test object configuration information and test interface configuration information in the voice performance test task information, sending the target test data to the terminal device to be tested corresponding to the voice performance test task information, and obtaining a voice recognition result or a semantic understanding result fed back by the terminal device to be tested corresponding to the voice performance test task information, comprises:

calling a semantic understanding interface of the terminal equipment to be tested corresponding to the voice performance test task information according to the semantic understanding and the interface address and the access parameter of the semantic understanding interface of the terminal equipment to be tested corresponding to the voice performance test task information, sending the test text to the terminal equipment to be tested corresponding to the voice performance test task information, and acquiring a semantic understanding result fed back by the terminal equipment to be tested corresponding to the voice performance test task information.

12. A speech performance testing apparatus, the apparatus comprising:

13. A speech performance testing apparatus, the apparatus comprising:

14. A speech performance testing system, comprising:

the information interaction module is used for acquiring test data through a test data uploading interface and sending the test data to the data storage module; acquiring voice performance test task information through a test task configuration interface, and sending the voice performance test task information to a test execution module corresponding to the test execution module configuration information, wherein the voice performance test task information comprises a task name, test data configuration information, test object configuration information, test interface configuration information and/or test execution module configuration information;

the data storage module is used for receiving the test data and storing the test data; storing the voice recognition test result or the semantic understanding test result sent by each test execution module;

each test execution module is used for acquiring target test data corresponding to the voice performance test task information from the data storage module according to test data configuration information in the voice performance test task information when the voice performance test task information sent by the information interaction module is received; calling a to-be-tested interface of a to-be-tested terminal device corresponding to the voice performance test task information according to test object configuration information and test interface configuration information in the voice performance test task information, sending the target test data to the to-be-tested terminal device corresponding to the voice performance test task information, and acquiring a voice recognition result or a semantic understanding result fed back by the to-be-tested terminal device corresponding to the voice performance test task information; generating a voice recognition test result or a semantic understanding test result according to the voice recognition result or the semantic understanding result and/or the task name, and sending the voice recognition test result or the semantic understanding test result to the data storage module;

15. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the speech performance testing method according to any of claims 1-5 or the speech performance testing method according to any of claims 6-11 when executing the computer program.

16. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method for speech performance testing according to any one of claims 1-5, or the method for speech performance testing according to any one of claims 6-11.