CN112420019B - Equipment testing method and device - Google Patents
Equipment testing method and device Download PDFInfo
- Publication number
- CN112420019B CN112420019B CN202011296504.4A CN202011296504A CN112420019B CN 112420019 B CN112420019 B CN 112420019B CN 202011296504 A CN202011296504 A CN 202011296504A CN 112420019 B CN112420019 B CN 112420019B
- Authority
- CN
- China
- Prior art keywords
- tested
- test
- function
- semantic
- testing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 323
- 238000013507 mapping Methods 0.000 claims abstract description 59
- 238000000034 method Methods 0.000 claims abstract description 32
- 230000006870 function Effects 0.000 claims description 223
- 238000004590 computer program Methods 0.000 claims description 18
- 230000004044 response Effects 0.000 claims description 15
- 238000010998 test method Methods 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 5
- 238000011161 development Methods 0.000 description 11
- 238000013473 artificial intelligence Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/01—Assessment or evaluation of speech recognition systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/30—Semantic analysis
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Artificial Intelligence (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Machine Translation (AREA)
Abstract
The invention provides a method and a device for testing equipment, which comprise the following steps: acquiring a semantic function test template of a device to be tested, wherein the semantic function test template records a mapping relation between the function to be tested and the test semantics of the device to be tested; obtaining test corpora according to the test semantics, wherein each test semantic corresponds to a group of test corpora; and testing the function to be tested of the equipment to be tested by using the test corpus to obtain a test result. According to the invention, the problem of lower accuracy of the equipment test result is solved, and the effect of improving the accuracy of the equipment test result is further achieved.
Description
Technical Field
The invention relates to the field of communication, in particular to a method and a device for testing equipment.
Background
The voice control needs to use the equipment with the microphone device as a premise to carry out voice acquisition, and then command issuing and equipment control can be carried out. However, developers generally develop based on web browsers, which do not have voice capture functionality. For developers, the device function configuration is mostly performed in a web browser, and the device cannot be controlled by collecting voice.
For example, a developer needs to perform a voice function grayscale test on a device, and first the developer needs to perform data configuration on a web side and then perform the voice function test by using a grayscale application program. However, for the test result and the data online process, the web end cannot sense the result, so that the test result and the data online process completely depend on manual judgment of a developer, errors are easy to occur, and the data quality cannot be strictly controlled for the device access process.
Aiming at the problem of lower accuracy of equipment test results in the related art, no effective solution exists at present.
Disclosure of Invention
The embodiment of the invention provides a device testing method and device, which at least solve the problem of low accuracy of device testing results in the related art.
According to an embodiment of the present invention, there is provided a method of testing a device, including: acquiring a semantic function test template of a device to be tested, wherein the semantic function test template records a mapping relation between a function to be tested and test semantics of the device to be tested; obtaining test corpora according to the test semantics, wherein each test semantic corresponds to a group of test corpora; and testing the function to be tested of the equipment to be tested by using the test corpus to obtain a test result.
Optionally, the testing the function to be tested of the device to be tested by using the test corpus includes: the method comprises the steps that each test corpus in a first group of test corpora is respectively and sequentially sent to a device to be tested so as to control the device to be tested to sequentially execute corresponding operations according to each test corpus, and a group of operation responses are obtained, wherein the first group of test corpora is used for testing a first function to be tested of the device to be tested, and the function to be tested comprises the first function to be tested; and determining that the first function to be tested of the equipment to be tested is qualified if the matching rate of the group of operation responses and the first function to be tested is greater than or equal to a first threshold, otherwise determining that the first function to be tested of the equipment to be tested is unqualified.
Optionally, before the obtaining the semantic function testing template of the device to be tested, the method further includes: determining a function to be tested of the device to be tested; selecting test semantics from a semantic corpus according to the functions to be tested, wherein the semantic corpus records the mapping relation between each test semantic and a corresponding group of test corpora; and establishing a mapping relation between the function to be tested and the test semantics, and storing the mapping relation in the semantic function test template.
Optionally, after storing the mapping relationship in the semantic function test template, the method further includes: and binding the semantic function test template by the device to be tested.
Optionally, the method further comprises at least one of: under the condition that a second function to be tested is determined to be added to the device to be tested, acquiring a first test semantic corresponding to the second function to be tested from the semantic corpus, and creating a mapping relation between the second function to be tested and the first test semantic in the semantic function test template; and under the condition that the device to be tested deletes a third function to be tested, deleting a mapping relation between the third function to be tested and a second test semantic in the semantic function test template, wherein the second test semantic is used for testing the third function to be tested of the device to be tested.
According to another embodiment of the present invention, there is provided a test system of a device, including: the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a semantic function test template of a device to be tested, and the semantic function test template records a mapping relation between a function to be tested and a test semantic of the device to be tested; the second acquisition module is used for acquiring test corpora according to the test semantics, wherein each test semantic corresponds to a group of test corpora; and the testing module is used for testing the functions to be tested of the equipment to be tested by using the testing corpora to obtain a testing result.
Optionally, the test module comprises: the sending unit is used for respectively sending each testing corpus in the first group of testing corpora to the equipment to be tested in sequence so as to control the equipment to be tested to execute corresponding operations in sequence according to each testing corpus, and obtain a group of operation responses, wherein the first group of testing corpora is used for testing a first function to be tested of the equipment to be tested, and the function to be tested comprises the first function to be tested; the determining unit is used for determining that the first function to be tested of the device to be tested is qualified if the matching rate of the group of operation responses and the first function to be tested is greater than or equal to a first threshold value, and otherwise determining that the first function to be tested of the device to be tested is unqualified.
Optionally, the system further comprises: the determining module is used for determining the to-be-tested function of the to-be-tested equipment before the semantic function testing template of the to-be-tested equipment is obtained; the selection module is used for selecting test semantics from a semantic corpus according to the functions to be tested, wherein the semantic corpus records the mapping relation between each test semantic and a corresponding group of test corpora; and the establishing module is used for establishing a mapping relation between the function to be tested and the test semantics and storing the mapping relation in the semantic function test template.
According to a further embodiment of the present invention, there is also provided a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
According to yet another embodiment of the present invention, there is also provided an electronic device, including a memory in which a computer program is stored and a processor configured to execute the computer program to perform the steps in any of the above method embodiments.
By the method, the semantic function test template of the equipment to be tested is obtained, and the semantic function test template records the mapping relation between the function to be tested and the test semantics of the equipment to be tested; obtaining test corpora according to the test semantics, wherein each test semantic corresponds to a group of test corpora; and testing the function to be tested of the equipment to be tested by using the test corpus to obtain a test result. Therefore, the problem of low accuracy of the test result of the equipment can be solved, and the effect of improving the accuracy of the test result of the equipment is achieved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a block diagram of a hardware configuration of a mobile terminal of a device testing method according to an embodiment of the present invention;
FIG. 2 is a flow chart of testing of a device according to an embodiment of the present invention;
FIG. 3 is a schematic flow diagram of a system according to an alternative embodiment of the invention;
FIG. 4 is a system timing diagram in accordance with an alternative embodiment of the present invention;
fig. 5 is a block diagram of a test system of a device according to an embodiment of the present invention.
Detailed Description
The invention will be described in detail hereinafter with reference to the accompanying drawings in conjunction with embodiments. It should be noted that, in the present application, the embodiments and features of the embodiments may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
The method provided by the first embodiment of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking an example of the test method running on a mobile terminal, fig. 1 is a block diagram of a hardware structure of the mobile terminal of the test method of the device according to the embodiment of the present invention. As shown in fig. 1, the mobile terminal 10 may include one or more (only one shown in fig. 1) processors 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, and optionally may also include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration, and does not limit the structure of the mobile terminal. For example, the mobile terminal 10 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The memory 104 may be used for storing computer programs, for example, software programs and modules of application software, such as computer programs corresponding to the testing method of the device in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the computer programs stored in the memory 104, so as to implement the method described above. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the mobile terminal 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the mobile terminal 10. In one example, the transmission device 106 includes a Network adapter (NIC), which can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In this embodiment, a method for testing a device running on the mobile terminal is provided, and fig. 2 is a flowchart of testing a device according to an embodiment of the present invention, as shown in fig. 2, the flowchart includes the following steps:
step S202, a semantic function testing template of a device to be tested is obtained, wherein the semantic function testing template records a mapping relation between a function to be tested and a testing semantic of the device to be tested;
step S204, test corpora are obtained according to the test semantics, wherein each test semantics corresponds to a group of test corpora;
step S206, testing the function to be tested of the device to be tested by using the test corpus to obtain a test result.
Through the steps, the semantic function testing template of the equipment to be tested is obtained, and the semantic function testing template records the mapping relation between the function to be tested and the testing semantics of the equipment to be tested; obtaining test corpora according to the test semantics, wherein each test semantic corresponds to a group of test corpora; and testing the function to be tested of the equipment to be tested by using the test corpus to obtain a test result. Therefore, the problem of low accuracy of the test result of the equipment can be solved, and the effect of improving the accuracy of the test result of the equipment is achieved.
Alternatively, the execution subject of the above steps may be a terminal or the like, but is not limited thereto.
As an optional embodiment, the device to be tested may be an intelligent home device with a voice function, such as an intelligent refrigerator, an intelligent washing machine, an intelligent air conditioner, and the like. The voice function test template may be pre-established, and the voice to-be-tested function template records a mapping relationship between a to-be-tested function and a test semantic, for example, if the to-be-tested function controls the smart home device to be turned on, then a mapping relationship may be established between the to-be-tested function "controlling the device to be turned on" and the test semantic "turning on". The above test semantics are used to represent semantics of the test device function, and may be represented by words, characters, or numbers, for example, the semantics "1" may also be used to represent semantics of the test device start function, so that "control device start" is recorded in the semantic function test template, and a mapping relationship is established between the test semantics "1". The functions to be tested and the test semantics are only for illustrating the embodiment, and the specific functions to be tested and the test semantics can be selected according to the actual situation, which is not limited herein.
As an alternative embodiment, a semantic meaning may correspond to a plurality of corpora, for example, for the corpora "turn on tv", "turn on tv" and "play program", all of which may be used to indicate that the tv is controlled to turn on, so that a test semantic meaning may correspond to a plurality of test corpora. The test expectations may be pre-set. After the test semantics are determined according to the to-be-tested function of the equipment, a plurality of test predictions corresponding to the test semantics are selected from preset test predictions according to the test semantics, and the test predictions are used for testing the to-be-tested function of the equipment. In the embodiment, the function to be tested of the device is tested by using the test semantics, so that the problem of inaccurate test result caused by the fact that the web browser does not have a voice function is avoided, and the technical effect of improving the accuracy of the test result of the device is achieved.
Optionally, the testing the function to be tested of the device to be tested by using the test corpus includes: the method comprises the steps that each test corpus in a first group of test corpora is respectively and sequentially sent to a device to be tested so as to control the device to be tested to sequentially execute corresponding operations according to each test corpus, and a group of operation responses are obtained, wherein the first group of test corpora is used for testing a first function to be tested of the device to be tested, and the function to be tested comprises the first function to be tested; and determining that the first function to be tested of the equipment to be tested is qualified if the matching rate of the group of operation responses and the first function to be tested is greater than or equal to a first threshold, otherwise determining that the first function to be tested of the equipment to be tested is unqualified.
As an optional implementation manner, the test predictions may be sequentially sent to the devices to be tested at the web end to control the devices to be tested to execute corresponding operations according to the obtained test predictions, and determine whether the functions to be tested of the devices to be tested are qualified according to the test results. In this embodiment, taking the to-be-tested television as an example, and taking the to-be-tested function as controlling the television to be turned on, the test expectation is "turn on the television", or "play a program", the developer may sequentially send the three test corpora to the television to be tested through the web end, and the television executes corresponding operations after receiving the expectation, so as to obtain the operation response of the television. For example, turning on a television. It is also possible for the television set to perform the wrong operation or not perform any operation. And feeding back the result executed by the television to the web end, matching the operation response of the television with the function to be tested by the web end, and determining that the function for controlling the television to be started is qualified if the matching rate is greater than or equal to a first threshold value. In this embodiment, the first threshold may be determined according to actual situations, for example, in the example of testing the television set start function, the first threshold may be set to 2, that is, in three test predictions of "start the television set", "turn on the television", and "play a program", two test predictions successfully control the television set to start, and then it is determined that the start function of the television set is qualified, otherwise it is determined that the start function of the television set is not qualified. In this embodiment, the test corpus is sequentially used to control the devices to be tested to execute corresponding operations, and whether the functions to be tested of the devices to be tested are qualified is determined according to the operation response and the matching rate between the functions to be tested, so that each function to be tested can be comprehensively tested, and the accuracy of the test result is improved.
Optionally, before the obtaining the semantic function testing template of the device to be tested, the method further includes: determining a function to be tested of the device to be tested; selecting test semantics from a semantic corpus according to the functions to be tested, wherein the semantic corpus records the mapping relation between each test semantic and a corresponding group of test corpora; and establishing a mapping relation between the function to be tested and the test semantics, and storing the mapping relation in the semantic function test template.
As an optional implementation, the semantic prediction library may be preset, and predictions may be acquired from the internet, and a mapping relationship between the predictions with the same semantics and the semantics is established and stored in the semantic prediction library. For example, the linguistic data "open", "open" and "play" can be used to represent the opening device, and then a mapping relationship can be established between the semantic "open" and the linguistic data "open", "open" and "play", and the mapping relationship is stored in the semantic corpus. In this embodiment, by pre-establishing the mapping relationship between the semantics and the corpora, when the device to be tested is tested, a suitable corpus can be selected from the semantic prediction library as test data, so that the test efficiency is improved.
As an optional implementation manner, taking a device to be tested as a television as an example, the function to be tested is to control the television to be turned on, a mapping relation between the function to be tested and the "turning on" of the television is established, and the mapping relation is stored in a semantic function testing template, when a developer tests the turning on function of the television, the developer finds a corresponding semantic in the semantic function testing template, and because the mapping relation is established between the semantic "turning on" and the linguistic data "turning on", and "playing", is established in the semantic corpus, the developer can obtain the corresponding linguistic data in the semantic corpus, and the start function of the television can be tested by using the linguistic data. In this embodiment, a mapping relationship between semantics and a prediction is established in a semantic function testing template, and a relationship between a function to be tested and the semantics is established in the semantic function testing template, so that the function to be tested of the device to be tested can be tested according to the corresponding corpus obtained by the function to be tested, and the effect of improving testing efficiency and accuracy can be achieved.
Optionally, after storing the mapping relationship in the semantic function test template, the method further includes: and binding the semantic function test template by the device to be tested. In this embodiment, since there may be many functions to be tested of the device to be tested under normal conditions, all the functions to be tested and corresponding semantics may be stored in the semantic function testing template, and the device to be tested and the semantic function testing template are bound, where the device to be tested and the semantic function testing template may be in a one-to-one relationship, that is, one device to be tested corresponds to one semantic function testing template, or may be in a many-to-one relationship, that is, multiple devices to be tested correspond to one semantic function testing template. By means of binding the device to be tested and the semantic function testing template, the corresponding semantic function testing template can be quickly found according to the identity of the device to be tested, so that the device to be tested can be conveniently tested, and the testing efficiency is improved. In addition, the checking can be carried out according to the bound semantic function test template after the test is finished, and the test accuracy is improved.
Optionally, the method further comprises at least one of: under the condition that a second function to be tested is determined to be newly added to the device to be tested, obtaining a first test semantic corresponding to the second function to be tested in the semantic corpus, and creating a mapping relation between the second function to be tested and the first test semantic in the semantic function test template; and under the condition that the device to be tested deletes a third function to be tested, deleting the mapping relation between the third function to be tested and a second test semantic in the semantic function test template, wherein the second test semantic is used for testing the third function to be tested of the device to be tested.
As an optional implementation, the semantic function testing template bound to the device to be tested may be updated according to the change of the function to be tested. For example, a function to be tested is added or deleted. Under the condition of newly adding a function to be tested, searching a test semantic corresponding to the newly added test function in the semantic pre-material library, and adding a mapping relation between the corresponding newly added test function and the test semantic in the semantic function test template. And under the condition of deleting a certain function to be tested of the equipment to be tested, deleting the mapping relation between the function to be tested and the corresponding test semantics in the semantic function test template bound with the equipment to be tested. In the embodiment, the semantic function test template bound with the device to be tested can be updated in real time, and the accuracy of the device test result can be improved.
The application is illustrated below by means of a specific embodiment.
Fig. 3 is a schematic flow chart of a system according to an alternative embodiment of the present invention, which includes the following steps:
s31, a developer can carry out equipment test through a development platform and obtain semantic corpus information from an artificial intelligence platform through the development platform;
s32, a developer can configure a mapping relation between a test semantic and a function to be tested on a development platform and synchronize the mapping relation to an artificial intelligence platform;
s33, a developer initiates equipment binding on a development platform and calls an Internet of things cloud binding device;
s34, a developer selects a corpus corresponding to the semantics on a development platform, and the corpus is issued to realize the voice function control of the equipment;
s35, the artificial intelligence platform takes the corpora, matches the corresponding equipment functions, and assembles the corpora into a command to call the Internet of things cloud to control the equipment;
and S36, synchronizing the control result to the development platform by the artificial intelligence platform, so that the development platform completes the semantic function verification process.
Fig. 4 is a timing diagram of a system according to an alternative embodiment of the present invention, which includes the following steps:
s41, mapping the semantic corpus distributed on the artificial intelligence platform to the artificial intelligence platform;
step S42, configuring a mapping relation between semantics and template functions based on the application types, and formulating a semantic function test template;
s43, a developer can configure a model function, when the development platform monitors that the model function changes, the function and semantic mapping relation is automatically matched and synchronized to the artificial intelligence platform;
step S44, starting semantic online test, and calling an Internet of things cloud interface through a development platform to realize the binding of web-side equipment so as to meet the following equipment control;
s45, a developer selects a certain corpus under certain semantic meaning to test; the development platform can issue the corpus to the artificial intelligence platform;
s46, matching semantics and a function command by the artificial intelligence platform according to the corpora, and calling an Internet of things cloud interface to issue the function command;
and S47, returning the command execution result to the artificial intelligence through the Internet of things cloud, and synchronously returning to the development platform.
Through the application, the complex configuration of data by a developer is simplified, and the frequency of switching between a web end and equipment is reduced; online test data are processed, and a test result is judged online; standardize, perfect equipment access flow, improve the efficiency that can test equipment function, improved the rate of accuracy of test result.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
In this embodiment, a test system of a device is further provided, and the system is used to implement the foregoing embodiments and preferred embodiments, and details of which have been already described are omitted. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 5 is a block diagram of a test system of a device according to an embodiment of the present invention, as shown in fig. 5, the system including: the first obtaining module 52 is configured to obtain a semantic function testing template of a device to be tested, where the semantic function testing template records a mapping relationship between a function to be tested and a testing semantic of the device to be tested; a second obtaining module 54, configured to obtain test corpora according to the test semantics, where each test semantic corresponds to a group of test corpora; and the testing module 56 is configured to test the function to be tested of the device to be tested by using the testing corpus to obtain a testing result.
Optionally, the test module comprises: the sending unit is used for respectively sending each testing corpus in the first group of testing corpora to the equipment to be tested in sequence so as to control the equipment to be tested to execute corresponding operations in sequence according to each testing corpus, and obtain a group of operation responses, wherein the first group of testing corpora is used for testing a first function to be tested of the equipment to be tested, and the function to be tested comprises the first function to be tested; the determining unit is used for determining that the first function to be tested of the device to be tested is qualified under the condition that the matching rate of the group of operation responses and the first function to be tested is larger than or equal to a first threshold value, and otherwise determining that the first function to be tested of the device to be tested is unqualified.
Optionally, the system further comprises: the determining module is used for determining the to-be-tested function of the to-be-tested equipment before the semantic function testing template of the to-be-tested equipment is obtained; the selecting module is used for selecting a test semantic from a semantic corpus according to the function to be tested, wherein the semantic corpus records the mapping relation between each test semantic and a corresponding group of test corpora; and the establishing module is used for establishing a mapping relation between the function to be tested and the test semantics and storing the mapping relation in the semantic function test template.
Optionally, the system is further configured to bind the semantic function testing template with the device to be tested after the mapping relationship is stored in the semantic function testing template.
Optionally, the system is further configured to, when it is determined that a second function to be tested is newly added to the device to be tested, obtain a first test semantic corresponding to the second function to be tested in the semantic corpus, and create a mapping relationship between the second function to be tested and the first test semantic in the semantic function test template; and under the condition that the device to be tested deletes a third function to be tested, deleting the mapping relation between the third function to be tested and a second test semantic in the semantic function test template, wherein the second test semantic is used for testing the third function to be tested of the device to be tested.
It should be noted that the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are located in different processors in any combination.
Embodiments of the present invention also provide a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
Alternatively, in the present embodiment, the storage medium may be configured to store a computer program for executing the steps of:
s1, obtaining a semantic function test template of a device to be tested, wherein the semantic function test template records a mapping relation between a function to be tested and a test semantic of the device to be tested;
s2, obtaining test corpora according to the test semantics, wherein each test semantics corresponds to a group of test corpora;
and S3, testing the function to be tested of the equipment to be tested by using the test corpus to obtain a test result.
Optionally, the storage medium is further arranged to store a computer program for performing the steps of:
optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing computer programs, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, obtaining a semantic function test template of a device to be tested, wherein the semantic function test template records a mapping relation between a function to be tested and a test semantic of the device to be tested;
s2, obtaining test corpora according to the test semantics, wherein each test semantics corresponds to a group of test corpora;
and S3, testing the function to be tested of the equipment to be tested by using the test corpus to obtain a test result.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.
Claims (8)
1. A method of testing a device, comprising:
acquiring a semantic function test template of a device to be tested, wherein the semantic function test template records a mapping relation between a function to be tested and test semantics of the device to be tested;
obtaining test corpora according to the test semantics, wherein each test semantic corresponds to a group of test corpora;
testing the function to be tested of the equipment to be tested by using the test corpus to obtain a test result;
using the test corpus to test the functions to be tested of the equipment to be tested, including: the method comprises the steps that each test corpus in a first group of test corpora is respectively and sequentially sent to a device to be tested so as to control the device to be tested to sequentially execute corresponding operations according to each test corpus, and a group of operation responses are obtained, wherein the first group of test corpora is used for testing a first function to be tested of the device to be tested, and the function to be tested comprises the first function to be tested; and determining that the first function to be tested of the equipment to be tested is qualified if the matching rate of the group of operation responses and the first function to be tested is greater than or equal to a first threshold, otherwise determining that the first function to be tested of the equipment to be tested is unqualified.
2. The method of claim 1, wherein prior to said obtaining a semantic function test template for a device under test, the method further comprises:
determining a function to be tested of the device to be tested;
selecting a test semantic from a semantic corpus according to the function to be tested, wherein the semantic corpus records the mapping relation between each test semantic and a corresponding group of test corpora;
and establishing a mapping relation between the function to be tested and the test semantics, and storing the mapping relation in the semantic function test template.
3. The method of claim 2, wherein after the storing the mapping relationship in the semantic function test template, the method further comprises:
and binding the semantic function testing template by the device to be tested.
4. The method of claim 3, further comprising at least one of:
under the condition that a second function to be tested is determined to be added to the device to be tested, acquiring a first test semantic corresponding to the second function to be tested from the semantic corpus, and creating a mapping relation between the second function to be tested and the first test semantic in the semantic function test template;
and under the condition that the device to be tested deletes a third function to be tested, deleting the mapping relation between the third function to be tested and a second test semantic in the semantic function test template, wherein the second test semantic is used for testing the third function to be tested of the device to be tested.
5. A system for testing a device, comprising:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a semantic function test template of a device to be tested, and the semantic function test template records a mapping relation between a function to be tested and a test semantic of the device to be tested;
the second acquisition module is used for acquiring test corpora according to the test semantics, wherein each test semantic corresponds to a group of test corpora;
the testing module is used for testing the functions to be tested of the equipment to be tested by using the testing corpus to obtain a testing result;
the test module includes: the sending unit is used for respectively sending each testing corpus in the first group of testing corpora to the equipment to be tested in sequence so as to control the equipment to be tested to execute corresponding operations in sequence according to each testing corpus, and obtain a group of operation responses, wherein the first group of testing corpora is used for testing a first function to be tested of the equipment to be tested, and the function to be tested comprises the first function to be tested; the determining unit is used for determining that the first function to be tested of the device to be tested is qualified if the matching rate of the group of operation responses and the first function to be tested is greater than or equal to a first threshold value, and otherwise determining that the first function to be tested of the device to be tested is unqualified.
6. The system of claim 5, further comprising:
the determining module is used for determining the to-be-tested function of the to-be-tested equipment before the semantic function testing template of the to-be-tested equipment is obtained;
the selection module is used for selecting test semantics from a semantic corpus according to the functions to be tested, wherein the semantic corpus records the mapping relation between each test semantic and a corresponding group of test corpora;
and the establishing module is used for establishing a mapping relation between the function to be tested and the test semantics and storing the mapping relation in the semantic function test template.
7. A storage medium, in which a computer program is stored, wherein the program is executable by a terminal device or a computer to perform the method of any one of claims 1 to 4.
8. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and wherein the processor is arranged to execute the computer program to perform the method of any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011296504.4A CN112420019B (en) | 2020-11-18 | 2020-11-18 | Equipment testing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011296504.4A CN112420019B (en) | 2020-11-18 | 2020-11-18 | Equipment testing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112420019A CN112420019A (en) | 2021-02-26 |
| CN112420019B true CN112420019B (en) | 2023-02-03 |
Family
ID=74773462
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011296504.4A Active CN112420019B (en) | 2020-11-18 | 2020-11-18 | Equipment testing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112420019B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115146650B (en) * | 2022-06-27 | 2023-06-30 | 西安羚控电子科技有限公司 | Test process creation method and system based on semantic recognition |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106202045A (en) * | 2016-07-08 | 2016-12-07 | 成都之达科技有限公司 | Special audio recognition method based on car networking |
| CN110221969A (en) * | 2019-05-21 | 2019-09-10 | 深圳壹账通智能科技有限公司 | A kind of page function test method and relevant apparatus |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9734821B2 (en) * | 2015-06-30 | 2017-08-15 | International Business Machines Corporation | Testing words in a pronunciation lexicon |
| US10204033B2 (en) * | 2017-03-11 | 2019-02-12 | Wipro Limited | Method and system for semantic test suite reduction |
| US10748526B2 (en) * | 2018-08-28 | 2020-08-18 | Accenture Global Solutions Limited | Automated data cartridge for conversational AI bots |
| CN111145737B (en) * | 2018-11-06 | 2022-07-01 | 中移（杭州）信息技术有限公司 | Voice test method and device and electronic equipment |
| CN109637536B (en) * | 2018-12-27 | 2020-11-13 | 苏州思必驰信息科技有限公司 | Method and device for automatically identifying semantic accuracy |
| CN111488436B (en) * | 2019-01-29 | 2023-05-05 | 阿里巴巴集团控股有限公司 | Multi-round dialogue model generation method, testing device and electronic equipment |
| US10997965B2 (en) * | 2019-04-02 | 2021-05-04 | Accenture Global Solutions Limited | Automated voice processing testing system and method |
| CN110415681B (en) * | 2019-09-11 | 2022-02-18 | 北京声智科技有限公司 | Voice recognition effect testing method and system |
| CN111079441A (en) * | 2019-12-16 | 2020-04-28 | 深圳市三宝创新智能有限公司 | Voice-aware semantic system |
| CN111488735B (en) * | 2020-04-09 | 2023-10-27 | 中国银行股份有限公司 | Test corpus generation method and device and electronic equipment |
| CN111916088B (en) * | 2020-08-12 | 2022-09-27 | 腾讯科技（深圳）有限公司 | Voice corpus generation method and device and computer readable storage medium |
-
2020
- 2020-11-18 CN CN202011296504.4A patent/CN112420019B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106202045A (en) * | 2016-07-08 | 2016-12-07 | 成都之达科技有限公司 | Special audio recognition method based on car networking |
| CN110221969A (en) * | 2019-05-21 | 2019-09-10 | 深圳壹账通智能科技有限公司 | A kind of page function test method and relevant apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112420019A (en) | 2021-02-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106776294B (en) | Automatic android mobile phone testing method and system | |
| CN110493812B (en) | Distribution network test processing method, device and system, processor and master control equipment | |
| CN108712300A (en) | A kind of automated testing method and system of smart machine distribution | |
| CN110032507A (en) | Applied program testing method, device, system, electronic equipment and storage medium | |
| CN109450708A (en) | A kind of Nginx Dynamic Configuration and system | |
| CN108228444A (en) | A kind of test method and device | |
| CN104427547A (en) | Business and network association test method, device and system | |
| CN112420019B (en) | Equipment testing method and device | |
| CN110019916A (en) | Event-handling method, device, equipment and storage medium based on user's portrait | |
| CN109062820A (en) | A kind of software performance testing method and device | |
| CN115391219A (en) | Test case generation method and device, electronic equipment and storage medium | |
| CN113434422B (en) | Virtual device debugging method and device and virtual device debugging system | |
| CN113452556A (en) | Product skill configuration method and device, storage medium and electronic device | |
| CN110990381B (en) | Processing method and device of server, storage medium and electronic device | |
| CN111274325B (en) | Platform automatic test method and system | |
| CN113434184A (en) | Equipment upgrading method and device, storage medium and electronic device | |
| CN210016474U (en) | Distribution network test control equipment and system | |
| CN112735406A (en) | Device control method and apparatus, storage medium, and electronic apparatus | |
| CN116074228A (en) | Network card testing method and device, storage medium and electronic equipment | |
| CN115442266A (en) | Gateway performance testing method and device, storage medium and electronic device | |
| CN112994973B (en) | Automatic batch testing method and device for Internet of things equipment and computer-readable storage medium | |
| CN114676043A (en) | Testing method and device of intelligent voice module, storage medium and electronic device | |
| CN112698948A (en) | Method and device for acquiring product resources, storage medium and electronic device | |
| CN112650815A (en) | Method and device for synchronizing environmental data, storage medium and electronic device | |
| CN113064926B (en) | Data screening method and device, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |