CN111190806B - Log processing method and device of voice interaction equipment - Google Patents
Log processing method and device of voice interaction equipment Download PDFInfo
- Publication number
- CN111190806B CN111190806B CN201911390580.9A CN201911390580A CN111190806B CN 111190806 B CN111190806 B CN 111190806B CN 201911390580 A CN201911390580 A CN 201911390580A CN 111190806 B CN111190806 B CN 111190806B
- Authority
- CN
- China
- Prior art keywords
- log
- voice
- filtering parameter
- user
- voice interaction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 81
- 238000003672 processing method Methods 0.000 title claims abstract description 11
- 238000001914 filtration Methods 0.000 claims abstract description 79
- 230000004044 response Effects 0.000 claims abstract description 54
- 238000012544 monitoring process Methods 0.000 claims abstract description 21
- 238000000034 method Methods 0.000 claims abstract description 17
- 238000012545 processing Methods 0.000 claims description 11
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000012360 testing method Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 3
- 238000013079 data visualisation Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000007639 printing Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification techniques
- G10L17/22—Interactive procedures; Man-machine interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Computer Hardware Design (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a log processing method of voice interaction equipment, wherein the voice interaction equipment collects user voices and returns response results to a user, and the user voices comprise awakening word voices and intention voices, and the method comprises the following steps: reading a configuration file, wherein the configuration file comprises a first filtering parameter, a second filtering parameter and a third filtering parameter; monitoring a log generated by the voice interaction equipment; when a first log matched with the first filtering parameter is monitored, the first log is obtained, and the first log comprises text data corresponding to the awakening word voice; when a second log matched with the second filtering parameter is monitored, the second log is obtained, and the second log comprises text data corresponding to the intention voice; and when a third log matched with the third filtering parameter is monitored, acquiring the third log, wherein the third log comprises the response result.
Description
Technical Field
The present invention relates to log management technologies, and in particular, to a log processing method and apparatus for a voice interaction device.
Background
Under various scenes, the status of the device log is extremely important, and a great deal of useful information is contained in mass log data. And Data Visualization (Data Visualization) conveys log information to users intuitively and clearly by way of images.
At present, the android development platform is provided with a log printing function, and logs required by filtering are usually directly on the platform. When the voice interaction device is tested, because the self-contained log printing function of the android development platform is single, the requirement of complex scene testing cannot be met, for example, the response duration (namely response time consumption) of the voice interaction device to the requirement of a user cannot be obtained, and the index is an important index for measuring the performance of the voice interaction device. Moreover, the log data acquired in this way is complex, and invalid or non-critical data is too much, which affects the test efficiency and test result of the voice interaction device.
Disclosure of Invention
The invention provides a log processing method of voice interaction equipment, which aims to solve the technical problem.
One aspect of the present invention provides a log processing method for a voice interaction device, where the voice interaction device collects a user voice and returns a response result to the user, where the user voice includes a wakeup word voice and an intention voice, and the method includes:
Reading a configuration file, wherein the configuration file comprises a first filtering parameter, a second filtering parameter and a third filtering parameter;
monitoring a log generated by the voice interaction equipment;
when a first log matched with the first filtering parameter is monitored, the first log is obtained, and the first log comprises text data corresponding to the awakening word voice;
when a second log matched with the second filtering parameter is monitored, the second log is obtained, and the second log comprises text data corresponding to the intention voice;
and when a third log matched with the third filtering parameter is monitored, acquiring the third log, wherein the third log comprises the response result.
The value of the first filtering parameter is the text data of the awakening word, and if the log contains the text data of the awakening word, the log is a first log matched with the first filtering parameter;
the value of the second filtering parameter is a second set value, the second set value indicates that the voice interaction equipment finishes collecting the voice of the user, and if the log contains the second set value, the log is a second log matched with the second filtering parameter;
And if the log contains the third set value, the log is a third log matched with the third filtering parameter.
After the second log and the third log are obtained, the method further comprises the following steps:
determining a time difference between a second moment of the second log record and a third moment of the third log record as the time consumed by the voice interaction device for responding to the voice;
the second moment is the finishing moment of finishing the voice acquisition of the user; and the third moment is the moment when the voice interaction equipment returns the response result to the user.
Wherein the second log further comprises expected results for the user speech, the method further comprising:
and comparing the expected result with the response result contained in the third log, and when the expected result is matched with the response result contained in the third log, determining that the response of the voice interaction equipment to the user voice is successful, otherwise, confirming that the response is failed.
Wherein, the method also comprises:
and acquiring and storing all logs generated by the voice interaction equipment in a preset time interval.
Another aspect of the present invention provides a log processing apparatus for a voice interaction device, where the voice interaction device collects a user voice and returns a response result to the user, where the user voice includes a wakeup word voice and an intention voice, the apparatus including:
the reading module is used for reading a configuration file, and the configuration file comprises a first filtering parameter, a second filtering parameter and a third filtering parameter;
the monitoring module is used for monitoring the log generated by the voice interaction equipment;
the acquisition module is used for acquiring a first log matched with the first filtering parameter when the monitoring module monitors the first log, wherein the first log comprises text data corresponding to the awakening word voice;
the acquisition module is further configured to acquire a second log when the monitoring module monitors the second log matched with the second filtering parameter, where the second log includes text data corresponding to the intended voice;
the obtaining module is further configured to obtain a third log when the monitoring module monitors the third log matched with the third filtering parameter, where the third log includes the response result.
The value of the first filtering parameter is the text data of the awakening word, and if the log contains the text data of the awakening word, the log is a first log matched with the first filtering parameter;
the value of the second filtering parameter is a second set value, the second set value indicates that the voice interaction equipment finishes collecting the voice of the user, and if the log contains the second set value, the log is a second log matched with the second filtering parameter;
and if the log contains the third set value, the log is a third log matched with the third filtering parameter.
Wherein, the device still includes:
a calculating module, configured to determine a time difference between a second time of the second log record and a third time of the third log record as a time consumed by the voice interaction device for responding to the voice;
the second moment is the finishing moment of finishing the voice acquisition of the user; and the third moment is the moment when the voice interaction equipment returns the response result to the user.
Wherein the second log further comprises expected results for the user speech, the apparatus further comprising:
and the analysis module is used for comparing the expected result with the response result contained in the third log, and when the expected result is matched with the response result contained in the third log, the voice interaction equipment is determined to successfully respond to the user voice, otherwise, the response is determined to fail.
Wherein, the device still includes:
and the storage module is used for acquiring and storing all logs generated by the voice interaction equipment in a preset time interval.
According to the scheme, the log data are obtained according to the filtering parameters, and effective and key log data can be obtained in a targeted mode according to the scene, so that the testing efficiency can be improved.
Drawings
Fig. 1 is a schematic diagram illustrating a log processing method according to an embodiment of the present invention;
fig. 2 is a schematic diagram illustrating a log processing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the disclosure provides a log processing method for voice interaction equipment, based on which the test for the voice interaction equipment is realized, the response time consumption of the voice interaction equipment can be tested, and the test efficiency and the accuracy of a test result can also be improved.
The log processing method provided by the disclosure is used for carrying out expansion description on the conversation based on the voice interaction equipment and the user. The dialogue input is user voice and the output is the response result of the voice interaction device. For example, the user inputs the voice "hello Xiaoming, turn on the television", and the voice interaction device controls the television to turn on. Typically, user speech consists of two parts: one is a wake-up word, such as "hello Xiaoming"; one is an intention, such as "turn on television".
The embodiment of the present disclosure as shown in fig. 1 provides a log processing method for a voice interaction device, which is applied to a log processing tool, where the log processing tool can be deployed for the voice interaction device, for example, on a computer, a mobile terminal, and the like. In embodiments of the present disclosure, the log management tool may be written in python.
The method comprises the following steps:
step 101, reading a configuration file, wherein the configuration file comprises a first filtering parameter, a second filtering parameter and a third filtering parameter.
In order to achieve the acquisition of the key log data, the embodiment of the disclosure provides a filtering parameter of the log. When the log and the filter parameter match, the log is obtained.
These filter parameters are pre-written in a configuration file that is read when the log processing tool is started.
In order to test the response time of the voice interaction device, in the embodiment of the present disclosure, at least three filtering parameters are provided:
the value of the first filtering parameter is text data of the awakening word;
the value of the second filtering parameter is a second set value, and the second set value indicates that the voice interaction equipment finishes collecting the user voice;
the value of the third filter parameter is a third setting value, and the third setting value indicates the voice interaction device to return a response result to the user.
Step 102, monitoring a log generated by the voice interaction device.
After the log processing tool is connected with the voice interaction device (namely, the device to be tested), log monitoring on the device to be tested can be started. For the monitored logs, filtering is performed using a filtering parameter.
Before the monitoring is started, the communication between the log management tool and the voice interaction equipment is ensured. Therefore, the configuration file may further include a device IP (IP of the voice interaction device), after the log tool is started, the configuration file is read, the device IP is connected to the voice interaction device in an ADB (Android, debug bridge) manner, the connection state is monitored in real time, a request is continuously sent to the voice interaction device through the ADB, a return value is monitored, when the correct value is 1, it is determined that the network is in a normal state (i.e., connected), and the other devices are abnormal (i.e., disconnected). When a disconnection is detected, it can be immediately reconnected, and the test process needs to be restarted.
Step 103, when a first log matched with the first filtering parameter is monitored, the first log is obtained, and the first log comprises text data corresponding to the awakening word voice.
The value of the first filtering parameter is the text data of the awakening word, and if the log contains the text data of the awakening word, the log is the first log matched with the first filtering parameter.
When a pair of dialogs starts, i.e. the user starts to input the wake-up word speech, the voice interaction device may generate a log recording the event, wherein the text data containing the wake-up word.
And 104, when a second log matched with the second filtering parameter is monitored, acquiring the second log, wherein the second log comprises text data corresponding to the intention voice.
And if the log contains the second set value, the log is a second log matched with the second filtering parameter.
When the user finishes inputting the voice, namely the voice interaction device finishes collecting the voice of the user, the voice interaction device generates a log and records the event, wherein the log comprises text data of an intention part in the voice of the user and a second set value representing the state, and the second set value can be set at will.
And 105, when a third log matched with the third filtering parameter is monitored, acquiring the third log, wherein the third log comprises a response result.
And if the log contains the third set value, the log is a third log matched with the third filtering parameter.
After the voice interaction device collects the voice of the user, the voice interaction device analyzes the voice to generate a response result. The voice interaction device feeds back the response result to the user, and at this time, the voice interaction device generates a log and records the event, wherein the log includes the response result and a third setting value representing the state, and the third setting value can be set arbitrarily.
Based on the obtained log, time consumed for response can be determined, and the method comprises the following steps:
determining the time difference between the second moment of the second log record and the third moment of the third log record as the time consumed by the voice interaction equipment for responding to the voice;
the second moment is the moment when the collection of the user voice is finished (namely the moment when the user inputs the voice to be finished); and the third moment is the moment when the voice interaction equipment returns the response result to the user.
It should be noted that after the response elapsed time is calculated, data such as the response elapsed time, the user intention, the expected result, the response result, and the like can be acquired by the slicing method in python and output to the window of the log management tool for the tester to use.
In order to further enrich the use scenario of the log processing tool, the second log further includes an expected result for the voice of the user, where the expected result is a preset result returned for the user's intention. And comparing the expected result with the response result (namely the actually returned result) contained in the third log, wherein when the expected result is matched with the response result (namely the actually returned result), the response of the voice interaction equipment to the voice of the user is successful, otherwise, the response is failed. And based on the number of times, carrying out multiple rounds of dialogue tests, and testing the response accuracy of the voice interaction equipment.
In another embodiment, the present disclosure further supports acquiring all logs generated by the voice interaction device during the period of time every predetermined length of time. Therefore, when the voice interaction equipment has an error, the corresponding log can be searched at the local terminal, the error reason can be analyzed, and the error process does not need to be reproduced once and once like the existing processing mode.
In the above description, all the transmission of the log (from the voice interaction device to the log management tool) can be implemented based on the ADB method.
In addition, performance data of the voice interaction device, such as performance data of a CPU, a memory and the like, can be acquired in real time based on the ADB mode.
In the above scheme, the functions of monitoring the log, periodically acquiring the log, acquiring performance data, and the like can be realized by adopting multiple threads.
As shown in fig. 2, an embodiment of the present disclosure further provides a log processing apparatus, including:
a reading module 10, configured to read a configuration file, where the configuration file includes a first filtering parameter, a second filtering parameter, and a third filtering parameter;
a monitoring module 20, configured to monitor a log generated by the voice interaction device;
an obtaining module 30, configured to obtain a first log when the monitoring module 20 monitors the first log matched with the first filtering parameter, where the first log includes text data corresponding to the wakeup word voice;
the obtaining module 30 is further configured to obtain a second log when the monitoring module 20 monitors the second log matched with the second filtering parameter, where the second log includes text data corresponding to the intended speech;
the obtaining module 30 is further configured to obtain a third log when the monitoring module 20 monitors the third log matched with the third filtering parameter, where the third log includes the response result.
The value of the first filtering parameter is the text data of the awakening word, and if the log contains the text data of the awakening word, the log is a first log matched with the first filtering parameter;
The value of the second filtering parameter is a second set value, the second set value indicates that the voice interaction equipment finishes collecting the voice of the user, and if the log contains the second set value, the log is a second log matched with the second filtering parameter;
and if the log contains the third set value, the log is a third log matched with the third filtering parameter.
Wherein, the device still includes:
a calculating module 40, configured to determine a time difference between a second time of the second log record and a third time of the third log record as a time consumed by the voice interaction device for responding to the voice;
the second moment is the finishing moment of finishing the voice acquisition of the user; and the third moment is the moment when the voice interaction equipment returns the response result to the user.
Wherein the second log further comprises expected results for the user speech, the apparatus further comprising:
an analysis module 50, configured to compare the expected result with the response result included in the third log, and when the expected result and the response result are matched, determine that the response of the voice interaction device to the user voice is successful, otherwise, determine that the response is failed.
Wherein, the device still includes:
a storage module 60 (not shown in the figure) for acquiring and storing all logs generated by the voice interaction device in a predetermined time interval.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (8)
1. A log processing method of a voice interaction device, wherein the voice interaction device collects user voices and returns response results to the user, and the user voices comprise wakeup word voices and intention voices, and the method comprises the following steps:
reading a configuration file, wherein the configuration file comprises a first filtering parameter, a second filtering parameter and a third filtering parameter;
monitoring a log generated by the voice interaction equipment;
when a first log matched with the first filtering parameter is monitored, the first log is obtained, and the first log comprises text data corresponding to the awakening word voice;
when a second log matched with the second filtering parameter is monitored, the second log is obtained, and the second log comprises text data corresponding to the intention voice;
When a third log matched with the third filtering parameter is monitored, the third log is obtained, and the third log comprises the response result;
the value of the first filtering parameter is the text data of the awakening word, and if the log contains the text data of the awakening word, the log is a first log matched with the first filtering parameter;
the value of the second filtering parameter is a second set value, the second set value indicates that the voice interaction equipment finishes collecting the voice of the user, and if the log contains the second set value, the log is a second log matched with the second filtering parameter;
and if the log contains the third set value, the log is a third log matched with the third filtering parameter.
2. The method of claim 1, wherein after the second log and the third log are obtained, the method further comprises:
determining a time difference between a second moment of the second log record and a third moment of the third log record as a time consumed for the voice interaction device to respond to the user voice;
The second moment is the finishing moment of finishing the voice acquisition of the user; and the third moment is the moment when the voice interaction equipment returns the response result to the user.
3. The method of claim 1, wherein the second log further comprises expected results for the user's voice, the method further comprising:
and comparing the expected result with the response result contained in the third log, and when the expected result is matched with the response result contained in the third log, determining that the response of the voice interaction equipment to the user voice is successful, otherwise, confirming that the response is failed.
4. The method of claim 1, further comprising:
and acquiring and storing all logs generated by the voice interaction equipment in a preset time interval.
5. A log processing device of a voice interaction device, wherein the voice interaction device collects user voices and returns response results to the user, and the user voices comprise awakening word voices and intention voices, and the log processing device is characterized by comprising:
the reading module is used for reading a configuration file, and the configuration file comprises a first filtering parameter, a second filtering parameter and a third filtering parameter;
The monitoring module is used for monitoring the log generated by the voice interaction equipment;
the acquisition module is used for acquiring a first log matched with the first filtering parameter when the monitoring module monitors the first log, wherein the first log comprises text data corresponding to the awakening word voice;
the acquisition module is further configured to acquire a second log when the monitoring module monitors the second log matched with the second filtering parameter, where the second log includes text data corresponding to the intended voice;
the acquisition module is further configured to acquire a third log when the monitoring module monitors the third log matched with the third filtering parameter, where the third log includes the response result;
the value of the first filtering parameter is the text data of the awakening word, and if the log contains the text data of the awakening word, the log is a first log matched with the first filtering parameter;
the value of the second filtering parameter is a second set value, the second set value indicates that the voice interaction equipment finishes collecting the voice of the user, and if the log contains the second set value, the log is a second log matched with the second filtering parameter;
And if the log contains the third set value, the log is a third log matched with the third filtering parameter.
6. The apparatus of claim 5, further comprising:
the computing module is used for determining the time difference between the second moment recorded by the second log and the third moment recorded by the third log as the time consumed by the voice interaction equipment for responding to the voice of the user;
the second moment is the finishing moment of the completion of the voice acquisition of the user; and the third moment is the moment when the voice interaction equipment returns the response result to the user.
7. The apparatus of claim 5, wherein the second log further comprises expected results for the user's speech, the apparatus further comprising:
and the analysis module is used for comparing the expected result with the response result contained in the third log, and when the expected result is matched with the response result contained in the third log, the voice interaction equipment is determined to successfully respond to the user voice, otherwise, the response is determined to fail.
8. The apparatus of claim 5, further comprising:
and the storage module is used for acquiring and storing all logs generated by the voice interaction equipment in a preset time interval.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911390580.9A CN111190806B (en) | 2019-12-30 | 2019-12-30 | Log processing method and device of voice interaction equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911390580.9A CN111190806B (en) | 2019-12-30 | 2019-12-30 | Log processing method and device of voice interaction equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111190806A CN111190806A (en) | 2020-05-22 |
| CN111190806B true CN111190806B (en) | 2022-07-29 |
Family
ID=70707832
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911390580.9A Active CN111190806B (en) | 2019-12-30 | 2019-12-30 | Log processing method and device of voice interaction equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111190806B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111785268A (en) * | 2020-06-30 | 2020-10-16 | 北京声智科技有限公司 | Method and device for testing voice interaction response speed and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016078214A1 (en) * | 2014-11-18 | 2016-05-26 | 中兴通讯股份有限公司 | Terminal processing method, device and computer storage medium |
| CN108038231A (en) * | 2017-12-26 | 2018-05-15 | 广东欧珀移动通信有限公司 | log processing method, device, terminal device and storage medium |
| CN108416041A (en) * | 2018-03-14 | 2018-08-17 | 苏州思必驰信息科技有限公司 | Voice log analysis method and system |
-
2019
- 2019-12-30 CN CN201911390580.9A patent/CN111190806B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016078214A1 (en) * | 2014-11-18 | 2016-05-26 | 中兴通讯股份有限公司 | Terminal processing method, device and computer storage medium |
| CN108038231A (en) * | 2017-12-26 | 2018-05-15 | 广东欧珀移动通信有限公司 | log processing method, device, terminal device and storage medium |
| CN108416041A (en) * | 2018-03-14 | 2018-08-17 | 苏州思必驰信息科技有限公司 | Voice log analysis method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111190806A (en) | 2020-05-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6973415B1 (en) | System and method for monitoring and modeling system performance | |
| US7082381B1 (en) | Method for performance monitoring and modeling | |
| US7197428B1 (en) | Method for performance monitoring and modeling | |
| JP2008171101A (en) | Policy improvement system | |
| US7478273B2 (en) | Computer system including active system and redundant system and state acquisition method | |
| KR20070080313A (en) | Method and system for analyzing performance of providing services to client terminal | |
| CN111464376A (en) | Website availability monitoring method and device, storage medium and computer equipment | |
| CN111190806B (en) | Log processing method and device of voice interaction equipment | |
| CN114141302A (en) | Test method of solid state disk and electronic equipment | |
| CN116306429A (en) | Method, device, computer storage medium and terminal for realizing state data capture | |
| CN113676377B (en) | Online user number evaluation method, device, equipment and medium based on big data | |
| CN113140217B (en) | Voice instruction testing method, testing device and readable storage medium | |
| CN115103289A (en) | Earphone aging monitoring method and device, computer equipment and storage medium | |
| CN114840422A (en) | Test method, test device, electronic equipment and storage medium | |
| CN113392005A (en) | Large file processing test method and system | |
| CN111240990A (en) | ISMCLI command line testing method, system, terminal and storage medium | |
| CN113409816B (en) | Audio-frequency clamping-on detection method, device, computer equipment and storage medium | |
| CN113778770B (en) | Detection method and system for hard disk chip | |
| CN103678375A (en) | Test state presentation and anomaly indexing system and method | |
| CN108874608A (en) | A kind of method, apparatus and computer storage medium of pressure test | |
| CN114240079A (en) | Data processing method and device | |
| CN117608938A (en) | Server testing method and device, electronic equipment and storage medium | |
| CN117294735A (en) | Intranet B/S application system health checking method, system and device | |
| CN117785706A (en) | Method, device and storage medium for optimizing test case generation | |
| CN117893093A (en) | Method, device, equipment and medium for measuring personnel efficiency index |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 215024 building 14, Tengfei Innovation Park, 388 Xinping street, Suzhou Industrial Park, Jiangsu Province Applicant after: Sipic Technology Co.,Ltd. Address before: 215024 building 14, Tengfei Innovation Park, 388 Xinping street, Suzhou Industrial Park, Jiangsu Province Applicant before: AI SPEECH Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |