CN115629950A - Method for extracting asynchronous request processing time point of performance test - Google Patents
Method for extracting asynchronous request processing time point of performance test Download PDFInfo
- Publication number
- CN115629950A CN115629950A CN202211629546.4A CN202211629546A CN115629950A CN 115629950 A CN115629950 A CN 115629950A CN 202211629546 A CN202211629546 A CN 202211629546A CN 115629950 A CN115629950 A CN 115629950A
- Authority
- CN
- China
- Prior art keywords
- time point
- log
- file
- association
- extracting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a method for extracting a performance test asynchronous request processing time point, which comprises the following steps: s1, adjusting the log output of application service on a link to be tested, and increasing the time point of a log output request processing flow, a request serial number and flow identification keyword output; s2, performing performance test on the link to be tested, and recording the starting time and the ending time of the performance test; s3, collecting log files generated by the application services on the pressure test link in the test process, and collecting the log files from a server where each application service is located through the starting time and the ending time after the performance test is executed; the method can effectively solve the problem of extracting the response time of the performance test asynchronous request, unifies the data providing mode through the log output mode, and reduces the secondary development workload.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a method for extracting a performance test asynchronous request processing time point.
Background
The request response time is an important index of the performance test result, and is obtained by calculating the difference between the result return time point of the request and the trigger time point of the request. The main performance testing tools such as a meter, a loadrunner, and the like, the statistical response time of the process from the triggering of the API request to the receiving of the API return result is only applicable to the API of the synchronization request. For the asynchronous request API, in addition to the response time of the API itself, the response time of the background service for processing the asynchronous request needs to be statistically analyzed, and the current performance test faces the difficulty of obtaining the time points of each flow of the asynchronous request, and developers need to design the background service program to provide support for obtaining the processing time points of each flow.
The prior art is realized by the following technical scheme: 1. tracking the opening request by java through skywalk and other frameworks, and realizing the statistics of the processing time point and the consumed time of the request in each service for the subsequent response time through secondary development; 2. the C + + or other languages lack a request trace framework and require additional development of request trace functionality. However, the method has the following defects that different development languages have different support degrees for request tracking under the ecological conditions, a unified technical framework is lacked, and developers need to make more changes on service programs to realize the processing time point of the storage request in each service.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a method for extracting a performance test asynchronous request processing time point, which can reduce the workload of secondary development, in view of the deficiencies of the above technical solutions.
The invention provides a method for extracting asynchronous request processing time points of performance tests, which comprises the following steps:
s1, adjusting the log output of application service on a link to be tested, and increasing the time point of a log output request processing flow, a request serial number and flow identification keyword output;
s2, performing performance test on the link to be tested, and recording the starting time and the ending time of the performance test;
s3, collecting log files generated by the application services on the pressure test link in the test process, and collecting the log files from a server where each application service is located through the starting time and the ending time after the performance test is executed;
s4, after the content of the log file is read, the regular expression is used for matching and extracting each log output request processing flow time point, and the log extraction record of the same flow time point is stored in a cache file;
and S5, correlating the cache file records of all the process time points through the request serial numbers to obtain all the processing process time points of each request.
In the method for extracting the processing time point of the performance test asynchronous request, the step S4 further includes the following steps:
and S41, setting extraction rules of each flow time point, wherein each rule is responsible for extracting one time point of a processing flow, and when a log file under the same application service records a plurality of time points, a plurality of extraction rules need to be configured for the log file under the same application service.
In the method for extracting the processing time point of the performance test asynchronous request, the step S4 further includes the following steps:
and S42, controlling the operation sequence of the log content extraction through the set content extraction step.
In the method for extracting the asynchronous request processing time point for performance testing, the step S4 further includes the following steps:
and S43, sequentially executing all content extraction steps, finishing the extraction of all requested flow time points, and obtaining cache files of all requested flow time points.
In the method for extracting the asynchronous request processing time point for performance test according to the present invention, the rule content in step S41 includes: the method comprises the steps of extracting a regular expression, a field name and a cache file, wherein the regular expression is used for regular matching of log file content, identifying keywords through a process to match the log content, and extracting a time point and a request serial number through extracting a sub-expression; the extraction field names are used for identifying extraction contents in subsequent association operation, wherein the serial numbers in all extraction rules are requested to use the same field names; the content extraction cache file is a csv-format file and is used for storing the flow time point record extracted by the rule, wherein the first line of the cache file content is the extraction field name, and the second line is used for extracting the log time point record.
In the method for extracting the asynchronous request processing time point for performance test according to the present invention, in step S42;
in the content extraction step, the log file range required to be processed in the step S42 is filtered through a file filtering regular expression, a plurality of log files are generated by applying the service in the performance test process, and in order to extract the content of the log files of the same service at the same time, the log files are filtered by matching file names in a regular expression mode;
by the extraction rule list of all time points of the log file content of the processing range in the extraction rule setting step S42, in the process of reading the log file content, each row of log content executes all extraction rules in the list for content extraction and storage.
In the method for extracting the processing time point of the performance test asynchronous request, the step S5 further includes the following steps:
s51, loading the content of the extracted file at the time point triggered by the test request recorded by the application service log into a memory, and assigning the content to an associated result cache object;
s52, dividing the result cache object into a plurality of fragments according to the fixed size of the request record;
s53, the associated thread group creates the associated threads with the same number according to the number of the fragments, and the fragments are respectively distributed to the associated threads to carry out associated operation;
s54, after the associated thread group creates the thread, the associated controller is informed to trigger the next round of association;
and S55, when the association controller receives and triggers the next round of association request, the cache loading controller is informed to load the next extraction file into the memory.
In the method for extracting the processing time point of the performance test asynchronous request, the step S5 further includes the following steps:
s56, when the cache loading controller receives a request for loading the next extraction file, judging whether the extraction file has a time point without processing, if so, loading the content of the unprocessed extraction file into the time point cache in the memory, and informing the association controller of finishing loading after the loading is finished, and if all the extraction files are finished associating, informing the association controller of finishing associating;
and S57, when the association controller receives the cache loading completion signal, the association controller informs the association thread group to start association, and after receiving the association completion signal, the association thread group is informed to release thread resources, and records of the result cache object are written into the association result file.
In the method for extracting the processing time point of the performance test asynchronous request, the step S5 further includes the following steps:
and S58, when the associated thread group receives the association starting signal, all associated threads read each request record of the segment in sequence, use the request serial number to inquire the flow time point in the time point cache and add the flow time point to the segment record, and after all associated threads complete the association operation of the round, the associated thread group informs the associated controller to send the trigger of the next round of association.
The extraction method of the performance test asynchronous request processing time point can solve the extraction problem of the performance test asynchronous request response time, and reduces the secondary development workload by unifying the data supply mode in a log output mode.
Drawings
FIG. 1 is a flow chart of a method for extracting a processing time point of an asynchronous request in a performance test according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Moreover, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
As shown in fig. 1, a method for extracting a performance test asynchronous request processing time point is provided, which includes the following steps:
in step S1, adjusting the log output of the application service on the link to be tested, and increasing the time point of the log output request processing flow, the request serial number and the flow identification keyword output; log so as to distinguish application services to which the log file belongs and generation time, and the size of each log file is set to be the maximum value, for example, 50M, so that the extraction performance is prevented from being influenced by the generation of a larger log file, and a new log file is automatically generated to the maximum value of the log file; the number of the single log file is not more than 100M, and the main purpose is to reduce the probability that multiple pressure measurement results are mixed in one log file and reduce the number of logs for processing non-current tests when the contents of the log file are read. The time output of the log file needs to be accurate to millisecond, and the time output format needs to be unified, which is expressed as year, month, day, hour, minute, second and millisecond; the application service receiving the request is responsible for generating a request serial number, the serial number adopts a globally unique ID and runs through the whole processing flow of the request, and all the application services need to output the request serial number when outputting a processing time point log; when each application service outputs a process time point log file, the content of the log file needs to contain process identification keywords, so that the process time point log can be filtered from the log file through the keywords without confusion, and error extraction is avoided; each application service needs to output at least a time point of receiving a request and a time point of completing a request result response.
The request serial number is used for associating the time point with the request, because the service log contains a plurality of processing logs of the request, and if the serial number is not output, the log content cannot be distinguished from which request corresponds;
each row of output logs needs to contain log time, request serial numbers and identification keywords for identifying which process outputs the log;
in step S2, performing performance test on the link to be tested, and recording the starting time and the ending time of the performance test;
in step S3, collecting log files generated by the application services on the compression link in the testing process, and collecting the log files from the server where each application service is located through the starting time and the ending time after the performance test is executed;
in step S4, after the content of the log file is read, the regular expression is used for matching and extracting each log output request processing flow time point, and the log extraction record of the same flow time point is stored in a cache file;
in step S5, the cache file records of all process time points are associated by the request serial number, so as to obtain all process flow time points of each request.
In an embodiment, step S4 further includes the following steps:
in step S41, extraction rules for each process time point are set, each rule is responsible for extracting one time point of the processing process, and when a plurality of time points are recorded in a log file under the same application service, a plurality of extraction rules need to be configured for the log file under the same application service.
In an embodiment, step S4 further comprises the steps of:
in step S42, the log content extraction operation sequence is controlled by setting content extraction.
In an embodiment, step S4 further includes the following steps:
in step S43, all the content extraction steps are sequentially executed to complete the extraction of all the requested flow time points, and obtain the cache files of all the requested flow time points.
In one embodiment, the rule content in step S41 includes: extracting a regular expression, a field name and a content extraction cache file, wherein the regular expression is used for regular matching of log file content, matching log content through process identification keywords, and extracting a time point and a request serial number through extracting a sub-expression; extracting field names for identifying the extracted contents in the subsequent association operation, wherein the serial numbers are requested to use the same field names in all the extraction rules; the content extraction cache file is a file in a csv format and is used for storing the flow time point record extracted by the rule, wherein the first line of the cache file content is the extraction field name, and the second line is used for extracting the record for the log time point.
In one embodiment, in step S42;
in the content extraction step, the log file range required to be processed in the step S42 is filtered through a file filtering regular expression, a plurality of log files are generated by applying a service in the performance test process, and in order to extract the content of the log files of the same service at the same time, the log files are filtered by matching file names in a regular expression mode;
by the extraction rule list of all time points of the log file content of the processing range in the extraction rule setting step S42, in the process of reading the log file content, each row of log content executes all extraction rules in the list for content extraction and storage.
In an embodiment, step S5 further includes the steps of:
in step S51, the content of the test request trigger time point extraction file recorded by the application service log is loaded into the memory and assigned to the associated result cache object;
in step S52, dividing the result cache object into a plurality of pieces according to a fixed size for the request record; wherein each segment comprises 10 ten thousand request records;
in step S53, the association thread group creates the same number of association threads according to the number of fragments, and performs association operations after allocating the fragments to the association threads respectively;
in step S54, after the associated thread group creates a thread, the associated controller is notified to trigger the next round of association;
in step S55, when the association controller receives a trigger for the next round of association request, the cache loading controller is notified to load the next fetch file into the memory.
In one embodiment, step S5 further comprises the steps of:
in step S56, when the cache loading controller receives a request for loading a next extraction file, it determines whether there is a time point at which the extraction file is not processed, if yes, loads an unprocessed extraction file content into the time point cache in the memory, and notifies the association controller of completing loading after completing loading, and if all the extraction files are completed, notifies the association controller of completing association;
in step S57, the association controller notifies the associated thread group to start association after receiving the cache load complete signal, notifies the associated thread group to release thread resources after receiving the association complete signal, and writes the record of the result cache object into the association result file.
In an embodiment, step S5 further includes the steps of:
in step S58, after the association thread group receives the association start signal, all association threads will sequentially read each request record of their segment and use the request serial number to query the flow time point in the time point cache and add it to the segment record, and after all association threads complete the association operation of this round, the association thread group notifies the association controller to trigger the next round of association.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art will appreciate that the embodiments described in this specification are presently preferred and that no acts or modules are required by the invention.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
Therefore, the above description is only a preferred embodiment of the present invention, and the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention will be covered within the scope of the present invention, and the scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (9)
1. A method for extracting asynchronous request processing time points in performance tests is characterized by comprising the following steps:
s1, adjusting the log output of application service on a link to be tested, and increasing the time point of a log output request processing flow, a request serial number and flow identification keyword output;
s2, performing performance test on the link to be tested, and recording the starting time and the ending time of the performance test;
s3, collecting log files generated by the application services on the pressure test link in the test process, and collecting the log files from the server where each application service is located through the start time and the end time after the performance test is executed;
s4, after the content of the log file is read, the regular expression is used for matching and extracting each log output request processing flow time point, and the log extraction record of the same flow time point is stored in a cache file;
and S5, correlating the cache file records of all the process time points through the request serial numbers to obtain all the processing process time points of each request.
2. The method for extracting the asynchronous request processing time point for performance test as claimed in claim 1, wherein said step S4 further comprises the steps of:
and S41, setting extraction rules of each flow time point, wherein each rule is responsible for extracting one time point of a processing flow, and when a log file under the same application service records a plurality of time points, a plurality of extraction rules need to be configured for the log file under the same application service.
3. The method for extracting asynchronous request processing time point for performance test as claimed in claim 2, wherein said step S4 further comprises the steps of:
and S42, controlling the operation sequence of the log content extraction by the setting content extraction step.
4. The method for extracting the asynchronous request processing time point for performance test as claimed in claim 3, wherein said step S4 further comprises the steps of:
and S43, sequentially executing all the content extraction steps, finishing the extraction of all the requested flow time points, and obtaining the cache files of all the requested flow time points.
5. The method for extracting asynchronous request processing time point for performance test as claimed in claim 4, wherein the rule content in said step S41 comprises: the method comprises the steps of extracting a regular expression, a field name and a cache file, wherein the regular expression is used for regular matching of log file contents, identifying keywords through a process to match the log contents, and extracting a time point and a request serial number through extracting sub-expressions; the extraction field names are used for identifying extraction contents in subsequent association operation, wherein the same field names are used in all the extraction rules for requesting serial numbers; the content extraction cache file is a file in a csv format and is used for storing the flow time point record extracted by the rule, wherein the first line of the cache file content is the extraction field name, and the second line is used for extracting the record for the log time point.
6. The method for extracting an asynchronous request processing time point for performance test as claimed in claim 5, wherein in said step S42;
in the content extraction step, the log file range required to be processed in the step S42 is filtered through a file filtering regular expression, a plurality of log files are generated by applying the service in the performance test process, and in order to extract the content of the log files of the same service at the same time, the log files are filtered by matching file names in a regular expression mode; by the extraction rule list of all time points of the log file content of the processing range in the extraction rule setting step S42, in the process of reading the log file content, each row of log content executes all extraction rules in the list for content extraction and storage.
7. The method for extracting the asynchronous request processing time point for performance test as claimed in claim 6, wherein said step S5 further comprises the steps of:
s51, loading the content of the extracted file at the time point triggered by the test request recorded by the application service log into a memory, and assigning the content to an associated result cache object;
s52, dividing the result cache object into a plurality of fragments according to the fixed size of the request record;
s53, the associated thread group creates the associated threads with the same quantity according to the quantity of the fragments, and the fragments are respectively distributed to the associated threads to carry out the associated operation;
s54, after the associated thread group creates the thread, the associated controller is informed to trigger the next round of association;
and S55, when the association controller receives and triggers the next round of association request, the cache loading controller is informed to load the next extraction file into the memory.
8. The method for extracting the asynchronous request processing time point for performance test as claimed in claim 7, wherein said step S5 further comprises the steps of:
s56, when the cache loading controller receives a request for loading the next extracted file, judging whether the extracted file at a time point is unprocessed or not, if so, loading the content of the unprocessed extracted file into the time point cache in the memory, and informing the association controller of finishing loading after the loading is finished, and if all the extracted files are finished to be associated, informing the association controller of finishing the association;
and S57, when the association controller receives the cache loading completion signal, the association controller informs the association thread group to start association, and after receiving the association completion signal, the association thread group is informed to release thread resources, and records of the result cache object are written into the association result file.
9. The method for extracting the asynchronous request processing time point for performance test as claimed in claim 8, wherein said step S5 further comprises the steps of:
and S58, when the associated thread group receives the association starting signal, all associated threads read each request record of the segment in sequence, use the request serial number to inquire the flow time point in the time point cache and add the flow time point to the segment record, and after all associated threads complete the association operation of the round, the associated thread group informs the associated controller to send the trigger of the next round of association.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211629546.4A CN115629950B (en) | 2022-12-19 | 2022-12-19 | Extraction method of performance test asynchronous request processing time point |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211629546.4A CN115629950B (en) | 2022-12-19 | 2022-12-19 | Extraction method of performance test asynchronous request processing time point |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115629950A true CN115629950A (en) | 2023-01-20 |
| CN115629950B CN115629950B (en) | 2023-04-28 |
Family
ID=84910737
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211629546.4A Active CN115629950B (en) | 2022-12-19 | 2022-12-19 | Extraction method of performance test asynchronous request processing time point |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115629950B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190156415A1 (en) * | 2017-11-22 | 2019-05-23 | Cooperation Loan Platform Company Limited | Fund transaction platforms |
| CN111078657A (en) * | 2019-12-26 | 2020-04-28 | 北京思特奇信息技术股份有限公司 | Service log query method, system, medium and equipment of distributed system |
| WO2021000494A1 (en) * | 2019-07-04 | 2021-01-07 | 平安科技（深圳）有限公司 | Blockchain-based operation logging method and apparatus, device, and storage medium |
| CN112882957A (en) * | 2021-03-30 | 2021-06-01 | 中信银行股份有限公司 | Test task validity checking method and device |
| CN113377611A (en) * | 2021-06-07 | 2021-09-10 | 广发银行股份有限公司 | Business processing flow monitoring method, system, equipment and storage medium |
| CN115237796A (en) * | 2022-08-03 | 2022-10-25 | 平安壹钱包电子商务有限公司 | Link abnormity identification method and device, storage medium and electronic equipment |
-
2022
- 2022-12-19 CN CN202211629546.4A patent/CN115629950B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190156415A1 (en) * | 2017-11-22 | 2019-05-23 | Cooperation Loan Platform Company Limited | Fund transaction platforms |
| WO2021000494A1 (en) * | 2019-07-04 | 2021-01-07 | 平安科技（深圳）有限公司 | Blockchain-based operation logging method and apparatus, device, and storage medium |
| CN111078657A (en) * | 2019-12-26 | 2020-04-28 | 北京思特奇信息技术股份有限公司 | Service log query method, system, medium and equipment of distributed system |
| CN112882957A (en) * | 2021-03-30 | 2021-06-01 | 中信银行股份有限公司 | Test task validity checking method and device |
| CN113377611A (en) * | 2021-06-07 | 2021-09-10 | 广发银行股份有限公司 | Business processing flow monitoring method, system, equipment and storage medium |
| CN115237796A (en) * | 2022-08-03 | 2022-10-25 | 平安壹钱包电子商务有限公司 | Link abnormity identification method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115629950B (en) | 2023-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110399293B (en) | System test method, device, computer equipment and storage medium | |
| CN109284269B (en) | Abnormal log analysis method and device, storage medium and server | |
| US9715409B2 (en) | Job delay detection method and information processing apparatus | |
| US7913233B2 (en) | Performance analyzer | |
| CN103198010A (en) | Software testing method, device and system | |
| CN110569214A (en) | Index construction method and device for log file and electronic equipment | |
| CN107003931B (en) | Decoupling test validation from test execution | |
| CN116089220A (en) | Index inspection method and device based on operating system and electronic equipment | |
| CN113220597B (en) | Test method, test device, electronic equipment and storage medium | |
| CN112948262A (en) | System test method, device, computer equipment and storage medium | |
| CN112685316A (en) | Code execution path acquisition method and device, computer equipment and storage medium | |
| CN115629950A (en) | Method for extracting asynchronous request processing time point of performance test | |
| JP4928480B2 (en) | Job processing system and job management method | |
| CN115576831A (en) | Test case recommendation method, device, equipment and storage medium | |
| EP2159697A1 (en) | Method for evaluating a production rule for a memory management analysis | |
| JP2009181494A (en) | Job processing system and job information acquisition method | |
| CN102521134A (en) | Test information detecting method and test information detecting device based on mainframe | |
| CN111309623B (en) | Coordinate class data classification test method and device | |
| CN117591431A (en) | Test method, test device, computer equipment and storage medium | |
| CN115145810A (en) | Method, device, equipment, medium and product for obtaining test data | |
| CN117493153A (en) | Interface testing method and device, electronic equipment and storage medium | |
| CN113961472A (en) | Automatic testing method and device, storage medium and electronic equipment | |
| CN115328790A (en) | Test code generation method, device, equipment and readable storage medium | |
| CN115202968A (en) | Problem positioning method and device for transaction system | |
| CN118260524A (en) | Data statistics method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |