CN116089187A - GPU test system, electronic equipment and storage medium - Google Patents

GPU test system, electronic equipment and storage medium Download PDF

Info

Publication number
CN116089187A
CN116089187A CN202211728431.0A CN202211728431A CN116089187A CN 116089187 A CN116089187 A CN 116089187A CN 202211728431 A CN202211728431 A CN 202211728431A CN 116089187 A CN116089187 A CN 116089187A
Authority
CN
China
Prior art keywords
test
service
target
test case
task
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202211728431.0A
Other languages
Chinese (zh)
Other versions
CN116089187B (en
Inventor
请求不公布姓名
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Moore Threads Technology Co Ltd
Original Assignee
Moore Threads Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Moore Threads Technology Co Ltd filed Critical Moore Threads Technology Co Ltd
Priority to CN202211728431.0A priority Critical patent/CN116089187B/en
Publication of CN116089187A publication Critical patent/CN116089187A/en
Application granted granted Critical
Publication of CN116089187B publication Critical patent/CN116089187B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/22Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
    • G06F11/2205Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing using arrangements specific to the hardware being tested
    • G06F11/2236Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing using arrangements specific to the hardware being tested to test CPU or processors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/22Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
    • G06F11/2273Test methods

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The disclosure relates to the technical field of computers, and discloses a GPU test system, electronic equipment and a storage medium, wherein the system comprises: the system comprises a test case service, a data processing unit and a data processing unit, wherein the test case service is used for concurrently uploading a test case set, and the test case set comprises a plurality of test cases for GPU test; a test plan service for concurrently generating a plurality of test plans, wherein each of the test plans is generated based on a plurality of the test cases; and the test task service is used for generating and running a plurality of test tasks concurrently, wherein each test task corresponds to one test plan. The method and the device can improve the uploading efficiency of the full test case set, improve the generating efficiency of the test plan and the running efficiency of the test task, and finally improve the end-to-end whole-course test efficiency of the GPU test.

Description

GPU test system, electronic equipment and storage medium
Technical Field
The disclosure relates to the field of computer technology, and in particular, to a GPU testing system, an electronic device, and a storage medium.
Background
Graphics processors (Graphics Processing Unit, GPUs) require testing prior to shipment to ensure their performance and stability. The number of Test cases (Test cases) for performing GPU testing is huge, usually more than a million, and how to implement high-concurrency industrial-level GPU testing based on large-scale Test cases is a current problem to be solved.
Disclosure of Invention
The disclosure provides a GPU test system, an electronic device and a technical scheme of a storage medium.
According to an aspect of the present disclosure, there is provided a GPU testing system, comprising: the system comprises a test case service, a data processing unit and a data processing unit, wherein the test case service is used for concurrently uploading a test case set, and the test case set comprises a plurality of test cases for GPU test; a test plan service for concurrently generating a plurality of test plans, wherein each of the test plans is generated based on a plurality of the test cases; and the test task service is used for generating and running a plurality of test tasks concurrently, wherein each test task corresponds to one test plan.
In one possible implementation manner, the test case service is configured to receive a test case set data packet that is uploaded in batches by a first target user, where the first target user is a user with access rights; the system further comprises: and the distributed object storage cluster is used for receiving the test case set data packet sent by the test case service and carrying out backup storage on the test case set data packet.
In one possible implementation manner, the test case service is configured to decompress the test case set data packet to obtain a first target data stream corresponding to the test case set; the system further comprises: a data stream platform, data stream consumer services; the data flow platform is used for receiving the first target data flow sent by the test case service and sending the first target data flow to the data flow consumer service.
In one possible implementation, the system further includes: a distributed relational database cluster; the data flow consumer service is used for sending a first operation request to the test case service; and the test case service is used for uploading the test cases in the first target data stream to the distributed relational database cluster for storage after receiving the first operation request.
In one possible implementation, the data flow consumer service is configured to send a test case upload status to the test case service; the test case service is used for sending the test case uploading state to the distributed relational database cluster.
In one possible implementation, the system further includes: a distributed cache cluster; the data flow consumer service is used for sending a second operation request to the test case service; and the test case service is used for sending the test case in the first target data stream to the distributed cache cluster for storage after receiving the second operation request.
In one possible implementation manner, the test case service is configured to monitor an upload state of the test case set data packet, and return first prompt information to the first target user when the upload state of the test case set data packet is that the upload is completed.
In one possible implementation manner, the test plan service is configured to receive a test plan creation request sent by a second target user, where the second target user is a user with access rights; the system further comprises: a distributed relational database cluster; the test plan service is used for initializing and creating a target test plan in the distributed relational database cluster based on the test plan creation request.
In a possible implementation manner, the test plan service is configured to receive a test case screening condition corresponding to the target test plan sent by the second target user, and send the test case screening condition to the test case service; the test case service is used for determining a test case screening result corresponding to the target test plan according to the test case screening condition and returning the test case screening result to the test plan service, wherein the test case screening result comprises a plurality of test case identifications.
In one possible implementation, the system further includes: a data stream platform, data stream consumer services; the data flow platform is used for receiving a second target data flow corresponding to the test case screening result sent by the test plan service and sending the second target data flow to the data flow consumer service; the data flow consumer service is used for sending a third operation request to the test case service; the test case service is configured to send a third target data stream corresponding to a test case subset corresponding to the test case screening result to the data stream consumer service after receiving the third operation request; and the data flow consumer service is used for sending the test case subset corresponding to the test case screening result to the target test plan in the distributed relational database cluster for storage.
In one possible implementation, the test plan service is configured to monitor a generation status of the target test plan, and return a second prompt message to the second target user when the generation status of the target test plan is completed.
In one possible implementation, the test plan service is configured to receive an executable state corresponding to the target test plan sent by the second target user, and send the executable state corresponding to the target test plan to the distributed relational database cluster.
In a possible implementation manner, the test task service is configured to receive a test task creation request sent by a third target user, where the third target user is a user with access rights, and the test task creation request is configured to request to create a test task based on a target test plan in the test plan service; the system further comprises: a distributed relational database cluster; and the test task service is used for initializing and creating a target test task corresponding to the target test plan in the distributed relational database cluster based on the test task creation request.
In one possible implementation, the system further includes: testing deployment services; the test task service is used for creating a test instance corresponding to the target test task in the test deployment service; the test deployment service is configured to determine a GPU to be tested corresponding to the test case, and obtain test case paging information corresponding to the target test task from the test task service, where the test case paging information is used to indicate a subset of test cases corresponding to the target test plan.
In one possible implementation, the system further includes: a data stream platform, data stream consumer services; the data flow platform is used for receiving a fourth target data flow corresponding to the test case paging information sent by the test deployment service and sending the fourth target data flow to the data flow consumer service; the data stream consumer service is used for sending a fourth operation request to the test plan service; the test plan service is configured to send a subset of test cases indicated by the test case paging information to the test task service after receiving the fourth operation request; and the test task service is used for sending the test case subset indicated by the test case paging information to the target test task in the distributed relational database cluster for storage.
In one possible implementation manner, the test task service is configured to monitor a generation state of the target test task, and return third prompt information to the third target user when the generation state of the target test task is completed.
In one possible implementation manner, the test task service is configured to receive an executable state corresponding to the target test task sent by the third target user, and send the executable state corresponding to the target test task to the distributed relational database cluster.
In one possible implementation manner, the test deployment service is configured to send the subset of test cases indicated by the test case paging information to the GPU to be tested for testing, so as to obtain a test result; the test deployment service is used for sending the test result to the test task service; and the test task service is used for sending the test result to the distributed relational database cluster.
In one possible implementation manner, the test task service is configured to monitor a test state of the target test task, and return a fourth prompt message to the third target user when the test state of the target test task is completed.
According to an aspect of the present disclosure, there is provided an electronic apparatus including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to run the system described above.
According to an aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, run the above system.
In an embodiment of the present disclosure, a GPU testing system includes: the test case service is used for concurrently uploading a test case set, wherein the test case set comprises a plurality of test cases for GPU test; a test plan service for concurrently generating a plurality of test plans, wherein each test plan is generated based on a plurality of test cases; and the test task service is used for generating and running a plurality of test tasks concurrently, wherein each test task corresponds to one test plan. According to the GPU test system based on the embodiment of the disclosure, the uploading efficiency of the full test case set can be improved, the generating efficiency of a test plan is improved, the running efficiency of a test task is improved, and therefore the whole process test efficiency from the GPU test end to the end is finally improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the technical aspects of the disclosure.
Fig. 1 illustrates a block diagram of a GPU testing system, according to an embodiment of the present disclosure.
FIG. 2 illustrates a flow chart of uploading a test case according to an embodiment of the present disclosure.
FIG. 3 illustrates a flow chart of generating a test plan according to an embodiment of the present disclosure.
FIG. 4 illustrates a flow chart for generating and running test tasks according to an embodiment of the disclosure.
Fig. 5 shows a block diagram of an electronic device, according to an embodiment of the disclosure.
Detailed Description
Various exemplary embodiments, features and aspects of the disclosure will be described in detail below with reference to the drawings. In the drawings, like reference numbers indicate identical or functionally similar elements. Although various aspects of the embodiments are illustrated in the accompanying drawings, the drawings are not necessarily drawn to scale unless specifically indicated.
The word "exemplary" is used herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.
The term "and/or" is herein merely an association relationship describing an associated object, meaning that there may be three relationships, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.
Furthermore, numerous specific details are set forth in the following detailed description in order to provide a better understanding of the present disclosure. It will be understood by those skilled in the art that the present disclosure may be practiced without some of these specific details. In some instances, methods, means, elements, and circuits well known to those skilled in the art have not been described in detail in order not to obscure the present disclosure.
In GPU testing, quality assurance (Quality Assurance, QA) engineers need to label each test case with various labels for calibrating the scenario of the test. Therefore, in order to ensure a highly usable state of test cases, it is necessary to be able to rapidly import and update large-scale (millions or more) test cases.
Because of the complexity of GPU testing, QA engineers may formulate different Test plans (Test Plan) according to different Test case sets to purposefully solve different problems, rather than going through the entire Test case set. Therefore, in order to accelerate the test progress, it is necessary to efficiently index and quickly generate test plans corresponding to different test case subsets from a large-scale (millions or more) test case set.
Based on each generated test plan, whether the test plan passes or not needs to be verified through multiple rounds of tests, and test results of each test case of each round of tests are rapidly stored for result analysis and prediction. Therefore, a Test Job (Test Job) capable of generating and running a Test plan having a large-scale (millions or more) Test case at high concurrency is required.
The embodiment of the disclosure provides a GPU testing system, which can be applied to the GPU testing scenario, and the GPU testing system provided by the embodiment of the disclosure is described in detail below.
Fig. 1 illustrates a block diagram of a GPU testing system, according to an embodiment of the present disclosure. The GPU testing system adopts a micro-service architecture, as shown in fig. 1, the GPU testing system comprises:
And the test case service is used for concurrently uploading a test case set, wherein the test case set comprises a plurality of test cases for GPU test.
The test case set herein may include a common test case set for performing GPU testing, and may also include a test case set specifically designed by a GPU manufacturer for GPUs produced by the GPU manufacturer, which is not specifically limited in this disclosure.
The test case set provides a test case foundation for the subsequent formulation of various test plans, and the QA engineer can add various labels to the test cases according to own test experience so as to facilitate the subsequent highly customized test plans.
Since the data size of the test case set is over a million levels, high concurrent access of large-scale data is inherently challenging, and the speed of formulation of test cases determines the start time of the relevant test plans.
In the GPU testing system provided by the embodiments of the present disclosure, the test case service is used to provide uploading, updating, managing and pulling of millions of test cases. The process of high concurrency uploading and updating the test case set based on the test case service will be described in detail below with reference to possible implementation manners of the present disclosure, and will not be described here.
And the test plan service is used for generating a plurality of test plans concurrently, wherein each test plan is generated based on a plurality of test cases.
In the GPU test system provided by the embodiment of the disclosure, the test plan service is used for providing multi-concurrency generation, management and pulling of millions of test plans. The process of generating the test plan based on the high concurrency of the test plan service will be described in detail later in connection with possible implementation manners of the present disclosure, and will not be described herein.
And the test task service is used for generating and running a plurality of test tasks concurrently, wherein each test task corresponds to one test plan.
For one test plan, hundreds or thousands of times may need to be tested during a GPU driven iteration, and thus, each test plan run may be referred to as a test task.
In the GPU testing system provided by the embodiments of the present disclosure, a test task service is used to provide high concurrency generation, pulling, and result updating of millions of test tasks of a test plan. The process of generating and running the test task based on the high concurrency of the test task service will be described in detail below in connection with possible implementation manners of the present disclosure, and will not be described herein.
According to the GPU test system disclosed by the embodiment of the invention, the uploading efficiency of the full test case set can be improved, the generating efficiency of a test plan is improved, and the running efficiency of a test task is improved, so that the whole process test efficiency from the GPU test end to the end is finally improved.
In one possible implementation manner, the test case service is configured to receive a test case set data packet that is uploaded in batches by a first target user, where the first target user is a user with access rights; the GPU testing system further comprises: the distributed object storage cluster is used for receiving the test case set data packet sent by the test case service and carrying out backup storage on the test case set data packet.
FIG. 2 illustrates a flow chart of uploading a test case according to an embodiment of the present disclosure. As shown in fig. 2, a first target user logs in the GPU test system through a user name and a password, and obtains a first access token corresponding to the first target user from an authorization service (Auth) in the GPU test system. Wherein the first access token is a globally unique identification identifying the identity and access rights of the first target user, and may be used to track the user behavior of the first target user. The first target user may be a QA engineer, which is not specifically limited by the present disclosure.
Because the data volume of the test case set is millions, in order to save bandwidth when uploading the test case set, the test case set is uploaded in a batch packing compression mode.
As shown in fig. 2, the first target user uploads test case set data packets to the test case service in bulk.
After the test case set data packet is uploaded to the test case service, the front end controller of the test case service can directly backup the test case set data packet to the distributed object storage cluster so as to prevent data loss caused by various human and/or uncontrollable factors.
As shown in fig. 2, the test case service sends the test case set data packet to the distributed object storage cluster for backup storage.
Furthermore, the GPU testing system includes: a distributed relational database cluster (DB) for large Data storage to support complex business oriented logic queries. As shown in FIG. 2, the test case service initiates creation of a test case set in a distributed relational database cluster. At this time, the test case set created by initialization in the distributed relational database cluster is empty, and is ready for subsequent storage of the test case uploaded by the first target user.
In one possible implementation manner, the test case service is configured to decompress the test case set data packet to obtain a first target data stream corresponding to the test case set; the GPU testing system further comprises: a data stream platform, data stream consumer services; the data flow platform is used for receiving the first target data flow sent by the test case service and sending the first target data flow to the data flow consumer service.
The Test Case service decompresses the Test Case set data packet at the cloud to obtain a Test Case set, and then divides the Test Case set into a plurality of data blocks (Test Case groups) and asynchronously sends the data blocks to a data flow platform (Streaming) in a first target data flow mode, so that high-concurrency and high-throughput data volume can be effectively buffered. On the other side of the data Stream platform, a data Stream Consumer service (Stream Consumer) performs high concurrency consumption on the test case data block corresponding to the first target data Stream according to the subscribed data Stream name (for example, the name of the first target data Stream) and the concurrency adaptive to the current network bandwidth. As shown in FIG. 2, the test case service asynchronously generates and transmits a first target data stream to the data stream platform, from which the data stream consumer service asynchronously consumes the first target data stream.
The test cases obtained by the data stream consumer service from the first target data stream in parallel can comprise the following two storage modes according to different use purposes, and the following detailed description is provided.
In one possible implementation, a data stream consumer service is configured to send a first operation request to a test case service; and the test case service is used for uploading the test cases in the first target data stream to the distributed relational database cluster for storage after receiving the first operation request.
For the test cases needing to be permanently stored, the data flow consumer service sends the test cases to the distributed relational database cluster for storage. The test cases that need to be permanently stored may be all or part of the set of test cases, which is not specifically limited in this disclosure.
As shown in fig. 2, the data stream consumer service sends a first operation request to the test case service. Wherein the first operation request is an operation for requesting persistence of each test case. And uploading the corresponding test cases in the first target data stream to the distributed relational database cluster by the test case service for storage, namely, persisting the corresponding test cases to the test case set created in the distributed relational database cluster before.
In one possible implementation, a data stream consumer service is used to send test case upload status to a test case service; and the test case service is used for sending the uploading state of the test case to the distributed relational database cluster.
As shown in fig. 2, the data flow consumer service sends a test case upload status to the test case service, so that the test case service sends the test case upload status to the distributed relational database cluster to update the upload status of the test case set data packet in the distributed relational database cluster.
In one possible implementation, the GPU testing system further includes: a distributed cache cluster; the data flow consumer service is used for sending a second operation request to the test case service; and the test case service is used for sending the test cases in the first target data stream to the distributed cache cluster for storage after receiving the second operation request.
Because the data reading rate of the distributed Cache cluster (Cache) is higher than that of the distributed relational database cluster, the data flow consumer service sends the test cases to the distributed Cache cluster for storage aiming at the test cases which need to be frequently read for testing, so that the subsequent reading rate is improved. The test cases requiring frequent reading for testing may be test cases requiring frequent repeated testing with a high test failure rate, or may be other selected test cases, which is not particularly limited in the present disclosure.
As shown in fig. 2, the data flow consumer service sends a second operation request to the test case service, where the second operation request is an operation for requesting to upload a new test case to the distributed cache cluster; and uploading the corresponding test cases in the first target data stream to the distributed cache cluster for storage by the test case service, namely uploading the corresponding test cases to the distributed cache cluster for caching.
In order to process the storage congestion caused by serial update caused by different kinds of data uploading from different first target users in parallel, a queue can be established according to the update kinds to update corresponding parameters sequentially.
In one possible implementation, the test case service is configured to monitor an upload state of the test case set data packet, and return a first prompt message to the first target user when the upload state of the test case set data packet is that the upload is completed.
The background of the test case service has a high-concurrency thread pool starting periodic service, and the uploading state of the test case set data packet is continuously monitored. When the uploading state of the test case set data packet is that uploading is completed, as shown in fig. 2, a first prompt message is returned to the first target user. The first prompt message is used for prompting the first target user that all the uploaded test case set data packets are uploaded.
In one possible implementation, the test plan service is configured to receive a test plan creation request sent by a second target user, where the second target user is a user with access rights; and the test plan service is used for initializing and creating a target test plan in the distributed relational database cluster based on the test plan creation request.
FIG. 3 illustrates a flow chart of generating a test plan according to an embodiment of the present disclosure. As shown in fig. 3, the second target user logs in the GPU test system through a user name and a password, and obtains a second access token corresponding to the second target user from an authorization service in the GPU test system, where the second access token is a globally unique identifier for identifying the identity and access authority of the second target user, and may be used to track the user behavior of the second target user. The second target user may be a QA engineer, which is not specifically limited by the present disclosure.
As shown in fig. 3, the second target user sends a test plan creation request to the test plan service, which initiates creation of a target test plan in the distributed relational database cluster, at which point the target test plan is empty. The test plan service returns the created target test plan to the second target user.
And the second target user selects and designates the test case screening conditions corresponding to the target test plan in the system predefined condition space and the user defined condition space according to the using range of the test plan, and sends the test case screening conditions to the test plan service. Wherein the system predefined conditions include: classification attributes of test cases, prefabricated item attributes, priority attributes, dependency attributes and the like; the user-defined conditions include: user-defined tag attributes, single test case compression test attributes, user-defined test dependency attributes, and the like.
In one possible implementation, the test plan service is configured to receive a test case screening condition corresponding to the target test plan sent by the second target user, and send the test case screening condition to the test case service; and the test case service is used for determining a test case screening result corresponding to the target test plan according to the test case screening condition and returning the test case screening result to the test plan service, wherein the test case screening result comprises a plurality of test case identifiers.
As shown in fig. 3, the second target user sends the test case screening conditions corresponding to the target plan to the test plan service.
In order to accelerate the acquisition of the total number of test cases corresponding to the test case screening conditions, the test plan service scans the distributed cache clusters by using the test case screening conditions, and determines test case screening results conforming to the test case screening conditions.
Because the test cases stored in the distributed cache clusters may not be all data, the test plan service may use the test case screening conditions in the distributed relational database clusters and load the test cases that will be stored in the distributed relational database clusters but not in the distributed cache clusters as a new screening result into the current test case screening result. The test case screening result only comprises the test case identification which accords with the test case screening condition, and does not comprise the data of the test case identification.
As shown in fig. 3, the test plan service sends the test case screening conditions to the test case service concurrently, the test case service sends the test case screening conditions to the distributed cache cluster concurrently, determines test case screening results in the distributed cache cluster, and returns the test case screening results to the test plan service.
In one possible implementation, the data flow platform is configured to receive a second target data flow corresponding to the test case screening result sent by the test plan service, and send the second target data flow to the data flow consumer service; the data flow consumer service is used for sending a third operation request to the test case service; the test case service is used for sending a third target data stream corresponding to the test case subset corresponding to the test case screening result to the data stream consumer service after receiving the third operation request; and the data flow consumer service is used for sending the test case subset corresponding to the test case screening result to a target test plan in the distributed relational database cluster for storage.
To quickly load millions of test cases into a target test plan, the test plan service divides the test case screening results into a plurality of data blocks and asynchronously sends them to the data flow platform in a second target data flow manner. As shown in FIG. 3, the test plan service asynchronously transmits test case screening results to the data flow platform in the manner of a second target data flow.
In order to continue to consume the test case filtering results in the data stream platform smoothly, the data stream consumer service first subscribes to the theme corresponding to the target test plan of the data stream platform, and then concurrently and continuously scans the data stream offset of the data stream platform to determine whether the current theme can be consumed, namely, consume the second target data stream from the data stream platform. As shown in fig. 3, the data stream consumer service asynchronously consumes the second target data stream from the data stream platform.
After the data flow consumer service obtains the test case screening result corresponding to the second target data flow, as shown in fig. 3, a third operation request is sent to the test case service, where the third operation request is used to request to obtain a corresponding test case. And the test case service acquires a corresponding test case subset from the distributed cache cluster according to the third operation request, and sends the test case subset to the data flow consumer service in a third target data flow mode.
As shown in fig. 3, the data flow consumer service sends a fifth operation request to the test plan service, where the fifth operation request is used to request that the subset of test cases corresponding to the test case screening result be persisted to the target test plan; and the test plan service sends the test case subset corresponding to the test case screening result in the third target data stream to the target test plan in the distributed relational database cluster for storage.
In one possible implementation manner, the third operation request may be a test case screening result determined by all test case screening conditions, or may be a test case screening sub-result obtained by combining different test screening conditions. When the third operation request can be the test case screening result determined by all the test case screening conditions, determining the whole target test plan; when the third operation request is a Test case screening sub-result obtained according to different Test screening conditions, different Test sub-plans (Test Plan Unit) can be determined in the target Test Plan, and each Test sub-Plan corresponds to different Test screening conditions. Therefore, when the test task is executed, the whole target test plan can be executed, and one or more test sub-plans in the target test plan can be executed according to actual test requirements.
In one possible implementation, to quickly read test cases corresponding to the target test plan multiple times, the test plan service copies a subset of test cases corresponding to the target test plan stored in the distributed relational database cluster and stores it to the distributed cache cluster.
In one possible implementation, the test plan service is configured to monitor a generation status of the target test plan, and return a second prompt to the second target user when the generation status of the target test plan is complete.
The background of the test plan service has a high-concurrency thread pool starting periodic service, and the generation state of the target test plan is continuously monitored. As shown in fig. 3, when the generation state of the target test plan is completed, a second prompt message is returned to the second target user. The second prompt information is used for prompting the second target user that various states of the target test plan are in a completed state.
In one possible implementation, the test plan service is configured to receive an executable state corresponding to the target test plan sent by the second target user, and send the executable state corresponding to the target test plan to the distributed relational database cluster.
Because the professional ability of the second target user is limited, whether the created target test plan can be operated or not needs to be checked by a QA engineer with higher professional ability, and after checking the target test plan, the target test plan can execute the subsequent test operation. At this time, as shown in fig. 3, the second target user sends the executable state corresponding to the target test plan to the test plan service, and the test plan service updates the executable state corresponding to the target test plan to the distributed relational database cluster.
In one possible implementation manner, the test task service is configured to receive a test task creation request sent by a third target user, where the third target user is a user with access rights, and the test task creation request is configured to request to create a test task based on a target test plan in the test plan service; and the test task service is used for initializing and creating a target test task corresponding to the target test plan in the distributed relational database cluster based on the test task creation request.
FIG. 4 illustrates a flow chart for generating and running test tasks according to an embodiment of the disclosure. As shown in fig. 4, the third target user logs in the GPU testing system through a user name and a password, and obtains a third access token corresponding to the third target user from an authorization service in the GPU testing system, where the third access token is a globally unique identifier for identifying the identity and access authority of the third target user, and may be used to track the user behavior of the third target user. The third target user may be a QA engineer, which is not specifically limited by the present disclosure.
As shown in fig. 4, the third target user sends a test task creation request to the test task service, and the test task service creates a target test task corresponding to the target test plan in the distributed relational database cluster in an initialized manner based on the target test plan selected by the test task creation request, where the target test task is empty. The test task service returns the created target test task to the third target user.
In one possible implementation, the GPU testing system further includes: testing deployment services; the test task service is used for creating a test instance corresponding to the target test task in the test deployment service; the test deployment service is used for determining the GPU to be tested corresponding to the test instance and obtaining test instance paging information corresponding to the target test task from the test task service, wherein the test instance paging information is used for indicating a test instance subset corresponding to the target test plan.
As shown in fig. 4, the test task service creates a test instance corresponding to the target test task in the test deployment service, the test deployment service determines the GPU to be tested, installs the GPU driver to the GPU to be tested, and further obtains hardware information of the GPU to be tested, so as to prepare for subsequent testing.
As shown in fig. 4, the test deployment service sends a request for acquiring test case paging information corresponding to the target test task to the test task service, and the test task service returns the test case paging information to the test deployment service. The number of the test cases included in each test case paging information can be determined according to actual conditions, and the disclosure is not limited in particular.
In one possible implementation manner, the data flow platform is configured to receive a fourth target data flow corresponding to the test case paging information sent by the test deployment service, and send the fourth target data flow to the data flow consumer service; a data stream consumer service for sending a fourth operation request to the test plan service; the test plan service is used for sending the subset of the test cases indicated by the test case paging information to the test task service after receiving the fourth operation request; and the test task service is used for sending the test case subset indicated by the test case paging information to a target test task in the distributed relational database cluster for storage.
In order to upload test cases to test cases, the test deployment service sends the test case paging information to the data flow platform in a fourth target data flow form, and the data flow consumer service performs high concurrency consumption on the test case paging information corresponding to the fourth target data flow according to the subject corresponding to the subscribed target test task and the concurrency degree adaptive to the current network bandwidth on the other side of the data flow platform.
As shown in fig. 4, the test deployment service asynchronously generates a fourth target data stream and sends the fourth target data stream to the data stream platform, and the data stream consumer service asynchronously consumes the fourth target data stream from the data stream platform; the data flow consumer service sends a fourth operation request to the test plan service; and after receiving the fourth operation request, the test plan service sends the subset of the test cases indicated by the test case paging information to the test task service. The test plan service is a subset of test cases indicated by the test case paging information acquired from the distributed cache cluster.
As shown in FIG. 4, the test task service sends a subset of test cases indicated by the test case paging information to a target test task in the distributed relational database cluster for persistent storage.
Since the target Test plan may include a plurality of Test sub-plans, one Test Job Unit may be corresponding to each Test sub-plan. And the test task service sends the test case subset corresponding to each test sub-plan to a target test task in the distributed relational database cluster to be used as a test sub-task for persistent storage.
In one possible implementation, the test task service is configured to monitor a generation status of the target test task, and return a third prompt message to the third target user when the generation status of the target test task is completed.
The background of the test task service has a high-concurrency starting periodic service of a thread pool, and the generation state of the target test task is continuously monitored. As shown in fig. 4, when the generation state of the target test task is completed, third prompt information is returned to the third target user. The third prompting information is used for prompting that all test cases corresponding to the target test task are added completely.
In one possible implementation, the test task service is configured to receive an executable state corresponding to a target test task sent by a third target user, and send the executable state corresponding to the target test task to the distributed relational database cluster.
Because the professional ability of the third target user is limited, whether the created target test task can be operated or not needs to be checked by a QA engineer with higher professional ability, and after checking the target test task, the target test task can execute the subsequent test operation. At this time, as shown in fig. 4, the third target user sends the executable state corresponding to the target test meter task to the test task service, and the test task service updates the executable state corresponding to the target test task to the distributed relational database cluster. Once the target test task is in an operational state, it is not allowed to make any modifications.
In one possible implementation manner, the test deployment service is configured to send a subset of test cases indicated by the test case paging information to the GPU to be tested for testing, so as to obtain a test result; the test deployment service is used for sending the test result to the test task service; and the test task service is used for sending the test result to the distributed relational database cluster.
As shown in fig. 4, the test deployment service sends the subset of test cases indicated by the test case paging information to the GPU to be tested for testing, so as to obtain a test result. In an example, an unconsumed test case may be obtained from the test case paging information in a recursive manner, and sent to the GPU to be tested for testing, and the test result thereof is recorded.
As shown in fig. 4, the test deployment service sends the test result to the test task service, and the test task service sends the test result to the distributed relational database cluster for persistent storage. In an example, the test deployment service asynchronously and concurrently uploads test results to a message queue at a deployment unit level in the test task service, and the deployment unit in the test task service concurrently acquires the test results from the message queue by a thread with a set size and persistently stores the test results in a distributed relational database cluster to facilitate data analysis and visual processing of the test results.
In one possible implementation, the test task service is configured to monitor a test state of the target test task, and return a fourth prompt message to the third target user when the test state of the target test task is completed.
The background of the test task service is provided with a timing task for continuous monitoring, and the test state of the target test task is updated periodically. The test state may include: the time and user information that the test case is consumed, the time and hardware information that the test case is run, statistics of various erroneous results of the test results, and the like.
As shown in fig. 3, when the test state of the target test task is completed, a fourth prompt message is returned to the third target user. The fourth display information is used for prompting the fourth target user that the target test task is tested and completed.
According to the GPU test system disclosed by the embodiment of the invention, the uploading efficiency of the full test case set can be improved, the generation efficiency of a test plan is improved, and the running efficiency of a test task is improved, so that the whole process test efficiency from GPU end to end is finally improved.
According to the GPU testing system disclosed by the embodiment of the invention, the uploading of the full test case set, the generation of the full test plan and the generation of the test tasks of the full test plan can be realized on a 32-core 64GB cluster machine in about 6 minutes.
It will be appreciated that the above-mentioned method embodiments of the present disclosure may be combined with each other to form a combined embodiment without departing from the principle logic, and are limited to the description of the present disclosure. It will be appreciated by those skilled in the art that in the above-described methods of the embodiments, the particular order of execution of the steps should be determined by their function and possible inherent logic.
In addition, the disclosure further provides an electronic device, a computer readable storage medium, and a program, which can be used to run the GPU testing system provided in the disclosure, and corresponding technical schemes and descriptions and corresponding descriptions of method parts are omitted.
The method has specific technical association with the internal structure of the computer system, and can solve the technical problems of improving the hardware operation efficiency or the execution effect (including reducing the data storage amount, reducing the data transmission amount, improving the hardware processing speed and the like), thereby obtaining the technical effect of improving the internal performance of the computer system which accords with the natural law.
In some embodiments, functions or modules included in an apparatus provided by the embodiments of the present disclosure may be used to perform a method described in the foregoing method embodiments, and specific implementations thereof may refer to descriptions of the foregoing method embodiments, which are not repeated herein for brevity.
The disclosed embodiments also provide a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the above-described method. The computer readable storage medium may be a volatile or nonvolatile computer readable storage medium.
The embodiment of the disclosure also provides an electronic device, which comprises: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to perform the above method.
Embodiments of the present disclosure also provide a computer program product comprising computer readable code, or a non-transitory computer readable storage medium carrying computer readable code, which when run in a processor of an electronic device, performs the above method.
The electronic device may be provided as a server or other modality of device.
Fig. 5 shows a block diagram of an electronic device, according to an embodiment of the disclosure. Referring to fig. 5, an electronic device 1900 may be provided as a server or terminal device. Referring to FIG. 5, electronic device 1900 includes a processing component 1922 that further includes one or more processors and memory resources represented by memory 1932 for storing instructions, such as application programs, that can be executed by processing component 1922. The application programs stored in memory 1932 may include one or more modules each corresponding to a set of instructions. Further, processing component 1922 is configured to execute instructions to perform the methods described above.
The electronic device 1900 may also include a power component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input/output (interface 1958. The electronic device 1900 may operate based on an operating system stored in a memory 1932, such as the microsoft Server operating system (Windows Server) TM ) Apple Inc. developed graphical user interface based operating System (Mac OS X TM ) Multi-user multi-process computer operating system (Unix) TM ) Unix-like operating system (Linux) of free and open source code TM ) Unix-like operating system (FreeBSD) with open source code TM ) Or the like.
In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 1932, including computer program instructions executable by processing component 1922 of electronic device 1900 to perform the methods described above.
The present disclosure may be a system, method, and/or computer program product. The computer program product may include a computer readable storage medium having computer readable program instructions embodied thereon for causing a processor to implement aspects of the present disclosure.
The computer readable storage medium may be a tangible device that can hold and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: portable computer disks, hard disks, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static Random Access Memory (SRAM), portable compact disk read-only memory (CD-ROM), digital Versatile Disks (DVD), memory sticks, floppy disks, mechanical coding devices, punch cards or in-groove structures such as punch cards or grooves having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media, as used herein, are not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., optical pulses through fiber optic cables), or electrical signals transmitted through wires.
The computer readable program instructions described herein may be downloaded from a computer readable storage medium to a respective computing/processing device or to an external computer or external storage device over a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmissions, wireless transmissions, routers, firewalls, switches, gateway computers and/or edge servers. The network interface card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium in the respective computing/processing device.
Computer program instructions for performing the operations of the present disclosure can be assembly instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, c++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions may be executed entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present disclosure are implemented by personalizing electronic circuitry, such as programmable logic circuitry, field Programmable Gate Arrays (FPGAs), or Programmable Logic Arrays (PLAs), with state information of computer readable program instructions, which can execute the computer readable program instructions.
Various aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable medium having the instructions stored therein includes an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The computer program product may be realized in particular by means of hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied as a computer storage medium, and in another alternative embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), or the like.
The foregoing description of various embodiments is intended to highlight differences between the various embodiments, which may be the same or similar to each other by reference, and is not repeated herein for the sake of brevity.
It will be appreciated by those skilled in the art that in the above-described method of the specific embodiments, the written order of steps is not meant to imply a strict order of execution but rather should be construed according to the function and possibly inherent logic of the steps.
If the technical scheme of the application relates to personal information, the product applying the technical scheme of the application clearly informs the personal information processing rule before processing the personal information, and obtains independent consent of the individual. If the technical scheme of the application relates to sensitive personal information, the product applying the technical scheme of the application obtains individual consent before processing the sensitive personal information, and simultaneously meets the requirement of 'explicit consent'. For example, a clear and remarkable mark is set at a personal information acquisition device such as a camera to inform that the personal information acquisition range is entered, personal information is acquired, and if the personal voluntarily enters the acquisition range, the personal information is considered as consent to be acquired; or on the device for processing the personal information, under the condition that obvious identification/information is utilized to inform the personal information processing rule, personal authorization is obtained by popup information or a person is requested to upload personal information and the like; the personal information processing rule may include information such as a personal information processor, a personal information processing purpose, a processing mode, and a type of personal information to be processed.
The foregoing description of the embodiments of the present disclosure has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the various embodiments described. The terminology used herein was chosen in order to best explain the principles of the embodiments, the practical application, or the improvement of technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims (21)

1. A GPU testing system, the system comprising:
the system comprises a test case service, a data processing unit and a data processing unit, wherein the test case service is used for concurrently uploading a test case set, and the test case set comprises a plurality of test cases for GPU test;
a test plan service for concurrently generating a plurality of test plans, wherein each of the test plans is generated based on a plurality of the test cases;
and the test task service is used for generating and running a plurality of test tasks concurrently, wherein each test task corresponds to one test plan.
2. The system of claim 1, wherein the test case service is configured to receive test case set data packets that are uploaded in batches by a first target user, where the first target user is a user with access rights;
The system further comprises:
and the distributed object storage cluster is used for receiving the test case set data packet sent by the test case service and carrying out backup storage on the test case set data packet.
3. The system of claim 2, wherein the test case service is configured to decompress the test case set data packet to obtain a first target data stream corresponding to the test case set;
the system further comprises: a data stream platform, data stream consumer services;
the data flow platform is used for receiving the first target data flow sent by the test case service and sending the first target data flow to the data flow consumer service.
4. A system according to claim 3, wherein the system further comprises: a distributed relational database cluster;
the data flow consumer service is used for sending a first operation request to the test case service;
and the test case service is used for uploading the test cases in the first target data stream to the distributed relational database cluster for storage after receiving the first operation request.
5. The system of claim 4, wherein the data stream consumer service is configured to send a test case upload status to the test case service;
the test case service is used for sending the test case uploading state to the distributed relational database cluster.
6. A system according to claim 3, wherein the system further comprises: a distributed cache cluster;
the data flow consumer service is used for sending a second operation request to the test case service;
and the test case service is used for sending the test case in the first target data stream to the distributed cache cluster for storage after receiving the second operation request.
7. The system according to any one of claims 2 to 6, wherein the test case service is configured to monitor an upload status of the test case set data packet, and return a first prompt message to the first target user when the upload status of the test case set data packet is that the upload is completed.
8. The system of claim 1, wherein the test plan service is configured to receive a test plan creation request sent by a second target user, wherein the second target user is a user with access rights;
The system further comprises: a distributed relational database cluster;
the test plan service is used for initializing and creating a target test plan in the distributed relational database cluster based on the test plan creation request.
9. The system of claim 8, wherein the test plan service is configured to receive test case screening conditions corresponding to the target test plan sent by the second target user, and send the test case screening conditions to the test case service;
the test case service is used for determining a test case screening result corresponding to the target test plan according to the test case screening condition and returning the test case screening result to the test plan service, wherein the test case screening result comprises a plurality of test case identifications.
10. The system of claim 9, wherein the system further comprises: a data stream platform, data stream consumer services;
the data flow platform is used for receiving a second target data flow corresponding to the test case screening result sent by the test plan service and sending the second target data flow to the data flow consumer service;
The data flow consumer service is used for sending a third operation request to the test case service;
the test case service is configured to send a third target data stream corresponding to a test case subset corresponding to the test case screening result to the data stream consumer service after receiving the third operation request;
and the data flow consumer service is used for sending the test case subset corresponding to the test case screening result to the target test plan in the distributed relational database cluster for storage.
11. The system of any one of claims 8 to 10, wherein the test plan service is configured to monitor a generation status of the target test plan, and to return a second prompt to the second target user when the generation status of the target test plan is complete.
12. The system of claim 11, wherein the test plan service is configured to receive the executable state corresponding to the target test plan sent by the second target user, and send the executable state corresponding to the target test plan to the distributed relational database cluster.
13. The system of claim 1, wherein the test task service is configured to receive a test task creation request sent by a third target user, where the third target user is a user with access rights, and the test task creation request is configured to request creation of a test task based on a target test plan in the test plan service;
the system further comprises: a distributed relational database cluster;
and the test task service is used for initializing and creating a target test task corresponding to the target test plan in the distributed relational database cluster based on the test task creation request.
14. The system of claim 13, wherein the system further comprises: testing deployment services;
the test task service is used for creating a test instance corresponding to the target test task in the test deployment service;
the test deployment service is configured to determine a GPU to be tested corresponding to the test case, and obtain test case paging information corresponding to the target test task from the test task service, where the test case paging information is used to indicate a subset of test cases corresponding to the target test plan.
15. The system of claim 14, wherein the system further comprises: a data stream platform, data stream consumer services;
the data flow platform is used for receiving a fourth target data flow corresponding to the test case paging information sent by the test deployment service and sending the fourth target data flow to the data flow consumer service;
the data stream consumer service is used for sending a fourth operation request to the test plan service;
the test plan service is configured to send a subset of test cases indicated by the test case paging information to the test task service after receiving the fourth operation request;
and the test task service is used for sending the test case subset indicated by the test case paging information to the target test task in the distributed relational database cluster for storage.
16. The system of claim 15, wherein the test task service is configured to monitor a generation status of the target test task and return a third prompt to the third target user when the generation status of the target test task is complete.
17. The system of claim 16, wherein the test task service is configured to receive an executable state corresponding to the target test task sent by the third target user, and send the executable state corresponding to the target test task to the distributed relational database cluster.
18. The system of claim 17, wherein the test deployment service is configured to send the subset of test cases indicated by the test case paging information to the GPU to be tested for testing, to obtain a test result;
the test deployment service is used for sending the test result to the test task service;
and the test task service is used for sending the test result to the distributed relational database cluster.
19. The system of claim 18, wherein the test task service is configured to monitor a test status of the target test task and return a fourth prompt to the third target user when the test status of the target test task is complete.
20. An electronic device, comprising:
a processor;
A memory for storing processor-executable instructions;
wherein the processor is configured to invoke the instructions stored in the memory to run the system of any of claims 1 to 19.
21. A computer readable storage medium having stored thereon computer program instructions, which when executed by a processor, operate the system of any of claims 1 to 19.
CN202211728431.0A 2022-12-30 2022-12-30 GPU test system, electronic equipment and storage medium Active CN116089187B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211728431.0A CN116089187B (en) 2022-12-30 2022-12-30 GPU test system, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211728431.0A CN116089187B (en) 2022-12-30 2022-12-30 GPU test system, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN116089187A true CN116089187A (en) 2023-05-09
CN116089187B CN116089187B (en) 2024-02-02

Family

ID=86203827

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211728431.0A Active CN116089187B (en) 2022-12-30 2022-12-30 GPU test system, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116089187B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108572919A (en) * 2018-05-30 2018-09-25 平安普惠企业管理有限公司 Automated testing method, device, computer equipment and storage medium
CN108804320A (en) * 2018-05-30 2018-11-13 平安普惠企业管理有限公司 Automated testing method, device, computer equipment and storage medium
US20190163618A1 (en) * 2017-11-27 2019-05-30 Accenture Global Solutions Limited Robotic regression testing for smart devices
US10437712B1 (en) * 2018-06-20 2019-10-08 Ca, Inc. API functional-test generation
CN110413527A (en) * 2019-07-30 2019-11-05 中国工商银行股份有限公司 Test macro, test method, electronic equipment and computer readable storage medium
CN111367780A (en) * 2020-03-30 2020-07-03 西安芯瞳半导体技术有限公司 Performance test method and device of GPU (graphics processing Unit) and computer storage medium
CN112231230A (en) * 2020-11-12 2021-01-15 腾讯科技(深圳)有限公司 Test case management method and device, electronic equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190163618A1 (en) * 2017-11-27 2019-05-30 Accenture Global Solutions Limited Robotic regression testing for smart devices
CN108572919A (en) * 2018-05-30 2018-09-25 平安普惠企业管理有限公司 Automated testing method, device, computer equipment and storage medium
CN108804320A (en) * 2018-05-30 2018-11-13 平安普惠企业管理有限公司 Automated testing method, device, computer equipment and storage medium
US10437712B1 (en) * 2018-06-20 2019-10-08 Ca, Inc. API functional-test generation
CN110413527A (en) * 2019-07-30 2019-11-05 中国工商银行股份有限公司 Test macro, test method, electronic equipment and computer readable storage medium
CN111367780A (en) * 2020-03-30 2020-07-03 西安芯瞳半导体技术有限公司 Performance test method and device of GPU (graphics processing Unit) and computer storage medium
CN112231230A (en) * 2020-11-12 2021-01-15 腾讯科技(深圳)有限公司 Test case management method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN116089187B (en) 2024-02-02

Similar Documents

Publication Publication Date Title
US10642725B2 (en) Automated test generation for multi-interface enterprise virtualization management environment
CN108376061B (en) Method and apparatus for developing unmanned vehicle applications
CN111913738A (en) Access request processing method, device, computing equipment and medium
CN111324441A (en) Operating environment switching method and device, computer equipment and storage medium
CN112799782B (en) Model generation system, method, electronic device and storage medium
CN113377665A (en) Container technology-based testing method and device, electronic equipment and storage medium
CN106549795B (en) System for monitoring a plurality of distributed devices
CN111427665A (en) Quantum application cloud platform and quantum computing task processing method
CN107402878B (en) Test method and device
CN112115113B (en) Data storage system, method, device, equipment and storage medium
CN113032257A (en) Automatic test method, device, computer system and readable storage medium
CN116089187B (en) GPU test system, electronic equipment and storage medium
CN116662302A (en) Data processing method, device, electronic equipment and storage medium
CN106933449B (en) Icon processing method and device
CN112559001B (en) Method and device for updating application
CN113448730A (en) Service processing method and device, computer equipment and storage medium
CN108287792B (en) Method and apparatus for outputting information
CN113032256A (en) Automatic test method, device, computer system and readable storage medium
CN112532747B (en) Method, apparatus, device and storage medium for outputting information
CN115981857B (en) Fault analysis system
US10268958B1 (en) Recommended launch configuration
CN116136813B (en) Method, device and storage medium for simulating adaptive multi-model avionics signals
CN114063879B (en) Method for processing operation command, electronic device and storage medium
US20230259347A1 (en) Container based generation of inputs for generic functions
US20210209161A1 (en) Cognitively generating parameter settings for a graph database

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant