CN110362478B - Application upgrade test method and device, computer equipment and storage medium - Google Patents
Application upgrade test method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN110362478B CN110362478B CN201910531884.6A CN201910531884A CN110362478B CN 110362478 B CN110362478 B CN 110362478B CN 201910531884 A CN201910531884 A CN 201910531884A CN 110362478 B CN110362478 B CN 110362478B
- Authority
- CN
- China
- Prior art keywords
- test
- order
- data
- historical
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/368—Test management for test version control, e.g. updating test cases to a new software version
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application relates to an application upgrading test method, an application upgrading test device, computer equipment and a storage medium. The method comprises the following steps: acquiring a test order generated by the upgraded service client according to the test data; determining an order label corresponding to the test order; searching a historical order corresponding to the order label from a database; the historical order is generated according to the test data by the service client before upgrading; comparing and analyzing the test order and the historical order to determine a difference part between the test order and the historical order; and determining a client test result obtained by testing the upgraded service client according to the preset upgrade requirement corresponding to the upgraded service client and the matching degree between the difference part and the upgraded service client. The method based on the testing technology can improve the system testing efficiency.
Description
Technical Field
The present application relates to the field of test technologies, and in particular, to a method and an apparatus for testing application upgrade, a computer device, and a storage medium.
Background
With the development of computer technology, more and more services can be implemented by a service system (including a service client and a service server), for example, the service client is provided for a user to use, and the service server is used as a background processing server. With the enrichment and expansion of business contents, business systems, namely application programs, are often required to be upgraded. In order to ensure the stability of the upgraded service system, the upgraded service system often needs to be tested to determine the upgrade condition of the service system.
The conventional method for testing the upgraded system mainly adopts a manual mode, and performs a joint test between the service client and the service server manually, that is, an end-to-end integration test. The adoption of a manual end-to-end test method results in low system test efficiency.
Disclosure of Invention
In view of the above, it is necessary to provide an application upgrade testing method, apparatus, computer device and storage medium capable of improving system testing efficiency.
An application upgrade testing method, the method comprising:
acquiring a test order generated by the upgraded service client according to the test data;
determining an order label corresponding to the test order;
searching a historical order corresponding to the order label from a database; the historical order is generated according to the test data by the service client before upgrading;
comparing and analyzing the test order and the historical order to determine a difference part between the test order and the historical order;
and determining a client test result obtained by testing the upgraded service client according to the preset upgrade requirement corresponding to the upgraded service client and the matching degree between the difference part and the upgraded service client.
A system upgrade test apparatus, the apparatus comprising:
the acquisition module is used for acquiring a test order generated by the upgraded service client according to the test data;
the determining module is used for determining an order label corresponding to the test order;
the searching module is used for searching a historical order corresponding to the order label from a database; the historical order is generated according to the test data by the service client before upgrading;
the analysis module is used for comparing and analyzing the test order and the historical order and determining the difference part between the test order and the historical order;
the determining module is further configured to determine a client test result obtained by testing the upgraded service client according to a preset upgrade requirement corresponding to the upgraded service client and the matching degree between the difference portion and the upgraded service client.
A computer device comprising a memory storing a computer program and a processor implementing the following steps when the computer program is executed:
acquiring a test order generated by the upgraded service client according to the test data;
determining an order label corresponding to the test order;
searching a historical order corresponding to the order label from a database; the historical order is generated according to the test data by the service client before upgrading;
comparing and analyzing the test order and the historical order to determine a difference part between the test order and the historical order;
and determining a client test result obtained by testing the upgraded service client according to the preset upgrade requirement corresponding to the upgraded service client and the matching degree between the difference part and the upgraded service client.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
acquiring a test order generated by the upgraded service client according to the test data;
determining an order label corresponding to the test order;
searching a historical order corresponding to the order label from a database; the historical order is generated according to the test data by the service client before upgrading;
comparing and analyzing the test order and the historical order to determine a difference part between the test order and the historical order;
and determining a client test result obtained by testing the upgraded service client according to the preset upgrade requirement corresponding to the upgraded service client and the matching degree between the difference part and the upgraded service client.
According to the application upgrading test method, the application upgrading test device, the computer equipment and the storage medium, the upgraded service client side is obtained to generate the test order according to the test data, and the order label corresponding to the test order is determined so as to carry out version control. And searching a historical order corresponding to the order label from the database, comparing and analyzing the test order and the historical order, and determining the difference part between the test order and the historical order. And determining a client test result according to a preset upgrading requirement corresponding to the upgraded service client and the matching degree between the difference part and the upgraded service client. Therefore, the upgraded service client can be automatically and intelligently tested, the client test result can be obtained without manually and jointly testing the client and the server, and the system test efficiency is greatly improved.
Drawings
FIG. 1 is a diagram of an application scenario in which a test method for application upgrade is applied in one embodiment;
FIG. 2 is a flowchart illustrating a method for application upgrade testing in one embodiment;
FIG. 3 is a flowchart illustrating the testing step performed on the service server in one embodiment;
FIG. 4 is a diagram of an application system in which the upgrade test method is applied in one embodiment;
FIG. 5 is a block diagram of an embodiment of an application upgrade test apparatus;
FIG. 6 is a block diagram showing the construction of an application upgrade test apparatus according to another embodiment;
FIG. 7 is a diagram of the internal structure of a computer device in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The application upgrading test method provided by the application upgrading test method can be applied to the application environment shown in fig. 1. Wherein the terminal 110 and the service server 120 communicate through a network. The test equipment 130 communicates with the terminal 110 through a network. The test equipment 130 communicates with the service server 120 via a network. The terminal 110 runs a service client, the upgraded service client generates a test order according to the test data, and the test device 130 obtains the test order and tests the service client and the service server 120 according to the test order, so as to obtain a client test result and a server test result. The terminal 110 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and the server 120 may be implemented by an independent server or a server cluster formed by a plurality of servers. The test device may be a terminal or a server.
In one embodiment, as shown in fig. 2, an application upgrade testing method is provided, which is described by taking the application of the method to the testing device 130 in fig. 1 as an example, and includes the following steps:
s202, obtaining a test order generated by the upgraded service client according to the test data.
The application upgrading refers to upgrading of an application program and at least comprises at least one of upgrading of a service client and upgrading of a service server. The service client is an application installed on the user terminal and can communicate with the service server through a network connection. The service client may specifically be a separate application running on the terminal, or may be a web interface provided by the service server and opened in a browser. In practical application, due to business requirements, a situation that a business client needs to be functionally upgraded often occurs, and at this time, a business client before upgrading and a business client after upgrading exist. The test for application upgrade may specifically include a test for the upgraded service client, a test for the upgraded service server, and the like.
The test data is data for differences before and after the test system is upgraded. The test data may be stored in a test file. The test file is a file for testing, and specifically may include a plurality of groups of test cases. Each set of test cases includes complete test data. The test file may be a text file, a table file, or a PDF (Portable Document Format) file, and the file Format of the test file is not limited herein. The test order is an order (mainly presented in a message form) generated by the service client according to the test data.
Specifically, the service client may obtain the test data, perform data processing on the entered test data, and generate a corresponding test order. When the service client sends the test order to the service server in the form of a message, the test equipment can intercept and acquire the test order sent by the service client.
In one embodiment, the test data can be manually input into the service client, and the service client generates a corresponding test order according to the test data. In another embodiment, the test equipment can automatically acquire the test file, automatically input the test data in the test file into the service client, and the service client generates a corresponding test order according to the test data.
And S204, determining an order label corresponding to the test order.
The order label is a tool for identifying or classifying orders, and is convenient for locating and searching corresponding orders. Order labels may be used to distinguish between different types of test cases. Specifically, after the test equipment obtains the test order, the test equipment may assign a matching order label to the test order. For example, for a test order generated according to type a test data, the test equipment may assign a label to the corresponding test order; for test orders generated from type B test data, the test equipment may assign a B label to the corresponding test order.
In one embodiment, the test equipment may assign the same order label to test orders of the same type. Before and after the business client is upgraded, the order labels distributed by the testing equipment are the same through the testing orders generated by the testing data of the same type. In this way, the test equipment can determine the upgrading condition of the service client by analyzing the difference between the test order and the historical order corresponding to the same order label.
S206, searching a historical order corresponding to the order label from the database; and generating the historical order according to the test data by the service client before upgrading.
The historical order is an order (mainly presented in a message form) generated by the service client before upgrading according to the test data. Specifically, the testing equipment searches the historical orders associated with the determined order labels from the database and acquires the order information of the corresponding historical orders. The order information is information related to the order, and specifically may include a product type, a sales channel, a quantity, a time stamp, a serial number, and the like.
In one embodiment, when the business client is online, the testing device may store the order generated by the business client and the corresponding order label in the database in association as a historical order for the next time the test is upgraded. Correspondingly, when the subsequent service client is upgraded, the test equipment updates the test order generated by the upgraded service client into the database so as to update the order information stored in the database in time. And the updated order information is used as the historical order information of the historical order of the next upgrading test.
In one embodiment, the application upgrade test method further includes a step of storing test order information of a test order, and the step specifically includes: backing up historical order information of historical orders; and covering the historical order information with the test order information of the test order, and storing the test order information into a database so as to store the test order information corresponding to the business client with the latest version in the database.
Specifically, the testing device can backup and store the historical order information stored in the database to other computer devices or other storage paths for information tracing and tracing. Furthermore, the test equipment can cover the corresponding historical order information with the test order information of the currently acquired test order and store the test order information into the database, so that only the test order information corresponding to the latest version service client side is stored in the database. Therefore, when upgrading next time, the test equipment can determine the upgrading condition of the service client according to the latest historical order information.
In one embodiment, in the upgrade test process of the current service client, only the test orders corresponding to part of the order labels are generated. And when the test order information of the test order covers the corresponding historical order information, covering the corresponding historical order information with the test order information corresponding to the same order label. And enabling the order information corresponding to each order label to be the order information of the current latest version.
In the above embodiment, the historical order information of the historical order is backed up, and the test order information of the test order is overlaid on the historical order information and stored in the database. The order information stored in the database can be guaranteed to be the order information of the latest version, and the upgrading test result of the client side can be conveniently and accurately determined.
And S208, comparing and analyzing the test order and the historical order, and determining the difference part between the test order and the historical order.
In particular, the trade information collector may compare the test order information with the historical order information found for the same order label to determine a difference between the test order and the historical order.
In one embodiment, the test equipment may assign the same order label to test orders of the same type. When service clients of different versions perform data processing on test data of the same type to generate corresponding test orders, the test equipment can analyze specific upgraded components of the service clients by comparing differences between the test orders corresponding to the same order labels and historical orders.
In one embodiment, the step S208 of comparing the test order with the historical order and determining the difference between the test order and the historical order specifically includes: obtaining order keywords; extracting order key information corresponding to the order key words from the order information of the test order and the historical order respectively; and comparing and analyzing the extracted order key information to determine the difference part between the test order and the historical order.
The order keyword is a word corresponding to key information in the order, such as "product type", or "order quantity", etc. Specifically, the test equipment can acquire a preset order keyword, and extract order key information corresponding to the order keyword from test order information of a test order; and extracting order key information corresponding to the order key words from the historical order information of the historical orders.
Further, the testing equipment can compare the order key information of the testing order with the order key information of the historical order, so as to determine the upgrading testing result of the business client. Therefore, the test equipment can avoid non-key information (such as information of a timestamp, a serial number and the like) which does not influence the test logic, and the comparison efficiency and the comparison effect of comparing and analyzing the test order and the historical order are greatly improved.
S210, determining a client test result obtained by testing the upgraded service client according to the preset upgrade requirement corresponding to the upgraded service client and the matching degree between the difference part and the upgraded service client.
The preset upgrading requirement is an upgrading function effect planned in advance before the business client is upgraded. For example, the preset upgrade requirement may specifically be a functional requirement that needs to be met by the current upgrade. Specifically, the test device may obtain a preset upgrade requirement corresponding to the upgraded service client in advance. The testing equipment analyzes whether the difference part is the difference brought by the upgrading service client by comparing the matching degree between the preset upgrading requirement and the difference part, analyzes whether the difference meets the preset function requirement, and further judges whether the upgrading of the service client is successful, namely, determines the testing result of the upgrading of the service client.
In one embodiment, the testing device may determine the matching degree between the preset upgrade requirements and the difference part by determining whether the difference part between the test order and the historical order meets the preset upgrade requirements and which part of the preset upgrade requirements are met. In one embodiment, if the difference portion does not satisfy the predetermined functional requirement, the test equipment may further analyze the reason for the failed upgrade and the corresponding solution. The test equipment can generate an upgrade test report of the service client according to the difference part, the difference reason, the upgrade result, the reason analysis when the upgrade fails, the corresponding solution measure and the like between the test order information and the historical order information.
According to the application upgrading test method, the upgraded service client side is obtained according to the test order generated by the test data, and the order label corresponding to the test order is determined so as to carry out version control. And searching a historical order corresponding to the order label from the database, and comparing and analyzing the test order and the historical order to determine a client test result obtained by testing the upgraded service client. Therefore, the upgrading conditions of the service client can be determined according to the difference between the orders generated by the test data of the service client before and after upgrading. The upgraded service client is automatically and intelligently tested, and the client test result can be obtained without manually and manually carrying out the joint test of the client and the server, so that the system test efficiency is greatly improved.
In one embodiment, the application upgrade test method further includes a step of testing the service server, and the step specifically includes the following steps:
s302, the test order information of the test order is searched from the database.
Specifically, after the testing equipment stores the testing order information of the testing order in the database in a manner of covering the historical order information, the testing equipment can search the corresponding testing order information from the database.
S304, the test order information is sent to the service server.
Specifically, the test equipment may send the test order information to the service server, where the sent test order information is used to instruct the service server to perform service processing on the test order information, so as to obtain corresponding order processing data. In one embodiment, the order processing data is data applicable to downstream systems. The service server performs service processing on the test order information, which may be specifically related to the function of the service server, for example, the service server performs format and type conversion on the test order information to obtain order processing data; alternatively, the service server may perform comprehensive processing on multiple sets of test order information to obtain order processing data, and the like, which is not limited herein.
S306, obtaining order processing data obtained by the business server conducting business processing on the test order information.
Specifically, the test device may obtain order processing data obtained by performing service processing on the test order information by the service server through network connection.
In one embodiment, after the service server performs service processing on the test order information to obtain order processing data, the order processing data may be stored in the database. The service server can send the order processing data to the testing equipment according to the preset time interval. Or when the storage capacity of the generated order processing data reaches a preset capacity, the business server sends the order processing data to the testing equipment.
In an embodiment, the step S306, that is, the step of obtaining order processing data obtained by the service server performing the service processing on the test order information specifically includes: converting the data format and/or the data type of the test order information through a service server to obtain order processing data matched with the target data format and/or the target data type; determining an order identification corresponding to the test order information; and searching corresponding order processing data from the service server at regular time according to the order identifier.
Among them, the data format (data format) is a rule that describes that data is stored in a file or record. A text format in the form of characters, or a compressed format in the form of binary data, etc. A data type (data type) is a category to which a group of data belongs, and mainly refers to a set of values having the same property and a collective name of a group of operations defined on the set of values in a data structure. The order identifier is used for uniquely identifying the order, and specifically may be an alphabet, a character, a chinese character, or a number.
In one embodiment, when the service client performs data processing on the test data and generates a test order, an order identifier of the test order is correspondingly generated, and the test file is updated according to the order identifier. The testing equipment can obtain the order identification corresponding to the testing order from the testing file. And the business server performs business processing on the test order information to obtain order processing data, and can store the order identification and the order processing data in a local association mode. Further, the test equipment can search corresponding order processing data from the service server at regular time according to the order identification.
In an embodiment, the content of the service processing performed by the service server on the test order information may specifically be that the service server converts the data format of the test order information to obtain order processing data in the matched target data format, and/or that the service server converts the data type of the test order information to obtain order processing data in the matched target data type. The target data format and the target data type are preset data formats and data types related to actual service requirements, such as data formats and data types suitable for downstream systems.
In one embodiment, the service server converts the data format and/or the data type of the test order information to obtain order processing data matched with the target data format and/or the target data type, and then stores the order processing data in the database. In the operating logic of the service server, there is a central data management module, through which all operations for storing data in the database are operated. For the service server, a special code embedding setting is set, and data stored in a database is stored in a local file in a Json format. The test equipment can search the order processing data corresponding to the Json format from the business server according to the order identification of the test order.
In the above embodiment, the data format and the data type of the test order information are converted by the service server, order processing data matching the target data format and the target data type can be obtained, the corresponding order processing data is regularly searched from the service server according to the order identifier corresponding to the test order information, and the order processing data can be conveniently, quickly and accurately obtained.
And S308, determining a server test result corresponding to the service server according to the order processing data and the expected result data.
The expected result data is result data expected by the service system upgrade, namely standard data. Specifically, the test device may compare and analyze the order processing data with the expected result data, and determine a test result obtained by testing the upgraded service server. When the order processing data and the expected result data are completely the same or different within a preset range, judging that the service server upgraded at the time meets the upgrading requirement; when the difference between the order processing data and the expected result data exceeds the preset range, the service server is judged to be failed to upgrade, and the test equipment can determine the reason of the failure of the upgrade, corresponding improvement measures and the like according to the difference.
In the embodiment, the test order information is sent to the service server, the order processing data obtained by the service server performing service processing on the test order information is obtained, the server test result corresponding to the service server is determined according to the order processing data and the expected result data, the upgraded service server is automatically and intelligently tested, the client and the server do not need to be manually tested in a combined mode, the server test result can be obtained, and the system test efficiency is greatly improved.
In one embodiment, the application upgrade testing method further includes a step of generating an application upgrade test report, where the step specifically includes: updating a test file corresponding to the test data according to the test result of the client and the test result of the server; and generating a corresponding application upgrading test report according to the updated test file.
The test report is obtained by testing the upgraded system, and the test report is the final product of the test stage, and generally includes a test method, a test result and defect report, a test conclusion and a recommendation, and the like. Specifically, the test device may update the test file corresponding to the test data according to the client test result and the server test result. And generating a corresponding application upgrading test report according to the updated test file.
In one embodiment, the test report may be presented in the form of a file or in the form of a web page. The presentation is performed in a file format, such as a text format, a table format, or a picture format.
In the embodiment, the test file corresponding to the test data is updated according to the client test result and the server test result, and then an accurate and comprehensive application upgrading test report can be generated according to the updated test file.
It should be understood that although the various steps in the flow charts of fig. 2-3 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-3 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.
Referring to fig. 4, fig. 4 shows an application system diagram of an application upgrade test method. In one embodiment, a test apparatus includes a test data builder, an information collector, and an automated tester. The test data builder, the information collector and the automatic tester can be respectively deployed in different servers to jointly form a server cluster; or may be deployed in the same server and implemented by different modules in the same server.
In one embodiment, the test equipment further comprises a scheduler, and for the test data builder, the information collector and the automation tester, before executing the application upgrade test method, the scheduling and setting of each service can be performed by the scheduler. Such as setting the running order of each server and each service running in the test process.
In one embodiment, the test data builder automatically enters test data into the service client, and the service client generates a test order according to the test data. When the business client sends the test order to the business server, the information collector intercepts and acquires the test order. The information collector is also used for determining an order label corresponding to the test order, searching a historical order corresponding to the order label from the database, comparing and analyzing the test order and the historical order, and determining a difference part between the test order and the historical order; and determining a client test result obtained by testing the upgraded service client according to the preset upgrade requirement corresponding to the upgraded service client and the matching degree between the difference part and the upgraded service client.
In one embodiment, the information collector is further configured to backup historical order information of the historical order, overwrite the historical order information with test order information of the test order, and store the test order information in the database, so that the database stores the test order information corresponding to the latest version of the service client.
In one embodiment, the automated tester is configured to retrieve test order information for a test order from a repository; sending the test order information to a service server; acquiring order processing data obtained by the business server performing business processing on the test order information; and the automatic tester determines a server test result corresponding to the service server according to the order processing data and the expected result data.
In one embodiment, the service server converts the data format and the data type of the test order information to obtain order processing data matched with the target data format and the target data type; the automatic tester is also used for determining an order mark corresponding to the test order information; and searching corresponding order processing data from the service server at regular time according to the order identification.
In one embodiment, the automated tester is further configured to update the test file corresponding to the test data according to the client test result and the server test result; and generating a corresponding application upgrading test report according to the updated test file.
In one embodiment, the information collector is further configured to obtain an order keyword; extracting order key information corresponding to order keywords from the order information of the test order and the historical order respectively; and comparing and analyzing the extracted order key information to determine the difference part between the test order and the historical order.
The application upgrading test system acquires the test order generated by the upgraded service client according to the test data, and determines the order label corresponding to the test order so as to control the version. And searching a historical order corresponding to the order label from the database, comparing and analyzing the test order and the historical order, and determining the difference part between the test order and the historical order. And determining a client test result according to a preset upgrading requirement corresponding to the upgraded service client and the matching degree between the difference part and the upgraded service client. Therefore, the upgraded service client can be automatically and intelligently tested, the client test result can be obtained without manually and jointly testing the client and the server, and the system test efficiency is greatly improved.
In one embodiment, as shown in fig. 5, there is provided an application upgrade testing apparatus 500 comprising: an obtaining module 501, a determining module 502, a searching module 503 and an analyzing module 504, wherein:
an obtaining module 501, configured to obtain a test order generated by the upgraded service client according to the test data.
A determining module 502 is configured to determine an order label corresponding to the test order.
A searching module 503, configured to search a historical order corresponding to the order label from a database; and generating the historical order through the service client before upgrading according to the test data.
The analysis module 504 is configured to compare the test order with the historical order and determine a difference between the test order and the historical order.
The determining module 502 is further configured to determine a client test result obtained by testing the upgraded service client according to a preset upgrade requirement corresponding to the upgraded service client and a matching degree between the difference portion and the preset upgrade requirement.
In one embodiment, the application upgrade test device 500 further comprises a backup module 505 and an overlay storage module 506, wherein:
and a backup module 505 for backing up the historical order information of the historical orders.
And the overlay storage module 506 is configured to overlay the historical order information with the test order information of the test order, and store the test order information into the database, so that the database stores the test order information corresponding to the business client of the latest version.
In one embodiment, the application upgrade testing apparatus 500 further comprises a sending module 507, wherein:
the searching module 503 is further configured to search the test order information of the test order from the database;
a sending module 507, configured to send the test order information to the service server;
the obtaining module 501 is further configured to obtain order processing data obtained by performing service processing on the test order information by the service server;
the determining module 502 is further configured to determine a server test result corresponding to the service server according to the order processing data and the expected result data.
In an embodiment, the obtaining module 501 is further configured to convert a data format and/or a data type of the test order information by the service server to obtain order processing data matching a target data format and/or a target data type; determining an order identification corresponding to the test order information; and searching corresponding order processing data from the service server at regular time according to the order identifier.
Referring to fig. 6, in one embodiment, the application upgrade testing apparatus 500 further includes an updating module 508 and a generating module 509, wherein:
and the updating module 508 is configured to update the test file corresponding to the test data according to the client test result and the server test result.
A generating module 509, configured to generate a corresponding application upgrade test report according to the updated test file.
In one embodiment, the analysis module 504 is further configured to obtain order keywords; extracting order key information corresponding to the order key words from the order information of the test order and the historical order respectively; and comparing and analyzing the extracted order key information to determine the difference part between the test order and the historical order.
The application upgrading test device acquires a test order generated by the upgraded service client according to the test data, and determines an order label corresponding to the test order so as to perform version control. And searching a historical order corresponding to the order label from the database, comparing and analyzing the test order and the historical order, and determining the difference part between the test order and the historical order. And determining a client test result according to a preset upgrading requirement corresponding to the upgraded service client and the matching degree between the difference part and the upgraded service client. Therefore, the upgraded service client can be automatically and intelligently tested, the client test result can be obtained without manually and jointly testing the client and the server, and the system test efficiency is greatly improved.
For the specific definition of the application upgrade testing apparatus, reference may be made to the above definition of the application upgrade testing method, which is not described herein again. All or part of each module in the application upgrade testing device can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent of a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a server, the internal structure of which may be as shown in fig. 7. The computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement an application upgrade test method.
It will be appreciated by those skilled in the art that the configuration shown in fig. 7 is a block diagram of only a portion of the configuration associated with the present application, and is not intended to limit the computing device to which the present application may be applied, and that a particular computing device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the steps of the application upgrade test method described above. The steps of the application upgrade test method herein may be steps in the application upgrade test methods of the various embodiments described above.
In one embodiment, a computer readable storage medium is provided, storing a computer program which, when executed by a processor, causes the processor to perform the steps of the application upgrade test method described above. The steps of the application upgrade test method herein may be steps in the application upgrade test methods of the various embodiments described above.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), rambus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
All possible combinations of the technical features in the above embodiments may not be described for the sake of brevity, but should be considered as being within the scope of the present disclosure as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is specific and detailed, but not to be understood as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. An application upgrade test method applied to test equipment, the method comprising:
acquiring a test order generated by the upgraded service client according to the test data; the test data is used for testing the difference before and after the system is upgraded;
determining an order label corresponding to the test order; the order labels are used for distinguishing different types of test cases;
searching a historical order corresponding to the order label from a database; the historical order is generated by the service client before upgrading according to the test data;
obtaining order keywords;
extracting order key information corresponding to the order key words from the order information of the test order and the historical order respectively;
comparing and analyzing the extracted order key information to determine a difference part between the test order and the historical order;
determining a client test result obtained by testing the upgraded service client according to the matching degree between the preset upgrade requirement corresponding to the upgraded service client and the difference part;
searching the database for the test order information of the test order;
sending the test order information to a service server;
acquiring order processing data obtained by the business server performing business processing on the test order information;
and determining a server test result corresponding to the service server according to the order processing data and the expected result data.
2. The method of claim 1, further comprising:
backing up historical order information of the historical order;
and covering the test order information of the test order with the historical order information, and storing the test order information into the database, so that the test order information corresponding to the business client with the latest version is stored in the database.
3. The method according to claim 1, wherein the obtaining of the order processing data obtained by the service server performing the service processing on the test order information includes:
converting the data format and/or the data type of the test order information through the service server to obtain order processing data matched with a target data format and/or a target data type;
determining an order mark corresponding to the test order information;
and searching corresponding order processing data from the service server at regular time according to the order identification.
4. The method of claim 1, further comprising:
updating a test file corresponding to the test data according to the client test result and the server test result;
and generating a corresponding application upgrading test report according to the updated test file.
5. An application upgrade test device applied to test equipment, the device comprising:
the acquisition module is used for acquiring a test order generated by the upgraded service client according to the test data; the test data is used for testing the difference before and after the system is upgraded;
the determining module is used for determining an order label corresponding to the test order; the order labels are used for distinguishing different types of test cases;
the searching module is used for searching a historical order corresponding to the order label from a database; the historical order is generated according to the test data by the service client before upgrading;
the analysis module is used for acquiring order keywords; extracting order key information corresponding to the order key words from the order information of the test order and the historical order respectively; comparing and analyzing the extracted order key information to determine a difference part between the test order and the historical order;
the determining module is further used for determining a client test result obtained by testing the upgraded service client according to a preset upgrade requirement corresponding to the upgraded service client and the matching degree between the difference part and the upgraded service client;
the searching module is also used for searching the test order information of the test order from the database; the device further comprises:
the sending module is used for sending the test order information to a service server;
the acquisition module is used for acquiring order processing data obtained by the business server performing business processing on the test order information;
and the determining module is used for determining a server test result corresponding to the service server according to the order processing data and the expected result data.
6. The apparatus of claim 5, further comprising:
the backup module is used for backing up historical order information of the historical orders;
and the covering storage module is used for covering the historical order information with the test order information of the test order and storing the test order information into the database.
7. The apparatus of claim 5,
the acquisition module is further configured to convert the data format and/or the data type of the test order information through the service server to obtain order processing data matching a target data format and/or a target data type; determining an order mark corresponding to the test order information; and searching corresponding order processing data from the service server at regular time according to the order identification.
8. The apparatus of claim 5, further comprising:
the updating module is used for updating the test file corresponding to the test data according to the client test result and the server test result;
and the generating module is used for generating a corresponding application upgrading test report according to the updated test file.
9. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any one of claims 1 to 4 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910531884.6A CN110362478B (en) | 2019-06-19 | 2019-06-19 | Application upgrade test method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910531884.6A CN110362478B (en) | 2019-06-19 | 2019-06-19 | Application upgrade test method and device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110362478A CN110362478A (en) | 2019-10-22 |
| CN110362478B true CN110362478B (en) | 2023-04-18 |
Family
ID=68217398
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910531884.6A Active CN110362478B (en) | 2019-06-19 | 2019-06-19 | Application upgrade test method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110362478B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112231224A (en) * | 2020-10-30 | 2021-01-15 | 平安银行股份有限公司 | Business system testing method, device, equipment and medium based on artificial intelligence |
| CN112463630A (en) * | 2020-12-08 | 2021-03-09 | 广州品唯软件有限公司 | Version difference testing method and device, computer equipment and storage medium |
| CN113656315B (en) * | 2021-08-19 | 2023-01-24 | 北京百度网讯科技有限公司 | Data testing method and device, electronic equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105450464A (en) * | 2014-08-27 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Test method and test device for service interfaces |
| CN107730385A (en) * | 2017-07-27 | 2018-02-23 | 上海壹账通金融科技有限公司 | Simulation process method, apparatus, storage medium and the computer equipment of sequence information |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103631705B (en) * | 2012-08-24 | 2018-01-05 | 百度在线网络技术（北京）有限公司 | A kind of regression testing method and device for search engine |
| US10241898B2 (en) * | 2016-03-11 | 2019-03-26 | Wipro Limited | Method and system for enabling self-maintainable test automation |
| CN108170606B (en) * | 2018-01-03 | 2022-02-15 | 中国工商银行股份有限公司 | System and method for testing system software upgrading application |
| CN108170453B (en) * | 2018-01-17 | 2021-01-01 | 中国平安人寿保险股份有限公司 | MIT system upgrading method, storage medium and terminal equipment |
| CN109871315B (en) * | 2019-01-03 | 2021-09-24 | 平安科技（深圳）有限公司 | Diagnosis method and device for system upgrade failure based on machine learning |
-
2019
- 2019-06-19 CN CN201910531884.6A patent/CN110362478B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105450464A (en) * | 2014-08-27 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Test method and test device for service interfaces |
| CN107730385A (en) * | 2017-07-27 | 2018-02-23 | 上海壹账通金融科技有限公司 | Simulation process method, apparatus, storage medium and the computer equipment of sequence information |
Non-Patent Citations (1)
| Title |
|---|
| 张洪秀.大型分布式交易系统动态升级机制的设计与实现.《中国优秀硕士学位论文全文数据库 (信息科技辑)》.2019,I138-995. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110362478A (en) | 2019-10-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109474578B (en) | Message checking method, device, computer equipment and storage medium | |
| WO2020186786A1 (en) | File processing method and apparatus, computer device and storage medium | |
| CN110290212B (en) | Service call recording method, device, computer equipment and storage medium | |
| CN110362478B (en) | Application upgrade test method and device, computer equipment and storage medium | |
| CN111475370A (en) | Operation and maintenance monitoring method, device and equipment based on data center and storage medium | |
| CN110362479B (en) | System upgrade test method and system | |
| CN110751533B (en) | Product portrait generation method and device, computer equipment and storage medium | |
| CN108563734B (en) | System information query method, device, computer equipment and storage medium | |
| CN109766483B (en) | Regular expression generation method, device, computer equipment and storage medium | |
| CN111090788B (en) | json file comparison method and device, storage medium and computer equipment | |
| CN110955608B (en) | Test data processing method, device, computer equipment and storage medium | |
| CN112434949A (en) | Service early warning processing method, device, equipment and medium based on artificial intelligence | |
| CN109325042B (en) | Processing template acquisition method, form processing method, device, equipment and medium | |
| CN111190946A (en) | Report generation method and device, computer equipment and storage medium | |
| CN110659297A (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN111324375A (en) | Code management method and device, computer equipment and storage medium | |
| CN109462661B (en) | Data synchronization method and device, computer equipment and storage medium | |
| CN111125748A (en) | Judgment method and device for unauthorized query, computer equipment and storage medium | |
| CN110727710B (en) | Data analysis method and device, computer equipment and storage medium | |
| CN111966339A (en) | Method and device for recording buried point parameters, computer equipment and storage medium | |
| CN108880988B (en) | Method, system, computer equipment and storage medium for monitoring instant communication message | |
| CN108460116B (en) | Search method, search device, computer equipment, storage medium and search system | |
| CN110647452B (en) | Test method, test device, computer equipment and storage medium | |
| CN111460268B (en) | Method and device for determining database query request and computer equipment | |
| CN112363929B (en) | System online method and device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |