CN116955196A - Test method, device and equipment - Google Patents

Abstract

The disclosure provides a testing method, a testing device and testing equipment, wherein the testing method comprises the following steps: acquiring a historical data set generated in a production environment, wherein data in the historical data set is processed by an online code in a program in the production environment, and the obtained actual result data is written into an online production table; in the production environment, processing the data in the historical data set by using the updated test codes, and writing the obtained test result data into a test table; based on the service function of the on-line code representation, acquiring target test data from the test table and acquiring historical actual data from the on-line production table; and comparing the target test data with the historical actual data, and judging whether the updated test code is abnormal or not according to a comparison result. According to the technical scheme provided by one or more embodiments of the present disclosure, the comprehensiveness and efficiency of the test can be improved.

Description

Test method, device and equipment

Technical Field

The disclosure relates to the technical field of data processing, and in particular relates to a testing method, a testing device and testing equipment.

Background

At present, when testing a program, a test environment and simulation data can be generally constructed first, and then in the test environment, the updated program is utilized to process the simulation data so as to obtain a corresponding test result. Subsequently, whether the test result accords with the expectation or not can be judged, if not, the exception of the updated program is indicated, and the updated program needs to be debugged.

However, in the existing test mode, the built simulation data cannot cover part of specific scenes in the real production environment, so that the program for completing the test cannot be compatible with the real production environment.

In view of this, there is a need for a more comprehensive test approach.

Disclosure of Invention

One or more embodiments of the present disclosure provide a testing method, apparatus, and device, which can improve the comprehensiveness and efficiency of testing.

In one aspect, the present disclosure provides a test method, the method comprising: acquiring a historical data set generated in a production environment, wherein data in the historical data set is processed by an online code in a program in the production environment, and the obtained actual result data is written into an online production table; in the production environment, processing the data in the historical data set by using the updated test codes, and writing the obtained test result data into a test table; the updated test code is updated based on the online code; based on the service function represented by the on-line code, acquiring target test data corresponding to the service function from the test table, and acquiring historical actual data corresponding to the service function from the on-line production table; and comparing the target test data with the historical actual data, and judging whether the updated test code is abnormal or not according to a comparison result.

Another aspect of the present disclosure also provides a test apparatus, the apparatus comprising: a history data acquisition unit, configured to acquire a history data set generated in a production environment, where data in the history data set is written into an online production table after being processed by an online code in a program in the production environment, where obtained actual result data is written into the online production table; the test processing unit is used for processing the data in the historical data set by using the updated test codes in the production environment and writing the obtained test result data into a test table; the updated test code is updated based on the online code; the function data extraction unit is used for acquiring target test data corresponding to the service function from the test table based on the service function represented by the online code, and acquiring historical actual data corresponding to the service function from the online production table; and the judging unit is used for comparing the target test data with the historical actual data and judging whether the updated test code is abnormal or not according to a comparison result.

Another aspect of the disclosure also provides a test apparatus, including a memory and a processor, where the memory is configured to store a computer program, and the computer program is executed by the processor to implement the test method described above.

Another aspect of the present disclosure also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described test method.

According to the technical scheme provided by one or more embodiments of the present disclosure, the verification process of the test code can be completed in an actual production environment, so that the test code and the online code are ensured to perform data processing in the same environment, and data errors caused by different environments are avoided. Furthermore, the data for the test code to process is a historical data set generated in the actual production environment, not a simulated data set. By adopting the historical data set generated in the actual production environment, on one hand, various scenes in the actual production environment can be covered, so that the testing process of the program is more comprehensive; on the other hand, the test code and the on-line code process the same data, and when the test code is judged to be abnormal later, whether the target test data corresponding to the service function is consistent with the historical actual data can be directly judged aiming at the service function to be verified, so that the verification process of the test code is greatly simplified.

Drawings

The features and advantages of the various embodiments of the present disclosure will be more clearly understood by reference to the accompanying drawings, which are schematic and should not be construed as limiting the disclosure in any way, in which:

FIG. 1 shows a schematic diagram of the steps of a test method in one embodiment of the present disclosure;

FIG. 2 shows a flow diagram of a test method in one embodiment of the present disclosure;

FIG. 3 shows a functional block diagram of a test device in one embodiment of the present disclosure;

fig. 4 shows a schematic structural diagram of a test apparatus in one embodiment of the present disclosure.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are some embodiments of the present disclosure, but not all embodiments. All other embodiments, which can be made by those skilled in the art without the inventive effort, based on the embodiments in this disclosure are intended to be within the scope of this disclosure.

In the related art, a process of testing updated code in a program is generally performed in a test environment. In the test environment, first, simulation data may be generated according to an application scenario of a program. For example, when the data settlement function in the test program is required, simulation data in the data settlement scene may be generated in advance, and the simulation data may be, for example, detail data such as browsing amount, click amount, and profit generated in a specified page.

After generating the simulation data in the test environment, the simulation data can be processed by utilizing the codes to be tested, so as to generate corresponding test result data. For example, in the above-mentioned data settlement scenario, the data settlement code may be used to process the detail data such as the browsing amount, the clicking amount, the profit, etc. in the relevant designated page, so as to obtain the test result data such as the browsing amount, the clicking amount, the profit amount, etc. in the designated page in a certain period of time.

Generally, before the code to be tested processes the analog data, a theoretical standard data is preset, and then by comparing the test result data with the theoretical standard data, it can be determined whether the code to be tested correctly executes the corresponding service function.

However, the above-mentioned test methods in the related art have certain drawbacks. For example, the whole test process is performed in a test environment, but the difference between the actual production environment and the test environment is large, even if the code to be tested is verified in the test environment, the verified code cannot be ensured to be deployed in the actual production environment, and the corresponding service function can be correctly executed. The reason is that in the actual production environment, the performance of the equipment used by the user and the network environment are greatly changed, and the test environment cannot completely simulate the actual production environment.

For another example, the simulation data cannot cover various scenes in the actual production environment, so that a high test coverage rate cannot be achieved. Verifying passing code in a test environment may also be abnormal in some specific scenarios when deployed into a complex production environment.

In view of this, one embodiment of the present disclosure provides a testing method, referring to fig. 1 and 2, which may include the following steps.

S1: and acquiring a historical data set generated in a production environment, wherein the actual result data obtained after the data in the historical data set is processed by an online code in a program in the production environment is written into an online production table.

In this embodiment, in order to improve the test coverage of the code, the history data set generated in the actual production environment may be directly used as the basic data of the test. Since the historical dataset is generated in the production environment, individual scenarios in the production environment can be more fully characterized.

The production environment may refer to an environment in which a program actually runs. The actual environment in which the program is running may also vary from user to user, resulting in data in different scenarios. For example, the performance of the terminal device running the program may vary, the network environment in which the terminal device is located may vary, and the operation data generated in the program may also vary, and these differences may generate various historical data in the actual production environment, and the set of the historical data may be used as the set of the historical data.

In practical applications, the acquired historical data set may correspond to a certain time span. For example, the set of historical data for testing may be a set of historical data for the last month in the production environment. Of course, what time span is specifically adopted can be flexibly selected according to actual requirements, and the disclosure is not limited to this.

In this embodiment, history data generated in the production environment can be processed by on-line code in a program. Wherein the on-line code in the program may be code that has been tested and verified and deployed into the production environment. The on-line code is typically capable of accurately implementing a certain service function or functions. And for the historical data generated in the production environment, after the on-line code processes the historical data, corresponding actual result data can be obtained.

Specifically, in one practical application scenario, the data in the historical data set includes detail data of a target area in a target page within a specified period. For example, the target page may refer to a page on which an advertisement is published. Accordingly, the target area in the target page may refer to a certain advertisement space in the target page, and each item of detail data generated by the advertisement space may be used as data in the historical data set. The detail data may be, for example, browsing detail data, click detail data, revenue detail data, etc. corresponding to the advertisement position. Correspondingly, the actual result data obtained through the online code processing comprises: and counting the detail data of the target area in the appointed time period to obtain the total data. For example, the specified time may be the last month, and each time the ad slot has generated detail data, the online code counts the detail data to aggregate the total data for the ad slot for the last month.

In this embodiment, the actual result data obtained after the data in the history data set is subjected to the on-line code processing in the production environment may be written into the on-line production table. The online production table may be a data table built in advance according to a certain data format. Thus, after the actual result data is obtained, the actual result data can be written in the data format prescribed by the on-line production table at the specified position of the on-line production table.

S3: in the production environment, processing the data in the historical data set by using the updated test codes, and writing the obtained test result data into a test table; the updated test code is updated based on the online code.

In this embodiment, when the program performs version iteration, the online code may be updated, and the updated test code may be obtained based on the online code update. In practical applications, the on-line code updating method may include various methods such as adding codes, modifying codes, and deleting codes.

In order to improve the accuracy of the test, the data in the historical data set can be processed by using the updated test codes in the production environment so as to obtain corresponding test result data. In this way, the test result data and the actual result data obtained through on-line code processing are generated in the same production environment, so that a unified basis is established for subsequent data comparison.

In this embodiment, the online code and the updated test code generally implement the same service function. For example, the online code and the test code are used for settling details data generated in the target page, or for counting traffic data generated in the target page. However, in practical applications, when implementing the same service function, the updated test code may add additional new functions. For example, when the detail data generated in the target page is settled, the updated test code may include a function of backing up the total data obtained by settlement. For this case, the block code corresponding to the newly added function may be first identified from the updated test code, and the block code may be verified. The present disclosure does not limit the verification process of the block code, and only the final verification result needs to be obtained.

In this embodiment, after the block code passes the verification, the block code is characterized to be able to correctly execute the corresponding new function. In this case, the updated test code containing the block code may be further subjected to overall verification. The test code is verified as a whole, rather than the remaining code after the block code is removed, because the original code may be affected after the block code is introduced. For example, the location of the introduction of the block code may affect the data processing logic of the original code. In this case, in order to ensure that the test code obtained after the block code is introduced can still accurately implement the original service function, it is necessary to perform overall verification of the test code. Specifically, the meaning of performing overall verification on the test code means that the updated test code is directly utilized to process data in the historical data set, so as to obtain test result data. Of course, the test result data herein may include the result data corresponding to the new added function in addition to the result data corresponding to the original service function.

In this embodiment, after the test result data is obtained, the test result data may be written into the test table. The test table and the online production table in step S1 may have the same data format, except that the contents of the two tables are isolated from each other. The test result data may be written at a designated location of the test meter in accordance with the data format of the test meter.

In one embodiment, both the test table and the on-line production table are located in an actual production environment, and the test process and the production process use a homologous historical data set, so that in order to effectively write the actual result data and the test result data into the corresponding tables, the data to be processed can be identified by using the middleware, and the data to be processed can be written into the correct tables based on the identification result.

In particular, the middleware can be realized based on the GORM framework, and by identifying the data identification in the data to be processed, the middleware can complete the process of writing the data to be processed into the corresponding table. Specifically, after the online code processes the data in the historical data set, a first data identifier for representing the online production type can be added into the obtained actual result data; after the updated test code processes the data in the historical data set, a second data identifier for characterizing the test type can be added into the obtained test result data. Of course, in practical application, in order to simplify the process of adding the data identifier, after the actual result data is obtained, the first data identifier may not be added to the actual result data, but only the corresponding second data identifier may be added to the obtained test result data. Wherein the first data identifier (if added) or the second data identifier may be added to the actual result data or the specified location of the test result data.

The actual result data and the test result data obtained by processing can be transmitted to the middleware. The middleware, upon receiving the data to be processed, may attempt to read the data identification from a specified location in the data to be processed. After reading the data identification, the data type characterized by the data identification may be identified. If the data identifier characterizes the online production type, the current data to be processed is actual result data obtained through online code processing, and the data to be processed can be written into an online production table by the middleware; and if the data identifier characterizes the test type, indicating that the current data to be processed is test result data obtained by processing the updated test code, wherein the data to be processed can be written into a test table by the middleware.

Of course, for the scenario that the data identifier is not added to the actual result data, if the middleware can read the data identifier from the data to be processed, the data to be processed can be directly determined to be the test result data obtained by the updated test code processing, and the data to be processed can be written into the test table by the middleware. If the middleware cannot read the data identifier from the data to be processed, the current data to be processed is the actual result data obtained through the on-line code processing, and the data to be processed can be written into the on-line production table by the middleware. That is, after receiving the data to be processed, the middleware may determine whether the data to be processed includes a preset data identifier. The preset data identifier may be the second data identifier characterizing the test type described above. Under the condition that the data to be processed contains the preset data identifier, the data to be processed is indicated to be test result data, and the data to be processed can be written into the test table at the moment; and under the condition that the data to be processed does not contain the preset data identifier, indicating that the data to be processed is actual result data, and writing the data to be processed into the online production table.

In practical applications, there may be an association between the naming of the test table and the on-line production table. For example, the naming of the test table may be represented by the "naming of the production table on-line + suffix", wherein the suffix may be, for example, "test". Of course, the naming of the test meter and the online production meter may be varied as long as the middleware is enabled to uniquely determine the corresponding online production meter and test meter based on the naming.

S5: based on the service function represented by the on-line code, acquiring target test data corresponding to the service function from the test table, and acquiring historical actual data corresponding to the service function from the on-line production table.

In this embodiment, the updated test code may add new functions based on the original online code. As described in step S3, after the verification is completed, the block code corresponding to the new function may perform overall verification on the updated test code. The purpose of the overall verification is to determine whether the newly added block code will affect the service functions originally supported by the on-line code. In view of this, the test result data obtained based on the updated test code processing may include target test data corresponding to the original service function, and may also include block test data corresponding to the new function. When the updated test code is integrally verified, whether the target test data corresponding to the original service function is normal or not needs to be verified (the block test data corresponding to the newly added function is verified independently).

In this embodiment, the service function of the on-line code characterization may be determined. For example, if the service function represented by the on-line code before updating is to count the detail data of a relevant advertisement slot, the main service function is to count the detail data of the advertisement slot although a new function may be added to the updated test code.

After the service function represented by the online code is determined, target test data corresponding to the service function can be obtained from the test table. The test table records data according to the inherent data format, so that the target test data corresponding to the service function is recorded at the appointed position according to the inherent data format, and the corresponding target test data can be read from the appointed position in the test table. Similarly, the historical actual data corresponding to the service function can be obtained from the online production table.

S7: and comparing the target test data with the historical actual data, and judging whether the updated test code is abnormal or not according to a comparison result.

In this embodiment, after the target test data and the historical actual data are obtained, if the contents of the two data characterizations are the same, it is indicated that the updated test code is consistent with the data obtained by processing the online code in the actual production environment after the historical data set is processed, and no abnormality exists in the updated test code. If the contents of the two data characterizations are different, the updated test code is indicated to have abnormality, and the test code can be further examined to ensure that the corrected test code and the online code in the actual production environment are the same after the same historical data set is processed, and the obtained result data corresponding to the service function is the same.

Taking the benefits of ad slots in a target page as an example, a number of different ads may be deployed in the ad slots, which may be presented in sequence or in time slots in the target page. In this way, the ad slot may correspond to accounts of multiple ad issuers. The historical dataset generated in the on-line production environment may include each piece of detail data under a respective account. After the on-line codes process the data in the historical data set, the obtained actual result data can comprise the number of the detail data under each account and the total data after the detail data under each account are summarized. Similarly, after the updated test data processes the data in the historical data set, the obtained test result data may also include the number of data pieces of detail data and the corresponding total data.

When comparing the target test data with the historical actual data, the data number and the total data under the same account can be respectively compared. Specifically, it may be determined whether the number of data pieces of the detail data in the target test data and the number of data pieces of the detail data in the history actual data are consistent under the same account, and whether the total data in the target test data and the total data in the history actual data are consistent under the same account. As long as there is one inconsistency, it indicates that there is an exception in the updated test code.

Of course, along with the change of the actual application scene, the data content contained in the target test data and the historical actual data also changes, and when the technical scheme of the disclosure is implemented, the data of the same type only needs to be compared.

According to the technical scheme provided by one or more embodiments of the present disclosure, the verification process of the test code can be completed in an actual production environment, so that the test code and the online code are ensured to perform data processing in the same environment, and data errors caused by different environments are avoided. Furthermore, the data for the test code to process is a historical data set generated in the actual production environment, not a simulated data set. By adopting the historical data set generated in the actual production environment, on one hand, various scenes in the actual production environment can be covered, so that the testing process of the program is more comprehensive; on the other hand, the test code and the on-line code process the same data, and when the test code is judged to be abnormal later, whether the target test data corresponding to the service function is consistent with the historical actual data can be directly judged aiming at the service function to be verified, so that the verification process of the test code is greatly simplified.

Referring to fig. 3, the present disclosure further provides a testing apparatus, the apparatus including:

a history data obtaining unit 100, configured to obtain a history data set generated in a production environment, where data in the history data set is written into an online production table after being processed by an online code in a program in the production environment;

a test processing unit 200, configured to process, in the production environment, the data in the historical data set by using the updated test code, and write the obtained test result data into a test table; the updated test code is updated based on the online code;

a function data extraction unit 300, configured to obtain, based on the service function represented by the on-line code, target test data corresponding to the service function from the test table, and obtain historical actual data corresponding to the service function from the on-line production table;

and the judging unit 400 is used for comparing the target test data with the historical actual data and judging whether the updated test code has an abnormality or not according to a comparison result.

The respective units set forth in the above embodiments may be implemented by a computer chip or by a product having a certain function. One typical implementation is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

For convenience of description, the above devices are described as being functionally divided into various units, respectively. Of course, the functions of each element may be implemented in the same piece or pieces of software and/or hardware when implementing the present application.

Referring to fig. 4, the disclosure further provides a test apparatus, where the test apparatus includes a memory and a processor, and the memory is configured to store a computer program, and when the computer program is executed by the processor, implement the test method described above.

The present disclosure also provides a computer readable storage medium for storing a computer program which, when executed by a processor, implements the test method described above.

The processor may be a central processing unit (Central Processing Unit, CPU). The processor may also be any other general purpose processor, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof.

The memory, as a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the methods in embodiments of the present disclosure. The processor executes various functional applications of the processor and data processing, i.e., implements the methods of the method embodiments described above, by running non-transitory software programs, instructions, and modules stored in memory.

The memory may include a memory program area and a memory data area, wherein the memory program area may store an operating system, at least one application program required for a function; the storage data area may store data created by the processor, etc. In addition, the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some implementations, the memory optionally includes memory remotely located relative to the processor, the remote memory being connectable to the processor through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

It will be appreciated by those skilled in the art that implementing all or part of the above-described embodiment method may be implemented by a computer program to instruct related hardware, where the program may be stored in a computer readable storage medium, and the program may include the above-described embodiment method when executed. Wherein the storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a Flash Memory (Flash Memory), a Hard Disk (HDD), or a Solid State Drive (SSD); the storage medium may also comprise a combination of memories of the kind described above.

In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for embodiments of the apparatus, device and storage medium, the description is relatively simple as it is substantially similar to the method embodiments, as relevant points are found in the partial description of the method embodiments.

The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and variations of the present application will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. which come within the spirit and principles of the application are to be included in the scope of the claims of the present application.

Although embodiments of the present disclosure have been described with reference to the accompanying drawings, various modifications and variations may be made by those skilled in the art without departing from the spirit and scope of the disclosure, and such modifications and variations fall within the scope as defined by the appended claims.

Claims (10)

1. A method of testing, the method comprising:

acquiring a historical data set generated in a production environment, wherein data in the historical data set is processed by an online code in a program in the production environment, and the obtained actual result data is written into an online production table;

in the production environment, processing the data in the historical data set by using the updated test codes, and writing the obtained test result data into a test table; the updated test code is updated based on the online code;

based on the service function represented by the on-line code, acquiring target test data corresponding to the service function from the test table, and acquiring historical actual data corresponding to the service function from the on-line production table;

and comparing the target test data with the historical actual data, and judging whether the updated test code is abnormal or not according to a comparison result.

2. The method of claim 1, wherein prior to processing the data in the historical dataset with the updated test code, the method further comprises:

identifying a block code corresponding to the newly added function from the updated test code, and verifying the block code;

accordingly, after the block code is verified, the data in the historical dataset is processed using the updated test code containing the block code.

3. The method of claim 1, wherein the online code, after processing to obtain the actual result data, writes a first data identifier characterizing an online production type into the actual result data, and wherein the updated test code, after processing to obtain the test result data, writes a second data identifier characterizing a test type into the test result data;

the actual result data and the test result data are written into the on-line production table and the test table by middleware in the following manner, respectively:

receiving data to be processed, wherein the data to be processed is the actual result data or the test result data;

identifying a data identifier contained in the data to be processed, and writing the data to be processed into the online production table under the condition that the data identifier is the first data identifier; and writing the data to be processed into the test table under the condition that the data identifier is the second data identifier.

4. The method of claim 1, wherein the actual result data and the test result data are written by middleware into the on-line production table and the test table, respectively, in the following manner:

receiving data to be processed, wherein the data to be processed is the actual result data or the test result data;

judging whether the data to be processed contains a preset data identifier or not, and writing the data to be processed into the test table under the condition that the data to be processed contains the preset data identifier; and under the condition that the data to be processed does not contain the preset data identification, writing the data to be processed into the online production table.

5. The method of claim 1, wherein determining whether the updated test code has an exception based on the comparison comprises:

if the comparison result represents that the target test data is the same as the historical actual data, judging that the updated test code is not abnormal;

and if the comparison result represents that the target test data is different from the historical actual data, judging that the updated test code is abnormal.

6. The method of claim 1, wherein the data in the historical dataset includes details of a target region in a target page over a specified period of time;

correspondingly, the actual result data obtained through the online code processing comprises: and counting the detail data of the target area in the appointed time period to obtain the total data.

7. The method of claim 1 or 6, wherein comparing the target test data and the historical actual data comprises:

judging whether the number of the data strips of the detail data in the target test data is consistent with the number of the data strips of the detail data in the historical actual data, and judging whether the total data in the target test data is consistent with the total data in the historical actual data.

8. A test apparatus, the apparatus comprising:

a history data acquisition unit, configured to acquire a history data set generated in a production environment, where data in the history data set is written into an online production table after being processed by an online code in a program in the production environment, where obtained actual result data is written into the online production table;

the test processing unit is used for processing the data in the historical data set by using the updated test codes in the production environment and writing the obtained test result data into a test table; the updated test code is updated based on the online code;

the function data extraction unit is used for acquiring target test data corresponding to the service function from the test table based on the service function represented by the online code, and acquiring historical actual data corresponding to the service function from the online production table;

and the judging unit is used for comparing the target test data with the historical actual data and judging whether the updated test code is abnormal or not according to a comparison result.

9. A test device comprising a memory and a processor, the memory being for storing a computer program which, when executed by the processor, implements the method of any one of claims 1 to 7.

10. A computer readable storage medium for storing a computer program which, when executed by a processor, implements the method of any one of claims 1 to 7.