CN110069416B - Test data processing method and device and related equipment - Google Patents

Test data processing method and device and related equipment Download PDF

Info

Publication number
CN110069416B
CN110069416B CN201910355835.1A CN201910355835A CN110069416B CN 110069416 B CN110069416 B CN 110069416B CN 201910355835 A CN201910355835 A CN 201910355835A CN 110069416 B CN110069416 B CN 110069416B
Authority
CN
China
Prior art keywords
test
data
target
service data
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910355835.1A
Other languages
Chinese (zh)
Other versions
CN110069416A (en
Inventor
杨正华
任政坤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Music Entertainment Technology Shenzhen Co Ltd
Original Assignee
Tencent Music Entertainment Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Music Entertainment Technology Shenzhen Co Ltd filed Critical Tencent Music Entertainment Technology Shenzhen Co Ltd
Priority to CN201910355835.1A priority Critical patent/CN110069416B/en
Publication of CN110069416A publication Critical patent/CN110069416A/en
Application granted granted Critical
Publication of CN110069416B publication Critical patent/CN110069416B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3692Test management for test results analysis

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Computer And Data Communications (AREA)

Abstract

The embodiment of the invention discloses a test data processing method, a device and related equipment, wherein the method comprises the following steps: the test server receives test report data sent by the target server; the test report data is report data for testing in the target report data; the target reported data refers to data which is not put in storage in the target server; the target report data is generated by the target server according to the application behavior data sent by the target client; the test report data comprises a plurality of test service data; the test server performs abnormality detection processing on the plurality of test service data to obtain abnormal service data and normal service data; and the test server outputs the abnormal service data and the normal service data. By adopting the invention, the efficiency of reporting data by the test client can be improved.

Description

Test data processing method and device and related equipment
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a test data processing method, apparatus, and related devices.
Background
With the rapid development of mobile internet technology, the number of users of intelligent terminals is increasing, and users can meet the basic demands of communication, online shopping and the like through apps (application programs) in the intelligent terminals. During the process of using the app, the intelligent terminal generates a large amount of behavior data about the app, the intelligent terminal reports the behavior data to the server, and the subsequent server can analyze the user behavior based on the reported data so as to improve the app quality, so that the accuracy of the reported data has important value.
When a tester needs to test whether the data reported by the intelligent terminal to the server has abnormal report, the prior art mainly searches test data from a report log file of the server and analyzes the test data, and the specific process is as follows: and the test personnel generates a plurality of test data in the client through the test cases, the client reports the test data to the server, and when the reported data received by the server reaches the quantity requirement, the server writes the plurality of reported data into the report log file. And searching test data corresponding to the test personnel from the report log file by the subsequent test personnel, and analyzing whether the test data has abnormality or not.
The server executes the operation of generating the report log file once only after receiving a plurality of report data, which causes that a tester spends a lot of time waiting for the generation of the report log file, and searches and extracts test data from the log file storing a lot of report data, which also consumes a lot of time and directly causes the inefficiency of testing the report data.
Disclosure of Invention
The embodiment of the invention provides a test data processing method, a device and related equipment, which can improve the efficiency of reporting data by a test client.
In one aspect, an embodiment of the present invention provides a test data processing method, including:
the test server receives test report data sent by the target server; the test report data is report data for testing in the target report data; the target reported data refers to data which is not put in storage in the target server; the target report data is generated by the target server according to the application behavior data sent by the target client; the test report data comprises a plurality of test service data;
the test server performs abnormality detection processing on the plurality of test service data to obtain abnormal service data and normal service data;
and the test server outputs the abnormal service data and the normal service data.
In another aspect, an embodiment of the present invention provides a test data processing method, including:
the method comprises the steps that a target server receives application behavior data sent by a target client, analyzes and fills the application behavior data, and obtains target report data; the target reported data refers to data which is not put in storage in the target server;
the target server extracts test report data for testing from the target report data;
The target server sends the test report data to a test server so that the test server outputs abnormal service data and normal service data in the test report data; the abnormal service data and the normal service data are determined by the test server after performing abnormality detection processing on a plurality of test service data in the test report data.
Another aspect of the embodiment of the present invention provides a test data processing apparatus, including:
the first receiving module is used for receiving test report data sent by the target server; the test report data is report data for testing in the target report data; the target reported data refers to data which is not put in storage in the target server; the target report data is generated by the target server according to the application behavior data sent by the target client; the test report data comprises a plurality of test service data;
the detection module is used for carrying out abnormal detection processing on the plurality of test service data to obtain abnormal service data and normal service data;
and the output module is used for outputting the abnormal service data and the normal service data.
Another aspect of the embodiment of the present invention provides a test data processing apparatus, including:
the second receiving module is used for receiving the application behavior data sent by the target client, analyzing and filling the application behavior data, and obtaining target reporting data; the target reported data refers to data which is not put in storage in the target server;
the second extraction module is used for extracting test report data for testing from the target report data;
the sending module is used for sending the test report data to a test server so that the test server outputs abnormal service data and normal service data in the test report data; the abnormal service data and the normal service data are determined by the test server after performing abnormality detection processing on a plurality of test service data in the test report data.
Another aspect of an embodiment of the present invention provides an electronic device, including: a processor and a memory;
the processor is connected to a memory, wherein the memory is configured to store program code, and the processor is configured to invoke the program code to perform a method as in one aspect of an embodiment of the present invention.
Another aspect of an embodiment of the present invention provides an electronic device, including: a processor and a memory;
the processor is connected to a memory, wherein the memory is configured to store program code, and the processor is configured to invoke the program code to perform a method as in another aspect of an embodiment of the invention.
Another aspect of the embodiments of the present invention provides a computer storage medium storing a computer program comprising program instructions which, when executed by a processor, perform a method as in one aspect of the embodiments of the present invention.
Another aspect of the present embodiments provides a computer storage medium storing a computer program comprising program instructions which, when executed by a processor, perform a method as in another aspect of the present embodiments.
According to the embodiment of the invention, before the target server writes all the target report data into the data warehouse, the test report data is forwarded to the test server, the subsequent test server can perform anomaly detection on the test report data, determine whether the anomaly data exists or not, and output the anomaly data so as to complete the test on the report data. According to the method, the test report data is directly bypassed from the target server to the test server, instead of extracting the test report data from the report log file after the target report data generates the report log file, so that the time for generating the report log file by the target report data can be saved, the time for searching the test report data in the report log file can also be saved, namely, the time for acquiring the report data of the test client is shortened, and the efficiency of reporting the data of the test client is further improved.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a system architecture diagram for test data processing according to an embodiment of the present invention;
FIG. 2 is a flow chart of a test data processing method according to an embodiment of the present invention;
FIG. 3 is a schematic view of a visual interface provided by an embodiment of the present invention;
FIG. 4 is a flowchart of another test data processing method according to an embodiment of the present invention;
fig. 5 is a schematic diagram of forwarding test report data according to an embodiment of the present invention;
FIG. 6 is an interactive schematic diagram of a test data processing method according to an embodiment of the present invention;
FIG. 7 is a block diagram of a test data processing method according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of a test data processing apparatus according to an embodiment of the present invention;
Fig. 9 is a schematic structural diagram of a target server according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
fig. 11 is a schematic structural diagram of another electronic device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Fig. 1 is a system architecture diagram for testing data processing according to an embodiment of the present invention. The target server establishes a connection with a cluster of user terminals through switch 10d, which may include: user terminal 10a, user terminal 10b, user terminal 10c, wherein user terminal 10a is a test terminal used by a tester, and the report data generated by test terminal 10a (user terminal 10 a) is test report data generated according to a test case.
The user terminal 10a, the user terminal 10b, the..and the user terminal 10c report the respective generated application behavior data to the target server, and the target server extracts the application behavior data for testing from the received application behavior data as test report data (i.e., the application behavior data generated by the user terminal 10 a). The target server sends the test report data to the test server, and the test server detects whether abnormal report exists in the test report data and outputs normal data and abnormal data in the test report data. The subsequent target server may then write all application behavior data to the data warehouse for storage. The target server may send the test report data to the test server, and simultaneously write the report data (application behavior data) of all the user terminals into the data warehouse.
The user terminals 10a, 10b, 10c shown in fig. 1 may include a mobile phone, a tablet computer, a notebook computer, a palm computer, a mobile internet device (MID, mobile internet device), a wearable device (e.g., a smart watch, a smart bracelet, etc.), and so on.
Fig. 2 is a schematic flow chart of a test data processing method according to an embodiment of the invention. As shown in fig. 2, the test data processing method may include:
step S101, a test server receives test report data sent by a target server; the test report data is report data for testing in the target report data; the target reported data refers to data which is not put in storage in the target server; the target report data is generated by the target server according to the application behavior data sent by the target client; the test report data includes a plurality of test service data.
Specifically, the test server (e.g., the test server in the embodiment corresponding to fig. 1) receives test report data sent by the target server (e.g., the target server in the embodiment corresponding to fig. 1), where the test report data is report data for testing in the target report data, and the target report data is not written in a data warehouse corresponding to the target server yet, i.e., the target report data is not yet put in storage.
In other words, before writing all the target report data into the corresponding data warehouse, the target server selects and copies the test report data from the target report data, and then sends the test report data to the test server. The subsequent target server may write the target report data (of course including the test report data) into the corresponding data repository (of course, this process may also be parallel, i.e., the target server may send the test report data to the test server, and also write the target report data into the data repository, and it should be emphasized that the target server may not write the target report data into the data repository until the test report data is not determined.
The client corresponding to the target server is called a target client, and the target report data is data obtained by analyzing and filling the application behavior data after the target server receives the application behavior data sent by the target client. Each application behavior data comprises a plurality of original service data, each original service data is used for recording occurrence or description states of events in the target client, such as the times of button clicking, the time length of operating the target client and the like, after the target client generates the plurality of original service data, the plurality of original service data are packaged into one application behavior data (namely, each original service data is independent) and sent to the target server, so that the interaction times between the target client and the target server can be reduced, and the load of the target server is reduced.
The following describes how the test server receives the test report data sent by the target server: the test server receives at least one original test data (i.e. the data after application behavior data parsing and filling in the foregoing) sent by the target server. Taking an original test data as an example, the test server determines the source system of the original test data according to the system path information carried by the original test data (different apps correspond to different source systems, and servers of the app reporting data may be all referred to as target servers).
The test server adjusts the data format of the original test data according to the system type of the source system, so that the adjusted data format of the original test data matches the source system (for example, all data types are converted into integer type or character string type). And the test server converts the content data contained in the original test data with the adjusted data format into data with a data exchange format (for example, json format) to obtain target test data meeting the target storage format, wherein the target test data with the data exchange format is easy to read and write by a user and easy to analyze and store by a machine compared with the original test data.
If there are multiple original test data, each original test data may be converted into a corresponding target test data in the manner described above.
The test server acquires the service configuration conditions, extracts the target test data meeting the service configuration conditions from at least one target test data according to the data type and the service type corresponding to the target test data, and uses the target test data as test report data.
For example, there are 3 target test data (there are 3 original test data corresponding thereto), and the source system of the target test data 1 is the system a, the source system of the target test data 2 is the system a, and the source system of the target test data 3 is the system C. The service configuration condition is that the source system is the system A, so that only the target test data 1 and the target test data 2 in the 3 target test data meet the service configuration condition, namely the target test data 1 and the target test data 2 are test report data.
The test server reads a plurality of test service data contained in the test report data, and stores the plurality of test service data in a target database corresponding to the test server. It should be noted that, each target test data includes a plurality of test service data (corresponding to the original service data in the foregoing description), because the target client generates a plurality of original service data before reporting the application behavior data to the target server once.
Optionally, the test server refers to the field included in each test service data as a target field (e.g., uid, path, uneme all belong to the target field). The test server obtains a field input by a user as an input field, searches a plurality of target fields for the same target field as the input field, takes test service data corresponding to the searched target field as display service data, and displays the display service data in a target visual interface. If the number of the input fields is more than one, the test server takes the test service data with any input field as the display service data.
Please refer to fig. 3, which is a schematic diagram of a visual interface provided in an embodiment of the present invention, as shown in fig. 3, the target visual interface 30a includes 6 target fields, which are respectively: the fields "user id", the field "user name", the field "path information", the field "account balance", the field "data timestamp", the field "song id", the test server obtains the field selected by the user as an input field, i.e. the 4 input fields include: the field "user id", the field "path information", the field "data time stamp", the field "song id", the test server uses the test service data with any input field as display service data, the display service data is displayed in the target visual interface 30a, and 4 pieces of test service data are displayed in the interface as shown in the target visual interface 30 a.
Step S102, the test server carries out abnormality detection processing on the plurality of test service data to obtain abnormal service data and normal service data.
Specifically, the test server detects whether the same test service data exists in the plurality of test service data, wherein the same test service data refers to that target fields contained in the two test service data are the same, and values of the two test service data in the same target field are the same.
If the same test service data exist, the test server takes the same test service data as abnormal service data; correspondingly, the test server takes the test service data except the abnormal service data in all the test service data as the normal service data.
For example, test traffic data 1 is: [001 (field is user id), 1.1.12 (field is path information), 70 (field is path id) ]; the test service data 2 is: [001 (field is user id), 1.1.12 (field is network address), 70 (field is path id) ], that is, the two test service data are identical test service data, then test service data 1 and test service data 2 are abnormal service data.
Optionally, the test server extracts path information contained in each test service data, which is called target path information. The test server searches target path information which does not meet the path rule in the plurality of target path information, and takes the test service data corresponding to the searched target path information as abnormal service data; correspondingly, the test server takes the target path information meeting the path rule in the plurality of target path information as normal service data.
For example, the target path information of the test traffic data 1 is: personal homepage\My attention\Japanese and Korean singer, path rule is: the personal homepage\the japanese and korean singers\the japanese and korean female singers, that is, the page of the japanese and korean female singers can be accessed only through the page of the japanese and korean singers, and the test service data 1 can access the page of the japanese and korean female singers through the page of the my attention, so that the target path information of the test service data 1 does not satisfy the path rule, and thus the test service data 1 is abnormal service data.
Optionally, the user may customize the detection rule (referred to as an input rule), and extract test service data satisfying the input rule from the plurality of test service data as normal service data; and correspondingly extracting test service data which does not meet the input rule from the plurality of test service data, and taking the test service data as abnormal service data.
Optionally, a page identifier (referred to as a target page identifier) exists in each service test data, where the target page identifier is used to represent a page where the service test data is generated. When all the test service data are the test data aiming at a plurality of target pages with a hierarchical relation, the test server counts the exposure of each target page according to the target page identification and the exposure identification contained in each test service data, wherein the exposure of the target page refers to the number of times of displaying the target page in the screen of the intelligent terminal where the target client is located, and the exposure identification is used for representing whether the corresponding target page is exposed or not.
The test server sorts the plurality of target pages according to the exposure of each target page to obtain a target page sequence, wherein the target page sequence can be an ascending sequence or a descending sequence, and if the target page sequence is the ascending sequence, the higher the exposure, the higher the target page sequencing is; if the target page sequence is a descending sequence, the target page sequence with smaller exposure is ranked higher. The test server acquires standard page sequences of a plurality of target pages, and if the standard page sequences are different from the target page sequences, a plurality of test service data can be determined as abnormal service data; correspondingly, if the standard page sequence is the same as the target page sequence, a plurality of test service data can be determined as normal service data.
For example, target page 2 is a sub-page of target page 1, that is to say target page 1 must be accessed first to access target page 2, i.e. the exposure application of target page 1 is greater than or the exposure of target page 2. If the exposure of the target page 1 is counted to be smaller than the target page 2 according to the page identifications and the exposure identifications respectively corresponding to the test service data 1, the test service data 2 and the test service data 3, the test service data 1, the test service data 2 and the test service data 3 are abnormal service data.
Optionally, the plurality of test service data includes first orientation data pertaining to a first test case and second orientation data pertaining to a second test case, where the first test case and the second test case may pertain to an automatic test case. The test server obtains a case parameter (called a first case parameter) of the first test case and a case parameter (called a second case parameter) of the second test case, where the case parameter may include a case start time, a case end time, and a media access control address (also called a MAC address) of an intelligent terminal where the target client is located. The test server may divide the plurality of test service data into first directional test data belonging to the first test case and second directional test data belonging to the second test case according to the first test case parameter and the second test case parameter. In other words, even if the test server receives test report data (a plurality of test service data) sent by different intelligent terminals and based on different test cases, the test service data can be accurately divided into the test report data belonging to different intelligent terminals and different test cases according to the mac address of the intelligent terminal, the case starting time and the case ending time of the test cases and other case parameters. The first test case and the second test case are not limited to only two test cases, but only for distinguishing a plurality of test cases, namely, the first test case can contain a plurality of test cases, and the second test case can also contain a plurality of test cases.
The test server sorts the operation behaviors contained in the first directional test data according to the operation behaviors corresponding to the test service data contained in the first directional test data and the generation time stamp (called data time stamp, namely the time stamp for generating each test service data) of each test service data to obtain a first target behavior sequence, wherein the first target behavior sequence can be in ascending order or in descending order; correspondingly, the test server sorts the operation behaviors contained in the second directional test data according to the operation behaviors corresponding to the test service data contained in the second directional test data and the data time stamp of each test service data to obtain a second target behavior sequence, wherein the second target behavior sequence can be in ascending order or in descending order.
The test server acquires the behavior sequence of the operation behaviors contained in the first test case as a first standard behavior sequence, and acquires the behavior sequence of the operation behaviors contained in the second test case as a second standard behavior sequence.
If the first target behavior sequence is different from the first standard behavior sequence and the second target behavior sequence is different from the second standard behavior sequence, the test server may determine that the first directional test data and the second directional test data (i.e., all the test service data) are abnormal service data.
If the first target behavior sequence is different from the first standard behavior sequence and the second target behavior sequence is the same as the second standard behavior sequence, the test server may determine the first directional test data in the plurality of test service data as abnormal service data and determine the remaining second directional test data as normal service data.
If the first target behavior sequence is the same as the first standard behavior sequence and the second target behavior sequence is different from the second standard behavior sequence, the test server may determine the first directional test data of the plurality of test service data as normal service data and determine the second directional test data as abnormal service data.
If the first target behavior sequence is the same as the first standard behavior sequence and the second target behavior sequence is the same as the second standard behavior sequence, the test server may determine that the first directional test data and the second directional test data (i.e., all the test service data) are normal service data.
In other words, if the first target behavior sequence is the same as the first standard behavior sequence, determining if the first directional test data is abnormal service data; whether the second target behavior sequence is identical to the second standard behavior sequence or not determines whether the second directional test data is abnormal service data or not.
The foregoing description refers to determining abnormal service data and normal service data in a plurality of test service data by detecting whether there are identical test service data, path rules, page exposure, behavior sequences, and the like. The above detection modes can be combined and overlapped in any order to be used as a means for detecting whether abnormal service data exists in a plurality of test service data. For example, the abnormal service data and the normal service data can be detected by whether the same test service data exists, then whether the abnormal service data exists in the normal service data is detected by further passing through a path rule, and the abnormal service data in the plurality of test service data can be accurately identified by precisely detecting step by step.
Step S103, the test server outputs the abnormal service data and the normal service data.
Specifically, the test server data outputs the identified abnormal service data and the identified normal service data, for example, the abnormal service data may be displayed in a web page manner in a screen, or an abnormal prompt message may be generated according to the abnormal service data, so as to prompt a user to abnormal service data, so that the user may conveniently check the functional module corresponding to the abnormal service data, or mail may be generated according to the abnormal service data, and the mail including the abnormal service data may be sent to a corresponding tester.
Optionally, the test server may further detect whether missing report data exists in the data reported by the old version client. The specific process is as follows: the test server pulls the reference service data, wherein the reference service data and the target clients with different versions execute the test data generated by the same system test case, and the version time stamp corresponding to the reference service data is smaller than the version time stamp corresponding to the plurality of test service data.
It may also be understood that the reference service data is data reported after the old version target client executes the system test case, and the plurality of test service data is data reported after the new version target client executes the system test case. The test server extracts the page identifier contained in the reference service data as the reference page identifier, and of course, the test service data also contains the page identifier (i.e. the target page identifier in the foregoing description).
The test server takes the test service with the reference page identifier as standard service data from a plurality of test service data, and the standard service data and the reference service data are test data corresponding to the same functional module by screening the same page identifier. The test server extracts test service data which does not belong to reference service data from standard service data, and the test service data is used as missing service data (the missing service data exists in the test data corresponding to the new version but does not exist in the test data corresponding to the old version), and the missing service data is output (the test service data can be displayed by a webpage or sent to a corresponding tester by mail).
For example, the plurality of test traffic data includes: service data A1, service data A2, service A3 and test service data A4, wherein the pages of service data A1, service data A2 and service A3 are identified as page 1, and the page of service data A4 is identified as page 2. The pulled reference service data is: the service data A1 and the service data A2, and the page marks of the service data A1 and the service data A2 are page 1, so that the service data A1, the test service data A2 and the test service A3 can be determined to be standard service data in a plurality of test service data, and the standard test service data but not the reference service data are as follows: traffic data A3, so traffic data A3 is missing traffic data.
According to the method, the test report data is directly bypassed from the target server to the test server, instead of the to-be-tested report data being written into the data warehouse from the target server and then being extracted from the data warehouse, a large amount of time for storing the test report data and searching the test report data in the data warehouse can be saved, namely, the time for reporting the data by the test client is shortened, and the efficiency for reporting the data by the test client is further improved.
Fig. 4 is a flow chart of another test data processing method according to an embodiment of the invention, and as shown in fig. 4, the test data processing method includes the following steps:
Step S201, a target server receives application behavior data sent by a target client, analyzes and fills the application behavior data, and obtains target report data; the target report data refers to data which is not put in storage in the target server.
Specifically, the target client generates a plurality of original service data, packages and compresses the plurality of original service data into application behavior data, and sends the application behavior data to the target server corresponding to the target client.
After receiving the application behavior data, if the blank field exists in the original service data in the application behavior data, the target server first analyzes the blank field, then searches the value of the blank field in the corresponding target file, fills the found value into the original service data, and after the processing is performed on all the original service data, target report data corresponding to the application behavior data can be obtained, wherein the target report data comprises a plurality of analysis data, and each analysis data refers to the data after analysis and filling of each original service data.
Step S202, the target server extracts test report data for testing from the target report data.
Specifically, when the target report data includes at least one unit report data (i.e., the number of target report data is a plurality of units), the target client needs to extract test report data for testing from the at least one unit report data. The specific process is as follows: the target server detects its own network address as a test network address. If the test network address exists in the intranet address list, it indicates that the target server is in the test environment or in the intranet environment, and the target server determines all unit report data as test report data, that is, the target report data generated according to the application behavior data received by the server in the test environment is the test report data for testing, because the server in the test environment only communicates with the target client in the test environment.
If the test network address does not exist in the intranet address list, the test server extracts target user identifiers in a plurality of analysis data contained in each unit of report data (it should be noted that each unit of report data contains a plurality of analysis data (analysis data is data obtained by analyzing and filling original report data), but target user identifiers of analysis data in the same unit of report data are the same), and the unit report data corresponding to the target user identifiers existing in the test user identifier list is used as the test report data.
For example, the target report data includes: unit report data 1 (all target user identifiers of all analysis data in unit report data 1 are user 1), unit report data 2 (all target user identifiers of all analysis data in unit report data 2 are user 2), and unit report data 3 (all target user identifiers of all analysis data in unit report data 3 are user 3), if the test network address of the test server is not in the intranet address list, and the test user identifier list comprises user 1 and user 3, the unit report data 1 and the unit report data 3 are test report data.
Step 203, the target server sends the test report data to a test server, so that the test server outputs abnormal service data and normal service data in the test report data; the abnormal service data and the normal service data are determined by the test server after performing abnormality detection processing on a plurality of test service data in the test report data.
Specifically, the target server includes a general gateway interface (Common Gateway Interface, CGI) and a background sending interface, where the two interfaces are both used to send application behavior data of the target client to a data warehouse corresponding to the target server, and the background sending interface is located behind the general gateway interface, where the data flow sequence is: target client-universal gateway interface-background send interface-data warehouse.
The transmission type of the test report data comprises a first transmission type and a second transmission type, and when the test report data needs to be transmitted to the target data warehouse, if the test report data is directly transmitted to the data warehouse from the universal gateway interface, the transmission type of the test report data belongs to the first type; if the test report data is sent to the data warehouse from the universal gateway interface and the background sending interface, the sending type of the test report data belongs to the second type. When the test report data belongs to the first transmission type, the universal gateway interface in the target server directly transmits the test report data to the test server, and when the test report data belongs to the second transmission type, the universal gateway interface and the background transmission interface in the target server transmit the test report data to the test server.
Fig. 5 is a schematic diagram of forwarding test report data according to an embodiment of the present invention, where as shown in fig. 5, a target server includes a general gateway interface and a background sending interface, and the background sending interface is located after passing through the gateway interface. After the target client sends the test report data to the universal gateway interface, if the target server detects that the test report data is directly sent to the data warehouse from the universal gateway interface, the test report data is indicated to belong to the first sending type, so that the universal gateway interface in the target server directly forwards the test report data to the test server, and the test server receives and stores the test report data. If the target server detects that the test report data is subsequently sent to the data warehouse through the universal gateway interface and the background sending interface, the test report data is indicated to belong to the second sending type, so that the universal gateway interface and the background sending interface in the target server forward the test report data to the test server, and the test server receives and stores the test report data
Fig. 6 is an interactive schematic diagram of a test data processing method according to an embodiment of the present invention. The test server comprises a data receiver and a report analyzer, and the test data processing method comprises the following steps:
in step S301, the automatic test interface sends a task start message to the data receiver in the test server.
Specifically, the automatic test interface may drive the corresponding target client to automatically execute the automatic test case (e.g., the first test case and the second test case in the foregoing description) so as to generate test report data. The automatic test interface creates a test task and sends a task start message to the data receiver, the task start message carrying a task id.
In step S302, the data receiver feeds back a reply message agreeing to the task to the automatic test interface.
In step S303, the automatic test interface sends a message to the data receiver to start executing the automatic test case.
Specifically, the automatic test interface sends an instance start message for starting executing the automatic test instance to the data receiver, wherein the instance start message carries a task id of a task to which the instance start message belongs, a mac address of an intelligent terminal where a target client executing the automatic test instance is located, and an instance start time for executing the automatic test instance by the target client.
In step S304, the data receiver feeds back a reply message agreeing to execute the automatic test case to the automatic test interface.
In step S305, the automatic test interface notifies the target client to execute the automatic test case.
Step S306, the target client executes the automatic test case and sends test report data to the target server.
Specifically, the target client automatically executes the automatic test case according to the notification sent by the automatic test interface, and sends the application behavior data generated after the automatic test case is executed to the target server.
In step S307, the target server transmits test report data to the data receiver.
Specifically, since the target client for executing the automatic test case is in the test environment and the target server interacted with the target client in the test environment is also in the test environment, the target server can detect that the target server is in the test environment. The target server can analyze and fill the application behavior data into target report data, then directly determine the target report data into test report data, and then send the test report data to the data receiver. The specific process of the target server generating the target report data according to the application behavior data and further determining the test report data may refer to step S201-step S202 in the corresponding embodiment of fig. 4.
Step S308, the target client informs the automatic test interface that the automatic test case is executed.
Step S309, the automatic test interface sends a task end message to the data receiver.
Specifically, the automatic test interface sends an instance ending message to the data receiver, where the instance ending message carries a task id of a task to which the instance ending message belongs, a mac address of an intelligent terminal where a target client executing the automatic test instance is located, and an instance ending time for the target client executing the automatic test instance.
In step S310, the data receiver feeds back a reply message agreeing to end the automatic test case to the automatic test interface.
In step S311, the automatic test interface sends a task end message to the data receiver.
In step S312, the data receiver feeds back a reply message agreeing to end the task to the automatic test interface.
In step S313, the data receiver notifies the report analyzer to analyze the test report data.
Specifically, the data receiver informs a report analyzer in the test server to analyze test report data, the report analyzer is used for analyzing whether abnormal service data exists in a plurality of test service data in the test report data, and if the report analyzer detects that the abnormal service data exists, the abnormal service data can be sent to an intelligent terminal bound by a tester through mail. The specific process of the report analyzer for detecting whether the abnormal service data exists may refer to step S102 in the corresponding embodiment of fig. 2.
Referring to fig. 7, which is a component structure diagram of a test data processing method provided by an embodiment of the present invention, as shown in fig. 7, a test report data forwarding component in a target server receives test report data generated by a target client in an external network environment, or test report data generated by a daily test and test report data generated by executing an automatic test case, and the test report data forwarding component in the target server forwards the received test report data to a test report data receiving component in the test server. The monitoring and analyzing module in the test server performs anomaly detection on the received test report data to determine normal service data and abnormal service data in a plurality of test service data in the test report data, wherein the operation behavior sequence in the test report data generated by searching missing service data, analyzing daily data and automatic test cases can be statistically analyzed, the abnormal service data and the normal service data are determined in a rule-based manner, and a user can customize rules through the rule entry module and determine rules through the form analyzing module, and the specific process of the anomaly detection can be seen in step S102 in the corresponding embodiment of the above-mentioned FIG. 2. After the monitoring and analyzing module detects the abnormal service data and the normal service data, the abnormal service data and the normal service data can be stored separately based on the storage module, and the abnormal service data and the normal service data are displayed (or mail is notified to a tester) based on the webpage of the display module.
According to the method, the test report data is directly bypassed from the target server to the test server, instead of the to-be-tested report data being written into the data warehouse from the target server and then being extracted from the data warehouse, a large amount of time for storing the test report data and searching the test report data in the data warehouse can be saved, namely, the time for reporting the data by the test client is shortened, and the efficiency for reporting the data by the test client is further improved.
Further, please refer to fig. 8, which is a schematic diagram illustrating a structure of a test data processing apparatus according to an embodiment of the present invention. As shown in fig. 8, the test data processing apparatus 1 may be applied to the test server in the above-described corresponding embodiment of fig. 2 to 7, and the test data processing apparatus 1 may include: a first receiving module 11, a detecting module 12 and an output module 13.
The first receiving module 11 is configured to receive test report data sent by the target server; the test report data is report data for testing in the target report data; the target reported data refers to data which is not put in storage in the target server; the target report data is generated by the target server according to the application behavior data sent by the target client; the test report data comprises a plurality of test service data;
The detection module 12 is configured to perform anomaly detection processing on the plurality of test service data to obtain abnormal service data and normal service data;
and an output module 13, configured to output the abnormal service data and the normal service data.
The specific functional implementation manners of the first receiving module 11, the detecting module 12, and the output module 13 may refer to step S101 to step S103 in the corresponding embodiment of fig. 2, which are not described herein.
Referring to fig. 8, the first receiving module 11 may include: a receiving unit 111, a first extracting unit 112, a reading unit 113.
A receiving unit 111, configured to receive at least one original test data sent by the target server, and convert the at least one original test data into target test data in a target storage format according to a source system corresponding to the original test data, respectively;
a first extracting unit 112, configured to extract, from at least one target test data, target test data that meets a service configuration condition according to a data type and a service type of the target test data, as the test report data;
and a reading unit 113, configured to read a plurality of test service data included in the test report data, and sequentially store the plurality of test service data in a target database.
The specific functional implementation manner of the receiving unit 111, the first extracting unit 112, and the reading unit 113 may refer to step S101 in the corresponding embodiment of fig. 2, which is not described herein.
Referring to fig. 8, the test data processing apparatus 1 may include: the first receiving module 11, the detecting module 12, and the output module 13 may further include: a combination module 14, a first acquisition module 15, a display module 16.
A combination module 14, configured to extract a target field included in each test service data;
a first obtaining module 15, configured to obtain an input field, and use test service data corresponding to a target field that is the same as the input field in multiple target fields as display service data;
and the display module 16 is used for displaying the display service data in the target visual interface.
The specific function implementation manner of the combining module 14, the first obtaining module 15, and the display module 16 may refer to step S101 in the corresponding embodiment of fig. 2, which is not described herein.
Referring to fig. 8, the detection module 12 may include: an extraction unit 121, a first determination unit 122.
An extracting unit 121, configured to extract the same test service data from the plurality of test service data as the abnormal service data;
The first determining unit 122 is configured to take, as the normal service data, test service data other than the abnormal service data among the plurality of test service data.
The specific functional implementation manner of the extracting unit 121 and the first determining unit 122 may refer to step S102 in the corresponding embodiment of fig. 2, which is not described herein.
Referring to fig. 8, the detection module 12 may include: a combining unit 123, a second determining unit 124.
A combining unit 123, configured to extract target path information included in each test service data;
a second determining unit 124, configured to use, as the abnormal service data, test service data corresponding to target path information that does not satisfy a path rule among the plurality of target path information;
the second determining unit 124 is further configured to use, as the normal service data, test service data corresponding to target path information that satisfies the path rule among the plurality of target path information.
The specific functional implementation manner of the combining unit 123 and the second determining unit 124 may refer to step S102 in the corresponding embodiment of fig. 2, which is not described herein.
Referring to fig. 8, the plurality of test service data are test data for a plurality of target pages having a hierarchical relationship;
The detection module 12 may include: a statistics unit 125, a third determination unit 126.
The statistics unit 125 is configured to count an exposure of each target page according to a target page identifier included in each test service data, and order the plurality of target pages according to the exposure, so as to obtain a target page sequence;
the statistics unit 125 is further configured to obtain a standard page sequence of the plurality of target pages;
a third determining unit 126, configured to determine the plurality of test service data as the abnormal service data if the standard page sequence is different from the target page sequence;
the third determining unit 126 is further configured to determine the plurality of test service data as the normal service data if the standard page sequence is the same as the target page sequence.
The specific functional implementation manner of the statistics unit 125 and the third determination unit 126 may refer to step S102 in the corresponding embodiment of fig. 2, which is not described herein.
Referring to fig. 8, the plurality of test service data includes first directional test data and second directional test data
The detection module 12 may include: an acquisition unit 127, a division unit 128, and an identification unit 129.
An obtaining unit 127, configured to obtain a first case parameter of a first test case and a second case parameter of a second test case;
a dividing unit 128, configured to divide the plurality of test service data into first directional test data belonging to a first test case and second directional test data belonging to a second test case according to the first case parameter and the second case parameter;
the dividing unit 128 is further configured to determine a first target behavior sequence included in the first directional test data according to a data timestamp corresponding to the first directional test data, and determine a second target behavior sequence included in the second directional test data according to a data timestamp corresponding to the second directional test data;
the dividing unit 128 is further configured to obtain a first standard behavior sequence corresponding to the first test case, and obtain a second standard behavior sequence corresponding to the second test case;
an identifying unit 129, configured to identify abnormal service data and normal service data in the plurality of test service data according to the first target behavior sequence, the second target behavior sequence, the first standard behavior sequence, and the second standard behavior sequence.
The specific functional implementation manners of the obtaining unit 127, the dividing unit 128, and the identifying unit 129 may refer to step S102 in the corresponding embodiment of fig. 2, which is not described herein.
Referring to fig. 8, the recognition unit 129 may include: a first determination subunit 1291, a second determination subunit 1292.
A first determining subunit 1291, configured to determine the plurality of test service data as the abnormal service data if the first target behavior sequence is different from the first standard behavior sequence and the second target behavior sequence is different from the second standard behavior sequence;
the first determining subunit 1291 is further configured to determine, if the first target behavior sequence is the same as the first standard behavior sequence and the second target behavior sequence is different from the second standard behavior sequence, the first directional test data as normal service data and the second directional test data as abnormal service data;
a second determining subunit 1292, configured to determine the first directional test data as abnormal service data and determine the first directional test data as normal service data if the first target behavior sequence is different from the first standard behavior sequence and the second target behavior sequence is the same as the second standard behavior sequence;
The second determining subunit 1292 is further configured to determine the plurality of test service data as the normal service data if the first target behavior sequence is the same as the first standard behavior sequence and the second target behavior sequence is the same as the second standard behavior sequence.
The specific function implementation manner of the first determining subunit 1291 and the second determining subunit 1292 may refer to step S102 in the corresponding embodiment of fig. 2, which is not described herein.
Referring to fig. 8, the test data processing apparatus 1 may include: the first receiving module 11, the detecting module 12, the output module 13, the combining module 14, the first obtaining module 15, the display module 16 may further include: a second acquisition module 17, a determination module 18.
A second acquisition module 17, configured to acquire reference service data; the reference service data and the plurality of test service data are test data generated by the target client executing the system test cases of different versions, and version time stamps corresponding to the reference service data are smaller than version time stamps corresponding to the plurality of test service data;
a determining module 18, configured to extract a reference page identifier from the reference service data, and use the test service data with the reference page identifier as standard service data;
The determining module 18 is further configured to extract test service data that does not belong to the reference service data from the standard service data as missing service data, and output the missing service data.
The specific function implementation manner of the second obtaining module 17 and the determining module 18 may refer to step S103 in the corresponding embodiment of fig. 2, which is not described herein.
Further, please refer to fig. 9, which is a schematic structural diagram of a target server according to an embodiment of the present invention, the target server includes: the test data processing device 2 and the generic gateway interface and the background send interface. As shown in fig. 9, the test data processing device 2 may include: a second receiving module 21, a second extracting module 22, and a transmitting module 23.
The second receiving module 21 is configured to receive application behavior data sent by the target client, parse and fill the application behavior data, and obtain target report data; the target reported data refers to data which is not put in storage in the target server;
a second extracting module 22, configured to extract test report data for testing from the target report data;
the sending module 23 is configured to send the test report data to a test server, so that the test server outputs abnormal service data and normal service data in the test report data; the abnormal service data and the normal service data are determined by the test server after performing abnormality detection processing on a plurality of test service data in the test report data.
The specific functional implementation manner of the second receiving module 21, the second extracting module 22, and the sending module 23 may refer to step S201 and step S203 in the corresponding embodiment of fig. 4, which are not described herein.
Referring to fig. 9, the target report data includes at least one unit report data;
the second extraction module 22 may include: an address determination unit 221, and a data determination unit 222.
An address determining unit 221, configured to obtain a network address of the target server as a test network address;
a data determining unit 222, configured to determine the at least one unit report data as the test report data if the test network address exists in the intranet address list;
the data determining unit 222 is further configured to extract target user identifiers from the at least one unit report data, and determine unit report data corresponding to the target user identifiers in the test user identifier list as the test report data, if the test network address does not exist in the intranet address list.
The specific functional implementation manner of the address determining unit 221 and the data determining unit 222 may refer to step S202 in the corresponding embodiment of fig. 4, which is not described herein.
Referring to fig. 9, the target server includes a generic gateway interface and a background sending interface;
when the test report data belong to a first sending type, sending the test report data to the test server through the universal gateway interface; the first transmission type refers to a transmission type transmitted from the universal gateway interface to a data warehouse in the target server;
when the test report data belongs to a second transmission type, the test report data is transmitted to the test server through the universal gateway interface and the background transmission interface; the second transmission type refers to a transmission type transmitted from the generic gateway interface and the background transmission interface to the data repository.
Further, please refer to fig. 10, which is a schematic structural diagram of an electronic device according to an embodiment of the present invention. The test server in the foregoing corresponding embodiment of fig. 2 to fig. 7 may be the electronic device 1000, as shown in fig. 10, where the electronic device 1000 may include: a user interface 1002, a processor 1004, an encoder 1006, and a memory 1008. Signal receiver 1016 is used to receive or transmit data via cellular interface 1010, WIFI interface 1012, a. The encoder 1006 encodes the received data into a computer-processed data format. The memory 1008 has stored therein a computer program, by which the processor 1004 is arranged to perform the steps of any of the method embodiments described above. The memory 1008 may include volatile memory (e.g., dynamic random access memory, DRAM) and may also include non-volatile memory (e.g., one-time programmable read only memory, OTPROM). In some examples, the memory 1008 may further include memory located remotely from the processor 1004, which may be connected to the electronic device 1000 over a network. The user interface 1002 may include: a receiver 1018, and a display 1020.
In the electronic device 1000 shown in fig. 10, the processor 1004 may be configured to invoke the storage of a computer program in the memory 1008 to implement:
receiving test report data sent by a target server; the test report data is report data for testing in the target report data; the target reported data refers to data which is not put in storage in the target server; the target report data is generated by the target server according to the application behavior data sent by the target client; the test report data comprises a plurality of test service data;
performing anomaly detection processing on the plurality of test service data to obtain abnormal service data and normal service data;
and outputting the abnormal service data and the normal service data.
It should be understood that the electronic device 1000 described in the embodiment of the present invention may perform the description of the test data processing method in the embodiment corresponding to fig. 2 to 3, and may also perform the description of the test data processing apparatus 1 in the embodiment corresponding to fig. 8, which is not repeated herein. In addition, the description of the beneficial effects of the same method is omitted.
Furthermore, it should be noted here that: the embodiment of the present invention further provides a computer storage medium, in which a computer program executed by the test data processing apparatus 1 mentioned above is stored, and the computer program includes program instructions, when executed by the processor, can execute the description of the test data processing method in the embodiment corresponding to fig. 2 to 3, and therefore, a detailed description will not be given here. In addition, the description of the beneficial effects of the same method is omitted. For technical details not disclosed in the embodiments of the computer storage medium according to the present invention, please refer to the description of the method embodiments of the present invention.
Further, please refer to fig. 11, which is a schematic structural diagram of another electronic device according to an embodiment of the present invention. The target server in the foregoing corresponding embodiment of fig. 2 to fig. 7 may be an electronic device 2000, as shown in fig. 11, the electronic device 2000 may include: a user interface 2002, a processor 2004, an encoder 2006, and a memory 2008. The signal receiver 2016 is configured to receive or transmit data via the cellular interface 2010, the WIFI interface 2012, the..or the NFC interface 2014. The encoder 2006 encodes the received data into a computer-processed data format. The memory 2008 has stored therein a computer program, the processor 2004 being arranged to perform the steps of any of the method embodiments described above by means of the computer program. Memory 2008 can include volatile memory (e.g., dynamic random access memory, DRAM) and can also include nonvolatile memory (e.g., one-time programmable read only memory, OTPROM). In some examples, memory 2008 may further include memory remotely located relative to processor 2004, which may be connected to electronic device 2000 via a network. The user interface 2002 may include: a receiver 2018, and a display 2020.
The electronic device 2000 may further include: the generic gateway interface 2021 and the background transmission interface 2022, and the generic gateway interface 2021 and the background transmission interface 2022 are used to transmit data.
In the electronic device 2000 illustrated in fig. 11, the processor 2004 may be used to invoke the storage of a computer program in the memory 2008 to implement:
receiving application behavior data sent by a target client, analyzing and filling the application behavior data to obtain target reporting data; the target reported data refers to data which is not put in storage in the target server;
extracting test report data for testing from the target report data;
transmitting the test report data to a test server so that the test server outputs abnormal service data and normal service data in the test report data; the abnormal service data and the normal service data are determined by the test server after performing abnormality detection processing on a plurality of test service data in the test report data.
It should be understood that the electronic device 2000 in the embodiment of the present invention may perform the description of the test data processing method in the embodiment corresponding to fig. 4 to 7, and may also perform the description of the test data processing apparatus 2 in the embodiment corresponding to fig. 9, which is not repeated herein. In addition, the description of the beneficial effects of the same method is omitted.
Furthermore, it should be noted here that: the embodiment of the present invention further provides a computer storage medium, in which a computer program executed by the test data processing apparatus 2 mentioned above is stored, and the computer program includes program instructions, when executed by the processor, can execute the description of the test data processing method in the embodiment corresponding to fig. 4 to 7, and therefore, a detailed description will not be given here. In addition, the description of the beneficial effects of the same method is omitted. For technical details not disclosed in the embodiments of the computer storage medium according to the present invention, please refer to the description of the method embodiments of the present invention.
Those skilled in the art will appreciate that implementing all or part of the above-described methods in accordance with the embodiments may be accomplished by way of a computer program stored on a computer readable storage medium, which when executed may comprise the steps of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), or the like.
The foregoing disclosure is illustrative of the present invention and is not to be construed as limiting the scope of the invention, which is defined by the appended claims.

Claims (26)

1. A method of testing data processing comprising:
the test server receives test report data sent by the target server; the test report data is report data for testing in the target report data; the target reported data refers to data which is not put in storage in the target server; the target report data is generated by the target server according to the application behavior data sent by the target client; the test report data comprises a plurality of test service data;
the test server performs abnormality detection processing on the plurality of test service data to obtain abnormal service data and normal service data;
and the test server outputs the abnormal service data and the normal service data.
2. The method of claim 1, wherein the test server receiving test report data sent by the target server comprises:
the test server receives at least one piece of original test data sent by the target server, and respectively converts the at least one piece of original test data into target test data in a target storage format according to a source system corresponding to the original test data;
The test server extracts target test data meeting service configuration conditions from at least one target test data according to the data type and the service type of the target test data, and the target test data is used as the test report data;
and the test server reads a plurality of test service data contained in the test report data and sequentially stores the test service data in a target database.
3. The method as recited in claim 1, further comprising:
the test server extracts a target field contained in each test service data;
the test server acquires an input field and takes test service data corresponding to a target field which is the same as the input field in a plurality of target fields as display service data;
and the test server displays the display service data in a target visual interface.
4. A method according to any one of claims 1 to 3, wherein the performing, by the test server, anomaly detection processing on the plurality of test service data to obtain abnormal service data and normal service data includes:
the test server extracts the same test service data from the plurality of test service data as the abnormal service data;
The test server takes the test service data except the abnormal service data in the plurality of test service data as the normal service data.
5. A method according to any one of claims 1 to 3, wherein the performing, by the test server, anomaly detection processing on the plurality of test service data to obtain abnormal service data and normal service data includes:
the test server extracts target path information contained in each test service data;
the test server takes test service data corresponding to target path information which does not meet the path rule in the plurality of target path information as the abnormal service data;
and the test server takes test service data corresponding to the target path information meeting the path rule in the plurality of target path information as the normal service data.
6. A method according to any one of claims 1-3, wherein the plurality of test traffic data are test data for a plurality of target pages having a hierarchical relationship;
the test server performs abnormality detection processing on the plurality of test service data to obtain abnormal service data and normal service data, and the method comprises the following steps:
The test server counts the exposure of each target page according to the target page identification contained in each test service data, and sorts the plurality of target pages according to the exposure to obtain a target page sequence;
the test server acquires standard page sequences of the target pages;
if the standard page sequence is different from the target page sequence, the test server determines the plurality of test service data as the abnormal service data;
and if the standard page sequence is the same as the target page sequence, the test server determines the plurality of test service data as the normal service data.
7. A method according to any of claims 1-3, wherein the plurality of test traffic data comprises first directional test data and second directional test data;
the test server performs abnormality detection processing on the plurality of test service data to obtain abnormal service data and normal service data, and the method comprises the following steps:
the test server acquires a first case parameter of a first test case and a second case parameter of a second test case;
the test server divides the plurality of test service data into first directional test data belonging to a first test case and second directional test data of a second test case according to the first case parameter and the second case parameter;
The test server determines a first target behavior sequence contained in the first directional test data according to the data time stamp corresponding to the first directional test data, and determines a second target behavior sequence contained in the second directional test data according to the data time stamp corresponding to the second directional test data;
the test server acquires a first standard behavior sequence corresponding to the first test case and acquires a second standard behavior sequence corresponding to the second test case;
the test server identifies abnormal service data and normal service data in the plurality of test service data according to the first target behavior sequence, the second target behavior sequence, the first standard behavior sequence and the second standard behavior sequence.
8. The method of claim 7, wherein the test server identifying abnormal traffic data and normal traffic data in the plurality of test traffic data based on the first target behavior sequence, the second target behavior sequence, the first standard behavior sequence, and the second standard behavior sequence, comprises:
if the first target behavior sequence is different from the first standard behavior sequence and the second target behavior sequence is different from the second standard behavior sequence, the test server determines the plurality of test service data as the abnormal service data;
If the first target behavior sequence is the same as the first standard behavior sequence and the second target behavior sequence is different from the second standard behavior sequence, the test server determines the first directional test data as normal service data and the second directional test data as abnormal service data;
if the first target behavior sequence is different from the first standard behavior sequence and the second target behavior sequence is the same as the second standard behavior sequence, the test server determines the first directional test data as abnormal service data and determines the first directional test data as normal service data;
and if the first target behavior sequence is the same as the first standard behavior sequence and the second target behavior sequence is the same as the second standard behavior sequence, the test server determines the plurality of test service data as the normal service data.
9. A method according to any one of claims 1-3, further comprising:
the test server acquires reference service data; the reference service data and the plurality of test service data are test data generated by the target client executing the system test cases of different versions, and version time stamps corresponding to the reference service data are smaller than version time stamps corresponding to the plurality of test service data;
The test server extracts a reference page identifier from the reference service data, and takes the test service data with the reference page identifier as standard service data;
and the test server extracts test service data which does not belong to the reference service data from the standard service data as missing service data and outputs the missing service data.
10. A method of testing data processing comprising:
the method comprises the steps that a target server receives application behavior data sent by a target client, analyzes and fills the application behavior data, and obtains target report data; the target reported data refers to data which is not put in storage in the target server;
the target server extracts test report data for testing from the target report data;
the target server sends the test report data to a test server so that the test server outputs abnormal service data and normal service data in the test report data; the abnormal service data and the normal service data are determined by the test server after performing abnormality detection processing on a plurality of test service data in the test report data.
11. The method of claim 10, wherein the target reporting data comprises at least one unit reporting data;
the target server extracts test report data for testing from the target report data, and the method comprises the following steps:
the target server obtains a network address of the target server as a test network address;
if the test network address exists in the intranet address list, the target server determines the at least one unit of reported data as the test reported data;
and if the test network address does not exist in the intranet address list, the target server extracts target user identifiers from the at least one unit report data respectively, and determines the unit report data corresponding to the target user identifiers existing in the test user identifier list as the test report data.
12. The method of claim 10, wherein the target server comprises a generic gateway interface and a background send interface;
the target server sends the test report data to a test server, and the method comprises the following steps:
when the test report data belong to a first sending type, the universal gateway interface in the target server sends the test report data to the test server; the first transmission type refers to a transmission type transmitted from the universal gateway interface to a data warehouse in the target server;
When the test report data belongs to a second transmission type, the universal gateway interface and the background transmission interface in the target server transmit the test report data to the test server; the second transmission type refers to a transmission type transmitted from the generic gateway interface and the background transmission interface to the data repository.
13. A test data processing apparatus, comprising:
the first receiving module is used for receiving test report data sent by the target server; the test report data is report data for testing in the target report data; the target reported data refers to data which is not put in storage in the target server; the target report data is generated by the target server according to the application behavior data sent by the target client; the test report data comprises a plurality of test service data;
the detection module is used for carrying out abnormal detection processing on the plurality of test service data to obtain abnormal service data and normal service data;
and the output module is used for outputting the abnormal service data and the normal service data.
14. The apparatus of claim 13, wherein the first receiving module comprises:
The receiving unit is used for receiving at least one piece of original test data sent by the target server and respectively converting the at least one piece of original test data into target test data in a target storage format according to a source system corresponding to the original test data;
the first extraction unit is used for extracting target test data meeting service configuration conditions from at least one target test data according to the data type and the service type of the target test data, and taking the target test data as the test report data;
and the reading unit is used for reading a plurality of test service data contained in the test report data and sequentially storing the plurality of test service data in a target database.
15. The apparatus as recited in claim 13, further comprising:
the combination module is used for extracting target fields contained in each test service data;
the first acquisition module is used for acquiring an input field and taking test service data corresponding to a target field which is the same as the input field in a plurality of target fields as display service data;
and the display module is used for displaying the display service data in the target visual interface.
16. The apparatus according to any one of claims 13-15, wherein the detection module comprises:
the extraction unit is used for extracting the same test service data from the plurality of test service data to serve as the abnormal service data;
and the first determining unit is used for taking the test service data except the abnormal service data in the plurality of test service data as the normal service data.
17. The apparatus according to any one of claims 13-15, wherein the detection module comprises:
the combination unit is used for extracting target path information contained in each test service data;
a second determining unit, configured to use, as the abnormal service data, test service data corresponding to target path information that does not satisfy a path rule among the plurality of target path information;
the second determining unit is further configured to use, as the normal service data, test service data corresponding to target path information that satisfies the path rule in the plurality of target path information.
18. The apparatus of any of claims 13-15, wherein the plurality of test traffic data is test data for a plurality of target pages having a hierarchical relationship;
The detection module comprises:
the statistics unit is used for counting the exposure of each target page according to the target page identification contained in each test service data, and sequencing the plurality of target pages according to the exposure to obtain a target page sequence;
the statistics unit is further used for obtaining standard page sequences of the target pages;
a third determining unit, configured to determine the plurality of test service data as the abnormal service data if the standard page sequence is different from the target page sequence;
the third determining unit is further configured to determine the plurality of test service data as the normal service data if the standard page sequence is the same as the target page sequence.
19. The apparatus of any of claims 13-15, wherein the plurality of test traffic data comprises first directional test data and second directional test data;
the detection module comprises:
the acquisition unit is used for acquiring first case parameters of the first test case and second case parameters of the second test case;
the dividing unit is used for dividing the plurality of test service data into first directional test data belonging to a first test case and second directional test data of a second test case according to the first case parameter and the second case parameter;
The dividing unit is further configured to determine a first target behavior sequence included in the first directional test data according to a data timestamp corresponding to the first directional test data, and determine a second target behavior sequence included in the second directional test data according to a data timestamp corresponding to the second directional test data;
the dividing unit is further used for obtaining a first standard behavior sequence corresponding to the first test case and obtaining a second standard behavior sequence corresponding to the second test case;
the identification unit is used for identifying abnormal service data and normal service data in the plurality of test service data according to the first target behavior sequence, the second target behavior sequence, the first standard behavior sequence and the second standard behavior sequence.
20. The apparatus of claim 19, wherein the identification unit comprises:
a first determining subunit, configured to determine the plurality of test service data as the abnormal service data if the first target behavior sequence is different from the first standard behavior sequence and the second target behavior sequence is different from the second standard behavior sequence;
The first determining subunit is further configured to determine the first directional test data as normal service data and determine the second directional test data as abnormal service data if the first target behavior sequence is the same as the first standard behavior sequence and the second target behavior sequence is different from the second standard behavior sequence;
the second determining subunit is configured to determine the first directional test data as abnormal service data and determine the first directional test data as normal service data if the first target behavior sequence is different from the first standard behavior sequence and the second target behavior sequence is the same as the second standard behavior sequence;
the second determining subunit is further configured to determine the plurality of test service data as the normal service data if the first target behavior sequence is the same as the first standard behavior sequence and the second target behavior sequence is the same as the second standard behavior sequence.
21. The apparatus according to any one of claims 13-15, further comprising:
the second acquisition module is used for acquiring the reference service data; the reference service data and the plurality of test service data are test data generated by the target client executing the system test cases of different versions, and version time stamps corresponding to the reference service data are smaller than version time stamps corresponding to the plurality of test service data;
The determining module is used for extracting a reference page identifier from the reference service data and taking the test service data with the reference page identifier as standard service data;
the determining module is further configured to extract test service data that does not belong to the reference service data from the standard service data, as missing service data, and output the missing service data.
22. A test data processing apparatus for use with a target server, comprising:
the second receiving module is used for receiving the application behavior data sent by the target client, analyzing and filling the application behavior data, and obtaining target reporting data; the target reported data refers to data which is not put in storage in the target server;
the second extraction module is used for extracting test report data for testing from the target report data;
the sending module is used for sending the test report data to a test server so that the test server outputs abnormal service data and normal service data in the test report data; the abnormal service data and the normal service data are determined by the test server after performing abnormality detection processing on a plurality of test service data in the test report data.
23. The apparatus of claim 22, wherein the target reporting data comprises at least one unit reporting data;
the second extraction module comprises:
the address determining unit is used for acquiring the network address of the target server and taking the network address as a test network address;
the data determining unit is used for determining the at least one unit of reported data as the test reported data if the test network address exists in an intranet address list;
and the data determining unit is further configured to extract target user identifiers from the at least one unit reporting data if the test network address does not exist in the intranet address list, and determine unit reporting data corresponding to the target user identifiers existing in the test user identifier list as the test reporting data.
24. The apparatus of claim 22, wherein the target server comprises a generic gateway interface and a background send interface;
when the test report data belong to a first sending type, sending the test report data to the test server through the universal gateway interface; the first transmission type refers to a transmission type transmitted from the universal gateway interface to a data warehouse in the target server;
When the test report data belongs to a second transmission type, the test report data is transmitted to the test server through the universal gateway interface and the background transmission interface; the second transmission type refers to a transmission type transmitted from the generic gateway interface and the background transmission interface to the data repository.
25. An electronic device, comprising: a processor and a memory;
the processor being connected to a memory, wherein the memory is adapted to store program code, the processor being adapted to invoke the program code to perform the method according to any of claims 1-12.
26. A computer storage medium, characterized in that the computer storage medium stores a computer program comprising program instructions which, when executed by a processor, perform the method of any of claims 1-12.
CN201910355835.1A 2019-04-29 2019-04-29 Test data processing method and device and related equipment Active CN110069416B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910355835.1A CN110069416B (en) 2019-04-29 2019-04-29 Test data processing method and device and related equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910355835.1A CN110069416B (en) 2019-04-29 2019-04-29 Test data processing method and device and related equipment

Publications (2)

Publication Number Publication Date
CN110069416A CN110069416A (en) 2019-07-30
CN110069416B true CN110069416B (en) 2023-05-16

Family

ID=67369502

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910355835.1A Active CN110069416B (en) 2019-04-29 2019-04-29 Test data processing method and device and related equipment

Country Status (1)

Country Link
CN (1) CN110069416B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106940679A (en) * 2017-02-23 2017-07-11 中科创达软件股份有限公司 Data processing method and device
WO2018000607A1 (en) * 2016-06-30 2018-01-04 乐视控股(北京)有限公司 Method and electronic apparatus for identifying test case failure causes
CN108737333A (en) * 2017-04-17 2018-11-02 腾讯科技(深圳)有限公司 A kind of data detection method and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018000607A1 (en) * 2016-06-30 2018-01-04 乐视控股(北京)有限公司 Method and electronic apparatus for identifying test case failure causes
CN106940679A (en) * 2017-02-23 2017-07-11 中科创达软件股份有限公司 Data processing method and device
CN108737333A (en) * 2017-04-17 2018-11-02 腾讯科技(深圳)有限公司 A kind of data detection method and device

Also Published As

Publication number Publication date
CN110069416A (en) 2019-07-30

Similar Documents

Publication Publication Date Title
CN107908541B (en) Interface testing method and device, computer equipment and storage medium
CN107783899B (en) Method and device for testing H5 page in application program and computer equipment
CN105553769B (en) A kind of data acquisition and analysis system and method
CN110414242A (en) For detecting the method, apparatus, equipment and medium of service logic loophole
US8335845B2 (en) Web application management method and web system
CN107085549B (en) Method and device for generating fault information
CN105022694A (en) Test case generation method and system for mobile terminal test
CN111309505A (en) Page exception handling method and device and electronic equipment
CN110261554A (en) A kind of food safety detection system and method
JP6052832B2 (en) Method and apparatus for efficiently executing modules
CN117499287A (en) Web testing method, device, storage medium and proxy server
CN113360413A (en) Code testing method and device
CN110069416B (en) Test data processing method and device and related equipment
CN116610967A (en) Bank system abnormality detection method, device and equipment based on clustering
CN110505177B (en) Information collection system, terminal equipment and remote host
CN111352821A (en) Service testing method, device, electronic equipment and computer readable storage medium
CN114996080A (en) Data processing method, device, equipment and storage medium
CN112364267B (en) Front-end data acquisition method and device
CN112559278B (en) Method and device for acquiring operation data
CN114285774A (en) Flow recording method and device, electronic equipment and storage medium
CN105827447A (en) Service alarm method and apparatus
CN112671615A (en) Method, system and storage medium for collecting operation behavior data of front-end user
CN105391602A (en) Data acquisition test method and device
CN112752165A (en) Subtitle processing method, subtitle processing device, server and computer-readable storage medium
CN113051176B (en) Automatic test data processing method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant