CN112783507B - Data stream guiding playback method and device, electronic equipment and readable storage medium - Google Patents
Data stream guiding playback method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN112783507B CN112783507B CN202110126137.1A CN202110126137A CN112783507B CN 112783507 B CN112783507 B CN 112783507B CN 202110126137 A CN202110126137 A CN 202110126137A CN 112783507 B CN112783507 B CN 112783507B
- Authority
- CN
- China
- Prior art keywords
- data
- interface request
- request data
- instruction information
- cleaning instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 238000004140 cleaning Methods 0.000 claims abstract description 159
- 238000012545 processing Methods 0.000 claims description 43
- 238000013473 artificial intelligence Methods 0.000 abstract description 8
- 238000012360 testing method Methods 0.000 description 11
- 238000004590 computer program Methods 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 10
- 239000000047 product Substances 0.000 description 9
- 238000004891 communication Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000004044 response Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 230000010076 replication Effects 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000010926 purge Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/40—Transformation of program code
- G06F8/41—Compilation
- G06F8/42—Syntactic analysis
- G06F8/427—Parsing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The disclosure discloses a data drainage playback method, a device, an electronic device and a readable storage medium, and relates to the field of artificial intelligence such as cloud computing and knowledge graph, wherein the method can comprise the following steps: acquiring original data to be processed, wherein the original data comprises N pieces of interface request data, and N is a positive integer greater than one; analyzing the association relation between the interface request data to obtain cleaning instruction information; and carrying out drainage playback according to the original data and the cleaning instruction information. By applying the scheme disclosed by the disclosure, the success rate of the playback result can be improved.
Description
Technical Field
The disclosure relates to the technical field of artificial intelligence, in particular to a data drainage playback method, a device, electronic equipment and a readable storage medium in the fields of cloud computing, knowledge graph and the like.
Background
With the high-speed development of cloud services, the capability of cloud computing is continuously perfected, the product architecture of cloud manufacturers is increasingly huge, intricate and complex dependency relations exist among service products, meanwhile, the cloud manufacturers generally promise higher reliability guarantee, and the drainage playback test can well solve the problem of user scene coverage, so that the method has important significance for guaranteeing the quality of cloud products.
At present, the main stream drainage playback modes in the industry comprise a request reconstruction and playback mode based on logs, a network traffic replication and playback mode based on traffic replication (TcpCopy) and the like, and the modes all have a general problem that automatic data cleaning is not supported, so that the problems of low success rate of playback results and the like are caused.
Disclosure of Invention
The disclosure provides a data stream playback method, a data stream playback device, an electronic device and a readable storage medium.
A data stream playback method comprising:
acquiring original data to be processed, wherein the original data comprises N pieces of interface request data, and N is a positive integer greater than one;
analyzing the association relation between the interface request data to obtain cleaning instruction information;
and carrying out drainage playback according to the original data and the cleaning instruction information.
A data stream playback device comprising: the device comprises a data acquisition module, an instruction acquisition module and a playback module;
the data acquisition module is used for acquiring original data to be processed, wherein the original data comprises N pieces of interface request data, and N is a positive integer greater than one;
the instruction acquisition module is used for analyzing the association relation between the interface request data to obtain cleaning instruction information;
And the playback module is used for conducting drainage playback according to the original data and the cleaning instruction information.
An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method as described above.
A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform a method as described above.
A computer program product comprising a computer program which, when executed by a processor, implements a method as described above.
One embodiment of the above disclosure has the following advantages or benefits: the association relation between the interface request data in the original data can be analyzed to obtain the cleaning instruction information, and further drainage playback can be performed according to the original data and the cleaning instruction information, so that automatic data cleaning can be realized by utilizing the cleaning instruction information, and further the success rate of playback results and the like are improved.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.
Drawings
The drawings are for a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
FIG. 1 is a flow chart of an embodiment of a data stream playback method according to the present disclosure;
fig. 2 is a schematic diagram of an overall implementation process of the data stream playback method according to the present disclosure;
fig. 3 is a schematic structural diagram of an embodiment 300 of a data stream playback device according to the present disclosure;
fig. 4 illustrates a schematic block diagram of an example electronic device 400 that may be used to implement embodiments of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
In addition, it should be understood that the term "and/or" herein is merely one association relationship describing the associated object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.
Fig. 1 is a flowchart of an embodiment of a data stream playback method according to the present disclosure. As shown in fig. 1, the following detailed implementation is included.
In step 101, raw data to be processed is obtained, where the raw data includes N pieces of interface request data, where N is a positive integer greater than one.
In step 102, the association relationship between the interface request data is analyzed to obtain the cleaning instruction information.
In step 103, stream playback is performed according to the original data and the purge instruction information.
According to the scheme of the method embodiment, the association relation between the interface request data in the original data can be analyzed to obtain the cleaning instruction information, and further drainage playback can be performed according to the original data and the cleaning instruction information, so that automatic data cleaning can be realized by utilizing the cleaning instruction information, and further the success rate of playback results and the like are improved.
A series of interface request calls can be generated in the process of carrying out integrated test on the system, and a large amount of interface request data with association relation is generated.
Accordingly, the original data may be obtained, where the original data may include N pieces of interface request data, where N is a positive integer greater than one. Each interface request data may include request and response data, which may also be referred to as return data or return results, etc. The interface request data may be stored in a JS Object Notation (JSON, javaScript Object notification) format, as shown in table one, JS is an abbreviation for JavaScript, a programming language.
Table-one interface request data storage format
Corresponding request identifiers, i.e., requestids, may be set for each interface request data, for example, for N pieces of interface request data, the interface request data may be numbered in the order of 1-N according to the order of the acquisition time from first to last. The first table is a storage format of interface request data with the number of 1 and an included data content example.
And the key for realizing automatic data cleaning is to acquire cleaning instruction information of the data. For services with complex interface logic and dependency, the parameters used in the next request are likely to be a certain field in the returned data of the previous request, and the association relationship between the requests must be represented in terms of parameters.
For the N pieces of interface request data in the present disclosure, the association relationship may include an association relationship between interface request data in the same service, and accordingly, the association relationship between interface request data in the same service may be analyzed based on an inverted index algorithm, so as to obtain cleaning instruction information.
The inverted index is a storage way of word-document evidence, and documents containing the word can be quickly searched according to the word through the inverted index. In the present disclosure, an inverted index algorithm is applied to the problem of association between processing requests, and an inverted index is established for a predetermined parameter in interface request data, i.e. an inverted index of different parameters in the request is established. The predetermined parameters include in particular which parameters may be according to the actual need. For example, an inverted index of parameters of the request path (uri), request uri parameters, request header, response body, etc. may be established, where the request uri parameters may refer to "parameters" after "method" shown in table one.
The following description will take the case of creating the request uri and the inverted index of the request uri parameter as an example.
1) Establishing an inverted index of a request uri
The first "≡character and the last" $ "character of the uri regular expression can be removed according to the uri value, then the segmentation is carried out according to the"/"character, the actual uri element value in the segmentation result is taken, if not, an empty json list is returned, otherwise, the inverted index result of the uri element value is returned.
The reverse index of the request uri is established in the above manner, and the result example and format can be shown in table two.
Inverted index of Table II request uri
As shown in Table two, where location specifies the location of the action value, here "uri"; value is the position in uri that is replaced, for example, if uri value is/v 1/functions/replayest/aliases, it is the array after dividing by "/": [ ", 'v1', 'functions', 'replayest', 'aliases', 'in' the array of segmented results the order of the 'replayest' fields is 3, so the value of value is 3.
2) Establishing inverted index of request uri parameter
Assuming that the request uri parameter is "locale=zh-cn & pageno=1 & pagesize=10", then parse into json format:
the corresponding inverted index is:
as described above, the association relationship between the interface request data in the same service can be analyzed based on the inverted index algorithm, so as to obtain the cleaning instruction information.
Specifically, for the original data, a unique identifier may be generated, for example, a unique identifier may be generated by using a universal unique identifier (UUID, universally Unique Identifier), and may be stored in a clean_id field.
The method can be used for applying a json memory in the memory by taking the clean_id as a key, and is used for storing the inverted index set file, if the data volume is large, the data volume can be transferred from the memory to a database (MongoDB) based on distributed file storage for storage, and can be used for applying a json memory in the memory additionally by taking the clean_id as a key, and is used for storing the cleaning instruction set file and marked by all_rule.
On the basis, the N pieces of interface request data can be analyzed and searched in sequence according to the sequence of the acquisition time from first to last, and the following first processing can be executed aiming at the first searched piece of interface request data meeting the preset requirements: adding inverted index data corresponding to the first interface request data meeting the preset requirements into an inverted index set file, acquiring cleaning instruction information corresponding to the first interface request data meeting the preset requirements, and adding the cleaning instruction information into the cleaning instruction set file; the inverted index set file and the cleaning instruction set file are both initially empty.
Taking the next piece of interface request data as current data, wherein the next piece of interface request data is the interface request data which is acquired first in unprocessed interface request data, and executing the following second processing: if it is determined that the association relationship exists between the current data and the interface request data acquired before according to the inverted index set file and the inverted index data corresponding to the current data, the current data is used as the data to be processed, and the following third processing is executed: acquiring cleaning instruction information corresponding to the data to be processed, adding the cleaning instruction information into a cleaning instruction set file, and adding inverted index data corresponding to the data to be processed into an inverted index set file when the data to be processed meets the preset requirement; otherwise, taking the next piece of interface request data as current data, and repeatedly executing the second processing; and when the interface request data are processed, taking the cleaning instruction information in the cleaning instruction set file as the obtained cleaning instruction information.
In addition, if it is determined that there is no association between the current data and the interface request data acquired before, but it is determined that the current data meets the predetermined requirement, the inverted index data corresponding to the current data may be added to the inverted index set file, and the cleaning instruction information corresponding to the current data may be acquired and added to the cleaning instruction set file.
For any interface requesting data, meeting the predetermined requirements may include: the request method of the interface to request data is update (PUT) or creation (POST).
The request method of the interface request data may include PUT, POST, search (GET), DELETE (DELETE), etc., where the scenario of the association relationship between the requests is usually found in PUT and POST methods, for example, after the last interface creates a resource, the resource id is returned to the subsequent interface for calling.
For any interface request data, before adding the inverted index data corresponding to the interface request data into the inverted index set file, the inverted index data corresponding to the interface request data can be subjected to de-duplication processing.
In addition, for any interface request data, the method for obtaining the cleaning instruction information corresponding to the interface request data and adding the cleaning instruction information to the cleaning instruction set file may include: if the instruction information corresponding to the interface request data exists in the information engine, updated instruction information can be generated according to the corresponding instruction information and the interface request data, the updated instruction information can be added into the cleaning instruction set file, otherwise, the instruction information can be set for the interface request data, and the set instruction information can be respectively added into the cleaning instruction set file and the information engine. How to set instruction information for the interface request data is the prior art.
Further, when determining that the instruction information corresponding to the interface request data exists in the information engine, if determining that the reliability of the corresponding instruction information is greater than a predetermined threshold, generating updated instruction information according to the corresponding instruction information and the interface request data, and adding the updated instruction information into the cleaning instruction set file, otherwise, setting instruction information for the interface request data, and adding the set instruction information into the cleaning instruction set file and the information engine respectively.
Further, the relative delay instruction information corresponding to the interface request data can be obtained and added into the cleaning instruction set file. When the interface request data is the first interface request data meeting the preset requirements, the relative delay instruction information corresponding to the interface request data can be set to be 0, and when the interface request data is the data to be processed or the current data, the difference between the starting time of the interface request data and the starting time of the first interface request data meeting the preset requirements can be obtained, and the difference is used as the relative delay instruction information corresponding to the interface request data.
The manner in which the data is processed for each interface request is further described below in connection with specific examples.
1) Initial interface request data
Assuming that N pieces of interface request data are numbered as interface request data 1-interface request data N in order of acquisition time from first to last, it may be determined first whether a request method of interface request data 1 is PUT or POST, if yes, the first processing may be performed for interface request data 1, if not, it may be determined whether a request method of interface request data 2 is PUT or POST, if yes, the first processing may be performed for interface request data 2, otherwise, it may be determined whether a request method of interface request data 3 is PUT or POST, and so on. The interface request data that performs the first process may be considered as "initial interface request data".
Assuming that the request method of the interface request data 1 is POST, the first processing can be executed for the interface request data 1, that is, the inverted index data corresponding to the interface request data 1 can be added into the inverted index set file, and the cleaning instruction information corresponding to the interface request data 1 can be obtained and added into the cleaning instruction set file.
Before adding the inverted index data corresponding to the interface request data 1 into the inverted index set file, the inverted index data corresponding to the interface request data 1 may be subjected to deduplication. For example, in the inverted index data corresponding to the interface request data 1, if the inverted index of the same data exists in the request and the response at the same time, the inverted index of the request parameter may be reserved, and the inverted index of the response parameter may be removed. For example, there is an inverted index with a value of replay test (replayest) in the request body, and there is an inverted index with a value of replayest in the response body, so that only the inverted index with a value of replayest in the request body can be added, thereby saving storage resources, reducing workload of subsequent processing, improving processing efficiency and the like.
For the interface request data 1, it may also be determined whether the instruction information corresponding to the interface request data 1 exists in the information engine, where the instruction information is usually referred to as replacement instruction information, if yes, the instruction information may be taken out, updated instruction information may be generated according to the instruction information and the interface request data 1, and the updated instruction information may be added to the cleaning instruction set file, otherwise, the instruction information may be set for the interface request data 1, and the set instruction information may be respectively added to the cleaning instruction set file and the information engine.
For example, the information engine has recorded a certain interface and has set 1 piece of replacement instruction information, as follows:
the value of target can be fetched from the interface request data 1 by a field location, value or the like in the instruction information and constructed as updated instruction information.
In addition, when determining that the instruction information corresponding to the interface request data 1 exists in the information engine, it may be further determined whether the reliability of the corresponding instruction information is greater than a predetermined threshold, a specific value of the predetermined threshold may be determined according to actual needs, if yes, updated instruction information may be generated according to the corresponding instruction information and the interface request data 1, and the updated instruction information may be added to the cleaning instruction set file, otherwise, the instruction information may be set for the interface request data 1, and the set instruction information may be respectively added to the cleaning instruction set file and the information engine.
When any instruction information is added into the information engine, an initial credibility can be set for the instruction information, and the credibility of the instruction information can be flexibly adjusted according to actual use conditions as the instruction information is continuously used. For example, since playback failure is caused by the instruction information error, the credibility of the instruction information may be lowered.
Through the processing, the accuracy of the used instruction information is ensured, and the accuracy of the subsequent processing results and the like are further improved.
In addition, the relative delay instruction information corresponding to the interface request data 1 can be obtained and added into the cleaning instruction set file. Specifically, the relative delay instruction information corresponding to the interface request data 1 may be set to 0, i.e., the "delay" field value may be set to 0.
Furthermore, the start time of the interface request data 1 may also be taken as the relative start point srcStartTime of the playback data.
In practical application, for the interface request data 1, a list corresponding to the interface request data 1 may be created in the cleaning instruction set file, and a corresponding key value may be added, so that cleaning instruction information corresponding to the interface request data 1 may be added to the corresponding list.
2) Processing subsequent interface request data in a circulating way
Assuming that the initial interface request data is interface request data 1, the subsequent processing may be performed for interface request data 2-interface request data N, respectively.
Firstly, for the interface request data 2, the interface request data can be used as current data, and whether an association relationship exists between the current data and the previously acquired interface request data or not can be determined according to the inverted index set file and the inverted index data corresponding to the current data, namely, whether the association relationship exists between the interface request data 2 and the interface request data 1 or not is determined.
How to determine whether there is an association relationship between the current data and the interface request data acquired before according to the inverted index set file and the inverted index data corresponding to the current data is not limited. For example, the inverted index of each parameter corresponding to the current data may be sequentially searched in the inverted index set file, if the index is hit, it indicates that there is a possible association relationship with the previous interface request data, and in order to further determine, whether there is an association relationship may be further determined according to a certain manner, for example, if the key corresponding value of the last stage of location is the same, it may be considered that there is an associated parameter, and it may be considered that there is an association relationship between the current data and the previously acquired interface request data.
Assuming that the association relationship exists between the current data and the interface request data acquired before, the current data can be used as the data to be processed, cleaning instruction information corresponding to the data to be processed can be acquired and added into a cleaning instruction set file, and further, when the data to be processed is determined to meet the preset requirement, inverted index data corresponding to the data to be processed can be added into an inverted index set file.
For the data to be processed, whether instruction information corresponding to the data to be processed exists in the information engine can be determined, if so, the instruction information can be taken out, updated instruction information can be generated according to the instruction information and the data to be processed, the updated instruction information is added into the cleaning instruction set file, otherwise, the instruction information can be set for the data to be processed, and the set instruction information can be respectively added into the cleaning instruction set file and the information engine.
When determining that the instruction information corresponding to the data to be processed exists in the information engine, determining whether the credibility of the corresponding instruction information is larger than a preset threshold value, if so, generating updated instruction information according to the corresponding instruction information and the data to be processed, adding the updated instruction information into a cleaning instruction set file, otherwise, setting the instruction information for the data to be processed, and adding the set instruction information into the cleaning instruction set file and the information engine respectively.
In addition, the relative delay instruction information corresponding to the data to be processed can be obtained and added into the cleaning instruction set file. Specifically, a difference between the start time of the data to be processed and the start time of the interface request data 1, namely, srcStartTime, may be obtained, and the difference is used as the relative delay instruction information corresponding to the data to be processed.
In practical application, for the data to be processed, a list corresponding to the data to be processed can be created in the cleaning instruction set file, and a corresponding key value is added, so that cleaning instruction information corresponding to the data to be processed can be added into the corresponding list.
If the request method of the data to be processed is PUT or POST, the inverted index data corresponding to the data to be processed can be added into the inverted index set file, and before adding, the inverted index data corresponding to the data to be processed can be subjected to duplication removal processing, and the specific duplication removal mode can refer to the duplication removal mode of the interface request data 1.
When the inverted index data corresponding to the data to be processed is added into the inverted index set file, the inverted index data corresponding to the data to be processed can be fused with the existing data in the inverted index set file. For example, if there is an inverted index of a certain data, the inverted index corresponding to the data is in a list form, and the inverted index corresponding to the data to be processed may be added to the end.
Taking the example that the current data, i.e. the interface request data 2, has an association relationship with the interface request data acquired before, if it is determined that the current data does not have an association relationship with the interface request data acquired before according to the inverted index data, whether the current data meets the predetermined requirement can be further determined, if yes, the inverted index data corresponding to the current data can be added into the inverted index set file, the cleaning instruction information corresponding to the current data can be acquired, and the cleaning instruction set file can be added.
Assuming that the request method of the current data, i.e. the interface request data 2, is PUT or POST, the inverted index data corresponding to the current data may be added to the inverted index set file, and before adding, the inverted index data corresponding to the current data may be subjected to deduplication.
For the current data, whether instruction information corresponding to the current data exists in the information engine can be determined, if so, the instruction information can be taken out, updated instruction information can be generated according to the instruction information and the current data, the updated instruction information is added into the cleaning instruction set file, otherwise, the instruction information can be set for the current data, and the set instruction information can be respectively added into the cleaning instruction set file and the information engine.
In addition, when determining that the instruction information corresponding to the current data exists in the information engine, determining whether the credibility of the corresponding instruction information is larger than a preset threshold, if so, generating updated instruction information according to the corresponding instruction information and the current data, adding the updated instruction information into the cleaning instruction set file, otherwise, setting the instruction information according to the current data, and adding the set instruction information into the cleaning instruction set file and the information engine respectively.
And the relative delay instruction information corresponding to the current data can be obtained and added into the cleaning instruction set file. Specifically, a difference between the start time of the current data and the start time of the interface request data 1, namely, srcStartTime, may be obtained, and the difference is used as the relative delay instruction information corresponding to the current data.
In practical application, for the current data, a list corresponding to the current data can be created in the cleaning instruction set file and a corresponding key value can be added, so that cleaning instruction information corresponding to the current data can be added into the corresponding list.
Assuming that there is no association between the current data, i.e. the interface request data 2, and the interface request data acquired before, and the request method of the current data is not PUT or POST, then the next piece of interface request data can be continuously processed. I.e. for interface request data 3, may be processed in the manner of interface request data 2.
After all the N pieces of interface request data are processed, the cleaning instruction information in the cleaning instruction set file can be used as the obtained cleaning instruction information.
It can be seen that, after the processing mode is adopted, only the inverted index data corresponding to the interface request data meeting the requirements (such as the interface request data with the association relation or the request method of PUT or POST) is added into the inverted index set file, so that storage resources are saved, invalid instruction information is reduced, the workload of subsequent processing is reduced, and the like.
The method mainly analyzes the association relation between the interface request data in the same service and obtains the corresponding cleaning instruction information.
In practical applications, the association relationship may further include: interfaces between different services request the association relationship between data. For example, the N pieces of interface request data may correspond to at least two different services.
Correspondingly, the association relation between the interface request data among different services can be obtained according to the constructed knowledge graph, and the corresponding cleaning instruction information can be obtained.
For example, when any interface request data is processed in the above manner, whether the interface request data has external dependency can be determined by querying the knowledge graph, and if the external dependency exists, instruction information corresponding to the external dependency can be added into the cleaning instruction set file. How the instruction information is generated is not limited, and may be, for example, manually generated or automatically generated, etc.
The knowledge graph can be pre-constructed, such as by processing interface documents of cloud products, extracting dependency relationships among cloud product resources, and constructing a knowledge graph relationship graph, which can include forward dependency relationships and reverse dependency relationships among cloud products. How to construct the knowledge graph is not limited, for example, a manual construction mode can be adopted. The knowledge graph may provide an interface to the outside in order to obtain the required information, etc., by calling the interface. When some information needed by the knowledge graph is deleted, the improvement/supplement and the like can be performed manually.
Through the processing, the obtained cleaning instruction information is further perfected, so that the obtained cleaning instruction information is more comprehensive and accurate, and the like.
And then, the drainage playback can be performed according to the original data and the cleaning instruction information, such as completing request playback and result verification, so as to complete the drainage playback test, and the specific implementation is not limited, and the existing mode can be adopted. And after the test is completed, cleaning the cleaning instruction set files and the inverted index set files in the memory and the MongoDB.
The method can utilize the cleaning instruction information to realize automatic data cleaning, thereby improving the success rate of playback results, effectively guaranteeing the quality of service test with complex dependence relationship between services, having no requirement on the technical architecture of cloud products, having wide applicability, being capable of realizing integrated test with low cost in test scenes with long request link and involving multiple interface calls, improving the test efficiency, supporting universal drainage, data cleaning and playback test, realizing the coverage of real user scenes, improving the test coverage rate and the like.
In view of the foregoing description, fig. 2 is a schematic diagram of an overall implementation process of the data stream playback method according to the present disclosure, and the detailed implementation is referred to the foregoing related description and will not be repeated.
It should be noted that, for the sake of simplicity of description, the foregoing method embodiments are expressed as a series of combinations of actions, but it should be understood by those skilled in the art that the present disclosure is not limited by the order of actions described, as some steps may be performed in other order or simultaneously in accordance with the present disclosure. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all of the preferred embodiments, and that the acts and modules referred to are not necessarily required by the present disclosure.
The foregoing is a description of embodiments of the method, and the following further describes embodiments of the present disclosure through examples of apparatus.
Fig. 3 is a schematic diagram of a composition structure of an embodiment 300 of the data stream playback device according to the present disclosure. As shown in fig. 3, includes: a data acquisition module 310, an instruction acquisition module 302, and a playback module 303.
The data obtaining module 301 is configured to obtain raw data to be processed, where the raw data includes N pieces of interface request data, and N is a positive integer greater than one.
The instruction acquisition module 302 is configured to analyze an association relationship between the interface request data, and obtain cleaning instruction information.
And the playback module 303 is used for conducting drainage playback according to the original data and the cleaning instruction information.
Wherein, the association relationship may include: the interfaces within the same service request the association between data. The instruction acquisition module 302 may analyze the association relationship between the interface request data in the same service based on the inverted index algorithm to obtain the cleaning instruction information.
Specifically, the instruction acquiring module 302 may sequentially analyze and find N pieces of interface request data according to the order of the acquiring time from first to last, and execute the following first processing for the first found piece of interface request data meeting the predetermined requirement: adding inverted index data corresponding to the first interface request data meeting the preset requirements into an inverted index set file, acquiring cleaning instruction information corresponding to the first interface request data meeting the preset requirements, and adding the cleaning instruction information into the cleaning instruction set file; the inverted index set file and the cleaning instruction set file are both initially empty; taking the next piece of interface request data as current data, wherein the next piece of interface request data is the interface request data which is acquired first in unprocessed interface request data, and executing the following second processing: if it is determined that the association relationship exists between the current data and the interface request data acquired before according to the inverted index set file and the inverted index data corresponding to the current data, the current data is used as the data to be processed, and the following third processing is executed: acquiring cleaning instruction information corresponding to the data to be processed, adding the cleaning instruction information into a cleaning instruction set file, and adding inverted index data corresponding to the data to be processed into an inverted index set file when the data to be processed meets preset requirements; otherwise, taking the next piece of interface request data as current data, and repeatedly executing second processing; and when all the interface request data are processed, taking the cleaning instruction information in the cleaning instruction set file as the obtained cleaning instruction information.
If it is determined that there is no association between the current data and the interface request data acquired previously, but it is determined that the current data meets the predetermined requirement, the instruction acquisition module 302 may further add the inverted index data corresponding to the current data to the inverted index set file, acquire the cleaning instruction information corresponding to the current data, and add the cleaning instruction information to the cleaning instruction set file.
For any interface requesting data, meeting the predetermined requirements may include: the request method of the interface request data is PUT or POST.
For any interface request data, the inverted index data corresponding to the interface request data may include: an inverted index is established for a predetermined parameter in the interface request data.
For any interface request data, the instruction obtaining module 302 may further perform deduplication processing on the inverted index data corresponding to the interface request data before adding the inverted index data corresponding to the interface request data to the inverted index set file.
In addition, for any interface request data, if it is determined that the instruction information corresponding to the interface request data exists in the information engine, the instruction acquisition module 302 may generate updated instruction information according to the corresponding instruction information and the interface request data, and may add the updated instruction information to the cleaning instruction set file, or else, may set instruction information for the interface request data, and may add the set instruction information to the cleaning instruction set file and the information engine, respectively.
In addition, when determining that the instruction information corresponding to the interface request data exists in the information engine, the instruction acquisition module 302 may generate updated instruction information according to the corresponding instruction information and the interface request data if determining that the reliability of the corresponding instruction information is greater than a predetermined threshold, and may add the updated instruction information to the cleaning instruction set file, or may set instruction information for the interface request data, and may add the set instruction information to the cleaning instruction set file and the information engine, respectively.
The instruction acquisition module 302 may also acquire the relative delay instruction information corresponding to the interface request data, and add the relative delay instruction information to the cleaning instruction set file. When the interface request data is the first interface request data meeting the preset requirements, the relative delay instruction information corresponding to the interface request data can be set to be 0, and when the interface request data is the data to be processed or the current data, the difference between the starting time of the interface request data and the starting time of the first interface request data meeting the preset requirements can be obtained, and the difference is used as the relative delay instruction information corresponding to the interface request data.
The association relationship may further include: interfaces between different services request the association relationship between data. Accordingly, the instruction obtaining module 302 may obtain the association relationship between the interface request data between different services according to the constructed knowledge graph, and obtain the corresponding cleaning instruction information.
The specific workflow of the embodiment of the apparatus shown in fig. 3 is referred to the related description in the foregoing method embodiment, and will not be repeated.
In a word, by adopting the scheme of the embodiment of the disclosure, the association relation between the interface request data in the original data can be analyzed to obtain the cleaning instruction information, and then drainage playback can be performed according to the original data and the cleaning instruction information, so that the automatic data cleaning can be realized by using the cleaning instruction information, and further the success rate of playback results and the like are improved.
The scheme disclosed by the disclosure can be applied to the field of artificial intelligence, and particularly relates to the fields of cloud computing, knowledge graph and the like. Artificial intelligence is the subject of studying certain thinking processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.) that make a computer simulate a person, and has technology at both hardware and software levels, and artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing, etc., and artificial intelligence software technologies mainly include computer vision technologies, speech recognition technologies, natural language processing technologies, machine learning/deep learning, big data processing technologies, knowledge graph technologies, etc.
According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.
Fig. 4 illustrates a schematic block diagram of an example electronic device 400 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile apparatuses, such as personal digital assistants, cellular telephones, smartphones, wearable devices, and other similar computing apparatuses. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 4, the apparatus 400 includes a computing unit 401 that can perform various suitable actions and processes according to a computer program stored in a Read Only Memory (ROM) 402 or a computer program loaded from a storage unit 408 into a Random Access Memory (RAM) 403. In RAM 403, various programs and data required for the operation of device 400 may also be stored. The computing unit 401, ROM 402, and RAM 403 are connected to each other by a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.
Various components in device 400 are connected to I/O interface 405, including: an input unit 406 such as a keyboard, a mouse, etc.; an output unit 407 such as various types of displays, speakers, and the like; a storage unit 408, such as a magnetic disk, optical disk, etc.; and a communication unit 409 such as a network card, modem, wireless communication transceiver, etc. The communication unit 409 allows the device 400 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The computing unit 401 may be a variety of general purpose and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 401 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 401 performs the various methods and processes described above, such as the methods described in this disclosure. For example, in some embodiments, the methods described in the present disclosure may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as the storage unit 408. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 400 via the ROM 402 and/or the communication unit 409. One or more steps of the methods described in this disclosure may be performed when the computer program is loaded into RAM 403 and executed by computing unit 401. Alternatively, in other embodiments, the computing unit 401 may be configured to perform the methods described in the present disclosure by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of large management difficulty and weak service expansibility in the traditional physical hosts and Virtual Private Servers (VPSs). The server may also be a server of a distributed system or a server that incorporates a blockchain.
Cloud computing refers to a technology system which is used for accessing an elastically extensible shared physical or virtual resource pool through a network, resources can comprise a server, an operating system, a network, software, application, storage equipment and the like, and can be deployed and managed in an on-demand and self-service mode, and by means of cloud computing technology, high-efficiency and powerful data processing capacity can be provided for technical application and model training of artificial intelligence, blockchain and the like.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel or sequentially or in a different order, provided that the desired results of the technical solutions of the present disclosure are achieved, and are not limited herein.
The above detailed description should not be taken as limiting the scope of the present disclosure. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present disclosure are intended to be included within the scope of the present disclosure.
Claims (16)
1. A data stream playback method comprising:
acquiring original data to be processed, wherein the original data comprises N pieces of interface request data, and N is a positive integer greater than one;
analyzing the association relation between the interface request data to obtain cleaning instruction information;
performing drainage playback according to the original data and the cleaning instruction information;
wherein, the association relation includes: the association relation between the interface request data in the same service;
the analyzing the association relation between the interface request data to obtain the cleaning instruction information comprises the following steps: according to the sequence of the acquisition time from first to last, analyzing and searching the N pieces of interface request data in sequence, and aiming at the first searched piece of interface request data meeting the preset requirement, executing the following first processing: adding inverted index data corresponding to the first interface request data meeting the preset requirements into an inverted index set file, acquiring cleaning instruction information corresponding to the first interface request data meeting the preset requirements, and adding the cleaning instruction information into a cleaning instruction set file; the inverted index set file and the cleaning instruction set file are both initially empty;
taking the next piece of interface request data as current data, wherein the next piece of interface request data is the interface request data which is acquired first in unprocessed interface request data, and executing the following second processing: if it is determined that an association relationship exists between the current data and the interface request data acquired before according to the inverted index set file and the inverted index data corresponding to the current data, the current data is used as data to be processed, and the following third processing is executed: acquiring cleaning instruction information corresponding to the data to be processed, adding the cleaning instruction information into the cleaning instruction set file, and adding inverted index data corresponding to the data to be processed into the inverted index set file when the data to be processed meets the preset requirement; otherwise, taking the next piece of interface request data as the current data, and repeatedly executing the second processing; when all interface request data are processed, taking the cleaning instruction information in the cleaning instruction set file as the obtained cleaning instruction information;
The association relationship further comprises: the interfaces between different services request the association relation between data;
the method further comprises the steps of: acquiring the association relation between the interface request data among different services according to the constructed knowledge graph, and acquiring the corresponding cleaning instruction information, wherein the method comprises the following steps: when any interface request data is processed, responding to the fact that external dependence exists in the interface request data through inquiring the knowledge graph, and adding instruction information corresponding to the external dependence into the cleaning instruction set file.
2. The method of claim 1, further comprising:
if it is determined that the association relationship does not exist between the current data and the interface request data acquired before, but it is determined that the current data meets the predetermined requirement, adding inverted index data corresponding to the current data into the inverted index set file, acquiring cleaning instruction information corresponding to the current data, and adding the cleaning instruction information into the cleaning instruction set file.
3. The method of claim 2, wherein,
for any interface, requesting data, the meeting of the predetermined requirements includes: the request method of the interface request data is to update PUT or create POST.
4. The method of claim 2, wherein,
for any interface request data, the inverted index data corresponding to the interface request data includes: an inverted index established for a predetermined parameter in the interface request data;
the method further comprises the steps of: and for any interface request data, before adding the inverted index data corresponding to the interface request data into the inverted index set file, performing de-duplication processing on the inverted index data corresponding to the interface request data.
5. The method of claim 2, wherein,
for any interface request data, acquiring cleaning instruction information corresponding to the interface request data, and adding the cleaning instruction information into the cleaning instruction set file comprises the following steps:
if the instruction information corresponding to the interface request data exists in the information engine, generating updated instruction information according to the corresponding instruction information and the interface request data, adding the updated instruction information into the cleaning instruction set file, otherwise, setting the instruction information for the interface request data, and adding the set instruction information into the cleaning instruction set file and the information engine respectively.
6. The method of claim 5, further comprising:
when determining that the instruction information corresponding to the interface request data exists in the information engine, if determining that the credibility of the corresponding instruction information is greater than a preset threshold, generating updated instruction information according to the corresponding instruction information and the interface request data, adding the updated instruction information into the cleaning instruction set file, otherwise, setting instruction information for the interface request data, and adding the set instruction information into the cleaning instruction set file and the information engine respectively.
7. The method of claim 5, wherein,
the step of obtaining the cleaning instruction information corresponding to the interface request data, and the step of adding the cleaning instruction information into the cleaning instruction set file further comprises the steps of:
acquiring relative delay instruction information corresponding to the interface request data, and adding the relative delay instruction information into the cleaning instruction set file;
when the interface request data is the first interface request data meeting the preset requirements, setting the relative delay instruction information corresponding to the interface request data to be 0;
when the interface request data is the data to be processed or the current data, acquiring a difference value between the starting time of the interface request data and the starting time of the first piece of interface request data meeting the preset requirement, and taking the difference value as the relative delay instruction information corresponding to the interface request data.
8. A data stream playback device comprising: the device comprises a data acquisition module, an instruction acquisition module and a playback module;
the data acquisition module is used for acquiring original data to be processed, wherein the original data comprises N pieces of interface request data, and N is a positive integer greater than one;
the instruction acquisition module is used for analyzing the association relation between the interface request data to obtain cleaning instruction information;
the playback module is used for conducting drainage playback according to the original data and the cleaning instruction information;
wherein, the association relation includes: the association relation between the interface request data in the same service;
the instruction acquisition module sequentially analyzes and searches the N pieces of interface request data according to the sequence of the acquisition time from first to last, and executes the following first processing aiming at the first searched piece of interface request data meeting the preset requirement: adding inverted index data corresponding to the first interface request data meeting the preset requirements into an inverted index set file, acquiring cleaning instruction information corresponding to the first interface request data meeting the preset requirements, and adding the cleaning instruction information into a cleaning instruction set file; the inverted index set file and the cleaning instruction set file are both initially empty; taking the next piece of interface request data as current data, wherein the next piece of interface request data is the interface request data which is acquired first in unprocessed interface request data, and executing the following second processing: if it is determined that an association relationship exists between the current data and the interface request data acquired before according to the inverted index set file and the inverted index data corresponding to the current data, the current data is used as data to be processed, and the following third processing is executed: acquiring cleaning instruction information corresponding to the data to be processed, adding the cleaning instruction information into the cleaning instruction set file, and adding inverted index data corresponding to the data to be processed into the inverted index set file when the data to be processed meets the preset requirement; otherwise, taking the next piece of interface request data as the current data, and repeatedly executing the second processing; when all interface request data are processed, taking the cleaning instruction information in the cleaning instruction set file as the obtained cleaning instruction information;
The association relationship further comprises: the interfaces between different services request the association relation between data;
the instruction acquisition module is further configured to acquire association relationships between interface request data between different services according to the constructed knowledge graph, and acquire corresponding cleaning instruction information, including: when any interface request data is processed, responding to the fact that external dependence exists in the interface request data through inquiring the knowledge graph, and adding instruction information corresponding to the external dependence into the cleaning instruction set file.
9. The apparatus of claim 8, wherein,
the instruction acquisition module is further configured to, if it is determined that there is no association between the current data and the interface request data acquired previously, but it is determined that the current data meets the predetermined requirement, add the inverted index data corresponding to the current data to the inverted index set file, acquire cleaning instruction information corresponding to the current data, and add the cleaning instruction information to the cleaning instruction set file.
10. The apparatus of claim 9, wherein,
for any interface, requesting data, the meeting of the predetermined requirements includes: the request method of the interface request data is to update PUT or create POST.
11. The apparatus of claim 9, wherein,
for any interface request data, the inverted index data corresponding to the interface request data includes: an inverted index established for a predetermined parameter in the interface request data;
the instruction acquisition module is further configured to, for any interface request data, perform deduplication processing on inverted index data corresponding to the interface request data before adding the inverted index data corresponding to the interface request data into the inverted index set file.
12. The apparatus of claim 9, wherein,
and the instruction acquisition module generates updated instruction information according to the corresponding instruction information and the interface request data and adds the updated instruction information into the cleaning instruction set file if the instruction information corresponding to the interface request data exists in the information engine, otherwise, the instruction information is set for the interface request data, and the set instruction information is respectively added into the cleaning instruction set file and the information engine.
13. The apparatus of claim 12, wherein,
The instruction acquisition module is further configured to, when determining that the instruction information corresponding to the interface request data exists in the information engine, generate updated instruction information according to the corresponding instruction information and the interface request data if the reliability of the corresponding instruction information is determined to be greater than a predetermined threshold, and add the updated instruction information to the cleaning instruction set file, otherwise, set instruction information for the interface request data, and add the set instruction information to the cleaning instruction set file and the information engine, respectively.
14. The apparatus of claim 12, wherein,
the instruction acquisition module is further used for acquiring relative delay instruction information corresponding to the interface request data and adding the relative delay instruction information into the cleaning instruction set file;
when the interface request data is the first interface request data meeting the preset requirements, setting the relative delay instruction information corresponding to the interface request data to be 0;
when the interface request data is the data to be processed or the current data, acquiring a difference value between the starting time of the interface request data and the starting time of the first piece of interface request data meeting the preset requirement, and taking the difference value as the relative delay instruction information corresponding to the interface request data.
15. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.
16. A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110126137.1A CN112783507B (en) | 2021-01-29 | 2021-01-29 | Data stream guiding playback method and device, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110126137.1A CN112783507B (en) | 2021-01-29 | 2021-01-29 | Data stream guiding playback method and device, electronic equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112783507A CN112783507A (en) | 2021-05-11 |
| CN112783507B true CN112783507B (en) | 2023-07-25 |
Family
ID=75759793
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110126137.1A Active CN112783507B (en) | 2021-01-29 | 2021-01-29 | Data stream guiding playback method and device, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112783507B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107122422A (en) * | 2017-04-06 | 2017-09-01 | 山东建筑大学 | Service-oriented wisdom settlement real-time dataBase system and its method of work |
| CN107480053A (en) * | 2017-07-21 | 2017-12-15 | 杭州销冠网络科技有限公司 | A kind of Software Test Data Generation Method and device |
| CN110618983A (en) * | 2019-08-15 | 2019-12-27 | 复旦大学 | JSON document structure-based industrial big data multidimensional analysis and visualization method |
| CN110888806A (en) * | 2019-11-15 | 2020-03-17 | 天津联想协同科技有限公司 | Interface testing method, electronic equipment and storage medium |
| CN111061645A (en) * | 2019-12-26 | 2020-04-24 | 中科曙光国际信息产业有限公司 | Automatic interface testing method and device for application program interface |
| CN111400323A (en) * | 2020-04-13 | 2020-07-10 | 上海东普信息科技有限公司 | Data retrieval method, system, device and storage medium |
| CN111435344A (en) * | 2019-01-15 | 2020-07-21 | 中国石油集团川庆钻探工程有限公司长庆钻井总公司 | Big data-based drilling acceleration influence factor analysis model |
| CN112100052A (en) * | 2020-08-07 | 2020-12-18 | 北京奇艺世纪科技有限公司 | Interface test scene playback method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120290107A1 (en) * | 2011-05-12 | 2012-11-15 | John Carlson | Apparatus and method for displaying state data of an industrial plant |
-
2021
- 2021-01-29 CN CN202110126137.1A patent/CN112783507B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107122422A (en) * | 2017-04-06 | 2017-09-01 | 山东建筑大学 | Service-oriented wisdom settlement real-time dataBase system and its method of work |
| CN107480053A (en) * | 2017-07-21 | 2017-12-15 | 杭州销冠网络科技有限公司 | A kind of Software Test Data Generation Method and device |
| CN111435344A (en) * | 2019-01-15 | 2020-07-21 | 中国石油集团川庆钻探工程有限公司长庆钻井总公司 | Big data-based drilling acceleration influence factor analysis model |
| CN110618983A (en) * | 2019-08-15 | 2019-12-27 | 复旦大学 | JSON document structure-based industrial big data multidimensional analysis and visualization method |
| CN110888806A (en) * | 2019-11-15 | 2020-03-17 | 天津联想协同科技有限公司 | Interface testing method, electronic equipment and storage medium |
| CN111061645A (en) * | 2019-12-26 | 2020-04-24 | 中科曙光国际信息产业有限公司 | Automatic interface testing method and device for application program interface |
| CN111400323A (en) * | 2020-04-13 | 2020-07-10 | 上海东普信息科技有限公司 | Data retrieval method, system, device and storage medium |
| CN112100052A (en) * | 2020-08-07 | 2020-12-18 | 北京奇艺世纪科技有限公司 | Interface test scene playback method and device |
Non-Patent Citations (1)
| Title |
|---|
| 数据管护技术及应用;于明鹤;聂铁铮;李国良;;大数据(第06期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112783507A (en) | 2021-05-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113342345A (en) | Operator fusion method and device of deep learning framework | |
| CN112559631B (en) | Data processing method and device of distributed graph database and electronic equipment | |
| CN112860811B (en) | Method and device for determining data blood relationship, electronic equipment and storage medium | |
| CN113641829A (en) | Method and device for training neural network of graph and complementing knowledge graph | |
| CN113127357B (en) | Unit test method, apparatus, device, storage medium, and program product | |
| CN116860751A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN116761020A (en) | Video processing method, device, equipment and medium | |
| CN113868254B (en) | Method, device and storage medium for removing duplication of entity node in graph database | |
| CN114168119B (en) | Code file editing method, device, electronic equipment and storage medium | |
| CN112783507B (en) | Data stream guiding playback method and device, electronic equipment and readable storage medium | |
| CN116309002B (en) | Graph data storage, access and processing methods, training methods, equipment and media | |
| CN116009847A (en) | Code generation method, device, electronic equipment and storage medium | |
| CN114969444A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN113704256B (en) | Data identification method, device, electronic equipment and storage medium | |
| CN115186738A (en) | Model training method, device and storage medium | |
| CN113691403A (en) | Topological node configuration method, related device and computer program product | |
| CN114218166A (en) | Data processing method and device, electronic equipment and readable storage medium | |
| CN113051504A (en) | Document preview method, apparatus, device, storage medium and program product | |
| CN113792117B (en) | Method and device for determining data update context, electronic equipment and storage medium | |
| CN112948246B (en) | AB test control method, device and equipment of data platform and storage medium | |
| CN115759233B (en) | Model training method, graph data processing device and electronic equipment | |
| CN117692531A (en) | Method, device, equipment and storage medium for determining identity of internal and external network assets | |
| CN118175153A (en) | Data downloading method and device, electronic equipment and storage medium | |
| CN116992057A (en) | Method, device and equipment for processing multimedia files in storage equipment | |
| CN117573626A (en) | Compressed file previewing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |