CN113469284A - Data analysis method, device and storage medium - Google Patents
Data analysis method, device and storage medium Download PDFInfo
- Publication number
- CN113469284A CN113469284A CN202110843990.5A CN202110843990A CN113469284A CN 113469284 A CN113469284 A CN 113469284A CN 202110843990 A CN202110843990 A CN 202110843990A CN 113469284 A CN113469284 A CN 113469284A
- Authority
- CN
- China
- Prior art keywords
- operator
- operators
- similarity
- operation window
- field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000007405 data analysis Methods 0.000 title claims abstract description 84
- 238000000034 method Methods 0.000 title claims abstract description 62
- 238000004458 analytical method Methods 0.000 claims abstract description 119
- 238000004806 packaging method and process Methods 0.000 claims abstract description 15
- 238000011144 upstream manufacturing Methods 0.000 claims description 88
- 238000006243 chemical reaction Methods 0.000 claims description 45
- 230000004044 response Effects 0.000 claims 2
- 238000010586 diagram Methods 0.000 description 17
- 238000012545 processing Methods 0.000 description 12
- 238000004590 computer program Methods 0.000 description 7
- 238000005538 encapsulation Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 239000000654 additive Substances 0.000 description 2
- 230000000996 additive effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/36—Software reuse
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure relates to the field of computers, and discloses a method, a device and a storage medium for data analysis, wherein the method is applied to computing equipment, and specifically comprises the following steps: the method comprises the steps of receiving a data analysis request, determining a plurality of preset operators corresponding to the data analysis request, and displaying the plurality of determined operators in an operator operation window, wherein each operator is obtained by packaging business logic of different analysis stages, so that when the matching operation in the operator operation window is responded, the execution sequence of each operator is determined in the operator operation window based on the similarity of fields contained in each operator, and when the analysis execution operation in the operator operation window is responded, the business logic packaged by each operator is executed in the operator operation window based on the execution sequence, and the analysis result of at least one operator is output.
Description
Technical Field
The present application relates to computer technologies, and in particular, to a method, an apparatus, and a storage medium for data analysis.
Background
With the development of technology, big data has become an important asset in various industries. The useful value of analyzing and mining from massive big data is no longer the work of pure technical personnel, and common business personnel also need to directly use the big data to carry out business analysis. Especially, when a large number of data tables exist in the database, the field analysis in the database is time-consuming and labor-consuming by means of manual analysis, and an efficient and easy-to-use analysis tool is often needed to support the analysis process, so that the use threshold of the big data technology is reduced, and the business value of big data analysis and mining can be fully played.
Currently, a common analysis tool is a visualized computational model orchestration system. For example, several visualization components, such as a table association component, a field filtering component, and the like, which represent basic business logic, are integrated in an analysis tool, but in the analysis process, the encapsulation degree of the components representing the basic business logic is low, a plurality of components are often required to be called to complete corresponding analysis tasks, and the expansion reusability of the components is poor, which results in poor user experience of a user.
Disclosure of Invention
The embodiment of the disclosure provides a data analysis method, a data analysis device and a storage medium, which are used for improving the reusability and the use flexibility of operators.
The specific technical scheme provided by the disclosure is as follows:
in a first aspect, a method for data analysis is applied to a computing device, and the method includes:
receiving a data analysis request, determining a plurality of preset operators corresponding to the data analysis request, and displaying the determined operators in an operator operation window, wherein each operator is obtained by packaging business logic of different analysis stages;
when the matching operation in the operator operation window is responded, determining the execution sequence of each operator in the operator operation window based on the similarity of fields contained in each operator;
and when the analysis execution operation in the operator operation window is responded, executing the service logic packaged by each operator in the operator operation window based on the execution sequence, and outputting the analysis result of at least one operator.
Optionally, determining a plurality of preset operators corresponding to the data analysis request includes:
analyzing the service key words corresponding to the data analysis request;
and taking the operators with the service logics consistent with the service keywords in the operators as a plurality of preset operators corresponding to the data analysis requests.
Optionally, before receiving the data analysis request, the method further includes:
defining a unified structure for each operator, wherein the structure at least comprises an input structure for operating business logic, a parameter structure for transmitting input parameters for the input structure, a script structure for operating the business logic and an output structure for outputting an analysis result, the input structure is used for limiting the format of the input parameters, and the analysis result is obtained after the input parameters are operated by the business logic and is output by the operator in the format of the output structure;
packaging each operator one by one according to formats of an input structure, a parameter structure, a script structure and an output structure;
and generating an operator operation window based on each packaged operator.
Optionally, when responding to the analysis execution operation in the operator operation window, based on the execution order, executing the service logic encapsulated by each operator in the operator operation window, and outputting an analysis result of at least one operator, including:
when the analysis execution operation in the operator operation window is responded, the analysis input parameter corresponding to the data analysis request is obtained;
determining operators corresponding to business logic for processing analysis input parameters in each operator based on the execution sequence, and inputting the analysis input parameters into the determined operators to execute the business logic, wherein the format of the analysis input parameters is the format of an input structure;
and executing each business logic corresponding to each operator except the determined operator to obtain at least one analysis result, and outputting the analysis result through at least one operator in the format of an output structure.
Optionally, when a matching operation in the operator operation window is responded, determining, in the operator operation window, an execution sequence between the operators based on a similarity of fields included in the operators, including:
when the matching operation of each operator presented in the operator operation window is responded, the operators are arranged according to the sequence corresponding to the matching operation to obtain at least one upstream operator pair and at least one downstream operator pair, wherein the upstream operator pair comprises an upstream operator and a downstream operator, and the business logic corresponding to the upstream operator is executed before the business logic corresponding to the downstream operator;
extracting a plurality of output fields from an upstream operator and a plurality of input fields from a downstream operator;
for each output field of any one upstream operator, respectively calculating the similarity between the output field and a plurality of input fields of the corresponding downstream operator, and taking the output field with the similarity exceeding a similarity threshold and the maximum similarity as a target field;
in an operator operation window, updating an input field with the similarity exceeding a similarity threshold value and the maximum similarity in a downstream operator as a target field in an upstream operator so as to determine the execution sequence among the operators.
Optionally, after calculating, for each output field of any one upstream operator, a similarity between the output field and a plurality of input fields of a corresponding downstream operator, and taking the output field with the similarity exceeding a similarity threshold and the maximum similarity as a target field, the method further includes:
converting each output field of the upstream operator by adopting a pre-established conversion relation to obtain a conversion field corresponding to each output field, wherein the conversion relation is used for representing a conversion mode of converting the output field into the conversion field;
and taking the conversion field as a target field.
Optionally, after the output field with the similarity exceeding the similarity threshold and the maximum similarity is taken as the target field, the method further includes:
and setting the input field with the similarity not exceeding the similarity threshold value to be null.
In a second aspect, an apparatus for data analysis, comprises:
the receiving module is used for receiving the data analysis request, determining a plurality of preset operators corresponding to the data analysis request, and displaying the determined operators in an operator operation window, wherein each operator is obtained by packaging business logic of different analysis stages;
the determining module is used for determining the execution sequence among the operators in the operator operation window based on the similarity of fields contained in the operators when responding to the matching operation in the operator operation window;
and the execution module is used for executing the business logic encapsulated by each operator in the operator operation window based on the execution sequence when responding to the analysis execution operation in the operator operation window, and outputting the analysis result of at least one operator.
Optionally, a plurality of preset operators corresponding to the data analysis request are determined, and the receiving module is configured to:
analyzing the service key words corresponding to the data analysis request;
and taking the operators with the service logics consistent with the service keywords in the operators as a plurality of preset operators corresponding to the data analysis requests.
Optionally, before receiving the data analysis request, the data analysis device further includes a definition module, where the definition module is configured to:
defining a unified structure for each operator, wherein the structure at least comprises an input structure for operating business logic, a parameter structure for transmitting input parameters for the input structure, a script structure for operating the business logic and an output structure for outputting an analysis result, the input structure is used for limiting the format of the input parameters, and the analysis result is obtained after the input parameters are operated by the business logic and is output by the operator in the format of the output structure;
packaging each operator one by one according to formats of an input structure, a parameter structure, a script structure and an output structure;
and generating an operator operation window based on each packaged operator.
Optionally, when responding to the analysis execution operation in the operator operation window, based on the execution sequence, executing the service logic encapsulated by each operator in the operator operation window, and outputting an analysis result of at least one operator, where the execution module is configured to:
when the analysis execution operation in the operator operation window is responded, the analysis input parameter corresponding to the data analysis request is obtained;
determining operators corresponding to business logic for processing analysis input parameters in each operator based on the execution sequence, and inputting the analysis input parameters into the determined operators to execute the business logic, wherein the format of the analysis input parameters is the format of an input structure;
and executing each business logic corresponding to each operator except the determined operator to obtain at least one analysis result, and outputting the analysis result through at least one operator in the format of an output structure.
Optionally, when the matching operation in the operator operation window is responded, the execution sequence between the operators is determined in the operator operation window based on the similarity of the fields included in the operators, and the determining module is configured to:
when the matching operation of each operator presented in the operator operation window is responded, the operators are arranged according to the sequence corresponding to the matching operation to obtain at least one upstream operator pair and at least one downstream operator pair, wherein the upstream operator pair comprises an upstream operator and a downstream operator, and the business logic corresponding to the upstream operator is executed before the business logic corresponding to the downstream operator;
extracting a plurality of output fields from an upstream operator and a plurality of input fields from a downstream operator;
for each output field of any one upstream operator, respectively calculating the similarity between the output field and a plurality of input fields of the corresponding downstream operator, and taking the output field with the similarity exceeding a similarity threshold and the maximum similarity as a target field;
in an operator operation window, updating an input field with the similarity exceeding a similarity threshold value and the maximum similarity in a downstream operator as a target field in an upstream operator so as to determine the execution sequence among the operators.
Optionally, for each output field of any one upstream operator, the similarity between the output field and the multiple input fields of the corresponding downstream operator is calculated, and the output field with the similarity exceeding the similarity threshold and the maximum similarity is taken as the target field, and the determining module is configured to:
converting each output field of the upstream operator by adopting a pre-established conversion relation to obtain a conversion field corresponding to each output field, wherein the conversion relation is used for representing a conversion mode of converting the output field into the conversion field;
and taking the conversion field as a target field.
Optionally, after the output field with the similarity exceeding the similarity threshold and the maximum similarity is taken as the target field, the determining module is further configured to:
and setting the input field with the similarity not exceeding the similarity threshold value to be null.
In a third aspect, a terminal includes:
a memory for storing executable instructions;
a processor for reading and executing executable instructions stored in the memory to implement a method as in any one of the first aspect.
In a fourth aspect, a computer-readable storage medium, wherein instructions, when executed by a processor, enable the processor to perform the method of any of the first aspect.
To sum up, in the embodiments of the present disclosure, it is disclosed that a data analysis request is received, a plurality of preset operators corresponding to the data analysis request are determined, and the determined operators are presented in an operator operation window, each operator is obtained by encapsulating business logic of different analysis stages, so that when a matching operation in the operator operation window is responded, an execution sequence between each operator is determined in the operator operation window based on similarity of fields included in each operator, and when an analysis execution operation in the operator operation window is responded, the business logic encapsulated by each operator is executed in the operator operation window based on the execution sequence, and an analysis result of at least one operator is output, and the execution sequence of the operators is determined according to the field similarity by performing uniform format encapsulation on the plurality of operators, so that the execution sequence of the operators can be determined intelligently and quickly, and the reusability and the use flexibility of the operator are improved.
Drawings
FIG. 1 is a schematic diagram of a system architecture for analyzing data according to an embodiment of the present application;
FIG. 2 is a schematic flow chart illustrating analysis of data by a computing device according to an embodiment of the present disclosure;
FIG. 3 is a schematic flow chart illustrating an operator encapsulation performed by a computing device according to an embodiment of the present application;
FIG. 4 is a schematic diagram illustrating a unified packaging of operators by a computing device according to an embodiment of the present application;
FIG. 5 is a schematic flow chart illustrating a process of searching for an operator corresponding to an analysis data analysis request by a computing device according to an embodiment of the present application;
FIG. 6 is a schematic flow chart illustrating matching of operators by a computing device according to an embodiment of the present application;
FIG. 7 is a diagram illustrating a computing device matching output fields and input fields of operators according to an embodiment of the present application;
FIG. 8 is a schematic flow chart illustrating a process of determining operator execution sequence by a computing device according to an embodiment of the present application;
FIG. 9 is a diagram illustrating a computing device matching operators by converting fields according to an embodiment of the present application;
FIG. 10 is a diagram illustrating matching of output fields and input fields of operators by another computing device in an embodiment of the present application;
FIG. 11 is a schematic flow chart illustrating a process of executing each operator and obtaining an analysis result by a computing device according to an embodiment of the present application;
FIG. 12 is a diagram illustrating a computing device executing various operators and obtaining analysis results according to an embodiment of the present application;
FIG. 13a is a schematic diagram of a logic architecture of an apparatus according to an embodiment of the present disclosure;
FIG. 13b is a schematic diagram of a logic architecture of another apparatus according to an embodiment of the present disclosure;
fig. 14 is a schematic entity architecture diagram of a terminal in the embodiment of the present disclosure.
Detailed Description
In order to improve reusability and use flexibility of operators, in the embodiment of the application, after receiving a data analysis request, a computing device determines a plurality of preset operators corresponding to the data analysis request, and presents the determined operators in an operator operation window, so that when a matching operation in the operator operation window is responded, an execution sequence of the operators is determined in the operator operation window based on similarity of fields contained in the operators, and when an analysis execution operation in the operator operation window is responded, service logic packaged by the operators is executed in the operator operation window based on the execution sequence, and an analysis result of at least one operator is output.
In the following, a preferred embodiment of the present application is described in detail with reference to the drawings, first, in the embodiment of the present disclosure, generally, an application scenario of a system mainly includes a client and a computing device, and referring to fig. 1, a main body of performing data analysis in the system is exemplarily shown by the computing device, where the computing device may be a computer with processing capability, a notebook computer, or the like. In the implementation process, a client triggering the computing device to perform data analysis is a smart phone, a notebook computer and the like, and the client can trigger matching operation and analysis execution operation in the operator operation window to prompt the computing device to complete the task of data analysis. However, other auto-triggering conditions (for example, trigger conditions such as a timer and a counter are preset) may be set in the system instead of the client, so that the computing device performs the process of data analysis under the control of the auto-triggering conditions.
The following describes a case where a method of performing data analysis by a computing device is applied to the computing device. Referring to fig. 2, in the embodiment of the present disclosure, a specific process of the computing device performing data analysis is as follows:
step 201: receiving a data analysis request, determining a plurality of preset operators corresponding to the data analysis request, and displaying the determined operators in an operator operation window, wherein each operator is obtained by packaging business logic of different analysis stages.
Generally, the business logic of data analysis is complex, and if the business logic of data analysis is encapsulated in an operator every time, the code amount of the operator is very large, and the reusability of the operator is not strong. However, if the operators are constructed in a manner of performing block processing according to business logic, it is difficult to ensure that input and output parameters of each block of operators are consistent, and problems often occur in connection among the operators.
In view of the above situation, in the embodiment of the present application, service logics at different analysis stages are encapsulated in advance to obtain N operators, and it should be noted that the format of the encapsulation is uniform, so that the connection between the operators is facilitated. For example, the operator a performs name statistics on residents in the XX area, the operator B performs age statistics on residents in the XX area, and then the resident number, the number of residents, and the like allowed to be input in the operator a and the resident number, the number of residents, and the like allowed to be input in the operator B are all consistent.
Specifically, before the computing device receives the data analysis request, as shown in fig. 3, the method further includes:
step 101: defining a unified structure for each operator, wherein the structure at least comprises an input structure for operating business logic, a parameter structure for transmitting input parameters for the input structure, a script structure for operating the business logic and an output structure for outputting an analysis result, the input structure is used for limiting the format of the input parameters, and the analysis result is obtained after the input parameters are operated by the business logic and is output by the operator in the format of the output structure.
Because the execution of the business logic needs to substitute the real parameter into the script code to compile and execute, the result can be output at last, namely the result of the real parameter after compiling and executing. Based on this, the calculation setting is that the operators define a unified structure, and at least an input structure, a script structure, an output structure and an output structure are included in the structure, that is, the formats of the input structure, the script structure, the output structure and the output structure of each operator are unified, so as to facilitate the execution of business logic.
Referring to a specific example, as shown in fig. 4, in the process of packaging a certain operator, an input structure is subdivided into an input name, an input placeholder, an input description, an input field, and the like to unify the packaging formats, where the specific input field includes a name, an age, and an address, where the specific field name of the name is name (string type), the specific field name of the age is age (int type), and the specific field name of the address is address (string type); the output structure is subdivided into an output name, an output placeholder, an output description, an output field and the like so as to unify the packaging formats, wherein the specific output field comprises a name, an age and an address, the specific field name of the name is name (string type), the specific field name of the age is age (int type), and the specific field name of the address is address (string type), and obviously, the formats of the output field and the input field are consistent when the operator is packaged; the input parameters are subdivided into variable names, variable placeholders, variable descriptions, variable types, display modes, display units and default values; the codes of the script structure are unified into an SQL format.
Specifically, the input structure is used for limiting the format of the input parameters, the operator only allows the input parameters for data analysis to be input in the format of the input structure, the input parameters in other formats cannot be received, the analysis result is obtained after the input parameters are operated through business logic, namely the input parameters are operated through codes of the script structure to obtain the analysis result, and the operator only allows the analysis result to be output through the operator in the format of the output structure.
Step 102: and packaging each operator one by one according to the formats of the input structure, the parameter structure, the script structure and the output structure.
In the implementation process, the computing equipment packages each operator one by one according to the formats of the input structure, the parameter structure, the script structure and the output structure, so that the structure arrangement, the codes and the like of business logic are invisible to the outside, when the computing equipment uses the operators, the computing equipment only needs to regard the operators as a black box, inputs the input parameters into the operators in the format of the input structure, and after the execution is finished, the computing equipment outputs the analysis results in the format of the output structure.
Step 103: and generating an operator operation window based on each packaged operator.
After the operators are packaged uniformly, the computing equipment generates a visual interface, namely an operator operating window, according to the packaged operators, so that a client can call the operators conveniently.
In an implementation process, after the computing device receives the data analysis request, a plurality of preset operators corresponding to the data analysis request are determined, as shown in fig. 5, specifically including:
step 2011: and analyzing the service key words corresponding to the data analysis request.
In order to determine which operator corresponds to the data analysis request received this time, the computing device first analyzes the data analysis request to extract the service keyword corresponding to the data analysis request. For example, when a data analysis request carries a service keyword, the computing device directly obtains the service keyword from the data analysis request; when the storage location of the service keyword is indicated in the data analysis request, the computing device may read the service keyword from the corresponding storage location.
It should be noted that the business keyword is consistent with the business logic of the preset operator. It is assumed that the service logic is additive computation, and the service keywords are additive, addend, and the like.
Step 2012: and taking the operators with the service logics consistent with the service keywords in the operators as a plurality of preset operators corresponding to the data analysis requests.
After the business key words are determined, the computing device searches operators with business logic consistent with the business key words one by one in all preset operators. For example, when the business keyword is an addition, the computing device takes the two addend operators, the three addend operators and other multi-addend operators involved in the business logic of the preset operator as the preset multi-operators corresponding to the data analysis request.
And after the operators with the business logic consistent with the business key words are determined, the computing equipment presents the determined operators in an operator operation window. Preferably, the operator operation window is arranged in columns, all preset operators are placed in one column, and the plurality of operators determined above are presented in another column.
Step 202: and when the matching operation in the operator operation window is responded, determining the execution sequence among operators in the operator operation window based on the similarity of fields contained in the operators.
In the implementation process, when the computing device responds to the matching operation in the operator operation window, the computing device determines the execution sequence of the operators presented in the operator operation window according to the matching operation. Specifically, the computing device matches the output field of one operator with the input field of the next operator, so that after the operator finishes executing to obtain the first analysis result, the next operator can continue executing after receiving the first analysis result, and the process is repeated until all business logics are finished and the analysis result is output, as shown in fig. 6, the method specifically includes:
step 2021: when the matching operation of each operator presented in the operator operation window is responded, the operators are arranged according to the sequence corresponding to the matching operation to obtain at least one upstream operator pair and at least one downstream operator pair, wherein the upstream operator pair comprises an upstream operator and a downstream operator, and the business logic corresponding to the upstream operator is executed before the business logic corresponding to the downstream operator.
In the implementation process, when the computing device responds to the matching operation of each operator presented in the operator operation window, for example, when the client clicks a matching button in the operator operation window, the computing device arranges each operator according to the sequence corresponding to the matching operation, where the sequence corresponding to the matching operation is mainly used to define the execution sequence of each operator, for example, when the sequence corresponding to the matching operation is to calculate subtraction first and then calculate addition, then, in the execution process, the operator corresponding to the business logic performing the subtraction operation is executed first, and the operator corresponding to the business logic performing the addition operation is executed later.
And after the computing equipment arranges the operators according to the sequence corresponding to the matching operation, at least one upstream and downstream operator pair is obtained, wherein the upstream and downstream operator pair comprises an upstream operator and a downstream operator, and the business logic corresponding to the upstream operator is executed before the business logic corresponding to the downstream operator. Still, the above example in which the order corresponding to the matching operation is to calculate subtraction first and then to calculate addition is explained, where the operator corresponding to the business logic performing the subtraction operation is an upstream operator, and the operator corresponding to the business logic performing the subtraction operation is a downstream operator.
It should be added here that, when the number of operators corresponding to the data analysis request is large, a plurality of upstream and downstream operator pairs may be constructed according to the sequence corresponding to the matching operation, an upstream operator in a current upstream and downstream operator pair may be a downstream operator in a previous upstream and downstream operator pair, and a downstream operator in the current upstream and downstream operator pair may be an upstream operator in a next upstream and downstream operator pair. When the number of operators corresponding to the data analysis request is one, the operators do not form an upstream operator pair and a downstream operator pair.
Step 2022: a plurality of output fields are extracted from upstream operators, and a plurality of input fields are extracted from downstream operators.
In the implementation process, after the upstream and downstream operator pairs are determined, input and output between the upstream operator and the downstream operator are specifically matched. Specifically, the computing device first extracts a plurality of output fields from upstream operators and a plurality of input fields from downstream operators. Here, the output field is a different component in the output parameter of the upstream operator, and the input field is a different component in the input parameter of the downstream operator, and typically, specific values are carried in the output field and the input field, such as name zhang, age 28, and so on.
Step 2023: and respectively calculating the similarity between the output field and a plurality of input fields of corresponding downstream operators aiming at each output field of any one upstream operator, and taking the output field with the similarity exceeding a similarity threshold value and the maximum similarity as a target field.
In the implementation process, after the output field and the input field are determined, the output field and the input field also need to be subjected to correlation matching, that is, which output field corresponds to which input field, as shown in fig. 7, the output fields 1, 2, 3, 4, and 5 of the upstream operator correspond to the input fields 1, 3, 2, 5, and 6 of the downstream operator, respectively, and such correspondence needs to be determined by calculating the similarity between the output operator and the input operator. Specifically, the computing device calculates similarity between the output field and a plurality of input fields of corresponding downstream operators, and uses the output field with the similarity exceeding a similarity threshold and the maximum similarity as a target field, as shown in fig. 8, where the above process specifically includes:
step 20231: and converting each output field of the upstream operator by adopting a pre-established conversion relation to obtain a conversion field corresponding to each output field, wherein the conversion relation is used for representing a conversion mode of converting the output field into the conversion field.
Because the business logic stored in different operators is different, especially when the business logic is operators from different fields, the fields in the operators cannot be matched. For example, the upstream operator is the name of a student (English) counted in international schools, and the downstream operator is the age of a teenager (Chinese) counted in street offices. Then, since the names in english and chinese cannot be directly corresponded, the output field of the upstream operator cannot be directly used as the input field of the downstream operator.
In the implementation process, the computing device converts each output field of the upstream operator by adopting a pre-established conversion relationship to obtain a conversion field corresponding to each output field, wherein the conversion relationship is a conversion mode for converting the output field into the conversion field, namely the output field is converted by the conversion mode corresponding to the conversion relationship to obtain the conversion field, and the conversion field can be matched with the input field of the downstream operator.
Step 20232: the conversion field is taken as the target field.
In implementation, the computing device takes the transformed field as the target field. For example, when the conversion field is a name and the input fields of the downstream operators include name, age, and address, the computing device matches the name as the conversion field to the name.
Referring to fig. 9, the conversion field is introduced from the code implementation level, the output field of the upstream operator is output1, and the output field of the upstream operator cannot be directly used as the input field of the downstream operator. Setting a conversion field to mid-view, converting name in an output field of an upstream operator to XM (abbreviation of name) by mid-view, converting age in the output field of the upstream operator to NL (abbreviation of age) by mid-view, converting adress in the output field of the upstream operator to JTZZ (abbreviation of Home Address) by mid-view, converting nll in the output field of the upstream operator (here, since there is no sex-related information in the output field of the upstream operator) to XB (abbreviation of sex) by mid-view, thereby binding the output field of the upstream operator with the input field of the downstream operator.
Referring to fig. 10, continuing from the implementation level, after the conversion shown in fig. 9, the output field name of the upstream operator is converted into the input field XM of the downstream operator, the output field adress of the upstream operator is converted into the input field JTZZ of the downstream operator, and the output field age of the upstream operator is converted into the input field NL of the downstream operator.
The computing device takes the middle as the converted conversion fields XM, NL and JTZZ as the target field.
It should be noted that, after the output field with the similarity exceeding the similarity threshold and the maximum similarity is taken as the target field, the method further includes: the input field of which the similarity does not exceed the similarity threshold is set to be null by the computing device, namely, one input field in the downstream operator cannot find the corresponding output field in the upstream operator, namely, the input field of which the corresponding output field cannot be found is not processed any more in the implementation process.
Step 2024: in an operator operation window, updating an input field with the similarity exceeding a similarity threshold value in a downstream operator into a target field in an upstream operator so as to determine the execution sequence among the operators.
Still taking the above assumptions, the computing device updates the input field with the highest similarity in the downstream operator, i.e., the name in the downstream operator, to the target field, i.e., the name, in the upstream operator in the operator operation window, where the similarity exceeds the similarity threshold, so that the input field (name) in the downstream operator is updated to the output field (name) of the upstream operator.
Through further matching between the input field in the downstream operator and the output field of the upstream operator, the specific execution trend of the input parameters from the upstream operator to the downstream operator is clarified, and thus the execution sequence among the operators is determined.
Step 203: and when the analysis execution operation in the operator operation window is responded, executing the service logic packaged by each operator in the operator operation window based on the execution sequence, and outputting the analysis result of at least one operator.
After the execution sequence among the operators is determined, when the computing device responds to the analysis execution operation in the operator operation window, for example, when the client clicks an execution button in the operator operation window, the computing device executes the service logic encapsulated by each operator according to the execution sequence, and obtains an analysis result, as shown in fig. 11, the method specifically includes the following steps:
step 2031: and when the analysis execution operation in the operator operation window is responded, acquiring an analysis input parameter corresponding to the data analysis request.
In the implementation process, when responding to the analysis execution operation in the operator operation window, the computing device starts to start the business logic corresponding to the data analysis request, and first, the computing device needs to acquire the analysis input parameters required for running the business logic, namely, the analysis input parameters corresponding to the data analysis request, for example, to count the ages of residents in the region C, and first, the computing device needs to acquire the resident data of the analysis input parameters corresponding to the data analysis request.
Step 2032: and determining operators corresponding to the business logic for processing the analysis input parameters in each operator based on the execution sequence, and inputting the analysis input parameters into the determined operators to execute the business logic, wherein the format of the analysis input parameters is the format of the input structure.
In the implementation process, the computing device determines the operator to be executed first in each operator according to the execution sequence, that is, the operator corresponding to the service logic that processes the analysis input parameter is included, and inputs the analysis input parameter into the determined operator to execute the service logic of the operator.
When the operators form a plurality of upstream and downstream operator pairs, the operator corresponding to the business logic that processes the analysis input parameter is an upstream operator, and is an upstream operator in the first executed upstream and downstream operator pair.
In addition, the format of the analysis input parameter is the format of the input structure, so that the input parameter can be matched with the code of the script structure corresponding to the service logic, and the smooth execution of the service logic is ensured.
Step 2033: and executing each business logic corresponding to each operator except the determined operator to obtain at least one analysis result, and outputting the analysis result through at least one operator in the format of an output structure.
In the implementation process, after the business logic of the operator executed first is executed, the computing device executes the business logics corresponding to the operators except the determined operator, that is, the computing device executes the downstream operator in the upstream and downstream operator pairs corresponding to the operator, and continues to execute the upstream operator in the upstream and downstream operator pairs and the business logic corresponding to the downstream operator according to the execution sequence until the business logics corresponding to the data analysis request are executed completely.
And after the business logic corresponding to the data analysis request is executed, the computing equipment outputs the analysis result in the format of an output structure through at least one operator. It should be noted that, each operator running the business logic may output the current analysis result in the format of the output structure, but in view of the integrity of the business logic, the analysis result of the last operator executing the business logic is usually output in the format of the output structure.
Referring to fig. 12, after the execution in the operator operation window is clicked, the corresponding analysis result can be viewed, and in another embodiment, a log in the execution process can be viewed, that is, the execution condition of the business logic can be viewed.
The above embodiments are further described in detail below using a specific application scenario.
Application scenarios:
based on the same inventive concept, referring to fig. 13a, an embodiment of the present application provides an apparatus for data analysis, including:
a receiving module 1310, configured to receive a data analysis request, determine a plurality of preset operators corresponding to the data analysis request, and present the determined operators in an operator operation window, where each operator is obtained by encapsulating service logic in different analysis stages;
a determining module 1320, configured to determine, when responding to the matching operation in the operator operation window, an execution sequence between the operators in the operator operation window based on the similarity of the fields included in the operators;
the executing module 1330 is configured to, when responding to the analysis execution operation in the operator operation window, execute the service logic encapsulated by each operator in the operator operation window based on the execution sequence, and output an analysis result of at least one operator.
Optionally, a preset plurality of operators corresponding to the data analysis request are determined, and the receiving module 1310 is configured to:
analyzing the service key words corresponding to the data analysis request;
and taking the operators with the service logics consistent with the service keywords in the operators as a plurality of preset operators corresponding to the data analysis requests.
Optionally, referring to fig. 13b, before receiving the data analysis request, a definition module 1300 is further included, and the definition module 1300 is configured to:
defining a unified structure for each operator, wherein the structure at least comprises an input structure for operating business logic, a parameter structure for transmitting input parameters for the input structure, a script structure for operating the business logic and an output structure for outputting an analysis result, the input structure is used for limiting the format of the input parameters, and the analysis result is obtained after the input parameters are operated by the business logic and is output by the operator in the format of the output structure;
packaging each operator one by one according to formats of an input structure, a parameter structure, a script structure and an output structure;
and generating an operator operation window based on each packaged operator.
Optionally, when responding to the analysis execution operation in the operator operation window, based on the execution sequence, the service logic encapsulated by each operator is executed in the operator operation window, and the analysis result of at least one operator is output, where the execution module 1330 is configured to:
when the analysis execution operation in the operator operation window is responded, the analysis input parameter corresponding to the data analysis request is obtained;
determining operators corresponding to business logic for processing analysis input parameters in each operator based on the execution sequence, and inputting the analysis input parameters into the determined operators to execute the business logic, wherein the format of the analysis input parameters is the format of an input structure;
and executing each business logic corresponding to each operator except the determined operator to obtain at least one analysis result, and outputting the analysis result through at least one operator in the format of an output structure.
Optionally, when responding to the matching operation in the operator operation window, the determining module 1320 is configured to determine, based on the similarity of the fields included in each operator, the execution sequence between each operator in the operator operation window, and to:
when the matching operation of each operator presented in the operator operation window is responded, each operator is arranged according to the position corresponding to the matching operation to obtain at least one upstream operator and downstream operator pair, wherein the upstream operator and the downstream operator pair comprise an upstream operator and a downstream operator, and the business logic corresponding to the upstream operator is executed before the business logic corresponding to the downstream operator;
extracting a plurality of output fields from an upstream operator and a plurality of input fields from a downstream operator;
for each output field of any one upstream operator, respectively calculating the similarity between the output field and a plurality of input fields of the corresponding downstream operator, and taking the output field with the similarity exceeding a similarity threshold and the maximum similarity as a target field;
in an operator operation window, updating an input field with the similarity exceeding a similarity threshold value and the maximum similarity in a downstream operator as a target field in an upstream operator so as to determine the execution sequence among the operators.
Optionally, after calculating, for each output field of any one upstream operator, a similarity between the output field and a plurality of input fields of a corresponding downstream operator, and taking the output field with the similarity exceeding a similarity threshold and the maximum similarity as a target field, the determining module 1320 is further configured to:
converting each output field of the upstream operator by adopting a pre-established conversion relation to obtain a conversion field corresponding to each output field, wherein the conversion relation is used for representing a conversion mode of converting the output field into the conversion field;
the conversion field is taken as the target field.
Optionally, after the output field with the similarity exceeding the similarity threshold and the maximum similarity is taken as the target field, the determining module 1320 is further configured to:
and setting the input field with the similarity not exceeding the similarity threshold value to be null.
Based on the same inventive concept, referring to fig. 14, an embodiment of the present disclosure provides a terminal, including:
a memory 1401 for storing executable instructions;
a processor 1402 for reading and executing executable instructions stored in a memory to implement a method as in any of the first aspect.
Where in fig. 14 the bus architecture may include any number of interconnected buses and bridges, with one or more processors represented by processor 1402 and various circuits of memory represented by memory 1401 being linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface. The transceiver may be a plurality of elements, i.e., including a transmitter and a transceiver, providing a means for communicating with various other apparatus over a transmission medium. The processor 1402 is responsible for managing the bus architecture and general processing, and the memory 1401 may store data used by the processor 1402 in performing operations.
The processor 1402 is responsible for managing the bus architecture and general processing, and the memory 1401 may store data used by the processor 1400 in performing operations.
The memory 1401 and the processor 1402 cooperate with each other to implement any one of the methods executed by the computing device in steps 201 to 203 in the above embodiments, which are not described herein again.
Based on the same inventive concept, embodiments of the present application provide a computer-readable storage medium, wherein instructions of the storage medium, when executed by a processor, enable the processor to perform the method of any one of the first aspect.
To sum up, the embodiment of the present application discloses receiving a data analysis request, determining a plurality of preset operators corresponding to the data analysis request, and presenting the determined operators in an operator operation window, where each operator is obtained by encapsulating business logic of different analysis stages, so that when responding to matching operation in the operator operation window, an execution sequence of each operator is determined in the operator operation window based on similarity of fields contained in each operator, and when responding to analysis execution operation in the operator operation window, the business logic encapsulated by each operator is executed in the operator operation window based on the execution sequence, and an analysis result of at least one operator is output, and the execution sequence is determined according to the field similarity by encapsulating the plurality of operators in a unified format, so as to rapidly and intelligently determine the execution sequence of the operators, and the reusability and the use flexibility of the operator are improved.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product system. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product system embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program product systems according to the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (10)
1. A method of data analysis, for use with a computing device, the method comprising:
receiving a data analysis request, determining a plurality of preset operators corresponding to the data analysis request, and displaying the determined operators in an operator operation window, wherein each operator is obtained by packaging business logic of different analysis stages;
when the matching operation in the operator operation window is responded, determining the execution sequence among the operators in the operator operation window based on the similarity of fields contained in the operators;
and when responding to the analysis execution operation in the operator operation window, executing the service logic encapsulated by each operator in the operator operation window based on the execution sequence, and outputting the analysis result of at least one operator.
2. The method of claim 1, wherein determining a predetermined plurality of operators corresponding to the data analysis request comprises:
analyzing the service key words corresponding to the data analysis request;
and taking the operators with the service logics consistent with the service keywords in the operators as the preset operators corresponding to the data analysis requests.
3. The method of claim 1, wherein prior to receiving the data analysis request, further comprising:
defining a unified structure for each operator, wherein the structure at least comprises an input structure for operating the business logic, a parameter structure for transmitting input parameters for the input structure, a script structure for operating the business logic and an output structure for outputting the analysis result, the input structure is used for defining the format of the input parameters, the analysis result is obtained after the input parameters are operated by the business logic, and the analysis result is output by the operator in the format of the output structure;
packaging each operator one by one according to the formats of the input structure, the parameter structure, the script structure and the output structure;
and generating an operator operation window based on each packaged operator.
4. The method of claim 3, wherein said executing the business logic encapsulated by each operator in the operator operation window and outputting an analysis result of at least one of the operators in response to the analysis execution operation in the operator operation window based on the execution precedence order comprises:
when the analysis execution operation in the operator operation window is responded, the analysis input parameter corresponding to the data analysis request is obtained;
determining operators corresponding to the business logic which processes the analysis input parameters in each operator based on the execution sequence, and inputting the analysis input parameters into the determined operators to execute the business logic, wherein the format of the analysis input parameters is the format of the input structure;
and executing each business logic corresponding to each operator except the determined operator to obtain at least one analysis result, and outputting the analysis result through at least one operator in the format of the output structure.
5. The method of claim 3, wherein said determining, in response to a matching operation in said operator operation window, an execution order among said operators in said operator operation window based on a similarity of fields contained in said operators comprises:
when the matching operation of each operator presented in the operator operation window is responded, the operators are arranged according to the sequence corresponding to the matching operation to obtain at least one upstream operator pair and at least one downstream operator pair, wherein the upstream operator pair comprises an upstream operator and a downstream operator, and the business logic corresponding to the upstream operator is executed before the business logic corresponding to the downstream operator;
extracting a plurality of output fields from the upstream operator and a plurality of input fields from the downstream operator;
for each output field of any one upstream operator, respectively calculating the similarity between the output field and the plurality of input fields of the corresponding downstream operator, and taking the output field with the similarity exceeding a similarity threshold value and the maximum similarity as a target field;
in the operator operation window, updating the input field with the similarity exceeding a similarity threshold value and the maximum similarity in the downstream operator to the target field corresponding to the similarity in the upstream operator so as to determine the execution sequence among the operators.
6. The method of claim 5, wherein said for each of said output fields of any one of said upstream operators, after calculating the similarity between said output field and said plurality of input fields of the corresponding downstream operator, and taking said output field with the similarity exceeding a similarity threshold and the similarity being the maximum as a target field, further comprises:
converting each output field of the upstream operator by adopting a pre-established conversion relationship to obtain a conversion field corresponding to each output field, wherein the conversion relationship is used for representing a conversion mode of converting the output field into the conversion field;
and taking the conversion field as a target field.
7. The method of claim 5, wherein after the output field with the similarity exceeding a similarity threshold and the maximum similarity is taken as a target field, further comprising:
setting the input field for which the similarity does not exceed a similarity threshold to null.
8. An apparatus for data analysis, comprising:
the system comprises a receiving module, a data analysis module and a display module, wherein the receiving module is used for receiving a data analysis request, determining a plurality of preset operators corresponding to the data analysis request, and displaying the determined operators in an operator operation window, wherein each operator is obtained by packaging business logic of different analysis stages;
a determining module, configured to determine, in the operator operation window, an execution sequence between the operators based on similarity of fields included in the operators when a matching operation in the operator operation window is responded;
and the execution module is used for executing the service logic encapsulated by each operator in the operator operation window and outputting an analysis result of at least one operator based on the execution sequence when responding to the analysis execution operation in the operator operation window.
9. A terminal, comprising:
a memory for storing executable instructions;
a processor for reading and executing executable instructions stored in the memory to implement the method of any one of claims 1-7.
10. A computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor, enable the processor to perform the method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110843990.5A CN113469284B (en) | 2021-07-26 | 2021-07-26 | Data analysis method, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110843990.5A CN113469284B (en) | 2021-07-26 | 2021-07-26 | Data analysis method, device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113469284A true CN113469284A (en) | 2021-10-01 |
| CN113469284B CN113469284B (en) | 2024-07-02 |
Family
ID=77882462
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110843990.5A Active CN113469284B (en) | 2021-07-26 | 2021-07-26 | Data analysis method, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113469284B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115494989A (en) * | 2022-11-17 | 2022-12-20 | 帆软软件有限公司帆软南京分公司 | Analysis node generation method and device, electronic equipment and storage medium |
Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5355307A (en) * | 1992-03-02 | 1994-10-11 | Grundig Ag | Apparatus for entering and displaying control commands for controlling a machine loop |
| JPH10254902A (en) * | 1997-03-14 | 1998-09-25 | Nippon Telegr & Teleph Corp <Ntt> | Object similarity calculation method and similar object retrieval device |
| CN101398852A (en) * | 2008-10-16 | 2009-04-01 | 北京邮电大学 | Semantic Web service matching method and system |
| CN105471930A (en) * | 2014-07-28 | 2016-04-06 | 浙江大华技术股份有限公司 | Method, system and equipment for reading distributed data |
| US20180018248A1 (en) * | 2016-07-14 | 2018-01-18 | International Business Machines Corporation | Hierarchical data processor tester |
| CN107621934A (en) * | 2017-07-28 | 2018-01-23 | 中国人民解放军国防信息学院 | Based on modularization, the evaluation index computational methods of graphical operator and device |
| WO2018116522A1 (en) * | 2016-12-19 | 2018-06-28 | 日本電信電話株式会社 | Determination device, determination method, and determination program |
| US10509659B1 (en) * | 2016-09-28 | 2019-12-17 | Amazon Technologies, Inc. | Input processing logic to produce outputs for downstream systems using configurations |
| CN110851428A (en) * | 2019-11-19 | 2020-02-28 | 厦门市美亚柏科信息股份有限公司 | Database analysis method, device and medium based on rule operator dynamic arrangement |
| US20200081916A1 (en) * | 2018-09-12 | 2020-03-12 | Business Objects Software Ltd. | Predictive modeling with machine learning in data management platforms |
| CN111080170A (en) * | 2019-12-30 | 2020-04-28 | 北京云享智胜科技有限公司 | Workflow modeling method and device, electronic equipment and storage medium |
| CN111382347A (en) * | 2018-12-28 | 2020-07-07 | 广州市百果园信息技术有限公司 | Object feature processing and information pushing method, device and equipment |
| CN111752870A (en) * | 2020-05-28 | 2020-10-09 | 苏州浪潮智能科技有限公司 | Compatible method and system of server interface based on neural network |
| CN112069456A (en) * | 2020-09-21 | 2020-12-11 | 北京明略昭辉科技有限公司 | Model file generation method and device, electronic equipment and storage medium |
| CN112148455A (en) * | 2020-09-29 | 2020-12-29 | 星环信息科技（上海）有限公司 | Task processing method, device and medium |
| CN112632960A (en) * | 2021-01-06 | 2021-04-09 | 北京启明星辰信息安全技术有限公司 | Log analysis method and system based on dynamic field template |
| CN112632082A (en) * | 2020-12-30 | 2021-04-09 | 中国农业银行股份有限公司 | Method and device for creating Flink operation |
| CN112684907A (en) * | 2020-12-24 | 2021-04-20 | 科大讯飞股份有限公司 | Text input method, device, equipment and storage medium |
| CN112925838A (en) * | 2019-12-06 | 2021-06-08 | 阿里巴巴集团控股有限公司 | Data processing method and device |
| CN113032611A (en) * | 2021-03-12 | 2021-06-25 | 浙江大华技术股份有限公司 | Data processing method, target tracking method and related device |
-
2021
- 2021-07-26 CN CN202110843990.5A patent/CN113469284B/en active Active
Patent Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5355307A (en) * | 1992-03-02 | 1994-10-11 | Grundig Ag | Apparatus for entering and displaying control commands for controlling a machine loop |
| JPH10254902A (en) * | 1997-03-14 | 1998-09-25 | Nippon Telegr & Teleph Corp <Ntt> | Object similarity calculation method and similar object retrieval device |
| CN101398852A (en) * | 2008-10-16 | 2009-04-01 | 北京邮电大学 | Semantic Web service matching method and system |
| CN105471930A (en) * | 2014-07-28 | 2016-04-06 | 浙江大华技术股份有限公司 | Method, system and equipment for reading distributed data |
| US20180018248A1 (en) * | 2016-07-14 | 2018-01-18 | International Business Machines Corporation | Hierarchical data processor tester |
| US10509659B1 (en) * | 2016-09-28 | 2019-12-17 | Amazon Technologies, Inc. | Input processing logic to produce outputs for downstream systems using configurations |
| WO2018116522A1 (en) * | 2016-12-19 | 2018-06-28 | 日本電信電話株式会社 | Determination device, determination method, and determination program |
| CN107621934A (en) * | 2017-07-28 | 2018-01-23 | 中国人民解放军国防信息学院 | Based on modularization, the evaluation index computational methods of graphical operator and device |
| US20200081916A1 (en) * | 2018-09-12 | 2020-03-12 | Business Objects Software Ltd. | Predictive modeling with machine learning in data management platforms |
| CN111382347A (en) * | 2018-12-28 | 2020-07-07 | 广州市百果园信息技术有限公司 | Object feature processing and information pushing method, device and equipment |
| CN110851428A (en) * | 2019-11-19 | 2020-02-28 | 厦门市美亚柏科信息股份有限公司 | Database analysis method, device and medium based on rule operator dynamic arrangement |
| CN112925838A (en) * | 2019-12-06 | 2021-06-08 | 阿里巴巴集团控股有限公司 | Data processing method and device |
| CN111080170A (en) * | 2019-12-30 | 2020-04-28 | 北京云享智胜科技有限公司 | Workflow modeling method and device, electronic equipment and storage medium |
| CN111752870A (en) * | 2020-05-28 | 2020-10-09 | 苏州浪潮智能科技有限公司 | Compatible method and system of server interface based on neural network |
| CN112069456A (en) * | 2020-09-21 | 2020-12-11 | 北京明略昭辉科技有限公司 | Model file generation method and device, electronic equipment and storage medium |
| CN112148455A (en) * | 2020-09-29 | 2020-12-29 | 星环信息科技（上海）有限公司 | Task processing method, device and medium |
| CN112684907A (en) * | 2020-12-24 | 2021-04-20 | 科大讯飞股份有限公司 | Text input method, device, equipment and storage medium |
| CN112632082A (en) * | 2020-12-30 | 2021-04-09 | 中国农业银行股份有限公司 | Method and device for creating Flink operation |
| CN112632960A (en) * | 2021-01-06 | 2021-04-09 | 北京启明星辰信息安全技术有限公司 | Log analysis method and system based on dynamic field template |
| CN113032611A (en) * | 2021-03-12 | 2021-06-25 | 浙江大华技术股份有限公司 | Data processing method, target tracking method and related device |
Non-Patent Citations (3)
| Title |
|---|
| WANG C , LI X , ZHANG J 等: "Architecture Support for Task Out-of-Order Execution in MPSoCs", COMPUTERS IEEE TRANSACTIONS ON, 9 April 2014 (2014-04-09), pages 1296 - 1310 * |
| 樊春美;朱建生;单杏花;杨立鹏;李雯;: "基于Flink实时计算的自动化流控制算法", 计算机技术与发展, no. 8, 10 August 2020 (2020-08-10), pages 72 - 78 * |
| 陈波;王延章;: "基于关联token自适应字段匹配算法设计", 计算机工程与设计, no. 19, 16 October 2010 (2010-10-16), pages 106 - 109 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115494989A (en) * | 2022-11-17 | 2022-12-20 | 帆软软件有限公司帆软南京分公司 | Analysis node generation method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113469284B (en) | 2024-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109376069B (en) | Method and device for generating test report | |
| US9658834B2 (en) | Program visualization device, program visualization method, and program visualization program | |
| CN111181805B (en) | Micro-service test baffle generation method and system based on test case | |
| CN113268403B (en) | Time series analysis and prediction method, device, equipment and storage medium | |
| CN113326283A (en) | Method and device for calculating service index | |
| CN107797805B (en) | Code packaging method and device and computer readable storage medium | |
| US9367307B2 (en) | Staged points-to analysis for large code bases | |
| CN113377372A (en) | Business rule analysis method and device, computer equipment and storage medium | |
| CN113469284B (en) | Data analysis method, device and storage medium | |
| CN109241511B (en) | Electronic report generation method and equipment | |
| CN117033309A (en) | Data conversion method and device, electronic equipment and readable storage medium | |
| JP7015320B2 (en) | Data analysis support device, data analysis support method and data analysis support program | |
| CN113495723B (en) | Method, device and storage medium for calling functional component | |
| CN111859985B (en) | AI customer service model test method and device, electronic equipment and storage medium | |
| CN111338966B (en) | Big data processing detection method and device of data source table | |
| US11281458B2 (en) | Evaluation of developer organizations | |
| JP6660333B2 (en) | Information extraction device, information extraction method, and information extraction program | |
| CN112099794A (en) | Front-end project construction method and device | |
| EP4123479A2 (en) | Method and apparatus for denoising click data, electronic device and storage medium | |
| WO2015145538A1 (en) | Program chart creation device, program chart creation method, and program chart creation program | |
| CN115291889B (en) | Data blood relationship establishing method and device and electronic equipment | |
| WO2015063954A1 (en) | Program diagram creation device, program diagram creation method, and program diagram creation program | |
| CN117742779A (en) | Method, device, equipment and storage medium for checking resource configuration information | |
| CN115407983A (en) | Business model establishing method and business processing method | |
| CN117609721A (en) | SQL data analysis method and system based on Fidelius |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |