CN111625521A - Management method, system, medium and device constructed based on visual data set - Google Patents
Management method, system, medium and device constructed based on visual data set Download PDFInfo
- Publication number
- CN111625521A CN111625521A CN202010756092.1A CN202010756092A CN111625521A CN 111625521 A CN111625521 A CN 111625521A CN 202010756092 A CN202010756092 A CN 202010756092A CN 111625521 A CN111625521 A CN 111625521A
- Authority
- CN
- China
- Prior art keywords
- data
- data set
- nodes
- parameter configuration
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/211—Schema design and management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a management method, a system, a medium and equipment based on visual data set construction, wherein the management method based on visual data set construction comprises the following steps: acquiring an operation command aiming at a data node; the data nodes have data operation attributes corresponding to the data nodes; performing parameter configuration on the data nodes according to the operation command, and generating a data network with a topological structure according to the result of the parameter configuration and the dependency relationship between the data nodes; and constructing a data set by combining the dependency relationship of the data network and the data operation attribute of the data node. The invention provides a simple and easy-to-operate tool, which is used for business personnel to efficiently, reliably and flexibly build the calculation logic of the modeling data set, realizes the multiplexing among a plurality of projects, and greatly improves the efficiency and quality of the data set construction link.
Description
Technical Field
The invention belongs to the technical field of data set construction, relates to a data set construction method, and particularly relates to a management method, a management system, a management medium and management equipment based on visual data set construction.
Background
At present, the construction of modeling data sets is a most fundamental and extremely important link. Although many automatic training works already exist in links such as machine learning, tools are still lacked in the aspect of data set construction, and business personnel can independently complete the data set construction work containing responsible computing logic. The problems with existing systems are mainly focused on the following: (1) the tool, such as a tool like a button, needs a professional IT skill to use, and the user needs a certain programming development support to master the tool. (2) It is difficult to flexibly support various types of complex computational logic. (3) It is difficult to define the variables for batch completion. (4) It is difficult to multiplex the definition of variables between multiple items.
Therefore, how to provide a management method, system, medium and device constructed based on a visual data set to solve the defects that the prior art cannot provide a simple, easy-to-operate and efficient data set construction method, and the like, is a technical problem to be solved by those skilled in the art.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, an object of the present invention is to provide a management method, system, medium and device based on visualization data set construction, which is used to solve the problem that the prior art cannot provide a simple, easy-to-operate and efficient data set construction method.
To achieve the above and other related objects, an aspect of the present invention provides a management method constructed based on a visualized data set, including: acquiring an operation command aiming at a data node; the data nodes have data operation attributes corresponding to the data nodes; performing parameter configuration on the data nodes according to the operation command, and generating a data network with a topological structure according to the result of the parameter configuration and the dependency relationship between the data nodes; the parameter configuration refers to configuring parameters of computing logic corresponding to the data nodes so as to clarify the data operation attributes; and constructing a data set by combining the dependency relationship of the data network and the data operation attribute of the data node.
In an embodiment of the present invention, the operation instruction is a computing component dragging instruction; the step of obtaining the operation command for the data node comprises the following steps: and acquiring the computing component dragging instruction sent by the user aiming at the required data node so as to determine the data operation required by the user currently.
In an embodiment of the present invention, the step of performing parameter configuration on the data nodes according to the operation command, and generating a data network having a topology structure according to a result of the parameter configuration and a dependency relationship between the data nodes includes: generating a parameter configuration form according to the operation command; performing corresponding parameter configuration in the parameter configuration form according to the data operation attribute of the data node; determining the dependency relationship among different data nodes according to the created path of the data nodes; and generating the data network by combining the topological structures of the data nodes under the dependency relationship.
In an embodiment of the present invention, the step of performing corresponding parameter configuration in the parameter configuration form according to the data operation attribute of the data node includes: determining data operation attributes of the data nodes; the data operation attribute comprises screening, grouping aggregation, association and line-by-line operation; and carrying out corresponding parameter configuration according to the data operation attribute.
In an embodiment of the present invention, the step of constructing the data set by combining the dependency relationship of the data network and the data operation attribute of the data node includes: determining data corresponding to each data node according to the parameter configuration result; determining a logical operation relationship between different data nodes by combining the dependency relationship of the data network and the data operation attribute of the data nodes; and constructing the data set according to the logical operation relation in the data network.
In an embodiment of the present invention, the management method constructed based on the visualized data set further includes: and modifying the data set, including closing data nodes which do not need to be calculated and adjusting parameter configuration of the data nodes.
In an embodiment of the present invention, a logical operation path to be closed is determined, and a data node on the upstream of the logical operation path is closed; acquiring a parameter configuration instruction of a data node, and re-determining a data range corresponding to the data node by combining the parameter configuration instruction.
In another aspect, the present invention provides a management system constructed based on a visual data set, including: the instruction acquisition module is used for acquiring an operation command aiming at the data node; the data nodes have data operation attributes corresponding to the data nodes; the parameter configuration module is used for configuring parameters of the data nodes according to the operation command and generating a data network with a topological structure according to the result of parameter configuration and the dependency relationship among the data nodes; the parameter configuration refers to configuring parameters of computing logic corresponding to the data nodes so as to clarify the data operation attributes; and the data set construction module is used for constructing a data set by combining the dependency relationship of the data network and the data operation attribute of the data node.
A further aspect of the invention provides a medium on which a computer program is stored which, when being executed by a processor, carries out the method of managing a set of data based on a visualization.
A final aspect of the invention provides an apparatus comprising: a processor and a memory; the memory is used for storing a computer program, and the processor is used for executing the computer program stored by the memory so as to enable the device to execute the management method constructed based on the visual data set.
As described above, the management method, system, medium, and apparatus constructed based on the visualized data set according to the present invention have the following advantages:
the invention provides a simple and convenient tool easy to operate for business personnel through visual computing assembly dragging instructions, breaks through the limits of professional skills and special tools, provides the business personnel with high efficiency, reliably and flexibly builds the modeling data set computing logic, realizes the multiplexing among a plurality of projects, and greatly improves the efficiency and quality of a data set construction link. Through the flexible configuration of the execution sequence and parameters of specific computing components, a business person can construct a required data set through any complex computing process.
Drawings
FIG. 1 is a schematic flow chart diagram illustrating a management method based on visual data set construction according to an embodiment of the present invention.
Fig. 2 is a flowchart illustrating a data network generation process of the management method based on visual data set construction according to an embodiment of the present invention.
Fig. 3 is a schematic parameter configuration diagram of a management method constructed based on a visual data set according to an embodiment of the invention.
Fig. 4 is a schematic diagram illustrating a dependency relationship of a management method constructed based on a visual data set according to an embodiment of the present invention.
Fig. 5 is a flow chart illustrating a data set construction process of the management method based on visual data set construction according to an embodiment of the present invention.
Fig. 6 is a schematic diagram illustrating modification of a data set according to an embodiment of the management method based on a visualized data set.
FIG. 7 is a schematic diagram of a management system constructed based on a visual data set according to an embodiment of the present invention.
Fig. 8 is a schematic structural connection diagram of a management device constructed based on a visual data set according to an embodiment of the present invention.
Fig. 9 is a schematic view illustrating operations of data nodes in an embodiment of a management method based on a visual data set according to the present invention.
Fig. 10 is a parameter configuration interface diagram of a management method constructed based on a visual data set according to an embodiment of the present invention.
Fig. 11 is a schematic view of data set association in an embodiment of the management method based on visualized data set construction according to the present invention.
Description of the element reference numerals
Management system constructed based on visual data set
71 instruction acquisition module
72 parameter configuration module
73 data set construction module
8 device
81 processor
82 memory
83 communication interface
84 system bus
S11 to S13
S121 to S124
S131 to S133.
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
The management method based on the visual data set construction provides a simple and easy-to-operate data set construction tool, business personnel can efficiently, reliably and flexibly construct the calculation logic of the modeling data set, the multiplexing among a plurality of projects is realized, and the efficiency and the quality of the data set construction link are greatly improved.
The principle and implementation of the management method, system, medium and apparatus constructed based on the visualized data set according to the present embodiment will be described in detail below with reference to fig. 1 to 11, so that those skilled in the art can understand the management method, system, medium and apparatus constructed based on the visualized data set without creative work.
Referring to fig. 1, a schematic flow chart of a management method based on visualization data set construction according to an embodiment of the invention is shown. As shown in fig. 1, the management method constructed based on the visualization data set specifically includes the following steps:
s11, acquiring an operation command for the data node; the data nodes have data operation attributes corresponding thereto.
In the present embodiment, S11 includes: and acquiring the computing component dragging instruction sent by the user aiming at the required data node so as to determine the data operation required by the user currently.
S12, according to the operation command, the parameter configuration of the data nodes is carried out, and according to the result of the parameter configuration and the dependency relationship between the data nodes, a data network with a topological structure is generated. The parameter configuration refers to configuring parameters of computing logic corresponding to the data nodes so as to clarify the data operation attributes.
Referring to fig. 2, a data network generation flow chart of a management method constructed based on a visual data set according to an embodiment of the present invention is shown. As shown in fig. 2, S12 includes:
and S121, generating a parameter configuration form according to the operation command.
And S122, performing corresponding parameter configuration in the parameter configuration form according to the data operation attribute of the data node.
In the present embodiment, S122 includes:
(1) determining data operation attributes of the data nodes; the data operation attributes include screening, grouping and aggregation, association and line-by-line operation.
In particular, although the computing processes for different data sets are very diverse, they can be described in terms of basic computing logic, including but not limited to: screening, association, splicing, grouping and aggregation, duplication removal, conditional mapping and other data set logic calculation. The difference of different data set construction flows is reflected in the execution sequence of the basic computing components and different configuration parameters. The general computing components can flexibly support various complex computing flow logics through different combination forms.
List management is performed on different calculation components and parameters to be configured to form a table 1.
As shown in table 1, the screened computing components, the main configured parameters are the screening conditions; the calculation component of grouping and aggregation mainly configures parameters of grouping conditions and aggregation operation conditions; the system comprises an associated computing component, wherein the main configured parameters are an associated column and an associated mode, wherein the associated mode comprises left association and right association; the calculation component for line-by-line operation mainly configures parameters of an input column and an operation function.
Data set a and data set B are subjected to list management to form tables 2 and 3, respectively. And the left correlation is illustrated schematically by tables 2 and 3 to form table 4.
As can be seen from table 4, after the data set a and the data set B are left-related, all information of the data set a is retained, and a data record having a relationship between the data set a and the data set B is added. The data of the data set A and the data set B are records with id 2 and id 3, so that the name of the person with id 2 is judged to be Liqu in the data set A, and the gender is judged to be male in the data set B; the name of the person with id 3 is Chua III in the data set A, and the gender is a male in the data set B.
(2) And carrying out corresponding parameter configuration according to the data operation attribute.
Please refer to fig. 3, which is a schematic parameter configuration diagram of a management method constructed based on a visual data set according to an embodiment of the present invention. As shown in fig. 3, an observation point setting interface schematic of a certain data node when acquiring data is shown, and the start-stop time in _ time, the end time out _ time, and the data acquisition time interval that can be obtained for data are 24 h.
And S123, determining the dependency relationship among different data nodes according to the creation path of the data nodes.
And S124, generating the data network by combining the topological structure of the data nodes under the dependency relationship.
And S13, constructing a data set by combining the dependency relationship of the data network and the data operation attribute of the data node.
Please refer to fig. 4, which is a schematic diagram illustrating a dependency relationship of a management method constructed based on a visual data set according to an embodiment of the present invention. As shown in fig. 4, 3 screening nodes are included: the diagnosis is the VTE diagnosis after the ultrasonic diagnosis of the vein of the lower limb, the CT report diagnosis of the lung and the admission diagnosis. The screening node determines data corresponding to the node by configuring a certain screening condition, for example, the screening condition may be an observation point setting. Performing function row transformation on the nodes subjected to the lower limb vein ultrasonic diagnosis to judge VTE results, and then performing grouping and aggregation on the first records; and after the lung CT report treatment node logic is the same, the first recording node of the lower limb vein and the first recording node of the lung CT are integrated and merged, a difference set is obtained from the obtained data and the data of the node which is admitted and diagnosed as the VTE treatment node, and finally a required data set is constructed.
Referring to fig. 5, a data set construction flow chart of the management method based on visual data set construction according to an embodiment of the invention is shown. As shown in fig. 5, S13 includes:
s131, determining data corresponding to each data node according to the parameter configuration result.
And S132, determining the logical operation relationship among different data nodes by combining the dependency relationship of the data network and the data operation attribute of the data nodes.
S133, the data set is constructed according to the logical operation relation in the data network.
The management method based on the visual data set construction can realize the definition of batch variables, specifically, each calculation link can correspond to a plurality of variables instead of one variable, and the batch definition of the same type of variables is realized, so that the production efficiency of the data set construction is improved.
For example: for the time window screening-aggregation operation node, list management is performed on the detection items and the configuration parameters to form a table 5.
As can be seen from table 5, the data contained in one node is calculated by 1 × 3 × 2+1 × 2 × 1 = 8 variables through the selection of the configuration of the time window and the aggregation mode, which are: maximum red blood cell count within 1 day, minimum red blood cell count within 1 day, maximum red blood cell count within 7 days, minimum red blood cell count within 7 days, maximum red blood cell count within 1 month, minimum red blood cell count within 1 month, mean D2 mer within 1 day, and mean D2 mer within 7 days.
The above-described data set of 8 variables is automatically constructed by calculating the logical dependency of the components, so that the user does not have to define individually for each variable "maximum red blood cell count within 1 day, minimum red blood cell count within 1 day, maximum red blood cell count within 7 days, minimum red blood cell count within 7 days, maximum red blood cell count within 1 month, minimum red blood cell count within 1 month, average D2 mer within 1 day, and average D2 mer within 7 days".
In this embodiment, the management method constructed based on the visualized data set further includes: and modifying the data set, including closing data nodes which do not need to be calculated and adjusting parameter configuration of the data nodes.
Specifically, a logic operation path needing to be closed is determined, and a data node on the upstream of the logic operation path is closed.
Acquiring a parameter configuration instruction of a data node, and re-determining a data range corresponding to the data node by combining the parameter configuration instruction.
Please refer to fig. 6, which is a schematic view illustrating modification of a data set according to an embodiment of the management method based on a visualized data set according to the present invention. As shown in FIG. 6, for the same type of scenes, only one set of variable calculation logic needs to be maintained uniformly to realize the reusability of the variable definition. The requirements for different projects. The user can customize and modify the content in the following ways:
(1) turning off variables that do not need to be computed (which may be turned off by the configuration of the compute nodes), the system can automatically deduce which downstream compute nodes also need to be turned off.
In fig. 6, the user simply selects to turn off node B, and the system automatically deduces to turn off C, F the downstream associated computing node, and thus the path B-C-F is turned off. But a-C-F, D-E-C-F, D-E-F still performs its logical relationship in mind.
(2) And adjusting the parameters of the computing nodes.
For example, a computing node may function to select patients for a cardiology department, but the cardiology expressions may not necessarily be consistent from hospital to hospital. For example, a department of a first hospital's cardiology department may be said to be "intracardiac" in the database, but the statement may become "cardiology" in the alternative. Therefore, the same set of calculation flows may need to be configured in different scenarios to realize the multiplexing of the same set of variable calculation logic.
The two modes can realize the multiplexing of the constructed variable calculation logic. It is not necessary to rebuild the computational logic of the variables for each project.
In an embodiment of the present invention, a specific implementation of the management method constructed based on the visual data set is further described by taking a plurality of data node associations as an example.
Please refer to fig. 9, which is a schematic diagram illustrating operations of data nodes in an embodiment of a management method based on a visualized data set according to the present invention. As shown in fig. 9, there are four data nodes: reading a check report, screening a valid report, reading an mdm mapping table and reading a check detail. And respectively selecting three data nodes of the screening effective report, the reading mdm mapping table and the reading inspection detail, and displaying 'multi-node selection' while dragging, thereby popping up a form of configuration parameters.
Referring to fig. 10, a parameter configuration interface diagram of a management method constructed based on a visual data set according to an embodiment of the present invention is shown. As shown in FIG. 10, the interface displays the specific configuration content in the popped-up form. The method comprises the following steps: the operation type (in this embodiment, "association" is selected), and the node name is an association correlation table. There are a variety of ways of association, including left association, right association, inner association, and outer association.
Specifically, a data table file related to an upstream data node is automatically imported into an associated configuration form. The report _ id corresponds to a data node for screening the valid report, the laboratory examination detail corresponds to a data node for reading the verification detail, and the term dictionary corresponds to a data node for reading the mdm mapping table. Wherein, the term dictionary is used for unifying and mapping words among different hospitals. For example, the correspondence between cardiology and cardiology is substantially the same department under different names.
Please refer to fig. 11, which is a schematic diagram of data set association in an embodiment of a management method based on visualized data set construction according to the present invention. As shown in fig. 11, after the parameter configuration in the form is completed, clicking "ok" builds the associated data set according to the configured parameter. Namely, the data of the three data nodes of the effective report screening, the mdm reading mapping table and the inspection detail reading are correlated.
The protection scope of the management method constructed based on the visualized data set is not limited to the execution sequence of the steps listed in the embodiment, and all the schemes of adding, subtracting and replacing the steps in the prior art according to the principle of the present invention are included in the protection scope of the present invention.
The present embodiment provides a computer storage medium having stored thereon a computer program which, when being executed by a processor, implements the management method constructed on the basis of a visualization data set.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the above method embodiments may be performed by hardware associated with a computer program. The aforementioned computer program may be stored in a computer readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned computer-readable storage media comprise: various computer storage media that can store program codes, such as ROM, RAM, magnetic or optical disks.
The management system constructed based on the visualized data set provided by the embodiment will be described in detail with reference to the drawings. It should be noted that the division of the modules of the following system is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity or may be physically separated. And the modules can be realized in a form that all software is called by the processing element, or in a form that all the modules are realized in a form that all the modules are called by the processing element, or in a form that part of the modules are called by the hardware. For example: a module may be a separate processing element, or may be integrated into a chip of the system described below. Further, a certain module may be stored in the memory of the following system in the form of program code, and a certain processing element of the following system may call and execute the function of the following certain module. Other modules are implemented similarly. All or part of the modules can be integrated together or can be independently realized. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, the steps of the above method or the following modules may be implemented by hardware integrated logic circuits in a processor element or instructions in software.
The following modules may be one or more integrated circuits configured to implement the above methods, for example: one or more Application Specific Integrated Circuits (ASICs), one or more Digital Signal Processors (DSPs), one or more Field Programmable Gate Arrays (FPGAs), and the like. When some of the following modules are implemented in the form of a processing element calling program code, the processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of calling program code. These modules may be integrated together and implemented in the form of a System-on-a-chip (SOC).
Referring to fig. 7, a schematic structural diagram of a management system constructed based on a visual data set according to an embodiment of the present invention is shown. As shown in fig. 7, the management system 7 constructed based on the visualization data set includes: an instruction acquisition module 71, a parameter configuration module 72 and a data set construction module 73.
The instruction obtaining module 71 is configured to obtain an operation command for a data node; the data nodes have data operation attributes corresponding thereto.
In this embodiment, the instruction obtaining module 71 is specifically configured to obtain the computing component dragging instruction sent by the user for the required data node, so as to determine the data operation that the user currently needs to perform.
The parameter configuration module 72 is configured to perform parameter configuration on the data nodes according to the operation command, and generate a data network with a topology structure according to a result of the parameter configuration and a dependency relationship between the data nodes. The parameter configuration refers to configuring parameters of computing logic corresponding to the data nodes so as to clarify the data operation attributes.
In this embodiment, the parameter configuration module 72 is specifically configured to generate a parameter configuration form according to the operation command; performing corresponding parameter configuration in the parameter configuration form according to the data operation attribute of the data node; determining the dependency relationship among different data nodes according to the created path of the data nodes; and generating the data network by combining the topological structures of the data nodes under the dependency relationship.
The data set constructing module 73 is configured to construct a data set by combining the dependency relationships of the data network and the data operation attributes of the data nodes.
In this embodiment, the data set constructing module 73 is specifically configured to determine, according to a result of the parameter configuration, data corresponding to each data node; determining a logical operation relationship between different data nodes by combining the dependency relationship of the data network and the data operation attribute of the data nodes; and constructing the data set according to the logical operation relation in the data network.
The management system constructed based on the visualized data set can implement the management method constructed based on the visualized data set, but the implementation device of the management method constructed based on the visualized data set includes, but is not limited to, the structure of the management system constructed based on the visualized data set, which is exemplified in this embodiment, and all the structural modifications and substitutions of the prior art made according to the principle of the present invention are included in the protection scope of the present invention.
Please refer to fig. 8, which is a schematic structural connection diagram of a management apparatus constructed based on a visual data set according to an embodiment of the present invention. As shown in fig. 8, the present embodiment provides an apparatus 8, the apparatus 8 including: a processor 81, memory 82, communication interface 83, or/and system bus 84; the memory 82 and the communication interface 83 are connected to the processor 81 through a system bus 84 and perform communication with each other, the memory 82 is used for storing computer programs, the communication interface 83 is used for communicating with other devices, and the processor 81 is used for executing the computer programs to enable the device 8 to execute the steps of the management method constructed based on the visual data set.
The system bus 84 mentioned above may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The system bus may be divided into an address bus, a data bus, a control bus, and the like. The communication interface 83 is used to enable communication between the database access device and other devices (e.g., clients, read-write libraries, and read-only libraries). The Memory 82 may include a Random Access Memory (RAM), and may further include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory.
The Processor 81 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete gate or transistor logic device, discrete hardware component.
In summary, the management method, the management system, the management medium and the management equipment based on the visual data set construction provide a simple and easy-to-operate tool for business personnel through visual calculation component dragging instructions, break through the limitations of professional skills and special tools, enable the business personnel to efficiently, reliably and flexibly construct the calculation logic of the modeling data set, realize the multiplexing among a plurality of projects, and greatly improve the efficiency and the quality of a data set construction link. Through the flexible configuration of the execution sequence and parameters of a specific computing component, a business person can construct a required data set through any complex computing flow. The invention effectively overcomes various defects in the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.
Claims (10)
1. A management method constructed based on a visual data set is characterized by comprising the following steps:
acquiring an operation command aiming at a data node; the data nodes have data operation attributes corresponding to the data nodes;
performing parameter configuration on the data nodes according to the operation command, and generating a data network with a topological structure according to the result of the parameter configuration and the dependency relationship between the data nodes; the parameter configuration refers to configuring parameters of computing logic corresponding to the data nodes so as to clarify the data operation attributes;
and constructing a data set by combining the dependency relationship of the data network and the data operation attribute of the data node.
2. The visual data set construction-based management method according to claim 1, wherein the operation instruction is a computing component dragging instruction; the step of obtaining the operation command for the data node comprises the following steps:
and acquiring the computing component dragging instruction sent by the user aiming at the required data node so as to determine the data operation required by the user currently.
3. The management method constructed based on the visualized data set according to the claim 1, wherein the step of configuring the parameters of the data nodes according to the operation commands and generating the data network with the topological structure according to the result of configuring the parameters and the dependency relationship between the data nodes comprises:
generating a parameter configuration form according to the operation command;
performing corresponding parameter configuration in the parameter configuration form according to the data operation attribute of the data node;
determining the dependency relationship among different data nodes according to the created path of the data nodes;
and generating the data network by combining the topological structures of the data nodes under the dependency relationship.
4. The visualized data set construction-based management method according to claim 3, wherein the step of performing corresponding parameter configuration in the parameter configuration form according to the data operation attributes of the data nodes comprises:
determining data operation attributes of the data nodes; the data operation attribute comprises screening, grouping aggregation, association and line-by-line operation;
and carrying out corresponding parameter configuration according to the data operation attribute.
5. The method for managing based on visualized data set construction according to claim 3, wherein the step of constructing the data set by combining the dependency relationship of the data network and the data operation attribute of the data node comprises:
determining data corresponding to each data node according to the parameter configuration result;
determining a logical operation relationship between different data nodes by combining the dependency relationship of the data network and the data operation attribute of the data nodes;
and constructing the data set according to the logical operation relation in the data network.
6. The visual data set construction-based management method according to claim 1, further comprising:
and modifying the data set, including closing data nodes which do not need to be calculated and adjusting parameter configuration of the data nodes.
7. The visualization-based data set building management method of claim 6, wherein:
determining a logic operation path needing to be closed, and closing a data node at the upstream of the logic operation path;
acquiring a parameter configuration instruction of a data node, and re-determining a data range corresponding to the data node by combining the parameter configuration instruction.
8. A management system constructed based on a visual data set, the management system constructed based on the visual data set comprising:
the instruction acquisition module is used for acquiring an operation command aiming at the data node; the data nodes have data operation attributes corresponding to the data nodes;
the parameter configuration module is used for configuring parameters of the data nodes according to the operation command and generating a data network with a topological structure according to the result of parameter configuration and the dependency relationship among the data nodes; the parameter configuration refers to configuring parameters of computing logic corresponding to the data nodes so as to clarify the data operation attributes;
and the data set construction module is used for constructing a data set by combining the dependency relationship of the data network and the data operation attribute of the data node.
9. A medium on which a computer program is stored which, when being executed by a processor, carries out the method of managing based on a visual data set building of any one of claims 1 to 7.
10. An apparatus, comprising: a processor and a memory;
the memory is configured to store a computer program, and the processor is configured to execute the computer program stored by the memory to cause the apparatus to perform the management method constructed based on the visualized data set according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010756092.1A CN111625521B (en) | 2020-07-31 | 2020-07-31 | Management method, system, medium and device constructed based on visual data set |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010756092.1A CN111625521B (en) | 2020-07-31 | 2020-07-31 | Management method, system, medium and device constructed based on visual data set |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111625521A true CN111625521A (en) | 2020-09-04 |
| CN111625521B CN111625521B (en) | 2020-11-13 |
Family
ID=72259597
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010756092.1A Active CN111625521B (en) | 2020-07-31 | 2020-07-31 | Management method, system, medium and device constructed based on visual data set |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111625521B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113051819A (en) * | 2021-03-24 | 2021-06-29 | 依瞳科技(深圳)有限公司 | Visual modeling method, device, equipment and computer readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107545046A (en) * | 2017-08-17 | 2018-01-05 | 北京奇安信科技有限公司 | A kind of fusion method and device of multi-source heterogeneous data |
| US20190042917A1 (en) * | 2018-06-21 | 2019-02-07 | Intel Corporation | Techniques for determining artificial neural network topologies |
| CN110166312A (en) * | 2018-02-16 | 2019-08-23 | 丛林网络公司 | Network equipment model is automatically created using random test bed |
| CN110909039A (en) * | 2019-10-25 | 2020-03-24 | 北京华如科技股份有限公司 | Big data mining tool and method based on drag type process |
-
2020
- 2020-07-31 CN CN202010756092.1A patent/CN111625521B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107545046A (en) * | 2017-08-17 | 2018-01-05 | 北京奇安信科技有限公司 | A kind of fusion method and device of multi-source heterogeneous data |
| CN110166312A (en) * | 2018-02-16 | 2019-08-23 | 丛林网络公司 | Network equipment model is automatically created using random test bed |
| US20190042917A1 (en) * | 2018-06-21 | 2019-02-07 | Intel Corporation | Techniques for determining artificial neural network topologies |
| CN110909039A (en) * | 2019-10-25 | 2020-03-24 | 北京华如科技股份有限公司 | Big data mining tool and method based on drag type process |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113051819A (en) * | 2021-03-24 | 2021-06-29 | 依瞳科技(深圳)有限公司 | Visual modeling method, device, equipment and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111625521B (en) | 2020-11-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2909750B1 (en) | Specifying and applying rules to data | |
| US7587379B2 (en) | Method and system for capturing business rules for automated decision procession | |
| JP6449173B2 (en) | Building an application to configure a process | |
| US6965887B2 (en) | Rule processing methods for automating a decision and assessing satisfiability of rule-based decision diagrams | |
| US7809669B2 (en) | Rule processing system for determining a result response | |
| US10713572B2 (en) | Data discovery nodes | |
| WO2015048212A2 (en) | Evaluating rules applied to data | |
| WO2020113526A1 (en) | Chip verification method and device | |
| WO2005043356A2 (en) | Methods and systems for automated data processing | |
| US20070156742A1 (en) | Visual modeling method and apparatus | |
| CN111625521B (en) | Management method, system, medium and device constructed based on visual data set | |
| CN113434220A (en) | Method, device and equipment for constructing workflow and computer storage medium | |
| CN111858643B (en) | Database variable production method, system, computer device and storage medium | |
| CN114610648A (en) | Test method, device and equipment | |
| US8010572B1 (en) | Kstore scenario simulator processor and XML file | |
| US20070156755A1 (en) | Data source mapping method and apparatus | |
| CN112015423A (en) | Data processing system and method | |
| WO2024066576A1 (en) | Software configuration method and apparatus | |
| US11586791B1 (en) | Visualization of data buses in circuit designs | |
| US20220091824A1 (en) | Scope-based visual-programming mechanism | |
| Cao et al. | Causal Discovery from Unknown Interventional Datasets over Overlapping Variable Sets | |
| Janssenswillen et al. | Reproducible Process Analytics | |
| Mallick et al. | ChatVis: Automating Scientific Visualization with a Large Language Model | |
| CN117973183A (en) | Simulation model verification method and system based on visual pipeline mode | |
| Singh | Mathematical principles in software quality engineering |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |