CN117389983A - Method and device for constructing flow-oriented data warehouse - Google Patents
Method and device for constructing flow-oriented data warehouse Download PDFInfo
- Publication number
- CN117389983A CN117389983A CN202311146932.2A CN202311146932A CN117389983A CN 117389983 A CN117389983 A CN 117389983A CN 202311146932 A CN202311146932 A CN 202311146932A CN 117389983 A CN117389983 A CN 117389983A
- Authority
- CN
- China
- Prior art keywords
- data
- model
- flow
- dimension
- parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 120
- 238000010276 construction Methods 0.000 claims abstract description 38
- 238000013507 mapping Methods 0.000 claims abstract description 27
- 238000003860 storage Methods 0.000 claims abstract description 15
- 238000004140 cleaning Methods 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 9
- 230000008569 process Effects 0.000 description 18
- 238000010586 diagram Methods 0.000 description 12
- 238000004458 analytical method Methods 0.000 description 10
- 238000012545 processing Methods 0.000 description 10
- 230000009286 beneficial effect Effects 0.000 description 8
- 230000001419 dependent effect Effects 0.000 description 7
- 230000003993 interaction Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000005299 abrasion Methods 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010924 continuous production Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000005553 drilling Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000000227 grinding Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 238000003801 milling Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/211—Schema design and management
- G06F16/212—Schema design and management with details for data modelling support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Quality & Reliability (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a method and a device for constructing a flow-oriented data warehouse, a computer-readable storage medium and electronic equipment, wherein the method comprises the following steps: constructing a standardized data structure, and carrying out parameterization on the standardized data structure to obtain a parameter model; constructing a conceptual model, wherein the conceptual model comprises a flow unit and an object unit, and the object unit is inherited to the flow unit; based on the standardized data structure, carrying out standardized representation on the flow unit and the object unit to obtain a multi-dimensional data table, and carrying out model construction by taking the flow table in the multi-dimensional data table as a main real table to obtain a logic model; establishing a mapping relation between the parameter model and the logic model; and filling the industrial data corresponding to the parameter model into the logic model based on the mapping relation to obtain a data warehouse physical model.
Description
Technical Field
The invention relates to the technical field of industrial software, in particular to a method and a device for constructing a flow-oriented data warehouse.
Background
With the rapid development of industrial information technology, various industrial software is widely used in industrial enterprises in order to improve the working efficiency of the industrial enterprises. However, different industrial software corresponds to different software platforms and is stored in different databases, so that the problem of data islanding is caused, data interaction is difficult, a large amount of industrial data is difficult to effectively use, and the applicability of the industrial data is low.
Disclosure of Invention
The invention provides a method and a device for constructing a flow-oriented data warehouse, a computer-readable storage medium and electronic equipment, and aims to solve the technical problem of low applicability of industrial data in the prior art.
According to a first aspect of the present invention, there is provided a method for constructing a flow-oriented data warehouse, including:
constructing a standardized data structure, and carrying out parameterization on the standardized data structure to obtain a parameter model;
constructing a conceptual model, wherein the conceptual model comprises a flow unit and an object unit, and the object unit is inherited to the flow unit;
based on the standardized data structure, carrying out standardized representation on the flow unit and the object unit to obtain a multi-dimensional data table, and carrying out model construction by taking the flow table in the multi-dimensional data table as a main real table to obtain a logic model;
Establishing a mapping relation between the parameter model and the logic model;
and filling the industrial data corresponding to the parameter model into the logic model based on the mapping relation to obtain a data warehouse physical model.
Optionally, the multi-dimensional data table comprises a flow table, a product dimension table, a method dimension table, a workpiece dimension table, a device dimension table, a personnel dimension table, a time dimension table and a place dimension table; the method for constructing the model by taking the flow table in the multidimensional data table as a main real table to obtain a logic model comprises the following steps:
taking the flow table as a main fact table, and respectively linking the flow table with the product dimension table and the method dimension table;
respectively linking the product dimension table with the equipment dimension table and the workpiece dimension table; and respectively linking a method dimension table with the personnel dimension table, the time dimension table and the place dimension table to obtain the logic model.
Optionally, the building a standardized data structure includes:
storing raw data of the industrial system in a raw data layer;
storing the original data in a basic data layer, and performing data cleaning on the original data to obtain cleaning data;
and carrying out standardized representation on the cleaning data in a unified data layer, and carrying out multi-dimension division on the data after standardized representation to obtain the standardized data structure.
Optionally, after the step of obtaining the standardized data structure, the method further comprises:
an analytical data layer is constructed for providing data to an intelligent analytical model within an industrial system, and a data warehouse physical model is used for providing data to the analytical data layer.
Optionally, the standardized data structure is a five-dimensional four-layer structure including a personnel dimension, a location dimension, a time dimension, a product dimension, and a method dimension, and a system layer, an object layer, a parameter layer, and a data layer.
Optionally, the flow unit takes personnel, places, time, products and methods as attributes;
the object unit takes personnel, places, time, object names, object numbers, object purposes and object fields as attributes.
Optionally, before the step of filling the industrial data corresponding to the parameter model into the logic model based on the mapping relation to obtain a data warehouse physical model, the method includes:
determining parameter values of a parameter model based on scene data corresponding to each industrial scene; and inputting the parameter value into the parameter model, and determining industrial data corresponding to the parameter model.
According to a second aspect of the present invention, there is provided a construction apparatus for a flow-oriented data warehouse, including:
the data structure construction module is used for constructing a standardized data structure and carrying out parameterization on the standardized data structure to obtain a parameter model;
the system comprises a conceptual model construction module, a control module and a control module, wherein the conceptual model construction module is used for constructing a conceptual model, the conceptual model comprises a flow unit and an object unit, and the object unit is inherited to the flow unit;
the logic model construction module is used for carrying out standardized representation on the flow unit and the object unit based on the standardized data structure to obtain a multi-dimensional data table, and carrying out model construction by taking the flow table in the multi-dimensional data table as a main real table to obtain a logic model;
the mapping relation establishing module is used for establishing a mapping relation between the parameter model and the logic model;
and the physical model construction module is used for filling the industrial data corresponding to the parameter model into the logic model based on the mapping relation to obtain a data warehouse physical model.
According to a third aspect of the present invention, there is provided a computer-readable storage medium storing a computer program for executing the above-described construction method of a flow-oriented data warehouse.
According to a fourth aspect of the present invention, there is provided an electronic device comprising:
a processor;
a memory for storing the processor-executable instructions;
the processor is configured to read the executable instruction from the memory, and execute the instruction to implement the method for constructing a flow-oriented data warehouse.
Compared with the prior art, the method and the device for constructing the flow-oriented data warehouse, the computer-readable storage medium and the electronic equipment provided by the invention at least have the following beneficial effects:
according to the technical scheme, the standardized data structure is constructed, the unified data expression form is provided, and parameterization is carried out on the standardized data structure to obtain the parameter model, and the parameter model is beneficial to improving the reusability of data. The method comprises the steps of constructing a conceptual model comprising a flow unit and an object unit, and enabling the object unit to be inherited to the flow unit, namely, when the conceptual model is constructed, taking one flow unit of an industrial system as a construction unit, so that the accuracy of the conceptual model is ensured. And then carrying out standardized representation on the flow unit and the object unit according to the standardized data structure to obtain a multi-dimensional data table, wherein the multi-dimensional data table comprises the flow table, and carrying out model construction by taking the flow table as a main real table to obtain a logic model, namely, when the logic model is constructed, taking the flow as the main line to ensure the accuracy of the logic model. And establishing a mapping relation between the parameter model and the logic model, filling industrial data corresponding to the parameter model into the logic model through the mapping relation to obtain a data warehouse physical model, wherein the obtained data warehouse physical model has a standardized data expression form, can carry out structural treatment and integration on massive industrial data in a data source to form a data base, realizes data interaction, enables a large amount of industrial data to be effectively utilized, has higher applicability, and has better reusability.
Drawings
In order to more clearly illustrate the technical solutions of the present invention, the drawings that are needed in the description of the present invention will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort to a person skilled in the art.
FIG. 1 is a flow diagram of a method for building a flow-oriented data warehouse according to an exemplary embodiment of the present invention;
FIG. 2 is a schematic diagram of a data warehouse architecture in a method for constructing a flow-oriented data warehouse according to an exemplary embodiment of the present invention;
FIG. 3 is a schematic diagram of the structure of a flow unit and an object unit in a method for constructing a flow-oriented data warehouse according to an exemplary embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a logic model in a method for constructing a flow-oriented data warehouse according to an exemplary embodiment of the present invention;
FIG. 5 is a schematic flow diagram of parameterization in a method of constructing a flow-oriented data warehouse according to an exemplary embodiment of the present invention;
FIG. 6 is a schematic diagram of a construction apparatus of a flow-oriented data warehouse according to an exemplary embodiment of the present invention;
Fig. 7 is a block diagram of an electronic device according to an exemplary embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made more apparent and fully hereinafter with reference to the accompanying drawings, in which some, but not all embodiments of the invention are shown. All other embodiments, which can be made by one of ordinary skill in the art without creative efforts, based on the embodiments of the present invention are within the protection scope of the present embodiments.
With the rapid development of industrial information technology, various industrial software is widely used in industrial enterprises in order to improve the working efficiency of the industrial enterprises. However, different industrial software corresponds to different software platforms and is stored in different databases, the data structure standards are not uniform, the data meanings, formats and specifications are greatly different, the service semantics expressed by the data fields and the data tables are unknown, and therefore the problem of data island is caused, and the data interaction among different industrial software is difficult. Meanwhile, as the continuous production of the process industry proceeds, the data volume is greatly increased, the database size is increased, a large amount of industrial data is difficult to effectively utilize, and the applicability of the industrial data is low.
Exemplary method
Fig. 1 is a flow diagram of a method for constructing a flow-oriented data warehouse according to an exemplary embodiment of the present invention, which at least includes the following steps:
and 11, constructing a standardized data structure, and carrying out parameterization on the standardized data structure to obtain a parameter model.
The standardized data structure is used for providing a unified data expression form, and the unified data expression form is beneficial to the effective utilization of a large amount of industrial data. The parametric model is the result of parameterizing the standardized data structure.
The complexity of an industrial system and the multiple of services are considered, so that the running environments of equipment, process flows and the like in various industrial scenes are different, and therefore, equipment and required parameters in different scenes are different, algorithms used by different process flows are different, so that the data warehouse models constructed in different industrial scenes have differences and are difficult to multiplex; in this embodiment, after the standardized data structure is constructed, the standardized data structure is parameterized, that is, different data are displayed by using the same parameters, for example, the parameter x is introduced into the standardized data structure, and the length may be 1.5x, the width may be 1.2x, and the height may be 1.1x. If the length, the width and the height are changed from one industrial scene to another industrial scene, the data in the other industrial scene can be obtained quickly and accurately by changing the value of x, the migration multiplexing of the data warehouse can be realized, the parameter model can be used as a metadata model of the data warehouse, can be applied to all industrial software, has a simple and efficient structure, is convenient for users to comb and define an industrial system, reflects the connection and combination modes among various dimensions and layers, and has strong universality.
In one embodiment, the building a standardized data structure includes: storing raw data of the industrial system in a raw data layer; storing the original data in a basic data layer, and performing data cleaning on the original data to obtain cleaning data; and carrying out standardized representation on the cleaning data in a unified data layer, and carrying out multi-dimension division on the data after standardized representation to obtain the standardized data structure.
In this embodiment, as shown in fig. 2, an original data layer is constructed, where the original data layer is used to obtain original data of an industrial system, and collected data of initial features of all types and formats, such as sensor data of a robot, sensor data of a machine tool, sensor data of a motor, etc., are stored in the original data layer.
Further, a basic data layer is constructed, data cleaning is carried out on the original data, such as data cleaning is carried out on the original data through preprocessing means such as incomplete values, filling and removing of error values and the like, and characteristic processing means, cleaning data is obtained, and the cleaning data is stored in the basic data layer.
In one possible implementation manner, the basic data layer divides data into a product domain and a method domain according to two attributes of a product and a method of a process flow, wherein the product domain comprises data of equipment parameters, workpiece geometric parameters and the like, and the method domain comprises data of a robot arm/base position, a cutter rotating speed, workpiece stress and the like.
Further, a unified data layer is constructed, the unified data layer is a dimension data model based on a standardized data structure, data stored in a base layer are converted in modes of service fields, accessory description, point table mapping and the like, the standardized data maintains a unified standard form in terms of structures, types and the like, and unified dimension data information is provided for other layers through the standardized and unified data.
Further, an analytical data layer is constructed, the analytical data layer is used for providing data for an intelligent analytical model in the industrial system, and a data warehouse physical model is used for providing data for the analytical data layer. The analysis data layer is used for analyzing according to specific processing scenes, such as data analysis models including interference analysis, flutter analysis, abrasion loss prediction and the like, and is beneficial to effective application of industrial data.
The raw data layer, the base data layer, the unified data layer and the analysis data layer in this embodiment form a data warehouse architecture of the industrial system, and the data warehouse architecture is beneficial to providing the underlying data with unified dimensions and is beneficial to data interaction and data application.
In one embodiment, the standardized data structure is a five-dimensional four-layer structure including a personnel dimension, a place dimension, a time dimension, a product dimension, and a method dimension, as well as a system layer, an object layer, a parameter layer, and a data layer.
Specifically, at a system level, system information of an industrial system is defined. The system information includes a name of the industrial system, and if the industrial system includes a plurality of subsystems, the system information also includes a system name of the subsystems. The system information may also include description information for the industrial system including, but not limited to, the use of the industrial system, notes, etc.
At the object layer, determining target object information based on product concepts and product element attribute sets; determining target method information for the target object information based on the method concept and the method element attribute set; the target environment information is determined for the target object information based on the time concept, the time element attribute set, the space concept, the space element attribute set, the person concept, and the person element attribute set.
The product concept is used to indicate a product involved in an industrial system, which may include items, equipment, artifacts, etc. The product element attribute set is used for indicating various attributes of the product, wherein the various attributes are specific descriptions of the product, are characteristic information of the product, and can have clear and definite knowledge of the product, and the attributes can be geometric attributes, quality attributes and the like.
The method concepts are used to indicate methods involved in an industrial system, which may include processes, algorithms, and the like. The method element attribute set is used for indicating various attributes of the method, such as the stage of the method, the purpose of the method, a specific implementation means, and the like.
The time concept is used to indicate the time involved in an industrial system, which may include year, month, day, 12 hour system, 24 hour system, etc. The time element attribute set is used for indicating various attributes of time, for determining the stage at which the time element is located, a specific time value, and the like.
The space concept is used to indicate a space involved in an industrial system, which may also be referred to as a location concept, i.e. to indicate a location involved in an industrial system, which space may comprise an area, a division, etc. The space element attribute set is used to indicate various attributes of the space by which a specific place location, such as shop # 1, is determined.
The personnel concept is used to indicate personnel involved in an industrial system, which may include experts, project members, and the like. The personnel element attribute set is used to indicate various attributes of personnel, i.e., specific personnel.
In this embodiment, the concept is defined by the industrial system according to the concept in real life and the relationship between concepts, and the attribute mentioned in this embodiment is a feature of the concept and is generally used to indicate the specific content corresponding to the concept.
In one possible implementation, after the system layer defines the system name of the industrial system, the industrial system is entered, and first, a target object is defined, for example, the target object is determined in a defined product concept, and in a defined product element attribute set, attribute information related to the target object is determined, where the target object and the attribute information related to the target object form target object information.
After the target object information is determined, determining a target method corresponding to the target object, for example, determining the target method in the defined method concept, and determining attribute information related to the target method in the defined method element attribute set, wherein the target method and the attribute information related to the target method form target method information.
After the target object information and the target method information are determined, target environment information is further determined, wherein the target environment information comprises target time information, target space information and target personnel information.
When the target time information is determined, the target time is determined in the defined time concept, and the attribute information related to the target time is determined in the defined time element attribute set, wherein the target time and the attribute information related to the target time form the target time information.
When the target space information is determined, the target space is determined in the defined space concept, and the attribute information related to the target space is determined in the defined space element attribute set, wherein the target space and the attribute information related to the target space form the target space information.
When the target personnel information is determined, the target personnel is determined in the defined personnel concept, and the attribute information related to the target personnel is determined in the defined personnel element attribute set, wherein the target personnel information is formed by the target personnel and the attribute information related to the target personnel.
After the target space information, the target time information and the target personnel information are determined, the target environment information is determined for the target object information.
And at the parameter layer, determining the parameter dependent variable and the parameter fruit variable based on the target method information. And after the object layer is constructed, determining a parameter dependent variable and a parameter effect variable in the parameter layer according to the target method information. The parameter dependent variables represent parameters of the process object including geometric parameters, material parameters, performance parameters, etc. And calculating the parameter dependent variable by a target method, and determining the parameter dependent variable according to the obtained calculation result.
And in the data layer, carrying out operation based on the parameter dependent variable, the parameter effect variable and the target method information, namely determining specific numerical values corresponding to the parameter dependent variable, the target parameter method and the parameter effect variable as data layer information, and dividing the data layer information according to personnel dimension, place dimension, time dimension, product dimension and method dimension to obtain a plurality of dimension tables in the five-dimensional four-layer structure.
Step 12, constructing a conceptual model, wherein the conceptual model comprises a flow unit and an object unit, and the object unit is inherited to the flow unit.
The concept model is a result obtained by abstracting concepts in the industrial system. The conceptual model reflects the management requirement of the industrial process and is a basic premise for constructing a data warehouse. The conceptual model of the data warehouse comprises a flow unit and an object unit, the design of the conceptual model is shown in figure 3, and the flow unit takes personnel, places, time, products and methods as attributes; wherein, personnel, places and time are basic nodes, and products and methods are characteristic nodes. The object unit takes personnel, places, time, object names, object numbers, object purposes and object fields as attributes; wherein the personnel, the place and the time are basic nodes, the object name, the object number, the object use and the object field are characteristic nodes, the basic nodes are the common attributes of the flow units and the object units, and the characteristic nodes are the exclusive attributes of the flow units or the object units. The object unit inherits to the flow unit, that is, the corresponding object unit exists in the personnel node in the flow unit and is used for indicating specific personnel information; the location nodes in the flow unit are provided with corresponding object units for indicating specific location information; the time nodes in the flow unit have corresponding object units for indicating specific time information; the product nodes in the flow unit have corresponding object units for indicating specific product information; the method nodes in the flow unit have corresponding object units for indicating specific method information.
And step 13, carrying out standardized representation on the flow unit and the object unit based on the standardized data structure to obtain a multi-dimensional data table, and carrying out model construction by taking the flow table in the multi-dimensional data table as a main real table to obtain a logic model.
Specifically, the logical model of the data warehouse is converted on the basis of the conceptual model, and is converted into a standardized representation and a model which can be identified by a computer, and the logical model is similar to the conceptual model and does not exist real industrial data. In order to improve data consistency, when a logic model is constructed, a standardized representation is firstly carried out on a flow unit and an object unit according to a standardized data structure to obtain a multi-dimensional data table, wherein the multi-dimensional data table can comprise a flow table, a product dimension table, a method dimension table, a workpiece dimension table, a device dimension table, a personnel dimension table, a time dimension table and a place dimension table. And further, the flow table in the multidimensional data table is used as a main real table to carry out model construction to obtain a logic model, and the data warehouse construction form taking the flow as a main line is adopted, so that the accurate logic model is beneficial to obtaining, and the data loss caused by omission of any process flow is avoided.
In one embodiment, in step 13, the modeling is performed with the flow table in the multidimensional data table as a main real table to obtain a logic model, which includes:
and 131, taking the flow table as a main fact table, and respectively linking the flow table with the product dimension table and the method dimension table.
Step 132, linking the product dimension table with the equipment dimension table and the workpiece dimension table respectively; and respectively linking a method dimension table with the personnel dimension table, the time dimension table and the place dimension table to obtain the logic model.
Specifically, as shown in fig. 4, in the construction of the logic model, the flow table corresponding to the process flow is taken as the main fact table, namely, the top end of the umbrella model, and since the description of the process flow is that "something performs certain operations", the dimensions specifically associated with the flow table are divided into products and methods, so that the product dimension table and the method dimension table are added to the next layer of the flow table, namely, the flow table is respectively linked with the product dimension table and the method dimension table. The link mode is that the flow chart at the 1 layer contains the main key ID of the product dimension table and the method dimension table. The product involves two object dimensions, namely, the equipment dimension table and the workpiece dimension table, so that the equipment dimension table and the workpiece dimension table are added at the next layer of the product dimension table, and the product dimension table, the equipment dimension table and the workpiece dimension table are respectively linked in a way that the product dimension table at the second layer comprises the main key IDs of the equipment dimension table and the workpiece dimension table at the third layer. The method involves the operation by someone at a certain time and place, so that the next layer of the method dimension table is added with a time dimension table, a place dimension table and a personnel dimension table, and the method dimension table is respectively linked with the personnel dimension table, the time dimension table and the place dimension table in a way that the method dimension table at the two layers comprises the main key IDs of the personnel dimension table, the time dimension table and the place dimension table at the three layers. Finally, in actual processing, the industrial elements in different industrial scenes are mapped into a specific dimension level table in a multi-dimensional multi-level structure. And common attributes and feature attributes of the individual dimension industrial systems are included in the individual dimension tables.
In one possible implementation, the main fact table includes a process element parameter, where the process element parameter is used to indicate that the overall process flow corresponding to the industrial system is divided, that is, from a certain step to a certain step, into one sub-flow, and for the overall process flow, multiple sub-flows are included, and one sub-flow is regarded as one process element, so that the process element parameter is used as a measurement value of the overall process flow. When the logic model is constructed, the flow meta-parameters are used as traction to construct, so that the construction efficiency of the flow-oriented data warehouse is effectively improved.
And 14, establishing a mapping relation between the parameter model and the logic model.
The parameter model is a result obtained by parameterizing the standardized data structure, and comprises a plurality of dimension tables with parameters; the logic model is constructed according to the standardized data structure, so that the data representation between the parameter model and the logic model has consistency, and the possibility is provided for establishing the mapping relation between the parameter model and the logic model.
Specifically, a mapping relationship between the parameter model and the logic model is established, and a corresponding relationship can be established between a multidimensional data table in the logic model and a plurality of dimensional tables in the parameter model, so that data in the parameter model can be transmitted to the logic model to complete filling action on the logic model. For example, a product dimension table in the logic model may be linked to a product dimension table containing parameters in the parameter model, so that filling of the product dimension table in the logic model may be automatically completed when parameter values exist in the product dimension table in the parameter model.
In one possible implementation, the flow table in the logic model may be linked with the product dimension table and the method dimension table in the parameter model, the product dimension table in the logic model may be linked with the workpiece dimension table and the equipment dimension table in the parameter model, and the method dimension table in the logic model may be linked with the personnel dimension table, the time dimension table and the place dimension table in the parameter model, so that the change of the parameter in the parameter model affects the data filling of the logic model.
In an embodiment, the method further comprises:
step 16, determining parameter values of a parameter model according to scene data corresponding to each industrial scene and based on the scene data; and inputting the parameter value into the parameter model, and determining industrial data corresponding to the parameter model.
In this embodiment, different industrial scenes correspond to different scene data, for each scene data, according to the scene data, that is, the real operation data, a parameter value of a parameter model is determined, for example, for one scene data parameter x, the parameter value is 2, for another scene data parameter x, the parameter value is 1.2, and the parameter value is input into the parameter model to obtain industrial data corresponding to the parameter model, so that the industrial data corresponding to the parameter model mentioned in this embodiment refers to the industrial data obtained after the conversion by the parameter model. It should be noted that the process flow of the industrial system is complex, so the number of parameters in the parameter model may be at least one, for example, one parameter model may include a, b, c, d, e, f, and so on.
And 15, filling industrial data corresponding to the parameter model into the logic model based on the mapping relation to obtain a data warehouse physical model.
Specifically, according to the mapping relation between the parameter model and the logic model, industrial data corresponding to the parameter model is filled into the logic model to obtain a logic module containing real industrial data, namely a data warehouse physical model, wherein the data warehouse physical model is related to the parameter value of the parameter model, and the parameter value is related to an industrial scene, so that the data warehouse physical model is related to the industrial scene.
In a possible application scenario, the original data of the process such as milling, grinding, drilling and the like in the industrial system in the links such as design, simulation, manufacturing and the like are obtained, the data are analyzed, the data similarity is extracted, the data are extracted, converted and loaded to obtain a standardized data structure, the standardized data structure is parameterized to obtain a parametric model, namely a parameterized unified industrial data structure, the parameterized universal industrial data warehouse is obtained by utilizing the parametric model to construct the industrial system flow-oriented data warehouse, the universality is higher, the construction efficiency of the flow-oriented data warehouse is improved, the data interaction and the data application are facilitated, and unified multi-dimensional data support is provided for subsequent statistics, analysis and optimization.
In the above embodiment, by constructing the standardized data structure, a unified data expression form is provided, and parameterizing the standardized data structure, a parameter model is obtained, which is beneficial to improving the reusability of data. The method comprises the steps of constructing a conceptual model comprising a flow unit and an object unit, and enabling the object unit to be inherited to the flow unit, namely, when the conceptual model is constructed, taking one flow unit of an industrial system as a construction unit, so that the accuracy of the conceptual model is ensured. And then carrying out standardized representation on the flow unit and the object unit according to the standardized data structure to obtain a multi-dimensional data table, wherein the multi-dimensional data table comprises the flow table, and carrying out model construction by taking the flow table as a main real table to obtain a logic model, namely, when the logic model is constructed, taking the flow as the main line to ensure the accuracy of the logic model. And establishing a mapping relation between the parameter model and the logic model, filling industrial data corresponding to the parameter model into the logic model through the mapping relation to obtain a data warehouse physical model, wherein the obtained data warehouse physical model has a standardized data expression form, can carry out structural treatment and integration on massive industrial data in a data source to form a data base, realizes data interaction, enables a large amount of industrial data to be effectively utilized, has higher applicability, and has better reusability.
Exemplary apparatus
Based on the same conception as the embodiment of the method, the embodiment of the invention also provides a construction device of the flow-oriented data warehouse.
Fig. 6 is a schematic structural diagram of a construction apparatus of a flow-oriented data warehouse according to an exemplary embodiment of the present invention, including:
the data structure construction module 61 is configured to construct a standardized data structure, and perform parameterization on the standardized data structure to obtain a parameter model;
a conceptual model construction module 62, configured to construct a conceptual model, where the conceptual model includes a flow unit and an object unit, and the object unit inherits from the flow unit;
the logic model construction module 63 is configured to perform standardized representation on the flow unit and the object unit based on the standardized data structure to obtain a multidimensional data table, and perform model construction by using the flow table in the multidimensional data table as a main real table to obtain a logic model;
a mapping relationship establishing module 64, configured to establish a mapping relationship between the parameter model and the logic model;
and the physical model construction module 65 is configured to fill the industrial data corresponding to the parameter model into the logic model based on the mapping relationship, so as to obtain a data warehouse physical model.
In an exemplary embodiment of the present invention, the multi-dimensional data table includes a flow table, a product dimension table, a method dimension table, a workpiece dimension table, a device dimension table, a personnel dimension table, a time dimension table, and a place dimension table; the logic model construction module comprises:
the first link processing unit is used for taking the flow table as a main fact table and respectively linking the flow table with the product dimension table and the method dimension table;
the second link processing unit is used for respectively linking the product dimension table with the equipment dimension table and the workpiece dimension table; and respectively linking a method dimension table with the personnel dimension table, the time dimension table and the place dimension table to obtain the logic model.
In an exemplary embodiment of the present invention, the data structure construction module includes:
the original data acquisition unit is used for storing the original data of the industrial system in an original data layer;
the original data processing unit is used for storing the original data in the basic data layer and cleaning the original data to obtain cleaning data;
and the standardized processing unit is used for carrying out standardized representation on the cleaning data in a unified data layer, and carrying out multi-dimension division on the data after the standardized representation to obtain the standardized data structure.
In an exemplary embodiment of the present invention, the data structure building module further includes:
and the analysis layer construction unit is used for constructing an analysis data layer, the analysis data layer is used for providing data for an intelligent analysis model in the industrial system, and the data warehouse physical model is used for providing data for the analysis data layer.
In an exemplary embodiment of the present invention, the standardized data structure is a five-dimensional four-layer structure including a personnel dimension, a place dimension, a time dimension, a product dimension, and a method dimension, and a system layer, an object layer, a parameter layer, and a data layer.
In an exemplary embodiment of the present invention, the flow unit takes personnel, places, time, products and methods as attributes;
the object unit takes personnel, places, time, object names, object numbers, object purposes and object fields as attributes.
In an exemplary embodiment of the invention, the apparatus further comprises:
the industrial data acquisition module is used for determining parameter values of the parameter model according to scene data corresponding to each industrial scene and based on the scene data; and inputting the parameter value into the parameter model, and determining industrial data corresponding to the parameter model.
Exemplary electronic device
Fig. 7 illustrates a block diagram of an electronic device according to an embodiment of the invention.
As shown in fig. 7, the electronic device 70 includes one or more processors 71 and memory 72.
The processor 71 may be a Central Processing Unit (CPU) or other form of processing unit having data processing and/or instruction execution capabilities, and may control other components in the electronic device 70 to perform desired functions.
Memory 72 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, random Access Memory (RAM) and/or cache memory (cache), and the like. The non-volatile memory may include, for example, read Only Memory (ROM), hard disk, flash memory, and the like. One or more computer program instructions may be stored on the computer readable storage medium that can be executed by the processor 71 to implement the methods of constructing a flow-oriented data warehouse and/or other desired functions of the various embodiments of the present invention described above.
In one example, the electronic device 70 may further include: an input device 73 and an output device 74, which are interconnected by a bus system and/or other forms of connection mechanisms (not shown).
Of course, only some of the components of the electronic device 70 that are relevant to the present invention are shown in fig. 7 for simplicity, components such as buses, input/output interfaces, etc. are omitted. In addition, the electronic device 70 may include any other suitable components depending on the particular application.
Exemplary computer program product and computer readable storage Medium
In a sixth aspect, in addition to the methods and apparatus described above, embodiments of the invention may also be a computer program product comprising computer program instructions which, when executed by a processor, cause the processor to perform the steps in the method of constructing a flow-oriented data warehouse according to the various embodiments of the invention described in the "exemplary methods" section of this specification.
The computer program product may write program code for performing operations of embodiments of the present invention in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server.
Furthermore, embodiments of the present invention may also be a computer-readable storage medium, having stored thereon computer program instructions, which when executed by a processor, cause the processor to perform the steps in the method of constructing a flow-oriented data warehouse according to the various embodiments of the present invention described in the "exemplary methods" section above in this specification.
The computer readable storage medium may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The basic principles of the present invention have been described above in connection with specific embodiments, however, it should be noted that the advantages, benefits, effects, etc. mentioned in the present invention are merely examples and not intended to be limiting, and these advantages, benefits, effects, etc. are not to be considered as essential to the various embodiments of the present invention. Furthermore, the specific details of the invention described above are for purposes of illustration and understanding only, and are not intended to be limiting, as the invention may be practiced with the specific details described above.
The block diagrams of the devices, apparatuses, devices, systems referred to in the present invention are only illustrative examples and are not intended to require or imply that the connections, arrangements, configurations must be made in the manner shown in the block diagrams. As will be appreciated by one of skill in the art, the devices, apparatuses, devices, systems may be connected, arranged, configured in any manner. Words such as "including," "comprising," "having," and the like are words of openness and mean "including but not limited to," and are used interchangeably therewith. The terms "or" and "as used herein refer to and are used interchangeably with the term" and/or "unless the context clearly indicates otherwise. The term "such as" as used herein refers to, and is used interchangeably with, the phrase "such as, but not limited to.
It is also noted that in the apparatus, devices and methods of the present invention, the components or steps may be disassembled and/or assembled. Such decomposition and/or recombination should be considered as equivalent aspects of the present invention.
The previous description of the inventive aspects is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the invention. Thus, the present invention is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit embodiments of the invention to the form disclosed herein. Although a number of example aspects and embodiments have been discussed above, a person of ordinary skill in the art will recognize certain variations, modifications, alterations, additions, and subcombinations thereof.
Claims (10)
1. A method for constructing a flow-oriented data warehouse, comprising:
constructing a standardized data structure, and carrying out parameterization on the standardized data structure to obtain a parameter model;
constructing a conceptual model, wherein the conceptual model comprises a flow unit and an object unit, and the object unit is inherited to the flow unit;
based on the standardized data structure, carrying out standardized representation on the flow unit and the object unit to obtain a multi-dimensional data table, and carrying out model construction by taking the flow table in the multi-dimensional data table as a main real table to obtain a logic model;
establishing a mapping relation between the parameter model and the logic model;
and filling the industrial data corresponding to the parameter model into the logic model based on the mapping relation to obtain a data warehouse physical model.
2. The method of claim 1, wherein the multi-dimensional data table comprises a flow table, a product dimension table, a method dimension table, a workpiece dimension table, a device dimension table, a personnel dimension table, a time dimension table, and a place dimension table; the method for constructing the model by taking the flow table in the multidimensional data table as a main real table to obtain a logic model comprises the following steps:
taking the flow table as a main fact table, and respectively linking the flow table with the product dimension table and the method dimension table;
respectively linking the product dimension table with the equipment dimension table and the workpiece dimension table; and respectively linking a method dimension table with the personnel dimension table, the time dimension table and the place dimension table to obtain the logic model.
3. The method of claim 1, wherein said building a standardized data structure comprises:
storing raw data of the industrial system in a raw data layer;
storing the original data in a basic data layer, and performing data cleaning on the original data to obtain cleaning data;
and carrying out standardized representation on the cleaning data in a unified data layer, and carrying out multi-dimension division on the data after standardized representation to obtain the standardized data structure.
4. A method according to claim 3, wherein after the step of obtaining the standardized data structure, the method further comprises:
an analytical data layer is constructed for providing data to an intelligent analytical model within an industrial system, and a data warehouse physical model is used for providing data to the analytical data layer.
5. The method of claim 1, wherein the standardized data structure is a five-dimensional four-layer structure comprising a personnel dimension, a place dimension, a time dimension, a product dimension, and a method dimension, and a system layer, an object layer, a parameter layer, and a data layer.
6. The method of claim 5, wherein the flow unit is characterized by personnel, location, time, product, method;
the object unit takes personnel, places, time, object names, object numbers, object purposes and object fields as attributes.
7. The method according to claim 1, wherein before the step of filling the logical model with the industrial data corresponding to the parameter model based on the mapping relation to obtain a data warehouse physical model, the method comprises:
Determining parameter values of a parameter model based on scene data corresponding to each industrial scene; and inputting the parameter value into the parameter model, and determining industrial data corresponding to the parameter model.
8. A flow-oriented data warehouse building apparatus, comprising:
the data structure construction module is used for constructing a standardized data structure and carrying out parameterization on the standardized data structure to obtain a parameter model;
the system comprises a conceptual model construction module, a control module and a control module, wherein the conceptual model construction module is used for constructing a conceptual model, the conceptual model comprises a flow unit and an object unit, and the object unit is inherited to the flow unit;
the logic model construction module is used for carrying out standardized representation on the flow unit and the object unit based on the standardized data structure to obtain a multi-dimensional data table, and carrying out model construction by taking the flow table in the multi-dimensional data table as a main real table to obtain a logic model;
the mapping relation establishing module is used for establishing a mapping relation between the parameter model and the logic model;
and the physical model construction module is used for filling the industrial data corresponding to the parameter model into the logic model based on the mapping relation to obtain a data warehouse physical model.
9. A computer-readable storage medium storing a computer program for executing the method of constructing a flow-oriented data warehouse of any one of the preceding claims 1-7.
10. An electronic device, the electronic device comprising:
a processor;
a memory for storing the processor-executable instructions;
the processor is configured to read the executable instructions from the memory and execute the instructions to implement the method for building a flow-oriented data warehouse according to any of the preceding claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311146932.2A CN117389983A (en) | 2023-09-06 | 2023-09-06 | Method and device for constructing flow-oriented data warehouse |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311146932.2A CN117389983A (en) | 2023-09-06 | 2023-09-06 | Method and device for constructing flow-oriented data warehouse |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117389983A true CN117389983A (en) | 2024-01-12 |
Family
ID=89436262
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311146932.2A Pending CN117389983A (en) | 2023-09-06 | 2023-09-06 | Method and device for constructing flow-oriented data warehouse |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117389983A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150006467A1 (en) * | 2013-06-28 | 2015-01-01 | eBao Tech Corporation | Method and system for designing business domain model, data warehouse model and mapping therebetween synchronously |
| CN115658021A (en) * | 2022-11-07 | 2023-01-31 | 苏州数设科技有限公司 | Method and device for determining dynamic model, storage medium and electronic equipment |
| CN115794067A (en) * | 2022-11-07 | 2023-03-14 | 苏州数设科技有限公司 | Industrial software generation method and device, electronic equipment and readable storage medium |
-
2023
- 2023-09-06 CN CN202311146932.2A patent/CN117389983A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150006467A1 (en) * | 2013-06-28 | 2015-01-01 | eBao Tech Corporation | Method and system for designing business domain model, data warehouse model and mapping therebetween synchronously |
| CN115658021A (en) * | 2022-11-07 | 2023-01-31 | 苏州数设科技有限公司 | Method and device for determining dynamic model, storage medium and electronic equipment |
| CN115794067A (en) * | 2022-11-07 | 2023-03-14 | 苏州数设科技有限公司 | Industrial software generation method and device, electronic equipment and readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 陈兴 等: "基于维表结构的业务流程知识管理框架", 情报杂志, vol. 28, no. 10, 18 October 2009 (2009-10-18), pages 103 - 106 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116578040B (en) | Digital twin model construction method, system and terminal for machine tool fault diagnosis | |
| Abele et al. | Ontology-based validation of plant models | |
| CN114416855A (en) | Visualization platform and method based on electric power big data | |
| EP2827240A1 (en) | Method for generating control-code by a control-code-diagram | |
| WO2022252061A1 (en) | Knowledge-based assembly process planning method, apparatus and system | |
| Senington et al. | A linked data approach for the connection of manufacturing processes with production simulation models | |
| CN113901231A (en) | Method, device and medium for evolution analysis of knowledge graph | |
| CN114661968B (en) | Product data processing method, device and storage medium | |
| CN115809302A (en) | Metadata processing method, device, equipment and storage medium | |
| CN115357678A (en) | GIS automatic examination method and system based on structured natural language rule | |
| CN116821223A (en) | Industrial visual control platform and method based on digital twinning | |
| CN103186713A (en) | Method and web application for OEE-analysis | |
| CN114676961A (en) | Enterprise external migration risk prediction method and device and computer readable storage medium | |
| CN115658021B (en) | Determination method and device of dynamic model, storage medium and electronic equipment | |
| CN111767406B (en) | Knowledge representation method and device for PLC engineering | |
| CN117389983A (en) | Method and device for constructing flow-oriented data warehouse | |
| Shao et al. | Intermediate model based efficient and integrated multidisciplinary simulation data visualization for simulation information reuse | |
| WO2024045090A1 (en) | Product model simulation method and device | |
| Shang et al. | Correlation based analysis of parameter change propagation in variant product design | |
| CN110502476B (en) | Part retrieval and renaming method based on CAD system | |
| CN114047729A (en) | Natural plant processing control method, system, computer device and storage medium | |
| Kacalak et al. | A method of object-oriented symbolical description and evaluation of machine elements using antipatterns | |
| WO2013080657A1 (en) | Product information management device, method, and program | |
| CN117634861A (en) | Knowledge base-based industrial software execution flow determination method and device | |
| CN117787670B (en) | BIM data management method and system based on constructional engineering |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |