CN114817385B - Data management system of coal preparation plant application platform - Google Patents
Data management system of coal preparation plant application platform Download PDFInfo
- Publication number
- CN114817385B CN114817385B CN202210292336.4A CN202210292336A CN114817385B CN 114817385 B CN114817385 B CN 114817385B CN 202210292336 A CN202210292336 A CN 202210292336A CN 114817385 B CN114817385 B CN 114817385B
- Authority
- CN
- China
- Prior art keywords
- data
- coal preparation
- preparation plant
- module
- acquisition module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000003245 coal Substances 0.000 title claims abstract description 55
- 238000002360 preparation method Methods 0.000 title claims abstract description 55
- 238000013523 data management Methods 0.000 title claims abstract description 21
- 238000003908 quality control method Methods 0.000 claims abstract description 16
- 238000000034 method Methods 0.000 claims abstract description 11
- 238000007726 management method Methods 0.000 claims description 17
- 238000013499 data model Methods 0.000 claims description 16
- 238000003860 storage Methods 0.000 claims description 16
- 238000001514 detection method Methods 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 7
- 230000010354 integration Effects 0.000 claims description 5
- 238000012544 monitoring process Methods 0.000 claims description 5
- 238000007689 inspection Methods 0.000 claims description 4
- 238000013441 quality evaluation Methods 0.000 claims description 4
- 241000283014 Dama Species 0.000 claims description 3
- JNSGIVNNHKGGRU-JYRVWZFOSA-N diethoxyphosphinothioyl (2z)-2-(2-amino-1,3-thiazol-4-yl)-2-methoxyiminoacetate Chemical compound CCOP(=S)(OCC)OC(=O)C(=N/OC)\C1=CSC(N)=N1 JNSGIVNNHKGGRU-JYRVWZFOSA-N 0.000 claims description 3
- 230000002776 aggregation Effects 0.000 claims description 2
- 238000004220 aggregation Methods 0.000 claims description 2
- 238000004140 cleaning Methods 0.000 claims description 2
- 238000012216 screening Methods 0.000 claims description 2
- 238000005303 weighing Methods 0.000 claims description 2
- 238000007405 data analysis Methods 0.000 claims 2
- 238000007499 fusion processing Methods 0.000 abstract description 3
- 230000007246 mechanism Effects 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 11
- 238000004590 computer program Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 238000013439 planning Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 238000013480 data collection Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 238000004886 process control Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000008033 biological extinction Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000011282 treatment Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2291—User-Defined Types; Storage management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/02—Agriculture; Fishing; Forestry; Mining
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mining & Mineral Resources (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- General Health & Medical Sciences (AREA)
- Marketing (AREA)
- Software Systems (AREA)
- Marine Sciences & Fisheries (AREA)
- Animal Husbandry (AREA)
- Agronomy & Crop Science (AREA)
- Quality & Reliability (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Testing And Monitoring For Control Systems (AREA)
Abstract
The embodiment of the application discloses a data management system of an application platform of a coal preparation plant. One embodiment of the method comprises the following steps: the data acquisition module is configured to acquire multi-source heterogeneous data of the coal preparation plant informatization system according to batch data and stream data; the data management module is configured to manage the data acquired by the data acquisition module; and the data quality control module is configured to perform data quality control based on a pre-established data quality index system. The embodiment provides a data flow batch fusion processing mechanism, which collects multi-source heterogeneous data of a coal preparation plant informatization system according to batch data and stream data, performs data management and quality control, and improves the availability of the coal preparation plant data.
Description
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to a data management system of an application platform of a coal preparation plant.
Background
Most coal preparation plants built at present have a plurality of sets of informationized systems, such as PLC industrial control systems, and the construction of each system is independent, the system functions only comprise simple browsing, checking and the like, the data of each system cannot be collected, managed and controlled in quality uniformly, the availability of the data is poor, and valuable information is difficult to extract from the data of different systems.
Disclosure of Invention
The embodiment of the application provides a data management system of a coal preparation plant application platform, which comprises the following components: the data acquisition module is configured to acquire multi-source heterogeneous data of the coal preparation plant informatization system according to batch data and stream data; the data management module is configured to manage the data acquired by the data acquisition module; and the data quality control module is configured to perform data quality control based on a pre-established data quality index system.
In some embodiments, the data acquisition module is further configured to: and acquiring real-time stream data of the industrial control system of the coal preparation plant based on the OPC interface.
In some embodiments, collecting real-time stream data of a coal preparation plant industrial control system based on an OPC interface comprises: the online parameters and detection data in a PLC (programmable logic controller) in the industrial control system of the coal preparation plant are accessed in real time through OPC server software, and communication with the OPC server software is realized through referencing an automatic interface component.
In some embodiments, accessing online parameters and detection data in a PLC controller in a coal preparation plant industrial control system in real time through OPC server software includes: parameter configuration is carried out when the data acquisition module is initialized, and the names of OPC servers in the address hosts of the OPC servers are enumerated and connected to obtain the names; reading and displaying tag information of data in a PLC (programmable logic controller) preset in OPC server software; according to the acquisition frequency, the storage name and the position configured in the tag information, the tag name, the data value and the time stamp of the data are used as tag data to be transmitted to a configuration database of a server; unique ID codes are generated for the tag data, processed according to corresponding storage requirements and stored in a real-time database and a historical database respectively.
In some embodiments, the data acquisition module is further configured to: batch data of the coal preparation plant informatization system is collected based on the heterogeneous data source offline synchronization tool.
In some embodiments, the data resource pool of the coal preparation plant informatization system comprises an original data area, a standard data area, a data subject area, and an application subject area, the data governance module being further configured to: and the data acquired by the data acquisition module is managed based on the layering of the data resource pool.
In some embodiments, the data governance module is further configured to: and managing the data acquired by the data acquisition module based on the conceptual data model, the logic data model and the physical data model.
In some embodiments, a data quality index system is established based on a DAMA knowledge system by configuring data quality rules in combination with data quality requirements.
In some embodiments, the data quality control module is further configured to: and carrying out quality inspection on the data in the large data resource pool of the coal preparation plant application platform according to the data quality index system to form a data quality evaluation report.
In some embodiments, the system further comprises an integration module configured to: the data model services are integrated based on the service bus schema.
The data management system of the coal preparation plant application platform provided by the embodiment of the application comprises a data acquisition module, a data processing module and a data processing module, wherein the data acquisition module is configured to acquire multi-source heterogeneous data of a coal preparation plant informatization system according to batch data and stream data; the data management module is configured to manage the data acquired by the data acquisition module; the embodiment of the application provides a data flow batch fusion processing mechanism, which collects multi-source heterogeneous data of an informatization system of a coal preparation plant according to batch data and stream data, performs data management and quality control, and improves the availability of the data of the coal preparation plant.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the detailed description of non-limiting embodiments, made with reference to the accompanying drawings in which:
FIG. 1 is a schematic diagram of a data management system of a coal preparation plant application platform of the present application;
FIG. 2 is a schematic diagram of a real-time data acquisition process in an embodiment of the application;
FIG. 3 is a schematic diagram of a standard flow of data management for a coal preparation plant in an embodiment of the application;
FIG. 4 is a schematic diagram of a coal preparation plant data quality management framework in an embodiment of the application;
FIG. 5 is a schematic diagram of a prototype architecture of a service bus mode data model management engine system in an embodiment of the application;
FIG. 6 is a schematic diagram of a computer system suitable for use in implementing some embodiments of the application.
Detailed Description
The application is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be noted that, for convenience of description, only the portions related to the present application are shown in the drawings.
It should be noted that, without conflict, the embodiments of the present application and features of the embodiments may be combined with each other. The application will be described in detail below with reference to the drawings in connection with embodiments.
With continued reference to FIG. 1, one architecture 100 of the data management system of the coal preparation plant application platform of the present application is shown. The data management system of the coal preparation plant application platform comprises the following modules:
the data acquisition module 101 is configured to acquire multi-source heterogeneous data of the coal preparation plant informatization system according to batch data and stream data.
The multi-source heterogeneous data of the coal preparation plant informatization system can comprise data of informatization systems such as a coal preparation plant internal equipment on-line monitoring system, a belt scale weighing system, a gas monitoring system, a data reporting system, a PLC centralized control system and the like.
In some optional implementations of the present embodiment, the data acquisition module is further configured to: based on OPC (OLE for Process Control, OLE) interface for process control, real-time stream data of industrial control system of coal preparation plant is collected. In addition, the technical scheme of real-time data acquisition of the coal preparation plant can be realized based on the real-time flow technology.
In some optional implementations of this embodiment, collecting real-time stream data of a coal preparation plant industrial control system based on an OPC interface includes: the online parameters and detection data in a PLC (programmable logic controller) in the industrial control system of the coal preparation plant are accessed in real time through OPC server software, and communication with the OPC server software is realized through referencing an automatic interface component. As an example, referring to fig. 2, the online parameters and the detection data in each PLC controller of the coal-dressing factory industrial control system can be accessed in real time through OPC server software (such as KEPSERVER software), and the software program development communicates with the implementation KEPSERVER through a reference automation interface, i.e. an automation. When the acquisition module is initialized, parameter configuration is carried out, a program enumerates and acquires the name of an OPC Server in an address host of the configured OPC Server, reads and displays data labels, types and address information in a PLC (programmable logic controller) preset in OPC Server software, and transmits the label names, data values and time stamps of the data to a configuration database of a Server according to acquisition frequencies, storage names and positions in label storage settings, and simultaneously generates unique ID codes for each label data, processes the unique ID codes according to corresponding storage requirements and stores the unique ID codes in a real-time database and a history database.
In some optional implementations of this embodiment, accessing, in real time, online parameters and detection data in a PLC controller in a coal preparation factory industrial control system through OPC server software includes: parameter configuration is carried out when the data acquisition module is initialized, and the names of OPC servers in the address hosts of the OPC servers are enumerated and connected to obtain the names; reading and displaying tag information of data in a PLC (programmable logic controller) preset in OPC server software; according to the acquisition frequency, the storage name and the position configured in the tag information, the tag name, the data value and the time stamp of the data are used as tag data to be transmitted to a configuration database of a server; unique ID codes are generated for the tag data, processed according to corresponding storage requirements and stored in a real-time database and a historical database respectively.
In some optional implementations of the present embodiment, the data acquisition module is further configured to: batch data of the coal preparation plant informatization system is collected based on the heterogeneous data source offline synchronization tool.
The data governance module 102 is configured to govern the data collected by the data collection module.
In some optional implementations of this embodiment, the data resource pool of the coal preparation plant informatization system includes an original data area, a standard data area, a data topic area, and an application topic area, and the data management module is further configured to: and the data acquired by the data acquisition module is managed based on the layering of the data resource pool. Referring to fig. 3, data flows unidirectionally from a data lake to a level, and a lower data region provides a data source for an upper data region. The data in the data source is directly stored or is stored in the original data area after being structured; cleaning the original data area and normalizing the data by referring to a preset standard to obtain the data of the standard data area; the data of the standard data area are arranged, divided and/or associated and aggregated to obtain the data of the data subject area; and performing field screening and/or association aggregation on the data of the data subject area to obtain the data of the application subject area.
In some optional implementations of this embodiment, the data governance module is further configured to: and managing the data acquired by the data acquisition module based on the conceptual data model, the logic data model and the physical data model.
The data quality control module 103 is configured to perform data quality control based on a pre-established data quality index hierarchy.
In some alternative implementations of the present embodiment, the data quality index system is established based on a DAMA knowledge system by configuring data quality rules in combination with data quality requirements. The data quality management (Data Quality Management) of the coal preparation plant refers to a series of management activities such as identification, measurement, monitoring, early warning and the like on various data quality problems possibly caused in each stage of life cycle of data from planning, acquisition, storage, sharing, maintenance, application and extinction, and the quality of the data is further improved by improving and improving the management level of an organization. Referring to fig. 4, the data quality control technology is to form a basic principle of data quality of a coal preparation plant by configuring data quality rules, and establish a data quality index system of the coal preparation plant by combining quality requirements. According to the standard of the data quality index system, large data platforms such as CPIM (CERTIFIED IN PLANNING & Inventory Management, planning and inventory management certification) can carry out quality inspection on data in a large data resource pool according to the index system, and finally a data quality evaluation report is formed.
In some alternative implementations of the present embodiment, the data quality control module is further configured to: and carrying out quality inspection on the data in the large data resource pool of the coal preparation plant application platform according to the data quality index system to form a data quality evaluation report.
In some alternative implementations of the present embodiment, the system further includes an integration module configured to: the data model services are integrated based on the service bus schema. Referring to fig. 5, the multi-source heterogeneous data model service integration technology based on the service bus mode is realized by integrating the technical methods of flow batch data processing, multi-dimensional data fusion, cross-department data sharing and the like around the problems of information system distribution scattering, non-uniform technical standards, upright data chimney and the like in the construction process of an intelligent coal-dressing plant. The technology realizes the uniform access of the service bus multi-source heterogeneous data by selecting the adaptive acquisition access mode according to different service scenes, and provides an integrated data service access channel for the service requester based on a uniform data resource directory system. Meanwhile, based on a high-efficiency management architecture for the CPIM data model of the coal preparation plant, the management engine software system for the CPIM data model of the coal preparation plant, which comprises data acquisition management, data source management, data project management, data specification management and data service management, is integrated to realize integration of acquisition, storage, management, treatment, fusion and intelligence.
The system provided by the embodiment of the application is configured to collect multi-source heterogeneous data of the coal preparation plant informatization system according to batch data and stream data through the data collection module; the data management module is configured to manage the data acquired by the data acquisition module; the data quality control module is configured to control the data quality based on a pre-established data quality index system, provides a data flow batch fusion processing mechanism, collects multi-source heterogeneous data of the coal preparation plant informatization system according to batch data and stream data, performs data management and quality control, and improves the availability of the coal preparation plant data.
Referring now to FIG. 6, there is illustrated a schematic diagram of a computer system 600 suitable for use in implementing embodiments of the present application. The computer system shown in fig. 6 is merely an example, and should not be construed as limiting the functionality and scope of use of embodiments of the present application.
As shown in fig. 6, the computer system 600 includes a Central Processing Unit (CPU) 601, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 602 or a program loaded from a storage section 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the system 600 are also stored. The CPU 601, ROM 602, and RAM 603 are connected to each other through a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
The following components may be connected to the I/O interface 605: an input portion 606 including a keyboard, mouse, etc.; an output portion 607 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, a speaker, and the like; a storage section 608 including a hard disk and the like; and a communication section 609 including a network interface card such as a LAN card, a modem, or the like. The communication section 609 performs communication processing via a network such as the internet. The drive 610 is also connected to the I/O interface 605 as needed. Removable media 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is installed as needed on drive 610 so that a computer program read therefrom is installed as needed into storage section 608.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network through the communication portion 609, and/or installed from the removable medium 611. The above-described functions defined in the method of the present application are performed when the computer program is executed by a Central Processing Unit (CPU) 601. It should be noted that the computer readable medium according to the present application may be a computer readable signal medium or a computer readable medium, or any combination of the two. The computer readable medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present application, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the C-language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The above description is only illustrative of the preferred embodiments of the present application and of the principles of the technology employed. It will be appreciated by persons skilled in the art that the scope of the application referred to in the present application is not limited to the specific combinations of the technical features described above, but also covers other technical features formed by any combination of the technical features described above or their equivalents without departing from the inventive concept described above. Such as the above-mentioned features and the technical features disclosed in the present application (but not limited to) having similar functions are replaced with each other.
Claims (1)
1. A data management system for a coal preparation plant application platform, comprising:
the system comprises a data acquisition module, a data analysis module and a data analysis module, wherein the data acquisition module is configured to acquire multi-source heterogeneous data of an informatization system of a coal preparation plant according to batch data and stream data, and the multi-source heterogeneous data comprises data of an on-line monitoring system, a belt scale weighing system, a gas monitoring system, a data reporting system and a PLC centralized control system of internal equipment of the coal preparation plant;
The data management module is configured to manage the data acquired by the data acquisition module;
A data quality control module configured to perform data quality control based on a pre-established data quality index system;
The data resource pool of the coal preparation plant informatization system comprises an original data area, a standard data area, a data subject area and an application subject area, and the data management module is further configured to: layering and harnessing the data acquired by the data acquisition module based on the data resource pool; data flows unidirectionally from the data lake to the upper layer, and the lower layer data area provides a data source for the upper layer data area; the data in the data source is directly stored or is stored in the original data area after being structured; cleaning the data in the original data area and standardizing the data by referring to a preset standard to obtain the data in the standard data area; the data of the standard data area are arranged, divided and/or associated and aggregated to obtain the data of the data subject area; performing field screening and/or association aggregation on the data of the data subject area to obtain the data of the application subject area; wherein the data acquisition module is further configured to:
acquiring real-time flow data of a coal preparation factory industrial control system based on an OPC interface;
The method for acquiring real-time stream data of the coal preparation factory industrial control system based on the OPC interface comprises the following steps:
Accessing online parameters and detection data in a PLC (programmable logic controller) in a coal preparation factory industrial control system in real time through OPC server software, and communicating with the OPC server software through a reference automation interface component;
The accessing the online parameters and the detection data in the PLC in the industrial control system of the coal preparation plant in real time through the OPC server software comprises the following steps:
Parameter configuration is carried out when the data acquisition module is initialized, and the names of OPC servers in the address hosts of the OPC servers are enumerated and connected to obtain the names;
Reading and displaying tag information of data in a PLC (programmable logic controller) preset in OPC server software;
According to the acquisition frequency, the storage name and the position configured in the tag information, the tag name, the data value and the time stamp of the data are used as tag data to be transmitted to a configuration database of a server;
Generating a unique ID code for the tag data, processing according to corresponding storage requirements, and storing the unique ID code into a real-time database and a historical database respectively;
The OPC server software comprises KEPSERVER software, and the OPC server software is communicated with KEPSERVER software through a reference automation interface (Intop. OPCAutationdLL) component in software program development;
wherein the data acquisition module is further configured to:
collecting batch data of the coal preparation plant informatization system based on a heterogeneous data source offline synchronization tool;
wherein the data governance module is further configured to:
treating the data acquired by the data acquisition module based on a conceptual data model, a logic data model and a physical data model;
The data quality index system is established based on a DAMA knowledge system by combining data quality requirements through configuration data quality rules;
wherein the data quality control module is further configured to:
Based on a CPIM plan and an inventory management authentication big data platform, carrying out quality inspection on data in a big data resource pool of an application platform of a coal preparation plant according to the data quality index system to form a data quality evaluation report;
wherein the system further comprises an integration module configured to:
The data model services are integrated based on the service bus schema.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210292336.4A CN114817385B (en) | 2022-03-24 | 2022-03-24 | Data management system of coal preparation plant application platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210292336.4A CN114817385B (en) | 2022-03-24 | 2022-03-24 | Data management system of coal preparation plant application platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114817385A CN114817385A (en) | 2022-07-29 |
| CN114817385B true CN114817385B (en) | 2024-07-12 |
Family
ID=82531175
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210292336.4A Active CN114817385B (en) | 2022-03-24 | 2022-03-24 | Data management system of coal preparation plant application platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114817385B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111077870A (en) * | 2020-01-06 | 2020-04-28 | 浙江中烟工业有限责任公司 | Intelligent OPC data real-time acquisition and monitoring system and method based on stream calculation |
| CN111190881A (en) * | 2019-11-13 | 2020-05-22 | 深圳市华傲数据技术有限公司 | Data management method and system |
| CN113778967A (en) * | 2021-09-14 | 2021-12-10 | 中国环境科学研究院 | Yangtze river basin data acquisition processing and resource sharing system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8544028B2 (en) * | 2011-04-11 | 2013-09-24 | International Business Machines Corporation | Extracting and processing data from heterogeneous computer applications |
-
2022
- 2022-03-24 CN CN202210292336.4A patent/CN114817385B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111190881A (en) * | 2019-11-13 | 2020-05-22 | 深圳市华傲数据技术有限公司 | Data management method and system |
| CN111077870A (en) * | 2020-01-06 | 2020-04-28 | 浙江中烟工业有限责任公司 | Intelligent OPC data real-time acquisition and monitoring system and method based on stream calculation |
| CN113778967A (en) * | 2021-09-14 | 2021-12-10 | 中国环境科学研究院 | Yangtze river basin data acquisition processing and resource sharing system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114817385A (en) | 2022-07-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107734059B (en) | Industrial Internet cloud platform | |
| KR101935652B1 (en) | System and Method of Smart Factory Operation Management Solution Service Using Big Data Platform | |
| CN103984333B (en) | A kind of power plant monitoring and control management system | |
| US20170351226A1 (en) | Industrial machine diagnosis and maintenance using a cloud platform | |
| Zhu et al. | A framework-based approach to utility big data analytics | |
| KR101888637B1 (en) | Analysis methodology and platform architecture system for big data based on manufacturing specialized algorithm template | |
| US11507068B2 (en) | Method for life cycle management of a complex utility facility and system for its implementation | |
| CN111133391A (en) | Method for controlled sharing of wind farm and wind turbine data, data analysis algorithms and results of data analysis | |
| CN1720489A (en) | Integrated navigational tree importation and generation in a process plant | |
| CN115809302A (en) | Metadata processing method, device, equipment and storage medium | |
| CN116362443A (en) | Data management method and device for enterprise information platform | |
| KR101973328B1 (en) | Correlation analysis and visualization method of Hadoop based machine tool environmental data | |
| CN113506098A (en) | Power plant metadata management system and method based on multi-source data | |
| CN114817385B (en) | Data management system of coal preparation plant application platform | |
| CN117635185A (en) | Big data-based manufacturing cost online management method and server | |
| CN117519656A (en) | Software development system based on intelligent manufacturing | |
| CN117314037A (en) | Intelligent well lid integrated management platform, operation method and computer storage medium | |
| KR101984257B1 (en) | Cloud service based big data analysing system and method therein | |
| CN114140004A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN110096638B (en) | Irrigated area meteorological and remote sensing information monitoring platform | |
| Lenart et al. | Real-time monitoring and analyses of sensory data integrated into the BIM platform | |
| CN113313456A (en) | Intelligent management/control/maintenance cloud platform architecture for sintering production process flow | |
| CN117911194B (en) | Intelligent water management method and system based on big data | |
| CN118260294B (en) | Manufacturing pain signal summarizing method, system, medium and equipment based on AI | |
| Qian | Research on intelligent manufacturing system based on internet and big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20230703 Address after: 300120 building 3, Anshun building, Dafeng Road, Hongqiao District, Tianjin Applicant after: China coal (Tianjin) underground engineering intelligent Research Institute Co.,Ltd. Applicant after: CETC KEDA BIG DATA RESEARCH INSTITUTE Co.,Ltd. Address before: 300120 building 3, Anshun building, Dafeng Road, Hongqiao District, Tianjin Applicant before: China coal (Tianjin) underground engineering intelligent Research Institute Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |