CN113377776A - Intelligent mine data management system, method, equipment and readable storage medium - Google Patents

Intelligent mine data management system, method, equipment and readable storage medium Download PDF

Info

Publication number
CN113377776A
CN113377776A CN202110724323.5A CN202110724323A CN113377776A CN 113377776 A CN113377776 A CN 113377776A CN 202110724323 A CN202110724323 A CN 202110724323A CN 113377776 A CN113377776 A CN 113377776A
Authority
CN
China
Prior art keywords
data
information
coal mine
module
quality
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110724323.5A
Other languages
Chinese (zh)
Inventor
谈娌娜
邴喆
汪海涛
张光磊
张阳
王星
董振良
董洛兵
王毅
张佳佳
龚绮雯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xi'an Mellon Control Engineering LLC
China Coal Energy Research Institute Co Ltd
Original Assignee
Xi'an Mellon Control Engineering LLC
China Coal Energy Research Institute Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xi'an Mellon Control Engineering LLC, China Coal Energy Research Institute Co Ltd filed Critical Xi'an Mellon Control Engineering LLC
Priority to CN202110724323.5A priority Critical patent/CN113377776A/en
Publication of CN113377776A publication Critical patent/CN113377776A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2291User-Defined Types; Storage management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/20Natural language analysis
    • G06F40/237Lexical tools
    • G06F40/242Dictionaries
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/02Agriculture; Fishing; Mining

Abstract

The invention discloses an intelligent mine data management system, a method, equipment and a readable storage medium, wherein the method comprises the following steps of obtaining coal mine data, and adding quality control data in the coal mine data to form data source information; verifying the data source information, judging whether the data source information meets the requirement of coal mine data quality, and marking and updating the data which does not meet the coal mine data quality; and storing the data meeting the coal mine data quality requirement. The quality control data includes data transmission information, identification information, contact information, and reference information. The verification process of the data source information comprises the steps of verifying the data integrity, the accuracy and the timeliness in the data source information; and marking abnormal or irregular data, and updating the marked data by adopting a data interpolation method and a mode of ignoring or returning retransmission. The high efficiency, the usability, the easy operability and the like of the coal mine data in the collection, transmission and use processes are improved.

Description

Intelligent mine data management system, method, equipment and readable storage medium
Technical Field
The invention belongs to the technical field of information management, and particularly relates to an intelligent mine data management system, method, equipment and a readable storage medium.
Background
Along with the improvement of the informatization degree of coal mine data management, the application of a big data technology in an intelligent mine is deep, and the unified and standardized management of coal mine data becomes a problem which needs to be solved urgently. The coal mine data comprises three transmission processes from acquisition to use: for different coal mine institutions, data acquired by respective automation systems need to be transmitted to a coal mine superior management department; for a single coal mine, coal mine data are collected and summarized from an automatic system of the coal mine to a data unified storage platform (hereinafter referred to as a storage platform) and then the data in the storage platform are provided for coal mine intelligent applications. In the process, due to the fact that the automatic systems in the coal mine have different functions and different managed data types, the data formats output by the automatic systems are different, and the problems that data quality is not high, accuracy cannot be guaranteed, responsibility tracing is difficult and the like occur when the data are stored and used are caused.
When a problem occurs in the process of using data in the intelligent application of the coal mine, the source of errors is difficult to mine. In the process of acquiring and transmitting coal mine data to use, errors such as data loss, insufficient data precision, data redundancy, data overrun and the like often occur, but as the data stream transfer record of the data in the transmission process is not clear, the root tracing and the source tracing of the error data are challenged.
The existing coal mine data unified management standard does not clearly specify the description specification of a data source on the file format and the data format of the transmitted data when an automatic system of a coal mine institute submits the uploaded data; for transmitted data, there is no explicit data quality requirement description specification; for error data, reference standards for correcting and marking the error data are lacked; during the data transmission process, the requirement for the data flow relation record is lacked.
Disclosure of Invention
In order to solve the problems in the prior art, the invention provides an intelligent mine data management system, method, equipment and a readable storage medium, which improve the high efficiency, the availability, the operability and the like of coal mine data in the processes of collection, transmission and use.
In order to achieve the purpose, the invention provides the following technical scheme:
an intelligent mine data management method comprises the following processes,
acquiring coal mine data, and adding quality control data in the coal mine data to form data source information;
verifying the data source information, judging whether the data source information meets the requirement of coal mine data quality, and marking and updating the data which does not meet the coal mine data quality;
and storing the data meeting the coal mine data quality requirement.
Preferably, the quality control data includes data transmission information, identification information, contact information, and reference information.
Preferably, the verification process of the data source information includes verifying data integrity, accuracy and timeliness in the data source information;
and marking abnormal or irregular data, and updating the marked data by adopting a data interpolation method and a mode of ignoring or returning retransmission.
An intelligent mine data management system comprises a data source standard module, a data quality standard module and a data storage standard module;
the data source standard module is used for acquiring coal mine data and adding quality control data in the coal mine data to form data source information;
the data quality standard module is used for verifying the data quality of coal mine data;
and the data storage standard module is used for storing the coal mine data after quality control.
Preferably, the data source module comprises a data transmission information module, an identification information module, a contact information module and a reference information module;
the data transmission information module is used for adding data transmission information in coal mine data and saving the time of the data transmission information;
the identification information module is used for providing data set limitation and format specification information of coal mine data;
the contact information module is used for adding contact information in coal mine data;
the reference information module is used for providing reference information.
Preferably, the data quality standard module comprises a data quality content module, a data governance module, an identification information module, a contact information module and a reference information module;
the data quality content module is used for analyzing the integrity, accuracy and timeliness of data source information;
the data management module is used for marking abnormal or irregular data source information;
the identification information module is used for maintaining information;
the contact information module is used for providing corresponding contact information in the data source information
The reference information module is used for providing the reference rules of the specifications and the required coal mine data.
Preferably, the data storage standard module comprises a data label information module, an identification information module, a contact information module and a reference information module;
the data tag information entity is used for storing a service tag, an application tag and a timestamp of coal mine data;
the identification information module is used for storing basic information of coal mine data, and the basic information comprises a data set encoding format, a data packet format and a data encryption mode;
the contact information module is used for storing contact person unit names, responsibilities and contact person names;
the reference information module is used for storing reference data information.
A computer apparatus comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor when executing the computer program implementing the steps of an intelligent mine data management method as claimed in any one of the preceding claims.
A computer readable storage medium storing a computer program which, when executed by a processor, carries out the steps of an intelligent mine data management method as claimed in any one of the preceding claims.
Compared with the prior art, the invention has the following beneficial technical effects:
according to the intelligent mine data management system, a series of naming and using standards such as perfect data acquisition, transmission, detection verification and storage are formulated from a data source to data storage by adding quality control data in coal mine data; the method provides two division modes of a service level and an application level for the coal mine core data from different angles, wherein the service level is beneficial to coal mine industry personnel to know the data, and the application level is beneficial to non-coal mine industry personnel to fully manage the application data; the invention can standardize the access format of each coal mine data, and is beneficial to the high-efficiency use of the coal mine data; the data quality requirement description specification of each automation system in each coal mine yard is determined, and the availability of coal mine data is improved; the circulation relation of the data is clearly recorded, and the data is convenient to trace the source when errors occur. The method provides a data standard which is complete, high in availability and strong in practicability, and has important significance for a unified data exchange platform of a coal mine enterprise.
Furthermore, the affiliated party of the data of each time node is marked by applying the contact information in the data source, the data storage and the data quality information, so that the responsible party can be quickly determined when the data has problems, and the faulty data can be timely updated or corresponding measures can be taken.
Drawings
FIG. 1 is a conceptual structure diagram of the unified management standard of intelligent mine data of the present invention;
FIG. 2 is a conceptual block diagram of data source information in accordance with the present invention;
FIG. 3 is a conceptual block diagram of data quality information according to the present invention;
FIG. 4 is a conceptual block diagram of data storage information according to the present invention;
FIG. 5 is a diagram of a data source information structure according to the present invention;
FIG. 6 is a diagram of a data source-data transfer message structure in accordance with the present invention;
FIG. 7 is a data source-identifying information structure diagram of the present invention;
FIG. 8 is a diagram of a data source-contact information structure in accordance with the present invention;
FIG. 9 is a diagram of a data source-reference information structure according to the present invention;
FIG. 10 is a diagram of data quality information structure according to the present invention;
FIG. 11 is a block diagram of the data quality requirements of the present invention;
FIG. 12 is a diagram of the data quality-data governance standard structure of the present invention
FIG. 13 is a data quality-identifying information structure diagram of the present invention;
FIG. 14 is a data quality-contact information structure diagram of the present invention;
FIG. 15 is a data quality-reference information structure diagram according to the present invention;
FIG. 16 is a diagram of a data storage information structure according to the present invention;
FIG. 17 is a diagram of the present invention storage information-data tag information structure;
FIG. 18 is a diagram of the storage information-identification information structure of the present invention;
FIG. 19 is a diagram of a stored information-reference information structure according to the present invention;
fig. 20 is a diagram illustrating a structure of the storage information-contact information according to the present invention.
Detailed Description
The present invention will now be described in further detail with reference to specific examples, which are intended to be illustrative, but not limiting, of the invention.
Terms and definitions: data set (dataset), data set that can be identified. Note: the data set may be a database or may be part of a database.
Series of datasets (dataset series), sets of several datasets using the same specification.
Data quality (data quality), an overall characteristic of the ability of the data to meet regulatory and implicit requirements. [ introduction from GB/T19000]
Element (element), synonymous with attribute in UML terminology.
Entity (entity), a collection of elements that describe the homogeneous characteristics of data. The entities may be a single entity or may be aggregated entities comprising one or more entities.
Class (class) represents the encapsulation of an object. The following table is a legend for the classes.
Class name
+ Attribute name
+ method name
The top case represents the name of the class, the second case represents the properties of the class, namely the fields and attributes that are often said, and the third case represents the operation, namely the method and the behavior, of the class. The former + number indicates public, -number indicates private, and the # number indicates protected.
UML, relationships of models and data dictionaries
The following table illustrates the relationship between UML model terms and data dictionary terms.
UML model and data dictionary relationships
UML model terminology Data dictionary terminology
Bag (bag) Subsets
Generalization class Entity
Specialization classes Entity
Class I Entity
Properties Element(s)
Associated Element(s)
As shown in fig. 1, fig. 1 shows a conceptual configuration diagram of an intelligent mine data management system.
The invention covers all data elements required by the coal mine industry, and specifically comprises the data characteristics of coal mine work, data transmission, data storage and other contents. The standard adopts a UML class diagram method to describe an intelligent mine data management system.
The intelligent mine data management system consists of data source information, data quality information and data storage information.
The data source information is a detailed description of the coal mine data information source. The data source information entity is composed of a plurality of optional entities and optional elements, wherein the optional entities comprise a data transmission information entity, an identification information entity, a contact information entity and a reference information entity. The mandatory elements comprise a data source system and a data source description.
The data storage information entity describes the storage requirement specification related to the coal mine data and is represented by a necessary entity. The storage information entity consists of a plurality of optional entities and optional elements, wherein the optional entities comprise a data tag information entity, an identification information entity, a data security information entity, a contact information entity and a reference information entity, and the optional elements comprise a data storage position, a data storage medium and data retention time.
The data quality information is the requirement specification and the overall evaluation of the coal mine data quality. The data quality information entity consists of a plurality of optional entities and optional elements, wherein the optional entities comprise a data quality requirement entity, an identification information entity, a contact information entity and a reference information entity.
The standard provides a coal mine data naming standard, standardizes a data access party data naming format, and can name data according to specific conditions of various coal mine institutions.
The invention provides a coal mine overall description standard template, and coal mine professionals and non-professionals can visually know coal mine basic information through the description, so that a verification standard is provided for data management of a software system. The standard provides a general description example of a specific coal mine to assist other users to better apply the standard.
As shown in fig. 2, fig. 2 is a conceptual block diagram of data sources, which describes a conceptual structure of data source information in coal mine data. Each storage information data packet contains one or more entities and data storage information elements.
As shown in fig. 3, fig. 3 is a conceptual block diagram of data quality, which describes a conceptual structure of data quality information in coal mine data. Each data quality information packet contains one or more entities and a data quality information element.
As shown in fig. 4, fig. 4 is a conceptual block diagram of data storage, which describes a conceptual structure of data quality information in coal mine data. Each data quality information packet contains one or more entities and a data source information element.
As shown in fig. 5, the data source information is a detailed description of the source of the coal mine data information. The data source information entity is composed of a plurality of optional entities and optional elements, wherein the optional entities comprise a data transmission information entity, an identification information entity, a contact information entity and a reference information entity. The mandatory elements comprise a data source system and a data source description.
The data transmission information is information which needs to be retained in the data transmission process. The data source system refers to a source system of transmitted data, and the data source specification is a detailed description of the data source system. A UML class diagram for the data source information entity is shown in fig. 5.
As shown in fig. 6, the data transmission information includes two optional entities (but one of them must be selected) of online transmission and offline transmission, where the online transmission information entity includes three optional elements of transmission mode, connection address, and encryption mode, and the offline transmission information includes two optional elements of offline period and offline storage medium.
The data retention time after the transmission in the data transmission information is the time that the data needs to be retained in the data source system after the data transmission is completed. Before and after data transmission, a time stamp needs to be stored respectively for calculating transmission delay. The access modes of the online transmission information are divided into an active mode and a passive mode, wherein the active access refers to a data source open interface, and a data receiver actively acquires data; passive access refers to an open interface of a data receiver, a data source sends data to the data receiver, and the open interface needs to provide an IP address and a port. The offline period in the offline transmission information refers to how long the offline transmission takes as a period, and the offline storage medium refers to a medium used in the offline transmission process. A UML class diagram for a data transfer information entity is shown in fig. 6.
As shown in fig. 7, the identification information in the data source includes the mandatory entity data set restriction and format specification information, and also includes two mandatory elements, i.e., a data set encoding format and a data packet format.
The format specification information index data contains three necessary elements of file naming format, data format and file size. The file naming format specification is as follows: coal mine name abbreviation-system name abbreviation-time to generate a data set file, e.g., WJL _ MLYS _20190929112425. txt; the specific specification of the data format is as follows: the file header comprises a coal mine name abbreviation; system name shorthand; data upload time, these 3 fields are mandatory entries. The data upload time refers to the time at which the data set file was generated. Each field uses english notation "; "separate, the header ends with a" - "symbol. The file body is a collection of survey point base data. Each information format is 'measuring point name'; units of measurement; the upper limit of the measuring range; the lower limit of the measuring range; an upper alarm limit; alarm lower limit; time of data ". Each field of each piece of information is in English characters; "separate, end with" - "and each set of data ends with" | ". A UML class diagram identifying information entities is shown in fig. 7.
As shown in fig. 8, the contact information of the data source includes a mandatory entity of contact address, a contact unit name, two mandatory elements of responsibility, and one optional element being a contact name. A UML class diagram for the contact information entity is shown in fig. 8.
As shown in fig. 9, the reference information of the data source information includes a mandatory element name, four conditional mandatory element versions, a version date, an international standard book number, and an international standard serial number. A UML class diagram of a reference information entity for data source information is shown in fig. 9.
As shown in fig. 10, the data quality information is a requirement specification for coal mine data quality. The data quality information entity consists of a plurality of optional entities and optional elements, wherein the optional entities comprise a data quality requirement entity, an identification information entity, a contact information entity and a reference information entity. The data quality requirement refers to a quality evaluation standard for data of the data source, so as to standardize specific parameters of the data. A UML class diagram for the data quality entity is shown in fig. 10.
As shown in fig. 11, the data quality requirement is an overall quality standard that a data set must meet, and includes 3 conditional optional entities with integrity, accuracy, and timeliness, each entity includes a corresponding requirement and a possible error, wherein the integrity requirement can be divided into three optional elements of a system level integrity requirement, a parameter level integrity requirement, and an integrity error, the system level integrity indicates which service systems, subsystems, devices, and measurement point types need to be included in the whole coal mine system, and the parameter level integrity indicates which specific measurement points need to be included; the accuracy is divided into two necessary elements of accuracy requirement and accuracy error; the timeliness comprises two necessary elements of timeliness requirements and timeliness errors. The UML class diagram of the data quality requirement entity is shown in fig. 11.
As shown in fig. 12, the data governance standard is a specification of a governance method for abnormal or non-normative data, and includes 1 mandatory element (mark) and 3 conditional mandatory entities (integrity governance standard, accuracy governance standard, and timeliness governance standard).
The flag element is used to identify whether the data has been modified and which modification has been specifically made. All the 3 conditional mandatory entities comprise 3 mandatory elements of a data interpolation method, an ignoring and a return retransmission. Detailed description of the data interpolation method a code table is visible. Ignoring means that the error of the abnormal data is within an acceptable range and the system ignores the abnormal condition of the data. The return retransmission means that the abnormal data is the necessary data, and the current abnormal condition can not be interpolated or the interpolation result can not be accepted, the system refuses to accept the data and requires retransmission. The UML class diagram of the data governance standard is shown in fig. 12.
As shown in fig. 13, the identification information entity in the data quality is formed by the maintenance information of the mandatory entity, wherein the maintenance information includes the maintenance update frequency of the mandatory element and two conditions that must be described according to the update range of the element and the contact information. A UML class diagram identifying information entities is shown in fig. 13.
As shown in fig. 14, the contact information of data quality includes a mandatory entity of contact address, two mandatory elements of contact unit name and responsibility, and one optional element of contact name. A UML class diagram for the contact information entity is shown in fig. 14.
As shown in fig. 15, the reference information of the data quality is used for standardizing and requiring the quality of the coal mine data, and includes reference information of the equipment, reference rules such as equipment access rules and rating standards. A UML class diagram of a reference information entity for data quality is shown in fig. 15.
As shown in fig. 16, the data storage information entity describes the storage requirement specification related to the coal mine data, and is represented by a mandatory entity. The storage information entity consists of a plurality of optional entities and optional elements, wherein the optional entities comprise a data tag information entity, an identification information entity, a data security information entity, a contact information entity and a reference information entity, and the optional elements comprise a data storage position, a data storage medium and data retention time.
The data storage position of the data storage refers to a specific position for storing a data set, and is represented by a URL (uniform resource locator), the data storage medium refers to a medium used for storing data and comprises a plurality of selectable items, the data retention time refers to how long the data needs to be retained after the data storage is finished, and if the data retention time is selected, how to process the overdue data is explained; the data tag information entity refers to a tag information for data, which is used to know from which system the data originated or is applied to. The UML class diagram for the storage entity is shown in fig. 16.
As shown in fig. 17, the data tag information entity includes a service tag, an application tag, and a time stamp to which description data belongs. The service label, the application label and the time stamp are all necessary elements.
The service label of the data is used for describing which part of the service system of the coal mine the data comes from, and is generally described by a four-level label of a coal mine system, a subsystem, equipment and sub-equipment; the application label refers to the application type of the data, such as work type, equipment, disaster, operation, area, system, and the like, and provides support for data retrieval. A single piece of data has only one service tag but there may be multiple application tags. The storage time stamp refers to a time stamp when the storage of the data is completed. The UML class diagram of the data tag information is shown in fig. 17.
As shown in fig. 18, the identification information of the data storage is basic information describing the data storage of the coal mine, and is a mandatory entity of the data storage information entity, and it includes mandatory entity data set restriction, three mandatory element data set encoding formats, data packet formats, and data encryption manners. A UML class diagram identifying information entities is shown in fig. 18.
As shown in fig. 19, the reference information of the data storage is reference material information, and the UML class diagram of the reference information entity is shown in fig. 19.
As shown in fig. 20, the contact information of the data store contains the mandatory entity of the contact address, as well as two mandatory elements, a contact entity name and responsibility, and one optional element, a contact name. A UML class diagram for the contact information entity is shown in fig. 20.
The intelligent mine data management system provided by the invention standardizes the data supply and demand requirements of a large data platform manufacturer and a front-end system manufacturer, requires a data provider to provide data according to the standards of a data set file naming format, a data format and the like of a demand party, and needs to describe the whole data to a certain extent, so that the universality of the data is improved. From a data source to data storage, a series of naming and using standards such as perfect data acquisition, transmission, detection verification, storage and the like are formulated;
the method can provide a perfect data quality requirement standard of the core data of the coal mine according to the characteristics of the coal mine industry, not only standardizes the data integrity, accuracy and timeliness requirements which the data must meet, but also covers various possible data errors.
The quality integrity of core data of a coal mine requires multiple integrity requirements such as a standard integral integrity requirement and a local integrity requirement, the acquired data is required to have data of all systems under the coal mine, the data of each subsystem is required to be perfect, and the number of devices is also required to meet the actual condition of the coal mine.
The method provides two division modes of a service level and an application level for the coal mine core data from different angles, wherein the service level is beneficial to coal mine industry personnel to know the data, and the application level is beneficial to non-coal mine industry personnel to fully manage the application data; and marking data transceiving time in the data transmission process by adopting three-level timestamps, and adding timestamp labels when the data transmission of a data source is finished and the data storage of a data receiver is finished respectively when a coal mine data source starts to transmit data.
And the affiliated party of each time node data is marked by applying the contact information in the data source, the data storage and the data quality information, so that the responsible party can be quickly determined when the data has problems, and the faulty data can be timely updated or corresponding measures can be taken.
The invention can standardize the access format of each coal mine data, and is beneficial to the high-efficiency use of the coal mine data; the data quality requirement description specification of each automation system in each coal mine yard is determined, and the availability of coal mine data is improved; the circulation relation of the data is clearly recorded, and the data is convenient to trace the source when errors occur. The method provides a data standard which is complete, high in availability and strong in practicability, and has important significance for a unified data exchange platform of a coal mine enterprise.
An intelligent mine data management method comprises the following processes that coal mine data generally go through three transmission processes from acquisition to use: from the respective automation system to the storage platform (gather summary); from storage platforms to intelligent applications (intelligent computing); from the automation system or storage platform to the upper management department (summary reporting). In the process, due to the difference of development technology, application mode, transmission mode and the like of each automated system in the coal mine, if an effective data transmission and storage standard is lacked in the transmission process among the entities (an automation system, a storage platform, an intelligent application and a superior department), the coal mine data acquired by each target entity has the problems of low data quality, incapability of ensuring accuracy, difficulty in tracing abnormal data and the like.
The standard is specified aiming at the problems, and a series of standards are formulated for solving the problems existing in the transmission process between any two entities. As shown in the following figure, for the entity a, the data source standard is used to normalize the data source standard, the data receiving process of the entity B needs to comply with the data quality standard, and the entity B needs to store the data according to the data storage standard after obtaining the data.
The following are embodiments of the apparatus of the present invention that may be used to perform embodiments of the method of the present invention. For details of non-careless mistakes in the embodiment of the apparatus, please refer to the embodiment of the method of the present invention.
In yet another embodiment of the present invention, a computer device is provided that includes a processor and a memory for storing a computer program comprising program instructions, the processor for executing the program instructions stored by the computer storage medium. The Processor may be a Central Processing Unit (CPU), or may be other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable gate array (FPGA) or other Programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, etc., which is a computing core and a control core of the terminal, and is adapted to implement one or more instructions, and is specifically adapted to load and execute one or more instructions to implement a corresponding method flow or a corresponding function; the processor provided by the embodiment of the invention can be used for operating the intelligent mine data management method.
In yet another embodiment of the present invention, the present invention further provides a storage medium, specifically a computer-readable storage medium (Memory), which is a Memory device in a computer device and is used for storing programs and data. It is understood that the computer readable storage medium herein can include both built-in storage media in the computer device and, of course, extended storage media supported by the computer device. The computer-readable storage medium provides a storage space storing an operating system of the terminal. Also, one or more instructions, which may be one or more computer programs (including program code), are stored in the memory space and are adapted to be loaded and executed by the processor. It should be noted that the computer-readable storage medium may be a high-speed RAM memory, or may be a non-volatile memory (non-volatile memory), such as at least one disk memory. One or more instructions stored in the computer-readable storage medium may be loaded and executed by the processor to implement the corresponding steps of the intelligent mine data management method in the above embodiments.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting the same, and although the present invention is described in detail with reference to the above embodiments, those of ordinary skill in the art should understand that: modifications and equivalents may be made to the embodiments of the invention without departing from the spirit and scope of the invention, which is to be covered by the claims.
Data quality code < < code table >)
Figure BDA0003137270840000141
Figure BDA0003137270840000151
Access mode code Table
Serial number Name of Chinese English name Code Definition of
1 Active access 001 Data source open interface, data receiver actively obtaining data
2 Passive access 002 The data receiver opens an interface, and the data source sends data to the data receiver
Maintaining frequency codes code sheet
Figure BDA0003137270840000152
Figure BDA0003137270840000161
Data interpolation method code table
Figure BDA0003137270840000162

Claims (9)

1. An intelligent mine data management method is characterized by comprising the following processes,
acquiring coal mine data, and adding quality control data in the coal mine data to form data source information;
verifying the data source information, judging whether the data source information meets the requirement of coal mine data quality, and marking and updating the data which does not meet the coal mine data quality;
and storing the data meeting the coal mine data quality requirement.
2. An intelligent mine data management method as claimed in claim 1, wherein the quality control data comprises data transmission information, identification information, contact information and reference information.
3. The intelligent mine data management method according to claim 1, wherein the verification process of the data source information comprises verifying data integrity, accuracy and timeliness in the data source information;
and marking abnormal or irregular data, and updating the marked data by adopting a data interpolation method and a mode of ignoring or returning retransmission.
4. An intelligent mine data management system is characterized by comprising a data source standard module, a data quality standard module and a data storage standard module;
the data source standard module is used for acquiring coal mine data and adding quality control data in the coal mine data to form data source information;
the data quality standard module is used for verifying the data quality of coal mine data;
and the data storage standard module is used for storing the coal mine data after quality control.
5. The intelligent mine data management system of claim 4, wherein the data source module comprises a data transmission information module, an identification information module, a contact information module and a reference information module;
the data transmission information module is used for adding data transmission information in coal mine data and saving the time of the data transmission information;
the identification information module is used for providing data set limitation and format specification information of coal mine data;
the contact information module is used for adding contact information in coal mine data;
the reference information module is used for providing reference information.
6. The intelligent mine data management system of claim 4, wherein the data quality standard module comprises a data quality content module, a data governance module, an identification information module, a contact information module and a reference information module;
the data quality content module is used for analyzing the integrity, accuracy and timeliness of data source information;
the data management module is used for marking abnormal or irregular data source information;
the identification information module is used for maintaining information;
the contact information module is used for providing corresponding contact information in the data source information
The reference information module is used for providing the reference rules of the specifications and the required coal mine data.
7. The intelligent mine data management system of claim 4, wherein the data storage standard module comprises a data tag information module, an identification information module, a contact information module and a reference information module;
the data tag information entity is used for storing a service tag, an application tag and a timestamp of coal mine data;
the identification information module is used for storing basic information of coal mine data, and the basic information comprises a data set encoding format, a data packet format and a data encryption mode;
the contact information module is used for storing contact person unit names, responsibilities and contact person names;
the reference information module is used for storing reference data information.
8. A computer arrangement comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the steps of an intelligent mine data management method as claimed in any one of claims 1 to 3 are implemented when the computer program is executed by the processor.
9. A computer-readable storage medium storing a computer program, wherein the computer program when executed by a processor implements the steps of an intelligent mine data management method according to any one of claims 1 to 3.
CN202110724323.5A 2021-06-29 2021-06-29 Intelligent mine data management system, method, equipment and readable storage medium Pending CN113377776A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110724323.5A CN113377776A (en) 2021-06-29 2021-06-29 Intelligent mine data management system, method, equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110724323.5A CN113377776A (en) 2021-06-29 2021-06-29 Intelligent mine data management system, method, equipment and readable storage medium

Publications (1)

Publication Number Publication Date
CN113377776A true CN113377776A (en) 2021-09-10

Family

ID=77579645

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110724323.5A Pending CN113377776A (en) 2021-06-29 2021-06-29 Intelligent mine data management system, method, equipment and readable storage medium

Country Status (1)

Country Link
CN (1) CN113377776A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2002951910A0 (en) * 2002-10-04 2002-10-24 Tenix Industries Pty Limited Data quality and integrity engine
CN109922124A (en) * 2018-12-29 2019-06-21 淄博矿业集团有限责任公司 A kind of coal mine data management system based on Hadoop
US10628058B1 (en) * 2017-02-15 2020-04-21 Bank Of America Corporation System for electronic data verification, storage, and transfer
CN112256682A (en) * 2020-10-22 2021-01-22 佳都新太科技股份有限公司 Data quality detection method and device for multi-dimensional heterogeneous data
CN112667704A (en) * 2020-12-22 2021-04-16 煤炭科学研究总院 Coal mine industry internet data middle platform system structure

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2002951910A0 (en) * 2002-10-04 2002-10-24 Tenix Industries Pty Limited Data quality and integrity engine
US10628058B1 (en) * 2017-02-15 2020-04-21 Bank Of America Corporation System for electronic data verification, storage, and transfer
CN109922124A (en) * 2018-12-29 2019-06-21 淄博矿业集团有限责任公司 A kind of coal mine data management system based on Hadoop
CN112256682A (en) * 2020-10-22 2021-01-22 佳都新太科技股份有限公司 Data quality detection method and device for multi-dimensional heterogeneous data
CN112667704A (en) * 2020-12-22 2021-04-16 煤炭科学研究总院 Coal mine industry internet data middle platform system structure

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
王鹏: "智慧矿山安全管控大数据平台建设探讨", 《煤炭工程》 *

Similar Documents

Publication Publication Date Title
CN109522746A (en) A kind of data processing method, electronic equipment and computer storage medium
CN108563768B (en) Data conversion method, device, equipment and storage medium for different data models
CN111159191A (en) Data processing method, device and interface
US20080091742A1 (en) System and method for detecting and updating geographical information dataset versions
EP1725953A1 (en) Apparatus and method for data consistency validation.
CN108512726B (en) Data monitoring method and equipment
CN109977383A (en) A kind of form information extracting method based on Excel
CN115391439B (en) Document data export method, device, electronic equipment and storage medium
CN112883125A (en) Entity data processing method, device, equipment and storage medium
CN110471903B (en) Heterogeneous system node information summarizing and trade database generating method and device
CN111106899A (en) Data verification method and device in Internet of things, computer equipment and storage medium
CN111339231B (en) Crowd-sourced update result processing method and device
CN110765750A (en) Report data entry method and terminal equipment
CN111966707A (en) Query statement generation method and device, electronic equipment and computer readable medium
CN112925757A (en) Method, equipment and storage medium for tracking operation log of intelligent equipment
CN109165209B (en) Data verification method, device, equipment and medium for object types in database
CN107564582B (en) Single disease quality monitoring system and method
CN111858236B (en) Knowledge graph monitoring method and device, computer equipment and storage medium
CN113868498A (en) Data storage method, electronic device, device and readable storage medium
CN113377776A (en) Intelligent mine data management system, method, equipment and readable storage medium
CN112241399B (en) NoSQL-based PSD-BPA data analysis and management method and system
CN103778218A (en) Cloud computation-based standard information consistency early warning system and method
CN116107971A (en) Model data processing method and device, electronic equipment and storage medium
CN112416904A (en) Electric power data standardization processing method and device
CN114461193B (en) Method, device, equipment and storage medium for generating communication protocol code

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination