CN108614819B - Geological data management system - Google Patents

Geological data management system Download PDF

Info

Publication number
CN108614819B
CN108614819B CN201611127394.2A CN201611127394A CN108614819B CN 108614819 B CN108614819 B CN 108614819B CN 201611127394 A CN201611127394 A CN 201611127394A CN 108614819 B CN108614819 B CN 108614819B
Authority
CN
China
Prior art keywords
data
geological
secret
geological data
subsystem
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201611127394.2A
Other languages
Chinese (zh)
Other versions
CN108614819A (en
Inventor
杨建平
孔昭煜
李晓蕾
熊兴玉
闫志伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sinosoft Co ltd
Development & Research Center Of China Geological Survey Bureau
Original Assignee
Sinosoft Co ltd
Development & Research Center Of China Geological Survey Bureau
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sinosoft Co ltd, Development & Research Center Of China Geological Survey Bureau filed Critical Sinosoft Co ltd
Priority to CN201611127394.2A priority Critical patent/CN108614819B/en
Publication of CN108614819A publication Critical patent/CN108614819A/en
Application granted granted Critical
Publication of CN108614819B publication Critical patent/CN108614819B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Bioethics (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The disclosure relates to a geological data management system, which comprises a data receiving subsystem, a collection information base construction subsystem, a service information base construction subsystem, a metadata base construction subsystem, a secret-related cleaning and secret processing subsystem and an online service support subsystem. The geological data management system can combine geological data management with information technology, so that the geological data management is supported in an informationized way, and the geological data management system can adapt to massive and diversified geological data management.

Description

Geological data management system
Technical Field
The present disclosure relates to the field of information technology, and in particular, to a geological data management system.
Background
In order to strengthen the management of geological data, give full play to the function of the geological data and protect the legal interest of geological data remittee, a geological data repository and a geological data keeping unit (namely a geological data collection mechanism) of national geological data repository, geological data repository of national geological data administrative departments of province, autonomous region and direct administration city keep and manage the remittee geological data according to the law, and provide geological data service for the whole society.
At present, a set of closed-loop service flow is not formed in the management and application of geological data by a geological industry department, and the links of remittance of the geological data, secret-related geological data, socialization service and the like cannot be organically combined and butted. For example, geological data is mainly recorded by manually registering forms in the process of the remittance business work; in the management of secret-related data, only the original data is subjected to secret setting, and after the geology is subjected to secret setting, how to carry out socialization service work is not defined; in the aspect of social service of geological data, only public geological data is shared, and a related management technology is lacked for how the confidential geological data is served to the public.
At present, the combination degree of geological data management technology and information technology is low, most of geological data management technology and information technology are in an environment without support of an informatization system, and the geological data management system cannot adapt to the management of mass and diversified geological data at present.
Disclosure of Invention
In view of this, the present disclosure provides a geological data management system to solve the problem that the existing geological data management technology is low in combination with the information technology and cannot adapt to the management of massive and diversified geological data.
According to an aspect of the present disclosure, there is provided a geological data management system including:
the data receiving subsystem is used for receiving, backing up, checking and warehousing the geological data in an original library;
the collected information base construction subsystem is connected with the data receiving subsystem and is used for carrying out data arrangement on the geological data in the data arrangement area and storing the geological data after data arrangement into the collected information base;
the service information base construction subsystem is connected with the collected information base construction subsystem and is used for carrying out data screening on the geological data of the data sorting area, carrying out integrated database updating maintenance according to the geological data subjected to data screening and the geological data in the collected information base, and storing the geological data subjected to updating maintenance into the service information base;
the metadata base construction subsystem is connected with the service information base construction subsystem and used for determining metadata of geological data in the service information base and storing the metadata of the geological data into the metadata base;
the secret-related cleaning and secret-related processing subsystem is respectively connected with the service information base construction subsystem and the metadatabase construction subsystem and is used for carrying out secret-related cleaning and secret processing on geological data in the service information base and the metadatabase and storing the geological data subjected to secret-related cleaning and secret processing into the extranet service base;
and the online service support subsystem is respectively connected with the service information base construction subsystem and the secret-related cleaning and secret-keeping processing subsystem and is used for performing service encapsulation and release on the geological data subjected to secret-related cleaning and secret-keeping processing.
In one possible implementation, the system further includes:
the data transfer subsystem is connected with the collected information base construction subsystem and is used for transferring the geological data of the collected information base to a second exchange area;
and the arrival service support subsystem is connected with the data transfer subsystem and is used for carrying out arrival service support on the geological data of the second exchange area.
In one possible implementation, the system further includes:
and the emergency service support subsystem is connected with the secret-related cleaning and secret processing subsystem and is used for screening out geological data related to the emergency service support from the external network service library and storing the geological data related to the emergency service support into the emergency service information library.
In one possible implementation, the system further includes:
and the emergency service support subsystem is connected with the secret-related cleaning and secret processing subsystem and is used for screening out geological data related to the emergency service support from the external network service library and storing the geological data related to the emergency service support into the emergency service information library.
In one possible implementation, the data receiving module includes:
the data receiving submodule is used for receiving geological data and storing the received qualification data into the first exchange area;
and the data copying submodule is connected with the data receiving submodule and is used for copying the geological data of the first exchange area to the data back-up area, the data inspection area and the data sorting area.
In one possible implementation, the data backup module includes:
the first backup submodule is used for backing up geological data of the data backup area;
the second backup submodule is used for backing up the geological data of the data inspection area;
and the third backup submodule is used for backing up the geological data of the data sorting area.
In one possible implementation, the secret-related cleaning and secret processing subsystem includes:
the data preprocessing module is used for preprocessing the geological data in the service information base and the metadata base;
the confidential cleaning module is connected with the data preprocessing module and is used for carrying out confidential point information marking and confidential level judgment on the geological data subjected to data preprocessing according to confidential cleaning rules;
and the secret processing module is connected with the secret cleaning module and used for carrying out secret processing according to the secret point information and the secret level of the geological data, determining non-secret-related geological data and storing the non-secret-related geological data into the extranet service library.
In one possible implementation manner, the secret-related cleaning and secret processing subsystem further includes:
and the secret-related clearing rule updating module is used for updating the secret-related clearing rule.
In one possible implementation manner, the secret-related cleaning and secret processing subsystem further includes:
and the metadata database updating module is used for updating the metadata database according to the non-confidential geological data.
In one possible implementation, the online service support subsystem includes:
the early-stage preparation module is used for obtaining a public version geological map result list according to geological data of the service information base and obtaining a data screening result list according to geological data of the collection information base;
the data packaging module is used for carrying out data packaging processing on the public edition geological map result list and the data screening result list;
and the service release module is used for service release of the public edition geological map result list and the data screening result list after data encapsulation processing.
By establishing the geological data management system comprising the data receiving subsystem, the collected information base construction subsystem, the service information base construction subsystem, the metadata base construction subsystem, the secret-related cleaning and secret processing subsystem and the online service support subsystem, geological data management can be combined with information technology, so that the geological data management is supported in an informationized manner, and the geological data management system can adapt to massive and diversified geological data management.
Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments, features, and aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.
FIG. 1 illustrates a block diagram of a geological data management system according to an embodiment of the present disclosure.
FIG. 2 illustrates an exemplary block diagram of a geological data management system according to an embodiment of the present disclosure.
FIG. 3 illustrates a schematic diagram of a business process implemented using the geological data management system shown in FIG. 2.
FIG. 4 illustrates an exemplary block diagram of the data receiving subsystem 11 of the geological data management system according to an embodiment of the present disclosure.
Fig. 5 shows a schematic diagram of the business process implemented by the data receiving subsystem 11 shown in fig. 4.
FIG. 6 illustrates an exemplary block diagram of the confidential clearance and privacy handling subsystem 15 of the geological data management system according to an embodiment of the present disclosure.
Fig. 7 shows a schematic diagram of the business process implemented by the key clearing and key processing subsystem 15 shown in fig. 6.
FIG. 8 illustrates an exemplary block diagram of the online service support subsystem 16 of the geological data management system according to an embodiment of the present disclosure.
Fig. 9 shows a schematic diagram of the business process implemented using the online service support subsystem 16 shown in fig. 8.
FIG. 10 is a schematic diagram illustrating a corresponding logical architecture diagram of a geological data management system, according to an embodiment of the present disclosure.
FIG. 11 illustrates a schematic diagram of a corresponding technical architecture diagram of a geological data management system, according to an embodiment of the present disclosure.
Detailed Description
Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers can indicate functionally identical or similar elements. While the various aspects of the embodiments are presented in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.
The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.
Furthermore, in the following detailed description, numerous specific details are set forth in order to provide a better understanding of the present disclosure. It will be understood by those skilled in the art that the present disclosure may be practiced without some of these specific details. In some instances, methods, means, elements and circuits that are well known to those skilled in the art have not been described in detail so as not to obscure the present disclosure.
FIG. 1 illustrates a block diagram of a geological data management system according to an embodiment of the present disclosure. As shown in fig. 1, the geological data management system comprises a data receiving subsystem 11, a collection information base construction subsystem 12, a service information base construction subsystem 13, a metadata base construction subsystem 14, a secret-related cleaning and secret processing subsystem 15 and an online service support subsystem 16.
And the data receiving subsystem 11 is used for receiving, backing up, checking and warehousing the geological data in an original library.
The receiving of the geological data may include handing over collected data, handing over exchanged data, and the like, which is not limited herein. The exchange data may originate from an exchange data transfer unit, such as a geographic information center, and is not limited herein. In this embodiment, all sources of geological data may be examined. The original library of geological data may be a library of geological data stored in an original information library.
The geological data can refer to original geological data, result geological data, physical geological data, geological science and technology files and the like in the forms of characters, charts, sound images, electromagnetic media and the like formed in geological production work. The original geological data can refer to original records, data, intermediate interpretation data and the like which are directly formed or collected during geological work and are stored by various carrier types. The original geological data mainly comprises: recording, cataloguing, hand drawing, various assay test analysis data and summary data in the field. The result geological data can refer to the final geological work result in the form of characters, diagrams, sound images and the like which is formed by analyzing, sorting and comprehensively researching various recorded data and real objects directly formed or collected in geological work and related data collected through various channels and compiled according to certain specifications and formats. The main forms of the achievement geological data comprise various geological survey reports, various investigation (survey) geological reports, mine production (development) geological reports, mine closed pit geological reports, various geological scientific research reports, geological maps and specifications, geological compilations, geological yearbooks, geological logs (histories), resource storage tables, databases, reports and the like. The physical geological data can refer to rock and ore cores, various specimens, samples, optical sheets and other physical geological data which are collected and preserved according to regulations in geological exploration, scientific research and other related production technical activities. The geological science and technology file can be a scientific and technology file formed in geological exploration, scientific research and other activities. The geological science and technology archive mainly comprises a regional archive, a solid mineral geological archive, a petroleum geological archive, a marine geological archive, a hydrogeological archive, an engineering geological archive, an environmental geological archive, a geophysical, a geochemistry, a remote sensing, a geological mapping archive, an experimental test archive, a prospecting engineering archive, a scientific research archive and the like, and can be divided into an original geological archive and a copied local quality archive.
And the collected information base construction subsystem 12 is connected with the data receiving subsystem 12 and is used for carrying out data arrangement on the geological data in the data arrangement area and storing the geological data after data arrangement into the collected information base.
The collected information base construction subsystem 12 can be used for processing data in the data arrangement area, such as normative processing, cleaning conversion, error correction and the like, and the unification of standards of all data is completed.
And the service information base construction subsystem 13 is connected with the library information base construction subsystem 12 and is used for carrying out data screening on the geological data of the data sorting area, carrying out integrated database updating and maintenance according to the geological data after data screening and the geological data in the library information base, and storing the geological data after updating and maintenance into the service information base.
The service information base construction subsystem 13 may be used to screen out geological data that is not involved in secret, so as to serve the public. The integrated database is updated and maintained according to the geological data after data screening and the geological data in the museum information base, so that the related geological data of the data service screened from the data arrangement area and the data acquired from the museum information base are integrated through the multidimensional screening condition, and the national geological data service information base is formed through the integration and integration of the two data.
In this embodiment, the library information base can be used for storing the standard data after data arrangement, and the original information base can be used for storing the submitted original data. The collection database can be used to store data of all security levels, while the service information base only stores data that can be provided to the public.
And the metadata base construction subsystem 14 is connected with the service information base construction subsystem 13 and is used for determining the metadata of the geological data in the service information base and storing the metadata of the geological data into the metadata base.
The metadata in the present embodiment means differently from metadata in a conventional database, which refers to data describing data. The metadata of the present embodiment is exemplified below by taking a book as an example. For example, the submitted data is a book with information of title (title name), author, publisher, pricing, etc., and the metadata is each page in the book, and a book has 500 pages, so the book corresponds to 500 pieces of metadata. Each metadata also has corresponding information such as name, page number, etc., such as directory, drawing, attached table, etc.
The metadata base is established, so that a geological data management system can be managed finely, data are subdivided into minimum units, the metadata base is established, and a foundation is laid for the overall process of subsequent data.
And the secret-related cleaning and secret processing subsystem 15 is respectively connected with the service information base construction subsystem 13 and the metadata base construction subsystem 14 and is used for carrying out secret-related cleaning and secret processing on geological data in the service information base and the metadata base and storing the geological data subjected to secret-related cleaning and secret processing into the extranet service base.
Through secret-related cleaning and secret processing, non-secret-related geological data are determined, and therefore information data capable of serving the social public are obtained.
And the online service support subsystem 16 is respectively connected with the service information base construction subsystem 13 and the secret-related cleaning and secret processing subsystem 15 and is used for performing service encapsulation and publishing on the geological data subjected to secret-related cleaning and secret processing.
The geological data after confidential cleaning and confidential processing is packaged and issued by the online service support subsystem 16, so that social public can obtain the geological data from a website.
The problem that geological data collection, secret-related geological data secret determination, secret-related geological data decryption and socialization service cannot be organically combined and connected is solved. Meanwhile, a set of perfect management technology can be established for the management of secret-related rules in the geological industry, and the management technology comprises the work of collection, acceptance, bibliographic arrangement, storage maintenance, processing and manufacturing, data publishing, sharing and exchange and the like in the geological industry.
In one possible implementation, the system further includes: the data transfer subsystem 17 is connected with the collected information base construction subsystem 12 and is used for transferring the geological data of the collected information base to the second exchange area; and the arrival service support subsystem 18 is connected with the data forwarding subsystem 17 and is used for performing arrival service support on the geological data of the second exchange area. Wherein the second switching zone may be a data room-service room switching zone.
In one possible implementation, the system further includes: and the emergency service support subsystem 19 is connected with the secret-related cleaning and secret processing subsystem 15 and is used for screening out geological data related to the emergency service support from the external network service library and storing the geological data related to the emergency service support into the emergency service information library.
The geological data related to the emergency service support may include geological data related to earthquake or other natural disaster, geological data related to major activities (such as military exercises and naval return), and the like, which are not limited herein. Emergency services can be prepared in advance for an emergency by providing an emergency services support subsystem.
FIG. 2 illustrates an exemplary block diagram of a geological data management system according to an embodiment of the present disclosure. As shown in fig. 2, the geological data management system comprises a data receiving subsystem 11, a collection information base construction subsystem 12, a service information base construction subsystem 13, a metadata base construction subsystem 14, a secret-related cleaning and secret processing subsystem 15, an online service support subsystem 16, a data transfer subsystem 17, an arrival service support subsystem 18 and an emergency service support subsystem 19.
FIG. 3 illustrates a schematic diagram of a business process implemented using the geological data management system shown in FIG. 2. The first switching area may be a storage room-data room switching area, and the second switching area may be a data room-service room switching area. As shown in fig. 3:
in the data receiving part, the data collecting room can transmit the data to the data room through the first exchange area, and the data room can receive the data and copy the data to the data preparation area and the data inspection area. Data error feedback is required for problems found during data inspection. For example, the number of the submitted data information single folders is 500, and the number of the actual checks is 497; for another example, the submitted data information sheet is named as "Wuhan geological report", and the subject name found in the inspection process is the "Wuhan geological survey report". The collecting room is used as a receiving and summarizing department of the data, and in order to unify the origin and the provenance, when the data finds errors, the collecting room can be informed, and the collecting room feeds back the relevant errors to a data producer or a data submitter. And performing data inspection on the geological data in the data inspection area, wherein the inspected geological data can be stored in the original information base.
In the collection information base construction part, carry out data arrangement to the geological data in data arrangement district, the geological data after the arrangement can be deposited in the collection information base.
And in the service information base construction part, data screening is carried out on the geological data in the data arrangement area, updating and maintenance of the integrated database are carried out according to the geological data subjected to data screening and the geological data in the collection information base, and the updated and maintained geological data are stored in the service information base.
And in the online service support part, updating the data distribution map according to the screened geological data, and performing service packaging on the screened geological data and issuing the service packaged data to the service master station. The data distribution map can be used for prompting the public to release new information data at present.
And in the metadata database construction part, creating a metadata database, determining the metadata of the geological data in the service information base, and storing the metadata of the geological data into the metadata database.
And carrying out secret-related technology processing and secret-related cleaning in the secret-related cleaning and secret processing part, and storing the geological data subjected to secret-related cleaning and secret processing into an external network service library.
And in the emergency service support part, screening out geological data related to the emergency service support from the external network service library, and storing the geological data related to the emergency service support into the emergency service information library.
And in the data transfer part, the geological data of the library information base is transferred to the second exchange area, namely, the data transfer processing of the data room and the service room is carried out, and the transferred geological data can be stored in the data service room for the user to look up.
And in the arrival service support part, the geological data of the second exchange area is subjected to arrival service support.
FIG. 4 illustrates an exemplary block diagram of the data receiving subsystem 11 of the geological data management system according to an embodiment of the present disclosure. As shown in fig. 4, the data receiving subsystem 11 includes a data receiving module 111, a data backup module 112, a data verification module 113, and an original library warehousing module 114.
And the data receiving module 111 is used for receiving and copying the geological data.
In one possible implementation, the data receiving module 111 includes: the data receiving submodule is used for receiving geological data and storing the received qualification data into the first exchange area; and the data copying submodule is connected with the data receiving submodule and is used for copying the geological data of the first exchange area to the data back-up area, the data inspection area and the data sorting area. Wherein the first exchange area may be a stowage data room exchange area. The collection room can mount the network virtual hard disk first, then copy the new exchange data to the network virtual hard disk, after the copying is completed, unload the network virtual hard disk, and inform the data room, and then mount the network virtual hard disk to copy the data. The data backup area can be used for storing all original data, so that the data backup area can be used for subsequent data tracing.
In this embodiment, the swap area is understood to be a shared disk, but only one of the two can be mounted and used at the same time, and after the data is mounted and copied, the other can be mounted and used.
And the data backup module 112 is connected with the data receiving module 111 and is used for backing up geological data.
In one possible implementation, the data backup module 112 includes: the first backup submodule is used for backing up geological data of the data backup area; the second backup submodule is used for backing up geological data of the data inspection area; and the third backup submodule is used for backing up the geological data in the data sorting area.
And the data checking module 113 is connected with the data receiving module 111 and is used for checking the geological data. The data inspection is mainly to check the data received by the data receiving module 111. For example, it is possible to first perform a preliminary check on the contents such as the number of folders, the number of files, and the size of the data amount, record the related problem, and then perform a file directory and file number check of the data. The service range of the data ping may include seven items: title, form unit, author, time of formation, language, security level, and item number.
And the original library storage module 114 is connected with the data inspection module 113 and is used for storing the inspected geological data into the original information library.
Fig. 5 shows a schematic diagram of the business process implemented by the data receiving subsystem 11 shown in fig. 4. The same parts in fig. 5 as those in fig. 3 will not be described again here. As shown in fig. 5:
in the data receiving part, the data exchange of collection can include data exchange list, single batch data list and single batch data exchange. The data copying may include copying the geological data of the first exchange area to the data preparation area, the data interrogation area, and the data marshalling area.
In the data backup part, the data in the data backup area, the data inspection area and the data sorting area can be backed up. For example, data in the data preparation area can be kept for a long time, and data in the data inspection area and the data sorting area can be kept for half a year.
In the data checking part, data checking, checking record, checking result feedback, checking result aggregation and checking data modification completion can be carried out on geological data.
In the original library storage part, the data after the inspection and modification can be stored in the original information library.
FIG. 6 illustrates an exemplary block diagram of the confidential clearance and privacy handling subsystem 15 of the geological data management system according to an embodiment of the present disclosure. As shown in fig. 6, the secret-related cleaning and secret processing subsystem 15 includes a data preprocessing module 151, a secret-related cleaning module 152, and a secret processing module 153.
And the data preprocessing module 151 is used for preprocessing the geological data in the service information base and the metadata base. Wherein the data preprocessing may include a deduplication process.
And the secret-related cleaning module 152 is connected with the data preprocessing module 151 and is used for performing secret-related point information labeling and secret level judgment on the geological data subjected to data preprocessing according to the secret-related cleaning rule.
And the secret-related cleaning rule can be determined according to a secret-determining working guide of geological survey results. The working guide for determining the density of the geological survey results can be an instructive document formed by the design and the density of the confidential geological data in the actual business work and the guidance of the management rules of the confidential geological data issued by the development and research center of the geological survey bureau (national geological information center) in China according to the ministry of resources of the state and the national security bureau in combination.
The secret-related cleaning module 152 may be configured to perform secret-related point information labeling and secret level determination on the geological data after data preprocessing according to the secret-related cleaning rule, so as to form secret-related point information and secret level information of each metadata in the geological data.
And the security processing module 153 is connected with the security-related cleaning module 152 and is used for performing security processing according to the security-related point information and the security level of the geological data, determining non-security-related geological data and storing the non-security-related geological data into the extranet service library.
The confidentiality processing module 153 is directed to a result product after confidentiality cleaning, and can perform confidentiality removing processing on confidential information according to the described confidential point information and the described confidentiality level, so as to obtain information data capable of serving the public.
In one possible implementation, the confidential clearance and confidential processing subsystem 15 further includes: and a secret-related clearance rule updating module 154 for updating the secret-related clearance rule.
In one possible implementation, the confidential clearance and confidential processing subsystem 15 further includes: and the metadata database updating module 155 is used for updating the metadata database according to the non-confidential geological data.
The confidential clearing and confidential processing subsystem 15 provided in this example is an integrated project confidential clearing system, which is a geological data confidential clearing application system that is customized, developed and implemented by comprehensively using geographic informatization and computer engineering technologies and combining with software engineering related ideas, and uses a confidential rule management technology to serve for the confidential classification of confidential geological data.
Fig. 7 shows a schematic diagram of the business process implemented by the key clearing and key processing subsystem 15 shown in fig. 6. The same parts in fig. 7 as those in fig. 3 will not be described again here. As shown in fig. 7:
in the early preparation part, the list of the files to be cleaned can be determined according to task requirements, and data preprocessing is carried out on geological data of the library information base according to the list of the files to be cleaned. Wherein the data preprocessing may include a deduplication process.
In the rule updating part, the rule related to secret cleaning can be updated after data is finalized.
In the secret-related cleaning part, secret-related point information labeling and secret level judgment can be carried out on geological data subjected to data preprocessing according to secret-related cleaning rules, secret processing is carried out according to the secret-related point information and the secret level of the geological data, non-secret-related geological data are determined, the non-secret-related geological data are stored in the extranet service library, and the metadata base is updated according to the non-secret-related geological data.
FIG. 8 illustrates an exemplary block diagram of the online service support subsystem 16 of the geological data management system according to an embodiment of the present disclosure. As shown in fig. 8, the online service support subsystem 16 includes a pre-preparation module 161, a data encapsulation module 162, and a service publishing module 163.
The early-stage preparation module 161 is configured to obtain an open-edition result list of the geological map according to geological data of the service information base, and obtain a data screening result list according to geological data of the collection information base.
And the data packaging module 162 is used for performing data packaging processing on the public version geological map result list and the data screening result list.
And the service publishing module 163 is configured to publish the public version geological map result list and the data screening result list after the data encapsulation.
Fig. 9 shows a schematic diagram of the business process implemented using the online service support subsystem 16 shown in fig. 8. The same parts in fig. 9 as those in fig. 3 will not be described again. As shown in fig. 9:
in the early preparation part, a public version geological map result list is derived from a service information base, a data screening result list is derived from a collection service base, and data processing work is started after a task is determined.
In the data encapsulation part, one geographic thematic map can be composed of a plurality of map layers, and the map layers can be deleted. Projection transformation (projective transformation) is a process of transforming the coordinates of a map proxel of one kind into the coordinates of a proxel of another kind. The tiling is to collect all contents of the geographic information database into one File, and only one File of HDF (Hierarchical Data File) is seen in a folder outside the system. The tile watermark is obtained by adding related watermarks on a tile map through a certain watermark algorithm. In the online service support business process, the data processed by the data processor may be geographic engineering data or picture data, and if the data is the picture data, the collection and processing work of a plurality of pictures is required. Organization structure normalization may perform the following on data: determining a data format, determining whether a project file is named correctly, determining whether a file storage position is correct, determining whether data is opened normally, determining whether the data is displayed normally, determining a coordinate system, determining projection parameters, determining civil center longitude, determining a scale, determining whether the data is full, determining whether an empty layer exists, determining whether an original graph is consistent with a graph, determining a graph drawing unit of the graph and determining the graph drawing time of the graph.
In the service release part, quality control refers to rechecking the service to be registered and released.
The geological data management system provided by the embodiment can analyze, arrange, record, determine the density, integrate, decrypt, issue and the like the geological data, forms a digital resource information base which meets the characteristics of geological data and meets the requirements of permanent storage and long-term availability, and belongs to the construction project of the national geological database integrated management system.
FIG. 10 is a schematic diagram illustrating a corresponding logical architecture diagram of a geological data management system, according to an embodiment of the present disclosure. As shown in fig. 10, the logical architecture of the geological data management system may include an infrastructure layer, a data layer, a support layer, an application layer, a user layer, a standard specification system and a security system. Wherein:
the standard system and the safety guarantee system are used for guaranteeing the technology, system, user service, information safety and network safety of the construction, operation and management of the integrated offline data management and distribution system.
The infrastructure layer can comprise two parts of machine room equipment and a network, wherein the machine room equipment can comprise machine room equipment, server equipment, storage equipment and computer terminals, and the network can be a local area network inside a national geological repository, and can comprise an electronic government affairs extranet, the Internet and a mobile Internet.
The data layer mainly comprises a service database, a metadata database and a system database. The service database may include a source information base, a collection information base, and a service information base. The metadata base is built by other units, and the system can update the metadata through an interface. The system database is mainly used for storing user, authority and log information of the system.
The support layer may be an application support layer of the integrated offline data management and distribution System, and may include a GIS (Geographic Information System) base platform, a relational database, an application middleware, a metadata and directory service platform, a unified user right management platform, an integrated bus platform, and the like. The metadata and directory service platform can be used for unifying user authority management platforms, is a system for other units to build, and provides unified user information, authority configuration and access control capability for the system.
The application layer runs on each platform of the support layer, and the specific service application is completed by acquiring and calling various information resource services and basic function services provided by each platform of the support layer. The application layer can provide an integrated offline data management and distribution system for users, and can be used for realizing functions of data receiving and checking, data integrated management, data distribution, secret-related cleaning, statistical analysis and the like.
The user layer can provide data management and service for personnel in a data collection room, a data management room and a data service room, and the personnel in the data management room can have the roles of data management room leader, data management room manager, data processing group leader, data processor, quality inspector, service room personnel and the like.
FIG. 11 illustrates a schematic diagram of a corresponding technical architecture diagram of a geological data management system, according to an embodiment of the present disclosure. As shown in fig. 11, the technical architecture of the geological data management system may include an infrastructure layer, a data layer, a support layer, a service layer, an application layer and a user layer. Wherein:
the infrastructure layer can comprise two parts of machine room equipment and a network, wherein the machine room equipment can comprise machine room equipment, server equipment, storage equipment and computer terminals, and the network can be a local area network inside a national geological repository, and can comprise an electronic government affairs extranet, the Internet and a mobile Internet.
The data layer may employ a file type database (FGDB | Files System), a spatial database (geocatabase), a spatial database middleware (ArcSDE), and a relational database (Oracle11g, SQL Server, etc.). The geological data map and the related documents are mainly stored by adopting a file system of an operating system, and corresponding data index information is stored in a relational database. The spatial data are stored in two modes of a file type database and a spatial database system according to the practical use condition of the data.
The support layer can provide system foundation environment support and can comprise ArcEngine 10.1,. NET Framework 4.5, Oracle11g, ArcGIS Server10.1, MapGIS K9/10 development components, IGServer and the like.
The service layer may publish, provide a series of services invoked by the application layer based on the support platform. The service layer can comprise external system services such as a security management service, a data directory service and a metadata service, and internal system services such as a data query service, a data editing service, a task management service, a statistical analysis service and a confidential processing service, and the services can be realized based on various GIS platforms. The statistical analysis service can be service content which is mainly constructed by the system, and a statistical analysis service data operation Interface can be realized based on NET Framework Entity Framework data access and operation library development, each database object is converted into an Application program object (Entity) by using an abstract data structure mode, data fields are converted into attributes (property), relations are converted into combination attributes (association), an E/R model of the database is completely converted into an object model, a Programming language is used for calling the access database, the service is realized by NET WebAPI (Web Application Programming Interface), and the corresponding functions of a data access layer, a business model layer and a model management layer are provided with REST (Representational State Transfer) service.
The application layer can comprise two technical architectures of B/S (Browser/Server) and C/S (Client/Server). The existing system functions can be maintained in a C/S framework, and the newly added statistical analysis part can be realized in a B/S mode, so that the system is updated in time and can be applied anytime and anywhere. The B/S mainly uses JS (JavaScript) and HTML (Hypertext Markup Language) to realize interface interaction logic, and the C/S part adopts a Net window program to realize the interface interaction logic.
The user layer may include a PC (Personal Computer), a browser, a smart phone, and the like, which is not limited herein.
The geological data management system provided by the embodiment responds to the relevant national policy on geological data. The system can perform density fixing and density removing on the confidential geological data, and is a modern, diversified and multidisciplinary comprehensive management system serving the public. The system can combine geological data management with information technology, so that the geological data management is supported in an informationized way, and the system can adapt to massive and diversified geological data management. The system combines various ideas in the information age, comprehensively utilizes contents such as a geographic information technology, a computer software technology, a big data storage and a data structure technology and the like under the condition of following related regulations established by the state, establishes a set of secret-related rule management system based on the geological industry, and covers business processes such as data collection, data receiving and checking, secret-related cleaning, integration and integration, quick mapping, public service and the like.
The geological data management system provided by the embodiment is applied to bidirectional, comprehensive and convenient data information sustainable service utilization oriented to decision support and social service, so that the comprehensive management and service level of a national geological database and geological data is improved, support is provided for geological digital resource information diversification service, the development of geological work informatization is promoted, geological work is influenced on one side, and the development of national geological career is promoted.
The integrated management system of the national geological database is established by developing the research of the comprehensive integrated management technical method of multiple and mass geological data and geological data, solves the integrated management and interactive updating mechanism of the geological data, and realizes centralized display, publishing and publishing.
Having described embodiments of the present disclosure, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein were chosen in order to best explain the principles of the embodiments, the practical application, or technical improvements to the techniques in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims (9)

1. A geological data management system, comprising:
the data receiving subsystem is used for receiving, backing up, checking and warehousing the geological data in an original library;
the collected information base construction subsystem is connected with the data receiving subsystem and is used for carrying out data arrangement on the geological data in the data arrangement area and storing the geological data after data arrangement into the collected information base;
the service information base construction subsystem is connected with the collected information base construction subsystem and is used for carrying out data screening on the geological data of the data sorting area, carrying out integrated database updating maintenance according to the geological data subjected to data screening and the geological data in the collected information base, and storing the geological data subjected to updating maintenance into the service information base;
the metadata base construction subsystem is connected with the service information base construction subsystem and used for determining metadata of geological data in the service information base and storing the metadata of the geological data into the metadata base;
the secret-related cleaning and secret-related processing subsystem is respectively connected with the service information base construction subsystem and the metadatabase construction subsystem and is used for carrying out secret-related cleaning and secret processing on geological data in the service information base and the metadatabase and storing the geological data subjected to secret-related cleaning and secret processing into the extranet service base;
the online service supporting subsystem is respectively connected with the service information base construction subsystem and the secret-related cleaning and secret-keeping processing subsystem and is used for performing service packaging and publishing on the geological data subjected to secret-related cleaning and secret-keeping processing; the online service support subsystem comprises:
the early-stage preparation module is used for obtaining a public version geological map result list according to geological data of the service information base and obtaining a data screening result list according to geological data of the collection information base;
the data packaging module is used for carrying out data packaging processing on the public edition geological map result list and the data screening result list;
and the service release module is used for service release of the public edition geological map result list and the data screening result list after data encapsulation processing.
2. The system of claim 1, further comprising:
the data transfer subsystem is connected with the collected information base construction subsystem and is used for transferring the geological data of the collected information base to a second exchange area;
and the arrival service support subsystem is connected with the data transfer subsystem and is used for carrying out arrival service support on the geological data of the second exchange area.
3. The system according to claim 1 or 2, characterized in that the system further comprises:
and the emergency service support subsystem is connected with the secret-related cleaning and secret processing subsystem and is used for screening out geological data related to the emergency service support from the external network service library and storing the geological data related to the emergency service support into the emergency service information library.
4. The system of claim 1, wherein the data receiving subsystem comprises:
the data receiving module is used for receiving and copying geological data;
the data backup module is connected with the data receiving module and used for backing up geological data;
the data checking module is connected with the data receiving module and is used for checking geological data;
and the original library storage module is connected with the data inspection module and is used for storing the inspected geological data into the original information library.
5. The system of claim 4, wherein the data receiving module comprises:
the data receiving submodule is used for receiving geological data and storing the received qualification data into the first exchange area;
and the data copying submodule is connected with the data receiving submodule and is used for copying the geological data of the first exchange area to the data back-up area, the data inspection area and the data sorting area.
6. The system of claim 5, wherein the data backup module comprises:
the first backup submodule is used for backing up geological data of the data backup area;
the second backup submodule is used for backing up the geological data of the data inspection area;
and the third backup submodule is used for backing up the geological data of the data sorting area.
7. The system of claim 1, wherein the critical clearing and critical processing subsystem comprises:
the data preprocessing module is used for preprocessing the geological data in the service information base and the metadata base;
the confidential cleaning module is connected with the data preprocessing module and is used for carrying out confidential point information marking and confidential level judgment on the geological data subjected to data preprocessing according to confidential cleaning rules;
and the secret processing module is connected with the secret cleaning module and used for carrying out secret processing according to the secret point information and the secret level of the geological data, determining non-secret-related geological data and storing the non-secret-related geological data into the extranet service library.
8. The system of claim 7, wherein the critical clearing and critical processing subsystem further comprises:
and the secret-related clearing rule updating module is used for updating the secret-related clearing rule.
9. The system of claim 7 or 8, wherein the critical clearing and critical processing subsystem further comprises:
and the metadata database updating module is used for updating the metadata database according to the non-confidential geological data.
CN201611127394.2A 2016-12-09 2016-12-09 Geological data management system Expired - Fee Related CN108614819B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611127394.2A CN108614819B (en) 2016-12-09 2016-12-09 Geological data management system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611127394.2A CN108614819B (en) 2016-12-09 2016-12-09 Geological data management system

Publications (2)

Publication Number Publication Date
CN108614819A CN108614819A (en) 2018-10-02
CN108614819B true CN108614819B (en) 2021-03-09

Family

ID=63644038

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611127394.2A Expired - Fee Related CN108614819B (en) 2016-12-09 2016-12-09 Geological data management system

Country Status (1)

Country Link
CN (1) CN108614819B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112163134A (en) * 2020-09-21 2021-01-01 梁蕾 Geological data management system
CN112395476A (en) * 2020-11-04 2021-02-23 广州理工学院 Engineering data management method
CN112417499B (en) * 2020-11-18 2022-04-22 中国电子科技集团公司第三十研究所 Intranet secret point extraction and management method based on block chain
CN112633707A (en) * 2020-12-25 2021-04-09 山东省地质矿产勘查开发局第四地质大队(山东省第四地质矿产勘查院) Engineering geology management system
CN113836083A (en) * 2021-09-15 2021-12-24 云南建投第一勘察设计有限公司 Geological material library collecting and arranging system and method

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1477567A (en) * 2003-07-11 2004-02-25 中国地质大学(武汉) Computer-aided geologic investigation system based on portable machine
CN101221250A (en) * 2007-01-12 2008-07-16 大港油田集团有限责任公司 Three-dimensional stratum characteristic decryption method based on geologic information acquisition data
CN201622567U (en) * 2010-01-07 2010-11-03 深圳市勘察测绘院有限公司 Geological and geographic information system
CN101901244A (en) * 2010-01-07 2010-12-01 深圳市勘察测绘院有限公司 Geological geographic information system processing method
CN103810333A (en) * 2014-01-27 2014-05-21 长江三峡勘测研究院有限公司(武汉) Engineering geology informatization work system
CN104462539A (en) * 2014-12-24 2015-03-25 中国电建集团成都勘测设计研究院有限公司 Three-dimensional visual original exploration data management method
CN104850945A (en) * 2015-05-05 2015-08-19 中国能源建设集团江苏省电力设计院有限公司 Geological record acquisition system, and management and control method based on network and android system
KR101548647B1 (en) * 2014-12-19 2015-08-31 한국건설기술연구원 Processor for visualization of three dimensional geo-spatial information
CN104933829A (en) * 2015-05-19 2015-09-23 重庆大学 Method for constructing geological disaster prediction and early-warning system
CN105069162A (en) * 2015-08-26 2015-11-18 中国电建集团北京勘测设计研究院有限公司 Informatized exploratory adit catalog data acquisition system and method
CN105718499A (en) * 2015-12-11 2016-06-29 中国地质调查局发展研究中心 Geological data cleaning method and system
CN106023313A (en) * 2016-05-16 2016-10-12 马鞍山城智信息技术有限公司 3D geologic digital reconnaissance report generating method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9137258B2 (en) * 2012-02-01 2015-09-15 Brightpoint Security, Inc. Techniques for sharing network security event information

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1477567A (en) * 2003-07-11 2004-02-25 中国地质大学(武汉) Computer-aided geologic investigation system based on portable machine
CN101221250A (en) * 2007-01-12 2008-07-16 大港油田集团有限责任公司 Three-dimensional stratum characteristic decryption method based on geologic information acquisition data
CN201622567U (en) * 2010-01-07 2010-11-03 深圳市勘察测绘院有限公司 Geological and geographic information system
CN101901244A (en) * 2010-01-07 2010-12-01 深圳市勘察测绘院有限公司 Geological geographic information system processing method
CN103810333A (en) * 2014-01-27 2014-05-21 长江三峡勘测研究院有限公司(武汉) Engineering geology informatization work system
KR101548647B1 (en) * 2014-12-19 2015-08-31 한국건설기술연구원 Processor for visualization of three dimensional geo-spatial information
CN104462539A (en) * 2014-12-24 2015-03-25 中国电建集团成都勘测设计研究院有限公司 Three-dimensional visual original exploration data management method
CN104850945A (en) * 2015-05-05 2015-08-19 中国能源建设集团江苏省电力设计院有限公司 Geological record acquisition system, and management and control method based on network and android system
CN104933829A (en) * 2015-05-19 2015-09-23 重庆大学 Method for constructing geological disaster prediction and early-warning system
CN105069162A (en) * 2015-08-26 2015-11-18 中国电建集团北京勘测设计研究院有限公司 Informatized exploratory adit catalog data acquisition system and method
CN105718499A (en) * 2015-12-11 2016-06-29 中国地质调查局发展研究中心 Geological data cleaning method and system
CN106023313A (en) * 2016-05-16 2016-10-12 马鞍山城智信息技术有限公司 3D geologic digital reconnaissance report generating method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"基于ArcGIS的整装勘查信息系统设计与建立";袁慧香;《中国地质》;20150215;第355-362页 *
"资料数据集成与服务研究——以整装勘查区地质工作为例";王新春;《中国地质》;20160415;第692-696页 *

Also Published As

Publication number Publication date
CN108614819A (en) 2018-10-02

Similar Documents

Publication Publication Date Title
CN108614819B (en) Geological data management system
EP2609525A1 (en) Geospatial database integration
Marten et al. Sparse and dense linear algebra for machine learning on parallel-RDBMS using SQL
Candela et al. An approach to assess the quality of Jupyter projects published by GLAM institutions
KR102491599B1 (en) System for providing unified portal service for the search of cultural heritage
Huang et al. DCC curation lifecycle model 2.0: Literature review and comparative analysis
Loseto et al. A mobile and web platform for crowdsourcing obd-ii vehicle data
Rahaman et al. The scholarly rewards and tragic irony of 3D models in virtual heritage discourse
Schmidt et al. National Security Commission on Artificial Intelligence: Interim Report, November 2019
KR20080009107A (en) Personalizable information networks
Geologic Materials Repository Working Group The US Geological Survey Geologic Collections Management System (GCMS)—A master catalog and collections management plan for US Geological Survey geologic samples and sample collections
Books Caring for digital data in archaeology: A guide to good practice
Spear et al. MetPetDB: A database for metamorphic geochemistry
Morkner et al. Fostering Data Curation Throughout the Entire Carbon Storage Data Life Cycle via the Energy Data eXchange and GeoCube
Groppe et al. Anonymous shopping in the internet by separation of data
Harding Usability of geographic information: factors identified from task-focused user interviews
Al-Farisi et al. Data management and quality control in the petrophysical environment
Matthews Documentation and databases
Li et al. Design and Implementation of Survey and Design Enterprise File Sorting System
Nivin DeepNet: An Extensible Data Acquisition and Curation Framework Supporting Computer Vision Deep Learning Research
von Mering et al. DiSSCo Prepare Milestone report for MS1. 1 “Corpus of Life science user stories and use cases compiled, gaps identified and new surveys, if any, initiated” and MS1. 2 “Corpus of Earth science user stories and use cases compiled, gaps identified and new surveys, if any, initiated
Lisdorf et al. Optimize data value, not just data quality: How to avoid another Mars Climate Orbiter disaster
Dohmen Keynote-Multi Source for Digital Underground Constructions
Gao et al. Metadata design and editing module development for geological disposal of high-level radioactive waste
CN114048274A (en) Mapping result coordinate conversion system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210309