CN117194341A - Public data sharing method and device, public data platform and electronic equipment - Google Patents
Public data sharing method and device, public data platform and electronic equipment Download PDFInfo
- Publication number
- CN117194341A CN117194341A CN202310194619.XA CN202310194619A CN117194341A CN 117194341 A CN117194341 A CN 117194341A CN 202310194619 A CN202310194619 A CN 202310194619A CN 117194341 A CN117194341 A CN 117194341A
- Authority
- CN
- China
- Prior art keywords
- data
- sharing
- public
- collection
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 238000013523 data management Methods 0.000 claims abstract description 17
- 238000007726 management method Methods 0.000 claims description 25
- 238000013480 data collection Methods 0.000 claims description 24
- 238000003860 storage Methods 0.000 claims description 17
- 230000008569 process Effects 0.000 claims description 15
- 238000004140 cleaning Methods 0.000 claims description 12
- 238000012544 monitoring process Methods 0.000 claims description 9
- 230000002159 abnormal effect Effects 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 7
- 230000000875 corresponding effect Effects 0.000 description 13
- 238000004891 communication Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 5
- 238000010276 construction Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000002776 aggregation Effects 0.000 description 4
- 238000004220 aggregation Methods 0.000 description 4
- 230000010354 integration Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000003032 molecular docking Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 230000000977 initiatory effect Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 241000239290 Araneae Species 0.000 description 1
- 239000008186 active pharmaceutical agent Substances 0.000 description 1
- 238000012550 audit Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 238000010224 classification analysis Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000000586 desensitisation Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 210000001503 joint Anatomy 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Abstract
The invention provides a public data sharing method, a public data sharing device, a public data platform and electronic equipment, which relate to the technical field of public big data management and comprise the following steps: compiling a data catalog generated by an information system in a digital source unit; acquiring the collection data corresponding to the target data from the data catalog based on the data sharing application sent by the number unit; generating an approval work order according to the data sharing application, and calling a sample and a rule according to a data interface by using a number unit under the condition that the approval work order passes, so as to share common data; the technical problem that common data sharing among related departments cannot be widely applied in the prior art is solved by decoupling the number units and the number source units.
Description
Technical Field
The present invention relates to the technical field of public big data management, and in particular, to a public data sharing method and apparatus, a public data platform, and an electronic device.
Background
The current sharing data among related departments has two modes of point-to-point sharing and data interface service bus, but the public data sharing among related departments cannot be widely applied due to the consideration of the cost safety of the two modes.
Disclosure of Invention
The invention aims to provide a public data sharing method, a public data sharing device, a public data platform and electronic equipment, which are used for relieving the technical problem that public data sharing among related departments cannot be widely applied in the prior art by decoupling a digital unit and a digital source unit.
In a first aspect, an embodiment of the present invention provides a method for sharing public data, including:
compiling a data catalog generated by an information system in a digital source unit;
acquiring the collection data corresponding to the target data from the data catalog based on a data sharing application sent by a number unit;
and generating an approval work order according to the data sharing application, and calling a sample and a rule according to a data interface by the number using unit to share common data under the condition that the approval work order passes.
With reference to the first aspect, an embodiment of the present invention provides a first possible implementation manner of the first aspect, where, based on a data sharing application sent in a unit of number, a step of obtaining, from the data directory, aggregate data corresponding to target data includes:
determining a gathering state of target data based on the data catalog;
if the target data are collected, a data sharing application aiming at the target data is initiated;
if the target data is not collected, a collection application aiming at the target data is initiated, a data collection task is dispatched according to the collection application, and data collection operation is carried out on the target data to obtain collection data.
With reference to the first aspect, an embodiment of the present invention provides a second possible implementation manner of the first aspect, where, before the step of generating an approval work order according to the data sharing application, the method further includes:
and managing the collected data, and storing the collected data into a corresponding database according to the data type.
With reference to the first aspect, the embodiment of the present invention provides a third possible implementation manner of the first aspect, where the method further includes:
and if the abnormal feedback of the data quality of the number unit is received in the public data sharing process, notifying the number source unit to carry out the operations of collecting, managing, warehousing and sharing on the target data again.
With reference to the first aspect, an embodiment of the present invention provides a fourth possible implementation manner of the first aspect, where the method further includes:
monitoring and protecting public data in the whole life cycle process of the public data; and if the public data is found to be abnormal, alarming.
With reference to the first aspect, an embodiment of the present invention provides a fifth possible implementation manner of the first aspect, where the data directory includes: data table name, number source system name, number source unit name, data table field and data sample.
In a second aspect, an embodiment of the present invention further provides a common data sharing apparatus, including:
the compiling module is used for compiling a data catalog generated by the information system in the digital source unit;
the acquisition module is used for acquiring the collection data corresponding to the target data from the data catalog based on the data sharing application sent by the user number unit;
and the sharing module generates an approval work order according to the data sharing application, and under the condition that the approval work order passes, the use number unit calls a sample and a rule according to a data interface to share public data.
In a third aspect, an embodiment of the present invention further provides a public data platform, including:
the data directory system is used for acquiring data resources corresponding to the data directory by using a number unit;
the data collecting system is used for collecting target data according to the data catalogue;
the data management system is used for cleaning and correcting management operation on the collected data;
the data warehouse is used for carrying out data warehouse-building operation according to the type of the collected data;
the data sharing system is used for providing a data sharing application channel for the number unit;
and the data security system is used for performing security monitoring on the public data.
In a fourth aspect, an embodiment provides an electronic device, including a memory, a processor, where the memory stores a computer program executable on the processor, and where the processor implements the steps of the method according to any of the foregoing embodiments when the computer program is executed.
In a fifth aspect, embodiments provide a machine-readable storage medium storing machine-executable instructions that, when invoked and executed by a processor, cause the processor to implement the steps of the method of any of the preceding embodiments.
The embodiment of the invention provides a public data sharing method, a public data platform and electronic equipment, which can acquire target data of a number unit through recording a data catalog of public data of a number source unit information system and a data sharing application of the number unit, acquire the target data from the data catalog and perform collection processing on the target data to obtain collection data, and then generate an approval work order based on a sharing application sent out for the collection data.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and drawings.
In order to make the above objects, features and advantages of the present invention more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the present invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a peer-to-peer shared data model between related departments according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a related department data interface service bus data sharing model according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a common data platform architecture according to an embodiment of the present invention;
FIG. 4 is a flowchart of a method for sharing public data according to an embodiment of the present invention;
fig. 5 is a schematic functional block diagram of a common data sharing device according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a hardware architecture of an electronic device according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
With the development of the age, the quantity and the volume of public data of related departments are larger and larger, and data sharing is often needed among the departments. For example, the former trans-provincial and trans-urban business transfer connection requires business operators to carry information such as related certificates and the like to handle in related departments of the transfer place. The business transactor holds the relevant certificate and then goes to relevant departments of the home location for transacting. Finally, the certificate of the transaction is held, and the new migration department is checked. Therefore, with the development of informatization construction, more and more departments need to share data of other departments.
The traditional related departments share data in two modes of point-to-point sharing and data interface service bus.
One is sharing in a point-to-point fashion as shown in fig. 1. For example, the A department handles the B data of the B department and the C data of the C department, so that the A department can communicate with the B department and the C department, and the B department can be pulled to the A department and the C department can be pulled to the A department to share special lines in a point-to-point mode, when the A department handles the relevant function card, residents do not need to make a plurality of departments to make a running back and forth, and the A department can be used for calling the B department relevant data and the C department relevant data to quickly handle the relevant function card business. However, each level (province, city, county level) has hundreds to thousands of departments, with more and more sharing point-to-point, the network between the various departments forms a "spider web" and presents a series of typical problems: if all departments call special line shared data to a specific department, whether the original system service of the department has any security influence or not; or, a private line is opened for every two departments, so that the communication is carried out for a plurality of times in an off-line meeting, the communication and construction costs are high, and the management problem of maintaining the complex interfaces is solved.
And secondly, the data interface service bus mode shown in fig. 2 realizes cross-department data sharing through a data interface (API) central system. Different departments can register the data interfaces of the department into the API hub platform, and then the data demand department can subscribe and call the interfaces of the number source department in the API hub. While the centralized and large-area interface subscription and call mode can simplify the cross-department docking process in terms of interface management, all data interfaces are uniformly registered, applied, called and managed in an API (application program interface) center, the API center mode has two fundamental defects. Firstly, a plurality of data cannot collide, fuse and analyze on a large scale to find the value of the data. Because data calls between two APIs, one after the other, are not a way to achieve data large-scale collisions. Secondly, the nature of the interface calling mode is that in all the requirements or the digital source system which needs to generate the API, when a request with high calling quantity is met, a series of high concurrency operations may cause the digital source system to be down or dead. Therefore, the data sharing mode of the API hub is too dependent on the source system, has high performance requirements and is not beneficial to decentralized management. And meanwhile, the performance requirements on a main server and storage equipment of the log-source system are high.
Based on the above, the public data sharing method, the public data sharing device, the public data platform and the electronic equipment provided by the embodiment of the invention can solve the difficult problems of integrating, converging and managing sharing of massive public big data resources so as to support more application construction.
First, an embodiment of the present invention provides a common data platform, as shown in fig. 3, including:
and the data directory system is used for acquiring the data resources corresponding to the data directory by using the number units.
The main purpose of the data directory system 1 is to facilitate the source units to catalog data so that all relevant departments can know which data tables the source units possess, and the source units can apply for corresponding data resources through the data directory system. The data directory system supports operations such as adding, deleting, modifying, querying and the like of the public data directory.
And the data collecting system is used for collecting the target data according to the data catalogue.
The data collection system 2 mainly aims to read, copy and collect data of a number source unit to a public data platform as required, and comprises collection task management, a data synchronization channel, collection parameter configuration management and other functional modules, so that automatic creation and operation of a data collection flow can be realized. Data collection systems can be divided into two technical modes: data exchange mode and data high-speed rail mode. The data exchange mode realizes data collection through a database table bridging mode and comprises a data exchange system, a switching center, a switching front node, a bridging module, a data transmission module, a switching monitoring module and the like, and supports collection modes of databases, interfaces, files and the like. The data high-speed railway mode realizes real-time data collection by collecting data logs of a data source system and consists of a data real-time collection tool, a message subscription system, a real-time data warehouse and a task management system.
And the data management system is used for cleaning and correcting management operation on the collected data.
The data management system 3 is mainly used for cleaning the collected data, correcting and managing the problems found in the cleaning and sharing process and improving the data quality. The data management system should have the capability of collecting data flow type cleaning and offline cleaning task management, and can define and configure cleaning rules and data standards. The data management system mainly comprises functions of cleaning task management, cleaning rule management, data quality management, data problem feedback and the like.
And the data warehouse is used for carrying out data warehouse-building operation according to the type of the collected data.
After the data in the data management system is managed, the data warehouse 4 can carry out data warehouse building according to data classification and data analysis, and mainly comprises a basic warehouse and a thematic warehouse. The basic library is a basic data resource set established for population, legal person, credit information, electronic license, natural resource, geographic information and other objects. The topic library is a data resource set which surrounds the specific business field and supports the specific business scene application, and each level of business departments are responsible for construction and management. The topic library is required to rely on a public data platform to carry out data collection, management, sharing and model processing work, and a tool platform is not required to be repeatedly built. The data sharing of the thematic database also needs to incorporate a common data platform directory system and a sharing system.
The data sharing system is used for providing a data sharing application channel for the number units.
The data sharing system 5 is mainly used for providing an application channel for data sharing by a number unit and realizing government affair data sharing application, approval and data butt joint one-step service. The data sharing system has the functions of interface registration, interface list, interface management, application management, key management, security management, interface gateway, interface service monitoring, calling log analysis, log statistics summarization, log archiving, reporting and the like.
And the data security system is used for performing security monitoring on the public data.
The data security system 6 is mainly used for guaranteeing the data security of the whole public data platform, realizing the security technology protection and the security operation management covering the whole life cycle of data such as data acquisition, transmission, storage, processing, sharing, destruction and the like, and preventing data tampering, data leakage and data abuse. The system mainly comprises functional modules such as data classification, data storage encryption, data transmission encryption, data desensitization, data watermarking, digital signature, data interface access authorization, data security audit analysis tools and the like.
For the sake of understanding the present embodiment, a detailed description is provided of a public data sharing method disclosed in the present embodiment, where the method is applied to a public data platform, such as a controller, an upper computer, a server, and other intelligent control devices.
Fig. 4 is a flowchart of a method for sharing public data according to an embodiment of the present invention.
Referring to fig. 4, the method may include the steps of:
step S102, compiling a data catalog generated by the information system in the number source unit.
Wherein, the data catalog system of the data source unit based on public data platform compiles the data catalog that all information systems of this unit produced, and the data catalog includes: data table name, number source system name, number source unit name, data table field and data sample.
Step S104, acquiring the collected data corresponding to the target data from the data catalog based on the data sharing application sent by the number unit.
Illustratively, determining a status of the collection of target data based on the data catalog; if the data is collected, initiating a data sharing application aiming at the target data; if the target data is not collected, a collection application aiming at the target data is initiated, a data collection task is dispatched according to the collection application, and data collection operation is carried out on the target data to obtain collection data.
The method comprises the steps of browsing and searching a data catalog by using a number unit, searching required target data, and directly clicking a link to jump to a data sharing system to initiate a data sharing application if the data is collected; and if the data is not collected, initiating a data collection application. After the data collection system receives the data collection application sent by the data catalog system, a data collection flow is started, a data collection task list is distributed to a number source unit, the number source unit completes data collection operation according to the requirement, and the number source unit data is collected to a public data platform.
And S106, generating an approval work order according to the data sharing application, and calling a sample and a rule according to the data interface by using a number unit to share common data under the condition that the approval work order passes.
The data sharing system generates a data sharing approval work order, and after the approval of units such as a data source unit and a public data management department passes, the data sharing system calls a sample and a rule according to a data interface by the data unit to realize interface data sharing.
In a preferred embodiment of practical application, through a data directory recorded with public data of a number source unit information system and a data sharing application of a number unit, target data of the number unit can be obtained, the target data is obtained from the data directory, the target data is subjected to aggregation processing to obtain aggregation data, and then an approval work order is generated based on a sharing application sent out for the aggregation data.
It should be noted that, in the conventional point-to-point data sharing manner, the usage units and the source units are directly connected, which results in strong association between the usage units and the source units. On the one hand, if at least one unit of numbers initiates a high concurrency data call request, the source unit of numbers may be exhausted and crashed; on the other hand, if the source unit fails, the data cannot be called by the source unit easily. In the data interface service bus system, although the number source units register all data interfaces to the "data interface service bus unit", the number source units are eventually called data of the number source unit database through an interface (API), and the number source units are still strongly correlated in nature. The mutual influence of the number unit and the number source unit is large, the maintenance cost is high, and the safety performance is difficult to guarantee. The invention completely decouples the data units and the data source units through the public data platform, and the data source units only need to communicate and connect with the public data platform, so that the data generated by the units are cataloged and collected to the public data platform at regular time; the number unit only needs to communicate and connect with the public data platform, and the public data platform initiates a data sharing request, and the required public data can be obtained through an approval program. If a high concurrency data call request occurs in the number unit, the common data platform processes the data according to a security policy, so that the normal operation of the number source unit is not affected; if the digital source unit fails, the digital source unit is not influenced, and the shared use of the public data collected to the public data platform is realized.
In addition, the traditional point-to-point sharing mode and the data interface service bus mode are not used for collecting public data in one place, and the data are scattered, so that the data are not beneficial to the data fusion collision to release the data resource value; secondly, the data sharing efficiency of the whole system is low, and the data sharing cost is high; thirdly, the data security responsibility of the whole system is dispersed, the data security is difficult to manage, and the data security is difficult to guarantee. The public data platform provided by the invention gathers public data of all relevant departments, firstly, mass data gathering is adopted, so that public data fusion collision analysis is facilitated, and public data resource value is released to the maximum extent; secondly, through the data centralization and the unified data catalogue, the data sharing service is provided for the outside in a unified way, the efficiency of searching and applying for the required data resources by the digital departments is greatly improved, and the docking cost (comprising the communication docking cost and the construction operation and maintenance cost) for realizing the data sharing by the digital departments is greatly reduced; thirdly, through the data set, firm data security firewall can be built uniformly, and data security management of the whole system is facilitated.
The public data in the embodiment of the invention mainly refers to data collected and generated by related departments, public transaction function organizations, public service operation units such as water supply, power supply, air supply, public transportation and the like in the process of performing the responsibilities or providing public services in law, and can also be called public data. The technical scheme of the data integration and sharing platform can be applied to the fields of large public data and enterprise large data aggregation and integration, management and data sharing.
In some embodiments, prior to step S106, the method further comprises:
step 1.1), treating the collected data, and storing the collected data into a corresponding database according to the data type.
After the collected data enter the public data platform, the data management system cleans the data according to a set cleaning rule, generates a data management work order for the existing data problem, and feeds the data management work order back to the digital source unit for rectification. The treated data enter a data warehouse; different base libraries, topic libraries and collection libraries can be entered for storage according to different data types.
In some embodiments, the method further comprises:
step 2.1), if abnormal feedback of data quality of the number units is received in the public data sharing process, notifying the number source units to re-perform the operations of gathering, managing, warehousing and sharing on the target data.
Specifically, if the data quality problem is found in the process of using the shared data by the number unit, a data objection processing work order can be initiated in the data management system, the data quality problem is fed back to the number source unit, and the data collection, management, warehousing and sharing are performed again after the data correction is completed by the number source unit.
In some embodiments, to further ensure the reliability of the shared data, the method further comprises the steps of:
step 3.1), monitoring and protecting the public data in the whole life cycle process of the public data; and if the public data is found to be abnormal, alarming.
In the process of a data full life cycle of data collection, data management, data warehousing and data sharing, a data security system monitors and protects the data security of a public data platform, data security problems such as data tampering, data unauthorized access, data abuse and the like are found, timely alarming is carried out, and special personnel timely close-loop treatment is carried out.
The invention realizes the convergence and integration of data resources produced by different related departments and different information systems, the treatment and the warehouse building and the external sharing through a public data platform which operates independently; through decoupling of the number source system and the number utilization system, centralized management and shared scheduling of large government data are realized, the value of data resources is fully released, and the data safety is ensured. In addition, the public data platform disclosed by the invention comprises subsystems such as a data directory system, a data collection system, a data management system, a data warehouse, a data sharing system and the like. The data catalog system supports a data source unit to catalog the data table, so that the data source can be conveniently queried and retrieved by the data unit. The data collection system realizes the convergence, integration and collection of the data resources produced by the data source system. The data management system realizes cleaning and management of the collected data and feedback correction of the data problems found in the process of sharing the data, ensures the data integrity and improves the data quality. The data warehouse enables storage, analysis, and process modeling of high quality data resources. The data sharing system realizes the external sharing utilization of the data resources. The data security system ensures the data security of the whole public data platform through monitoring, protection and other means.
As shown in fig. 5, an embodiment of the present invention provides a common data sharing apparatus, including:
the compiling module is used for compiling a data catalog generated by the information system in the digital source unit;
the acquisition module is used for acquiring the collection data corresponding to the target data from the data catalog based on the data sharing application sent by the user number unit;
and the sharing module generates an approval work order according to the data sharing application, and under the condition that the approval work order passes, the use number unit calls a sample and a rule according to a data interface to share public data.
In some embodiments, the obtaining module is further specifically configured to determine, based on the data directory, a gathering state of the target data; if the target data are collected, a data sharing application aiming at the target data is initiated; if the target data is not collected, a collection application aiming at the target data is initiated, a data collection task is dispatched according to the collection application, and data collection operation is carried out on the target data to obtain collection data.
In some embodiments, before the step of generating an approval work order according to the data sharing application, the device is further configured to administer the collected data and store the collected data in a corresponding database according to a data type.
In some embodiments, the device is further configured to notify the number source unit to re-perform operations of collecting, managing, warehousing and sharing the target data if the abnormal feedback of the data quality of the number unit is received in a common data sharing process.
In some embodiments, the apparatus is further configured to monitor and protect the public data during a full lifecycle of the public data; and if the public data is found to be abnormal, alarming.
In some embodiments, the data directory includes: data table name, number source system name, number source unit name, data table field and data sample.
In the embodiment of the present invention, the electronic device may be, but is not limited to, a personal computer (Personal Computer, PC), a notebook computer, a monitoring device, a server, and other computer devices with analysis and processing capabilities.
As an exemplary embodiment, referring to fig. 6, an electronic device 110 includes a communication interface 111, a processor 112, a memory 113, and a bus 114, the processor 112, the communication interface 111, and the memory 113 being connected by the bus 114; the memory 113 is used for storing a computer program supporting the processor 112 to execute the method, and the processor 112 is configured to execute the program stored in the memory 113.
The machine-readable storage medium referred to herein may be any electronic, magnetic, optical, or other physical storage device that can contain or store information, such as executable instructions, data, or the like. For example, a machine-readable storage medium may be: RAM (Radom Access Memory, random access memory), volatile memory, non-volatile memory, flash memory, a storage drive (e.g., hard drive), any type of storage disk (e.g., optical disk, dvd, etc.), or a similar storage medium, or a combination thereof.
The non-volatile medium may be a non-volatile memory, a flash memory, a storage drive (e.g., hard drive), any type of storage disk (e.g., optical disk, dvd, etc.), or a similar non-volatile storage medium, or a combination thereof.
It can be understood that the specific operation method of each functional module in this embodiment may refer to the detailed description of the corresponding steps in the above method embodiment, and the detailed description is not repeated here.
The computer readable storage medium provided by the embodiments of the present invention stores a computer program, where the computer program code may implement the method described in any of the foregoing embodiments when executed, and the specific implementation may refer to the method embodiment and will not be described herein.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described system and apparatus may refer to corresponding procedures in the foregoing method embodiments, which are not described herein again.
In addition, in the description of embodiments of the present invention, unless explicitly stated and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention will be understood in specific cases by those of ordinary skill in the art.
In the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. are based on the directions or positional relationships shown in the drawings, are merely for convenience of describing the present invention and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and thus should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
Finally, it should be noted that: the above examples are only specific embodiments of the present invention, and are not intended to limit the scope of the present invention, but it should be understood by those skilled in the art that the present invention is not limited thereto, and that the present invention is described in detail with reference to the foregoing examples: any person skilled in the art may modify or easily conceive of the technical solution described in the foregoing embodiments, or perform equivalent substitution of some of the technical features, while remaining within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention, and are intended to be included in the scope of the present invention.
Claims (10)
1. A method for sharing common data, comprising:
compiling a data catalog generated by an information system in a digital source unit;
acquiring the collection data corresponding to the target data from the data catalog based on a data sharing application sent by a number unit;
and generating an approval work order according to the data sharing application, and calling a sample and a rule according to a data interface by the number using unit to share common data under the condition that the approval work order passes.
2. The method of claim 1, wherein the step of obtaining the collected data corresponding to the target data from the data directory based on the data sharing application issued in units of number, comprises:
determining a gathering state of target data based on the data catalog;
if the target data are collected, a data sharing application aiming at the target data is initiated;
if the target data is not collected, a collection application aiming at the target data is initiated, a data collection task is dispatched according to the collection application, and data collection operation is carried out on the target data to obtain collection data.
3. The method of claim 2, wherein prior to the step of generating an approval work order from the data sharing application, the method further comprises:
and managing the collected data, and storing the collected data into a corresponding database according to the data type.
4. The method according to claim 1, wherein the method further comprises:
and if the abnormal feedback of the data quality of the number unit is received in the public data sharing process, notifying the number source unit to carry out the operations of collecting, managing, warehousing and sharing on the target data again.
5. The method according to claim 1 or 4, characterized in that the method further comprises:
monitoring and protecting public data in the whole life cycle process of the public data; and if the public data is found to be abnormal, alarming.
6. The method of claim 1, wherein the data directory comprises: data table name, number source system name, number source unit name, data table field and data sample.
7. A common data sharing apparatus, comprising:
the compiling module is used for compiling a data catalog generated by the information system in the digital source unit;
the acquisition module is used for acquiring the collection data corresponding to the target data from the data catalog based on the data sharing application sent by the user number unit;
and the sharing module generates an approval work order according to the data sharing application, and under the condition that the approval work order passes, the use number unit calls a sample and a rule according to a data interface to share public data.
8. A common data platform, comprising:
the data directory system is used for acquiring data resources corresponding to the data directory by using a number unit;
the data collecting system is used for collecting target data according to the data catalogue;
the data management system is used for cleaning and correcting management operation on the collected data;
the data warehouse is used for carrying out data warehouse-building operation according to the type of the collected data;
the data sharing system is used for providing a data sharing application channel for the number unit;
and the data security system is used for performing security monitoring on the public data.
9. An electronic device comprising a memory, a processor and a program stored on the memory and capable of running on the processor, the processor implementing the method of any one of claims 1 to 6 when executing the program.
10. A computer readable storage medium, characterized in that the computer program is stored in the readable storage medium, which computer program, when executed, implements the method of any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310194619.XA CN117194341A (en) | 2023-02-27 | 2023-02-27 | Public data sharing method and device, public data platform and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310194619.XA CN117194341A (en) | 2023-02-27 | 2023-02-27 | Public data sharing method and device, public data platform and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117194341A true CN117194341A (en) | 2023-12-08 |
Family
ID=88983888
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310194619.XA Pending CN117194341A (en) | 2023-02-27 | 2023-02-27 | Public data sharing method and device, public data platform and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117194341A (en) |
-
2023
- 2023-02-27 CN CN202310194619.XA patent/CN117194341A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102577139B1 (en) | Smart contract-based data processing methods, devices, and storage media | |
| CN110716832B (en) | Service operation monitoring and alarming method, system, electronic equipment and storage medium | |
| CN108134764B (en) | Distributed data sharing and exchanging method and system | |
| CN100578455C (en) | Resource functionality verification before use by a grid job submitted to a grid environment | |
| US20120054155A1 (en) | Systems and methods for dynamically replicating data objects within a storage network | |
| CN105868914A (en) | Cloud management system and management method of automobile electronic health archive | |
| CN109905492B (en) | Safety operation management system and method based on distributed modular data center | |
| CN104504014A (en) | Data processing method and device based on large data platform | |
| CN110063042B (en) | Database fault response method and terminal thereof | |
| CN109787844A (en) | A kind of distribution master station communication fault fast positioning system | |
| CN111177480A (en) | Block chain directory file system | |
| CN113746684B (en) | Network equipment management method and device, computer equipment and storage medium | |
| CN107248934A (en) | A kind of automatic detecting method and device | |
| CN109600395A (en) | A kind of device and implementation method of terminal network access control system | |
| CN111506661B (en) | Content access management method, device and storage medium | |
| CN113411209A (en) | Distributed password service full-link detection system and method | |
| CN117194341A (en) | Public data sharing method and device, public data platform and electronic equipment | |
| CN114070856B (en) | Data processing method, device, system, operation and maintenance auditing equipment and storage medium | |
| CN112448972B (en) | Data exchange and sharing platform | |
| CN108304731A (en) | A kind of method, system and information processing platform that management business data calls | |
| CN109412861B (en) | Method for establishing security association display of terminal network | |
| CN113421052A (en) | Data sharing management method, system and computer readable storage medium | |
| CN113220480A (en) | Distributed data task cross-cloud scheduling system and method | |
| CN114826902B (en) | Cross-region operation and maintenance data storage method and device | |
| CN114268464B (en) | Stock asset supervision system for heterogeneous data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |