CN112199431A - Method for sharing data based on metadata and data sharing system - Google Patents

Method for sharing data based on metadata and data sharing system Download PDF

Info

Publication number
CN112199431A
CN112199431A CN202011110943.1A CN202011110943A CN112199431A CN 112199431 A CN112199431 A CN 112199431A CN 202011110943 A CN202011110943 A CN 202011110943A CN 112199431 A CN112199431 A CN 112199431A
Authority
CN
China
Prior art keywords
data
data sharing
sharing
deployment
metadata
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011110943.1A
Other languages
Chinese (zh)
Other versions
CN112199431B (en
Inventor
谢进
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Fanglian Yunma Technology Co ltd
Original Assignee
Chengdu Fanglian Yunma Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Fanglian Yunma Technology Co ltd filed Critical Chengdu Fanglian Yunma Technology Co ltd
Priority to CN202011110943.1A priority Critical patent/CN112199431B/en
Publication of CN112199431A publication Critical patent/CN112199431A/en
Application granted granted Critical
Publication of CN112199431B publication Critical patent/CN112199431B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/254Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/45Structures or tools for the administration of authentication
    • G06F21/46Structures or tools for the administration of authentication by designing passwords or checking the strength of passwords
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/602Providing cryptographic facilities or services

Abstract

The invention discloses a method and a system for sharing data based on metadata, wherein the method comprises the steps of reading a table of a database and metadata forming a basis of an ER relationship, adding comments to establish the ER relationship, and deleting a useless table and a field in the metadata; acquiring a page data resource directory and a mapping relation between the directory and a table in a database, and generating query sql; establishing a dataFrame for the data sets, associating the data sets through the dataFrame and configuring a data sharing task; loading a configuration file, manufacturing a container mirror image, pushing the mirror image to a private mirror image warehouse, and issuing a data sharing task by a deployment program; and the data sharing mechanism finishes registering and submits the request, finishes data sharing key distribution and receives data configuration information for data sharing. The invention can realize active metadata maintenance, carry out uniform authorization management on users accessing data sharing, reduce the technical complexity of data sharing and improve the data sharing efficiency through the deployment and visual configuration of the data sharing program.

Description

Method for sharing data based on metadata and data sharing system
Technical Field
The present invention relates to the field of data sharing technologies, and in particular, to a method and a system for data sharing based on metadata.
Background
In the past 20 years, the economy of China is increased at a high speed for 20 years, and the digitalized construction of China is rapidly developed for 20 years, and a great amount of data is accumulated in various industries and governments. Although the amount of data is large, the data is relatively dispersed, the relevance is not strong, and the data islanding phenomenon is relatively serious. With the implementation of the policy of "releasing administration" in China, IT is becoming one of the important indexes for IT system construction that "let data run more and the crowd break less". Data sharing across industries, government departments, and even between government departments and industries is increasing.
Current data sharing techniques are essentially focused on hardware devices or on untrusted blockchain data sharing. But in fact is mostly based on trust-based data sharing on either the B-side or the G-side. Based on trusted data sharing, the importance of management is greater than data sharing technology implementation. In other words, managing data sharing is also a highly valued technique.
Most IT systems are built as required, and a unified top-level plan is lacked, so that data resources are distributed in the IT systems, and a clear directory structure is not available. The technical means for realizing data sharing are various, and uniform authorization and monitoring are not performed, so that data management is at the edge of being out of control, and great data safety hazards exist. The data sharing technology is not unified, so that the data sharing technology has high complexity, the development efficiency of the data sharing program is low, and the maintenance cost is high.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a method and a system for sharing data based on metadata.
The purpose of the invention is realized by the following technical scheme:
a method for data sharing based on metadata, comprising the steps of:
the method comprises the following steps: initializing data resources, reading tables and ER relations of a database through a data resource initialization subprogram, forming basic metadata, adding comments to the metadata, establishing the ER relations, and deleting useless tables and fields in the metadata;
step two: configuring a data set, acquiring a page data resource directory, generating query sql of the data set according to a mapping relation between the data resource directory and a table in a database, and configuring the sql to generate the data set;
step three: configuring a data sharing task, constructing a dataFrame of a pandas for each data set, associating a plurality of data sets through the dataFrame, and configuring the associated data sets in the data sharing task;
step four: releasing a data sharing task, selecting a data releasing mode, loading a yaml configuration file to a corresponding template program, manufacturing a container mirror image, pushing the mirror image to a private mirror image warehouse, selecting a deployment mode to deploy a corresponding data sharing program, and releasing the data sharing task;
step five: and data sharing exchange, namely encrypting the data set by the data issuing mechanism, finishing registration and submitting a data sharing permission request by the data sharing mechanism, receiving the shared data after the request passes, selecting a data sharing task, distributing a data sharing secret key with the data issuing mechanism, receiving data configuration information, decrypting the encrypted data set according to the distributed shared secret key, and loading the decrypted data set in an inert loading mode to finish data sharing.
Specifically, the data publishing mode in the fourth step includes an RESTFul interface pushing mode, a base table pushing mode and a message pushing mode;
the RESTFul interface pushing mode reads sql corresponding to the data set by adopting a configuration program, and then writes the sql into a Yaml configuration file of the RESTFul interface;
the base table pushing mode can simultaneously configure the number of ETL nodes, the concurrent number of each node and the execution plan by reading the sql of the data set, and write the configuration data into an ETL program yaml configuration file;
the message pushing mode firstly configures a pushed data set, configures message reading frequency and intermediate type of a target end message, and writes configuration data into a message pushing program yaml configuration file.
Specifically, the deployment modes of the data sharing program in the fourth step include container deployment and k8s deployment; the container deployment is used for deploying data sharing tasks issued by a base table pushing mode and a message pushing mode; the k8s is used for deploying the data sharing task issued by the RESTFul interface pushing method in a cluster mode.
Specifically, the deployment process of the container deployment specifically includes: and loading the yaml configuration file to a corresponding template program, manufacturing a container mirror image, pushing the mirror image to a private mirror image warehouse, and manually assigning or automatically assigning a server through paramiko ssh.
Specifically, the deployment process of the k8s deployment specifically includes: and loading the yaml configuration file to a corresponding template program, manufacturing a container mirror image, pushing the mirror image to a private mirror image warehouse, manufacturing a k8s deployment yaml file, uploading the deployment yaml file of the deployment yaml to a server where a k8s management client is located through paramiko, executing a k8s deployment command, and generating the deployment yaml.
Specifically, the process that the data issuing organization encrypts the data set in the fifth step includes: the data issuing organization firstly reads data of a data set, selects an encryption field through a yaml configuration file, randomly generates 24-bit character strings in an ascii character + digital form as a password of 3DES, encrypts the data of the selected encryption field through the 3DES password with the length of 24-bit password, and finally encrypts the 24-bit 3DES password through rsa public key files and adds the 24-bit 3DES password to shared data.
Specifically, the process of decrypting, by the data sharing mechanism, the encrypted data set according to the distributed shared key in the fifth step includes: and decrypting the data of the 3DES _ CODE by using an rsa private key distributed by the data issuing mechanism to obtain a 3DES password, and decrypting the encrypted data set by using a 3DES decryption algorithm to obtain the decrypted data set.
A system for data sharing based on metadata includes
The data initialization module is used for reading the table and ER relation of the database, generating basic metadata, performing annotation adding on the metadata, establishing the ER relation, and performing operation of deleting a useless table and a field in the metadata;
the data set configuration module is used for acquiring a page data resource directory and generating query sql of a data set according to the mapping relation between the data resource directory and a table in a database;
the data sharing task configuration module is used for constructing a dataFrame of a pandas for each data set, associating a plurality of data sets through the dataFrame, and configuring the associated data sets in a data sharing task;
the task issuing module is used for selecting a data issuing mode, loading the yaml configuration file to a corresponding template program, manufacturing a container mirror image, pushing the mirror image to a private mirror image warehouse, selecting a deployment mode to deploy a corresponding data sharing program and issuing a data sharing task;
and the data sharing management module is used for providing registration and data sharing permission request submitting services for the data sharing mechanism, approving the data sharing request and managing the transmission of the shared data.
The invention has the beneficial effects that: the invention can realize active metadata maintenance, ensure the data resource catalog to be consistent with the real environment and carry out uniform authorization management on users accessing data sharing. Deploying the data sharing program through the container, orchestrating the container through k8s, and then invoking k8s api to manage and monitor the data sharing program. And the data sharing program is configured visually, so that the technical complexity of data sharing is reduced, and business personnel can also issue a data sharing task according to business requirements to complete data sharing.
Drawings
FIG. 1 is a flow chart of the method of the present invention.
Fig. 2 is a system architecture diagram of the present invention.
Detailed Description
In order to more clearly understand the technical features, objects, and effects of the present invention, embodiments of the present invention will now be described with reference to the accompanying drawings.
In this embodiment, as shown in fig. 1, a method for sharing data based on metadata includes the following steps:
the method comprises the following steps: initializing data resources, reading tables and ER relations of a database through a data resource initialization subprogram, forming basic metadata, adding comments to the metadata, establishing the ER relations, and deleting useless tables and fields in the metadata.
Step two: and configuring a data set, acquiring a page data resource directory, and generating query sql of the data set according to the mapping relation between the data resource directory and a table in a database. The data of the data set is lazy loaded, namely, the data is loaded only when a sharing request is made, and the data exists in a configuration file mode before being added to the sharing program.
Step three: configuring a data sharing task, constructing a dataFrame of a pandas for each data set, associating a plurality of data sets through the dataFrame, and configuring the associated data sets in the data sharing task. After the configuration of the data sets is completed, a data sharing task can be configured, the data sharing is carried out based on the configured data sets, a plurality of data sets can be configured in one sharing task, but the association relation before the data sets needs to be specified, each data set corresponds to a dataFrame of a pandas, the association is carried out through the dataFrame during the association, and the pressure of the database is well transferred. The configured data sharing task supports three publishing modes of RESTFul interface pushing, base table pushing, message pushing and the like to publish data.
Step four: and releasing the data sharing task, selecting a data releasing mode, loading the yaml configuration file to a corresponding template program, manufacturing a container mirror image, pushing the mirror image to a private mirror image warehouse, selecting a deployment mode to deploy a corresponding data sharing program, and releasing the data sharing task.
The publishing mode refers to RESTFul interface, library table pushing and message pushing, namely which modes can be selected when the sharing task configuration is configured, multiple selection is supported, and simultaneous publishing is represented. Each publishing mode corresponds to a template program, and the variable is the yaml configuration file. The data release mode comprises an RESTFul interface push mode, a base table push mode and a message push mode. And reading sql corresponding to the data set by adopting a configuration program in the RESTFul interface pushing mode, and writing the sql into a configuration file of the RESTFul interface yaml. The base table pushing mode can simultaneously configure the number of ETL nodes, the concurrent number of each node and the execution plan by reading the sql of the data set, and write the configuration data into the yaml configuration file of the ETL program. The message pushing mode firstly configures a pushed data set, configures message reading frequency and intermediate type of a target end message, and writes configuration data into a message pushing program yaml configuration file.
The deployment modes of the data sharing program comprise container deployment and k8s deployment. The container deployment is used for deploying data sharing tasks issued by a base table pushing mode and a message pushing mode. k8s is used for deploying the data sharing task issued by the RESTFul interface push method in a cluster mode.
The deployment process of container deployment specifically includes: and loading the yaml configuration file to a corresponding template program, manufacturing a container mirror image, pushing the mirror image to a private mirror image warehouse, and manually assigning or automatically assigning a server through paramiko ssh.
The deployment process of the k8s deployment specifically includes: and loading the yaml configuration file to a corresponding template program, manufacturing a container mirror image, pushing the mirror image to a private mirror image warehouse, manufacturing a k8s deployment yaml file, uploading the deployment yaml file of the deployment yaml to a server where a k8s management client is located through paramiko, executing a k8s deployment command, and generating the deployment yaml.
Step five: and data sharing exchange, namely, completing registration and submitting a data sharing permission request by a data sharing mechanism, receiving shared data after the request passes, selecting a data sharing task, distributing a data sharing key with a data issuing mechanism, receiving data configuration information, and receiving the data to complete data sharing. All organizations or units needing to share data need to register users and apply for authority, and can receive shared data after approval of data management bodies is passed.
In the data sharing exchange process, firstly, an RSA public key/private key pair is generated, when a data sharing user is registered, a data sharing key is distributed when a data issuing mechanism finishes examination and approval, the sharing key is generated through an RSA toolkit of python, two pem files of the public key and the private key are generated, the public key is stored by the data issuing mechanism and used for encrypting data, and the private key is provided for the user and the data sharing mechanism and used for decrypting the data.
Considering performance issues, rsa does not encrypt data directly, but encrypts data with 3DES, using rsa to encrypt the cipher of 3 DES. A3 des _ code field is added to each data issuing mechanism shared out and used for storing a password for data encryption. The process that the data issuing organization firstly encrypts the data set comprises the following steps: the data issuing organization firstly reads data of a data set, selects an encryption field through a yaml configuration file, randomly generates 24-bit character strings in an ascii character + digital form as a password of 3DES, encrypts the data of the selected encryption field through the 3DES password with the length of 24-bit password, and finally encrypts the 24-bit 3DES password through rsa public key files and adds the 24-bit 3DES password to shared data.
When the user uses the shared data, the encrypted data is decrypted firstly, and the process of decrypting the encrypted data set by the data sharing mechanism according to the distributed shared key comprises the following steps: and decrypting the data of the 3DES _ CODE by using an rsa private key distributed by the data issuing mechanism to obtain a 3DES password, and decrypting the encrypted data set by using a 3DES decryption algorithm to obtain the decrypted data set.
In the present invention, as shown in fig. 2, a system for performing data sharing based on metadata is provided, which includes a data initialization module, a data set configuration module, a data sharing task configuration module, a task issuing module, and a data sharing management module. The data initialization module is used for reading a table and an ER relation of the database, generating basic metadata, performing annotation adding on the metadata, establishing the ER relation, and performing operation of deleting a useless table and a field in the metadata.
And the data set configuration module is used for acquiring the page data resource catalog and generating the query sql of the data set according to the mapping relation between the data resource catalog and the table in the database.
And the data sharing task configuration module is used for constructing a dataFrame of a pandas for each data set, associating the data sets through the dataFrame, and configuring the associated data sets in a data sharing task.
And the task issuing module is used for selecting a data issuing mode, loading the yaml configuration file to the corresponding template program, manufacturing a container mirror image, pushing the mirror image to the private mirror image warehouse, selecting a deployment mode to deploy the corresponding data sharing program, and issuing the data sharing task.
And the data sharing management module is used for providing registration and data sharing permission request submitting services for the data sharing mechanism, approving the data sharing request and managing the transmission of the shared data.
The foregoing shows and describes the general principles and broad features of the present invention and advantages thereof. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, which are described in the specification and illustrated only to illustrate the principle of the present invention, but that various changes and modifications may be made therein without departing from the spirit and scope of the present invention, which fall within the scope of the invention as claimed. The scope of the invention is defined by the appended claims and equivalents thereof.

Claims (8)

1. A method for data sharing based on metadata, comprising the steps of:
the method comprises the following steps: initializing data resources, reading tables and ER relations of a database through a data resource initialization subprogram, forming basic metadata, adding comments to the metadata, establishing the ER relations, and deleting useless tables and fields in the metadata;
step two: configuring a data set, acquiring a page data resource directory, generating query sql of the data set according to a mapping relation between the data resource directory and a table in a database, and configuring the sql to generate the data set;
step three: configuring a data sharing task, constructing a dataFrame of a pandas for each data set, associating a plurality of data sets through the dataFrame, and configuring the associated data sets in the data sharing task;
step four: releasing a data sharing task, selecting a data releasing mode, loading a yaml configuration file to a corresponding template program, manufacturing a container mirror image, pushing the mirror image to a private mirror image warehouse, selecting a deployment mode to deploy a corresponding data sharing program, and releasing the data sharing task;
step five: and data sharing exchange, namely encrypting the data set by the data issuing mechanism, finishing registration and submitting a data sharing permission request by the data sharing mechanism, receiving the shared data after the request passes, selecting a data sharing task, distributing a data sharing secret key with the data issuing mechanism, receiving data configuration information, decrypting the encrypted data set according to the distributed shared secret key, and loading the decrypted data set in an inert loading mode to finish data sharing.
2. The method according to claim 1, wherein the data publishing mode in step four includes a RESTFul interface pushing mode, a base table pushing mode and a message pushing mode;
the RESTFul interface pushing mode reads sql corresponding to the data set by adopting a configuration program, and then writes the sql into a Yaml configuration file of the RESTFul interface;
the base table pushing mode can simultaneously configure the number of ETL nodes, the concurrent number of each node and the execution plan by reading the sql of the data set, and write the configuration data into an ETL program yaml configuration file;
the message pushing mode firstly configures a pushed data set, configures message reading frequency and intermediate type of a target end message, and writes configuration data into a message pushing program yaml configuration file.
3. The method for data sharing based on metadata according to claim 1, wherein the deployment modes of the data sharing program in the fourth step include container deployment and k8s deployment; the container deployment is used for deploying data sharing tasks issued by a base table pushing mode and a message pushing mode; the k8s is used for deploying the data sharing task issued by the RESTFul interface pushing method in a cluster mode.
4. The method according to claim 3, wherein the deployment process of the container deployment specifically includes: and loading the yaml configuration file to a corresponding template program, manufacturing a container mirror image, pushing the mirror image to a private mirror image warehouse, and manually assigning or automatically assigning a server through paramiko ssh.
5. The method according to claim 3, wherein the deployment process of the k8s deployment specifically includes: and loading the yaml configuration file to a corresponding template program, manufacturing a container mirror image, pushing the mirror image to a private mirror image warehouse, manufacturing a k8s deployment yaml file, uploading the deployment yaml file of the deployment yaml to a server where a k8s management client is located through paramiko, executing a k8s deployment command, and generating the deployment yaml.
6. The method for data sharing based on metadata as claimed in claim 1, wherein the process of encrypting the data set by the data issuing authority in the fifth step includes: the data issuing organization firstly reads data of a data set, selects an encryption field through a yaml configuration file, randomly generates 24-bit character strings in an ascii character + digital form as a password of 3DES, encrypts the data of the selected encryption field through the 3DES password with the length of 24-bit password, and finally encrypts the 24-bit 3DES password through rsa public key files and adds the 24-bit 3DES password to shared data.
7. The method of claim 1, wherein the step five decryption process of the encrypted data set by the data sharing mechanism according to the distributed shared key comprises: and decrypting the data of the 3DES _ CODE by using an rsa private key distributed by the data issuing mechanism to obtain a 3DES password, and decrypting the encrypted data set by using a 3DES decryption algorithm to obtain the decrypted data set.
8. A system for sharing data based on metadata, comprising
The data initialization module is used for reading the table and ER relation of the database, generating basic metadata, performing annotation adding on the metadata, establishing the ER relation, and performing operation of deleting a useless table and a field in the metadata;
the data set configuration module is used for acquiring a page data resource directory and generating query sql of a data set according to the mapping relation between the data resource directory and a table in a database;
the data sharing task configuration module is used for constructing a dataFrame of a pandas for each data set, associating a plurality of data sets through the dataFrame, and configuring the associated data sets in a data sharing task;
the task issuing module is used for selecting a data issuing mode, loading the yaml configuration file to a corresponding template program, manufacturing a container mirror image, pushing the mirror image to a private mirror image warehouse, selecting a deployment mode to deploy a corresponding data sharing program and issuing a data sharing task;
and the data sharing management module is used for providing registration and data sharing permission request submitting services for the data sharing mechanism, approving the data sharing request and managing the transmission of the shared data.
CN202011110943.1A 2020-10-16 2020-10-16 Metadata-based data sharing method and data sharing system Active CN112199431B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011110943.1A CN112199431B (en) 2020-10-16 2020-10-16 Metadata-based data sharing method and data sharing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011110943.1A CN112199431B (en) 2020-10-16 2020-10-16 Metadata-based data sharing method and data sharing system

Publications (2)

Publication Number Publication Date
CN112199431A true CN112199431A (en) 2021-01-08
CN112199431B CN112199431B (en) 2024-03-15

Family

ID=74009205

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011110943.1A Active CN112199431B (en) 2020-10-16 2020-10-16 Metadata-based data sharing method and data sharing system

Country Status (1)

Country Link
CN (1) CN112199431B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112883025A (en) * 2021-01-25 2021-06-01 北京云思畅想科技有限公司 System and method for visualizing mapping relation of ceph internal data structure

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20150018024A (en) * 2013-08-08 2015-02-23 주식회사 에스원 Data sharing method and data sharing system
CN109379399A (en) * 2018-08-31 2019-02-22 杭州东方通信软件技术有限公司 A kind of data sharing based on metadata is from subscribing to processing method and system
CN111176867A (en) * 2020-01-16 2020-05-19 创意信息技术股份有限公司 Data sharing exchange and open application platform
CN111342961A (en) * 2020-03-04 2020-06-26 贵州弈趣云创科技有限公司 Method for realizing data cross-platform sharing by configuring key pair

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20150018024A (en) * 2013-08-08 2015-02-23 주식회사 에스원 Data sharing method and data sharing system
CN109379399A (en) * 2018-08-31 2019-02-22 杭州东方通信软件技术有限公司 A kind of data sharing based on metadata is from subscribing to processing method and system
CN111176867A (en) * 2020-01-16 2020-05-19 创意信息技术股份有限公司 Data sharing exchange and open application platform
CN111342961A (en) * 2020-03-04 2020-06-26 贵州弈趣云创科技有限公司 Method for realizing data cross-platform sharing by configuring key pair

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
辜寄蓉等: "基于元数据的信息共享机制研究", 物探化探计算技术, vol. 28, no. 1, 28 February 2006 (2006-02-28), pages 75 - 79 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112883025A (en) * 2021-01-25 2021-06-01 北京云思畅想科技有限公司 System and method for visualizing mapping relation of ceph internal data structure

Also Published As

Publication number Publication date
CN112199431B (en) 2024-03-15

Similar Documents

Publication Publication Date Title
US10402376B2 (en) Secure cloud-based shared content
US10691817B2 (en) Encryption for distributed storage and processing
CN102394894B (en) Network virtual disk file safety management method based on cloud computing
US10581603B2 (en) Method and system for secure delegated access to encrypted data in big data computing clusters
US7792300B1 (en) Method and apparatus for re-encrypting data in a transaction-based secure storage system
US9894040B2 (en) Trust services for securing data in the cloud
US20230087628A1 (en) Compromise free cloud data encryption and security
US20140115327A1 (en) Trust services data encryption for multiple parties
US20100325732A1 (en) Managing Keys for Encrypted Shared Documents
US10951396B2 (en) Tamper-proof management of audit logs
Shetty et al. Data security in Hadoop distributed file system
WO2019082442A1 (en) Data registration method, data decoding method, data structure, computer, and program
CA2773293A1 (en) Multiple independent encryption domains
Sangeetha et al. Multi keyword searchable attribute based encryption for efficient retrieval of health Records in Cloud
Muthurajkumar et al. Secured data storage and retrieval algorithm using map reduce techniques and chaining encryption in cloud databases
JP2022544484A (en) Encrypted Knowledge Graph
WO2018208786A1 (en) Method and system for secure delegated access to encrypted data in big data computing clusters
CN112199431B (en) Metadata-based data sharing method and data sharing system
Damiani et al. iPrivacy: a distributed approach to privacy on the cloud
Kumar et al. Data security and encryption technique for cloud storage
CN115836291A (en) System generated data set encryption key
US11902284B2 (en) Tenant user management in cloud database operation
US20230067054A1 (en) Encryption of database log files
US20240106657A1 (en) Method and apparatus for posting a user message of a user in an internet forum
JP2024039418A (en) Information processing systems and programs

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant