CN104731939B - Method for sharing data among tenants through data table - Google Patents
Method for sharing data among tenants through data table Download PDFInfo
- Publication number
- CN104731939B CN104731939B CN201510146460.XA CN201510146460A CN104731939B CN 104731939 B CN104731939 B CN 104731939B CN 201510146460 A CN201510146460 A CN 201510146460A CN 104731939 B CN104731939 B CN 104731939B
- Authority
- CN
- China
- Prior art keywords
- data
- tenant
- tables
- tenants
- sharing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 22
- 238000013523 data management Methods 0.000 claims abstract description 12
- 238000007726 management method Methods 0.000 claims abstract description 10
- 230000001360 synchronised effect Effects 0.000 claims description 4
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 6
- 238000002955 isolation Methods 0.000 description 3
- 206010037660 Pyrexia Diseases 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/176—Support for shared access to files; File sharing support
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Storage Device Security (AREA)
Abstract
The invention discloses a method for sharing data among tenants through a data table, which comprises the following concrete implementation processes: firstly, tenant data source management is carried out: in a cloud computing environment, a tenant inputs a data source through an online web page, applies for a new data management service, starts a timer after the input is finished, and updates data at regular time; and (3) carrying out data classification: combing and customizing the data directory and the grouping list information, and enabling a tenant to associate the created data table with the corresponding data directory, so that the data table can be conveniently retrieved and browsed; and finishing data sharing: the data tables of the tenants are shared in an open mode and are applied for use among the data tables. Compared with the prior art, the method for sharing data among tenants through the data table has the advantages that a resource management mode which is highly flexible and easy to use among tenants is achieved, high sharing of data resources among multiple tenants is achieved, the practicability is high, and the popularization is easy.
Description
Technical field
The present invention relates to big data technical field, shared between specifically a kind of highly practical, tenant by tables of data
The method of data.
Background technology
Multi-tenant technology（English：multi-tenancy technology）Or multiple leasing techniques, it is a kind of software
Architecture technology, it be inquire into realize how in the environment of multi-user shared identical system or program assembly, and still
It can ensure that the isolation of data between each user.
Due to the fever of cloud computing subject under discussion, as how triangular web framework and service offer are more in shared data center
Clients are identical or even the service of customizable for number, and still can ensure the data isolation of client, allow multi-tenant technology into
For aobvious under cloud computing technology.
In cloud computing, the epoch of big data, data are managed, shared and using being an important problem between tenant, such as
How effectively management and the data resource using cloud computing determine the vitality of the upper layer application ecosystem, based on this, now carry
For by the method for tables of data shared data, this method is from the angle that data management, data sharing and data utilize between a kind of tenant
Degree sets out, with it is a kind of gear to actual circumstances, healthy and strong easy-to-use mode is the shared of big data under cloud computing environment and using proposing one
The practical solution of kind.
The content of the invention
The technical assignment of the present invention is to be directed to above shortcoming, there is provided passes through tables of data between a kind of highly practical, tenant
The method of shared data.
It is by the method for tables of data shared data, its specific implementation process between a kind of tenant：
Tenant data source control is carried out first：Under cloud computing environment, tenant by online web page logging data source,
Apply for new data management service, after typing, opening timing device, periodically updates the data；
Carry out data classification：Comb and customize data directory and group list information, tenant closes the tables of data created
Corresponding data directory on connection, easy to tables of data retrieval and browse；
Complete data sharing：The tables of data opening and shares of tenant are simultaneously carrying out application use each other.
The data source is relevant database or HBASE NoSQL databases, and following information is included in the data source：
IP, port, data source types, character set, description, field, table information.
The process that the timing updates the data is：Database, table information and field information under dynamic pulling data source, will
These metadata automatic synchronizations are to data management system, opening timing device, periodically according to the change of real data table dynamic
More new metadata.
Each tenant of data source control uses a set of independent data management service between the tenant, the data between tenant
It is mutually isolated, it is independent of each other.
The data are divided into two kinds of vertical and horizontal：The classification of longitudinal direction is mutually independent data dimension, the data
Dimension includes key element, department；Horizontal data classification is the classification under same data dimension, including personnel under same key element and
Article.
In the data sharing step, after cloud tenant selects the data to be opened, system is serviced automatically by data by ETL
Table is synchronized in Hive, using Hive as data warehouse, carries out the management of data permission, the data of multi-tenant are unified in Hive
Storage；The data opened can be applied using by other tenants；Tenant beyond the clouds combine application tables of data with itself
Tables of data is associated inquiry and analysis by SQL, and the execution authority of SQL is controlled by software systems, according to data application shape
State carries out logic judgment.
By the method for tables of data shared data between a kind of tenant of the present invention, has the following advantages：
By the method for tables of data shared data between a kind of tenant proposed by the present invention, multi-tenant under cloud computing environment is solved
Data isolation between data resource online management, metadata management and tenant；The sharing problem of big data, is high in the clouds between solution tenant
Data mining provides basis；Data application, data are audited and licensed between support tenant, it is allowed to which tenant is existed based on web page
The privately owned data resource of wire management, can carry out data sharing by data application；Shared data is united after the importing of ETL data
One is stored in Hive, and using Hive as data warehouse, the shared of table is carried out by data application between tenant；It is highly practical, it is easy to
Promote.
Embodiment
Below by specific embodiment, the invention will be further described.
The invention discloses by the method for tables of data shared data, under private clound, multi-tenant remotely counts between a kind of tenant
Online data management and the utilization of resources according to multi-source data resources such as source, RDS data sources, tenant is carried out with reference to Hive, Kettle
Between data shared and utilize, for more tissues, the data integration under multidisciplinary and multiservice system and it is shared propose it is one whole
The solution of set.
It, which implements process, includes following three steps：
First, tenant data source control.
Under cloud computing environment, after tenant applies for that a new data management service, application pass through, pass through online web page
Logging data source.
Data source includes the NoSQL databases such as relevant database and the HBASE of mainstream, and data source information includes IP, end
The information such as mouth, data source types, character set, description, after typing, database, table information under dynamic pulling data source and
Field information, these metadata are synchronized automatically between data management system, opening timing device, periodically according to real data table
Change dynamic more new metadata.
Different from general metadata management system, data source control is each rent based on cloud computing environment between tenant
Family can apply for a set of independent data management service, and the data between tenant are mutually isolated, are independent of each other.
2nd, data are classified.
Data directory and group list information are combed and customized according to industry characteristic, and tenant closes the tables of data created
Corresponding data directory on connection, easy to tables of data retrieval and browse.
Data are divided into vertical and horizontal both of which, and longitudinal classification can be mutually independent data dimension, than
Such as key element, department, the classification of horizontal data are classifications under same data dimension, such as the personnel under same key element and article
Deng.
3rd, data sharing.
The tables of data of tenant with opening and shares and can carry out application use each other.Cloud tenant selection will open
Data after, system by ETL service tables of data is synchronized in Hive automatically, using Hive as data warehouse, progress data
The management of authority, the data of multi-tenant, which are unified in Hive, to be stored.
The data opened can be applied using by other tenants.
Tenant is associated inquiry and analysis, SQL with the tables of data of itself with reference to the tables of data of application by SQL beyond the clouds
Execution authority controlled by software systems, carry out logic judgment according to data application status.
Above-mentioned embodiment is only the specific case of the present invention, and scope of patent protection of the invention includes but not limited to
Above-mentioned embodiment, passes through the claim of the method for tables of data shared data between a kind of any tenant for meeting the present invention
The appropriate change or replacement that the those of ordinary skill of book and any technical field does it, should all fall into the present invention's
Scope of patent protection.
Claims (2)
1. pass through the method for tables of data shared data between a kind of tenant, it is characterised in that its specific implementation process is：
Tenant data source control is carried out first：Under cloud computing environment, tenant passes through online web page logging data source, the number
It is relevant database or HBASE NoSQL databases according to source, following information is included in the data source：IP, port, data source class
Type, character set, description, field, table information；Apply for new data management service, after typing, opening timing device, timing is more
New data, the process periodically updated the data are：Database, table information and field information under dynamic pulling data source, by these
To data management system, opening timing device, periodically updates metadata automatic synchronization according to the change of real data table dynamic
Metadata；
Carry out data classification：Comb and customize data directory and group list information, tenant associates the tables of data created
Corresponding data directory, easy to tables of data retrieval and browse, which is divided into two kinds of vertical and horizontal：The classification of longitudinal direction
It is mutually independent data dimension, which includes key element, department；Horizontal data classification is under same data dimension
Personnel and article under classification, including same key element；
Complete data sharing：The tables of data opening and shares of tenant are simultaneously carrying out application use each other, in data sharing step,
After cloud tenant selects the data to be opened, tables of data is synchronized in Hive by system automatically by ETL services, and number is used as using Hive
According to warehouse, the management of data permission is carried out, the data of multi-tenant, which are unified in Hive, to be stored；The data opened can be by it
His tenant applies using；Tenant beyond the clouds with reference to application tables of data and the tables of data of itself by SQL be associated inquiry with
Analysis, the execution authority of SQL are controlled by software systems, and logic judgment is carried out according to data application status.
2. pass through the method for tables of data shared data between a kind of tenant according to claim 1, it is characterised in that the rent
Each tenant of data source control uses a set of independent data management service between family, and the data between tenant are mutually isolated, mutually not
Influence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510146460.XA CN104731939B (en) | 2015-03-31 | 2015-03-31 | Method for sharing data among tenants through data table |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510146460.XA CN104731939B (en) | 2015-03-31 | 2015-03-31 | Method for sharing data among tenants through data table |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104731939A CN104731939A (en) | 2015-06-24 |
| CN104731939B true CN104731939B (en) | 2018-05-01 |
Family
ID=53455826
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510146460.XA Active CN104731939B (en) | 2015-03-31 | 2015-03-31 | Method for sharing data among tenants through data table |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104731939B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106203810B (en) * | 2016-07-01 | 2020-05-19 | 上海中传网络技术股份有限公司 | CRM data processing method based on cloud platform |
| CN106503085B (en) * | 2016-10-10 | 2020-04-28 | 北京世纪超星信息技术发展有限责任公司 | Domain-based customizable search systems, methods, and techniques |
| CN109756527B (en) * | 2017-11-01 | 2022-01-21 | 阿里巴巴集团控股有限公司 | Data sharing method, device and system |
| CN108038390A (en) * | 2017-12-09 | 2018-05-15 | 珠海横琴小可乐信息技术有限公司 | A kind of software, that is, service platform tenant data isolation and shared method and system |
| CN110414259B (en) * | 2018-04-28 | 2023-08-25 | 阿里巴巴集团控股有限公司 | Method and equipment for constructing data category and realizing data sharing |
| CN110119422B (en) * | 2019-05-16 | 2021-05-07 | 武汉神算云信息科技有限责任公司 | Data processing system and equipment for data warehouse of micro-credit tenant |
| CN111522869A (en) * | 2020-03-26 | 2020-08-11 | 中国南方电网有限责任公司 | Setting computing cloud data management method and setting computing system suitable for multiple tenants |
| CN112487378A (en) * | 2020-12-11 | 2021-03-12 | 宝付网络科技（上海）有限公司 | Tenant authority management system suitable for big data platform |
| CN114791907B (en) * | 2022-03-30 | 2023-01-06 | 北京柏睿数据技术股份有限公司 | Method and system for processing multi-tenant shared data |
| CN116010431B (en) * | 2023-03-27 | 2023-06-02 | 北京有生博大软件股份有限公司 | Data element management method and management system based on multi-tenant mode |
| CN117076473B (en) * | 2023-10-11 | 2024-02-06 | 浪潮通用软件有限公司 | Metadata operation method, system, equipment and medium for SaaS multi-tenant |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7529728B2 (en) * | 2003-09-23 | 2009-05-05 | Salesforce.Com, Inc. | Query optimization in a multi-tenant database system |
| CN101777047A (en) * | 2009-01-08 | 2010-07-14 | 国际商业机器公司 | System, equipment and method for accessing database under multiple-tenant environment |
| CN101996214A (en) * | 2009-08-27 | 2011-03-30 | 国际商业机器公司 | Method and device for processing database operation request |
| CN104216893A (en) * | 2013-05-31 | 2014-12-17 | 中国电信股份有限公司 | Partitioned management method for multi-tenant shared data table, server and system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030163692A1 (en) * | 2002-01-31 | 2003-08-28 | Brocade Communications Systems, Inc. | Network security and applications to the fabric |
| CN101639835A (en) * | 2008-07-30 | 2010-02-03 | 国际商业机器公司 | Method and device for partitioning application database in multi-tenant scene |
-
2015
- 2015-03-31 CN CN201510146460.XA patent/CN104731939B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7529728B2 (en) * | 2003-09-23 | 2009-05-05 | Salesforce.Com, Inc. | Query optimization in a multi-tenant database system |
| CN101777047A (en) * | 2009-01-08 | 2010-07-14 | 国际商业机器公司 | System, equipment and method for accessing database under multiple-tenant environment |
| CN101996214A (en) * | 2009-08-27 | 2011-03-30 | 国际商业机器公司 | Method and device for processing database operation request |
| CN104216893A (en) * | 2013-05-31 | 2014-12-17 | 中国电信股份有限公司 | Partitioned management method for multi-tenant shared data table, server and system |
Non-Patent Citations (1)
| Title |
|---|
| "基于ECGP的企业数据集成研究";张绍谦 等;《华中科技大学学报(自然科学版)》;20110630;第39卷(第S1期);第1-2章 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104731939A (en) | 2015-06-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104731939B (en) | Method for sharing data among tenants through data table | |
| US10404787B1 (en) | Scalable distributed data streaming computations across multiple data processing clusters | |
| CN102426602B (en) | Scoped database connections | |
| CN107688500A (en) | A kind of distributed task scheduling processing method, device, system and equipment | |
| CN105184144B (en) | A kind of multisystem right management method | |
| CN104317970B (en) | A kind of data stream type processing method based on data mart modeling center | |
| JP2016500854A5 (en) | ||
| CN104111936B (en) | Data query method and system | |
| CN107066867A (en) | A kind of big data cluster resource allocation methods and device | |
| CN104298761B (en) | The implementation method that master data is matched between a kind of heterogeneous software system | |
| CN107003886A (en) | The management that application of the trustship directory service to catalogue is accessed | |
| CN108984639A (en) | The data processing method and device of server cluster | |
| CN108132775A (en) | A kind of tenant manages system and method | |
| CN102917006A (en) | Method and device for achieving uniform control management of computing resource and object authority | |
| CN105930417B (en) | A kind of big data ETL interactive process platform based on cloud computing | |
| Prout et al. | Enabling on-demand database computing with MIT SuperCloud database management system | |
| CN114553865A (en) | Heterogeneous hybrid cloud system architecture design method | |
| CN107977396A (en) | A kind of update method of the tables of data of KeyValue databases and table data update apparatus | |
| CN104239532A (en) | Method and device for self-making user extraction information tool in Hive | |
| CN102779160B (en) | Mass data information index system and index structuring method | |
| CN106789324A (en) | FTP distributed acquisition methods based on MapReduce | |
| CN102999607A (en) | Data storage method, data access method and related devices | |
| CN109684412A (en) | A kind of distributed data base system | |
| CN106789267A (en) | public cloud management system and management method | |
| CN104780202A (en) | End-to-end cloud service database virtualization and management framework and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180806 Address after: 250100 S06 tower, 1036, Chao Lu Road, hi tech Zone, Ji'nan, Shandong. Patentee after: Shandong wave cloud Mdt InfoTech Ltd Address before: No. 1036, Shandong high tech Zone wave road, Ji'nan, Shandong Patentee before: Inspur Group Co., Ltd. |
|
| TR01 | Transfer of patent right | ||
| CP03 | Change of name, title or address |
Address after: 250100 No. 1036 Tidal Road, Jinan High-tech Zone, Shandong Province, S01 Building, Tidal Science Park Patentee after: Inspur cloud Information Technology Co., Ltd Address before: 250100 Ji'nan science and technology zone, Shandong high tide Road, No. 1036 wave of science and Technology Park, building S06 Patentee before: SHANDONG LANGCHAO YUNTOU INFORMATION TECHNOLOGY Co.,Ltd. |
|
| CP03 | Change of name, title or address |