CN107577767A - A kind of uniform service layer method for building up based on big data - Google Patents
A kind of uniform service layer method for building up based on big data Download PDFInfo
- Publication number
- CN107577767A CN107577767A CN201710788728.9A CN201710788728A CN107577767A CN 107577767 A CN107577767 A CN 107577767A CN 201710788728 A CN201710788728 A CN 201710788728A CN 107577767 A CN107577767 A CN 107577767A
- Authority
- CN
- China
- Prior art keywords
- data
- service layer
- uniform service
- building
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a kind of uniform service layer method for building up based on big data, this method mainly includes the following steps that：Initially set up data source, it is ensured that data connection is normal；Then data set is built, related data is packaged；Then business scenario, selection displaying template and data set are created；Uniform service layer is finally distributed to, user is assigned and weighed, generation link is called for user.The present invention passes through the encapsulation to big data platform bottom data, data are unified in into service layer to be managed, and the unified interface that provides uses data for outside, it is effective to avoid outside directly operation big data platform bottom document, both facilitated unified management of the data center to data to turn avoid incipient fault for data security.
Description
Technical field
The invention belongs to big data technical field, is related to a kind of uniform service layer method for building up based on big data.
Background technology
Since big data platform is established, strong support works are provided for each field, with data center's data
Increasingly huge, service coverage face is more and more wider, and data are various in a jumble, assets protection responsibility is unclear, data user rate is not high, big number
Slowly highlighted according to platform data the problems such as cannot ensureing safe to use, big data uniform service layer method for building up is from data
The many aspects such as management monitors with maintenance, data request for utilization, data dispatch, data permission distribution, strengthen providing data center
The management and monitoring of production, improve data assets process for using, the lean management performance of enterprise data assets.
The content of the invention
Cannot effectively be solved the problems, such as in view of big data platform data is safe to use, it is an object of the invention to provide one kind
Uniform service layer method for building up based on big data, this method build a layer proxy between application cluster and bottom data source
That is uniform data layer.Model data mapping is initially set up, realizes the pattern number of each attribute of business model and bottom big data platform
According to mapping, then the unified query based on business model and the API of renewal are provided, simplify the development mode using platform.
The encapsulation to bottom data is the method achieve, uniform service layer carries out path redirection to big data platform bottom document, made
User obtains the path of big data platform bottom document, and the security of data is ensured that user passes through uniform service layer URL
Using data, all authorities are managed in uniform service layer.
The purpose of the present invention is achieved through the following technical solutions：
A kind of uniform service layer method for building up based on big data, it is characterised in that：This method includes establishing data source, it is ensured that number
It is normal according to connection；Then data set is built, related data is packaged；Create business scenario, selection displaying template and data
Collection；Uniform service layer is finally distributed to, user is assigned and weighed, generation link is called for user.Its particular content is as follows：
1）Establish multiple types of data source（HDFS、Hive、HBase）, it is ensured that data connection is normal.
2）By the data source established, data set is built according to data source types, including writes SQL, read file etc.
Mode is screened to related data.
3）Create a new business scene, describe the function of business scenario, comprising tables of data or file etc., Ran Houxuan
Select the data set included and a kind of displaying template.
4）Scene is distributed to uniform service layer, power is assigned respectively to data or user, ultimately produces Redirect URL chain
Connect, there is provided user is called or shown.
Present invention is generally directed to data center to provide data external use, can from data source, data scrubbing, data
Loaded depending on change, data and be redirected to data using authorizing, formed whole data and use closed loop management.It is main logical in above process
Cross and be based on big data uniform service layer, realize that data center to the adequately managed of data assets, is carried to business department using data
For unified interface, effectively data permission is managed, the security of data is ensured while data value is lifted.
The present invention's has beneficial effect to be：By the encapsulation to big data platform bottom data, data are unified in clothes
Business layer is managed, and the unified interface that provides uses data for outside, effectively avoids outside directly operation big data platform
Bottom document, unified management of the data center to data had both been facilitated to turn avoid incipient fault for data security.
Brief description of the drawings
Fig. 1 is the flow frame diagram of this method.
Embodiment
Accompanying method of the present invention is further illustrated with reference to the accompanying drawings and detailed description.
The present invention proposes a kind of uniform service layer method for building up based on big data, and this method is in application cluster and bottom number
According between source, one layer proxy of structure is uniform data layer.Model data mapping is initially set up, realizes each attribute of business model and bottom
The model data mapping of layer big data platform, then provides the unified query based on business model and the API of renewal, simplifies application
Use the development mode of platform.Specific implementation step is as follows：
Step 1：Data source is initially set up, detection data source is connective
1）A data connection is established, selects data source types；
2）When selecting relevant database, type of database, driving title, access path, user name, password need to be selected；
3）When selecting HDFS, select file path, Hadoop user names are needed；
4）When selecting HIVE, Hadoop user names, URL paths need to be selected；
5）Data source is selected, whether normal carries out test detection data source connection.
Step 2：Data set is built, related data is packaged
1）A data source is selected first, and the affiliated type of data source of selection determines the type of data set；
2）When data set type is relational data and HIVE, SQL need to be write and obtain related data；
3）When data set type is HDFS, separator need to be specified, if include gauge outfit, if display gauge head, read line number etc. and obtain
Take related data；
4）Select data set to carry out preview, show the data of acquisition.
Step 3：Create business scenario, selection displaying template and data set
1）A business scenario is created, fills in business scenario title, explanation；
2）All associated data sets that selection scene includes；
3）Template is selected to carry out figure displaying to scene；
Step 4：Uniform service layer is distributed to, data and user are assigned with power, generation link is called for user
1）Establish the scene completed and be distributed to uniform service layer；
2）Tax power is carried out to associated user, is managed collectively data permission；
3）Generate URL link and outside progress data call is provided.
Claims (4)
1. a kind of uniform service layer method for building up based on big data, it is characterised in that this method mainly includes the following steps that：
1）Data source is initially set up, detection data source is connective；
2）Then data set is built, obtains related data；
3）Create business scenario, selection displaying template and data set；
4）Uniform service layer is distributed to, data and user are assigned with power, generation link is called for user.
2. according to the uniform service layer method for building up based on big data described in claim 1, it is characterised in that：Described step
Rapid 2）In, by the data source established, data set is built according to data source types, including write SQL, read file mode pair
Related data is screened.
3. according to the uniform service layer method for building up based on big data described in claim 1, it is characterised in that：The step
3）In, create a new business scene, describe the function of business scenario, comprising tables of data or file, then selection include
Data set and a kind of displaying template.
4. according to the uniform service layer method for building up based on big data described in claim 1, it is characterised in that：The step
4）In, scene is distributed to uniform service layer, power is assigned respectively to data or user, ultimately produces Redirect URL link, there is provided
User is called or shown.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710788728.9A CN107577767A (en) | 2017-09-05 | 2017-09-05 | A kind of uniform service layer method for building up based on big data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710788728.9A CN107577767A (en) | 2017-09-05 | 2017-09-05 | A kind of uniform service layer method for building up based on big data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107577767A true CN107577767A (en) | 2018-01-12 |
Family
ID=61031394
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710788728.9A Pending CN107577767A (en) | 2017-09-05 | 2017-09-05 | A kind of uniform service layer method for building up based on big data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107577767A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111078772A (en) * | 2019-12-04 | 2020-04-28 | 紫光云(南京)数字技术有限公司 | Capability management platform for load balancing of multiple data source services |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104200402A (en) * | 2014-09-11 | 2014-12-10 | 国家电网公司 | Publishing method and system of source data of multiple data sources in power grid |
| CN105608144A (en) * | 2015-12-17 | 2016-05-25 | 山东鲁能软件技术有限公司 | Big data analysis platform device and method based on multilayer model iteration |
| CN105786695A (en) * | 2014-12-26 | 2016-07-20 | 北大医疗信息技术有限公司 | Data test method and system |
| CN107066499A (en) * | 2016-12-30 | 2017-08-18 | 江苏瑞中数据股份有限公司 | The data query method of multi-source data management and visualization system is stored towards isomery |
-
2017
- 2017-09-05 CN CN201710788728.9A patent/CN107577767A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104200402A (en) * | 2014-09-11 | 2014-12-10 | 国家电网公司 | Publishing method and system of source data of multiple data sources in power grid |
| CN105786695A (en) * | 2014-12-26 | 2016-07-20 | 北大医疗信息技术有限公司 | Data test method and system |
| CN105608144A (en) * | 2015-12-17 | 2016-05-25 | 山东鲁能软件技术有限公司 | Big data analysis platform device and method based on multilayer model iteration |
| CN107066499A (en) * | 2016-12-30 | 2017-08-18 | 江苏瑞中数据股份有限公司 | The data query method of multi-source data management and visualization system is stored towards isomery |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111078772A (en) * | 2019-12-04 | 2020-04-28 | 紫光云(南京)数字技术有限公司 | Capability management platform for load balancing of multiple data source services |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108885627B (en) | Query-as-a-service system providing query result data to remote client | |
| Moreno-Vozmediano et al. | Key challenges in cloud computing: Enabling the future internet of services | |
| CN109492991B (en) | Intelligent integrated management system for power distribution project construction | |
| CN105843182B (en) | A kind of power scheduling accident prediction system and method based on OMS | |
| EP2947569B1 (en) | Hybrid applications operating between on-premise and cloud platforms | |
| CN110543464A (en) | Big data platform applied to smart park and operation method | |
| CN105956029B (en) | Mix the data access method under storage architecture | |
| US20080027788A1 (en) | Object Oriented System and Method for Optimizing the Execution of Marketing Segmentations | |
| CN107465656A (en) | A kind of safety monitoring big data processing method and system based on cloud computing | |
| CN106445556A (en) | Visualized code generation method and system thereof | |
| CN106776780A (en) | Data exchange and shared method and system in a kind of cloud environment | |
| CN108520004B (en) | Multi-tenant data source switching system based on method parameter section | |
| CN108809985B (en) | Mobile platform system | |
| CN109962805A (en) | A kind of multi-platform cut-in method and equipment based on Authority and Domain Based Management | |
| CN105577423A (en) | Real-time data center cluster management system | |
| WO2023011140A1 (en) | Forest resource one-graph quality inspection logic rule update method, system and cloud platform | |
| CN104580081A (en) | Integrated SSO (single sign on) system | |
| CN114281790B (en) | Multi-type load resource aggregator access system and method | |
| CN111444259A (en) | Electric power data sharing method based on block chain | |
| CN109951370B (en) | Hierarchical interconnection method and device for big data centers | |
| CN107577767A (en) | A kind of uniform service layer method for building up based on big data | |
| CN108464031B (en) | The redundancy based on database in telecommunication network | |
| CN111914019A (en) | Stable control data management system and method based on block chain technology | |
| CN104732449B (en) | A kind of information system method of operation method for establishing model | |
| CN106993032A (en) | The embedded accurate communication cloud service platform applied based on mobile Internet |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180112 |
|
| WD01 | Invention patent application deemed withdrawn after publication |