CN105893630A - Distributed data service system based on meta data - Google Patents
Distributed data service system based on meta data Download PDFInfo
- Publication number
- CN105893630A CN105893630A CN201610358181.4A CN201610358181A CN105893630A CN 105893630 A CN105893630 A CN 105893630A CN 201610358181 A CN201610358181 A CN 201610358181A CN 105893630 A CN105893630 A CN 105893630A
- Authority
- CN
- China
- Prior art keywords
- data
- server
- metadata
- service system
- system based
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2216/00—Indexing scheme relating to additional aspects of information retrieval not explicitly covered by G06F16/00 and subgroups
- G06F2216/03—Data mining
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a distributed data service system based on meta data. The distributed data service system comprises a meta data server, a data handling server, a subject data storage unit, a data display server and a client, wherein the data display server is connected with the data handling server, the meta data server is connected with the client and used for storing various types of original meta data, the data handling server is used for processing the meta data from the meta data server so as to obtain subject data and transmitting the subject data to the subject data storage unit; the data display server is used for displaying the subject data corresponding the original meta data selected by a user or the original meta data in a preset manner. The distributed data service system has the advantages that breaking through of the key technologies of the meta data server, the data handling server and the data display server is achieved, and a user can drag the original meta data on the client to achieve data handling and data display.
Description
Technical field
The present invention relates to Metadata Service technical field, particularly relate to Distributed database service system based on metadata.
Background technology
At present, market demand project is the key project that mining data is worth, and becomes each enterprises and institutions already and must build item
Mesh.And current, enterprises and institutions generally require the substantial amounts of fund of input, set up huge technical team, experience long-term work
Just can complete the construction of market demand project, and build project out and the most also can face system processing power
Deficiency, demand change realizes the various defect such as slow, and it is quick-fried that such market demand project construction pattern does not the most adapt to information
The demand that data value is excavated by the fried nowadays epoch, traces it to its cause mainly with the presence of problems with:
1, the correlation technique involved by market demand construction is more, and mutually quotes between each framework and be individually present, right
The human cost that requires a great deal of time for using these technology to carry out the team of market demand project construction carries out skill
The integration of art framework；
2, metadata is as the same existence of the knowledge base of Data application system, is used only for describing industry in prior art framework
Business data, user is only capable of checking the description information of data by metadata, and two can not pass through metadata direct analysis target
Data；
3, the nucleus module that data compilation technology processes as data, is orientated as data base by commercial company or Open Framework and arrives
One between data base extract, change, loading instrument.This instrument under can not directly dock metadata management utilize define
Metadata carry out data process, to above directly the intermediate object program of data compilation not being pushed to data exhibiting service, in order to
User is directly viewable analytical data；
4, data exhibiting technology can only directly Interworking Data storehouse or data warehouse, carry out representing analysis, this just requires data exhibition
The data now analyzed must be ready to by data compilation instrument in advance；
5, current market demand project design when owing to there is no unified whole process data description, data compilation, number
According to technology for revealing framework, distributed computing technology does not has well to be employed, and this makes to put into what a large amount of manpower and materials were built
Market demand project often operational efficiency is the lowest；
6, being the technology of more than 10 years mostly due to current market demand technology, data exhibiting application the most simply considers PC end
Application, the application power in mobile terminal is the most weak.
Summary of the invention
For above-mentioned technical problem, it is an object of the invention to provide a kind of Distributed database service system based on metadata
System, it can get through metadata, data compilation contacts with data exhibiting, and different business-subject data are carried out distributed depositing
Storage.
The present invention adopts the following technical scheme that realization:
Distributed database service system based on metadata, including the meta data server being sequentially connected with, data compilation server,
Subject data memory element, data display server and client, data display server is connected with data compilation server；
Meta data server is connected with client；Meta data server is for storing the original metadata of number of different types；Data are whole
Reason server for processing to obtain subject data to the metadata from meta data server, and sends this subject data
To subject data memory element；Client, and is used to obtain original metadata from meta data server for input operation information
Arbitrary original metadata is chosen in performing corresponding actions for user；Data display server is for the original unit chosen according to user
Corresponding subject data or original metadata are shown by data with presets.
Preferably, also include that JDBC interface, described data compilation server and subject data memory element are connect by JDBC
Mouth is connected with data display server.
Preferably, described presets includes form, block diagram, cake chart.
Preferably, the original metadata in described meta data server obtains from outside statistic unit.
Preferably, the original metadata in described meta data server obtains from outside statistic unit.
Preferably, described relevant action is for pulling.
Preferably, also including visualized operation unit, this visualized operation unit is connected with disposal data server.
Compared to existing technology, the beneficial effects of the present invention is:
The present invention realizes thoroughly getting through the technology joint of meta data server, data compilation server and data display server,
User can realize data compilation and data exhibiting function by pulling original metadata the most on the client.
Accompanying drawing explanation
Fig. 1 is the function structure chart of the present invention.
Detailed description of the invention
Below, in conjunction with accompanying drawing and detailed description of the invention, the present invention is described further:
Seeing Fig. 1, the present invention provides Distributed database service system based on metadata, and it uses html5 and java technology, adopts
By ehcache distributed caching technology, it is achieved that once dispose.Metadata is the data describing data, it is common that refer to data
The data that the design in warehouse and management personnel for exploitation and daily management data warehouse are.At present, metadata technique is also led
The construction in assistance data warehouse to be used for, as the data normalization for data warehouse manages, data quality management etc.；Data are whole
Reason belongs to data base's technology to data base, be a kind of extraction for data, change, loading technology, the usual ETL technology said
Belong to same category, the tool software having had the commercial company of maturation to provide, also there is the data compilation of open source system
Software, these software engineering framework all relative closures, it is commonly used to serve the structure of data warehouse, Data Mart；Data exhibiting
Technology i.e. data visualization technique, be the technology for data being showed by all means, is common in various report tool, figure
Shape presents technical tool and BI platform etc..
Meta data server that the present invention includes being sequentially connected with, data compilation server, subject data memory element, data
Showing server and client, data display server is connected with data compilation server；Meta data server and client
Connect.Metadatabase server is mainly used in storing the original metadata of number of different types, and original metadata is carried out data
Classification cataloguing, standard management, Dynamic Maintenance, synchronization etc.；Data compilation server is for being acquired metadata, transmit, connecing
Receive, the metadata from meta data server is processed to obtain subject data, and sends this subject data to number of topics
According to memory element.Client for input operation information to obtain original metadata from meta data server, and for for user
Perform corresponding actions and choose arbitrary original metadata；Data display server for the original metadata chosen according to user by phase
Subject data or original metadata is answered to show with presets.
The Distributed Services system of the present invention is for data applied customization, and service registry, service are issued and service subscription
Deng.
It is as follows that the systematic difference that the present invention provides has operating procedure:
S1: after whole system deployment success, for entering system by client-access, configures meta data server；
S2: various production Service Databases are configured；
The browser that S3: user is had by client extracts metadata, and system generates index information；
S4: after above-mentioned steps configuration successful, user can have three selections to operate metadata:
1, at the customization input frame gone out shown by data display server, user clicks on this customization input frame, and selects metadata,
The selection mode of user can be chosen by directly pulling, and customizes data query, and data display server generates data query
Collection, and Query Result can be directly generated icon analysis；
2, data display server provides an immobile interface to enter data compilation server for user, and selects metadata, customization
Data compilation task, can directly issue data compilation task to server；
3, data display server provides an immobile interface to choose original metadata or data compilation for user.
S5: user enters system by client, configures user group's structure, carries out the data source configured
Authorized appropriation；
S6: new user can according to the mandate of oneself to client-access to obtain data compilation analysis.
Metadata is not only managed by meta data server, it is also possible to docking subject data memory element, to both
Unified management, the program that efficiently solves separates with resource so that resource can be carried out respectively in the management of backup and program, has
The security maintenance of the system of being beneficial to and quickly upgrading.
On the other hand, also include that JDBC interface, described data compilation server and subject data memory element pass through JDBC
Interface is connected with data display server.Data compilation server provides the JDBC interface of standard, in order to data display service
Device directly utilizes data compilation intermediate object program, is all introduced into data base without all data compilation results.Also include visual
Changing operating unit, this visualized operation unit is connected with disposal data server, and user can be straight by visualized operation unit
Connect and metadata is arranged, design so that no matter user is to have data compilation or data exhibiting to design boundary easily
Face.
The market demand platform that the present invention realizes, enormously simplify the process of construction of business data application system, reduces
The cost that Data application system is built, is worth the technology efficiently that provides and realizes way for enterprise's fast construction system mining data
Footpath.
It will be apparent to those skilled in the art that can technical scheme as described above and design, make other various
Corresponding change and deformation, and all these change and deformation all should belong to the protection domain of the claims in the present invention
Within.
Claims (7)
1. Distributed database service system based on metadata, it is characterised in that include meta data server, the number being sequentially connected with
According to arranging server, subject data memory element, data display server and client, data display server is whole with data
Reason server connects；Meta data server is connected with client；Meta data server is for storing the original of number of different types
Metadata；Data compilation server is used for processing to obtain subject data to the metadata from meta data server, and
Send this subject data to subject data memory element；Client is used for input operation information to obtain former from meta data server
Beginning metadata, and choose arbitrary original metadata for performing corresponding actions for user；Data display server for according to
Corresponding subject data or original metadata are shown by the original metadata that family is chosen with presets.
2. Distributed database service system based on metadata as claimed in claim 1, it is characterised in that also include that JDBC connects
Mouthful, described data compilation server and subject data memory element are connected with data display server by JDBC interface.
3. Distributed database service system based on metadata as claimed in claim 1, it is characterised in that described presets
Including form, block diagram, cake chart.
4. Distributed database service system based on metadata as claimed in claim 1, it is characterised in that described metadata takes
Original metadata in business device obtains from outside statistic unit.
5. Distributed database service system based on metadata as claimed in claim 4, it is characterised in that described statistic unit
Including financial statistics unit, sale result unit, production leadtime unit, budget statistic unit.
6. Distributed database service system based on metadata as claimed in claim 1, it is characterised in that described relevant action
For pulling.
7. Distributed database service system based on metadata as claimed in claim 1, it is characterised in that also include visualization
Operating unit, this visualized operation unit is connected with disposal data server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610358181.4A CN105893630A (en) | 2016-05-26 | 2016-05-26 | Distributed data service system based on meta data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610358181.4A CN105893630A (en) | 2016-05-26 | 2016-05-26 | Distributed data service system based on meta data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105893630A true CN105893630A (en) | 2016-08-24 |
Family
ID=56717078
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610358181.4A Pending CN105893630A (en) | 2016-05-26 | 2016-05-26 | Distributed data service system based on meta data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105893630A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063502A (en) * | 2011-01-06 | 2011-05-18 | 天津神舟通用数据技术有限公司 | Method for realizing synchronization of data in heterogeneous database |
| CN102833331A (en) * | 2012-08-21 | 2012-12-19 | 北京邦诺存储科技有限公司 | Cloud storage system and metadata writing-in method and metadata reading method thereof |
| US20160050268A1 (en) * | 2006-08-01 | 2016-02-18 | Samsung Electronics Co., Ltd. | Contents sharing method between mobile terminal and local server |
| CN105354287A (en) * | 2015-10-30 | 2016-02-24 | 北京奇艺世纪科技有限公司 | Database metadata acquisition method and apparatus |
-
2016
- 2016-05-26 CN CN201610358181.4A patent/CN105893630A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160050268A1 (en) * | 2006-08-01 | 2016-02-18 | Samsung Electronics Co., Ltd. | Contents sharing method between mobile terminal and local server |
| CN102063502A (en) * | 2011-01-06 | 2011-05-18 | 天津神舟通用数据技术有限公司 | Method for realizing synchronization of data in heterogeneous database |
| CN102833331A (en) * | 2012-08-21 | 2012-12-19 | 北京邦诺存储科技有限公司 | Cloud storage system and metadata writing-in method and metadata reading method thereof |
| CN105354287A (en) * | 2015-10-30 | 2016-02-24 | 北京奇艺世纪科技有限公司 | Database metadata acquisition method and apparatus |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7991800B2 (en) | Object oriented system and method for optimizing the execution of marketing segmentations | |
| CN102257489A (en) | Bi-directional update of a grid and associated visualizations | |
| CN103136335A (en) | Data control method based on data platforms | |
| US20120143831A1 (en) | Automatic conversion of multidimentional schema entities | |
| CN102982050A (en) | Collecting and presenting temporal-based action information | |
| US20180032605A1 (en) | Integrated intermediary computing device for data analytic enhancement | |
| US10192330B2 (en) | Rendering data visualizations in different analytical applications | |
| JP2013140564A (en) | Method for business intelligence dashboard assembly tool with indication of relationship among content elements, computing system and computer program | |
| CN105793874B (en) | Method and system for managing community information | |
| CN111444256A (en) | Method and device for realizing data visualization | |
| CN103942299A (en) | Data linkage display device and method | |
| CN103678468A (en) | System and method for analyzing and displaying multidimensional data | |
| CN105279270A (en) | Patent retrieving apparatus and retrieving method therefor | |
| Baumgartner et al. | Web data extraction for business intelligence: the lixto approach | |
| US20240095256A1 (en) | Method and system for persisting data | |
| CN116342230A (en) | Electronic commerce data storage platform based on big data analysis | |
| US8832601B2 (en) | ETL tool utilizing dimension trees | |
| US20150066985A1 (en) | Retrieving information from social media sites based upon events in an enterprise | |
| EP3134832A1 (en) | Data processing system and data processing method | |
| CN105893630A (en) | Distributed data service system based on meta data | |
| Al Essa et al. | Data Mining and Warehousing | |
| US20190087484A1 (en) | Capturing context using network visualization | |
| US10417185B2 (en) | Gesture based semantic enrichment | |
| CN110083347A (en) | The realization system of Visualization Platform | |
| CN111143406A (en) | Database data comparison method and database data comparison system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160824 |