CN110377568A - A kind of metadata acquisition method and device - Google Patents
A kind of metadata acquisition method and device Download PDFInfo
- Publication number
- CN110377568A CN110377568A CN201910684276.9A CN201910684276A CN110377568A CN 110377568 A CN110377568 A CN 110377568A CN 201910684276 A CN201910684276 A CN 201910684276A CN 110377568 A CN110377568 A CN 110377568A
- Authority
- CN
- China
- Prior art keywords
- metadata
- meta
- model
- data source
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
- G06F16/164—File meta data generation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention provides a kind of metadata acquisition method and devices, wherein this method comprises: receiving the triggering command of the metadata of triggering collection data source；The meta-model of the metadata building of the data source is retrieved as according to the triggering command, wherein the meta-model is created according to data source characteristic and business demand；The corresponding metadata of the meta-model is acquired according to corresponding metadata acquisition device is arranged for the data source, therefore, it can solve and how problem is acquired to the metadata of different type, the data source of configurations in the related technology, realize the unified acquisition of metadata, the centralized management of different to the type dispersed in each system, configurations data sources.
Description
Technical field
The present invention relates to monitoring fields, in particular to a kind of metadata acquisition method and device.
Background technique
Metadata is to describe the data of data, is the attribute to data, structure and related data (storage location, the owner
Deng) explanation.The metadata of enterprise generally comprises data service metadata, technology metadata, operation metadata, management metadata etc.,
These metadata are dispersed in mostly in the subsystems of platform, and each system may more or less have self-management metadata
Tool or means.But these usual tools or means are designed just for the sake of meeting the function operation of system itself,
It is not able to satisfy the demands such as data quality management, data management and particular service.Such as the version transition of table structure, data are deposited
Space, read-write record, statistical information are stored up, the information such as the genetic connection of data and service attribute possibly can not pass through system itself
Tool get.Importantly, be difficult to accomplish to carry out the metadata of these fragmentations unified acquisition, centralized management and
It is shared between each system.
For how to be acquired problem to the metadata of different type, the data source of configurations in the related technology, still
Solution is not proposed.
Summary of the invention
The embodiment of the invention provides a kind of metadata acquisition method and devices, how right in the related technology at least to solve
Different type, the metadata of the data source of configurations are acquired problem.
According to one embodiment of present invention, a kind of metadata acquisition method is provided, comprising:
Receive the triggering command of the metadata of triggering collection data source；
The meta-model of the metadata building of the data source is retrieved as according to the triggering command, wherein the meta-model
It is to be created according to data source characteristic and business demand；
The corresponding metadata of the meta-model is acquired according to corresponding metadata acquisition device is arranged for the data source.
Optionally, before receiving the triggering command of metadata of triggering collection data source, the method also includes:
The multiple of different levels and granularity are constructed according to the metadata of data source characteristic and business demand to the data source
Sub- meta-model；
The relationship between the multiple sub- meta-model is established according to the level of the meta-model and granularity, is obtained as the number
The meta-model constructed according to the metadata in source.
Optionally, before receiving the triggering command of metadata of triggering collection data source, the method also includes:
It is received as the creation instruction of the meta-model of the metadata building of the data source；
The meta-model is constructed according to the metadata that the creation instruction is the data source.
Optionally, the corresponding member of the corresponding metadata acquisition device acquisition meta-model is being set according to for the data source
Before data, the method also includes:
Data source information is safeguarded according to operation system belonging to the data source, data source types.
Optionally, the corresponding member of the corresponding metadata acquisition device acquisition meta-model is being set according to for the data source
After data, the method also includes:
Classification storage is carried out to the metadata of acquisition.
Optionally, carrying out classification storage to the metadata of acquisition includes:
It by the meta-data preservation of acquisition into the corresponding catalogue of the meta-model, and is metadata setting first
Version information.
Optionally, after the meta-data preservation that will be acquired is into the corresponding catalogue of the meta-model, the method
Further include:
In the case where detecting that the corresponding metadata of the meta-model changes, the metadata acquisition device is called to adopt
Metadata after collection change；
It by the corresponding meta-data preservation of the updated meta-model into the corresponding catalogue of the meta-model, and is described
Second edition information is arranged in metadata after change, wherein the second edition information is obtained based on the first version information
It arrives.
Optionally, acquiring the corresponding metadata of the meta-model according to the metadata acquisition device includes:
It is that the meta-model creates acquisition tasks by task manager；
When running the acquisition tasks, the metadata acquisition device is called to acquire the corresponding metadata of the meta-model.
Optionally, it calls the metadata acquisition device to acquire the corresponding metadata of the meta-model to include:
The metadata acquisition device is called to extract at least following metadata corresponding with the meta-model: library metadata,
Index metadata, trigger metadata, table metadata, column metadata information.
According to another embodiment of the invention, a kind of metadata acquisition device is additionally provided, comprising:
First receiving module, the triggering command of the metadata for receiving triggering collection data source；
Module is obtained, the meta-model that the metadata for being retrieved as the data source according to the triggering command constructs,
In, the meta-model is created according to data source characteristic and business demand；
First acquisition module, for the corresponding metadata acquisition device acquisition meta-model to be arranged according to for the data source
Corresponding metadata.
Optionally, described device further include:
First building module is different for being constructed according to data source characteristic and business demand to the metadata of the data source
Multiple sub- meta-models of level and granularity；
Module is established, establishes the pass between the multiple sub- meta-model for the level and granularity according to the meta-model
System obtains the meta-model constructed for the metadata of the data source.
Optionally, described device further include:
Second receiving module, the creation instruction for the meta-model that the metadata for being received as the data source constructs；
Second building module, for constructing the meta-model according to the metadata that the creation instruction is the data source.
Optionally, described device further include:
Maintenance module carries out data source information for the operation system according to belonging to the data source, data source types
Maintenance.
Optionally, described device further include:
Memory module, for carrying out classification storage to the metadata of acquisition.
Optionally, the memory module, is also used to
It by the meta-data preservation of acquisition into the corresponding catalogue of the meta-model, and is metadata setting first
Version information.
Optionally, described device further include:
Second acquisition module, for calling in the case where detecting that the corresponding metadata of the meta-model changes
Metadata after the metadata acquisition device acquisition change；
Preserving module, for by the corresponding meta-data preservation of the updated meta-model to the corresponding mesh of the meta-model
In record, and second edition information is set for the metadata after the change, wherein the second edition information is based on described the
What one version information obtained.
Optionally, first acquisition module includes:
Creating unit, for being that the meta-model creates acquisition tasks by task manager；
Acquisition unit when for running the acquisition tasks, calls the metadata acquisition device to acquire the meta-model pair
The metadata answered.
Optionally, the creating unit, is also used to
The metadata acquisition device is called to extract at least following metadata corresponding with the meta-model: library metadata,
Index metadata, trigger metadata, table metadata, column metadata information.
According to still another embodiment of the invention, a kind of storage medium is additionally provided, meter is stored in the storage medium
Calculation machine program, wherein the computer program is arranged to execute the step in any of the above-described embodiment of the method when operation.
According to still another embodiment of the invention, a kind of electronic device, including memory and processor are additionally provided, it is described
Computer program is stored in memory, the processor is arranged to run the computer program to execute any of the above-described
Step in embodiment of the method.
Through the invention, the triggering command of the metadata of triggering collection data source is received；It is obtained according to the triggering command
The meta-model constructed for the metadata of the data source, wherein the meta-model is created according to data source characteristic and business demand
It builds；It therefore can according to the corresponding metadata of the corresponding metadata acquisition device acquisition meta-model is arranged for the data source
To solve the problems, such as how to be acquired in the related technology to the metadata of different type, the data source of configurations, realize to point
Dissipate the unified acquisition of metadata, the centralized management of different, configurations the data sources of type in each system.
Detailed description of the invention
The drawings described herein are used to provide a further understanding of the present invention, constitutes part of this application, this hair
Bright illustrative embodiments and their description are used to explain the present invention, and are not constituted improper limitations of the present invention.In the accompanying drawings:
Fig. 1 is a kind of hardware block diagram of the mobile terminal of metadata acquisition method of the embodiment of the present invention；
Fig. 2 is the flow chart of metadata acquisition method according to an embodiment of the present invention；
Fig. 3 is the schematic diagram of meta-model tree according to an embodiment of the present invention；
Fig. 4 is the block diagram of metadata acquisition device according to an embodiment of the present invention；
Fig. 5 is the block diagram one of metadata acquisition device according to the preferred embodiment of the invention；
Fig. 6 is the block diagram two of metadata acquisition device according to the preferred embodiment of the invention；
Fig. 7 is the block diagram three of metadata acquisition device according to the preferred embodiment of the invention.
Specific embodiment
Hereinafter, the present invention will be described in detail with reference to the accompanying drawings and in combination with Examples.It should be noted that not conflicting
In the case of, the features in the embodiments and the embodiments of the present application can be combined with each other.
It should be noted that description and claims of this specification and term " first " in above-mentioned attached drawing, "
Two " etc. be to be used to distinguish similar objects, without being used to describe a particular order or precedence order.
Embodiment 1
Embodiment of the method provided by the embodiment of the present application one can be in mobile terminal, terminal or similar fortune
It calculates and is executed in device.For running on mobile terminals, Fig. 1 is a kind of shifting of metadata acquisition method of the embodiment of the present invention
The hardware block diagram of dynamic terminal, as shown in Figure 1, mobile terminal 10 may include one or more (only showing one in Fig. 1)
(processor 102 can include but is not limited to the processing dress of Micro-processor MCV or programmable logic device FPGA etc. to processor 102
Set) and memory 104 for storing data, optionally, above-mentioned mobile terminal can also include the transmission for communication function
Equipment 106 and input-output equipment 108.It will appreciated by the skilled person that structure shown in FIG. 1 is only to illustrate,
It does not cause to limit to the structure of above-mentioned mobile terminal.For example, mobile terminal 10 may also include it is more than shown in Fig. 1 or
Less component, or with the configuration different from shown in Fig. 1.
Memory 104 can be used for storing computer program, for example, the software program and module of application software, such as this hair
The corresponding computer program of message method of reseptance in bright embodiment, processor 102 are stored in memory 104 by operation
Computer program realizes above-mentioned method thereby executing various function application and data processing.Memory 104 may include
High speed random access memory, may also include nonvolatile memory, as one or more magnetic storage device, flash memory or its
His non-volatile solid state memory.In some instances, memory 104 can further comprise remotely setting relative to processor 102
The memory set, these remote memories can pass through network connection to mobile terminal 10.The example of above-mentioned network includes but not
It is limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
Transmitting device 106 is used to that data to be received or sent via a network.Above-mentioned network specific example may include
The wireless network that the communication providers of mobile terminal 10 provide.In an example, transmitting device 106 includes a Network adaptation
Device (Network Interface Controller, referred to as NIC), can be connected by base station with other network equipments to
It can be communicated with internet.In an example, transmitting device 106 can for radio frequency (Radio Frequency, referred to as
RF) module is used to wirelessly be communicated with internet.
Based on above-mentioned mobile terminal, a kind of metadata acquisition method is present embodiments provided, Fig. 2 is real according to the present invention
The flow chart of the metadata acquisition method of example is applied, as shown in Fig. 2, the process includes the following steps:
Step S202 receives the triggering command of the metadata of triggering collection data source；
Step S204 is retrieved as the meta-model of the metadata building of the data source according to the triggering command, wherein institute
Stating meta-model is created according to data source characteristic and business demand；
Meta-model in the embodiment of the present invention is made of complementary multiple sub- meta-models, is had between multiple submodels
Standby set membership.
Step S206 acquires the corresponding member of the meta-model according to corresponding metadata acquisition device is arranged for the data source
Data.
S202 to S206 through the above steps receives the triggering command of the metadata of triggering collection data source；According to described
Triggering command is retrieved as the meta-model of the metadata building of the data source, wherein the meta-model is according to data source characteristic
With business demand creation；The corresponding member of the meta-model is acquired according to corresponding metadata acquisition device is arranged for the data source
Therefore data can solve how to be acquired the metadata of different type, the data source of configurations in the related technology and ask
Topic realizes the unified acquisition of metadata, the centralized management of different to the type dispersed in each system, configurations data sources.
Meta-model in the embodiment of the present invention can be meta-model built in system and be also possible to customized meta-model.
In an optional embodiment, for being meta-model built in system, according to data source characteristic and business demand to institute
State multiple sub- meta-models of metadata the building different levels and granularity of data source；It is built according to the level of the meta-model and granularity
The relationship between the multiple sub- meta-model is found, the meta-model constructed for the metadata of the data source is obtained.
In another optional embodiment, it is received as the creation instruction of the meta-model of the metadata building of the data source,
The meta-model is constructed according to the metadata that the creation instruction is the data source.
In the embodiment of the present invention, the corresponding metadata acquisition device acquisition meta-model is being set according to for the data source
Before corresponding metadata, data source information is safeguarded according to operation system belonging to the data source, data source types,
So that different business systems, different types of data source correspond to different sub- meta-models, carried out for the subsequent metadata to data source
Classification Management is prepared.
It is corresponding, metadata is checked for the ease of user, and according to for the data source, corresponding metadata acquisition is being set
After device acquires the corresponding metadata of the meta-model, classification storage is carried out to the metadata of acquisition.
In the embodiment of the present invention, carrying out classification storage to the metadata of acquisition be can specifically include: by the institute of acquisition
Meta-data preservation is stated into the corresponding catalogue of the meta-model, and first version information is set for the metadata.
Optionally, it after the meta-data preservation that will be acquired is into the corresponding catalogue of the meta-model, is detecting
First number in the case that the corresponding metadata of the meta-model changes, after calling the metadata acquisition device acquisition change
According to；It by the corresponding meta-data preservation of the updated meta-model into the corresponding catalogue of the meta-model, and is the change
Second edition information is arranged in metadata afterwards, wherein and the second edition information is obtained based on the first version information,
For example, second edition information is that first version information adds 1 to obtain.
In the embodiment of the present invention, above-mentioned steps S206 be can specifically include: be meta-model wound by task manager
Build acquisition tasks；When running the acquisition tasks, the metadata acquisition device is called to acquire the corresponding metadata of the meta-model.
Further, the metadata acquisition device is called to extract at least following metadata corresponding with the meta-model:
Library metadata, index metadata, trigger metadata, table metadata, column metadata information.
The embodiment of the invention provides a kind of general metadata management methods, comprising the following steps:
1) it constructs meta-model: to metadata according to data source characteristic and business demand, constructing the member of different levels and granularity
Model.Meta-model is divided into two kinds by building mode: built-in meta-model and customized meta-model.
A. built-in meta-model: first number that the metadata management tool or means that are carried by data source systems are got
According to the model of creation, general data source (Oracle, Hive, PostgreSql, Mysql etc.) can be in this way mostly
Built-in meta-model.The meta-model of different data sources building is different.
B. it customized meta-model: is sorted out according to metadata used in the system of enterprise platform independent development or user
The model of the metadata creation come, most data service metadata, operation metadata etc. need user-defined model.
2) dependence between meta-model is established, according to the granularity and level of meta-model, father and son between meta-model is established and closes
System.Every one kind data source can construct the model tree (ModelTree) of oneself by establishing the set membership of meta-model；
3) data source control: the operation system according to belonging to data source, data source types, to data source information, (connection is believed
Breath, title, said system) it carries out maintenance management；
4) it realizes metadata acquisition device: being directed to different types of frequently-used data source, realize corresponding collector.Collector energy
Enough collect the corresponding metadata of meta-model that the data source types have been given a definition.It is real in this method for built-in meta-model
Existing corresponding built-in metadata acquisition device；Meta-model customized for user is needed through template interface, and realization can acquire
To the corresponding metadata acquisition device of customized meta-model.
5) it realizes acquisition tasks manager, for creating and configuring acquisition tasks, runs acquisition tasks, check acquisition tasks
Details etc..
6) metadata storage management and release maintenance: according to the type of data source, affiliated operation system carries out metadata
Classification storage.The case where to each metadata updates, safeguards new version, for tracing the historical variations of metadata.
It is exemplified below.
1) assume there is operation system S, there are the data source mysql-1 of mysql type, the existing member in mysql-1 to be extracted
Data；
2) Fig. 3 is the schematic diagram of meta-model tree according to an embodiment of the present invention, as shown in figure 3, the member of building mysql type
Model creates following sub- meta-model: library meta-model (DBModel), list cell model (TableModel), field meta-model
(ColumnModel), View meta-model (ViewModel), trigger (TriggerModel) etc.；
3) set membership for establishing meta-model constructs the meta-model tree of Mysql-1；
The metadata acquisition device MysqlMetaCollector for realizing Mysql type, can extract corresponding with meta-model
Library metadata, index metadata, trigger metadata, table metadata, column metadata information.
5) task manager is that Mysql-1 creates an acquisition tasks Task-1；
6) when running acquisition tasks Task-1, MysqlMetaCollector collector is called, first number of Mysql-1 is obtained
It is believed that breath, is stored to data source Mysql-1 in the following, and safeguarding into first version version=1.
If 7) Mysql-1 metadata changes later, re-execute 6), every to update once, version requires to add
1。
Through the embodiment of the present invention, the acquisition and management of the metadata towards various general data sources, Neng Goushi are realized
For a variety of relational data sources.It also supports to be used for customized meta-model simultaneously, extracts the metadata of non-common data source, more
Flexibly, there is preferably compatibility.
Through the above description of the embodiments, those skilled in the art can be understood that according to above-mentioned implementation
The method of example can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but it is very much
In the case of the former be more preferably embodiment.Based on this understanding, technical solution of the present invention is substantially in other words to existing
The part that technology contributes can be embodied in the form of software products, which is stored in a storage
In medium (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal device (can be mobile phone, calculate
Machine, server or network equipment etc.) execute method described in each embodiment of the present invention.
Embodiment 2
The embodiment of the present invention, additionally provides a kind of metadata acquisition device, and the device is for realizing above-described embodiment and excellent
Embodiment is selected, the descriptions that have already been made will not be repeated.As used below, predetermined function may be implemented in term " module "
Software and/or hardware combination.Although device described in following embodiment is preferably realized with software, hardware,
Or the realization of the combination of software and hardware is also that may and be contemplated.
Fig. 4 is the block diagram of metadata acquisition device according to an embodiment of the present invention, as shown in Figure 4, comprising:
First receiving module 42, the triggering command of the metadata for receiving triggering collection data source；
Module 44 is obtained, the meta-model that the metadata for being retrieved as the data source according to the triggering command constructs,
Wherein, the meta-model is created according to data source characteristic and business demand；
First acquisition module 46, for corresponding metadata acquisition device acquisition first mould to be arranged according to for the data source
The corresponding metadata of type.
Fig. 5 is the block diagram one of metadata acquisition device according to the preferred embodiment of the invention, as shown in figure 5, described device
Further include:
First building module 52, for being constructed not according to data source characteristic and business demand to the metadata of the data source
Multiple sub- meta-models of same level and granularity；
Module 54 is established, establishes the pass between the multiple sub- meta-model for the level and granularity according to the meta-model
System obtains the meta-model constructed for the metadata of the data source.
Fig. 6 is the block diagram two of metadata acquisition device according to the preferred embodiment of the invention, as shown in fig. 6, described device
Further include:
Second receiving module 62, the creation instruction for the meta-model that the metadata for being received as the data source constructs；
Second building module 64, for according to metadata building first mould that the creation instruction is the data source
Type.
Optionally, described device further include:
Maintenance module carries out data source information for the operation system according to belonging to the data source, data source types
Maintenance.
Optionally, described device further include:
Memory module, for carrying out classification storage to the metadata of acquisition.
Optionally, the memory module, is also used to
It by the meta-data preservation of acquisition into the corresponding catalogue of the meta-model, and is metadata setting first
Version information.
Optionally, described device further include:
Second acquisition module, for calling in the case where detecting that the corresponding metadata of the meta-model changes
Metadata after the metadata acquisition device acquisition change；
Preserving module, for by the corresponding meta-data preservation of the updated meta-model to the corresponding mesh of the meta-model
In record, and second edition information is set for the metadata after the change, wherein the second edition information is based on described the
What one version information obtained.
Fig. 7 is the block diagram three of metadata acquisition device according to the preferred embodiment of the invention, as shown in fig. 7, described first
Acquisition module 46 includes:
Creating unit 72, for being that the meta-model creates acquisition tasks by task manager；
Acquisition unit 74 when for running the acquisition tasks, calls the metadata acquisition device to acquire the meta-model
Corresponding metadata.
Optionally, the creating unit 72, is also used to
The metadata acquisition device is called to extract at least following metadata corresponding with the meta-model: library metadata,
Index metadata, trigger metadata, table metadata, column metadata information.
It should be noted that above-mentioned modules can be realized by software or hardware, for the latter, Ke Yitong
Following manner realization is crossed, but not limited to this: above-mentioned module is respectively positioned in same processor；Alternatively, above-mentioned modules are with any
Combined form is located in different processors.
Embodiment 3
The embodiments of the present invention also provide a kind of storage medium, computer program is stored in the storage medium, wherein
The computer program is arranged to execute the step in any of the above-described embodiment of the method when operation.
Optionally, in the present embodiment, above-mentioned storage medium can be set to store by executing based on following steps
Calculation machine program:
S11 receives the triggering command of the metadata of triggering collection data source；
S12 is retrieved as the meta-model of the metadata building of the data source according to the triggering command, wherein the member
Model is created according to data source characteristic and business demand；
S13 acquires the corresponding metadata of the meta-model according to corresponding metadata acquisition device is arranged for the data source.
Optionally, in the present embodiment, above-mentioned storage medium can include but is not limited to: USB flash disk, read-only memory (Read-
Only Memory, referred to as ROM), it is random access memory (Random Access Memory, referred to as RAM), mobile hard
The various media that can store computer program such as disk, magnetic or disk.
Embodiment 4
The embodiments of the present invention also provide a kind of electronic device, including memory and processor, stored in the memory
There is computer program, which is arranged to run computer program to execute the step in any of the above-described embodiment of the method
Suddenly.
Optionally, above-mentioned electronic device can also include transmission device and input-output equipment, wherein the transmission device
It is connected with above-mentioned processor, which connects with above-mentioned processor.
Optionally, in the present embodiment, above-mentioned processor can be set to execute following steps by computer program:
S11 receives the triggering command of the metadata of triggering collection data source；
S12 is retrieved as the meta-model of the metadata building of the data source according to the triggering command, wherein the member
Model is created according to data source characteristic and business demand；
S13 acquires the corresponding metadata of the meta-model according to corresponding metadata acquisition device is arranged for the data source.
Optionally, the specific example in the present embodiment can be with reference to described in above-described embodiment and optional embodiment
Example, details are not described herein for the present embodiment.
Obviously, those skilled in the art should be understood that each module of the above invention or each step can be with general
Computing device realize that they can be concentrated on a single computing device, or be distributed in multiple computing devices and formed
Network on, optionally, they can be realized with the program code that computing device can perform, it is thus possible to which they are stored
It is performed by computing device in the storage device, and in some cases, it can be to be different from shown in sequence execution herein
Out or description the step of, perhaps they are fabricated to each integrated circuit modules or by them multiple modules or
Step is fabricated to single integrated circuit module to realize.In this way, the present invention is not limited to any specific hardware and softwares to combine.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field
For art personnel, the invention may be variously modified and varied.It is all within principle of the invention, it is made it is any modification, etc.
With replacement, improvement etc., should all be included in the protection scope of the present invention.
Claims (10)
1. a kind of metadata acquisition method characterized by comprising
Receive the triggering command of the metadata of triggering collection data source；
The meta-model of the metadata building of the data source is retrieved as according to the triggering command, wherein the meta-model is root
It is created according to data source characteristic and business demand；
The corresponding metadata of the meta-model is acquired according to corresponding metadata acquisition device is arranged for the data source.
2. the method according to claim 1, wherein the triggering in the metadata for receiving triggering collection data source refers to
Before order, the method also includes:
Multiple son members of different levels and granularity are constructed to the metadata of the data source according to data source characteristic and business demand
Model；
The relationship between the multiple sub- meta-model is established according to the level of the meta-model and granularity, is obtained as the data source
Metadata building meta-model.
3. the method according to claim 1, wherein the triggering in the metadata for receiving triggering collection data source refers to
Before order, the method also includes:
It is received as the creation instruction of the meta-model of the metadata building of the data source；
The meta-model is constructed according to the metadata that the creation instruction is the data source.
4. the method according to claim 1, wherein being adopted according to for the corresponding metadata of data source setting
Before storage acquires the corresponding metadata of the meta-model, the method also includes:
Data source information is safeguarded according to operation system belonging to the data source, data source types.
5. according to the method described in claim 4, it is characterized in that, being adopted according to for the corresponding metadata of data source setting
After storage acquires the corresponding metadata of the meta-model, the method also includes:
By the meta-data preservation of acquisition into the corresponding catalogue of the meta-model, and first version is set for the metadata
Information.
6. according to the method described in claim 5, it is characterized in that, in the meta-data preservation that will be acquired to the meta-model
After in corresponding catalogue, the method also includes:
In the case where detecting that the corresponding metadata of the meta-model changes, the metadata acquisition device acquisition is called to become
Metadata after more；
It by the corresponding meta-data preservation of the updated meta-model into the corresponding catalogue of the meta-model, and is the change
Second edition information is arranged in metadata afterwards, wherein the second edition information is obtained based on the first version information.
7. method according to any one of claim 1 to 6, which is characterized in that acquired according to the metadata acquisition device
The corresponding metadata of the meta-model includes:
It is that the meta-model creates acquisition tasks by task manager；
When running the acquisition tasks, the metadata acquisition device is called to acquire the corresponding metadata of the meta-model.
8. a kind of metadata acquisition device characterized by comprising
First receiving module, the triggering command of the metadata for receiving triggering collection data source；
Module is obtained, the meta-model that the metadata for being retrieved as the data source according to the triggering command constructs, wherein institute
Stating meta-model is created according to data source characteristic and business demand；
First acquisition module, for corresponding according to the corresponding metadata acquisition device acquisition meta-model is arranged for the data source
Metadata.
9. a kind of storage medium, which is characterized in that be stored with computer program in the storage medium, wherein the computer
Program is arranged to execute method described in described any one of claims 1 to 7 when operation.
10. a kind of electronic device, including memory and processor, which is characterized in that be stored with computer journey in the memory
Sequence, the processor are arranged to run the computer program to execute side described in described any one of claims 1 to 7
Method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910684276.9A CN110377568A (en) | 2019-07-26 | 2019-07-26 | A kind of metadata acquisition method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910684276.9A CN110377568A (en) | 2019-07-26 | 2019-07-26 | A kind of metadata acquisition method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110377568A true CN110377568A (en) | 2019-10-25 |
Family
ID=68256483
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910684276.9A Pending CN110377568A (en) | 2019-07-26 | 2019-07-26 | A kind of metadata acquisition method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110377568A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112685433A (en) * | 2021-01-07 | 2021-04-20 | 网易（杭州）网络有限公司 | Metadata updating method and device, electronic equipment and computer-readable storage medium |
| CN114048193A (en) * | 2022-01-12 | 2022-02-15 | 树根互联股份有限公司 | Data management and control method, device and computer readable storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101047549A (en) * | 2006-04-10 | 2007-10-03 | 华为技术有限公司 | Data synchronous system and its method |
| US20130262378A1 (en) * | 2012-04-02 | 2013-10-03 | Microsoft Corporation | Aggregation point for enterprise business application binding |
| CN104200402A (en) * | 2014-09-11 | 2014-12-10 | 国家电网公司 | Publishing method and system of source data of multiple data sources in power grid |
| CN106250110A (en) * | 2016-07-19 | 2016-12-21 | 凯德自控技术长沙股份有限公司 | Set up the method and device of model |
| CN108280147A (en) * | 2018-01-02 | 2018-07-13 | 浪潮软件集团有限公司 | Data management method and device |
| CN109033188A (en) * | 2018-06-27 | 2018-12-18 | 新华三大数据技术有限公司 | A kind of metadata acquisition method, apparatus, server and computer-readable medium |
| CN109446274A (en) * | 2017-08-31 | 2019-03-08 | 北京京东尚科信息技术有限公司 | The method and apparatus of big data platform BI metadata management |
| CN109656963A (en) * | 2018-12-18 | 2019-04-19 | 深圳前海微众银行股份有限公司 | Metadata acquisition methods, device, equipment and computer readable storage medium |
| CN109684486A (en) * | 2018-12-26 | 2019-04-26 | 中国南方电网有限责任公司 | Construction method, device, computer equipment and the storage medium of metadata schema |
-
2019
- 2019-07-26 CN CN201910684276.9A patent/CN110377568A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101047549A (en) * | 2006-04-10 | 2007-10-03 | 华为技术有限公司 | Data synchronous system and its method |
| US20130262378A1 (en) * | 2012-04-02 | 2013-10-03 | Microsoft Corporation | Aggregation point for enterprise business application binding |
| CN104200402A (en) * | 2014-09-11 | 2014-12-10 | 国家电网公司 | Publishing method and system of source data of multiple data sources in power grid |
| CN106250110A (en) * | 2016-07-19 | 2016-12-21 | 凯德自控技术长沙股份有限公司 | Set up the method and device of model |
| CN109446274A (en) * | 2017-08-31 | 2019-03-08 | 北京京东尚科信息技术有限公司 | The method and apparatus of big data platform BI metadata management |
| CN108280147A (en) * | 2018-01-02 | 2018-07-13 | 浪潮软件集团有限公司 | Data management method and device |
| CN109033188A (en) * | 2018-06-27 | 2018-12-18 | 新华三大数据技术有限公司 | A kind of metadata acquisition method, apparatus, server and computer-readable medium |
| CN109656963A (en) * | 2018-12-18 | 2019-04-19 | 深圳前海微众银行股份有限公司 | Metadata acquisition methods, device, equipment and computer readable storage medium |
| CN109684486A (en) * | 2018-12-26 | 2019-04-26 | 中国南方电网有限责任公司 | Construction method, device, computer equipment and the storage medium of metadata schema |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112685433A (en) * | 2021-01-07 | 2021-04-20 | 网易（杭州）网络有限公司 | Metadata updating method and device, electronic equipment and computer-readable storage medium |
| CN114048193A (en) * | 2022-01-12 | 2022-02-15 | 树根互联股份有限公司 | Data management and control method, device and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107766132A (en) | Multi-task scheduling method, application server and computer-readable recording medium | |
| CN105653425A (en) | Complicated event processing engine based monitoring system | |
| CN106533804A (en) | Network operation support system | |
| CN105574082A (en) | Storm based stream processing method and system | |
| CN104573184B (en) | Bullet train product meta-model construction method and device | |
| CN110399387A (en) | Method and device based on table incidence relation dynamic generation query SQL | |
| CN110377568A (en) | A kind of metadata acquisition method and device | |
| CN106777368A (en) | Data base query language adaptation method and device, distributed data-storage system | |
| CN102957622A (en) | Method, device and system for data processing | |
| CN105528454A (en) | Log treatment method and distributed cluster computing device | |
| CN105187230A (en) | Server switching method and server switching device | |
| CN108959048A (en) | The method for analyzing performance of modular environment, device and can storage medium | |
| CN104765596A (en) | Request handling method and device | |
| CN115392501A (en) | Data acquisition method and device, electronic equipment and storage medium | |
| CN106777265B (en) | Service data processing method and device | |
| CN113467782B (en) | Method, device and equipment for determining business process | |
| CN112350855B (en) | Configuration-based cloud center management method | |
| CN108021589A (en) | The collocation method and device of the inquiry dimension of database | |
| CN111209332A (en) | Database synchronization method based on self-made serialization algorithm | |
| CN106959903A (en) | Trap instruction Trap processing method and processing device | |
| US20210208929A1 (en) | System And Method For Providing Configurable Communications For A Software Platform On A Per Service Basis | |
| CN114281549A (en) | Data processing method and device | |
| CN109741805A (en) | PDF reports method and device, storage medium and the electronic device automatically generated | |
| CN108733693A (en) | Data managing method, device, storage medium and processor | |
| CN113468182A (en) | Data storage method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191025 |