CN110019267A

CN110019267A - A kind of metadata updates method, apparatus, system, electronic equipment and storage medium

Info

Publication number: CN110019267A
Application number: CN201711167311.7A
Authority: CN
Inventors: 吴嘉
Original assignee: China Mobile Communications Group Co Ltd; China Mobile Communications Co Ltd
Current assignee: China Mobile Communications Group Co Ltd; China Mobile Communications Co Ltd
Priority date: 2017-11-21
Filing date: 2017-11-21
Publication date: 2019-07-16

Abstract

The invention discloses a kind of metadata updates method, apparatus, system, electronic equipment and storage mediums, the first electronic equipment that the metadata updates method is applied to be equipped with metadata management system includes: to receive production system to send metadata evolution information, wherein the metadata evolution information includes the information of the first metadata after change type and change, and the information of the first metadata after the change type and change is what production system was got by way of bridge joint；According to the information of the first metadata after the change type and change, the first metadata of correspondence saved to itself is updated.The information of the first metadata after obtaining change by way of bridge joint in embodiments of the present invention, the required time is updated to the metadata after change in metadata management system to greatly shorten, it is participated in without artificial, therefore improves the timeliness and efficiency of metadata updates.

Description

A kind of metadata updates method, apparatus, system, electronic equipment and storage medium

Technical field

The present invention relates to big data technical fields more particularly to a kind of metadata updates method, apparatus, system, electronics to set Standby and storage medium.

Background technique

Metadata is the data about data, i.e., to the description information of data.IT (Internet Technology, interconnection Network technology) system is as actual production system, in IT system, different metadata is preserved, according to the difference of its attribute, member Data can be divided into technology metadata and data service metadata.Wherein, technology metadata lays particular stress on data structure and data processing details side The technicalization in face describes, mainly including structural informations such as model, table, view, fields in source system interface specification, data warehouse Description, Data Mart define the information such as the description of description and data handling procedure；Data service metadata is to data processing rule It mainly include business rule, business terms, index business bore, information classification etc. with the description of business meaning.

Under the background of big data era, data, that is, assets, metadata management realizes the lattice of description and the classification of information Formula, it helps enterprise to be preferably managed to data assets, clears the relationship between data.With MPP (MPP), under the traditional data warehouse environment based on the technologies such as high-performance integrated machine, relative to business datum, the change of metadata More and infrequently, therefore the acquisition of metadata generally carries out in batch fashion.I.e. metadata management system periodically from production system, Various metadata information files, such as SQL (Structured Query Language, structuralized query are obtained in management system Language) script, ETL (Extract-Transform-Load, data pick-up, conversion, loading process) script, running log, Service profile etc. after parse, analyze, be associated with of batch, realizes the acquisition and update of metadata.

Fig. 1 is the acquisition renewal process schematic diagram of metadata under available data warehouse, and metadata management system is by IT system The data such as the SQL script of middle acquisition, ETL log and database design, parsed, analyze after obtain technology metadata, and obtain Take the data such as document, table of typing in IT system, parsed, analyze after obtain data service metadata, by technology metadata and Data service metadata association, and the metadata stored in Metadata Repository is updated.Metadata, which is applied, passes through metadata pipe The API (Application Programming Interface, application programming interface) that reason system provides acquires first number According to application itself need metadata, wherein metadata apply including information browse, consanguinity analysis, the quality of data, asset views, Data safety etc..

Metadata acquisition carries out in batch fashion, and metadata management system collects same day metadata such as before daily 24 points Modification information, and handled, if the metadata in IT system changes, IT system can get change in real time Metadata, therefore when metadata changes in time T, the metadata updates process in IT system is non-delay i.e. in time T+0 It updates, and due to the metadata that metadata management system is changed in specific time batch capture, then metadata management Metadata may be updated in time T+H in system, and H is first number in the specific time and IT system of the metadata of acquisition change According to the difference of renewal time, there are one for the data cases in metadata and actual production system stored in metadata management system Fixed time delay.

Due to not supporting synchronized update under traditional data warehouse environment, if necessary in metadata management system batch updating The metadata being updated in IT system is got before the time of metadata, often will appear following classic applications scene: such as Data collector is added to the related data of day metadata and day metadata in IT system, that is, production system cluster, And notification data treatment people, data processing personnel, which first load, obtains newly added day metadata and related data, and to phase Data are closed to be cleaned；Data analyst modifies related table structure according to day metadata, and the date is added in correlation table The corresponding new data column of metadata and related data, to realize the addition of day metadata in metadata management system.Also It is when there are when the time of metadata updates and not up to batch updating metadata, data acquisition process is analyzed personnel and needed artificially Operation increases the workload of data acquisition process analysis personnel, reduces data acquisition efficiency, therefore to realize metadata updates There is delay, poor in timeliness, low efficiency in specific time batch capture more new metadata in existing way.

Summary of the invention

The present invention provides a kind of metadata updates method, apparatus, system, electronic equipment and storage medium, existing to solve With the presence of time batch capture more new metadata delay specific in technology, poor in timeliness, low efficiency problem.

The present invention provides a kind of metadata updates methods, set applied to the first electronics for being equipped with metadata management system It is standby, this method comprises:

Receive metadata evolution information, wherein the metadata evolution information include change type and change after first yuan The information of the first metadata after the information of data, the change type and change is that production system is obtained by way of bridge joint It arrives；

According to the information of the first metadata after the change type and change, to the first metadata of correspondence of itself preservation It is updated.

Further, after the reception metadata evolution information, in the according to after the change type and change The information of one metadata, before being updated to the metadata itself saved, the method also includes:

When in the metadata evolution information include file information, and the change type and change after first yuan of number According to information include in the information of the file when, the file is parsed, the after obtaining change type and change The information of one metadata.

Further, wherein including the first letter applied belonging to first metadata in the metadata evolution information Breath, it is described to the file carry out parsing include:

According to the corresponding relationship of the application pre-saved and parsing queue, determine that the corresponding target of first application parses Queue；

Queue is parsed by the target to parse the file.

Further, the method also includes:

By the first meta-data preservation after the change in the publishing queue for each application creation；

For each application, judge whether the application has subscribed first metadata；If so, being corresponded to by the application Publishing queue by the first metadata after the change, be sent to the application, and this using being deleted in corresponding publishing queue Except the first metadata after the change.

Further, the method also includes:

Receive the data acquisition request that the second application is sent；

Corresponding publishing queue is applied by described second, first number after changing in the publishing queue that described second is applied It is applied according to being sent to described second.

Further, the method also includes:

In each publishing queue, judge whether the duration of the second meta-data preservation is greater than the duration threshold value of setting；

If so, deleting second metadata.

The present invention provides a kind of metadata updates methods should applied to the second electronic equipment for being equipped with production system Method includes:

The information of the first metadata after obtaining change type and change by way of bridge joint；

The metadata evolution information of generation is sent to metadata management system, wherein wrapping in the metadata evolution information The information of the first metadata after including the change type and change makes the metadata management system receive metadata evolution letter Breath, according to the information of the first metadata after the change type and change, the correspondence that the metadata management system is saved First metadata is updated.

Further, the information that the first metadata after change type and change is obtained by way of bridge joint includes Following at least one:

The instruction that the database of intercept operation production system generates；Judge whether described instruction is to carry out metadata evolution Instruction；If so, obtaining the information of the first metadata after the change type carried in described instruction and change；

The execution journal for parsing the database of production system judges in the execution journal with the presence or absence of for metadata Metadata evolution；If so, obtaining the information of the change type in the execution journal and the first metadata after change；With

The configuration file for obtaining the database of production system judges in the configuration file with the presence or absence of for metadata Metadata evolution；If so, obtaining the information of the change type in the configuration file and the first metadata after change.

The present invention provides a kind of metadata updates devices, set applied to the first electronics for being equipped with metadata management system Standby, which includes:

Receiving module, for receiving metadata evolution information, wherein the metadata evolution information include change type and The information of the first metadata after the information of the first metadata after change, the change type and change passes through for production system What the mode of bridge joint was got；

Update module saves itself for the information according to the first metadata after the change type and change Corresponding first metadata is updated.

Described device further include:

Module is obtained, after being used for the reception metadata evolution information, described according to the change type and after changing The first metadata information, to itself save the first metadata of correspondence be updated before, when the metadata evolution believe It include the information of file in breath, and the information of the first metadata after the change type and change is included in the letter of the file When in breath, the file is parsed, the information of the first metadata after obtaining change type and change.

The acquisition module, described in determining according to the application pre-saved and the corresponding relationship for parsing queue The first corresponding target of application parses queue；Queue is parsed by the target to parse the file.

Described device further include:

Sending module, for by the first meta-data preservation after the change for each application creation publishing queue In；For each application, judge whether the application has subscribed first metadata；If so, applying corresponding hair by this The first metadata after the change is sent to the application by cloth queue, and this using deleting institute in corresponding publishing queue The first metadata after stating change.

The sending module is also used to receive the data acquisition request that the second application is sent；Pass through second application pair Metadata after changing in publishing queue that described second applies is sent to second application by the publishing queue answered.

Described device further include:

Removing module, for judging whether the duration of the second meta-data preservation is greater than setting in each publishing queue Duration threshold value；If so, deleting second metadata.

The present invention provides a kind of metadata updates devices should applied to the second electronic equipment for being equipped with production system Device includes:

Module is obtained, the information for the first metadata after obtaining change type by way of bridge joint and changing；

Sending module, for the metadata evolution information of generation to be sent to metadata management system, wherein the member number According to the information of the first metadata after including the change type in modification information and changing, connect the metadata management system Metadata evolution information is received, according to the information of the first metadata after the change type and change, to the metadata management The first metadata of correspondence that system saves is updated.

The acquisition module, specifically for the first metadata after obtaining change type by way of bridge joint and changing Information comprises at least one of the following: the instruction that the database of intercept operation production system generates；Judge described instruction whether be into The instruction of row metadata evolution；If so, obtaining the first metadata after the change type carried in described instruction and change Information；The execution journal for parsing the database of production system judges in the execution journal with the presence or absence of the member for metadata Data change；If so, obtaining the information of the change type in the execution journal and the first metadata after change；And acquisition The configuration file of the database of production system judges in the configuration file with the presence or absence of the metadata evolution for metadata； If so, obtaining the information of the change type in the configuration file and the first metadata after change.

The present invention provides a kind of electronic equipment, comprising: memory, processor and transceiver；

The processor executes following process: controlling the transceiver for reading the program in the memory Metadata evolution information, wherein the metadata evolution information includes the information of the first metadata after change type and change, The information of the first metadata after the change type and change is what production system was got by way of bridge joint；According to institute The information of the first metadata after stating change type and change, the first metadata of correspondence saved to itself are updated.

Further, the processor, be also used in the metadata evolution information whether include file information, and When the information of the first metadata after the change type and change includes in the information of the file, the file is carried out Parsing, the information of the first metadata after obtaining change type and change.

Further, the processor is specifically used for including the first metadata institute in the metadata evolution information The information of the first application belonged to determines first application pair according to the corresponding relationship of the application pre-saved and parsing queue The target parsing queue answered；Queue is parsed by the target to parse the file.

Further, the processor is also used to the first meta-data preservation after the change for each application In the publishing queue of creation；For each application, judge whether the application has subscribed first metadata；If so, control The transceiver by this using corresponding publishing queue by the first metadata after the change, be sent to the application, and This is applied in corresponding publishing queue and deletes the first metadata after the change.

Further, the processor is also used to control the data acquisition that the application of transceiver second is sent and asks It asks；Corresponding publishing queue is applied by described second, the metadata hair after changing in the publishing queue that described second is applied Give second application.

Further, the processor is also used in each publishing queue, judges that the duration of the second meta-data preservation is The no duration threshold value for being greater than setting；If so, deleting second metadata.

The processor executes following process: being obtained by way of bridge joint for reading the program in the memory The information of the first metadata after change type and change；The metadata evolution information of generation is sent to metadata management system System makes described wherein including the information of the first metadata after the change type and change in the metadata evolution information Metadata management system receives metadata evolution information, the information of the first metadata according to the change type and after changing, The first metadata of correspondence saved to the metadata management system is updated.

Further, the processor, specifically for first after obtaining change type by way of bridge joint and changing The information of metadata comprises at least one of the following: the instruction that the database of intercept operation production system generates；Judge described instruction It whether is the instruction for carrying out metadata evolution；If so, obtaining in described instruction first after the change type that carries and change The information of metadata；The execution journal for parsing the database of production system judges in the execution journal with the presence or absence of for member The metadata evolution of data；If so, obtaining the letter of the change type in the execution journal and the first metadata after change Breath；With the configuration file for the database for obtaining production system, judge in the configuration file with the presence or absence of the member for metadata Data change；If so, obtaining the information of the change type in the configuration file and the first metadata after change.

The present invention provides a kind of electronic equipment, comprising: processor, communication interface, memory and communication bus, wherein Processor, communication interface, memory complete mutual communication by communication bus；

It is stored with computer program in the memory, when described program is executed by the processor, so that the place Manage the step of device executes any of the above-described method.

The present invention provides a kind of computer readable storage medium, it is stored with the computer journey that can be executed by electronic equipment Sequence, when described program is run on the electronic equipment, so that the electronic equipment executes the step of any of the above-described the method Suddenly.

The present invention provides a kind of metadata updates system, the metadata updates system includes: to be applied to peace as above-mentioned The first electronic equipment equipped with metadata management system, and such as above-mentioned the second electronic equipment for being applied to be equipped with production system.

The present invention provides a kind of metadata updates method, apparatus, system, electronic equipment and storage mediums, are applied to peace The metadata updates method of the first electronic equipment equipped with metadata management system includes: reception metadata evolution information, wherein The metadata evolution information include change type and change after the first metadata information, the change type and change after The information of first metadata be that production system is got by way of bridge joint；After the change type and change The information of first metadata, the first metadata of correspondence saved to itself are updated.In embodiments of the present invention, when production is There are when metadata evolution in system, production system obtains the information of the first metadata after change by way of bridge joint, sends To metadata management system, the metadata that metadata management system saves itself is updated, without in the specific time batch The metadata that amount acquisition updates, therefore is updated significantly the required time to the metadata after change in metadata management system Shorten, is participated in without artificial, therefore improve the timeliness and efficiency of metadata updates.

Detailed description of the invention

In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with It obtains other drawings based on these drawings.

Fig. 1 is the acquisition renewal process schematic diagram of metadata under available data warehouse；

Fig. 2 is a kind of schematic diagram for metadata updates process that present example 1 provides；

Fig. 3 is a kind of schematic diagram for metadata acquisition renewal process that the embodiment of the present invention 6 provides；

Fig. 4 is a kind of schematic diagram for metadata updates process that the embodiment of the present invention 7 provides；

Fig. 5 is the schematic diagram that a kind of metadata acquisition that the embodiment of the present invention 7 provides updates；

Fig. 6 is a kind of structural schematic diagram for metadata acquisition more new system that the embodiment of the present invention 9 provides；

Fig. 7 is the structural schematic diagram for a kind of electronic equipment that the embodiment of the present invention 10 provides；

Fig. 8 is the structural schematic diagram for a kind of electronic equipment that the embodiment of the present invention 11 provides；

Fig. 9 is the structural schematic diagram for a kind of electronic equipment that the embodiment of the present invention 12 provides；

Figure 10 is the structural schematic diagram for a kind of electronic equipment that the embodiment of the present invention 13 provides；

Figure 11 is a kind of metadata updates schematic device provided in an embodiment of the present invention；

Figure 12 is a kind of metadata updates schematic device provided in an embodiment of the present invention.

Specific embodiment

In order to improve the timeliness and efficiency of metadata updates, the embodiment of the invention provides a kind of metadata updates sides Method, device, system, electronic equipment and storage medium.

To make the objectives, technical solutions, and advantages of the present invention clearer, make below in conjunction with the attached drawing present invention into one Step ground detailed description, it is clear that described embodiment is only a part of the embodiments of the present invention, rather than whole implementation Example.Based on the embodiments of the present invention, obtained by those of ordinary skill in the art without making creative efforts Every other embodiment, shall fall within the protection scope of the present invention.

Embodiment 1:

Fig. 2 be a kind of schematic diagram of metadata updates process provided in an embodiment of the present invention, the process the following steps are included:

S201: receiving metadata evolution information, wherein after the metadata evolution information includes change type and changes The information of the first metadata after the information of first metadata, the change type and change is side of the production system by bridge joint What formula was got.

Metadata updates method provided in an embodiment of the present invention is applied to the first electronic equipment, first electronic equipment installation There is metadata management system, which can be desktop computer, portable computer, smart phone, plate electricity The electronic equipments such as brain, personal digital assistant (Personal Digital Assistant, PDA), server.

The information of the first metadata after production system gets change type and change by way of bridge joint, can incite somebody to action And the information of the first metadata after change includes first number that the installation of the first electronic equipment is sent in metadata evolution information According to management system.

When production system obtains the information of the first metadata after change type and change by way of bridge joint, it can be It acquires in real time, is also possible to the acquisition periodically carried out every lesser time interval, such as 2 seconds, 1 minute, 10 minutes etc., The lesser time interval is for existing update interval.

The information that production system obtains the first metadata after change type and change by way of bridge joint can be by giving birth to First in production system detects device assembly completion, can then dispose the second explorer group in metadata management system accordingly Part, thus the metadata evolution information that real-time reception production system is sent.

The change type of metadata includes at least: newly-increased metadata, modification metadata and deletion metadata.

It include the information of the first metadata after change type and change in the metadata evolution information that production system is sent.

If production system gets the first metadata after multiple changes, can be in a metadata evolution information The change type of information and corresponding first metadata including the first metadata after a change, more by multiple metadata New information is sent to metadata management system, is also possible in a metadata evolution information include first yuan after multiple changes The change type of the information of data and corresponding each first metadata.

In addition, can also include the identification information of the first metadata in the metadata evolution information that production system is sent；Separately It outside, can also include the corresponding data class of the first metadata in the metadata evolution information in order to keep the information updated more detailed Type, metadata evolution additional information such as change people, change time.

S202: according to the information of the first metadata after change type and change, to first yuan of number of correspondence of itself preservation According to being updated.

When the metadata management system of the first electronic equipment receives metadata evolution information, metadata management system according to The information of the first metadata after change and the change type of the first metadata, the metadata saved to itself are updated.

Meta-data preservation in metadata management system carries out more in Metadata Repository, therefore to the metadata of itself Newly it can be understood as being updated the metadata in Metadata Repository.

When the change type of the first metadata is newly-increased metadata, then after newly increasing change in Metadata Repository The information of first metadata.

When the change type of the first metadata is modification metadata, then corresponding first will saved in Metadata Repository The information of metadata is revised as the information of the first metadata after change.

When the change type of the first metadata is to delete metadata, then corresponding the saved in Metadata Repository is deleted The information of one metadata.If the change type of the first metadata is to delete metadata, the letter of the first metadata after change Breath is sky.

It can be with the incidence relation between Preservation Metadata, then when the change class of the first metadata in metadata management system Can also include the first metadata when type is newly-increased metadata, in metadata evolution information be associated with other metadata System, for metadata management system when saving the first metadata, can also save the first metadata and other metadata is associated with pass System.

It is illustrated below with a specific embodiment, data collector is added to day in the cluster of production system The related data of phase metadata and day metadata, production system are concurrent by the day metadata got by way of bridge joint Metadata management system is given, metadata management system date received metadata is simultaneously updated Metadata Repository, data Treatment people directly according to the updated day metadata of metadata management system, carries out the related data of day metadata clear It washes, Metadata Repository directly stores the data after cleaning, and data analyst is not necessarily to any operation, and metadata can be realized The addition of day metadata in management system.

Production system recognizes the metadata in the presence of change, is obtained by way of bridge joint, and to metadata management system Metadata after being sent to change, metadata management system are updated according to the metadata after the change received, compared to The period for being acquired update when metadata evolution in specific time batch capture more new metadata, the embodiment of the present invention is big It is big to shorten, therefore can carry that millions under big data platform environment are extensive, high performance metadata management, it avoids batch and adopts Processing caused by when collecting more new metadata updates bottleneck, improves availability when metadata acquisition updates.

In embodiments of the present invention, when, there are when metadata evolution, production system is by way of bridge joint in production system The information of the first metadata after obtaining change, is sent to metadata management system, metadata management system saves itself Metadata is updated, without the metadata updated in specific time batch capture, therefore to change in metadata management system Metadata after more is updated the required time and greatly shortens, and participates in without artificial, therefore improve metadata updates Timeliness and efficiency.

Embodiment 2:

It is on the basis of the above embodiments, described in the embodiment of the present invention in order to obtain the information of the metadata after change After receiving metadata evolution information, described according to change type and the information of the first metadata after the change, to from Before the first metadata of correspondence that body saves is updated, the method also includes:

Metadata management system may directly carry first after change after receiving metadata evolution information, in message The information of metadata, it is also possible to carrying be file information, in this document include change after the first metadata information, Therefore in order to get the information of the first metadata after change type and the change, the member is judged in embodiments of the present invention In data modification information whether include file information, if it is determined that in metadata evolution information include file information, then need The information of metadata after first capable of just getting change type and change to document analysis.

After metadata management system receives metadata evolution information, whether first judge in metadata evolution information comprising text The information of part.Documentary format information is pre-saved in metadata management system, then judge in metadata evolution information whether Information comprising file can be, and identify the matched information of format information that whether there is in metadata evolution information with file, If so, determine include in metadata evolution information file information, metadata management system in metadata evolution information to wrapping The file contained is parsed, the information of the first metadata after obtaining change type and change.

If not including the information of file in metadata evolution information, metadata management system can be directly in metadata In modification information change type and get change after the first metadata information.

Metadata management system protects itself according to the information of the first metadata after the change type and change got The metadata deposited is updated.

Since in the embodiment of the present invention, metadata management system is after receiving metadata evolution information, if it is determined that member Include the information of file in data modification information, then file is parsed, to get first number after change type and change According to information.

Embodiment 3:

On the basis of the various embodiments described above, in the embodiment of the present invention, wherein including institute in the metadata evolution information State belonging to the first metadata the information of the first application, it is described parsing is carried out to the file to include:

Queue is parsed by the target to parse the file.

There may be differences for the corresponding data type of the metadata of different application, and the metadata of different types of data exists Data volume, parsing difficulty and other metadata association degree generated when change are different, therefore by applying corresponding parsing team Column parse file, can be further improved metadata updates efficiency, and the metadata of different types of data is changing The response time of Shi Yaoqiu also different from, therefore the response time requirement of different types of data can also be met.

Parsing queue can be to be created in metadata management system initialization, is also possible to create in real time according to demand , parsing queue can be understood as update message queue element, update message queue element can be based on RabbitMQ, The Message Queuing Middlewares such as Kafka are realized.

It is pre-saved in metadata management system using the corresponding relationship with parsing queue, therefore according to metadata evolution The information of first application belonging to the first metadata for including in information can determine that the first corresponding target of application parses team Column.

After determining the first application corresponding target parsing queue, queue is parsed by target, file is parsed.It is logical Crossing the process that target parsing queue parses file can be by target parsing queue, based on the parsing foot pre-saved This parses file, and the process parsed based on parsing script to file belongs to the prior art, in the embodiment of the present invention In do not repeat them here.

When being parsed by target parsing queue to file, it can be and file to be resolved is first saved in target parsing It is parsed again in queue.It parses queue by target to parse file, first after getting change type and changing The information of metadata, the first metadata of correspondence saved to itself are updated, can be by target solution after the completion of determining update The file analysed in queue is deleted.

File is saved in can be in target parsing queue, mesh is added to by the second explorer of metadata management system Mark parsing queue.

Furthermore if parsing queue is to the other information for also getting the first metadata after document analysis, such as affiliated first The information of application, the corresponding data type of metadata, the metadata evolution additional information of the first application such as change people, change time Deng, information such as application ID (Identification, exclusive identification code), the other information of the first application, then metadata management system System is according to the information of the first metadata after change type, change and these other informations being resolved to, pair that save to itself The first metadata is answered to be updated.

The corresponding data type of the first metadata, the data volume for needing to parse, parsing are directed to when parsing queue resolution file Difficulty, association range and the difference of response time are as shown in below table:

As described in above table, when the corresponding data type of the first metadata is DDL (Data Definition Language, data self language), the data such as DML (Data ManipulationL language, data manipulation language) When type, the data volume that this data type generates when the first metadata of resolution file acquisition in three kinds of data types is small, solution It is low to analyse difficulty, association range is small i.e. low with other metadata association degree, it is desirable that the faster response time；When the first metadata is corresponding Data type be ETL operation when, this data type in three kinds of data types resolution file obtain the first metadata when produce Raw data volume is medium, and parsing difficulty is medium, and association range height is i.e. and other metadata associations degree are high, it is desirable that when medium response Between；When the corresponding data type of the first metadata is non-structured document, this data type solves in three kinds of data types The data volume generated when analysing the first metadata of file acquisition is big, and parsing difficulty is high, and association range is medium to close with other metadata Connection degree is medium, it is desirable that the slower response time.

Due to, by being parsed using corresponding parsing queue to file, can be further improved in the embodiment of the present invention Metadata updates efficiency can also meet the response time requirement of different types of data.

Embodiment 4:

On the basis of the various embodiments described above, in the embodiment of the present invention, the method also includes:

Application higher for the requirement of real-time of metadata can subscribe to the first metadata, metadata management system in advance The first metadata after being changed to the application for having subscribed the first metadata, active push, thus real-time and efficiently more Singapore dollar Metadata in data application.

Publishing queue is pre-created in metadata management system, publishing queue can be initial in metadata management system It is created when change, is also possible to create in real time according to demand, publishing queue can be understood as the queue element that gives out information, publication Message queue component can be to be realized based on Message Queuing Middlewares such as RabbitMQ, Kafka.

Metadata management system creates corresponding publishing queue for the first application.Therefore metadata management system can incite somebody to action The first meta-data preservation after change is in the corresponding publishing queue of each application.

If some or certain applications are higher to the requirement of real-time of the first metadata, this or these application can be ordered The first metadata is read, metadata management system saves subscription information, wherein in subscription information includes which which application has subscribed Metadata.When the first metadata is changed, metadata management system is directed in subscription information and has subscribed the first metadata The first metadata after change is sent to the application using corresponding publishing queue by this by each application.It is incited somebody to action when in determination After the first metadata after change has been sent to the application, then at this using first after deleting change in corresponding publishing queue Metadata.

Furthermore if parsing queue is to the other information for also getting the first metadata after document analysis, such as metadata ID, metadata evolution additional information such as change people, change time other information.Then metadata management system is by having subscribed this First metadata using corresponding publishing queue, by the change type of the first metadata information, the first metadata after change And these other informations are sent to the application for having subscribed first metadata.

Corresponding publishing queue is created for each application, multiple applications can also be avoided while accessing the same publication team The problems such as column cause resource to seize, performance declines.

It certainly, in practical applications,, can in order to save memory headroom if the metadata needs of certain applications are less Think these application one publishing queues of creation, by a publishing queue, sends updated metadata to these applications.

The various embodiments described above are illustrated with a metadata acquisition renewal process shown in Fig. 3 below, user's operation The database of production system, for two tables of data are processed into the script that one is summarized data such as execution, which includes 3 altogether SQL statement, 4 metadata evolutions, then the first explorer of production system gets 3 SQL statements by way of bridge joint Corresponding modification information, respectively import (importing) modification information, create_table (building table) modification information, insert_ Into (insertion) modification information, these modification informations are successively packaged, are transmitted to the second of metadata management system These modification informations are sent to parsing queue by explorer, the second explorer, and dissection process is passed through in parsing queue, in these changes Identify that 4 metadata have change, including change metadata 1, change metadata 2, change metadata 3 and change member in information Data 4, wherein change metadata 1, change metadata 2, change metadata 3 and change metadata 4 are the metadata after change, And according to each change metadata and change type after change, the correspondence metadata of itself preservation is updated.And it will Metadata after this 4 changes pushes to publishing queue, as metadata has subscribed change metadata 1 and change metadata using 1 3, metadata has subscribed change metadata 2 and change metadata 4 using 2, then will change metadata 1 and change by publishing queue Metadata 3 is sent to metadata using 1, will change metadata 2 by publishing queue and change metadata 4 is sent to metadata and answers With 2.

Since the first metadata is subscribed in the higher application of the requirement of real-time in the embodiment of the present invention for metadata in advance, Metadata management system is to the application for having subscribed first metadata, metadata after active push change, thus real-time high-efficiency Metadata in the application of ground more new metadata.

Embodiment 5:

Receive the data acquisition request that the second application is sent；

Corresponding publishing queue is applied by described second, first number after changing in the publishing queue that the third is applied It is applied according to being sent to described second.

When using needing to obtain metadata, data acquisition request can be sent, metadata management system passes through application and corresponds to Publishing queue, send the metadata after change.

There is corresponding publishing queue using creation for second in metadata management system, therefore metadata management system exists It, can be by the meta-data preservation after change in the publishing queue of the second application after metadata after getting change.

If the second application is not high to the requirement of real-time of metadata, the second application is without subscribing to metadata.When second When using there is the demand for obtaining metadata, data acquisition request is sent to metadata management system.Because of metadata management system Creation has the publishing queue for the second application in system, then metadata management system can also pass through the publishing queue of the second application Receive the data acquisition request that the second application is sent.

Metadata management system applies corresponding publishing queue by second, after changing in the publishing queue of the second application Metadata be sent to the second application.Metadata after determining change has been sent to second application, then second answers at this With the metadata after deletion change in corresponding publishing queue.

In the embodiment of the present invention, when using obtaining metadata, data acquisition request can be sent, metadata management system is logical Cross the metadata updates for sending and realizing the metadata after change in metadata application using corresponding publishing queue.

Embodiment 6:

If so, deleting second metadata.

The second metadata that the duration saved in each publishing queue is greater than duration threshold value is deleted, memory money can be saved Source.

Duration threshold value is pre-stored in the first electronic equipment, and duration threshold value can be 6 hours, 1 day or 7 days etc..

After metadata after by publishing queue by change is sent to corresponding application, metadata management system can will be sent out Metadata after the change saved in cloth queue is deleted, to save memory source.And after the change for not sent Metadata, can still be stored in the publishing queue of application, if these change after metadata quantity it is very big, can disappear Consume a large amount of memory source of equipment.

After meta-data preservation after each change is into the publishing queue of application, metadata management system will record these yuan The preservation duration of data.The duration threshold value that meta-data preservation duration is preserved in metadata management system, for different data class The metadata of type, duration threshold value can be identical, can be different.It, can when the duration of the second meta-data preservation is greater than duration threshold value To think to there is the demand obtained to second metadata currently without application, therefore in order to save memory source, can will send out The second metadata that the duration saved in cloth queue is greater than duration threshold value is deleted.

Since the duration saved in each publishing queue to be greater than to the second metadata of duration threshold value in the embodiment of the present invention It deletes, memory source can be saved.

Embodiment 7:

Fig. 4 be a kind of metadata updates process schematic provided in an embodiment of the present invention, the process the following steps are included:

S401: the information of the first metadata after change type and acquisition are changed by way of bridge joint.

Metadata updates method provided in an embodiment of the present invention is applied to the second electronic equipment, second electronic equipment installation There is production system, which can be desktop computer, portable computer, smart phone, tablet computer, individual The electronic equipments such as digital assistants (Personal Digital Assistant, PDA), server.

Production system include conventional database systems, MPP (Massively Parallel Processing, on a large scale simultaneously Row processing) system, ETL operation, HDFS (Hadoop Distributed File System, Hadoop distributed field system System), Hbase (Hadoop Database, Hadoop database), Hive (Hadoop data warehouse master tool) system, Storm (big data frame) system, Sqoop (tool that data are transmitted between database) system etc..

Production system can get the information of the first metadata after change type and change by way of bridge joint, raw When production system obtains the information of the first metadata after change type and change by way of bridge joint, real-time acquisition can be , it is also possible to the acquisition periodically carried out every lesser time interval, such as 2 seconds, 1 minute, 10 minutes etc., this was lesser Time interval is for existing update interval.

Production system, can be with when obtaining the information of the first metadata after change type and change by way of bridge joint Device assembly is detected by first in production system to complete.

S402: being sent to metadata management system for the metadata evolution information of generation, wherein the metadata evolution is believed Include the information of the first metadata after the change type and change in breath, the metadata management system is made to receive metadata Modification information saves the metadata management system according to the information of the first metadata after the change type and change The first metadata of correspondence be updated.

Production system generates metadata evolution information according to the information of the first metadata after change type and change.

It include the information of the first metadata after change type and change in the metadata evolution information of generation.

In addition, can also include the identification information of the first metadata in metadata evolution information；In addition, in order to make update Information is more detailed, can also be attached including the corresponding data type of the first metadata, metadata evolution in the metadata evolution information Information is added such as to change people, change time.

If first in production system detects the information for the first metadata that device assembly obtains after change type and change, It is corresponding then second can be disposed in metadata management system and detect device assembly, thus the member that real-time reception production system is sent Data modification information.

Metadata management system receives metadata evolution information, according to the letter of the first metadata after change type and change Breath, the first metadata of correspondence saved to metadata management system itself are updated.

It is illustrated by a specific example below, as shown in figure 5, production system includes traditional database, MPP frame Structure, ETL file, HDFS, Hbase, Hive, Storm, Sqoop etc., when the first explorer in production system passes through the side of bridge joint Formula has captured metadata evolution order, and the first metadata of change has been got in metadata evolution order, generates packet The metadata evolution information of the information of the first metadata after including change type and change, is sent to member for metadata evolution information Metadata evolution information is sent to parsing queue and carried out at parsing by the second explorer in data management system, the second explorer Reason association, the metadata that metadata management system saves itself are updated, by the first meta-data preservation after change to hair In cloth queue, for the metadata application for having subscribed the first metadata, apply the corresponding queue that gives out information will by metadata The first metadata after change is pushed to metadata application, and metadata is applied including information browse application, consanguinity analysis application, number According to quality application, asset views application, data safety application.Because the first explorer obtains the first metadata of change in real time, Therefore metadata management system can in real time be updated the first metadata after change.

Embodiment 8:

On the basis of the above embodiments, in the embodiment of the present invention, it is described obtained by way of bridge joint change type and The information of the first metadata after change comprises at least one of the following:

The configuration file for obtaining the database of production system judges in the configuration file with the presence or absence of for described first The metadata evolution of metadata；If so, obtaining the change type in the configuration file and the first metadata after change Information.

Production system can obtain the first metadata after change type and change by way of at least one bridge joint Information.

The first, order intercept: when user directly operates the database of production system, the finger of operating database can be generated It enables, after production system is truncated to instruction, judges whether the instruction is the instruction for carrying out metadata evolution, if it is, thinking this Instruction can generate metadata evolution, then the information of the first metadata after obtaining the change type carried in the instruction and change, If it is not, then thinking that the instruction will not generate metadata evolution, then the instruction is not processed, because production system can be to operation Every instruction of database is intercepted, therefore which real-time highest.

The language for intercepting order is the Data Definition Language DDL and production system of the database application based on production system The data manipulation language DML of database application etc., wherein DDL includes create table, alter table, drop Table etc., DML include load, import, insert into etc..It is NoSQL data which, which is primarily adapted for use in production system, Library, and in each component of Hadoop platform it is online it is extemporaneous inquiry such as Spark, Strom.

Order, which intercepts, mainly to be implemented in client level, and client includes order line (CLI), command interaction interface etc., when After user logs in the client of production system, the explorer of production system is activated, and when user's operation client, operates client The instruction at end can be intercepted immediately.

Second, log parses: can not carry out order interception for the Database Systems of some production systems, can pass through The execution journal of the database of production system is parsed to determine whether there is the metadata of change, is specifically judged in execution journal With the presence or absence of the metadata evolution for being directed to metadata；If it is, after obtaining change type and the change in the execution journal The information of first metadata, if it is not, then being not processed to the execution journal.

It is traditional Relational DataBase, MPP database and timing operation that this kind of mode, which is primarily adapted for use in production system, Batch jobs, such as ETL operation, MapReduce script.According to the position that log is stored, log is parsed in client tier or clothes Business device layer can be implemented.The case where being ETL, MapReduce script for production system, since service logic is complicated, generation Log amount is huge, the reducible specification for determining journal format, such as increases tagged mode and carry out preliminary filtering to log, reduces number While according to amount, journal format is also unified.Since the generation of log has certain regularity, can be wanted according to timeliness Ask configuration to the acquisition frequency of journal file, timeliness requires its acquisition frequency of higher content also higher, to reduce because of log Scanning causes to waste to goal systems resource.

In addition, carry out log parsing when, it is simple for logic, generate log amount it is less can be configured to production be System end is parsed, and specifically can directly be parsed by explorer at production system end；, generation day complicated for processing logic Will amount is biggish, can take log is sent to metadata management system parses, and further mitigates the pressure of production system.

The third, file synchronization: this kind of mode can choose to semi-structured data and unstructured data, obtain production The configuration file of the database of system, the content for parsing configuration file obtain the metadata of change, judge in configuration file whether In the presence of the metadata evolution for being directed to metadata, if so, obtaining the change type in the configuration file and first yuan after change The information of data is if not processed the configuration file.

It is primarily adapted for use in the unstructured datas such as the semi-structured data such as word, excel and crawler, file stream.Such as The index specification that business department regularly publishes illustrates document.Implementation strategy under such mode include: for timeliness require compared with High situation can carry out file synchronization by the open interface proactive notification explorer of explorer by production system and operate；For Timeliness requires lower situation, and configurable explorer periodically carries out directory scan, such as run-down per hour.

Since in the embodiment of the present invention, production system obtains first yuan of number after change by way of at least one bridge joint According to information and the first metadata change type, be sent to metadata management system, metadata management system saves itself Metadata be updated, without the metadata updated in specific time batch capture, therefore right in metadata management system Metadata after change is updated the required time and greatly shortens, and participates in without artificial, therefore improve metadata updates Timeliness and efficiency.

Embodiment 9:

Fig. 6 is a kind of metadata acquisition more new system that the embodiment of the present invention 9 provides, the metadata updates system packet It includes: applied to the first electronic equipment 61 for being equipped with metadata management system, and applied to the second electricity for being equipped with production system Sub- equipment 62.

In order to improve the timeliness and efficiency of metadata updates, the embodiment of the invention provides a kind of metadata updates sides Method system, the metadata updates system include the first electronic equipment for being equipped with metadata management system, and are equipped with production system Second electronic equipment of system.

Second electronic equipment, the letter for the first metadata after obtaining change type by way of bridge joint and changing Breath；The metadata evolution information of generation is sent to the metadata management system in the first electronic equipment, wherein the metadata It include the information of the first metadata after the change type and change in modification information.

First electronic equipment, for receiving metadata evolution information, according to first yuan after the change type and change The information of data, the first metadata of correspondence saved to itself are updated.

First electronic equipment, after being also used to the reception metadata evolution information, described according to the change class The information of the first metadata after type and change, before being updated to the first metadata of correspondence itself saved, when the member It include the information of file in data modification information, and the information of the first metadata after the change type and change is included in institute When stating in the information of file, the file is parsed, the information of the first metadata after obtaining change type and change.

First electronic equipment is determined specifically for the corresponding relationship according to the application pre-saved and parsing queue The corresponding target of first application parses queue；Queue is parsed by the target to parse the file.

First electronic equipment is also used to create the first meta-data preservation after the change for each application Publishing queue in；For each application, judge whether the application has subscribed first metadata；If so, being answered by this With corresponding publishing queue by the first metadata after the change, it is sent to the application, and apply corresponding publication team at this The first metadata after deleting the change in column.

First electronic equipment is also used to receive the data acquisition request that the second application is sent；It is answered by described second With corresponding publishing queue, the metadata after changing in publishing queue that described second applies is sent to second application.

First electronic equipment, is also used in each publishing queue, judge the second meta-data preservation duration whether Greater than the duration threshold value of setting；If so, deleting second metadata.

Second electronic equipment, specifically for the first metadata after obtaining change type by way of bridge joint and changing Information comprises at least one of the following: the instruction that the database of intercept operation production system generates；Judge described instruction whether be into The instruction of row metadata evolution；If so, obtaining the first metadata after the change type carried in described instruction and change Information；The execution journal for parsing the database of production system judges in the execution journal with the presence or absence of the member for metadata Data change；If so, obtaining the information of the change type in the execution journal and the first metadata after change；And acquisition The configuration file of the database of production system judges in the configuration file with the presence or absence of the metadata evolution for metadata； If so, obtaining the information of the change type in the configuration file and the first metadata after change.

In embodiments of the present invention, when there are when metadata evolution, produce to be in the production system in the second electronic equipment System obtains the information of the first metadata after change, the metadata management being sent in the first electronic equipment by way of bridge joint System, the metadata that metadata management system saves itself are updated, without what is updated in specific time batch capture Metadata, therefore in metadata management system is updated to the metadata after change the required time and greatly shortened, without It is artificial to participate in, therefore improve the timeliness and efficiency of metadata updates.

Embodiment 10:

On the basis of the various embodiments described above, the embodiment of the invention also provides a kind of electronic equipment, as shown in fig. 7, packet It includes: processor 701, memory 702 and transceiver 703；

The processor 701 executes following process: controlling the transmitting-receiving for executing the program read in memory 702 Machine 703 receives metadata evolution information, wherein the metadata evolution information includes first yuan of number after change type and change According to information, the change type and change after the first metadata information be production system got by way of bridge joint 's；According to the information of the first metadata after the change type and change, the first metadata of correspondence itself saved is carried out It updates.

Based on the same inventive concept, a kind of electronic equipment is additionally provided in the embodiment of the present invention, due to above-mentioned electronic equipment The principle solved the problems, such as is similar to metadata updates method, therefore the implementation of above-mentioned electronic equipment may refer to the implementation of method, Overlaps will not be repeated.

In Fig. 7, bus architecture may include the bus and bridge of any number of interconnection, specifically be represented by processor 701 One or more processors and the various circuits of memory that represent of memory 702 link together.Bus architecture can be with Various other circuits of such as peripheral equipment, voltage-stablizer and management circuit or the like are linked together, these are all these Well known to field, therefore, it will not be further described herein.Transceiver 703 can be multiple element, that is, include hair Machine and receiver are sent, the unit for communicating over a transmission medium with various other devices is provided.It is total that processor 701 is responsible for management Line architecture and common processing, memory 702 can store the used data when executing operation of processor 701.

Optionally, processor 701 can be CPU (centre buries device), ASIC (Application Specific Integrated Circuit, specific integrated circuit), (Field-Programmable Gate Array, scene can compile FPGA Journey gate array) or CPLD (Complex Programmable Logic Device, Complex Programmable Logic Devices).

The processor 701, after being also used to the reception metadata evolution information, it is described according to the change type and The information of the first metadata after change, before being updated to the first metadata of correspondence itself saved, when the metadata It include the information of file in modification information, and the information of the first metadata after the change type and change is included in the text When in the information of part, the file is parsed, the information of the first metadata after obtaining change type and change.

The processor 701, described in determining according to the application pre-saved and the corresponding relationship for parsing queue The first corresponding target of application parses queue；Queue is parsed by the target to parse the file.

The processor 701 is also used to the first meta-data preservation after the change for each application creation In publishing queue；For each application, judge whether the application has subscribed first metadata；If so, passing through the application The first metadata after the change is sent to the application by corresponding publishing queue, and applies corresponding publishing queue at this Middle the first metadata deleted after the change.

The processor 701 is also used to receive the data acquisition request that the second application is sent；Pass through second application pair Metadata after changing in publishing queue that described second applies is sent to second application by the publishing queue answered.

The processor 701, is also used in each publishing queue, judges whether the duration of the second meta-data preservation is greater than The duration threshold value of setting；If so, deleting second metadata.

In embodiments of the present invention, when, there are when metadata evolution, production system is by way of bridge joint in production system The information of the first metadata after obtaining change is sent to metadata management system, is stored on processor execution memory When program, realize that the metadata saved to itself is updated, without the metadata updated in specific time batch capture, because The required time is updated to the metadata after change in this metadata management system to greatly shorten, and is participated in without artificial, Therefore the timeliness and efficiency of metadata updates are improved.

Embodiment 11:

On the basis of the various embodiments described above, the embodiment of the invention also provides a kind of electronic equipment, as shown in figure 8, packet It includes: processor 801, memory 802 and transceiver 803；

The processor 801 executes following process: by the side of bridge joint for executing the program read in memory 802 Formula obtains the information of the first metadata after change type and change；The transceiver 803 is controlled by the metadata evolution of generation Information is sent to metadata management system, wherein including the after the change type and change in the metadata evolution information The information of one metadata makes the metadata management system receive metadata evolution information, according to the change type and change The information of the first metadata afterwards, the first metadata of correspondence saved to the metadata management system are updated.

In fig. 8, bus architecture may include the bus and bridge of any number of interconnection, specifically be represented by processor 801 One or more processors and the various circuits of memory that represent of memory 802 link together.Bus architecture can be with Various other circuits of such as peripheral equipment, voltage-stablizer and management circuit or the like are linked together, these are all these Well known to field, therefore, it will not be further described herein.Transceiver 803 can be multiple element, that is, include hair Machine and receiver are sent, the unit for communicating over a transmission medium with various other devices is provided.It is total that processor 801 is responsible for management Line architecture and common processing, memory 802 can store the used data when executing operation of processor 801.

Optionally, processor 801 can be CPU (centre buries device), ASIC (Application Specific Integrated Circuit, specific integrated circuit), (Field-Programmable Gate Array, scene can compile FPGA Journey gate array) or CPLD (Complex Programmable Logic Device, Complex Programmable Logic Devices).

The processor 801, specifically for the first metadata after obtaining change type by way of bridge joint and changing Information comprise at least one of the following: the instruction that the database of intercept operation production system generates；Judge described instruction whether be Carry out the instruction of metadata evolution；If so, obtaining the first metadata after the change type carried in described instruction and change Information；The execution journal for parsing the database of production system judges in the execution journal with the presence or absence of for metadata Metadata evolution；If so, obtaining the information of the change type in the execution journal and the first metadata after change；With obtain The configuration file for taking the database of production system judges to become in the configuration file with the presence or absence of the metadata for metadata More；If so, obtaining the information of the change type in the configuration file and the first metadata after change.

Embodiment 12:

On the basis of the various embodiments described above, the embodiment of the invention also provides a kind of electronic equipment, as shown in figure 9, packet It includes: processor 901, communication interface 902, memory 903 and communication bus 904, wherein processor 901, communication interface 902 are deposited Reservoir 903 completes mutual communication by communication bus 904；

It is stored with computer program in the memory 903, when described program is executed by the processor 901, so that The processor 901 executes following steps:

Electronic equipment provided in an embodiment of the present invention can be desktop computer, portable computer, smart phone, plate The electronic equipments such as computer, personal digital assistant (Personal Digital Assistant, PDA), server.

The communication bus that above-mentioned electronic equipment is mentioned can be Peripheral Component Interconnect standard (Peripheral Component Interconnect, PCI) bus or expanding the industrial standard structure (Extended Industry Standard Architecture, EISA) bus etc..The communication bus can be divided into address bus, data/address bus, control bus etc..For just It is only indicated with a thick line in expression, figure, it is not intended that an only bus or a type of bus.

Communication interface 902 is for the communication between above-mentioned electronic equipment and other equipment.

Memory may include random access memory (Random Access Memory, RAM), also may include non-easy The property lost memory (Non-Volatile Memory, NVM), for example, at least a magnetic disk storage.Optionally, memory may be used also To be storage device that at least one is located remotely from aforementioned processor.

Above-mentioned processor can be general processor, including central processing unit, network processing unit (Network Processor, NP) etc.；It can also be digital signal processor (Digital Signal Processing, DSP), dedicated collection At circuit, field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hard Part component etc..

Embodiment 13:

On the basis of the various embodiments described above, the embodiment of the invention also provides a kind of electronic equipment, as shown in Figure 10, packet It includes: processor 1001, communication interface 1002, memory 1003 and communication bus 1004, wherein processor 1001, communication interface 1002, memory 1003 completes mutual communication by communication bus 1004；

It is stored with computer program in the memory 1003, when described program is executed by the processor 1001, is made It obtains the processor 1001 and executes following steps:

Communication interface 1002 is for the communication between above-mentioned electronic equipment and other equipment.

Figure 11 is a kind of metadata updates schematic device provided in an embodiment of the present invention, applied to being equipped with metadata pipe First electronic equipment of reason system, the device include:

Receiving module 1101, for receiving metadata evolution information, wherein the metadata evolution information includes change class The information of the first metadata after the information of the first metadata after type and change, the change type and change is production system It is got by way of bridge joint；

Update module 1102 protects itself for the information according to the first metadata after the change type and change The first metadata of correspondence deposited is updated.

Described device further include:

In a kind of metadata updates method, apparatus provided by the invention, system, electronic equipment and storage medium, work as production There are when metadata evolution in system, production system obtains the information of the first metadata after change, hair by way of bridge joint Metadata management system is given, the metadata that metadata management system saves itself is updated, without in the specific time The metadata that batch capture updates, therefore it is big to be updated the required time to the metadata after change in metadata management system It is big to shorten, it is participated in without artificial, therefore improve the timeliness and efficiency of metadata updates.

Figure 12 is a kind of metadata updates schematic device provided in an embodiment of the present invention, applied to being equipped with production system The second electronic equipment, which includes:

Module 1201 is obtained, the letter for the first metadata after obtaining change type by way of bridge joint and changing Breath；

Sending module 1202, for the metadata evolution information of generation to be sent to metadata management system, wherein described Include the information of the first metadata after the change type and change in metadata evolution information, makes the metadata management system System receives metadata evolution information, according to the information of the first metadata after the change type and change, to the metadata The first metadata of correspondence that management system saves is updated.

For systems/devices embodiment, since it is substantially similar to the method embodiment, so the comparison of description is simple Single, the relevent part can refer to the partial explaination of embodiments of method.

It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more, The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces The form of product.

The application is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates, Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or The function of being specified in multiple boxes.

These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one The step of function of being specified in a box or multiple boxes.

Although the preferred embodiment of the application has been described, it is created once a person skilled in the art knows basic Property concept, then additional changes and modifications can be made to these embodiments.So it includes excellent that the following claims are intended to be interpreted as It selects embodiment and falls into all change and modification of the application range.

Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies Within, then the present invention is also intended to include these modifications and variations.

Claims

1. a kind of metadata updates method, which is characterized in that applied to the first electronic equipment for being equipped with metadata management system, This method comprises:

Metadata evolution information is received, wherein the metadata evolution information includes the first metadata after change type and change Information, the change type and change after the first metadata information be production system got by way of bridge joint 's；

According to the information of the first metadata after the change type and change, the first metadata of correspondence itself saved is carried out It updates.

2. the method as described in claim 1, which is characterized in that after the reception metadata evolution information, described according to institute The information of the first metadata after stating change type and change, before being updated to the first metadata of correspondence itself saved, The method also includes:

When the information in the metadata evolution information including file, and the first metadata after the change type and change When information includes in the information of the file, the file is parsed, first yuan after obtaining change type and changing The information of data.

3. method according to claim 2, which is characterized in that wherein include described first yuan in the metadata evolution information Belonging to data first application information, it is described to the file carry out parsing include:

According to the corresponding relationship of the application pre-saved and parsing queue, determine that the corresponding target of first application parses team Column；

Queue is parsed by the target to parse the file.

4. method according to claim 1 or 2, which is characterized in that the method also includes:

For each application, judge whether the application has subscribed first metadata；If so, applying corresponding hair by this The first metadata after the change is sent to the application by cloth queue, and this using deleting institute in corresponding publishing queue The first metadata after stating change.

5. method as claimed in claim 4, which is characterized in that the method also includes:

Receive the data acquisition request that the second application is sent；

Corresponding publishing queue is applied by described second, the metadata hair after changing in the publishing queue that described second is applied Give second application.

6. method as claimed in claim 4, which is characterized in that the method also includes:

If so, deleting second metadata.

7. a kind of metadata updates method, which is characterized in that applied to the second electronic equipment for being equipped with production system, this method Include:

The metadata evolution information of generation is sent to metadata management system, wherein including institute in the metadata evolution information The information of the first metadata after stating change type and change, makes the metadata management system receive metadata evolution information, According to the information of the first metadata after the change type and change, the correspondence first that the metadata management system is saved Metadata is updated.

8. the method for claim 7, which is characterized in that it is described obtained by way of bridge joint change type and change after The information of the first metadata comprise at least one of the following:

The instruction that the database of intercept operation production system generates；Judge whether described instruction is the finger for carrying out metadata evolution It enables；If so, obtaining the information of the first metadata after the change type carried in described instruction and change；

The execution journal for parsing the database of production system judges in the execution journal with the presence or absence of first number for metadata According to change；If so, obtaining the information of the change type in the execution journal and the first metadata after change；With

The configuration file for obtaining the database of production system judges in the configuration file with the presence or absence of first number for metadata According to change；If so, obtaining the information of the change type in the configuration file and the first metadata after change.

9. a kind of metadata updates device, which is characterized in that applied to the first electronic equipment for being equipped with metadata management system, The device includes:

Receiving module, for receiving metadata evolution information, wherein the metadata evolution information includes change type and change The information of the first metadata after the information of the first metadata afterwards, the change type and change is that production system passes through bridge joint Mode get；

Update module, for the information according to the first metadata after the change type and change, to the correspondence of itself preservation First metadata is updated.

10. a kind of metadata updates device, which is characterized in that applied to the second electronic equipment for being equipped with production system, the dress It sets and includes:

Sending module, for the metadata evolution information of generation to be sent to metadata management system, wherein the metadata becomes Include the information of the first metadata after the change type and change in more information, the metadata management system is made to receive member Data modification information, according to the information of the first metadata after the change type and change, to the metadata management system The first metadata of correspondence of preservation is updated.

11. a kind of electronic equipment characterized by comprising memory, processor and transceiver；

The processor executes following process: controlling the transceiver member number for reading the program in the memory According to modification information, wherein the metadata evolution information includes the information of the first metadata after change type and change, it is described The information of the first metadata after change type and change is what production system was got by way of bridge joint；According to the change The information of the first metadata after more type and change, the first metadata of correspondence saved to itself are updated.

12. electronic equipment as claimed in claim 11, which is characterized in that the processor is also used to the reception metadata After modification information, in the information according to the first metadata after the change type and change, the correspondence saved to itself Before first metadata is updated, when in the metadata evolution information include file information, and the change type and When the information of the first metadata after change includes in the information of the file, the file is parsed, obtains change The information of the first metadata after type and change.

13. electronic equipment as claimed in claim 12, which is characterized in that the processor is specifically used for the metadata and becomes Information comprising the first application belonging to first metadata in more information, according to the application pre-saved and parsing queue Corresponding relationship determines that the corresponding target of first application parses queue；By the target parse queue to the file into Row parsing.

14. the electronic equipment as described in claim 11 or 12, which is characterized in that the processor is also used to the change The first meta-data preservation afterwards is in the publishing queue for each application creation；For each application, whether the application is judged Have subscribed first metadata；Apply corresponding publishing queue by the change by this if so, controlling the transceiver The first metadata afterwards, is sent to the application, and this using first yuan after deleting the change in corresponding publishing queue Data.

15. electronic equipment as claimed in claim 14, which is characterized in that the processor is also used to control the transceiver Receive the data acquisition request that the second application is sent；Corresponding publishing queue is applied by described second, described second is applied Publishing queue in change after metadata be sent to it is described second application.

16. electronic equipment as claimed in claim 14, which is characterized in that the processor is also used in each publishing queue In, judge whether the duration of the second meta-data preservation is greater than the duration threshold value of setting；If so, deleting second metadata.

17. a kind of electronic equipment characterized by comprising memory, processor and transceiver；

The processor executes following process: obtaining change by way of bridge joint for reading the program in the memory The information of the first metadata after type and change；The metadata evolution information of generation is sent to metadata management system, Described in include in metadata evolution information the first metadata after the change type and change information, make the metadata Management system receives metadata evolution information, according to the information of the first metadata after the change type and change, to described The first metadata of correspondence that metadata management system saves is updated.

18. electronic equipment as claimed in claim 17, which is characterized in that the processor, specifically for the side by bridge joint The information that formula obtains the first metadata after change type and change comprises at least one of the following: the number of intercept operation production system The instruction generated according to library；Judge whether described instruction is the instruction for carrying out metadata evolution；It is taken in described instruction if so, obtaining The information of the change type of band and the first metadata after change；The execution journal for parsing the database of production system, judges institute It states in execution journal with the presence or absence of the metadata evolution for metadata；If so, obtaining the change class in the execution journal The information of the first metadata after type and change；With the configuration file for the database for obtaining production system, the configuration text is judged With the presence or absence of the metadata evolution for metadata in part；If so, obtaining the change type in the configuration file and change The information of the first metadata afterwards.

19. a kind of electronic equipment characterized by comprising processor, communication interface, memory and communication bus, wherein place Device, communication interface are managed, memory completes mutual communication by communication bus；

It is stored with computer program in the memory, when described program is executed by the processor, so that the processor Perform claim requires the step of 1~6 any claim the method.

20. a kind of electronic equipment characterized by comprising processor, communication interface, memory and communication bus, wherein place Device, communication interface are managed, memory completes mutual communication by communication bus；

It is stored with computer program in the memory, when described program is executed by the processor, so that the processor Perform claim requires the step of 7~8 any claim the method.

21. a kind of computer readable storage medium, which is characterized in that it is stored with the computer journey that can be executed by electronic equipment Sequence, when described program is run on the electronic equipment, so that electronic equipment perform claim requirement 1~6 is any described The step of method.

22. a kind of computer readable storage medium, which is characterized in that it is stored with the computer journey that can be executed by electronic equipment Sequence, when described program is run on the electronic equipment, so that electronic equipment perform claim requirement 7~8 is any described The step of method.

23. a kind of metadata updates system, which is characterized in that the metadata updates system includes: that claim 11-16 such as appoints It is applied to that the first electronic equipment of metadata management system is installed described in one, and as described in claim 17-18 is any Applied to the second electronic equipment for being equipped with production system.