CN104809597B - Data resource management platform based on data fusion - Google Patents
Data resource management platform based on data fusion Download PDFInfo
- Publication number
- CN104809597B CN104809597B CN201510245576.9A CN201510245576A CN104809597B CN 104809597 B CN104809597 B CN 104809597B CN 201510245576 A CN201510245576 A CN 201510245576A CN 104809597 B CN104809597 B CN 104809597B
- Authority
- CN
- China
- Prior art keywords
- data
- unit
- data resource
- interface
- resource
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000004927 fusion Effects 0.000 title claims abstract description 19
- 238000012423 maintenance Methods 0.000 claims abstract description 53
- 238000007726 management method Methods 0.000 claims description 88
- 238000012986 modification Methods 0.000 claims description 53
- 230000004048 modification Effects 0.000 claims description 53
- 230000008859 change Effects 0.000 claims description 31
- 238000005516 engineering process Methods 0.000 claims description 14
- 238000004458 analytical method Methods 0.000 claims description 13
- 238000013523 data management Methods 0.000 claims description 8
- 239000008280 blood Substances 0.000 claims description 7
- 210000004369 blood Anatomy 0.000 claims description 7
- 238000013507 mapping Methods 0.000 claims description 6
- 239000002775 capsule Substances 0.000 claims description 4
- 238000013499 data model Methods 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 4
- 241001074085 Scophthalmus aquosus Species 0.000 claims description 3
- 230000000052 comparative effect Effects 0.000 claims description 3
- 230000000737 periodic effect Effects 0.000 claims description 3
- 230000002093 peripheral effect Effects 0.000 claims description 2
- 238000012217 deletion Methods 0.000 description 16
- 230000037430 deletion Effects 0.000 description 16
- 238000012790 confirmation Methods 0.000 description 10
- 238000004321 preservation Methods 0.000 description 7
- 230000009471 action Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 3
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000008676 import Effects 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000000034 method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000739 chaotic effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Data resource management platform based on data fusion includes data resource management platform front and back end, data resource management platform database, each operation system data resource of four large data center data resources and Utilities Electric Co.;With the connection of the Utilities Electric Co. each operation system;The data resource management platform database includes each operation system data resource of four large data center data resources and Utilities Electric Co. combed;Data resource management platform front and back end includes data resource views module, data resource application module, data resource maintenance module, data resource acquisition module, data center's demand management module, online data resource O&M module and data-interface configuration and management module.The present invention realizes to be managed collectively to the data of each operation system, is realized effective management and comprehensive utilization to Enterprise Data resource, is allowed data straight tube to show in front of the user, makes data message simpler understandable.
Description
Technical field
The present invention relates to a kind of business data resource management system, specifically a kind of data money based on data fusion
Source capsule platform.
Background technology
With the propulsion that informatization works, Shandong company has built up structuring data center, unstructured number in succession
According to management platform, magnanimity history/near-realtime data management platform and power grid GIS data platform (hereinafter referred to as " in four class data
The heart "), and provide the data, services such as corresponding shared exchange, analysis displaying for operation system.
Since SG186 engineerings, SG-ERP are built, build more than 100 and covered operation system, formd a large amount of, complicated
Data resource, and at present in terms of Enterprise Data resource management, do not form unified data resource management mechanism, technology branch
Support means are on the weak side, each data resource relative distribution, and user tends not to intuitively see the information that data are reflected, therefore company
There is an urgent need to study the Enterprise Data resource management mechanism that a whole set of is suitable for grid company business characteristic, realize to enterprise-level
The effective management and comprehensive utilization of data resource, each layer personnel of company are allowed to fill it can be seen that data, understand data, using data
Divide mining data value.
Currently, strong intelligent grid and SG-ERP engineerings are built under the new situation in Shandong company, in order to preferably support
Three five big System Constructions of collection, the integrated information platform of longitudinally through horizontal integrating is constructed, covering corporate HQ has been built up, has saved
City, the operating information system of districts and cities, generate a large amount of diversified data.How to realize and Enterprise Data resource is carried out effectively
Unified management and application, promote the operating efficiency of company, be at this stage and the following huge challenge that need to be faced.
The content of the invention
To solve each operation system relative distribution of current power system, ununified data resource management, it is impossible to real
Now to the effective management and comprehensive utilization of Enterprise Data resource, each layer personnel of company can not be allowed intuitively to see data, understand
The problem of data and use data, each operation system is implement resource integration it is an object of the invention to provide one kind, each industry
The related data set of business system is to the data resource pipe based on data fusion in a management platform, being managed collectively and utilizing
Platform.
To solve the above problems, the data resource management platform provided by the invention based on data fusion includes:Data provide
Source capsule platform front and back end, data resource management platform database, each operation system data resource of Utilities Electric Co. and structuring
Data center, unstructured data management platform, magnanimity history/near-realtime data management platform and power grid GIS data platform four
The data resource of class data center;
The data resource management platform possesses the user name password and correlative weight of each operation system database of Utilities Electric Co.
Limit, and included by hand by system interface and the connection of each operation system of the Utilities Electric Co., the system interface
Recording module and interface input module;
The data resource management platform database includes the data resource of the four classes data center combed,
And each operation system data resource of the Utilities Electric Co. by combing, and carry out regular or renewal manually;
The data resource management platform front and back end is arranged the data of the data resource management platform database
And displaying, it includes:
Data resource views module, it includes data resource statistical views unit, application domain view unit and SG-CIM and regarded
Figure unit, the data resource statistical views unit is used for display data resource overall distribution situation and variation tendency, and can look into
Company data general status and each business grouped data resource growth trend are seen, the application domain view unit is used to intuitively show
Relation between application system, and the model and integrated interface information of a certain system can be checked, the SG-CIM view units are used to open up
Show two level subject area;
Data resource application module, it includes distortion analytic unit, blood relationship management/impact analysis unit, version
Administrative unit and model comparing unit, the distortion analytic unit are used to carry out phase to new model model original with system
Analyzed like degree, the blood relationship management/impact analysis unit is used for the relation chain for showing model dependence and the pass for relying on model
Tethers bar, the version management unit are used for the old version for checking data resource account, and the model comparing unit is to system
The resource of middle maintenance is compared with database actual conditions;
Data resource maintenance module, it includes data resource classification maintenance unit and data conservation of resources unit, the number
According to resource classification maintenance unit to data relevant departments, business classification, operation system, integrated technology classification, data center region,
Main subject heading domain, two level subject area and database instance carry out classification maintenance, and the data resource maintenance unit provides including model
Source maintenance unit, model attributes maintenance unit, interface maintenance unit and data flow maintenance unit;
Data resource acquisition module, it includes database acquiring unit and ETL acquiring units, the database acquiring unit
Resource, Resource Properties and the data amount information of structural data are obtained by data resource management platform database, to acquisition
Data amount information carries out statistics displaying, and the ETL acquiring units map the graphical exhibition that the information extracted carries out the page by ETL
Show, then the logical relation of ETL mappings is analyzed with the graphics mode, and obtained by way of ETL between each data model
Flow to graph of a relation;
Data center's demand management module, it includes data application maintenance unit, data application approval unit and data Shen
Please query unit, the data application maintenance unit is used to look into the data resource of the data resource management platform database
Ask, be newly-built, changing and deleting function and being safeguarded that application of the data application approval unit to business department is examined,
The data application query unit provides department's demand application that inquiry has been filed on from application title, proposition department and data.
Further, the data resource management platform front and back end is additionally included in line data resource O&M module, the module
Become including data resource modification application unit, data resource change examination & approval unit, data resource change execution unit, data resource
More historical query unit and data resource change statistical views unit, change of the module to data resource are applied, examined
With perform operation, and realize supervision and retrospect to data resource change.
Further, the data resource management platform front and back end also includes data-interface configuration and management module, the mould
Configuration and change of the block to data-interface are managed, and monitor interface running status, show interface statistics view, it includes connecing
Mouth dispensing unit, interface running state monitoring unit and interface statistics view unit.
Further, the interface dispensing unit includes interface source configurator, interface target end configurator, interface link
Configurator and interface scheduling rule configurator, the interface source configurator are used for source end system information, database information and table
The configuration of information;Interface target end configurator is used for the configuration of target system information, database information and table information;It is described
Interface link configurator is used for the field corresponding relation and processing logical message of source and destination end table;The interface scheduling rule
Then configurator is mainly used in configuring interface interchange time and call number.
Preferably, the data resource statistical views unit includes resource summary view, business statistic of classification view and knot
Structure, unstructured, magnanimity and the class data statistics views of GIS tetra-.
Further, the application domain view unit includes application system correlator, and the application system correlator will close
The application system of connection is connected with line, and numeral, wherein line representative of data flow converting interface are set on line, the numeral on line
Represent interface quantity.
Preferably, the information compared in the model comparing unit is included to table name, literary name name section, field type, word
The uniformity of segment length is compared.
Further, bored under the SG-CIM periodic table of elements and include corresponding two under each main subject heading domain of the page
Level subject area, the lower brill page of each two level subject area include model and interface list unit.
Further, the version management unit also includes data resource peripheral account any two version can be compared
Version comparative device.
The beneficial effects of the present invention are:
The data resource of four class data centers and each operation system is pooled to data resource management platform by system interface
Database, system interface input two ways using manual typing and interface, not only collect the data of each operation system automatically,
And corresponding information can be manually entered as needed, so that staff is manually entered data under line;Data resource obtains mould
Block is analyzed distortion and blood relationship management/influence after obtaining data in data resource application module, then enters line number
According to amount Information Statistics view displaying, and between the data flow between each operation system and data model by way of ETL
The relation that flows to carry out view displaying, enable the form of chaotic, unorganized data view between current each operation system clear
It is clear to show, provide Information base for the upgrading of sorts of systems, integrated services.
More for Utilities Electric Co.'s operation system and department, the problem of data unclear classification is clear, the present invention devises data
Conservation of resources module, the module is to the data of each operation system according to data relevant departments, business classification, operation system, integrated
Technique classification, data center region, main subject heading domain, two level subject area and database instance carry out classification maintenance, and user can be with
According to demand, data are inquired about and edited according to different taxonomic properties, solve the data of current each operation system
Resource relative distribution, the problem of each layer personnel can not check data according to the wish of oneself.
The data resource views module of the present invention intuitively embodies by the way of statistical form, line chart and block diagram are combined
The total data message of each operation system and each business grouped data resource growth trend, and using module map by between each application system
Stream compression relation be shown, and user may be selected certain module map enter it is lower brill the page come show the model of correspondence system and
The information such as integrated interface, this pictorial representation simplify current each operation system with excessive table view display data resource
Situation, and user can be allowed faster, more easily find required data resource.
In order to manage access right of each business department to total data resource, the present invention devises data center's demand pipe
Module is managed, application approval program is carried out by the module when certain department uses data, ensure that the data of each business department exist
Collect the security during use, and application information can be inquired about in detail by application situation.Moreover, carried out to data
During change, change can be applied and be examined by line data resource O&M module, and inquiry change history, and the mould
Change has also been carried out statistical views displaying by block, makes data message simpler understandable.
The modules of the present invention together constitute data resource management platform, are handled in the big data of whole power system
During it is indispensable, they according to it is respective the division of labor data resource is analyzed and processed, realize all operation system numbers
According to the unified displaying and maintenance of resource, solving current power system does not have unified data resource management mechanism, each data money
Source relative distribution, it is unified difficult in maintenance, user tend not to intuitively to see the information that data are reflected and overview it is total it is believed that
The problem of breath.
Brief description of the drawings
Fig. 1 is the system construction drawing of the present invention;
Fig. 2 is the function framework figure of data resource management platform front and back end of the present invention;
Fig. 3 is the one-level business classification view of application domain view unit;
Fig. 4 is the two level application system view under application domain view unit " huge construction program ".
Embodiment
Below in conjunction with the accompanying drawings and the present invention is described in detail specific embodiment.
As shown in figure 1, being somebody's turn to do the data resource management platform based on data fusion includes the existing each business system of power system
Unite database, the existing each operation system database of power system be four class data centers data resource and Utilities Electric Co. it is each
Operation system data resource, wherein, four class data centers include structural data center, unstructured data management platform, sea
Measure history/near-realtime data management platform and power grid GIS data platform.Set on the basis of existing each operation system database
The data management platform is counted, it also includes data resource management platform front and back end and data resource management platform database, should
Data resource management platform possesses the user name password and associated rights of each operation system database, its data resource management
Platform database is existing each by power system by system interface and the existing each operation system connection of power system
Operation system data fusion includes manual recording module and interface input mould to data resource management platform database, system interface
Block, manual recording module include a data upload software, and the data for needing to collect are obtained by way of man-machine interaction.Interface
Input module includes application development interface and transmission program, receives external application to data resource management platform data
Storehouse sends data.By system interface by data resource management platform database and the existing each operation system data of power system
Storehouse is docked, and the data craft input database that will manually count can be achieved.
Data resource management platform database includes pretreatment, sorting, transmission, reception and storage, pre- place to data fusion
Reason is that basis collects platform file format specification, by the typing file for obtaining and receiving, interface document and receives file conversion
Into input file form required for unified sorting.Sorting is in the preprocessed file write-in landing file by all inputs, is supplied
Enter library software and write data into database, meanwhile, preprocessed file is respectively written into according to the configuration of system and sent in file.Hair
Send and refer to the data in this document according to the mapping relations of transmission file and node (according to data resource management platform database
Communication protocol definition it is good) be sent to corresponding node.Reception refers to receive the data from other nodes (according to data resource pipe
The good packet of the communication protocol definition of platform database).Storage refers to that according to various information coding standard file will be landed
Data be stored in corresponding database.
The data resource management platform database includes the four classes data center data resource merged, and
The each operation system data resource of the Utilities Electric Co. by fusion, and update periodically or manually.As shown in Fig. 2 institute
State data resource management platform front and back end and safeguard mould including data resource views module, data resource application module, data resource
Block, data resource acquisition module, data center's demand management module, online data resource O&M module and data-interface configuration and
Management module.
Each module of data resource management platform front and back end of the present invention is described in detail below:
Data resource management platform front and back end includes data resource management platform front end and data resource management platform rear end,
Data resource management platform front end includes display screen, for display data;Data resource management platform rear end is used to enter data
Row analytic operation, including data resource views module, data resource application module, data resource maintenance module, data resource obtain
Modulus block, data center's demand management module, online data resource O&M module and data-interface configuration and management module.
Data resource views module, it includes data resource statistical views unit, application domain view unit and SG-CIM and regarded
Figure unit.
User can check after client selects data resource statistical views unit in data resource management platform front end
Company data general status and each business grouped data resource growth trend.Data resource statistical views unit includes resource general view
View, business statistic of classification view and structuring, unstructured, magnanimity and the class data statistics views of GIS tetra-, these views are adopted
The general status of data and variation tendency are embodied with the mode of chart combination, allows user to having a data are simple and clear to recognize
Know.Wherein, resource summary view is designed as:The top of view is " pattern number, line drag number, interface on system number, line
The general view statistical form of number, data fluxion, record strip number and space-consuming ", the lower section of statistical form is data resource variation tendency
Column statistical chart and broken line graph.For being designed as four class data statistics views:The top of view is four class data resources
Growth trend curve map, lower section is the statistical form of the distribution classified in each business of four class data resources and accounting situation.To industry
Business statistic of classification view is designed as:Top is the change trend curve figure of each business grouped data resource, and lower section is each business
The histogram of classification current data bar number.
Application domain view unit is used for relation between intuitively displaying application system, and can further check the model of a certain system
With integrated interface information, model information includes attribute, data volume, authority, place database and the data dictionary description of model.Collection
Into word description explanation and data flow information of the interface message including the integration mode between system, interface.Using domain view list
Member includes the classification of one-level business, two level application system and application system correlator, and the application system correlator should by association
It is connected with system with service class with line, and numeral, wherein line representative of data flow converting interface is set on line, the number on line
Word represents interface quantity.The view as shown in figure 3, one-level business is classified, the view connect each service class with the line with arrow
Connect, represent stream compression interface, statistics have shown on line, the numeral represents the interface quantity of the interface, clicks on the view
A certain service class after enter the service class under two level application system view, such as Fig. 4 be " huge construction program " under two level application system
System view, similarly, the view connect application system with the line with arrow, represent stream compression interface, have number on line
Word shows that the numeral represents the interface quantity of the interface, enters the system after clicking on a certain system of two level application system view
Model and integrated interface displayed page.This pictorial representation is not only by the intuitively table of the relation between each service class and application system
Up to out, and data-interface quantity is also illustrated, and got under clicking on after each service class and application system corresponding specific
The page, make to show confusion between each service class and application system at present, that does not unify makes mode in order, and business personnel will wonder respectively
The problem that the situation of service class and application system needs to go to make in order into system in turn is addressed.
The SG-CIM view units are used to show two level subject area, and it is using the SG-CIM periodic table of elements as entrance, displaying
Secondary subject area.After clicking on two level subject area, display model and interface list unit, during model (interface) display in display frames
By system demonstration specifying information.
Data resource application module, it includes distortion analytic unit, blood relationship management/impact analysis unit, version
Administrative unit and model comparing unit.
When newly-increased model preserves, the distortion analytic unit is used to carry out new model and the original model of system
Similarity analysis, if original model is similar to the structure of new model, corresponding prompting is given, prompts Similarity value.And eject
The respective statistics table of two models of analysis is compared, and is gone out on statistical form with coloured font tags between two models not
Consistent field and the field being not present.
Consanguinity analysis in the blood relationship management/impact analysis unit is from a certain model, is graphically opened up
The relation chain that now model relies on.Impact analysis is from a certain model, graphically shows the pass for relying on model
Tethers bar.
The version management unit is used for the old version for checking data resource account.User is in client or control centre
Display screen on click on " version management " function and can check the old version of data resource account, further, the version
Administrative unit also includes the version comparative device that any two version can be compared, and any two version can be selected to be compared
It is right.
The resource safeguarded in system is compared the model comparing unit with database actual conditions, it is preferred that institute
Stating the information compared in model comparing unit includes carrying out the uniformity of table name, literary name name section, field type, field length
Compare.If exist it is inconsistent, using statistical form by the statistical conditions of inconsistent data list for operating personnel refer to.
Data resource maintenance module, it includes data resource classification maintenance unit and data conservation of resources unit.The number
According to resource classification maintenance unit to data relevant departments, business classification, operation system, integrated technology classification, data center region,
Main subject heading domain, two level subject area and database instance carry out classification maintenance.
Wherein, the maintenance of data relevant departments includes:
A, query function:Can be by the condition query data such as department name, industry number relevant departments.
B ,/modification function is increased newly:When preserving " data relevant departments ", required information item needs to fill in complete, specification, system
Prompt " preserving successfully ";If required item is filled in not exclusively or fills in lack of standardization, " required item please be filled in completely system prompt!”;Repair
The data relevant departments to be changed is selected when changing, similar " newly-increased " page of " modification " button ejection is clicked on, is carried out according to modification item
Modification.
C, function is deleted:Whether ejection " deletes selected department" prompt message, department selected by deletion after confirmation.
The maintenance of business classification includes:
A, query function:Can be by condition query business information such as Business Name, business numberings.
B ,/modification function is increased newly:When preserving " new business ", required information item needs to fill in complete, specification, system prompt
" preserving successfully ";If required item is filled in not exclusively or fills in lack of standardization, " required item please be filled in completely system prompt!”;During modification
The business to be changed is selected, similar " newly-increased " page of " modification " button ejection is clicked on, is modified according to modification item.
C, function is deleted:Whether ejection " deletes selected business" prompt message, business selected by deletion after confirmation.
Operation system, which is safeguarded, to be included:
A, query function:Can be by the condition query operation system such as systematic name, System Number.
B, newly-built/modification function:" newly-increased " button is clicked in query page, into system new added pages, is filled on request
With the required item of No. * in the page, " preservation " button, ejection prompt message " operation system preserves successfully " are clicked;If required item is believed
Cease it is wrong or for sky, then ejection " required item please be filled in completely!”;The operation system to be changed is selected during modification, is clicked on " modification "
Similar " newly-increased " page of button ejection, modifies according to modification item.
C, function is deleted:An operation system is selected in list is inquired about, clicks on " deletion " button, business system selected by deletion
System.
Integrated technology classification maintenance includes:
A, query function:Can be by condition query integrated technologies such as integrated technology title, integrated technology numberings.
B, newly-built/modification function:Click on " newly-increased " button, into new added pages, fill on request in the page with No. * must
Item is filled out, clicks [preservation] button, ejection prompt message " integrated technology preserves successfully ";If required item information is wrong or is sky,
" required item please be filled in completely for ejection!”;The integrated technology to be changed is selected during modification, it is similar " new to click on the ejection of " modification " button
Increase " page, modified according to modification item.
C, function is deleted:An integrated technology is selected in list is inquired about, " deletion " button is clicked on, skill is integrated selected by deletion
Art.
Data center's regional maintenance includes:
A, query function:Can be by condition query data centers such as data center's zone name, data center's zone numbers.
B, newly-built/modification function:Click on " newly-increased " button, into new added pages, fill on request in the page with No. * must
Item is filled out, clicks [preservation] button, ejection prompt message " data center preserves successfully ";If required item information is wrong or is sky,
" required item please be filled in completely for ejection!" modification when select the data center to be changed, it is similar " newly to click on the ejection of " modification " button
Increase " page, modified according to modification item.
C, function is deleted:An integrated technology is selected in list is inquired about, clicks on " deletion " button, is deleted in selected data
The heart.
Main subject heading domain, which is safeguarded, to be included:
A, query function:It can claim by main subject heading domain name, the condition query main subject heading domain such as main subject heading Field Number.
B, newly-built/modification function:Click on " newly-increased " button, into new added pages, fill on request in the page with No. * must
Item is filled out, clicks [preservation] button, ejection prompt message " main subject heading domain preserves successfully ";If required item information is wrong or is sky,
Then " required item please be filled in completely for ejection!”;The subject area to be changed is selected during modification, it is similar " new to click on the ejection of " modification " button
Increase " page, modified according to modification item.
C, function is deleted:A subject area is selected in list is inquired about, clicks on " deletion " button, deletes institute's subject area.
Two level subject area, which is safeguarded, to be included:
A, query function:Can be by condition query two level subject areas such as two level subject area title, two level theme Field Numbers.
B, newly-built/modification function:Click on " newly-increased " button, into new added pages, fill on request in the page with No. * must
Item is filled out, clicks [preservation] button, ejection prompt message " two level subject area preserves successfully ";If required item information is wrong or is sky,
Then " required item please be filled in completely for ejection!”;The subject area to be changed is selected during modification, it is similar " new to click on the ejection of " modification " button
Increase " page, modified according to modification item.
C, function is deleted:A subject area is selected in list is inquired about, clicks on " deletion " button, deletes institute's subject area.
Database instance, which is safeguarded, to be included:
A, query function:Can be by condition query database instances such as database instance title, database instance numberings.
B, newly-built/modification function:Click on " newly-increased " button, into new added pages, fill on request in the page with No. * must
Item is filled out, clicks [preservation] button, ejection prompt message " database instance preserves successfully ";If required item information is wrong or is sky,
Then " required item please be filled in completely for ejection!”;The database instance to be changed is selected during modification, it is similar to click on the ejection of " modification " button
" newly-increased " page, modifies according to modification item.
C, function is deleted:A database instance is selected in list is inquired about, clicks on " deletion " button, deletes institute's database
Example.
The data resource maintenance unit includes model resource maintenance unit, model attributes maintenance unit, interface and safeguards list
Member and data flow maintenance unit;
The maintenance of model resource maintenance unit includes:
A, " model resource configuration " is clicked on, the relevant configuration information of interrogation model resource.
B ,/modification function is increased newly:Business personnel or operation maintenance personnel are according to certain regular allocation models resource information, system
Automatically model resource configuration rule can be tested, meets specification, system prompt " configuration successful ", otherwise, prompt " to be configured with
By mistake, can not preserve ";The model resource to be changed is selected during modification, clicks on the ejection of " modification " button similar to " newly-increased " page, by repairing
Change item to modify.
C, function is deleted:Invalid or failure model resource configuration is selected to carry out deletion action, system ejection confirmation
" whether determine to delete model resource configuration", deleted after confirmation.
D, support to import model resource information by excel templates batch.
The maintenance of model attributes maintenance unit includes:
A, " model attributes configuration " is clicked on, the relevant configuration information of interrogation model attribute.
B ,/modification function is increased newly:Business personnel or operation maintenance personnel are according to certain regular allocation models attribute information, system
Automatically model attributes configuration rule can be tested, meets specification, system prompt " configuration successful ", otherwise, prompt " to be configured with
By mistake, can not preserve ";The model attributes to be changed are selected during modification, click on the ejection of " modification " button similar to " newly-increased " page, by repairing
Change item to modify.
C, function is deleted:Invalid or failure model attributes configuration is selected to carry out deletion action, system ejection confirmation
" whether determine to delete model attributes configuration", deleted after confirmation.
D, support to import model attributes information by excel templates batch.
The maintenance of interface maintenance unit includes:
A, " interface configuration " is clicked on, the relevant configuration information of query interface.
B ,/modification function is increased newly:According to certain rule configuration interface message, system can be certainly for business personnel or operation maintenance personnel
Dynamic docking port configuration rule is tested, and meets specification, system prompt " configuration successful ", otherwise, " configuration is wrong, can not for prompting
Preserve ";The interface to be changed is selected during modification, similar " newly-increased " page of " modification " button ejection is clicked on, is repaiied by modification item
Change.
C, function is deleted:Select invalid or failure interface to configure and carry out deletion action, system ejection confirmation " whether
It is determined that delete interface configuration", deleted after confirmation.
D, support to pass through excel template batch introducting interface information.
The maintenance of data flow maintenance unit includes:
A, " data stream configuration " is clicked on, inquires about the relevant configuration information of data flow.
B ,/modification function is increased newly:Business personnel or operation maintenance personnel are according to certain regular configuration data stream information, system meeting
Automatically data stream configuration rule is tested, meets specification, system prompt " configuration successful ", otherwise, prompt " configuration is wrong,
It can not preserve ";The data flow to be changed is selected during modification, similar " newly-increased " page of " modification " button ejection is clicked on, by modification item
Modify.
C, function is deleted:Invalid or failure data stream configuration is selected to carry out deletion action, system ejection confirmation " is
It is no to determine to delete the data stream configuration", deleted after confirmation.
D, support to import traffic flow information by excel templates batch.
Data resource acquisition module, it includes database acquiring unit and ETL acquiring units, the database acquiring unit
Resource, Resource Properties and the data amount information of structural data are obtained by data resource management platform database, to acquisition
Data amount information carries out statistics displaying;Numbering, resource Chinese, the money of resource are obtained by the database of database server
The information such as source English name, resource type, said system.The volume of Resource Properties is obtained by the database of database server
Number, the information such as resource Chinese, resource English name, resource type, said system.Data are obtained by resource management instrument
The data amount information of resource.
The ETL acquiring units map the graphical representation that the information extracted carries out the page by ETL, then with the figure side
Formula analyzes the logical relation of ETL mappings, and is obtained by way of ETL and to flow to graph of a relation between each data model.ETL reflects
Penetrate extraction and ETL mapped files are extracted by access interface, knowledge base form.ETL map analysis map the information extracted by ETL
The graphical representation of the page is carried out, then (is analyzed with the graphics mode to analyze the logical relation of ETL mappings between each operation system
Data flow).
Data center's demand management module, it includes data application maintenance unit, data application approval unit and data Shen
Please query unit.
The data application maintenance unit is for inquiring about, newly the data resource of the data resource management platform database
Function is built, changes and deletes to be safeguarded;
A, query function:Can be by all data application records of condition query such as application form type, application table names.
B, newly-built function:" database request for utilization " button is clicked on, into application new added pages, is filled on request in the page
With the required item of No. *, " preservation " button, ejection prompt message " database request for utilization preserves successfully " are clicked;If required item is believed
Cease it is wrong or for sky, then ejection " required item please be filled in completely!”;" data sharing application " and " data source Notification of Changes list " is same
On.
C, function is changed:It is similar " newly-increased " to click on the ejection of " modification " button for the application record to be changed in selection inquiry list
The page, modified according to modification item.
D, function is deleted:Deletion action can be carried out to the application record of no examination & approval, one is selected in list is inquired about
Application record, this application record can be removed by clicking on " deletion " button.
Application of the data application approval unit to business department is examined;Demand application is proposed in business department
Afterwards, the business department and Xintong Co being related to need to examine to application.
Data providing is examined to the demand application for being related to this department:Detailed requirements annex is downloaded, is carried out under line true
Whether can provide, if providing, carrying out examination & approval on line passes through if recognizing, can as applied for that demand described in annex is indefinite in detail
To retract, and illustration, can not such as provide to refuse, and illustration.Xintong Co is examined all demand applications
Batch:Detailed requirements annex is downloaded, analyzes whether meet demand in common data resource pool, it is as logical in met directly to examine
Cross, be such as unsatisfactory for, need to formulate the technology path (0 of data access with data providing:Resource pool has supported, and 1:Webservice,
2:JDBC, 3:Data duplication, 4:APUB, 5:Batch bus, 6:ETL), and examination & approval pass through.Access demand under data providing line
Data.
The data application query unit provides department's demand that inquiry has been filed on from application title, proposition department and data
Application;The demand application having been filed on is inquired about from application title, proposition department, data offer department etc., is included in Query Result:
Apply for title, propose that department, data offer department, demand data system, expected performance time, demand processing state are (" pending
Batch ", " having finished " and " calcellation " three kinds of states), demand deadline etc..And detailed demand information can be inquired about, including:Examination & approval
Record (including nodename, application reason, processing people, operating time, opinion) and approval process.For query function, to each
The authority of department is configured, and is only inquired about such as business department and is related to the demand of this department, and Xintong Co (letter portion of section) can inquire about
The demand of all business departments.
Online data resource O&M module includes data resource modification application unit, data resource change examination & approval unit, number
According to resource change execution unit, data resource change historical query unit and data resource change statistical views unit, the module
Operation is applied for, examined and performed in change to data resource, and realizes supervision and retrospect to data resource change.Pass through
Online data resource O&M can realize supervision and retrospect to data resource change, reach being managed to data resource
Purpose.The information that data resource change statistical views unit shows mainly includes:Resource information is changed, applicant, approver, is held
Pedestrian, change the time.
Data-interface is configured and management module, configuration and change of the module to data-interface are managed, and is monitored and connect
Mouth running status, shows interface statistics view, it includes interface dispensing unit, interface running state monitoring unit and interface statistics
View unit.
The interface dispensing unit include interface source configurator, interface target end configurator, interface link configurator and
Interface scheduling rule configurator,
The configuration information of interface source configurator includes:Source end system information, database information, table information etc..
The configuration information of interface target end configurator includes:Target system information, database information, table information etc..
The configuration information of interface link configurator mainly includes the field corresponding relation of source and destination end table, handles logic
Etc. information.
Source and aiming field mapping are as follows:
The configuration information of interface scheduling rule configurator mainly includes:Interface interchange time, call number etc..
Interface running state monitoring unit mainly monitors interface running status, source end system database state, target end system
Database connection status.
Interface statistics view unit is mainly from interface name, scheduling time, sources operation system, source table, target service system
System, destination end table etc. do statistics and showed to analyze.
Combination accompanying drawing described above is described above in detail to the preferred embodiment of the present invention and embodiment, but the present invention is not
The above-described embodiment and examples are confined to, for those skilled in the art, are not departing from structure of the present invention
On the premise of think of, some improvement and modification can also be made, these improvement and modification also should be regarded as protection scope of the present invention.
Claims (9)
1. a kind of data resource management platform based on data fusion, it is characterised in that before and after data resource management platform
It is end, data resource management platform database, each operation system data resource of Utilities Electric Co. and structural data center, non-structural
Change data management platform, magnanimity history/near-realtime data management platform and the data of the class data center of power grid GIS data platform four
Resource;
The data resource management platform possesses the user name password and associated rights of each operation system database of Utilities Electric Co., and
By system interface and the connection of each operation system of the Utilities Electric Co., the system interface includes manual typing mould
Block and interface input module;
The data resource management platform database includes the data resource of the four classes data center combed, and warp
The each operation system data resource of the Utilities Electric Co. combed is crossed, and update periodically or manually;
The data of the data resource management platform database are arranged and opened up by the data resource management platform front and back end
Show, it includes:
Data resource views module, it includes data resource statistical views unit, application domain view unit and SG-CIM view lists
Member, the data resource statistical views unit is used for display data resource overall distribution situation and variation tendency, and can check public affairs
Data general status and each business grouped data resource growth trend are taken charge of, the application domain view unit, which is used to intuitively show, to be applied
Relation between system, and the model and integrated interface information of a certain system can be checked, the SG-CIM view units are used to show two
Level subject area;
Data resource application module, it includes distortion analytic unit, blood relationship management/impact analysis unit, version management
Unit and model comparing unit, the distortion analytic unit are used to carry out similarity to new model and the original model of system
Analysis, the blood relationship management/impact analysis unit are used for the relation chain for showing model dependence and the relation chain for relying on model
Bar, the version management unit are used for the old version for checking data resource account, and the model comparing unit in system to tieing up
The resource of shield is compared with database actual conditions;
Data resource maintenance module, it includes data resource classification maintenance unit and data conservation of resources unit, the data money
Classify maintenance unit to data relevant departments, business classification, operation system, integrated technology classification, data center region, one-level in source
Subject area, two level subject area and database instance carry out classification maintenance, and the data resource maintenance unit is tieed up including model resource
Protect unit, model attributes maintenance unit, interface maintenance unit and data flow maintenance unit;
Data resource acquisition module, it includes database acquiring unit and ETL acquiring units, and the database acquiring unit passes through
Data resource management platform database obtains resource, Resource Properties and the data amount information of structural data, to the data of acquisition
Amount information carries out statistics displaying, and the ETL acquiring units map the graphical representation that the information extracted carries out the page by ETL,
The logical relation of ETL mappings is analyzed with the graphics mode again, and the flow direction between each data model is obtained by way of ETL
Graph of a relation;
Data center's demand management module, it includes data application maintenance unit, data application approval unit and data application and looked into
Unit is ask, the data application maintenance unit is for inquiring about, newly the data resource of the data resource management platform database
Build, change and delete function to be safeguarded, application of the data application approval unit to business department is examined, the number
According to application query unit department's demand application that inquiry has been filed on is provided from application title, proposition department and data.
2. the data resource management platform according to claim 1 based on data fusion, it is characterised in that the data money
Source capsule platform front and back end is additionally included in line data resource O&M module, and the module includes data resource modification application unit, number
Examination & approval unit, data resource change execution unit, data resource change historical query unit and data resource are changed according to resource to become
More statistical views unit, operation is applied for, examined and performed in change of the module to data resource, and realizes to data resource
The supervision and retrospect of change.
3. the data resource management platform according to claim 1 based on data fusion, it is characterised in that the data money
Source capsule platform front and back end also includes data-interface configuration and management module, and configuration and change of the module to data-interface are carried out
Management, and interface running status is monitored, interface statistics view is shown, it includes interface dispensing unit, interface running state monitoring
Unit and interface statistics view unit.
4. the data resource management platform according to claim 3 based on data fusion, it is characterised in that the interface is matched somebody with somebody
Putting unit includes interface source configurator, interface target end configurator, interface link configurator and interface scheduling rule configurator,
The interface source configurator is used for the configuration of source end system information, database information and table information;Match somebody with somebody at the interface target end
Put the configuration that device is used for target system information, database information and table information;The interface link configurator is used for source and mesh
Mark the field corresponding relation and processing logical message of end table;The interface scheduling rule configurator is mainly used in configuring interface tune
With time and call number.
5. the data resource management platform according to claim 1 based on data fusion, it is characterised in that the data money
Source statistical views unit includes resource summary view, business statistic of classification view and structuring, unstructured, magnanimity and GIS tetra-
Class data statistics view.
6. the data resource management platform according to claim 1 based on data fusion, it is characterised in that the application domain
View unit includes application system correlator, and the application system of association is connected by the application system correlator with line, and even
Setting is digital on line, wherein line representative of data flow converting interface, the digitized representation interface quantity on line.
7. the data resource management platform according to claim 1 based on data fusion, it is characterised in that the model ratio
The information compared in unit is included the uniformity of table name, literary name name section, field type, field length is compared.
8. the data resource management platform according to claim 1 based on data fusion, it is characterised in that in the SG-
Bored under the CIM periodic table of elements and include corresponding two level subject area under each main subject heading domain of the page, each two level subject area
The lower brill page includes model and interface list unit.
9. the data resource management platform according to claim 1 based on data fusion, it is characterised in that the version pipe
Reason unit also includes the version comparative device that data resource peripheral account any two version can be compared.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510245576.9A CN104809597B (en) | 2015-05-14 | 2015-05-14 | Data resource management platform based on data fusion |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510245576.9A CN104809597B (en) | 2015-05-14 | 2015-05-14 | Data resource management platform based on data fusion |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104809597A CN104809597A (en) | 2015-07-29 |
CN104809597B true CN104809597B (en) | 2018-02-13 |
Family
ID=53694405
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510245576.9A Active CN104809597B (en) | 2015-05-14 | 2015-05-14 | Data resource management platform based on data fusion |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104809597B (en) |
Families Citing this family (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105260835A (en) * | 2015-10-13 | 2016-01-20 | 北京凯行同创科技有限公司 | Method for modeling, analyzing, and self-optimizing multi-source business big data |
CN106933835A (en) * | 2015-12-29 | 2017-07-07 | 航天信息软件技术有限公司 | The data lead-in method and system of a kind of compatibility parsing Excel file |
CN108701176B (en) * | 2016-02-17 | 2022-10-14 | 开利公司 | Authorized time lapse view of system and credential data |
CN105893593B (en) * | 2016-04-18 | 2019-04-19 | 国网山东省电力公司信息通信公司 | A kind of method of data fusion |
CN106126199A (en) * | 2016-06-13 | 2016-11-16 | 乐视控股(北京)有限公司 | The building method of viewdata model and device |
CN106709000B (en) * | 2016-12-22 | 2020-07-14 | 河海大学 | Key view discovery method based on PageRank and origin graph abstraction |
CN106874373A (en) * | 2016-12-30 | 2017-06-20 | 江苏瑞中数据股份有限公司 | A kind of implementation method of the electric network data asset management platform based on SOA |
CN107146165B (en) * | 2017-04-24 | 2021-04-13 | 国网江西省电力公司经济技术研究院 | Distribution network planning data management method and system |
CN110753939B (en) * | 2017-06-07 | 2024-03-01 | 三菱电机楼宇解决方案株式会社 | Data name classification auxiliary device |
CN108269214A (en) * | 2017-06-30 | 2018-07-10 | 勤智数码科技股份有限公司 | The quick carding method of data and system in a kind of knowledge based library |
CN108492028A (en) * | 2018-03-21 | 2018-09-04 | 徐欣 | Demand data standardized method and standardized system |
CN108573371B (en) * | 2018-04-18 | 2023-06-20 | 平安科技(深圳)有限公司 | Data approval method, device, computer equipment and storage medium |
CN109189394B (en) * | 2018-08-02 | 2021-11-16 | 浪潮通用软件有限公司 | Method for self-adapting to grain situation data structure of domestic mainstream manufacturer |
CN109522292B (en) * | 2018-08-29 | 2020-02-18 | 云南电网有限责任公司信息中心 | Data processing device and method based on power grid standard unified information model |
CN109902117B (en) * | 2019-02-19 | 2021-07-06 | 新华三大数据技术有限公司 | Business system analysis method and device |
CN111080261A (en) * | 2019-12-19 | 2020-04-28 | 国网安徽省电力有限公司信息通信分公司 | Visual data asset management system based on big data |
CN111061794A (en) * | 2019-12-19 | 2020-04-24 | 无锡市耘林养老信息技术有限公司 | Method for butt joint of self system and third-party service system |
CN111581223B (en) * | 2020-04-11 | 2023-08-22 | 北京城市网邻信息技术有限公司 | Data updating method, device, terminal equipment and storage medium |
CN113992457B (en) * | 2021-09-09 | 2024-04-26 | 北京思特奇信息技术股份有限公司 | Configuration method and system for converged service model in telecommunication industry |
CN116383537B (en) * | 2023-05-23 | 2023-09-08 | 飞狐信息技术(天津)有限公司 | Page data preloading method, device, equipment and storage medium |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103942646A (en) * | 2014-04-16 | 2014-07-23 | 国家电网公司 | Power communication resource management system |
CN104102973A (en) * | 2014-07-04 | 2014-10-15 | 云南电力调度控制中心 | Realization method of integral operation and distributed deployment provincial and prefectural electric power scheduling data center |
-
2015
- 2015-05-14 CN CN201510245576.9A patent/CN104809597B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103942646A (en) * | 2014-04-16 | 2014-07-23 | 国家电网公司 | Power communication resource management system |
CN104102973A (en) * | 2014-07-04 | 2014-10-15 | 云南电力调度控制中心 | Realization method of integral operation and distributed deployment provincial and prefectural electric power scheduling data center |
Non-Patent Citations (2)
Title |
---|
《南方电网一体化运行数据中心建设方案研究》;梁寿愚等;《南方电网一体化运行数据中心建设方案研究》;20131020;第7卷(第5期);正文第14-20页 * |
《电力企业信息系统数据融合与共享方案研究》;刘殷等;《电力信息与通信技术》;20150315;正文第17-21页 * |
Also Published As
Publication number | Publication date |
---|---|
CN104809597A (en) | 2015-07-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104809597B (en) | Data resource management platform based on data fusion | |
CN107357856B (en) | Method for realizing data integration and data service based on power grid panoramic service model | |
CN103970872B (en) | Multi-level data processing method based on service aperture | |
Quiescenti et al. | Business process-oriented design of Enterprise Resource Planning (ERP) systems for small and medium enterprises | |
CN108537481A (en) | A kind of intelligent warehousing system and storage method based on cloud service | |
CN109829125A (en) | Show the platform of user management of dispatching of power netwoks operation data | |
CN107315776A (en) | A kind of data management system based on cloud computing | |
CN108492028A (en) | Demand data standardized method and standardized system | |
CN101916398A (en) | WEB GIS-based information management system of bridges in region | |
CN109189844A (en) | A kind of inspection examining report business management system | |
CN109491642A (en) | A kind of Requirements Modeling system and method based on scene, information data processing terminal | |
CN104616100B (en) | The management system of emergency preplan | |
CN103714434A (en) | Chemical industry production site patrol system based on internet of things technology | |
CN112150122A (en) | Agile network resource positioning and decision-making system | |
CN102376029B (en) | A kind of information object model framework device and method for Analysis of Policy Making | |
CN106203787A (en) | The industry information analysis method added based on a figure and system | |
CN107820214A (en) | A kind of user trajectory analysis system based on time suboptimal control | |
CN110570097A (en) | business personnel risk identification method and device based on big data and storage medium | |
CN115858651A (en) | Support platform is used in integration of wisdom city | |
CN114819478A (en) | Power grid collaborative planning management platform based on BIM | |
CN113779261B (en) | Quality evaluation method and device of knowledge graph, computer equipment and storage medium | |
CN108199862A (en) | A kind of operation system, which reports an error, manages system and method | |
CN114281795A (en) | Data model construction method based on service data standard table | |
CN108010318A (en) | Intelligent transportation equipment operation maintenance platform | |
CN115470940A (en) | Building engineering operation and maintenance management system based on BIM technology |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
EXSB | Decision made by sipo to initiate substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |