CN106844390A - A kind of inter-sectional data resource cut-in method - Google Patents
A kind of inter-sectional data resource cut-in method Download PDFInfo
- Publication number
- CN106844390A CN106844390A CN201510887933.1A CN201510887933A CN106844390A CN 106844390 A CN106844390 A CN 106844390A CN 201510887933 A CN201510887933 A CN 201510887933A CN 106844390 A CN106844390 A CN 106844390A
- Authority
- CN
- China
- Prior art keywords
- data
- resource
- database
- end processor
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A kind of inter-sectional data resource cut-in method, is analyzed to all departments' data resource first, forms the information resource catalogue for needing to be accessed；Then building for front end processor environment, including front end processor deployed with devices, network link, front end processor operating system and installing DB are carried out；Database table structure component, increases recording status field and timestamp field respectively in tables of data；Data resource is periodically regularly pushed to front end processor database by data access department；Data center updates the data resource to center according to front damming mode field and timestamp, completes resource and accesses and integration work.
Description
Technical field
Field is utilized the present invention relates to network information resource, and in particular to a kind of data resource by between all departments is integrated, together
The method that one data resource access interface reaches resource-sharing.
Background technology
In recent years, with the deep development of all departments' informatization, the data message resource that all departments grasp is developed rapidly and acute
Increase, information resources have become Socialized Reading and the indispensable production factors of development, invisible money as the valuable wealth of government
Produce and the wealth of society.For all departments especially government department, management reinforcement information resources, development and utilization
As the effective means run as maintaining social stability and instructing.But nowadays global IT application develop rapidly, information explosion formula
Increase, the dispersion of informatization platform that all departments each build respectively and information resources has become informatization with isolating
Main Bottleneck, " information island " phenomenon is very universal, and the complete of department's self-management function is drastically influence to a certain extent
The raising of kind and service level, affects the science and validity of manager's decision-making.It is right under such background and trend
The research of the method and technology that effectively access all departments' data resource is increasingly becoming government's related system and pays close attention to field.
The content of the invention
It is an object of the invention to provide a kind of inter-sectional data resource cut-in method, it is intended to can help that all departments are effective to be connect
Enter the Various types of data information resources of other departments, form effective convergence of Various types of data resource, structure is available for the data of data sharing
Center.
Technical scheme is as follows：
A kind of inter-sectional data resource cut-in method, it is characterised in that comprise the following steps：
(1) in by all departments' relevant information resource pushed into front end processor database by unit business storage facility located at processing plant, system is according to money
Source renewal frequency requirement sets timed task and accesses unit business storage facility located at processing plant, reads relevant information resource database table, will meet more
The data of New Terms are inserted into front end processor correspondence database table；
(2) accessed at data resource center and front end processor region, data center region and exchange area are set；Wherein in front end processor
Region is used to dispose preposition machine equipment, and builds the information resources that advance data storehouse is temporarily stored in preposition access phase push；Number
According to central area by assembling area, directorial area and thematic district's groups into being the core memory of data center's access information resource；Exchange area
Domain is made up of intranet and extranet exchange system, and for information resources turnover, data center provides security control guarantee.
(3) information resources enter the mirror database of assembling area under the form for keeping original form, structure and content, enter
The information resources of assembling area will be reclassified according to type of service, and cleaning, the place of data are carried out by related cleaning rule
Extracted to data center management area after the operation such as reason, duplicate removal；Information resources into directorial area will integrate requirement according to correlation, enter
Thematic data base is formed after the operations such as row splits, restructuring, reconstruct and enters special topic area of data center；
(4) the Information Resource Integrated System correlation that migrates across in whole information resources centre access phase relevant information resource is taken out
Take instrument realization.System connects source database and target database, and each correspondence letter of accessible database simultaneously in each migration phase
Breath resource table, it is real by configuring the main external key of source database, timestamp field, storehouse table relation, extracting frequency, cleaning rule etc.
Show extraction of the information resources by source database to target database.
(5) database table structure component.Need to increase recording status field and time respectively in tables of data in the link
Stamp field；
(6) the 6th, access unit and be responsible for for data resource periodically regularly pushing to front end processor database；According to front damming state
Field and timestamp update the data resource to center, complete resource and access and follow-up integration work.
The present invention is conducive to meeting the information requirement of information user diversification.The increasing of the information that existing information management system is provided
Value property is not strong, causes understanding of the information user to information to have any problem.Data resource access by make up Information Management System these
Defect, by extensive information, deep confluence analysis provides the effective information of diversification to information user.
The present invention can realize information increment.By organically blending and smooth flow and shared for inside and outside information, raising information makes
With rate, and generate the valuable information for being available for policymaker at different levels to formulate strategic decisions.
The present invention can according to organization internal demand, mobile phone, to organization internal, be realized accurately and in time by various polynary Heterogeneous Informations
Interior external information organically blends.
Specific embodiment
The access of data message resource of the invention is generally divided into preposition access and two stages are accessed at center.Wherein, it is preposition to connect
Enter the first stage that the stage is the access of data message resource, the stage is mainly responsible for completing the business number of data resource source department
According to information resources, operation system, business library are currently located by it, by relevant information resource supplying system, finally push to list
In locative preposition machine environment.Center access phase is that data message resource accesses second stage, and the stage is mainly responsible for completing business
Data message resource, by intranet and extranet exchange system, is finally drawn into data center's storage environment from unit front end processor environment,
The access of information resources is finally completed through over cleaning, integration, storage (Cheng Ku).
First, preposition access phase：
The first stage that preposition access phase is accessed as data message resource, mainly it is responsible for completing relevant information money by access unit
Source is pushed in front end processor database by unit business storage facility located at processing plant.System sets timed task and accesses according to resource updates frequency requirement
Unit business storage facility located at processing plant, reads relevant information resource database table, and the data that will meet update condition are inserted into front end processor correspondence number
According in the table of storehouse.In whole access procedure, first in terms of renewal frequency, because the renewal frequency of information resources may basis
Future, vocational work demand changed, it is therefore proposed that being designed to renewal frequency during system research and development can configure；Secondly in number
According to storage (front end processor database) aspect, it is necessary to the problem for noting is that database should try one's best selection and access unit industry in front end processor
The consistent database of business storage facility located at processing plant.Meanwhile, can increase compared with original unit's business production database table structure in front end processor database table structure
Add timestamp RecordStamp fields and recording status RecordStatus fields, carry out front end processor data insert when need by
Timestamp field and recording status are inserted in the lump.Wherein timestamp field content takes front-end processor system default time, and precision needs essence
Really to the second, form is：YYYY-MM-DD 24HH：MI：(the front-end processor system time should be entered SS by the time service server of centre punch one
Row unified management, unified time service), center will according to timestamp field by data by front end processor incremental update to data center；Note
Record mode field is used for record data status information, and the field contents only include tri- kinds of contents of add, update, delete, wherein
Add represents that this record is the record for pushing for the first time, and update represents that this records modified, is the record for pushing again；
Delete represents that this record has been deleted.
2nd, center access phase：
It is with front end processor database as source database, with data center as mesh that data message resource center accesses overall process
Mark database, extraction of the information resources by source database to target database is realized using Information Resource Integrated System.
At data resource center, access phase mainly includes front end processor region, three parts in data center region and exchange area.Its
In be used to dispose preposition machine equipment in front end processor region, and build advance data storehouse and be temporarily stored in the letter that preposition access phase is pushed
Breath resource；Data center region is by assembling area, directorial area and thematic district's groups into being that the core of data center's access information resource is deposited
Storage；Exchange area is made up of intranet and extranet exchange system, and for information resources turnover, data center provides security control guarantee.
Data resource center access procedure is mainly responsible for completing by service data information resource from unit front end processor, by intranet and extranet
Exchange system, is finally drawn into data center, and connecing for information resources is finally completed through over cleaning, integration, storage (Cheng Ku)
Enter.Mainly it is controlled by intranet and extranet exchange system in this process.Front end processor database deployed position is exchanged in intranet and extranet
The outer peripheral areas of system, information resources enter after being managed through security control and exchange system firstly the need of the outer exchange area for entering exchange system
Exchange area in system, finally enters the assembling area of data center.Information resources are basic to keep the shape of original form, structure and content
Into the mirror database of assembling area under formula.Information resources into assembling area will be reclassified according to type of service, and be passed through
Crossing related cleaning rule extracted to data center management area after cleaning, treatment, duplicate removal of data etc. are operated.Into directorial area
Information resources will be integrated according to correlation and require, formation thematic data base enters data after the operation such as being split, being recombinated, reconstruct
Center special topic area.
The related extraction work of Information Resource Integrated System is migrated across in whole information resources centre access phase relevant information resource
Tool is realized.System connects source database and target database, and each corresponding informance money of accessible database simultaneously in each migration phase
Source table, by configuring the main external key of source database, timestamp field, storehouse table relation, extracting frequency, cleaning rule etc., realizes letter
Cease extraction of the resource by source database to target database.
Claims (1)
1. a kind of inter-sectional data resource cut-in method, it is characterised in that comprise the following steps：
(1) in by all departments' relevant information resource pushed into front end processor database by unit business storage facility located at processing plant, system is according to money
Source renewal frequency requirement sets timed task and accesses unit business storage facility located at processing plant, reads relevant information resource database table, will meet more
The data of New Terms are inserted into front end processor correspondence database table；
(2) accessed at data resource center and front end processor region, data center region and exchange area are set；Wherein in front end processor
Region is used to dispose preposition machine equipment, and builds the information resources that advance data storehouse is temporarily stored in preposition access phase push；Number
According to central area by assembling area, directorial area and thematic district's groups into being the core memory of data center's access information resource；Exchange area
Domain is made up of intranet and extranet exchange system, and for information resources turnover, data center provides security control guarantee.
(3) information resources enter the mirror database of assembling area under the form for keeping original form, structure and content, enter
The information resources of assembling area will be reclassified according to type of service, and cleaning, the place of data are carried out by related cleaning rule
Extracted to data center management area after the operation such as reason, duplicate removal；Information resources into directorial area will integrate requirement according to correlation, enter
Thematic data base is formed after the operations such as row splits, restructuring, reconstruct and enters special topic area of data center；
(4) the Information Resource Integrated System correlation that migrates across in whole information resources centre access phase relevant information resource is taken out
Instrument realization is taken, system connects source database and target database, and each correspondence letter of accessible database simultaneously in each migration phase
Breath resource table, it is real by configuring the main external key of source database, timestamp field, storehouse table relation, extracting frequency, cleaning rule etc.
Show extraction of the information resources by source database to target database.
(5) recording status field and timestamp field are increased respectively in tables of data；
(6) unit is accessed to be responsible for for data resource periodically regularly pushing to front end processor database；According to front damming mode field and
Update of time stamp data resource completes resource and accesses and follow-up integration work to center.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510887933.1A CN106844390A (en) | 2015-12-07 | 2015-12-07 | A kind of inter-sectional data resource cut-in method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510887933.1A CN106844390A (en) | 2015-12-07 | 2015-12-07 | A kind of inter-sectional data resource cut-in method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106844390A true CN106844390A (en) | 2017-06-13 |
Family
ID=59151227
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510887933.1A Pending CN106844390A (en) | 2015-12-07 | 2015-12-07 | A kind of inter-sectional data resource cut-in method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106844390A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107844560A (en) * | 2017-10-30 | 2018-03-27 | 北京锐安科技有限公司 | A kind of method, apparatus of data access, computer equipment and readable storage medium storing program for executing |
| CN110795422A (en) * | 2019-09-12 | 2020-02-14 | 三盟科技股份有限公司 | Data service management method and system |
| CN110851458A (en) * | 2019-11-15 | 2020-02-28 | 江苏国泰新点软件有限公司 | Resource acquisition method, device, system and storage medium |
| CN111737252A (en) * | 2020-05-22 | 2020-10-02 | 广东科学技术职业学院 | Data fusion method and system based on data center |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8631050B1 (en) * | 2009-06-11 | 2014-01-14 | Eliving, Llc | Transformation engine |
| CN103793399A (en) * | 2012-10-31 | 2014-05-14 | 北京航天长峰科技工业集团有限公司 | Method for integrating information resources of system of politics and law |
| CN104104738A (en) * | 2014-08-06 | 2014-10-15 | 江苏瑞中数据股份有限公司 | FTP-based (file transfer protocol-based) data exchange system |
| CN104699849A (en) * | 2015-04-07 | 2015-06-10 | 同方知网数字出版技术股份有限公司 | Digital library resource unified search system |
| US20150261792A1 (en) * | 2014-03-17 | 2015-09-17 | Commvault Systems, Inc. | Maintaining a deduplication database |
-
2015
- 2015-12-07 CN CN201510887933.1A patent/CN106844390A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8631050B1 (en) * | 2009-06-11 | 2014-01-14 | Eliving, Llc | Transformation engine |
| CN103793399A (en) * | 2012-10-31 | 2014-05-14 | 北京航天长峰科技工业集团有限公司 | Method for integrating information resources of system of politics and law |
| US20150261792A1 (en) * | 2014-03-17 | 2015-09-17 | Commvault Systems, Inc. | Maintaining a deduplication database |
| CN104104738A (en) * | 2014-08-06 | 2014-10-15 | 江苏瑞中数据股份有限公司 | FTP-based (file transfer protocol-based) data exchange system |
| CN104699849A (en) * | 2015-04-07 | 2015-06-10 | 同方知网数字出版技术股份有限公司 | Digital library resource unified search system |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107844560A (en) * | 2017-10-30 | 2018-03-27 | 北京锐安科技有限公司 | A kind of method, apparatus of data access, computer equipment and readable storage medium storing program for executing |
| CN110795422A (en) * | 2019-09-12 | 2020-02-14 | 三盟科技股份有限公司 | Data service management method and system |
| CN110795422B (en) * | 2019-09-12 | 2020-10-27 | 三盟科技股份有限公司 | Data service management method and system |
| CN110851458A (en) * | 2019-11-15 | 2020-02-28 | 江苏国泰新点软件有限公司 | Resource acquisition method, device, system and storage medium |
| CN110851458B (en) * | 2019-11-15 | 2024-02-09 | 江苏国泰新点软件有限公司 | Resource acquisition method, device, system and storage medium |
| CN111737252A (en) * | 2020-05-22 | 2020-10-02 | 广东科学技术职业学院 | Data fusion method and system based on data center |
| CN111737252B (en) * | 2020-05-22 | 2023-10-03 | 广东科学技术职业学院 | Data fusion method and system based on data center |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104238963B (en) | A kind of date storage method, storage device and storage system | |
| CN102254029B (en) | View-based data access system and method | |
| CN106164847A (en) | Expansible business process intelligence and predictability analysis for Distributed architecture | |
| CN108932282A (en) | A kind of database migration method, apparatus and storage medium | |
| CN108228814A (en) | Method of data synchronization and device | |
| CN106844390A (en) | A kind of inter-sectional data resource cut-in method | |
| CN102663008B (en) | Government integrated business platform business library and construction method of base library | |
| CN105847336A (en) | Address book synchronization method and device | |
| CN102034152A (en) | SOA (Service Oriented Architecture) based heterogeneous software system data integration method and system | |
| Hofer | Architecture, technologies and challenges for cyber-physical systems in industry 4.0: A systematic mapping study | |
| CN109831529A (en) | A kind of integrated architecture of cloud chain number | |
| CN102339421A (en) | Decision support system for managing ecological construction | |
| CN102968373A (en) | Method and device for maintaining test system | |
| CN105095392B (en) | A kind of method and device of Data Mart data sharing | |
| CN113282599A (en) | Data synchronization method and system | |
| CN115858513A (en) | Data governance method, data governance device, computer equipment and storage medium | |
| Wu | Enterprise integration in e-government | |
| CN105701220A (en) | Internal business data system and processing method of enterprise | |
| KR20010071116A (en) | Apparatus for producing software and method for producing software | |
| CN102194156A (en) | Method and system for sci-tech novelty retrieval | |
| Perng | Hackathons and the practices and possibilities of participation | |
| CN105871659A (en) | Monitoring method and device of newly added server | |
| US20140280385A1 (en) | Hierarchical intersections | |
| CN110222032A (en) | A kind of generalised event model based on software data analysis | |
| CN111611220A (en) | File sharing method and system based on hierarchical nodes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170613 |
|
| WD01 | Invention patent application deemed withdrawn after publication |