CN111813763A - Fusion sharing platform based on diversified data - Google Patents
Fusion sharing platform based on diversified data Download PDFInfo
- Publication number
- CN111813763A CN111813763A CN202010674749.XA CN202010674749A CN111813763A CN 111813763 A CN111813763 A CN 111813763A CN 202010674749 A CN202010674749 A CN 202010674749A CN 111813763 A CN111813763 A CN 111813763A
- Authority
- CN
- China
- Prior art keywords
- data
- layer
- acquisition
- information
- fusion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000004927 fusion Effects 0.000 title claims abstract description 36
- 238000004140 cleaning Methods 0.000 claims abstract description 24
- 238000006243 chemical reaction Methods 0.000 claims description 26
- 238000007726 management method Methods 0.000 claims description 13
- 238000005516 engineering process Methods 0.000 claims description 12
- 230000005540 biological transmission Effects 0.000 claims description 6
- 230000007246 mechanism Effects 0.000 claims description 6
- 210000001503 joint Anatomy 0.000 claims description 5
- 210000000056 organ Anatomy 0.000 claims description 4
- 238000012549 training Methods 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims description 3
- 239000000463 material Substances 0.000 claims description 3
- 239000013589 supplement Substances 0.000 claims description 3
- 238000012546 transfer Methods 0.000 claims description 3
- 230000008030 elimination Effects 0.000 claims 1
- 238000003379 elimination reaction Methods 0.000 claims 1
- 238000004458 analytical method Methods 0.000 abstract description 5
- 238000013480 data collection Methods 0.000 abstract description 5
- 230000010354 integration Effects 0.000 abstract description 4
- 238000000034 method Methods 0.000 description 18
- 230000008569 process Effects 0.000 description 13
- 239000000306 component Substances 0.000 description 11
- 238000012545 processing Methods 0.000 description 8
- 238000011161 development Methods 0.000 description 7
- 238000010276 construction Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000007115 recruitment Effects 0.000 description 4
- 208000027418 Wounds and injury Diseases 0.000 description 3
- 230000006378 damage Effects 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 230000036541 health Effects 0.000 description 3
- 208000014674 injury Diseases 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000013500 data storage Methods 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000011835 investigation Methods 0.000 description 2
- 230000001737 promoting effect Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000009960 carding Methods 0.000 description 1
- 239000008358 core component Substances 0.000 description 1
- 230000002354 daily effect Effects 0.000 description 1
- 238000013075 data extraction Methods 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 238000013210 evaluation model Methods 0.000 description 1
- 238000012854 evaluation process Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 239000002360 explosive Substances 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000009472 formulation Methods 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 210000003462 vein Anatomy 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/26—Government or public services
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Tourism & Hospitality (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Marketing (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- General Business, Economics & Management (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Development Economics (AREA)
- Educational Administration (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Computational Linguistics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a fusion sharing platform based on diversified data, which collects resident information in multiple dimensions and the like, preliminarily establishes a big data service cloud platform based on population information, realizes fusion, sharing and application analysis of data of all departments, adopts unified technical standards and business specifications, deploys and operates according to a hierarchical mode, realizes integration communication, service linkage and integrated application based on the fusion and sharing platform among various levels, establishes systems for data collection, cleaning, resource exchange and sharing and the like, and establishes a public data exchange and sharing service system covering the whole city through internal and external network services to realize sharing, disclosure and standardization of information resources. Data are activated through business application, and all-round data resource service is provided for the masses, government departments, enterprises and the like.
Description
Technical Field
The invention belongs to the field of data processing, and particularly relates to a fusion sharing platform based on diversified data.
Background
With the rapid development of the internet, cloud computing, the internet of things and the like and the rapid popularization of video monitoring, intelligent terminals, application stores and the like, the global data volume has explosive growth, and the development of the big data industry in China faces the first difficult problems of data island standing and information fusion difficulty.
At present, sharing is a very important guiding concept, in order to promote big data fusion sharing, resolve the respective construction of information systems among departments, operate data in a closed manner, integrate the data acquisition requirements of departments such as poverty relief office, immigration office, human and social office, comprehensive administration, civil and administrative office, health and metering office and the like, realize one-round acquisition and multi-department data acquisition linkage mode, comprehensively promote the data resource carding of each relevant department in our province by building a unified fusion sharing platform, and finish the multi-dimensional data acquisition of all the residents; a normal state mechanism of data acquisition is set up; promoting a government data multidimensional exchange sharing mechanism; the current trend is to preliminarily complete the fusion and sharing of basic data of departments such as employment, civil administration, poverty alleviation, social security, immigration, and health and metering.
Disclosure of Invention
The purpose of the invention is as follows: the invention provides a fusion sharing platform based on diversified data, which can quickly, conveniently and effectively realize the input of single data, save the time cost of registered personnel and improve the capability of government electronic government affairs.
The technical scheme is as follows: a fusion sharing platform based on diversified data comprises a data acquisition layer, a data cleaning conversion layer, a data layer and an application layer;
the data acquisition layer realizes the data acquisition function and adopts various acquisition modes to meet the data acquisition requirements of different IT systems of data access units under specific current situations; meanwhile, an exception handling mechanism in the data transmission process is guaranteed; the collected data is stored in a temporary library of the exchange sharing platform;
the data cleaning conversion layer cleans data information in a temporary library of the exchange sharing platform, realizes the cleaning function of the acquired data, and provides different cleaning conversion components to meet the requirements of different formats and different content data conversion; the system simultaneously provides a data loading function, cleans and converts the completed data, and loads the data to a data center of the shared platform;
the data layer consists of a basic database, a special topic database and a government affair data master right database; wherein: the basic database is a foundation for sharing internal data information and opening external information of each unit IT system, and mainly comprises a personnel basic database, regional information and household basic information; the special subject database is established on a basic database, and forms a special subject database data basic database facing different fields according to the special subject service requirements; the government affair data master right library is collected and collected examination and approval data information of each organ unit;
the application layer comprises a first service application, and data of the data layer is activated and perfected; second, the application of data fusion and sharing;
the data acquisition layer, the data cleaning conversion layer, the data layer and the application layer operate on the basis of a data support system.
Specifically, the data collection includes data collection of government affairs resources and data collection of social resources.
Specifically, the data acquisition utilizes questionnaire recognition technology scanning software based on OCR to realize the scanning recognition acquisition of paper questionnaire data; the collected content comprises personal basic information, transfer employment intention and professional skill training requirements, poverty information, participation information and the like; the data are uploaded to a database management platform in an online or offline acquisition mode, and the storage and statistics of the data are realized.
Specifically, the cleaning conversion component comprises a format conversion component, a character conversion component, duplication removal, escape, combination and calculation.
Specifically, the data support system comprises a hardware operating environment and a system software operating environment.
Specifically, the data acquisition layer realizes the data acquisition function, and acquires data in various modes such as original system data arrangement and cleaning, newly-built system data interface butt joint, platform acquisition software, OCR paper material data acquisition and the like.
Specifically, the exchange sharing platform automatically checks data before warehousing and returns data sources for problematic data.
Specifically, the business layer application generates a lot of real and effective data, and the application system submits the data to the data layer through the interface to supplement, correct and activate the data.
Compared with the prior art, the invention has the beneficial effects that: through the collection to data, for the secondary operation utilization of data provides the basis, realize the fusion and the interaction of data, avoided the secondary collection of data, solved the situation that splits each other between the data in the past, reduced government data acquisition expenditure, promoted the operating efficiency of government. The data support system provides data updating and rich and perfect data service, single data can be quickly, conveniently and effectively input, the problems that data statistics is not in place and the data input process is complicated in the past are solved, the time cost of registrars is saved, the capacity of government electronic government affairs is improved, and the resource utilization efficiency is effectively improved. Meanwhile, the data application system carries out secondary processing and application on the basic data, can generate benefits and has a great imagination space in the future. The requirements of national economy and social development trend are met, and the economy is increased while the living comfort of people is improved.
The government basic data acquisition and storage cost is reduced; the system can provide query and retrieval services for each unit, and does not need to install a plurality of different systems to query respective data like the prior chimney type, thereby greatly saving the administrative data searching cost. Meanwhile, the traditional data acquisition modes are respectively administrative, each survey and acquisition only serves the department, the data acquisition has certain limitation, and more homogeneous data exist. The invention solves the problem of repeated data acquisition by one-time centralized acquisition and saves the cost of government data acquisition.
Under the support of unified technical standards and business specifications, systems for data acquisition, data cleaning, resource exchange sharing and the like are established, and a public data exchange sharing service system covering the whole city is established through internal and external network services; the data requirements of a plurality of doors are analyzed and fused, the fusion and sharing of the data are realized, and the original single data acquisition mode is changed. And realizing dynamic update of data, and realizing real-time update and replacement of data by using system software. The method has wide business application, can better help governments to apply data resource management and service the masses, and realizes data poverty alleviation.
Drawings
FIG. 1 is a data fusion and sharing platform architecture;
FIG. 2 is a schematic diagram of a platform data ensemble application architecture.
Detailed Description
The technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1-2, a fusion sharing platform based on diversified data includes a data acquisition layer, a data cleaning conversion layer, a data layer, and an application layer;
(1) data acquisition layer
The data acquisition function is realized, including the data acquisition of government affair resources and the data acquisition of social resources, and various acquisition modes are provided to meet the data acquisition requirements of different IT systems of data access units under specific current conditions. The method ensures the execution efficiency of data acquisition, processes exception and achieves reasonable utilization of resources.
The acquisition mode is to acquire data by various modes such as original system data arrangement and cleaning, newly-built system data interface butt joint, platform acquisition software, OCR paper material data acquisition and the like.
Aiming at data format errors, data logic errors and the like occurring in the data transmission process, the platform automatically checks the data before warehousing and returns data sources with problems.
(2) Data cleansing translation layer
Realize the cleaning function of data collection, provide abundant washing conversion components, if: format conversion component, character conversion component, de-duplication, escape, merging, calculation, etc.; so as to meet the requirements of different formats and different content data conversion. The system simultaneously provides a data loading function, and the data after the cleaning conversion is completed can be timely, efficiently and correctly loaded to the target storage center.
(3) Data layer
The platform data layer mainly comprises a basic database, a thematic database and a government affair data master right database. Wherein:
a basic database: the basic database is the foundation of each unit IT system, internal data information sharing and external information opening, and is also an important basis for constructing thematic application. The part mainly comprises a personnel basic database, regional information and household basic information. The basic database is the core of data association, forms a special subject database aiming at employment, training, participation insurance and the like, and can be seen clearly by connecting the basic database and each special subject database in series, and the single value is very small.
A special subject database: establishing on a basic database, and forming special subject database data facing different fields according to special subject service requirements, such as: keeping the health of children and residents, etc.
The government affair data master right library: collected approval data information of each organ unit and the like are collected.
(4) Application layer
The application layer comprises contents of 2 aspects, one is service application, and data layer data is activated and perfected; one is data fusion and sharing application, business application can generate a lot of real and effective data, and an application system submits the data to a data layer through an interface to supplement, correct and activate the data.
The construction of the basic support environment of the data fusion sharing platform follows the relevant standards, including two contents of a hardware operation environment and a system software operation environment.
The hardware operating environment comprises: computing resources, network resources, storage resources, and the like. The computing resources are mainly various servers and provide computing power for the big data fusion and sharing platform. The storage resource provides data storage service for various information resources, and a local disk or a disk array can be adopted.
The software running environment comprises: databases, application middleware and other middleware and functional components, etc.
From the whole, basic information, poverty relief information, labor force information, employment information, entrepreneurship information, special crowd information and the like of residents are collected in multiple dimensions. And a big data service cloud platform based on population information is established preliminarily, and fusion, sharing and application analysis of data of all departments are realized. The method mainly aims to solve the problems of repeated dispersion of information construction, uneven information level and the like of each organ unit and realize data sharing and reutilization. The needs of big data industry development and smart city construction are combined, and specific contents include:
(1) centralized collection and error investigation of family information and population information data: on one hand, data acquisition software, namely civil data acquisition software, is developed, and data acquisition personnel acquire data on site by using the software. And on the other hand, scanning software is developed by using an OCR-based questionnaire recognition technology, so that scanning, recognizing and collecting of paper questionnaire data are realized. The collected content comprises personal basic information, transfer employment intention and professional skill training requirements, poverty information, participation information and the like. The data are uploaded to a database management platform in an online or offline acquisition mode, and the storage and statistics of the data are realized.
(2) Big data fusion and sharing platform: the big data fusion and sharing platform is the basis for realizing the secondary utilization of data. The platform functions include: the platform comprises data acquisition, data processing, data conversion, data exchange, data comparison, data summarization, data pushing, data merging, data loading, data scheduling and the like, and the platform can realize processing and utilization of data, and external exchange and sharing service of the data; on one hand, the data resources are deposited through the platform, and on the other hand, favorable supporting capability is provided for forming a complete data application thematic information chain.
(3) The data dynamic updating system comprises: and developing data dynamic update software to realize dynamic update of village-level workers on data, and writing back the data of the business handling system to the big data center. The data dynamic updating system realizes timely updating and replacing of data, ensures the correctness of the data, and has great significance for secondary development and utilization of the data.
(4) Dynamic real-name system management system: the project dynamic real-name system management system utilizes the biological characteristic identification technologies such as the face identification technology, the finger vein identification technology and the like to develop an identity authentication system, realizes the integration of dynamic identity authentication services, ensures the synchronism of the authentication result of the insured user and the information of the insured user, and solves the problem of delay of the authentication result reflection of the identity authentication data. The dynamic real-name management system is used for realizing the offline registration of personnel, the export of registered data, the daily attendance check-in management, the information identification of the industrial injury personnel and the check-in work of the industrial injury department management personnel on the attendance information of the industrial injury insurance personnel and various statistical reports.
(5) The social security card system card data acquisition system comprises: firstly, a data acquisition mode of the social security card based on the internet is used for developing a special USBKey as a data acquisition terminal to realize the basic information input of the security personnel. Secondly, the system manages the acquisition points and the data quality, and ensures that qualified card making data is correctly imported into a card system of a social security department. Meanwhile, the function of feeding back information such as warehousing results, bank card making results and the like to the social security card making data acquisition system is realized. Specifically, the system has the functions of color unified management, automatic image cutting, automatic color mixing, automatic background removing, automatic detection, searching and positioning, system acceptance of various portrait data sources, simple and friendly system interface, manual intervention, authority management, automatic control of a digital camera and the like, and forms a complete card making process of social security card data acquisition, data warehousing and social security card issuing. The effects of improving the data acquisition efficiency of the social security card making, improving the data accuracy of the social security card making and promoting the application of the smart cloud are achieved.
(6) Key child early warning system of keeping on: firstly, the unattended child service system needs to realize a data extraction function and can extract unattended child information from a big data fusion and sharing system. And secondly, a corresponding algorithm is arranged in the left-behind child service system, so that the risk level assessment of the left-behind child is realized. Meanwhile, the system needs to have functions of data conversion, data summarization and the like, writing of risk level evaluation results is achieved, and classified division of left-behind children is achieved. In addition, the system needs to have a function of dynamic management. By constructing the left-behind child service system, the risk potential of left-behind children in the district can be eliminated in time, so that various policy measures for caring, rescuing and protecting the left-behind children are implemented in place in time.
(7) Construction of employment service system: firstly, the system is in butt joint with a big data fusion and sharing system to realize extraction of employment information. Secondly, analysis of employment information user portrait is achieved through a mathematical model. And then, the system has a human unit interface to realize the acquisition of the recruitment information. And finally, realizing the function of accurately pushing the recruitment information to the related personnel. The employment service system collects the skills and job hunting intentions of the personnel in a multidimensional way, can realize the matching analysis of the recruitment post and the job hunting personnel, and realizes the function of accurately recommending the positions. Meanwhile, the employment service system reduces the problem of asymmetry of job hunting and recruitment information and effectively promotes employment of personnel.
(8) And (3) building a resident credit system: firstly, the system is in butt joint with a big data fusion and sharing system, and extraction of dimensional data of residents is achieved. And secondly, by applying technologies such as data mining, artificial intelligence and the like, bringing more data except credit records into a credit investigation system, establishing a system evaluation model, and realizing the analysis of the credit portrait of the user. Meanwhile, a credit platform is established, and credit rating information is output.
Based on Service Oriented Architecture (SOA)
Service Oriented Architecture (SOA) is an application framework that focuses on everyday business applications and divides them into individual business functions and flows, so-called services. The SOA enables users to build, deploy and integrate the services without depending on application programs and running computing platforms thereof, thereby improving the flexibility of business processes. The flexibility of the service can accelerate the development speed of enterprises, reduce the total cost of ownership and improve the access to timely and accurate information. SOA facilitates more asset reuse (integration of legacy systems), easier management, and faster development and deployment.
XML-based data exchange
And designing a data bus, an assembly bus and a system control bus on the basis of xml, and realizing data assembly and meta-information description of basic services such as flexible data flow and business rules of the system.
Firstly, a data bus based on an xml technology provides data integration service including operations of extraction, conversion, transmission, loading and the like for interconnection and intercommunication among different databases of cross-region, cross-department and cross-application systems; by utilizing data exchange, the problem of timely and efficient uploading and issuing of data among departments at all levels can be effectively solved, data exchange and information sharing based on different transmission protocols among different mechanisms, different application systems and different databases can be quickly realized, and a good data environment is provided for various applications and decision support.
Secondly, the assembly bus based on the xml technology is mainly used for expressing various system data models and business rules, separating business requirements from technical implementation and rapidly realizing various business requirements.
The control bus based on the xml technology is mainly used for starting various rule engines and workflow engines, calling of various components and calling of component connection rules are achieved, and therefore building and reconstruction of a function model are achieved. For a particular enterprise application, there are many rules and workflows that are corporate and distinct from other companies. Through the design idea of the control bus, the specific rules and business logic of the company can be separated and also made into a component form. On one hand, the method greatly increases the reusability of software, and on the other hand, the method has great flexibility in the formulation and modification of the rule base of the company, but does not influence the modification of program codes.
AJAX-based multi-layer architecture
AJAX (asynchronous JavaScript and XML) is a synthesis of multiple technologies, and uses XHTML and CSS standardized presentation, DOM to realize dynamic display and interaction, XML and XSTL to exchange and process data, XMLHttpRequest object to read asynchronous data, and Javascript to bind and process all data.
At the core of AJAX is the JavaScript object XMLHttpRequest. This object was first introduced in Internet Explorer 5, a technology that supports asynchronous requests. In short, XMLHttpRequest makes it possible for you to make requests to the server and process responses using JavaScript without blocking the user.
The data flow of the data resource in the platform can be divided into the following processes:
(1) the data acquisition process comprises the following steps: data of an access unit are acquired in multiple modes, the acquisition modes can provide two modes of pushing and pulling according to different application scenes, and the system requirements meet the acquisition processing of different time periods, such as: the abnormal handling mechanism of the data transmission process is guaranteed in real time according to the requirements of hours, days, months and the like; the collected data is stored in a temporary library of the exchange sharing platform;
(2) and (3) data cleaning process: and cleaning data information in a temporary library of the exchange sharing platform, wherein the data cleaning and conversion are core components of the platform, and the cleaned and converted data are loaded to a data center. The system has data processing and exchanging capacity and is responsible for acquiring data of the front-end processor, cleaning, processing and processing the data, and finally loading the processed data to a big data fusion and sharing platform by combining with the data storage standard requirement;
(3) and (3) data exchange process: through various exchange means and safety exchange requirements, on one hand, basic information support is provided for an IT system of an access unit, and the data is acquired by the access unit; another aspect provides support data for a data topic application; finally, data support is provided for external data display of the data sharing service;
(4) and (3) a data sharing process: providing external data display of governments, enterprises, individuals and the like, and providing related functions such as directory retrieval, information query and the like;
(5) and (3) effect evaluation process: and evaluating the using effects of thematic display effect, data quality, satisfaction degree and the like in the using process of the user, and directly feeding the evaluation result back to the data center.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention.
Claims (8)
1. A fusion sharing platform based on diversified data is characterized in that: the system comprises a data acquisition layer, a data cleaning conversion layer, a data layer and an application layer;
the data acquisition layer realizes the data acquisition function and adopts various acquisition modes to meet the data acquisition requirements of different IT systems of data access units under specific current situations; meanwhile, an exception handling mechanism in the data transmission process is guaranteed; the collected data is stored in a temporary library of the exchange sharing platform;
the data cleaning conversion layer cleans data information in a temporary library of the exchange sharing platform, realizes the cleaning function of the acquired data, and provides different cleaning conversion components to meet the requirements of different formats and different content data conversion; the system simultaneously provides a data loading function, cleans and converts the completed data, and loads the data to a data center of the shared platform;
the data layer consists of a basic database, a special topic database and a government affair data master right database; wherein: the basic database is a foundation for sharing internal data information and opening external information of each unit IT system, and mainly comprises a personnel basic database, regional information and household basic information; the special subject database is established on a basic database, and forms a special subject database data basic database facing different fields according to the special subject service requirements; the government affair data master right library is collected and collected examination and approval data information of each organ unit;
the application layer comprises a first service application, and data of the data layer is activated and perfected; second, the application of data fusion and sharing;
the data acquisition layer, the data cleaning conversion layer, the data layer and the application layer operate on the basis of a data support system.
2. The fusion sharing platform based on diversified data according to claim 1, wherein: the data acquisition comprises data acquisition of government affair resources and data acquisition of social resources.
3. The fusion sharing platform based on diversified data according to claim 1, wherein: the data acquisition utilizes questionnaire recognition technology scanning software based on OCR to realize scanning recognition acquisition of paper questionnaire data; the collected content comprises personal basic information, transfer employment intention and professional skill training requirements, poverty information, participation information and the like; the data are uploaded to a database management platform in an online or offline acquisition mode, and the storage and statistics of the data are realized.
4. The fusion sharing platform based on diversified data according to claim 1, wherein: the cleaning conversion component comprises a format conversion component, a character conversion component, duplication elimination, escape, combination and calculation.
5. The fusion sharing platform based on diversified data according to claim 1, wherein: the data support system comprises a hardware operating environment and a system software operating environment.
6. The fusion sharing platform based on diversified data according to claim 1, wherein: the data acquisition layer realizes the data acquisition function and acquires data in various modes such as original system data arrangement and cleaning, newly-built system data interface butt joint, platform acquisition software, OCR paper material data acquisition and the like.
7. The fusion sharing platform based on diversified data according to claim 1, wherein: and the exchange sharing platform automatically checks the data before warehousing and returns the data source to the data with problems.
8. The fusion sharing platform based on diversified data according to claim 1, wherein: the business layer application can generate a lot of real and effective data, and the application system submits the data to the data layer through the interface to supplement, correct and activate the data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010674749.XA CN111813763A (en) | 2020-07-14 | 2020-07-14 | Fusion sharing platform based on diversified data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010674749.XA CN111813763A (en) | 2020-07-14 | 2020-07-14 | Fusion sharing platform based on diversified data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111813763A true CN111813763A (en) | 2020-10-23 |
Family
ID=72843402
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010674749.XA Pending CN111813763A (en) | 2020-07-14 | 2020-07-14 | Fusion sharing platform based on diversified data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111813763A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112766878A (en) * | 2020-12-30 | 2021-05-07 | 贵州人和致远数据服务有限责任公司 | Digital country population information management system based on big data technology processing mode |
| CN113822557A (en) * | 2021-09-08 | 2021-12-21 | 中国电子科技集团公司信息科学研究院 | Data fusion management system, data fusion management device, electronic device, and medium |
| CN114119316A (en) * | 2021-11-16 | 2022-03-01 | 浪潮卓数大数据产业发展有限公司 | Comprehensive management method and system for community basic level data |
| CN115481108A (en) * | 2022-09-19 | 2022-12-16 | 北京三维天地科技股份有限公司 | Management method and system for same data among different departments |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104463472A (en) * | 2014-12-12 | 2015-03-25 | 江阴中科今朝科技有限公司 | Electronic government platform system |
| CN106127657A (en) * | 2016-07-06 | 2016-11-16 | 成都丰窝科技有限公司 | A kind of municipal government hot line platform for data arrangement |
| CN106855962A (en) * | 2015-12-09 | 2017-06-16 | 星际空间（天津）科技发展有限公司 | A kind of method for building government affairs big data platform |
| CN109685697A (en) * | 2018-11-09 | 2019-04-26 | 贵州优易合创大数据资产运营有限公司 | Government data shared platform block catenary system based on the publication of multidisciplinary Data Integration |
-
2020
- 2020-07-14 CN CN202010674749.XA patent/CN111813763A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104463472A (en) * | 2014-12-12 | 2015-03-25 | 江阴中科今朝科技有限公司 | Electronic government platform system |
| CN106855962A (en) * | 2015-12-09 | 2017-06-16 | 星际空间（天津）科技发展有限公司 | A kind of method for building government affairs big data platform |
| CN106127657A (en) * | 2016-07-06 | 2016-11-16 | 成都丰窝科技有限公司 | A kind of municipal government hot line platform for data arrangement |
| CN109685697A (en) * | 2018-11-09 | 2019-04-26 | 贵州优易合创大数据资产运营有限公司 | Government data shared platform block catenary system based on the publication of multidisciplinary Data Integration |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112766878A (en) * | 2020-12-30 | 2021-05-07 | 贵州人和致远数据服务有限责任公司 | Digital country population information management system based on big data technology processing mode |
| CN113822557A (en) * | 2021-09-08 | 2021-12-21 | 中国电子科技集团公司信息科学研究院 | Data fusion management system, data fusion management device, electronic device, and medium |
| CN114119316A (en) * | 2021-11-16 | 2022-03-01 | 浪潮卓数大数据产业发展有限公司 | Comprehensive management method and system for community basic level data |
| CN115481108A (en) * | 2022-09-19 | 2022-12-16 | 北京三维天地科技股份有限公司 | Management method and system for same data among different departments |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111813763A (en) | Fusion sharing platform based on diversified data | |
| CN107730430A (en) | Production, teaching ＆ research public service system based on big data | |
| CN111814200A (en) | Automatic digital government affair service system based on block chain technology | |
| Li et al. | Granularity decision of microservice splitting in view of maintainability and its innovation effect in government data sharing | |
| CN114218291A (en) | Portrait generation method, apparatus, device and storage medium based on target object | |
| Klischewski | Top down or bottom up? How to establish a common ground for semantic interoperability within e-government communities | |
| Zhang et al. | Pattern recognition of construction bidding system based on image processing | |
| CN116450575A (en) | File informatization management archiving system based on deep learning network | |
| Yusifov | Using public registers for development of electronic demography system: The case of Azerbaijan | |
| CN111291029B (en) | Data cleaning method and device | |
| CN110134667B (en) | Population basic database based on big data technology | |
| CN114490568A (en) | Cross-domain database integration and migration method and system | |
| Xian et al. | From bureaucratic coordination to a data-driven model: transformation and capacity building of community-based prevention and control of public health events | |
| Schwitter | Bridging the offline and online: 20 years of offline meeting data of the German-language Wikipedia | |
| CN113011838A (en) | Market main body registration intelligent approval system based on preset rule data verification | |
| Yang | Human resource big data analysis and decision making of group enterprises based on cloud platform | |
| Zhang et al. | Smart Campus Economy One‐Card Management Mode Based on the Integration of Big Data and Cloud Computing | |
| Feng | Internet use, risk attitude and willingness for individual entrepreneurship | |
| Xu et al. | Big Data Management and Service | |
| Wang et al. | Research and design of college student classification Management information system based on Big data technology | |
| Gao | Research on the Application of Big Data in Security Information Collection | |
| CN116484054B (en) | Data processing method and related device | |
| Dong | Research on the application of big data in community smart service | |
| Song | Exploring the development of Chinese digital resources under lightweight deep learning | |
| Loughnane et al. | Rethinking the call for a US National data Center in the 1960s: Privacy, social Science research, and data fragmentation viewed from the perspective of contemporary archival theory |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201023 |