CN112287275A - City-class data middle platform - Google Patents
City-class data middle platform Download PDFInfo
- Publication number
- CN112287275A CN112287275A CN202011173983.0A CN202011173983A CN112287275A CN 112287275 A CN112287275 A CN 112287275A CN 202011173983 A CN202011173983 A CN 202011173983A CN 112287275 A CN112287275 A CN 112287275A
- Authority
- CN
- China
- Prior art keywords
- data
- platform
- sub
- level
- sharing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007726 management method Methods 0.000 claims abstract description 54
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 18
- 238000013523 data management Methods 0.000 claims abstract description 17
- 238000000034 method Methods 0.000 claims abstract description 13
- 238000012545 processing Methods 0.000 claims description 16
- 238000004458 analytical method Methods 0.000 claims description 13
- 238000011161 development Methods 0.000 claims description 11
- 230000008569 process Effects 0.000 claims description 10
- 239000008280 blood Substances 0.000 claims description 8
- 210000004369 blood Anatomy 0.000 claims description 8
- 230000002776 aggregation Effects 0.000 claims description 5
- 238000004220 aggregation Methods 0.000 claims description 5
- 238000007781 pre-processing Methods 0.000 claims description 5
- 230000002265 prevention Effects 0.000 claims description 4
- 238000013135 deep learning Methods 0.000 claims description 3
- 230000004927 fusion Effects 0.000 claims description 3
- 238000010801 machine learning Methods 0.000 claims description 3
- 230000010365 information processing Effects 0.000 abstract description 2
- XXQCMVYBAALAJK-UHFFFAOYSA-N ethyl n-[4-[benzyl(2-phenylethyl)amino]-2-(2-phenylethyl)-1h-imidazo[4,5-c]pyridin-6-yl]carbamate Chemical compound N=1C=2C(N(CCC=3C=CC=CC=3)CC=3C=CC=CC=3)=NC(NC(=O)OCC)=CC=2NC=1CCC1=CC=CC=C1 XXQCMVYBAALAJK-UHFFFAOYSA-N 0.000 description 10
- 238000003860 storage Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 4
- 238000013473 artificial intelligence Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000008520 organization Effects 0.000 description 3
- 238000012550 audit Methods 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000011068 loading method Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013070 change management Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013075 data extraction Methods 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000011282 treatment Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/26—Government or public services
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- Data Mining & Analysis (AREA)
- Human Resources & Organizations (AREA)
- Economics (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Entrepreneurship & Innovation (AREA)
- General Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Operations Research (AREA)
- Development Economics (AREA)
- Educational Administration (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides an urban data middle station, which relates to the technical field of information processing and comprises the following steps: the regional data resource center is used for acquiring and storing regional big data to form a regional data lake; the data management sub-platform is used for extracting the area-level big data and performing data management to form a basic library and a subject library so as to perform data resource management on the area-level big data; the data sharing and exchanging sub-platform is used for realizing data exchange between the regional data resource center and the data management sub-platform and realizing data sharing of the regional data resource center; the artificial modeling sub-platform is used for providing a basic algorithm model for the data governance sub-platform and upper-layer application; and the big data support sub-platform is used for providing data warehouse software for the district level data resource center and providing a support platform component for the data management sub-platform and the data sharing exchange sub-platform. The method has the advantages that the data sharing exchange sub-platform is established, and sharing exchange of the zone-level big data in the zone-level resource center is achieved.
Description
Technical Field
The invention relates to the field of information processing, in particular to an urban data center.
Background
The data center platform is a data application development portal and has the functions of covering the whole process of data application development in a closed loop mode, completely covering off-line calculation, real-time calculation application and the like. The method can meet the requirements of developers on data acquisition, data analysis, data mining, data quality, data maps, data models and data API application in each level. However, in the existing data center, the big data basic component is difficult to support streaming processing and comprehensive search, the intelligent auxiliary capacity in demand management, change management and task management in data sharing management is not strong enough, the aspects of metadata management, data cataloging, main data management and blood relationship analysis in data management are not strong enough, and the requirements of the city-level data center are difficult to meet.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides an urban data middle station, which specifically comprises the following steps:
the regional data resource center is used for acquiring regional big data and classifying and storing the regional big data to form a regional data lake;
the data management sub-platform is connected with the district-level data resource center and used for extracting the district-level big data from a district-level data lake of the district-level data resource center, performing data management on the district-level big data to form a basic library and a subject library to be stored in the district-level data resource center, and further performing data resource management on the district-level big data;
the data sharing and exchanging sub-platform is respectively connected with the district-level data resource center and the data administration sub-platform and is used for realizing data exchange between the district-level data resource center and the data administration sub-platform and realizing data sharing of the district-level data resource center;
the artificial modeling sub-platform is connected with the data governance sub-platform and is used for building an artificial intelligent modeling and scheduling platform, providing a mainstream machine learning and deep learning algorithm library and providing a basic algorithm model library for the data governance sub-platform and upper application;
and the data administration sub-platform and the data sharing exchange sub-platform are used for providing data warehouse software for the data resource center of the district-level data resource center area level and providing a support platform assembly for the data administration sub-platform and the data sharing exchange sub-platform to support the whole city-level data middle platform.
Preferably, the system further comprises a data resource management portal connected with the regional data resource center and used for allowing managers to interface government affair information sharing websites and supply and demand systems and provide data sharing to the sharing websites and the supply and demand systems through the regional data resource center.
Preferably, the data governance comprises a data preprocessing process, the data preprocessing process comprising:
data tagging, and/or data fusion, and/or data cleansing, and/or data quality management, and/or data aggregation.
Preferably, the data resource management includes:
metadata management, and/or data criteria management, and/or data quality management, and/or data blood source analysis, and/or data cubes.
Preferably, the data governance sub-platform further comprises a data modeling process, and the data governance sub-platform performs data modeling according to the algorithm model in the basic algorithm model library provided by the manual modeling sub-platform.
Preferably, the theme library includes:
the system comprises a traffic subject library, and/or an environment-friendly subject library, and/or an emergency command subject library, and/or a flood prevention station subject library, and/or a key scenic spot subject library, and/or a city management subject library.
Preferably, the support platform assembly comprises:
a line processing component, and/or a stream processing component, and/or a full text retrieval component, and/or a data development component, and/or a resource management component, and/or a security control component.
Preferably, the system further comprises a security protection module, which is respectively connected to the district-level data resource center, the data sharing exchange sub-platform, the data administration sub-platform and the big data support sub-platform, and is used for providing information security guarantee for the district-level data resource center, the data sharing exchange sub-platform, the data administration sub-platform and the big data support sub-platform.
Preferably, the data sharing exchange sub-platform comprises:
the first sharing unit is used for realizing data sharing between tenants of the basic library and the subject library in the regional data resource center;
and the second sharing unit is used for providing external service release and utilization for the outside of the city level data middlebox.
The technical scheme has the following advantages or beneficial effects:
the data sharing exchange sub-platform is established to realize the sharing exchange of the region-level big data in the region-level resource center, and the region-level data resource center is established, the basis and the conditions of government affair business and urban management are combined, the cross-department, cross-industry and cross-system application are taken as the key points, the data processing capacity is continuously improved, the data value increment is realized, and the government is promoted to further improve the administrative efficiency and the management level of refined and intelligent services.
Drawings
Fig. 1 is a schematic diagram of a structure of a city-level data center in a preferred embodiment of the present invention.
Detailed Description
The invention is described in detail below with reference to the figures and specific embodiments. The present invention is not limited to the embodiment, and other embodiments may be included in the scope of the present invention as long as the gist of the present invention is satisfied.
In a preferred embodiment of the present invention, based on the above problems existing in the prior art, there is provided an urban data center, as shown in fig. 1, specifically including:
the regional data resource center 1 is used for acquiring regional big data and classifying and storing the regional big data to form a regional data lake 11;
the data management sub-platform 3 is connected with the area-level data resource center 1 and used for extracting area-level big data from the area-level data resource center 1, performing data management on the area-level big data to form a basic library 12 and a subject library 13 to be stored in the area-level data resource center 1, and performing data resource management on the area-level big data;
the data sharing exchange sub-platform 2 is respectively connected with the area-level data resource center 1 and the data administration sub-platform 3 and is used for realizing data exchange between the area-level data resource center 1 and the data administration sub-platform 3 and realizing data sharing of the area-level data resource center 1;
the artificial modeling sub-platform 5 is connected with the data governance sub-platform 3 and is used for building an artificial intelligent modeling and scheduling platform, providing a mainstream machine learning and deep learning algorithm library and providing a basic algorithm model library for the data governance sub-platform 3 and upper application;
and the big data support sub-platform 4 is respectively connected with the district-level data resource center 1, the data administration sub-platform 3 and the data sharing exchange sub-platform 2, and is used for providing data warehouse software for the district-level data resource center and providing a support platform assembly 41 for the data administration sub-platform 3 and the data sharing exchange sub-platform 2 so as to support the whole city-level data middle platform.
Specifically, in this embodiment, the regional data resource center 1 includes three major parts, namely, a regional data lake 11, a basic library 12, and a theme library 13, and is a result formed by data access, data aggregation, and data governance. The data governance sub-platform 3 extracts the region-level big data from the region-level data lake 11, performs data governance on the region-level big data to form a basic library 12 and a theme library 13 to be stored in the region-level data resource center 1, and performs data resource management on the region-level big data. The data governance sub-platform 3 ensures the specification of data in the regional data lake 11 in the regional data resource center 1 through data governance, and constructs a basic library 12 and a theme library 13 according to a higher-level management mechanism. Through the data governance of the data governance sub-platform 3, the development of data management functions such as government affairs, internet of things and video data architectures, data standards and data development can be guaranteed, and meanwhile, the data management level is improved.
The data in the regional data resource center 1 covers all entrusted office departments, and the data sources comprise city-level data, regional government affair data, internet of things equipment data, video data and the like. Corresponding databases and data storage structures need to be designed to meet the storage requirements of multi-source heterogeneous structured data, semi-structured data and unstructured data, support government affair data sharing and exchanging requirements, support training requirements of urban application algorithm models and support data requirements of upper application systems.
The data governance sub-platform 3 is an important tool for data governance and data management, can integrate metadata assets of each link of the platform so as to browse and analyze metadata, and is also a source for forming a data resource management portal. The platform needs to provide a visual metadata management tool to meet the requirements of checking the metadata of the library table, checking the blood relationship and influence among the data and analyzing the dependency relationship among the data.
The data governance sub-platform 3 comprises a metadata management tool, a data standard management tool, a data quality management tool, a data blood source analysis tool, a data Cube design work and the like, and is used for supporting data extraction from the regional data lake 11 as required, Cube modeling and data governance are carried out according to established data standards, business models and the like to form a base library 12 and a theme library 13, and data resource management work such as metadata management and blood source analysis is carried out on data resources stored in all data resource centers. The data governance sub-platform 3 also continuously improves the big data full life cycle according to the city-level data middle platform specification, wherein the big data full life cycle comprises: aggregation, storage, integration, governance, service, and sharing. The data governance sub-platform 3 strengthens metadata management, data cataloging, main data management and blood relationship analysis in data governance, and simultaneously provides a data quality analysis tool to support the inspection of dirty data, missing values and abnormal values.
In this embodiment, the big data support sub-platform 4 serves as a bottom support of the whole big data resource platform, and has a main function of providing high-performance, high-stability and high-availability data warehouse software for the construction of the regional data lake 11 and the theme library 13 in the regional data resource center 1, and simultaneously, supports the development of the data sharing exchange sub-platform 2 and the data governance sub-platform 3 by providing the support platform component 41. Furthermore, a whole data sharing and exchanging system is established for the city-level middleboxes from multiple angles of data acquisition, data exchange, data storage, data governance, data sharing and exchange and the like.
According to the storage design of the bottom layer of the platform and the analysis of the service characteristics of the platform, the technical scheme adopts a Hadoop ecosystem to design the scheme of the big data support sub-platform 4. The big data support sub-platform 4 constructed needs to be able to satisfy large-scale processing and analysis scenarios including but not limited to the following mass data in the form of product components, engines or tools: offline batch processing, real-time stream processing analysis, data concurrent query, full-text retrieval, BI analysis, interactive analysis and the like; the constructed big data support sub-platform 4 can process both structured data and unstructured and semi-structured data, and meets the loading and storage of multi-source heterogeneous data such as configuration, logs, web pages, audios and videos, IoT (Internet of things), web crawlers and the like; the platform needs to provide a complete multi-tenant function, uniformly controls and manages computing resources, storage resources and data access resources, efficiently schedules and controls the computing resources, manages quota for the storage resources and strictly manages authority for data access; the platform needs to provide a uniform visual operation and maintenance monitoring interface to perform operation and maintenance management on the aspects of installation, configuration, monitoring and alarming.
The artificial modeling sub-platform 5 provides basic artificial intelligence algorithm model base and image processing services such as entity portrait, knowledge map, edge calculation, machine vision and the like, and meanwhile, visual artificial modeling development is carried out, and support is provided for the data governance sub-platform 3 and the algorithm model applied on the upper layer.
In the technical scheme, the business of the big data resource platform relates to industry-related algorithm models of a plurality of professional video images, IoT (internet of things), label drawings, maps and the like, and an AI intelligent modeling platform needs to be introduced to perform work such as data analysis processing, algorithm model establishment, model training, model publishing, model commissioning and the like in a visual mode in consideration of the fact that government customers lack professional big data and AI technical teams. Therefore, the adopted artificial modeling sub-platform 5 needs to pass the artificial intelligence platform benchmark test of an authoritative third party standardization organization.
In this embodiment, the data sharing switching sub-platform 2 mainly includes four functions: the method comprises the following steps of exchanging data between the area and platform data, exchanging data between the area platform data and city platform data, managing and exchanging data inside the platform, and exchanging data between the area platform data and upper application data. The data sharing and exchanging sub-platform 2 develops the supporting platform assembly 41, and meanwhile, by using the infrastructure of the government affair cloud platform, data exchanging services of flexible deployment, use as required and elastic expansion are provided for managers, and data sharing and exchanging among data of all parts in the data center are achieved.
The technical scheme builds a regional data sharing exchange system, which comprises corresponding organization roles, platform tools, standard specifications and management systems. The district-level data lake 11, the basic database 12, the theme database 13, the data sharing exchange sub-platform 2, the data resource management portal 6 and the like are planned, constructed and operated and maintained by a district big data center, and each exchange front node is constructed and operated and maintained by each service department.
In a preferred embodiment of the present invention, the system further comprises a data resource management portal 6 connected to the area-level data resource center 1, for the manager to interface with the government affair information sharing website and the supply and demand system, and provide data sharing to the sharing website and the supply and demand system through the area-level data resource center 1.
Specifically, in this embodiment, the data resource management portal 6 is configured to provide services of data asset management, data organization management, data flow approval, and data security audit for data operators in the big data center and resource managers in each government department when interfacing with a government information sharing website and a supply and demand website. When the data resource management portal 6 acquires the sharing demand, each government department carries out auditing of sharing demand application, the large data center implements data sharing, and provides required data to the sharing website and the supply and demand system; the big data center and the government department in the same time zone can respectively carry out statistical analysis on the data sharing conditions of all departments and the department of the commission and office. The data resource management portal 6 is mainly used by data operators in large data centers and resource managers in government departments. The data operator of the big data center can perform the tasks of sharing, checking the application condition of department resource sharing, sharing statistics and the like. The resource management personnel of the government department (data provider) can carry out the work of examining, approving, canceling, managing and the like of resource application, and the government department (data demander) can carry out the work of checking and canceling the application resource and the work of checking and canceling the subscription resource.
In a preferred embodiment of the present invention, the data governance comprises a data preprocessing process, the data preprocessing process comprising:
data tagging, and/or data fusion, and/or data cleansing, and/or data quality management, and/or data aggregation.
In a preferred embodiment of the present invention, the data resource management comprises:
metadata management, and/or data criteria management, and/or data quality management, and/or data blood source analysis, and/or data cubes.
In a preferred embodiment of the present invention, the data governance sub-platform 3 further comprises a data modeling process, and the data governance sub-platform 3 performs data modeling according to an algorithm model provided by the artificial modeling platform 5.
Specifically, in this embodiment, the data governance sub-platform 3 performs modeling according to the basic artificial intelligence algorithm model library and the related image processing service provided by the artificial modeling platform 5 to complete the basic library 12 and the theme library 13.
In a preferred embodiment of the present invention, the theme library 13 includes:
the system comprises a traffic subject library, and/or an environment-friendly subject library, and/or an emergency command subject library, and/or a flood prevention station subject library, and/or a key scenic spot subject library, and/or a city management subject library.
Specifically, in the present embodiment, the theme library 13 and the regional data lake 11 share the bottom storage. The theme base 13 is used for storing high-quality data resources formed after a series of cleaning, conversion, loading and treatment steps are carried out according to business requirements, the data resources come from the district-level data lake 11, and a traffic theme base, an environment-friendly theme base, an emergency command theme base, a flood prevention platform theme base, a key scenic spot theme base and a city management theme base are additionally arranged in the technical scheme, so that the resources in the theme base 13 are more complete.
In the preferred embodiment of the present invention, the support platform assembly 41 comprises:
a line processing component, and/or a stream processing component, and/or a full text retrieval component, and/or a data development component, and/or a resource management component, and/or a security control component.
Specifically, in this embodiment, the big data support sub-platform 4 supports the development of the data administration sub-platform 3 and the data sharing exchange sub-platform 2 by setting a line processing component, a stream processing component, a full text retrieval component, a data development component, and a security control component.
In a preferred embodiment of the present invention, the present invention further includes a security protection module, which is respectively connected to the area-level data resource center 1, the data sharing exchange sub-platform 2, the data administration sub-platform 3, and the big data support sub-platform 4, and is configured to provide information security for the area-level data resource center 1, the data sharing exchange sub-platform 2, the data administration sub-platform 3, and the big data support sub-platform 4.
Specifically, in this embodiment, a security protection module is provided to perform systematic and equivalent 2.0-level audit on the regional data resource center 1, the data sharing and exchanging sub-platform 2, the data management sub-platform 3, and the big data support sub-platform 4, so as to ensure that the urban data middlebox meets the security requirement.
In the preferred embodiment of the present invention, the data sharing switching sub-platform 2 comprises:
the first sharing unit 21 is configured to implement data sharing between tenants in the base library 12 and the subject library 13 in the regional data resource center 1;
and the second sharing unit 22 is configured to provide external service distribution and utilization to the outside of the middle station in the city-level data.
Specifically, in the present embodiment, the external service publishing and utilization includes data support for upper applications and data feedback for each department of commission of the source.
While the invention has been described with reference to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention.
Claims (9)
1. The utility model provides a city level data middling platform which characterized in that specifically includes:
the regional data resource center is used for acquiring regional big data and storing the regional big data to form a regional data lake;
the data management sub-platform is connected with the district-level data resource center and used for extracting the district-level big data from the district-level data lake and performing data management on the district-level big data to form a basic library and a subject library to be stored in the district-level data resource center so as to perform data resource management on the district-level big data;
the data sharing and exchanging sub-platform is respectively connected with the district-level data resource center and the data administration sub-platform and is used for realizing data exchange between the district-level data resource center and the data administration sub-platform and realizing data sharing of the district-level data resource center;
the artificial modeling sub-platform is connected with the data governance sub-platform and is used for building an artificial intelligent modeling and scheduling platform, providing a mainstream machine learning and deep learning algorithm library and providing a basic algorithm model library for the data governance sub-platform and upper application;
and the data administration sub-platform and the data sharing exchange sub-platform are used for providing data warehouse software for the district-level data resource center and providing a support platform assembly for the data administration sub-platform and the data sharing exchange sub-platform so as to support the whole city-level data middle platform.
2. The city-level data center as claimed in claim 1, further comprising a data resource management portal connected to the district-level data resource center for the manager to interface with government information sharing websites and supply and demand systems, and to provide data sharing to the sharing websites and supply and demand systems through the district-level data resource center.
3. The city-level data staging platform of claim 1 wherein the data governance comprises a data preprocessing process comprising:
data tagging, and/or data fusion, and/or data cleansing, and/or data quality management, and/or data aggregation.
4. The city-level data staging platform of claim 1 wherein the data resource management comprises:
metadata management, and/or data criteria management, and/or data quality management, and/or data blood source analysis, and/or data cubes.
5. The city-level data staging platform of claim 1 wherein the data governance sub-platform further comprises a data modeling process, the data governance sub-platform performing data modeling based on the algorithm models in the base algorithm model library provided by the manual modeling sub-platform.
6. The city level data center of claim 1, wherein the topic library comprises:
the system comprises a traffic subject library, and/or an environment-friendly subject library, and/or an emergency command subject library, and/or a flood prevention station subject library, and/or a key scenic spot subject library, and/or a city management subject library.
7. The city level data center station of claim 1, wherein the support platform assembly comprises:
a line processing component, and/or a stream processing component, and/or a full text retrieval component, and/or a data development component, and/or a resource management component, and/or a security control component.
8. The city-level data center station according to claim 1, further comprising a security module, respectively connected to the district-level data resource center, the data sharing exchange sub-platform, the data administration sub-platform, and the big data support sub-platform, for providing information security for the district-level data resource center, the data sharing exchange sub-platform, the data administration sub-platform, and the big data support sub-platform.
9. The city-level data staging platform of claim 1 wherein the data sharing switching sub-platform comprises:
the first sharing unit is used for realizing data sharing between tenants of the basic library and the subject library in the regional data resource center;
and the second sharing unit is used for providing external service release and utilization for the outside of the city level data middlebox.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011173983.0A CN112287275A (en) | 2020-10-28 | 2020-10-28 | City-class data middle platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011173983.0A CN112287275A (en) | 2020-10-28 | 2020-10-28 | City-class data middle platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112287275A true CN112287275A (en) | 2021-01-29 |
Family
ID=74373080
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011173983.0A Pending CN112287275A (en) | 2020-10-28 | 2020-10-28 | City-class data middle platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112287275A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112862445A (en) * | 2021-02-22 | 2021-05-28 | 浪潮云信息技术股份公司 | High-concurrency data exchange processing method and storage medium |
| CN113393357A (en) * | 2021-06-03 | 2021-09-14 | 八维通科技有限公司 | Data center station system suitable for urban traffic trip data service |
| CN116307757A (en) * | 2023-01-18 | 2023-06-23 | 辽宁荣科智维云科技有限公司 | Intelligent data interaction method, interaction system, computer equipment and application |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106326331A (en) * | 2016-06-29 | 2017-01-11 | 河南许继仪表有限公司 | Intelligent power utilization data service system based on cloud computation |
| CN106651188A (en) * | 2016-12-27 | 2017-05-10 | 贵州电网有限责任公司贵阳供电局 | Electric transmission and transformation device multi-source state assessment data processing method and application thereof |
| CN107967336A (en) * | 2017-12-05 | 2018-04-27 | 广东京信软件科技有限公司 | A kind of big data comprehensive management platform construction method based on functional unit |
| US20180137431A1 (en) * | 2016-11-15 | 2018-05-17 | General Electric Company | Multimodal, small and big data, machine learing systems and processes |
| CN110990664A (en) * | 2019-12-16 | 2020-04-10 | 云赛智联股份有限公司 | Big data operation management system |
| CN111209269A (en) * | 2019-12-16 | 2020-05-29 | 云赛智联股份有限公司 | Big data management system of wisdom city |
-
2020
- 2020-10-28 CN CN202011173983.0A patent/CN112287275A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106326331A (en) * | 2016-06-29 | 2017-01-11 | 河南许继仪表有限公司 | Intelligent power utilization data service system based on cloud computation |
| US20180137431A1 (en) * | 2016-11-15 | 2018-05-17 | General Electric Company | Multimodal, small and big data, machine learing systems and processes |
| CN106651188A (en) * | 2016-12-27 | 2017-05-10 | 贵州电网有限责任公司贵阳供电局 | Electric transmission and transformation device multi-source state assessment data processing method and application thereof |
| CN107967336A (en) * | 2017-12-05 | 2018-04-27 | 广东京信软件科技有限公司 | A kind of big data comprehensive management platform construction method based on functional unit |
| CN110990664A (en) * | 2019-12-16 | 2020-04-10 | 云赛智联股份有限公司 | Big data operation management system |
| CN111209269A (en) * | 2019-12-16 | 2020-05-29 | 云赛智联股份有限公司 | Big data management system of wisdom city |
Non-Patent Citations (2)
| Title |
|---|
| 何同飞: "基于hadoop的大数据处理平台设计与实现", 信息科技 * |
| 朱亦希: "基于大数据资源平台的虹口城市运行管理建设", 信息技术与标准化, pages 1 - 9 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112862445A (en) * | 2021-02-22 | 2021-05-28 | 浪潮云信息技术股份公司 | High-concurrency data exchange processing method and storage medium |
| CN113393357A (en) * | 2021-06-03 | 2021-09-14 | 八维通科技有限公司 | Data center station system suitable for urban traffic trip data service |
| CN116307757A (en) * | 2023-01-18 | 2023-06-23 | 辽宁荣科智维云科技有限公司 | Intelligent data interaction method, interaction system, computer equipment and application |
| CN116307757B (en) * | 2023-01-18 | 2024-02-20 | 辽宁荣科智维云科技有限公司 | Intelligent data interaction method, interaction system, computer equipment and application |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112287275A (en) | City-class data middle platform | |
| CN103400246B (en) | A kind of nuclear power plant's risk monitoring system based on cloud framework and monitoring method | |
| CN105138661B (en) | A kind of network security daily record k-means cluster analysis systems and method based on Hadoop | |
| CN103390037A (en) | Ten-thousand-person cooperation plotting method based on mobile terminal | |
| CN112241402A (en) | Empty pipe data supply chain system and data management method | |
| Chen et al. | Design principles of coordinated multi-incident emergency response systems | |
| Al-Jaroodi et al. | Service-oriented architecture for big data analytics in smart cities | |
| CN111538720B (en) | Method and system for cleaning basic data of power industry | |
| CN111988404A (en) | Intelligent production and operation integrated digital platform | |
| CN114706994A (en) | Operation and maintenance management system and method based on knowledge base | |
| CN111106968A (en) | Method for constructing information communication intelligent dispatching command sand table | |
| Wu et al. | An Auxiliary Decision‐Making System for Electric Power Intelligent Customer Service Based on Hadoop | |
| Qian et al. | Research on key construction technology of building engineering under the background of big data | |
| CN109711572A (en) | A kind of mobile O&M task processing system of photovoltaic plant | |
| CN115439015B (en) | Local area power grid data management method, device and equipment based on data middleboxes | |
| CN116629802A (en) | Big data platform system for railway port station | |
| CN113392154A (en) | Data system based on SOA framework and distributed deployment database | |
| Geng | SUSTAINABLE DATA CENTER: STRATEGIC PLANNING, DESIGN, CONSTRUCTION, AND OPERATIONS WITH EMERGING TECHNOLOGIES | |
| CN116523328A (en) | Intelligent decision-making method for cooperation of aviation equipment and manufacturing industry chain | |
| Chen et al. | Research and Construction of University Data Governance Platform Based on Smart Campus Environment | |
| Zhao et al. | An architecture of knowledge cloud based on manufacturing big data | |
| Zheng-Ping et al. | Analysis on Cloud Data Service Platform for Digital Oilfields. | |
| Pan et al. | An open sharing pattern design of massive power big data | |
| Du et al. | Development of an online resource integration system for computer aided aesthetic education by big data technology | |
| Soibelman et al. | Information logistics for construction design team collaboration |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |