CN115269739A - Enhanced data management method and system - Google Patents

Enhanced data management method and system Download PDF

Info

Publication number
CN115269739A
CN115269739A CN202210786812.8A CN202210786812A CN115269739A CN 115269739 A CN115269739 A CN 115269739A CN 202210786812 A CN202210786812 A CN 202210786812A CN 115269739 A CN115269739 A CN 115269739A
Authority
CN
China
Prior art keywords
data
parameters
acquiring
parameter set
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210786812.8A
Other languages
Chinese (zh)
Inventor
冯哲
刘晓东
杨森
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Avic Trust Co ltd
Original Assignee
Avic Trust Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Avic Trust Co ltd filed Critical Avic Trust Co ltd
Priority to CN202210786812.8A priority Critical patent/CN115269739A/en
Publication of CN115269739A publication Critical patent/CN115269739A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/283Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2465Query processing support for facilitating data mining operations in structured databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0631Resource planning, allocation, distributing or scheduling for enterprises or organisations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0201Market modelling; Market analysis; Collecting market data

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Strategic Management (AREA)
  • Databases & Information Systems (AREA)
  • Human Resources & Organizations (AREA)
  • General Physics & Mathematics (AREA)
  • Development Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Data Mining & Analysis (AREA)
  • Economics (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • General Business, Economics & Management (AREA)
  • Game Theory and Decision Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Marketing (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Educational Administration (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses an enhanced data management method, which is applied to an enhanced data management system, wherein the system comprises an enhanced data management platform and comprises the following steps: acquiring and acquiring multi-dimensional data parameters of an external environment to obtain a data parameter set; acquiring multi-dimensional state parameters of an internal environment to obtain a state parameter set; storing the data parameter set and the state parameter set as a system database, wherein the system database establishes a data warehouse model through integration; processing data commonalities according to the data warehouse model to realize data analysis and data management, and acquiring industry data parameters of an external environment to obtain first data parameters; acquiring and acquiring related industry data parameters of an external environment to acquire second data parameters; acquiring a client data parameter of an external environment to obtain a third data parameter; and taking the first data parameter, the second data parameter and the third data parameter as the data parameter set.

Description

Enhanced data management method and system
Technical Field
The invention relates to the technical field of electronic information, in particular to an enhanced data management method and system.
Background
With the application of big data technology and the rise of industrial internet, more and more information systems of enterprises are integrated, innovation is improved, service is shared, cooperative intelligence becomes a main melody, the integration and sharing of data are important characteristics of the data, the standard and the unification of the data are emphasized, the standardization and the normalization of the data are the premise of realizing the information integration and the sharing, and the information isolated island of each business system is eliminated fundamentally.
In recent decades, the rapid development and informatization of science and technology have enabled the data volume accumulated by the human society to exceed the total data volume of the past years, the quantity of data acquisition, storage, processing and transmission is increasing day by day, enterprises realize data sharing, more people can fully use the existing data resources, the repeated labor and corresponding cost such as data collection, data acquisition and the like are reduced, the improvement of company data quality can effectively manage data assets, the application and data management level of companies are further improved, the data analysis application requirements and supervision and submission requirements of all levels of users are supported, and a perfect and effective data management and control mechanism and a data analysis system are established, so that the data of companies are in a state of integral and orderly management, the maximization of the data asset value is gradually realized, and the realization of business targets is supported and ensured.
However, in the process of implementing data sharing, because data provided by different users may come from different approaches, the data content, data format and data quality are very different, and sometimes even the data format cannot be converted or information is lost after the data format is converted, which seriously hinders the flow of data in each department and each software system and the sharing operation part to be a data hub, there are also a lot of manual accounts, the fusion of internal and external data is not fused, reports and report forms are not automated, the enterprise data quality and standard management and control strength is to be improved, and problems of resource dispersion, integration sharing difficulty, service dispersion, difficult reuse and the like occur.
Disclosure of Invention
The application provides an enhanced data management method and system, which are used for solving the technical problem that data management is difficult due to low data quality and difficult data integration and sharing of the existing companies.
In view of the foregoing, the present application provides an enhanced data governance method and system.
In a first aspect of the application, there is provided an enhanced data governance method, the method being applied to an enhanced data governance system, the system comprising an enhanced data governance platform, the method comprising: acquiring multi-dimensional data parameters of an external environment to obtain a data parameter set; acquiring and obtaining multi-dimensional state parameters of an internal environment to obtain a state parameter set; storing the data parameter set and the state parameter set as a system database, wherein the system database establishes a data warehouse model through integration; and processing the data commonalities according to the data warehouse model to realize data analysis and data management.
In a second aspect of the present application, there is provided an enhanced data governance system, the system comprising: the device comprises a first obtaining unit, a second obtaining unit and a third obtaining unit, wherein the first obtaining unit is used for acquiring and obtaining multi-dimensional data parameters of an external environment to obtain a data parameter set; the second obtaining unit is used for acquiring and obtaining multi-dimensional state parameters of the internal environment to obtain a state parameter set; the first processing unit is used for storing the data parameter set and the state parameter set into a system database, and the system database establishes a data warehouse model through integration; and the second processing unit is used for processing the data commonalities according to the data warehouse model to realize data analysis and data management.
In a third aspect of the present application, there is provided an enhanced data governance system, comprising: a processor coupled to a memory for storing a program that, when executed by the processor, causes a system to perform the functions of the method of the first aspect.
In a fourth aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, carries out the functions of the method according to the first aspect.
One or more technical solutions provided in the present application have at least the following technical effects or advantages:
the method includes the steps of acquiring multidimensional data parameters of an external environment to obtain a data parameter set, acquiring multidimensional state parameters of an internal environment to obtain a state parameter set, storing the state parameter set and the data parameter set as a system database, establishing a data warehouse model through integration by the system database, and processing data commonalities according to the data warehouse model to achieve data analysis and data management.
The foregoing description is only an overview of the technical solutions of the present application, and the present application can be implemented according to the content of the description in order to make the technical means of the present application more clearly understood, and the following detailed description of the present application is given in order to make the above and other objects, features, and advantages of the present application more clearly understandable.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a system flow diagram of an enhanced data governance method provided by the present application;
FIG. 2 is a schematic flow chart illustrating the establishment of a data warehouse model in an enhanced data governance method according to the present application;
FIG. 3 is a schematic flow chart illustrating the implementation of data analysis and data management in an enhanced data governance method according to the present application;
FIG. 4 is a schematic diagram of an enhanced data governance system configuration as provided herein;
fig. 5 is a schematic structural diagram of an exemplary electronic device of the present application.
In the figure: 11. a first obtaining unit; 12. a second obtaining unit; 13. a first processing unit; 14. a second processing unit; 300. an electronic device; 301. a memory; 302. a processor; 303. a communication interface; 304. a bus architecture.
Detailed Description
The application provides an enhanced data management method and system, and aims to solve the technical problem that data management is difficult due to low data quality and difficult data integration and sharing of existing companies.
Summary of the application
In the process of implementing data sharing, because data provided by different users may come from different approaches, the data content, data format and data quality are very different, and sometimes even the problem that the data format cannot be converted or information is lost after the data format is converted is encountered, which seriously hinders the flow of data in each department and each software system and the shared operation part to be a data hub, and there are also a lot of manual accounts, the fusion of internal and external data is not fused, the report and report automation is lacking, the enterprise data quality is low, the standard control force is insufficient, the problems of resource dispersion, difficult integration and sharing, dispersed service, difficult multiplexing and the like occur.
In view of the above technical problems, the technical solution provided by the present application has the following general idea:
the method includes the steps of acquiring multidimensional data parameters of an external environment to obtain a data parameter set, acquiring multidimensional state parameters of an internal environment to obtain a state parameter set, storing the state parameter set and the data parameter set as a system database, establishing a data warehouse model through integration by the system database, and processing data commonalities according to the data warehouse model to achieve data analysis and data management.
Having described the basic principles of the present application, the following detailed description will be made in a clear and complete manner with reference to the accompanying drawings, and it is to be understood that the described embodiments are only a part of the embodiments of the present application, and not all embodiments of the present application, and that the present application is not limited by the exemplary embodiments described herein. All other embodiments that can be obtained by a person skilled in the art without making creative efforts based on the embodiments of the present application belong to the protection scope of the present application, and it should be noted that, for convenience of description, only a part, not all of the relevant parts of the present application are shown in the drawings.
Example one
As shown in fig. 1, the present application provides an enhanced data governance method, wherein the method is applied to an enhanced data governance system, the system comprising an enhanced data governance platform, the method comprising:
s100: acquiring and acquiring multi-dimensional data parameters of an external environment to obtain a data parameter set;
in particular, the external environment refers to other enterprises and related enterprises in the same industry as the analysis subject enterprise, including but not limited to: the collection modes of the corporate enterprises, the fund suppliers and the fund demanders include but are not limited to: annual or quarterly summary reports, network public big data, and data provided by related data collection companies.
Step S100 in the method provided in the embodiment of the present application includes:
s110: acquiring and acquiring industrial data parameters of an external environment to acquire first data parameters;
s120: acquiring and acquiring related industry data parameters of an external environment to acquire second data parameters;
s130: acquiring a client data parameter of an external environment to obtain a third data parameter;
s140: and taking the first data parameter, the second data parameter and the third data parameter as the data parameter set.
In particular, the collected industry data includes, but is not limited to: the system comprises four large blocks of management information data, product public information data, service data, inherent service data and the like, wherein the four large blocks comprise the management information data, the product public information data, the product information data, recruitment information data, application supplement information data, application detail data, inherent service information data and the like, and the collected customer data comprise but are not limited to the following data: the natural person customer data and the organization customer data are used for analyzing the condition of the company by taking other trusts management information data, trusts product public information data, trusts business data and trusts inherent business data collected by trusts industry as comparison data of the company.
S200: acquiring multi-dimensional state parameters of an internal environment to obtain a state parameter set;
specifically, the multidimensional state parameter refers to internal information and data related to enterprise operation, including company profiles, product information, operation data, and the like, and the collection method includes, but is not limited to: an internal database of the enterprise.
Step S200 in the method provided in the embodiment of the present application includes:
s210: acquiring human resource parameters of an internal environment to obtain first state parameters;
s220: acquiring operation parameters of an internal environment to obtain second state parameters;
s230: acquiring financial parameters of the internal environment to obtain third state parameters;
s240: acquiring service parameters of an internal environment to obtain a fourth state parameter;
s250: acquiring service parameters of an internal environment to obtain fifth state parameters;
s260: and taking the first state parameter, the second state parameter, the third state parameter, the fourth state parameter and the fifth state parameter as the state set.
In the embodiment of the application, human resource parameters, operation parameters, financial parameters, business parameters and project parameters of an internal environment are used as a state parameter set, specifically, the human resource parameters refer to changes and statistics of employees of an enterprise, the management state of the employees of the enterprise is known, the operation parameters refer to the operation state of the enterprise in an administrative management level, a sales level, a production level, a technical level and a capital management level, the financial parameters refer to a series of activities such as obtaining, using, consuming and distributing enterprise funds of the enterprise, the financial indexes of the enterprise are known, the business parameters refer to the coverage range of enterprise operation, the project parameters refer to the specific operation content of the enterprise, the state indexes of the enterprise in all aspects are known according to the data parameters, the development conditions of the enterprise are known according to corresponding state indexes in a comparison mode, exemplarily, the internal data of the enterprise are required to judge the development conditions of the enterprise, the personnel management conditions, the operation indexes, the financial indexes, the business indexes, the project indexes and the standard indexes of the enterprise in different periods are analyzed to generate development curves, and the development conditions of the enterprise are known according to the curves.
S300: storing the data parameter set and the state parameter set into a system database, wherein the system database establishes a data warehouse model through integration;
specifically, the database is a warehouse for storing data, the storage space of the database is large, millions of data can be stored, but the database does not store the data randomly and has certain rules, otherwise, the query efficiency is low, the current world is an internet world full of data, a large amount of data is flooded, namely the internet world is the data world, the data is from many sources, such as travel records, consumption records, browsed webpages, sent messages and the like, except text type data, images, music and sounds are data, internal data of an enterprise lead the data of each system into the data center in batches through a database direct connection mode, file type data and external data are led into the data center through a supplementary recording, crawler and lead-in interface mode, and a corresponding database is established through a data source to store the data of the data center.
Step S300 in the method provided in the embodiment of the present application includes:
s310: importing the data of each type into a data center in a corresponding mode according to the data parameter set and the state parameter set, and storing the data in a database form;
specifically, the data of each system is imported into the data center in batch by the internal data of the enterprise in a database direct connection mode, the file data and the external data are imported into the data center in a supplementary recording, crawler and importing interface mode, and the data of the data center is stored by establishing a corresponding database through a data source.
Step S310 in the method provided in the embodiment of the present application includes:
s311: importing the data of each system into the data center in batches in a database direct connection mode according to the general data;
s312: importing the file data and the external data into the data center in a supplementary recording, crawler and importing interface mode;
s313: and establishing a corresponding database through a data source to store the data of the data center.
Specifically, the data of each system is imported into the data center in batch by the internal data of the enterprise in a database direct connection mode, the file data and the external data are imported into the data center in a supplementary recording, crawler and importing interface mode, a corresponding database is established through a data source to store the data of the data center, and a data service interface provides a standard unified data interface for other systems, so that the data unification is ensured, the repeated development is avoided, the data synchronization is realized, the client main data and the data supplementary recording are synchronized with the other systems in real time or non-real time, and the integrity of the client data and the rest of the data needing manual supplementary recording are supplemented.
S320: the existing collected data and historical data are processed and integrated into a data warehouse model according to business indexes by a database warehouse technology.
Specifically, the database warehouse technology extracts data from different data sources through extraction, conversion and loading, processes and converts the data according to a certain data processing rule, finally loads the data into a data warehouse, defines the structure of the content of the data warehouse, and carries out regular structuralization and data warehouse system maintenance on the database, the table, the view, the index and the data by using predefined design types.
Step S320 in the method provided in the embodiment of the present application includes:
s321: the database warehouse technology extracts data from different data sources through extraction, conversion and loading, processes and converts the data according to a certain data processing rule, and finally loads the data into a data warehouse;
s321: periodically structuring and data warehouse system maintenance of databases, tables, views, indexes, and data using predefined design types according to the data warehouse content definition structure.
Specifically, the database warehouse technology corresponds to the characteristic that the traditional database organizes data facing applications, the data in the database is organized facing topics, a topic-oriented data organization mode is a complete and consistent description of the data of analysis objects at a higher level, and can completely and uniformly describe various data related to each analysis object and the connection among the data, the data in the database is extracted from an original distributed database, because source data corresponding to each topic of the database may be repeated or inconsistent in the original distributed database, and the integrated data cannot be directly obtained from the original database, the data must be uniformly and comprehensively integrated before entering the database, the unrenewability of the data in the database is specific to the applications, that is, when a user performs analysis processing, the data is not subjected to data updating operation in the database, the updated data is integrated into the whole data generation period which is finally deleted, the data in all the data is not changed, but the data in the database warehouse is continuously changed, and the data operation is usually a non-volatile data operation record, and the environment is a non-volatile data record. Data in the data warehouse is typically loaded and accessed once and data updates in the data warehouse are not performed in a general sense.
S400: processing the data commonalities according to the data warehouse model to realize data analysis and data management;
specifically, different types of data are analyzed and integrated according to a data warehouse model, and different data are properly managed, for example, a data management workbench comprises data management process issuing management, data quality monitoring, metadata display, document library management and the like, metadata management, metadata monitoring, metadata statistics in a monitoring service system and metadata conditions of a data platform, dimensions comprise system number, dependency relationship, table number and field number, metadata acquisition, metadata management, data standard management and standard monitoring: the monitoring standard issuing, changing, basic data standard counting, salesman data marking and counting functions are flexible in query: the standard retrieval is carried out according to conditions, the retrieval is supported according to departments, subject domains, service types and the like, and the standard management is released: and standard maintenance management is supported, and the standard is issued, modified, operated, managed and monitored and analyzed: quality inspection is monitored every day, quality inspection task monitoring, quality inspection result query, log query and a data report platform are adopted, a data cockpit for inherent business, trust business, wealth business, human resources, project management analysis and the like is realized, self-service analysis and statistical analysis of users are supported, a data large screen is used for displaying relevant indexes of the overall business situation, the trust business situation and the wealth situation on a large screen, the business cockpit, the inherent business, the trust business cockpit and the wealth business cockpit realize statistical analysis of general staff conditions and personnel variation conditions, the project management analysis cockpit is used for driving, a project review report is used for counting dimensional data such as project quantity, project scale, investment industry and the like in each project stage, project data supplement and record are realized, a self-service analysis function is realized, data special topic application is realized, common data is verified, data supplement and record is realized, a daily statistical report is realized, and data service and sharing are realized.
Step S400 in the method provided in the embodiment of the present application includes:
s410: mining all correlation information of company projects, all correlation information of clients, all correlation information of company management and all correlation information of company employees according to all data items and different aggregations related to the data;
s420: and analyzing the management of financial conditions, business conditions, customer conditions, operation conditions, risk control conditions, metadata, data quality, data standards, data services and data sharing according to the processing integration of all the associated information of the company projects, all the associated information of the customers, all the associated information of the company operation and all the associated information of the company employees.
Specifically, all correlation information of a company project, all correlation information of a client, all correlation information of company operation and all correlation information of company employees are mined according to all data items and different aggregations related to the data, and management of financial conditions, business conditions, client conditions, operation conditions, risk control conditions, metadata, data quality, data standards, data services and data sharing is analyzed according to all correlation information of the company project, all correlation information of the client, all correlation information of company operation and all correlation information of the company employees; the method comprises the following steps of data management process release management, data quality monitoring, metadata display, document library management and the like, wherein the metadata management realizes the functions of metadata monitoring, metadata acquisition, metadata management, metadata analysis and the like, the metadata monitoring monitors the metadata statistical condition and the data platform metadata condition in a monitoring business system, and the dimensionality comprises the system number, the dependency relationship, the table number, the field number and the metadata acquisition: the method comprises the following steps of collecting data source management, task management, adapter management and metadata management: the functions of metadata retrieval, drilling down and the like are realized, data standard management is realized, standard monitoring, standard type management, standard query, standard release and standard document management are realized, and standard monitoring is realized: the monitoring standard issuing, changing, basic data standard counting, salesman data marking and counting functions are flexible in query: the standard retrieval is carried out according to conditions, the retrieval is supported according to departments, subject domains, service types and the like, and the standard management is released: supporting standard maintenance management, issuing and modifying the standard, managing the standard document: the standard document is uploaded, modified, deleted and the like, data quality management is realized, quality inspection monitoring analysis and quality inspection management maintenance functions are realized, and quality inspection monitoring analysis is realized: quality inspection daily monitoring, quality inspection task monitoring, quality inspection result query, log query and a data report platform, so that a data cockpit for inherent service, trusted service, wealth service, human resources, project management analysis and the like is realized; the large data screen is realized, and self-service analysis and statistical analysis of users are supported; the method realizes the special application of operation, manpower, accounting and the like, such as data verification, data additional entry, daily statistical report forms and data large screens, performs large-screen display on relevant indexes of the whole operation condition, trust service condition and wealth condition, and realizes the inherent service of a service cockpit, namely, the method realizes the statistics of relevant inherent index data according to the year and month, including operation condition, asset liability, operation analysis and the trust service cockpit: the method realizes the analysis of the trust scale related index analysis, the company exhibition industry analysis, the operation short table and the like according to the year and month statistics, and the wealth service cockpit: realize wealth achievement analysis, wealth manager achievement statistics, manpower resources cockpit: the statistical analysis of the personnel presidential situation and the personnel change situation is realized, and the cockpit is analyzed through project management: the project review report is used for counting dimension data such as project number, project scale and project direction industry at each project stage, the project data is additionally recorded, a data maintenance additional recording modification function is realized, self-service analysis is realized, a user can self-service select according to index dimension, statistical analysis is performed, functions such as displaying, inquiring and exporting are realized, data special subject application is realized, and operation common data verification, operation data additional recording, manpower data additional recording, financial data additional recording and common data verification are realized: the method realizes more than 20 verification in a month including account management verification, product conformity timeliness verification, fund liquidity verification and the like, and data additional recording: the data adjusting functions such as project attribute adjustment, supervision index adjustment, financial industry channel projects and the like are realized, and the daily statistical report form is as follows: the method realizes operation statistical reports, including credit insurance fund, new scale detail on the same day, key supervision data and other related data statistics, supports management functions such as data query and export, data service and sharing, realizes service management, authority management, interface user management, token management and interface logs, is used for realizing data interface access of a data platform, and realizes data sharing and data service interface by providing a uniform API mode, unifying interface user management, responding to external data access requests and realizing data sharing: the system has the advantages that a standard unified data interface is provided for other systems, data unification is guaranteed, repeated development is avoided, the risk monitoring billboard provides a large screen for risks of enterprises, and the risk public opinion condition is concerned in real time.
Example two
Based on an enhanced data governance method as in the foregoing embodiment, as shown in fig. 4, the present application provides an enhanced data governance system, where the enhanced data governance system includes:
the first obtaining unit 11 is configured to acquire and obtain multidimensional data parameters of an external environment, and obtain a data parameter set;
a second obtaining unit 12, configured to acquire and obtain multidimensional state parameters of an internal environment, and obtain a state parameter set;
the first processing unit 13 is configured to store the data parameter set and the state parameter set as a system database, where the system database establishes a data warehouse model through integration;
the second processing unit 14 is used for processing data commonalities according to the data warehouse model to realize data analysis and data management;
further, the system further comprises:
the third obtaining unit is used for acquiring and obtaining the industry data parameters of the external environment to obtain the first data parameters;
the fourth obtaining unit is used for acquiring and obtaining the related industry data parameters of the external environment to obtain second data parameters;
the fifth obtaining unit is used for acquiring and obtaining the client data parameters of the external environment to obtain third data parameters;
the third processing unit is used for acquiring the multidimensional market distribution parameters of the market analysis device and acquiring a market distribution data set;
a fourth processing unit, configured to use the first data parameter, the second data parameter, and the third data parameter as the data parameter set;
further, the system further comprises:
a sixth obtaining unit, configured to acquire and obtain human resource parameters of an internal environment, and obtain a first state parameter;
a seventh obtaining unit, configured to acquire and obtain an operation parameter of the internal environment, and obtain a second state parameter;
the eighth obtaining unit is used for acquiring and obtaining financial parameters of the internal environment and obtaining third state parameters;
a ninth obtaining unit, configured to acquire and obtain service parameters of an internal environment to obtain a fourth state parameter;
a tenth obtaining unit, configured to acquire and obtain project parameters of the internal environment, and obtain a fifth state parameter;
and the fifth processing unit takes the first state parameter, the second state parameter, the third state parameter, the fourth state parameter and the fifth state parameter as the state parameter set.
Further, the system further comprises:
the sixth processing unit is used for importing the data of each type into a data center in a corresponding mode according to the data parameter set and the state parameter set and storing the data in a database form;
and the seventh processing unit is used for processing and integrating the existing acquired data and historical data into a data warehouse model according to the service indexes by a database warehouse technology.
Further, the system further comprises:
the eighth processing unit is used for mining all the associated information of the company project, all the associated information of the client, all the associated information of the company management and all the associated information of the company staff according to all the data items and different aggregations related to the data;
and the ninth processing unit is used for analyzing the management of financial status, business status, customer status, operation status, risk control status, metadata, data quality, data standard, data service and data sharing according to the processing integration of all the associated information of the company project, all the associated information of the customer, all the associated information of the company operation and all the associated information of the company employee.
Further, the system further comprises:
the tenth processing unit is used for importing the data of each system into the data center in batches in a database direct connection mode according to the general data;
the eleventh processing unit is used for importing the file data and the external data into the data center in a supplementary recording, crawler and importing interface mode;
and the twelfth processing unit is used for establishing a corresponding database through a data source to store the data of the data center.
Further, the system further comprises:
the thirteenth processing unit is used for extracting data from different data sources through extraction, conversion and loading according to the database warehouse technology, processing and format conversion are carried out on the data according to a certain data processing rule, and finally the data are loaded to the data warehouse;
and the thirteenth processing unit is used for performing regular structuring and data warehouse system maintenance on the database, the table, the view, the index and the data according to the data warehouse content definition structure by using a predefined design type.
EXAMPLE III
Based on the enhanced data governance method in the foregoing embodiment, the present application further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method in the first embodiment is implemented.
Exemplary electronic device
The electronic device of the present application is described below with reference to figure 5,
based on the same inventive concept as the enhanced data governance method in the foregoing embodiment, the present application also provides an enhanced data governance system, including: a processor coupled to a memory, the memory for storing a program that, when executed by the processor, causes the system to perform the steps of the method of embodiment one.
The electronic device 300 includes: processor 302, communication interface 303, memory 301. Optionally, the electronic device 300 may also include a bus architecture 304. Wherein, the communication interface 303, the processor 302 and the memory 301 may be connected to each other through a bus architecture 304; the bus architecture 304 may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus architecture 304 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in FIG. 5, but this is not intended to represent only one bus or type of bus.
Processor 302 may be a CPU, microprocessor, ASIC, or one or more integrated circuits configured to control the execution of the programs of the present application.
The communication interface 303 may be any device, such as a transceiver, for communicating with other devices or communication networks, such as an ethernet, a Radio Access Network (RAN), a Wireless Local Area Network (WLAN), a wired access network, and the like.
The memory 301 may be, but is not limited to, ROM or other type of static storage device that can store static information and instructions, RAM or other type of dynamic storage device that can store information and instructions, EEPROM, CD-ROM or other optical disk storage, optical disk storage (including compact disk, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory may be self-contained and coupled to the processor through a bus architecture 304. The memory may also be integral to the processor.
The memory 301 is used for storing computer-executable instructions for executing the present application, and is controlled by the processor 302 to execute. The processor 302 is used for executing the computer-executable instructions stored in the memory 301, so as to implement a method for adjusting the generation parameters of nano water ions provided by the above embodiments of the present application.
Those of ordinary skill in the art will understand that: the first, second, etc. reference numerals in this application are only for convenience of description and distinction, and are not used to limit the scope of this application, nor to indicate the sequence. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one" means one or more. At least two means two or more. "at least one," "any," or similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one (one ) of a, b, or c, may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or multiple.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions described in accordance with the present application are generated, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer finger
The instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, where the computer instructions may be transmitted from one website site, computer, server, or data center to another website site, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device including one or more available media integrated servers, data centers, and the like. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), among others.
The various illustrative logical units and circuits described in this application may be implemented or operated through the design of a general purpose processor, a digital signal processor, an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof. A general-purpose processor may be a microprocessor, but, in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital signal processor core, or any other similar configuration.
The steps of a method or algorithm described in this application may be embodied directly in hardware, in a software element executed by a processor, or in a combination of the two. The software cells may be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. For example, a storage medium may be coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC, which may be disposed in a terminal. In the alternative, the processor and the storage medium may reside in different components within the terminal. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Although the present application has been described in conjunction with specific features and embodiments thereof, it will be evident that various modifications and combinations may be made thereto without departing from the spirit and scope of the application. Accordingly, the specification and figures are merely exemplary of the application and are intended to cover any and all modifications, variations, combinations, or equivalents within the scope of the application. It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the present application and its equivalent technology, it is intended that the present application include such modifications and variations.

Claims (10)

1. An enhanced data governance method, wherein the method is applied to an enhanced data governance system, the system comprising an enhanced data governance platform, the method comprising:
acquiring and acquiring multi-dimensional data parameters of an external environment to obtain a data parameter set;
acquiring and obtaining multi-dimensional state parameters of an internal environment to obtain a state parameter set;
storing the data parameter set and the state parameter set as a system database, wherein the system database establishes a data warehouse model through integration;
and processing the data commonalities according to the data warehouse model to realize data analysis and data management.
2. The method of claim 1, wherein the acquiring obtains multidimensional data parameters of the external environment, obtaining a set of data parameters, comprises:
acquiring and acquiring industrial data parameters of an external environment to acquire first data parameters;
acquiring and acquiring related industry data parameters of an external environment to acquire second data parameters;
acquiring a client data parameter of an external environment to obtain a third data parameter;
and taking the first data parameter, the second data parameter and the third data parameter as the data parameter set.
3. The method of claim 1, wherein the acquiring obtains multidimensional state parameters of the internal environment, obtaining a set of state parameters, comprises:
acquiring human resource parameters of an internal environment to obtain first state parameters;
acquiring operation parameters of an internal environment to obtain second state parameters;
acquiring financial parameters of the internal environment to obtain third state parameters;
acquiring service parameters of an internal environment to obtain a fourth state parameter;
acquiring project parameters of an internal environment to obtain fifth state parameters;
and taking the first state parameter, the second state parameter, the third state parameter, the fourth state parameter and the fifth state parameter as the state parameter set.
4. The method of claim 1, wherein the data parameter sets and the state parameter sets are stored as a system database, and the system database builds a data warehouse model by integration, comprising:
importing the data of each type into a data center in a corresponding mode according to the data parameter set and the state parameter set, and storing the data in a database form;
the existing collected data and historical data are processed and integrated into a data warehouse model according to business indexes by a database warehouse technology.
5. The method of claim 1, wherein said processing data commonalities according to said data warehouse model to effect data analysis and data management comprises:
mining all associated information of company projects, all associated information of clients, all associated information of company management and all associated information of company employees according to all data items and different aggregations related to the data;
and analyzing the management of financial conditions, business conditions, customer conditions, operation conditions, risk control conditions, metadata, data quality, data standards, data services and data sharing according to the processing integration of all the associated information of the company projects, all the associated information of the customers, all the associated information of the company operation and all the associated information of the company employees.
6. The method according to claim 4, wherein the importing, according to the data parameter set and the state parameter set, each type of data into a data center in a corresponding manner, and storing the data in a database form includes:
importing the data of each system into the data center in batches in a database direct connection mode according to the general data;
importing the file data and the external data into the data center in a supplementing, crawling and importing interface mode;
and establishing a corresponding database through a data source to store the data of the data center.
7. The method of claim 4, wherein the integrating the existing collected data and the historical data into the data warehouse model according to the business index processing by the database warehouse technology comprises:
extracting data from different data sources through extraction, conversion and loading according to a database warehouse technology, processing and format conversion are carried out on the data according to a certain data processing rule, and finally the data are loaded to a data warehouse;
periodically structuring and data warehouse system maintenance of databases, tables, views, indexes, and data using predefined design types according to the data warehouse content definition structure.
8. An enhanced data governance system, the system comprising:
the device comprises a first obtaining unit, a second obtaining unit and a third obtaining unit, wherein the first obtaining unit is used for acquiring and obtaining multi-dimensional data parameters of an external environment to obtain a data parameter set;
the second obtaining unit is used for acquiring and obtaining multi-dimensional state parameters of the internal environment to obtain a state parameter set;
the first processing unit is used for storing the data parameter set and the state parameter set into a system database, and the system database establishes a data warehouse model through integration;
and the second processing unit is used for processing the data commonalities according to the data warehouse model to realize data analysis and data management.
9. An enhanced data governance system, comprising: a processor coupled to a memory, the memory for storing a program that, when executed by the processor, causes the system to perform the steps of the system of any of claims 1 to 8.
10. A computer-readable storage medium, characterized in that the storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the system according to any one of claims 1 to 8.
CN202210786812.8A 2022-07-04 2022-07-04 Enhanced data management method and system Pending CN115269739A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210786812.8A CN115269739A (en) 2022-07-04 2022-07-04 Enhanced data management method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210786812.8A CN115269739A (en) 2022-07-04 2022-07-04 Enhanced data management method and system

Publications (1)

Publication Number Publication Date
CN115269739A true CN115269739A (en) 2022-11-01

Family

ID=83763839

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210786812.8A Pending CN115269739A (en) 2022-07-04 2022-07-04 Enhanced data management method and system

Country Status (1)

Country Link
CN (1) CN115269739A (en)

Similar Documents

Publication Publication Date Title
US8898175B2 (en) Apparatus, systems and methods for dynamic on-demand context sensitive cluster analysis
US11914620B2 (en) System and method for aggregating values through risk dimension hierarchies in a multidimensional database environment
US10055426B2 (en) System and method transforming source data into output data in big data environments
US10754877B2 (en) System and method for providing big data analytics on dynamically-changing data models
US10235430B2 (en) Systems, methods, and apparatuses for detecting activity patterns
CN107908672B (en) Application report realization method, device and storage medium based on Hadoop platform
US8126750B2 (en) Consolidating data source queries for multidimensional scorecards
CN109033113B (en) Data warehouse and data mart management method and device
CN111444256A (en) Method and device for realizing data visualization
CN114880405A (en) Data lake-based data processing method and system
Martins et al. BigData oriented to business decision making: a real case study in constructel
US20210390496A1 (en) Method for model-based project scoring classification and reporting
CN112001539A (en) High-precision passenger traffic prediction method and passenger traffic prediction system
CN113886465A (en) Big data analysis platform for automobile logistics
CN116089490A (en) Data analysis method, device, terminal and storage medium
CN115269739A (en) Enhanced data management method and system
CN114707091A (en) Page display method and device, electronic equipment and storage medium
CN115689463A (en) Enterprise standing book database management system in rare earth industry
US20140244673A1 (en) Systems and methods for visualizing master data services information
US20180285433A1 (en) Behavioral analytics in information technology infrasturcture incident management systems
Zhao et al. Exploring big data applications for public resource transaction
CN117591516A (en) Supervision report data analysis system, supervision report data analysis method, supervision report data analysis equipment and storage medium
CN115757373A (en) Data warehouse cleaning method and device, computer equipment and storage medium
Ayyavaraiah Data Mining For Business Intelligence
CN114253945A (en) Data processing method and device for data warehouse and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination