CN113159547A - Enterprise data monitoring method and system based on big data architecture - Google Patents
Enterprise data monitoring method and system based on big data architecture Download PDFInfo
- Publication number
- CN113159547A CN113159547A CN202110387455.3A CN202110387455A CN113159547A CN 113159547 A CN113159547 A CN 113159547A CN 202110387455 A CN202110387455 A CN 202110387455A CN 113159547 A CN113159547 A CN 113159547A
- Authority
- CN
- China
- Prior art keywords
- data
- platform
- service
- analysis
- monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/26—Visual data mining; Browsing structured data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Human Resources & Organizations (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- Development Economics (AREA)
- Educational Administration (AREA)
- Entrepreneurship & Innovation (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Game Theory and Decision Science (AREA)
- Operations Research (AREA)
- Tourism & Hospitality (AREA)
- Quality & Reliability (AREA)
- Computational Linguistics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention belongs to the technical field of enterprise data monitoring, in particular to an enterprise data monitoring method based on a big data architecture, which comprises the following steps: the system comprises a basic service platform, a data acquisition and basic processing platform, a data storage platform, a data calculation and analysis platform and a data display platform. According to the invention, through the setting of the basic service platform, a user can log in and upload personal information and document information on existing equipment such as a mobile terminal, a PC terminal or a fingerprint card punch, the data can be classified, fused, issued, updated and stored through the acquisition and basic processing of the data, and finally displayed by visual tools, graphs, reports and practical technologies on the display platform through the calculation and analysis of the data, and the user can check the data of the whole enterprise through a background corresponding to the comprehensive information analysis layer, so that the purpose of monitoring the data of the whole enterprise is achieved.
Description
Technical Field
The invention belongs to the technical field of enterprise data monitoring, and particularly relates to an enterprise data monitoring method and system based on a big data architecture.
Background
With the rapid development of economy, enterprises are deeply innovated and reformed, and information data related to the enterprises are more and more, and the types of the information data are more and more abundant. However, the existing enterprise management system is difficult to compare the relevant data of the enterprise in time to achieve the purpose of monitoring, so that the invention provides the enterprise data monitoring method and system with a big data architecture.
Disclosure of Invention
To solve the problems set forth in the background art described above. The invention provides an enterprise data monitoring method and system based on a big data architecture, which have the characteristic of monitoring enterprise data in time.
In order to achieve the purpose, the invention provides the following technical scheme: the enterprise data monitoring method based on the big data architecture comprises the following steps:
the system comprises a basic service platform, a data acquisition and basic processing platform, a data storage platform, a data calculation and analysis platform and a data display platform;
the method comprises the following steps that a user automatically uploads related information to a basic service platform by utilizing a cloud computing platform, a network technology, a cloud storage technology, a virtualization technology and a resource monitoring technology in the basic service platform;
the related information can acquire and basically process related data through an ETL tool, a data intelligent perception technology or a crawler service, and the acquired and processed data is stored through fusion or memory data of a NoSQL technology, a distributed file system, a relational database and a non-relational database;
the stored data is finally displayed on a display platform by a visualization tool, a graph, a report form and a practical technology through data prediction and mining, data query and analysis, and calculation and analysis of BI business intelligence or map processing, so that the data can be monitored.
The data presentation platform also includes a monitoring platform.
Preferably, the basic service platform can be a mobile terminal, a PC terminal and existing equipment, the mobile terminal can log in through an enterprise APP, and the PC terminal can log in through a website.
Preferably, the collection and basic processing of data includes collection, differentiation, classification, cleaning, fusion, publishing, and updating.
Preferably, the calculation and analysis of the data includes the sorting and processing of the data, the exchange of data and the calculation and analysis.
Preferably, the data presentation platform includes data quality monitoring, dynamic update comparison, user images, user fingerprints and the like.
Preferably, the storage of data includes user personal information, document information, environmental data, and the like.
The enterprise data monitoring system based on the big data architecture comprises a platform service layer, a data service layer, an application service layer and a comprehensive information analysis layer;
the platform service layer is used for providing storage service, computing service and network service on the basis of cloud service;
the data service layer is used for constructing a monitoring platform, integrating and processing data, meeting the normative requirements and professional requirements of enterprises, exchanging data, performing real-time acquisition, batch acquisition, encryption processing and the like on the basis of a source database, and providing corresponding data for the application service layer under the combined action of computational analysis and data support;
and the comprehensive information analysis layer is established on the basis of the data service layer and the application service layer, and is used for mining and analyzing various types of data information, grasping the association among the data information and realizing dynamic monitoring.
Preferably, the data service layer and the application service layer are connected through a service interface.
Preferably, the computational analysis is operative to implement crawler services, data mining management, ETL management, and the like.
Compared with the prior art, the invention has the beneficial effects that:
1. according to the invention, through the setting of the basic service platform, a user can log in and upload personal information and document information on existing equipment such as a mobile terminal, a PC terminal or a fingerprint card punch, the data can be classified, fused, issued, updated and stored through the acquisition and basic processing of the data, and finally displayed by visual tools, graphs, reports and practical technologies on the display platform through the calculation and analysis of the data, and the user can check the data of the whole enterprise through a background corresponding to the comprehensive information analysis layer, so that the purpose of monitoring the data of the whole enterprise is achieved.
2. According to the invention, through the arrangement of the data service layer, the stored data can be integrated, processed, compared and exchanged, so that various data to be inquired can be provided for the application service layer, the use is more convenient, under the action of the comprehensive service layer, the association and the synthesis can be carried out on each data, the purpose of rapidly providing information is achieved, and the supervision personnel can rapidly acquire enterprise information.
Drawings
FIG. 1 is a schematic flow chart of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1
Referring to fig. 1, the present invention provides the following technical solutions: the enterprise data monitoring method based on the big data architecture comprises the following steps:
the system comprises a basic service platform, a data acquisition and basic processing platform, a data storage platform, a data calculation and analysis platform and a data display platform; basic service platform can be for removing end, PC end and existing equipment, removes end accessible enterprise APP and logs on, and the PC end can log on through the website, and existing equipment can fingerprint punched-card machine and portrait recognizer etc. through basic service platform's setting, and the user can log on and upload personal information and document information on removing end, PC end or fingerprint punched-card machine etc. existing equipment.
The method comprises the following steps that a user automatically uploads related information to a basic service platform by utilizing a cloud computing platform, a network technology, a cloud storage technology, a virtualization technology and a resource monitoring technology in the basic service platform;
the relevant information can be acquired and basically processed through an ETL tool, a data intelligent perception technology or a crawler service, the acquired and processed data are stored through fusion or memory data of a NoSQL technology, a distributed file system, a relational database and a non-relational database, the data storage comprises user personal information, document information, environmental data and the like, and the acquisition and the basic processing of the data comprise acquisition, difference, classification, cleaning, fusion, release and updating;
the stored data is finally displayed on a display platform by a visualization tool, a graph, a report form and a practical technology through data prediction and mining, data query and analysis, and calculation and analysis of BI business intelligence or map processing, and the data can be monitored, and the data display platform also comprises a monitoring platform. Through data acquisition and basic processing, the data can be classified, fused, published and updated and stored, and finally displayed on a display platform by using visual tools, graphs, reports and practical technologies through data calculation and analysis, and a user can check the data of the whole enterprise through a background corresponding to the comprehensive information analysis layer, so that the aim of monitoring the data of the whole enterprise is fulfilled.
Preferably, the calculation and analysis of the data comprise the sorting and processing of the data, the data exchange and the calculation and analysis, and the data display platform comprises data quality monitoring, dynamic updating comparison, user images, user fingerprints and the like.
The enterprise data monitoring system based on the big data architecture comprises a platform service layer, a data service layer, an application service layer and a comprehensive information analysis layer;
the platform service layer is used for providing storage service, computing service and network service on the basis of cloud service;
the data service layer is used for constructing a monitoring platform, integrating and processing data, meeting the normative requirements and professional requirements of enterprises, exchanging data, performing real-time acquisition, batch acquisition, encryption processing and the like on the basis of a source database, providing corresponding data for the application service layer under the combined action of calculation analysis and data support, integrating, processing, comparing and exchanging the stored data through the arrangement of the data service layer, providing various data to be inquired for the application service layer, and being more convenient to use;
the comprehensive information analysis layer is established on the basis of the data service layer and the application service layer, and is used for mining and analyzing various types of data information, grasping the association among the data information, realizing dynamic monitoring, associating and integrating the data under the action of the comprehensive service layer, and achieving the purpose of rapidly providing information and rapidly acquiring enterprise information by a supervisor.
Preferably, the data service layer and the application service layer are connected through a service interface, and the calculation analysis is used for realizing crawler service, data mining management, ETL management and the like.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that changes may be made in the embodiments and/or equivalents thereof without departing from the spirit and scope of the invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (9)
1. The enterprise data monitoring method based on the big data architecture is characterized by comprising the following steps: the method comprises the following steps:
the system comprises a basic service platform, a data acquisition and basic processing platform, a data storage platform, a data calculation and analysis platform and a data display platform;
the method comprises the following steps that a user automatically uploads related information to a basic service platform by utilizing a cloud computing platform, a network technology, a cloud storage technology, a virtualization technology and a resource monitoring technology in the basic service platform;
the related information can acquire and basically process related data through an ETL tool, a data intelligent perception technology or a crawler service, and the acquired and processed data is stored through fusion or memory data of a NoSQL technology, a distributed file system, a relational database and a non-relational database;
the stored data is subjected to data prediction and mining, data query and analysis, and calculation and analysis of BI business intelligence or map processing, and is finally displayed on a display platform by using a visualization tool, a graph, a report form and a real technology;
the data presentation platform also includes a monitoring platform.
2. The big data architecture-based enterprise data monitoring method according to claim 1, wherein: the basic service platform can be a mobile terminal, a PC terminal and existing equipment, the mobile terminal can log in through an enterprise APP, and the PC terminal can log in through a website.
3. The big data architecture-based enterprise data monitoring method according to claim 1, wherein: the data collection and basic processing comprises collection, difference, classification, cleaning, fusion, release and update.
4. The big data architecture-based enterprise data monitoring method according to claim 1, wherein: the calculation and analysis of the data comprise the arrangement and processing of the data, the data exchange and the calculation and analysis.
5. The big data architecture-based enterprise data monitoring method according to claim 1, wherein: the data display platform comprises data quality monitoring, dynamic updating comparison, user images, user fingerprints and the like.
6. The big data architecture-based enterprise data monitoring method according to claim 1, wherein: the storage of data includes user personal information, document information, environmental data, and the like.
7. Enterprise data monitoring system based on big data architecture, its characterized in that: the system comprises a platform service layer, a data service layer, an application service layer and a comprehensive information analysis layer;
the platform service layer is used for providing storage service, computing service and network service on the basis of cloud service;
the data service layer is used for constructing a monitoring platform, integrating and processing data, meeting the normative requirements and professional requirements of enterprises, exchanging data, performing real-time acquisition, batch acquisition, encryption processing and the like on the basis of a source database, and providing corresponding data for the application service layer under the combined action of computational analysis and data support;
and the comprehensive information analysis layer is established on the basis of the data service layer and the application service layer, and is used for mining and analyzing various types of data information, grasping the association among the data information and realizing dynamic monitoring.
8. The big-data architecture based enterprise data monitoring system of claim 7, wherein: the data service layer and the application service layer are connected through a service interface.
9. The big-data architecture based enterprise data monitoring system of claim 7, wherein: computational analysis is used for realizing crawler service, data mining management, ETL management and the like.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110387455.3A CN113159547A (en) | 2021-04-12 | 2021-04-12 | Enterprise data monitoring method and system based on big data architecture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110387455.3A CN113159547A (en) | 2021-04-12 | 2021-04-12 | Enterprise data monitoring method and system based on big data architecture |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113159547A true CN113159547A (en) | 2021-07-23 |
Family
ID=76889843
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110387455.3A Pending CN113159547A (en) | 2021-04-12 | 2021-04-12 | Enterprise data monitoring method and system based on big data architecture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113159547A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010139167A1 (en) * | 2009-06-05 | 2010-12-09 | 深圳市脑库计算机系统有限公司 | Expert support application system platform for government affair and business affair decision-making and its construction method |
| CN109272155A (en) * | 2018-09-11 | 2019-01-25 | 郑州向心力通信技术股份有限公司 | A kind of corporate behavior analysis system based on big data |
-
2021
- 2021-04-12 CN CN202110387455.3A patent/CN113159547A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010139167A1 (en) * | 2009-06-05 | 2010-12-09 | 深圳市脑库计算机系统有限公司 | Expert support application system platform for government affair and business affair decision-making and its construction method |
| CN109272155A (en) * | 2018-09-11 | 2019-01-25 | 郑州向心力通信技术股份有限公司 | A kind of corporate behavior analysis system based on big data |
Non-Patent Citations (1)
| Title |
|---|
| 刘强等: "基于大数据技术的企业综合数据分析平台", 《通信技术》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108470228A (en) | Financial data auditing method and audit system | |
| CN110796470A (en) | Market subject supervision and service oriented data analysis system | |
| US20190050435A1 (en) | Object data association index system and methods for the construction and applications thereof | |
| CN111080261A (en) | Visual data asset management system based on big data | |
| CN112883001A (en) | Data processing method, device and medium based on marketing and distribution through data visualization platform | |
| CN111737364B (en) | Safe multi-party data fusion and federal sharing method, device, equipment and medium | |
| CN110544035A (en) | internal control detection method, system and computer readable storage medium | |
| CN111311190A (en) | Experimental data management method convenient for data collection | |
| CN114913619A (en) | Intelligent mobile inspection method and system | |
| CN106355489A (en) | Data center system and data processing method for management | |
| CN109242431B (en) | Enterprise management method and system based on data system | |
| CN111598700A (en) | Financial wind control system and method | |
| CN104573074A (en) | High-speed calculating and analyzing method based on hospital data | |
| CN112232843B (en) | Drug supervision system and method based on big data technology | |
| CN113205808A (en) | AI (Artificial intelligence) consultation based cloud computing building method and system | |
| CN113159547A (en) | Enterprise data monitoring method and system based on big data architecture | |
| CN115567563B (en) | Comprehensive transportation hub monitoring and early warning system based on end edge cloud and control method thereof | |
| CN201751901U (en) | Large-scale database portrait search comparison system based on biometric portrait identification technology | |
| CN116862845A (en) | Brightness enhancement film quality evaluation system | |
| CN115578689A (en) | Cargo storage area supervision method and system | |
| CN115438812A (en) | Life-saving management method and device for power transmission equipment, computer equipment and storage medium | |
| CN112686156A (en) | Emotion monitoring method and device, computer equipment and readable storage medium | |
| CN112965948A (en) | Management service center system based on data | |
| CN110765173A (en) | Data management method and system under big data environment | |
| CN111831636B (en) | Data processing method, device, computer system and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210723 |