CN112261108A - Cluster management platform based on big data sharing service - Google Patents

Cluster management platform based on big data sharing service Download PDF

Info

Publication number
CN112261108A
CN112261108A CN202011110330.8A CN202011110330A CN112261108A CN 112261108 A CN112261108 A CN 112261108A CN 202011110330 A CN202011110330 A CN 202011110330A CN 112261108 A CN112261108 A CN 112261108A
Authority
CN
China
Prior art keywords
big data
module
management
platform
cluster
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011110330.8A
Other languages
Chinese (zh)
Inventor
郏光奇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Aogong Information Technology Co ltd
Original Assignee
Jiangsu Aogong Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Aogong Information Technology Co ltd filed Critical Jiangsu Aogong Information Technology Co ltd
Priority to CN202011110330.8A priority Critical patent/CN112261108A/en
Publication of CN112261108A publication Critical patent/CN112261108A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/176Support for shared access to files; File sharing support
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2219Large Object storage; Management thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a cluster management platform based on big data sharing service, which belongs to the technical field of big data management and comprises a big data sharing platform, a big data management platform and a big data cloud exchange platform, wherein the output end of the big data sharing platform is in communication connection with the input end of the big data management platform, and the output end of the big data management platform is in communication connection with the input end of the big data cloud exchange platform; in the invention, a Hadoop storage system with high expandability is arranged in the system, a Hadoop technical system is adopted as a storage and calculation frame of large data exchange, a Hadoop HDFS file system, a MapReduce calculation system and an HBase database system are utilized to support mass data, the improvement of data exchange capacity can be realized by the transverse expansion of standard hardware, a streaming data processing module is arranged in the system, and the advanced streaming data technology is adopted to enable the data processing service to be distributed in multiple points and processed according to the data volume, so that the use effect is good.

Description

Cluster management platform based on big data sharing service
Technical Field
The invention belongs to the technical field of big data management, and particularly relates to a cluster management platform based on big data sharing service.
Background
With the development of science and technology, big data concepts are proposed, big data is a term from the IT industry, generally refers to a data set which cannot be captured, managed and processed by a conventional software tool within a certain time range, is a massive, high-growth-rate and diversified information asset which can have stronger decision making power, insight discovery power and flow optimization capability only by a new processing mode, and in many industries, in order to acquire user habit information of a user, the big data acquisition and big data analysis are performed, and when the big data is subjected to sharing service, cluster management is performed.
The Chinese patent discloses (CN201610531522.3) an information security big data management system based on trusted cloud computing, which comprises an information sharing service platform and an information security service platform, wherein the information sharing service platform comprises a platform interface layer, a platform management layer and a platform deployment layer, the information security service platform comprises a data security processing layer and a data service layer, and the platform interface layer provides a uniform interface to the outside to realize the publishing, inquiring and acquiring of data by a user; the platform management layer is used for managing data processed by the data security processing layer and comprises an information storage module, a service classification management module and a service query retrieval module which are connected in sequence, the information sharing service platform effectively solves the problems of pressure concentration, difficult management of a large number of services and the like caused by centralized service management, a cloud storage system is used for storing the encrypted data, specific storage equipment information does not need to be known, the problems of data backup, redundancy and the like do not need to be considered, time cost and storage cost are saved, a large data management system is not arranged in the system, the system cannot manage various data information in real time and can only be used for sharing, as the large data has various types, if the data management is not carried out, the data are easy to be mixed and disordered, and meanwhile, the system also does not have a management monitoring system and cannot monitor the large data, the user cannot know the running condition of the platform in real time and needs to improve the platform to some extent.
Disclosure of Invention
The invention aims to: the cluster management platform based on the big data sharing service is provided for solving the problems that a big data management system is not arranged in a big data cluster management platform at present, various data information cannot be managed in real time and can only be shared, data are easy to be confused and disordered if the big data are not managed due to various kinds of big data, a management monitoring system is not provided at the same time, the big data cannot be monitored, and a user cannot know the running condition of the platform in real time.
In order to achieve the purpose, the invention adopts the following technical scheme:
the cluster management platform based on the big data sharing service comprises a big data sharing platform, a big data management platform and a big data cloud exchange platform, wherein the output end of the big data sharing platform is in communication connection with the input end of the big data management platform, and the output end of the big data management platform is in communication connection with the input end of the big data cloud exchange platform.
Preferably, the big data sharing platform comprises a cloud message server, a big data storage and exchange module, a stream data processing module and a data management and monitoring module, wherein an output end of the cloud message server is electrically connected with an input end of the big data storage and exchange module, an output end of the big data storage and exchange module is electrically connected with an input end of the stream data processing module, and an output end of the stream data processing module is electrically connected with an input end of the data management and monitoring module.
Preferably, the big data management platform comprises a cluster management module, a cluster deployment module, a task management platform, a service management module, a user management module and a state monitoring module, and the output end of the big data management platform is respectively connected with the input ends of the cluster management module, the cluster deployment module, the task management platform, the service management module, the user management module and the state monitoring module through a network.
Preferably, the big data cloud exchange platform comprises a directory management system, a data exchange system, a management monitoring system and a real-time system monitoring and resource alarming module, wherein the output end of the directory management system is electrically connected with the input ends of the role resource authority management module, the classification system and keyword resource management module, the database and file cataloging management module and the data exchange system respectively, the output end of the data exchange system is electrically connected with the input ends of the complex service configuration module driven by the service component, the Links service configuration module driven by the database and the management monitoring system respectively, and the output end of the management monitoring system is electrically connected with the input ends of the business domain management module, the node agent service management module and the real-time system monitoring and resource alarming module respectively.
Preferably, a Hadoop technical system is adopted in the big data storage exchange module as a storage and calculation frame of big data exchange.
Preferably, the cluster management module includes restart and shutdown of nodes, automatic discovery and cluster of nodes, and node status display, the cluster deployment module includes creation and deletion of clusters, and the task management platform includes submission, stop and deletion of tasks.
Preferably, the service management module includes restart and shutdown of the service and display of a service state, the user management module includes addition and deletion of user and user group permission settings, and the state monitoring module includes running state monitoring, node resource monitoring and cluster resource monitoring.
Preferably, the data exchange system provides complete configuration service development tools, which are Links and ServiceWorks.
Preferably, the development design tool of the complex service configuration module driven by the service component is ServiceWorks.
Preferably, the user in the resource alarm module can set alarm valve values for various resources through the alarm service to remind the user of various early warnings or abnormal conditions.
In summary, due to the adoption of the technical scheme, the invention has the beneficial effects that:
1. in the invention, a Hadoop storage system with high expandability is arranged in the system, a Hadoop technical system is adopted as a storage and calculation frame of large data exchange, a Hadoop HDFS file system, a MapReduce calculation system and an HBase database system are utilized to support mass data, so that the improvement of data exchange capacity can be realized by the transverse expansion of standard hardware, a streaming data processing module is arranged in the system, and the advanced streaming data technology is adopted to enable the data processing service to be distributed in multiple points and processed according to the data quantity, so that the use effect is good.
2. In the invention, a catalog management system is arranged in the system, a standard classification system is established for resources, classification system management is provided, at the same time, supports the management of key words, facilitates the inquiry and index of resources, can provide the online and offline cataloging of resources such as databases or files, and the like, edit and arrange various information resources, manages the use authority of the data resource, provides the detailed distribution of the resource use authority, and audits the resource according to the role, the Links provides a configuration tool driven by a data structure for the user, realizes the exchange definition from the database to the database, and greatly improves the efficiency of customizing the data exchange service based on the databases.
3. According to the invention, a large number of different conditions can be managed through the built-in large data management platform, the breadth and the range of a large data management range are greatly improved, the use effect of the platform is improved, the large data sharing platform, the large data management platform and the large data cloud exchange platform are integrated, the rapidity of large data information transmission is effectively improved, and the accuracy of information processing and the breadth of information sharing are improved.
Drawings
Fig. 1 is a schematic structural diagram of a main system module of a cluster management platform based on big data sharing service according to the present invention;
FIG. 2 is a schematic structural diagram of a subsystem module of a big data sharing platform in a cluster management platform based on big data sharing service according to the present invention;
FIG. 3 is a schematic structural diagram of a subsystem module of a big data management platform in a cluster management platform based on big data sharing service according to the present invention;
fig. 4 is a schematic structural diagram of a subsystem module of a big data cloud exchange platform in a cluster management platform based on big data sharing service according to the present invention;
illustration of the drawings: 1. a big data sharing platform; 2. a big data management platform; 3. big data cloud exchange platform.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-4, the present invention provides a technical solution: a cluster management platform based on big data sharing service comprises a big data sharing platform 1, a big data management platform 2 and a big data cloud exchange platform 3, wherein the output end of the big data sharing platform 1 is in communication connection with the input end of the big data management platform 2, and the output end of the big data management platform 2 is in communication connection with the input end of the big data cloud exchange platform 3;
the big data sharing platform 1 comprises a cloud message server, a big data storage and exchange module, a streaming data processing module and a data management and monitoring module, wherein the output end of the cloud message server is electrically connected with the input end of the big data storage and exchange module, the output end of the big data storage and exchange module is electrically connected with the input end of the streaming data processing module, the output end of the streaming data processing module is electrically connected with the input end of the data management and monitoring module, a Hadoop technical system is adopted in the big data storage and exchange module as a storage and calculation frame of big data exchange, the big data sharing platform 1 comprises the cloud message server, the big data storage and exchange module, the streaming data processing module and the data management and monitoring module, and the Hadoop technical system is adopted as a storage and calculation frame of big data exchange, the HDFS file system of Hadoop, the computing system of MapReduce and the database system of HBase are used for supporting mass data, so that the improvement of data exchange capacity can be realized by the transverse expansion of standard hardware, a streaming data processing module is arranged in the HDFS file system, and the advanced streaming data technology is adopted to enable the data processing service to be distributed in multiple points and processed according to the data volume, so that the use effect is good;
the big data management platform 2 comprises a cluster management module, a cluster deployment module, a task management platform, a service management module, a user management module and a state monitoring module, wherein the output end of the big data management platform 2 is respectively connected with the input ends of the cluster management module, the cluster deployment module, the task management platform, the service management module, the user management module and the state monitoring module through a network, the cluster management module comprises the restarting and closing of nodes, the automatic discovery and the cluster of the nodes and the state display of the nodes, the cluster deployment module comprises the creation and the deletion of the cluster, the task management platform comprises the submission, the stop and the deletion of tasks, the service management module comprises the restarting and the closing of services and the display of service states, the user management module comprises the user authority setting of the addition and the deletion of users and user groups, and the state monitoring module comprises the running state monitoring module, the running state monitoring, The node resource monitoring and cluster resource monitoring are realized, and the big data management platform 2 comprises a cluster management module, a cluster deployment module, a task management platform, a service management module, a user management module and a state monitoring module, and can manage a large number of different conditions, so that the breadth and the range of a big data management range are greatly improved, and the using effect of the platform is improved;
the big data cloud exchange platform 3 comprises a directory management system, a data exchange system, a management monitoring system and a real-time system monitoring and resource alarming module, wherein the output end of the directory management system is respectively electrically connected with the input ends of a role resource authority management module, a classification system and keyword resource management module, a database and file cataloging management module and the data exchange system, the output end of the data exchange system is respectively electrically connected with the input ends of a complex service configuration module driven by a service component, a Links service configuration module driven by the database and the management monitoring system, the output end of the management monitoring system is respectively electrically connected with the input ends of a business domain management module, a node agent service management module and the real-time system monitoring and resource alarming module, a complete configuration service development tool is provided in the data exchange system as Links and service works, the development design tool of the complex service configuration module driven by the service component is ServiceWorks, a user in the resource alarm module can set alarm valve values for various resources through alarm service to remind the user of various early warning or abnormal conditions, the big data cloud exchange platform 3 is arranged and comprises a directory management system, a data exchange system, a management monitoring system and a real-time system monitoring and resource alarm module, the output end of the directory management system is respectively electrically connected with the input ends of the role resource authority management module, the classification system and keyword resource management module, the database and file cataloging management module and the data exchange system, a standard classification system is established for the resources, the classification system management is provided, the keyword management is supported, the resources are convenient to inquire and index, the online and offline cataloging of the resources such as a database or a file can be provided, various information resources are edited and sorted, the use permission of the data resources is managed, the detailed distribution of the use permission of the resources is provided, the resource examination and verification according to roles are provided, meanwhile, a data exchange system is arranged, the data exchange service based on directory resources can be provided, a templating technology is adopted, a user can easily realize self-service exchange service, the main functions of the data exchange system are realized, Links provides a configuration tool driven by a data structure for the user, the exchange definition from a database to the database is realized, and the efficiency of customizing the data exchange service based on the databases is greatly improved;
the big data management platform can manage a large number of different conditions, greatly improves the breadth and range of a big data management range, improves the using effect of the platform, integrates a big data sharing platform, the big data management platform and a big data cloud exchange platform together, effectively improves the rapidity of big data information propagation, and improves the accuracy of information processing and the breadth of information sharing.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.

Claims (10)

1. The utility model provides a cluster management platform based on big data sharing service, includes big data sharing platform (1), big data management platform (2) and big data cloud exchange platform (3), its characterized in that: the output end of the big data sharing platform (1) is in communication connection with the input end of the big data management platform (2), and the output end of the big data management platform (2) is in communication connection with the input end of the big data cloud exchange platform (3).
2. The cluster management platform based on big data sharing service according to claim 1, wherein: the big data sharing platform (1) comprises a cloud message server, a big data storage and exchange module, a stream data processing module and a data management and monitoring module, wherein the output end of the cloud message server is electrically connected with the input end of the big data storage and exchange module, the output end of the big data storage and exchange module is electrically connected with the input end of the stream data processing module, and the output end of the stream data processing module is electrically connected with the input end of the data management and monitoring module.
3. The cluster management platform based on big data sharing service according to claim 1, wherein: the big data management platform (2) comprises a cluster management module, a cluster deployment module, a task management platform, a service management module, a user management module and a state monitoring module, and the output end of the big data management platform (2) is respectively connected with the input ends of the cluster management module, the cluster deployment module, the task management platform, the service management module, the user management module and the state monitoring module through a network.
4. The cluster management platform based on big data sharing service according to claim 1, wherein: the big data cloud exchange platform (3) comprises a directory management system, a data exchange system, a management monitoring system and a real-time system monitoring and resource alarming module, wherein the output end of the directory management system is electrically connected with the input ends of a role resource authority management module, a classification system and keyword resource management module, a database and file cataloging management module and the data exchange system respectively, the output end of the data exchange system is electrically connected with the input ends of a complex service configuration module driven by a service component, a Links service configuration module driven by the database and the management monitoring system respectively, and the output end of the management monitoring system is electrically connected with the input ends of a service domain management module, a node agent service management module and the real-time system monitoring and resource alarming module respectively.
5. The cluster management platform based on big data sharing service according to claim 2, wherein: a Hadoop technical system is adopted in the big data storage exchange module as a storage and calculation frame of big data exchange.
6. The cluster management platform based on big data sharing service according to claim 3, wherein: the cluster management module comprises the restarting and closing of nodes, the automatic discovery and cluster of the nodes and the node state display, the cluster deployment module comprises the creation and deletion of the cluster, and the task management platform comprises the submission, the stop and the deletion of tasks.
7. The cluster management platform based on big data sharing service of claim 6, wherein: the service management module comprises the restarting and closing of services and the display of service states, the user management module comprises the setting of user authority addition and deletion of users and user groups, and the state monitoring module comprises the operation state monitoring, the node resource monitoring and the cluster resource monitoring.
8. The cluster management platform based on big data sharing service according to claim 4, wherein: the data exchange system provides complete configurated service development tools, namely Links and ServiceWorks.
9. The cluster management platform based on big data sharing service according to claim 4, wherein: the development design tool of the complex service configuration module driven by the service component is ServiceWorks.
10. The cluster management platform based on big data sharing service according to claim 4, wherein: the user can set alarm valve values for various resources through the alarm service in the resource alarm module to remind the user of various early warnings or abnormal conditions.
CN202011110330.8A 2020-10-16 2020-10-16 Cluster management platform based on big data sharing service Pending CN112261108A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011110330.8A CN112261108A (en) 2020-10-16 2020-10-16 Cluster management platform based on big data sharing service

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011110330.8A CN112261108A (en) 2020-10-16 2020-10-16 Cluster management platform based on big data sharing service

Publications (1)

Publication Number Publication Date
CN112261108A true CN112261108A (en) 2021-01-22

Family

ID=74244555

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011110330.8A Pending CN112261108A (en) 2020-10-16 2020-10-16 Cluster management platform based on big data sharing service

Country Status (1)

Country Link
CN (1) CN112261108A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113420328A (en) * 2021-06-23 2021-09-21 鹤壁国立光电科技股份有限公司 Big data batch sharing exchange system

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100161565A1 (en) * 2008-12-18 2010-06-24 Electronics And Telecommunications Research Institute Cluster data management system and method for data restoration using shared redo log in cluster data management system
CN103281368A (en) * 2013-05-22 2013-09-04 河海大学 Data sharing exchange model and method based on cloud computation
US20160078342A1 (en) * 2012-05-04 2016-03-17 Transoft (Shanghai), Inc. Systems and methods of autonomic virtual network management
CN105703940A (en) * 2015-12-10 2016-06-22 中国电力科学研究院 Multistage dispatching distributed parallel computing-oriented monitoring system and monitoring method
CN106326006A (en) * 2016-08-23 2017-01-11 成都卡莱博尔信息技术股份有限公司 Task management system aiming at task flow of data platform
US20170344618A1 (en) * 2010-12-23 2017-11-30 Eliot Horowitz Systems and methods for managing distributed database deployments
CN107733986A (en) * 2017-09-15 2018-02-23 中国南方电网有限责任公司 Support the protection of integrated deployment and monitoring operation big data support platform
CN109086301A (en) * 2018-06-20 2018-12-25 江苏网域科技有限公司 A kind of data management platform based on cloud computing
CN109981772A (en) * 2019-03-22 2019-07-05 西安电子科技大学 A kind of multiple domain data share exchange platform architecture based on block chain

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100161565A1 (en) * 2008-12-18 2010-06-24 Electronics And Telecommunications Research Institute Cluster data management system and method for data restoration using shared redo log in cluster data management system
US20170344618A1 (en) * 2010-12-23 2017-11-30 Eliot Horowitz Systems and methods for managing distributed database deployments
US20160078342A1 (en) * 2012-05-04 2016-03-17 Transoft (Shanghai), Inc. Systems and methods of autonomic virtual network management
CN103281368A (en) * 2013-05-22 2013-09-04 河海大学 Data sharing exchange model and method based on cloud computation
CN105703940A (en) * 2015-12-10 2016-06-22 中国电力科学研究院 Multistage dispatching distributed parallel computing-oriented monitoring system and monitoring method
CN106326006A (en) * 2016-08-23 2017-01-11 成都卡莱博尔信息技术股份有限公司 Task management system aiming at task flow of data platform
CN107733986A (en) * 2017-09-15 2018-02-23 中国南方电网有限责任公司 Support the protection of integrated deployment and monitoring operation big data support platform
CN109086301A (en) * 2018-06-20 2018-12-25 江苏网域科技有限公司 A kind of data management platform based on cloud computing
CN109981772A (en) * 2019-03-22 2019-07-05 西安电子科技大学 A kind of multiple domain data share exchange platform architecture based on block chain

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
GLA国路安科技: "政务大数据方案,建设互联网+政务服务的基石", 《百度网址HTTPS://WWW.SOHU.COM/A/277071841_100293626》 *
方亮;黄晓红;: "企业融合架构云服务平台的构建及应用创新", 数字技术与应用, no. 06 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113420328A (en) * 2021-06-23 2021-09-21 鹤壁国立光电科技股份有限公司 Big data batch sharing exchange system

Similar Documents

Publication Publication Date Title
CN111984499B (en) Fault detection method and device for big data cluster
CN107302466B (en) Big data analysis platform and method for dynamic loop monitoring system
CN110650038B (en) Security event log collecting and processing method and system for multiple classes of supervision objects
CN106651633B (en) Power utilization information acquisition system based on big data technology and acquisition method thereof
CN106571960B (en) Log collection management system and method
CN104881352A (en) System resource monitoring device based on mobile terminal
CN112600891A (en) Edge cloud cooperation system based on information physical fusion and working method
CN112688819A (en) Comprehensive management system for network operation and maintenance
CN112671840B (en) Cross-department data sharing system and method based on block chain technology
CN113448812A (en) Monitoring alarm method and device under micro-service scene
CN111641524A (en) Monitoring data processing method, device, equipment and storage medium
CN113468159A (en) Data application full-link management and control method and system
Ma et al. Design and implementation of smart city big data processing platform based on distributed architecture
CN112559634A (en) Big data management system based on computer cloud computing
CN110161930B (en) Data monitoring system and data monitoring method thereof
CN115801563A (en) Method and application for dynamically collecting cluster logs
CN112261108A (en) Cluster management platform based on big data sharing service
CN113378219B (en) Unstructured data processing method and system
CN114510391A (en) Monitoring management system integrating infrastructure
CN113765717A (en) Operation and maintenance management system based on secret-related special computing platform
CN116961241B (en) Unified application monitoring platform based on power grid business
CN116366692A (en) High-performance intelligent edge terminal system
CN116431324A (en) Edge system based on Kafka high concurrency data acquisition and distribution
CN115391429A (en) Time sequence data processing method and device based on big data cloud computing
Chaolong et al. Study of smart transportation data center virtualization based on vmware vsphere and parallel continuous query algorithm over massive data streams

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination