CN112579703A - Big data comprehensive operation and maintenance platform processing system based on cloud computing - Google Patents
Big data comprehensive operation and maintenance platform processing system based on cloud computing Download PDFInfo
- Publication number
- CN112579703A CN112579703A CN202011513410.8A CN202011513410A CN112579703A CN 112579703 A CN112579703 A CN 112579703A CN 202011513410 A CN202011513410 A CN 202011513410A CN 112579703 A CN112579703 A CN 112579703A
- Authority
- CN
- China
- Prior art keywords
- synchronization
- module
- data
- platform
- synchronous
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 37
- 238000012423 maintenance Methods 0.000 title claims abstract description 28
- 230000001360 synchronised effect Effects 0.000 claims abstract description 42
- 238000012544 monitoring process Methods 0.000 claims abstract description 38
- 238000007726 management method Methods 0.000 claims abstract description 33
- 238000009792 diffusion process Methods 0.000 claims abstract description 26
- 238000012795 verification Methods 0.000 claims abstract description 14
- 238000004458 analytical method Methods 0.000 claims abstract description 8
- 238000012384 transportation and delivery Methods 0.000 claims abstract description 7
- 238000012800 visualization Methods 0.000 claims abstract description 5
- 230000006870 function Effects 0.000 claims description 15
- 230000008859 change Effects 0.000 claims description 9
- 230000005540 biological transmission Effects 0.000 claims description 6
- 230000007246 mechanism Effects 0.000 claims description 6
- 230000002457 bidirectional effect Effects 0.000 claims description 4
- 238000013439 planning Methods 0.000 claims description 4
- 230000008878 coupling Effects 0.000 claims description 3
- 238000010168 coupling process Methods 0.000 claims description 3
- 238000005859 coupling reaction Methods 0.000 claims description 3
- 238000009434 installation Methods 0.000 claims description 3
- 238000004806 packaging method and process Methods 0.000 claims description 3
- 238000000034 method Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 5
- 238000013500 data storage Methods 0.000 description 4
- 238000003860 storage Methods 0.000 description 4
- 230000002159 abnormal effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 208000014633 Retinitis punctata albescens Diseases 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000009960 carding Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 208000015778 Undifferentiated pleomorphic sarcoma Diseases 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000013481 data capture Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000012946 outsourcing Methods 0.000 description 1
- 230000000149 penetrating effect Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000004402 ultra-violet photoelectron spectroscopy Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/275—Synchronous replication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/602—Providing cryptographic facilities or services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Abstract
The invention discloses a cloud computing-based big data comprehensive operation and maintenance platform processing system, which comprises a cloud computing module and a big data processing module; the cloud computing module comprises an HTCloud cloud operating unit, an HTAppady high-performance application delivery unit and an HTSecurity intelligent security platform, and the big data processing module comprises an xy big data center comprehensive operation and maintenance management platform and an xy multi-source heterogeneous data exchange platform; the xy large data center comprehensive operation and maintenance management platform comprises a uniform resource monitoring module, a real-time abnormity warning module, an accurate fault positioning module and a visualization and decision analysis module; the xy multi-source heterogeneous data exchange platform adopts a layered structure, is in a one-way/two-way synchronous network topology and supports branch node diffusion and non-diffusion strategies; the xy multi-source heterogeneous data exchange platform comprises an encryption verification module, a data synchronization module between mainstream heterogeneous databases, a synchronization monitoring module, a synchronization topology module and a synchronization scheduling module.
Description
Technical Field
The invention relates to the technical field of big data, in particular to a big data comprehensive operation and maintenance platform processing system based on cloud computing.
Background
Cloud computing (cloud computing) is one type of distributed computing, and means that a huge data computing processing program is decomposed into countless small programs through a network "cloud", and then the small programs are processed and analyzed through a system consisting of a plurality of servers to obtain results and are returned to a user. In the early stage of cloud computing, simple distributed computing is adopted, task distribution is solved, and computing results are merged. Thus, cloud computing is also known as grid computing. By the technology, tens of thousands of data can be processed in a short time (several seconds), so that strong network service is achieved.
At present, the cloud service is not just distributed computing, but a result of hybrid evolution and leap of computer technologies such as distributed computing, utility computing, load balancing, parallel computing, network storage, hot backup redundancy, virtualization and the like. Platform operation and maintenance management by utilizing cloud computing and big data can realize a plurality of functions, and the functions of the platform operation and maintenance management are to be developed.
Disclosure of Invention
The invention aims to solve the defects in the prior art, and provides a cloud computing-based big data integrated operation and maintenance platform processing system.
In order to achieve the purpose, the invention adopts the following technical scheme:
a big data comprehensive operation and maintenance platform processing system based on cloud computing comprises a cloud computing module and a big data processing module; the cloud computing module comprises an HTCloud cloud operating unit, an HTAppady high-performance application delivery unit and an HTSecurity intelligent security platform, and the big data processing module comprises an xy big data center comprehensive operation and maintenance management platform and an xy multi-source heterogeneous data exchange platform; the xy big data center comprehensive operation and maintenance management platform comprises a uniform resource monitoring module, a real-time abnormity warning module, an accurate fault positioning module and a visualization and decision analysis module; the xy multi-source heterogeneous data exchange platform adopts a layered structure, is a one-way/two-way synchronous network topology and supports branch node diffusion and non-diffusion strategies; the xy multi-source heterogeneous data exchange platform comprises an encryption verification module, a data synchronization module between mainstream heterogeneous databases, a synchronization monitoring module, a synchronization topology module and a synchronization scheduling module.
Preferably, the xy multi-source heterogeneous data exchange platform adopts a client-server synchronization model and comprises a synchronous network planning management unit, an installation configuration unit, a block pipeline processing unit, a one-way synchronization unit, a two-way synchronization unit and a synchronization correctness guarantee unit, the xy multi-source heterogeneous data exchange platform runs in a parallel and independent mode, and a distributed multi-source heterogeneous data synchronization mechanism is provided in a loose coupling cooperation mode.
Preferably, the xy multi-source heterogeneous data exchange platform comprises a transmission layer, a SyncML protocol framework layer and an application layer, wherein the transmission layer receives and sends synchronous messages based on HTTP, HTTPS, SMTP and OBEX; the SyncML protocol framework layer participates in packaging and analyzing SyncML messages, receiving and sending the SyncML messages, realizes the SyncML synchronization protocol and provides a safety verification service; and the application layer realizes database data synchronization through a SyncML protocol.
Preferably, the xy multi-source heterogeneous data exchange platform unidirectional/bidirectional synchronous network topological structure corresponds to the application of synchronous collected data from bottom to top, and the unidirectional topology forms a tree-shaped set structure; the xy multi-source heterogeneous data exchange platform supports each pair of adjacent nodes on the synchronization tree to form a basic synchronization pair, and the adjacent synchronization node pairs are configured to have double roles of a client and a server.
Preferably, in the xy multi-source heterogeneous data exchange platform, data synchronization is realized by providing two configuration strategies of diffusion and non-diffusion, the received synchronous change is recorded into a change log table of the server by the diffusion strategy, and the client synchronous data change is not recorded by the change log of the server by the non-diffusion strategy.
Preferably, the encryption verification module encrypts the data content in the transmission process and performs MD5 verification; the functions of the data synchronization module comprise single-attribute main key table synchronization, multi-attribute main key table synchronization, no main key table synchronization, main key prefix addition, increment synchronization multi-thread control, log over-threshold to full-volume mode and database inside and outside file synchronization; the data synchronization module between the main stream heterogeneous databases supports data synchronization between MySQL, SQL Server, Oracle and Sybase databases; the synchronous mode of the xy multi-source heterogeneous data exchange platform comprises a diffusion/non-diffusion synchronous mode, an optimistic and prudent option mode, a refreshing mode and a merging mode; the synchronous monitoring module has the functions of state monitoring, synchronous task monitoring, synchronous data queue, synchronous table configuration management, client log, server log and longest time consumption statistics; the synchronous topological module is in a tree structure and comprises a client/service pair; the synchronous scheduling module has the functions of timing synchronization and forced synchronization.
Preferably, the HTCloud cloud operation unit includes a plurality of management modules for resources, containers, monitoring, work orders, logs, identities, systems.
The invention has the beneficial effects that: aiming at the characteristics and requirements of cross-region and cross-system data collection, high-availability cloud data access, data centralized processing and the like, a client-server synchronization model, an open universal data synchronization protocol and a HUB type heterogeneous data type mapping mechanism are adopted, key technologies such as massive relational database record set synchronization, data transmission and database operation parallel processing, data table full/incremental synchronization concurrent processing and the like are broken through, and an industry-oriented large data center processing platform middle layer function suite is constructed; the management system is applied to various original data carding and preparation, intelligent analysis and retrieval of thematic data, geographic space attribute correlation calculation of business data, multidimensional polymorphic display of data results and the like of an industrial data center.
Drawings
Fig. 1 is a structural diagram of a management system according to the present invention.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to specific embodiments, and it should be understood that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
Referring to fig. 1, the big data comprehensive operation and maintenance platform processing system based on cloud computing comprises a cloud computing module and a big data processing module; the cloud computing module comprises an HTCloud cloud operating unit, an HTAppady high-performance application delivery unit and an HTSecurity intelligent security platform, and the big data processing module comprises an xy big data center comprehensive operation and maintenance management platform and an xy multi-source heterogeneous data exchange platform; the xy large data center comprehensive operation and maintenance management platform comprises a uniform resource monitoring module, a real-time abnormity warning module, an accurate fault positioning module and a visualization and decision analysis module; the xy multi-source heterogeneous data exchange platform adopts a layered structure, is in a one-way/two-way synchronous network topology and supports branch node diffusion and non-diffusion strategies; the xy multi-source heterogeneous data exchange platform comprises an encryption verification module, a data synchronization module between mainstream heterogeneous databases, a synchronization monitoring module, a synchronization topology module and a synchronization scheduling module.
In this embodiment, the xy multi-source heterogeneous data exchange platform adopts a client-server synchronization model, and includes a synchronization network planning management unit, an installation configuration unit, a blocking pipeline processing unit, a unidirectional synchronization unit, a bidirectional synchronization unit, and a synchronization correctness guarantee unit, and the xy multi-source heterogeneous data exchange platform operates in a parallel independent mode, and provides a distributed multi-source heterogeneous data synchronization mechanism in a loose coupling cooperation mode.
In this embodiment, the xy multi-source heterogeneous data exchange platform includes a transport layer, a SyncML protocol framework layer, and an application layer, where the transport layer receives and sends a synchronization message based on HTTP, HTTPs, SMTP, and OBEX; the SyncML protocol framework layer participates in packaging and analyzing SyncML messages, receiving and sending the SyncML messages, realizes the SyncML synchronization protocol and provides a safety verification service; and the application layer realizes database data synchronization through a SyncML protocol.
In this embodiment, the xy multi-source heterogeneous data exchange platform unidirectional/bidirectional synchronous network topology structure corresponds to the application of synchronous collected data from bottom to top, and the unidirectional topology forms a tree structure; the xy multi-source heterogeneous data exchange platform supports each pair of adjacent nodes on the synchronization tree to form a basic synchronization pair, and the adjacent synchronization node pairs are configured to have double roles of a client and a server.
In this embodiment, in the xy multi-source heterogeneous data exchange platform, data synchronization is implemented to provide two configuration strategies, namely diffusion and non-diffusion, the diffusion strategy is to record received synchronous changes into a change log table of a server, and the change log of the server does not record client synchronous data changes according to the non-diffusion strategy.
In this embodiment, the encryption verification module encrypts the data content during transmission, and performs MD5 verification; the functions of the data synchronization module comprise single-attribute main key table synchronization, multi-attribute main key table synchronization, no main key table synchronization, main key prefix addition, increment synchronization multi-thread control, log over-threshold to full-volume mode and database inside and outside file synchronization; the data synchronization module between the main stream heterogeneous databases supports data synchronization between MySQL, SQL Server, Oracle and Sybase databases; the synchronous mode of the xy multi-source heterogeneous data exchange platform comprises a diffusion/non-diffusion synchronous mode, an optimistic and prudent option mode, a refreshing mode and a merging mode; the synchronous monitoring module has the functions of state monitoring, synchronous task monitoring, synchronous data queue, synchronous table configuration management, client log, server log and longest time consumption statistics; the synchronous topological module is in a tree structure and comprises a client/service pair; the synchronous scheduling module has the functions of timing synchronization and forced synchronization.
In this embodiment, the HTCloud cloud operating unit includes a plurality of management modules for resources, containers, monitoring, work orders, logs, identities, systems.
The xy multi-source heterogeneous data exchange platform is a general basic function suite for an industry data center and is applied to scenes of various (different sources, formats and qualities) original data carding and preparation, thematic data intelligent analysis and retrieval and mining, business data geographic space attribute correlation calculation, data result multi-dimensional polymorphic display and the like.
The xy multi-source heterogeneous data exchange platform provides a general Internet data resource synchronization solution, is suitable for large-scale synchronization and collection of heterogeneous data resources of various autonomous information systems, is suitable for various mainstream relational database products meeting the SQL92 standard, and can widely cover a large-scale data synchronization intermediate layer system for autonomously managing heterogeneous data nodes.
It is characterized in that: physical storage of support data originates from computers of different architectures; the storage of the support data originates from different operating systems; supporting the isomerism of data formats and the difference of data storage management mechanisms; supporting data storage in distributed physical locations; the data storage method supports the logic model heterogeneity of data storage, and data are stored and maintained in different business logics respectively.
The xy large data center comprehensive operation and maintenance management platform is a set of comprehensive cross-platform IT infrastructure operation state monitoring system. The operation state of the IT basic resource is collected uninterruptedly, the prefabricated IT service model is compared, and the IT operation and maintenance information is shown in an extraction mode.
It includes the following features and functions, the visual presentation: a brand-new plug-in development framework is adopted to realize unified visual display of IDC machine rooms, monitoring networks, operation services and applications, dynamic and real-time data and graphic display is carried out on the basis of CMDB, and the interactive operation capability of technicians on a WEB platform is improved.
IT service management: with configuration management as a core, the processing system automatically generates or manually initiates service demands by users, formulates tracking processing of different processes such as events, problems, changes and releases through the support of a workflow engine platform, decomposes and solidifies daily operation and maintenance operation plans and outsourcing service work, and forms an evaluable management index.
Application performance management: the method has the advantages that the key enterprise systems such as an operating system, an application server, a database, middleware, Web services, Web transactions, virtualization, ERP and the like occupy IDC machine room dynamic rings, resource application and the like, multi-angle and deep remote monitoring and management are carried out, and the running condition, the usability, the service influence and the actual experience of a final user of cloud application are mastered in time.
Monitoring uniform resources: and based on the resource model, uniformly planning a monitoring scheme to cover all resource nodes and a complete application chain. Active monitoring is performed on important IT equipment, such as network switches, routers, firewalls, UPSs, servers, storage, databases and the like. Provide 7 x 24 hours of uninterrupted monitoring of the underlying device resources.
And (3) real-time abnormal alarm: and configuring monitoring frequency according to various resource monitoring requirements, reducing invalid resource consumption, customizing a service monitoring path according to an event and scheduling in real time. By real-time monitoring of IT equipment and application activities, the system automatically initiates an alarm and response mechanism when an abnormal event occurs, notifying the responsible person at the first time.
Accurate fault location: the network full link tracking, the fault detection has no dead angle, the alarm information is compressed intelligently, the invalid line and repeated alarm are avoided, and the fault resource node is positioned accurately. Regularly and automatically carrying out health inspection on IT equipment hardware and an application system, and matching with an IT operation and maintenance team to carry out health inspection and monitoring on the system.
Visualization and decision analysis: and the abnormal event statistical analysis data is visualized, and the attention information is visually and intensively displayed. Data penetrating query is supported, required data items and display styles are freely defined through tables and patterns, and data windows are freely defined through dragging type layout, independent color matching and the like. And the machine room facilities and the resources are displayed in a live-action mode, and the machine room 3D model and the resources are monitored and integrated.
The application scenes are as follows: automation of an IT work order: the method supports automatic execution of IT work order tasks, such as VPN permission application, file server permission application, application system permission application and Internet access opening; applying domain name change, disk space expansion application and applying a firewall opening strategy. Resource delivery automation: according to the client resource application, automatic delivery is realized, the delivery efficiency of IT resources is improved, and the rapid online of an application system is guaranteed. Alarm processing automation: by analyzing the alarm information, the alarm processing, such as restarting a process, restarting a server, cleaning a log, expanding the volume of a table space and the like, is automatically performed, and the processing result is notified to a user.
The industrial application of the invention is mainly as follows: (1) the xy agricultural product safety circulation supply chain big data platform: the xy agricultural product secure circulation supply chain big data platform is a 'one cloud multi-end' comprehensive data service platform developed by integrating data information of information flow, fund flow, business flow and the like of an agricultural product supply chain based on application requirements of a Beijing new-place agricultural batch market, provides technical support for acceleration, quality improvement and cost reduction of a whole agricultural product supply chain, and is widely applied to information construction of an agricultural product distribution center, a wholesale market and the like. By combining the actual situation of the agricultural product wholesale market and the existing transaction mode, the platform covers core systems such as order agricultural management, vehicle access management, merchant management and the like, provides functions such as vehicle identification, cargo verification, electronic recording, mobile payment, market supervision and the like, gradually establishes an agricultural product quality grading standard, protects the safety of urban food, and is an efficient agricultural product supply chain information service system with intelligent, flow transparent and networked management of construction service.
(2) Regional medical big data processing platform: the regional medical big data processing platform is oriented to all levels of medical institutions, medical institutions and large physical examination institutions, provides customized cloud hospital information system products and services according to different service requirements, provides a core capability platform for integrating services, data and technical resources for the medical institutions and group hospitals, builds a new-generation medical information system which is easy to use, accurate and stable, promotes the longitudinal flow of medical resources, and creates an integrated internet medical online and offline service covering the whole service process.
(3) Big data platform of xy city fire control thing networking safety monitoring: the xy city fire fighting Internet of things safety monitoring cloud service platform is based on the principle of practical combat, overall promotion and step-by-step implementation, integrates the services of city fire fighting monitoring, safety power utilization monitoring, independent smoke detection, fire hydrant management, high-definition video monitoring, daily fire fighting patrol, mobile law enforcement and the like, creates an active safety prevention and control system with comprehensive sensing, open sharing, prediction early warning, research and judgment analysis and command decision making, provides integrated sensing fire fighting safety monitoring service for government departments, social units, intermediary organizations, social public and the like, and promotes the transformation from traditional fire fighting to modern fire fighting.
(4) The xyRPA process robot system: the xyRPA process robot system provides an intuitive and advanced automatic platform for each industry, easily improves the working efficiency of business processing, and obtains business benefits in a low-cost and nearly zero-risk mode. The RPA of the digital staff copies daily human-computer interaction, automatically executes monotonous repetitive tasks, and fills the gap between manual interaction and full automation. By means of automatic working capacity and customer support, digital staff expand the value of the platform, can complete tasks more quickly, reduce human errors, provide excellent customer service and enhance competitiveness for business development. Digital staff RPAs can be used in many scenarios, become an important component of automation strategies along with data capture, business rules, workflow, and the like.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (7)
1. A big data comprehensive operation and maintenance platform processing system based on cloud computing is characterized by comprising a cloud computing module and a big data processing module; the cloud computing module comprises an HTCloud cloud operating unit, an HTAppady high-performance application delivery unit and an HTSecurity intelligent security platform, and the big data processing module comprises an xy big data center comprehensive operation and maintenance management platform and an xy multi-source heterogeneous data exchange platform;
the xy big data center comprehensive operation and maintenance management platform comprises a uniform resource monitoring module, a real-time abnormity warning module, an accurate fault positioning module and a visualization and decision analysis module;
the xy multi-source heterogeneous data exchange platform adopts a layered structure, is a one-way/two-way synchronous network topology and supports branch node diffusion and non-diffusion strategies; the xy multi-source heterogeneous data exchange platform comprises an encryption verification module, a data synchronization module between mainstream heterogeneous databases, a synchronization monitoring module, a synchronization topology module and a synchronization scheduling module.
2. The cloud computing-based big data integrated operation and maintenance platform processing system according to claim 1, wherein the xy multi-source heterogeneous data exchange platform adopts a client-server synchronization model, and comprises a synchronization network planning management unit, an installation configuration unit, a block pipeline processing unit, a one-way synchronization unit, a two-way synchronization unit and a synchronization correctness guarantee unit, and the xy multi-source heterogeneous data exchange platform operates in a parallel and independent mode, and a distributed multi-source heterogeneous data synchronization mechanism is provided in a loose coupling cooperation mode.
3. The cloud computing-based big data integrated operation and maintenance platform processing system as claimed in claim 1, wherein the xy multi-source heterogeneous data exchange platform comprises a transport layer, a SyncML protocol framework layer and an application layer, wherein the transport layer receives and sends synchronization messages based on HTTP, HTTPs, SMTP and OBEX; the SyncML protocol framework layer participates in packaging and analyzing SyncML messages, receiving and sending the SyncML messages, realizes the SyncML synchronization protocol and provides a safety verification service; and the application layer realizes database data synchronization through a SyncML protocol.
4. The cloud computing-based big data integrated operation and maintenance platform processing system according to claim 1, wherein the xy multi-source heterogeneous data exchange platform unidirectional/bidirectional synchronous network topology corresponds to application of synchronous collected data from bottom to top, and the unidirectional topology forms a tree-shaped collection structure; the xy multi-source heterogeneous data exchange platform supports each pair of adjacent nodes on the synchronization tree to form a basic synchronization pair, and the adjacent synchronization node pairs are configured to have double roles of a client and a server.
5. The cloud computing-based big data integrated operation and maintenance platform processing system as claimed in claim 1, wherein in the xy multi-source heterogeneous data exchange platform, data synchronization is implemented to provide two configuration strategies of diffusion and non-diffusion, the diffusion strategy is to record received synchronous changes into a change log table of a server, and the change log of the non-diffusion strategy server does not record client synchronous data changes.
6. The cloud computing-based big data integrated operation and maintenance platform processing system according to claim 1, wherein the encryption verification module encrypts data content during transmission and performs MD5 verification; the functions of the data synchronization module comprise single-attribute main key table synchronization, multi-attribute main key table synchronization, no main key table synchronization, main key prefix addition, increment synchronization multi-thread control, log over-threshold to full-volume mode and database inside and outside file synchronization; the data synchronization module between the main stream heterogeneous databases supports data synchronization between MySQL, SQL Server, Oracle and Sybase databases; the synchronous mode of the xy multi-source heterogeneous data exchange platform comprises a diffusion/non-diffusion synchronous mode, an optimistic and prudent option mode, a refreshing mode and a merging mode;
the synchronous monitoring module has the functions of state monitoring, synchronous task monitoring, synchronous data queue, synchronous table configuration management, client log, server log and longest time consumption statistics; the synchronous topological module is in a tree structure and comprises a client/service pair; the synchronous scheduling module has the functions of timing synchronization and forced synchronization.
7. The cloud computing-based big data integrated operation and maintenance platform processing system as claimed in claim 1, wherein the HTCloud cloud operating unit comprises a plurality of management modules for resources, containers, monitoring, work orders, logs, identities, systems.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011513410.8A CN112579703A (en) | 2020-12-21 | 2020-12-21 | Big data comprehensive operation and maintenance platform processing system based on cloud computing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011513410.8A CN112579703A (en) | 2020-12-21 | 2020-12-21 | Big data comprehensive operation and maintenance platform processing system based on cloud computing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112579703A true CN112579703A (en) | 2021-03-30 |
Family
ID=75136359
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011513410.8A Pending CN112579703A (en) | 2020-12-21 | 2020-12-21 | Big data comprehensive operation and maintenance platform processing system based on cloud computing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112579703A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114553865A (en) * | 2022-01-12 | 2022-05-27 | 中国电子科技集团公司第十研究所 | Heterogeneous hybrid cloud system architecture design method |
| CN116187936A (en) * | 2023-02-03 | 2023-05-30 | 上海麦德通软件技术有限公司 | Work order intelligent generation system based on cloud platform |
| TWI817147B (en) * | 2021-06-23 | 2023-10-01 | 鼎新電腦股份有限公司 | Automated interface management method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101969475A (en) * | 2010-11-15 | 2011-02-09 | 张军 | Business data controllable distribution and fusion application system based on cloud computing |
| CN107046481A (en) * | 2017-04-18 | 2017-08-15 | 国网福建省电力有限公司 | A kind of information system integrated network management system comprehensive analysis platform |
| CN107122627A (en) * | 2017-03-28 | 2017-09-01 | 镇江睿泰资产管理有限公司 | Digital publishing system based on cloud computing |
-
2020
- 2020-12-21 CN CN202011513410.8A patent/CN112579703A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101969475A (en) * | 2010-11-15 | 2011-02-09 | 张军 | Business data controllable distribution and fusion application system based on cloud computing |
| CN107122627A (en) * | 2017-03-28 | 2017-09-01 | 镇江睿泰资产管理有限公司 | Digital publishing system based on cloud computing |
| CN107046481A (en) * | 2017-04-18 | 2017-08-15 | 国网福建省电力有限公司 | A kind of information system integrated network management system comprehensive analysis platform |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI817147B (en) * | 2021-06-23 | 2023-10-01 | 鼎新電腦股份有限公司 | Automated interface management method |
| CN114553865A (en) * | 2022-01-12 | 2022-05-27 | 中国电子科技集团公司第十研究所 | Heterogeneous hybrid cloud system architecture design method |
| CN114553865B (en) * | 2022-01-12 | 2023-05-12 | 中国电子科技集团公司第十研究所 | Heterogeneous hybrid cloud system architecture design method |
| CN116187936A (en) * | 2023-02-03 | 2023-05-30 | 上海麦德通软件技术有限公司 | Work order intelligent generation system based on cloud platform |
| CN116187936B (en) * | 2023-02-03 | 2023-08-29 | 上海麦德通软件技术有限公司 | Work order intelligent generation system based on cloud platform |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112579703A (en) | Big data comprehensive operation and maintenance platform processing system based on cloud computing | |
| CN109272155A (en) | A kind of corporate behavior analysis system based on big data | |
| CN204539177U (en) | Operation monitoring analysis shows unified platform | |
| CN108197261A (en) | A kind of wisdom traffic operating system | |
| CN108763957A (en) | A kind of safety auditing system of database, method and server | |
| CN112181960B (en) | Intelligent operation and maintenance framework system based on AIOps | |
| CN112349404A (en) | Multi-center medical equipment big data cloud platform based on cloud-edge-end architecture | |
| Bellini et al. | Data flow management and visual analytic for big data smart city/IOT | |
| CN111080261A (en) | Visual data asset management system based on big data | |
| CN115550392A (en) | Intelligent park digital twin platform system | |
| CN112749060A (en) | Power system service bus monitoring method | |
| CN112883001A (en) | Data processing method, device and medium based on marketing and distribution through data visualization platform | |
| CN112651872A (en) | Community comprehensive treatment system and method based on data middlebox | |
| Nesi et al. | Auditing and assessment of data traffic flows in an IoT architecture | |
| CN114706994A (en) | Operation and maintenance management system and method based on knowledge base | |
| CN112561683A (en) | Novel supervisory systems based on credit is jointly awarded and punishment service | |
| CN111414355A (en) | Offshore wind farm data monitoring and storing system, method and device | |
| Wei et al. | Big data analysis service platform building for complex product manufacturing | |
| CN111291029B (en) | Data cleaning method and device | |
| Chen et al. | Research on equipment situation display based on multi-source data fusion | |
| CN112784129A (en) | Pump station equipment operation and maintenance data supervision platform | |
| CN112101894A (en) | Coal dressing intelligent system | |
| CN111435466A (en) | Integrated machine room operation and maintenance management system | |
| CN114925045B (en) | PaaS platform for big data integration and management | |
| Ding et al. | Research on Active Monitoring System of Power Supply Service Demand Based on Computer Big Data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 100088 Room 405, 4th floor, building 1, yard 13, Deshengmenwai street, Xicheng District, Beijing Applicant after: Zhongke Xingyun Wulian Technology (Beijing) Co.,Ltd. Address before: 100088 Room 405, 4th floor, building 1, yard 13, Deshengmenwai street, Xicheng District, Beijing Applicant before: DAWN NEBULA INFORMATION TECHNOLOGY (BEIJING) CO.,LTD. |