CN114461490A - Operation and maintenance data aggregation system - Google Patents
Operation and maintenance data aggregation system Download PDFInfo
- Publication number
- CN114461490A CN114461490A CN202111676136.0A CN202111676136A CN114461490A CN 114461490 A CN114461490 A CN 114461490A CN 202111676136 A CN202111676136 A CN 202111676136A CN 114461490 A CN114461490 A CN 114461490A
- Authority
- CN
- China
- Prior art keywords
- maintenance data
- cluster
- data
- module
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/20—Administration of product repair or maintenance
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S10/00—Systems supporting electrical power generation, transmission or distribution
- Y04S10/50—Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computing Systems (AREA)
- Business, Economics & Management (AREA)
- Quality & Reliability (AREA)
- General Physics & Mathematics (AREA)
- Human Resources & Organizations (AREA)
- General Engineering & Computer Science (AREA)
- Mathematical Physics (AREA)
- Entrepreneurship & Innovation (AREA)
- General Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Strategic Management (AREA)
- Operations Research (AREA)
- Marketing (AREA)
- Economics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses an operation and maintenance data aggregation system. The system comprises a nanotube center module, an acquisition configuration module, a task management module and a data delivery module; the nano management center module is used for configuring voucher information, project information, equipment information and cluster information required by executing an operation and maintenance data acquisition task; the acquisition configuration module is used for configuring containerized acquisition device information and acquisition script information required by executing the operation and maintenance data acquisition task; the task management module is used for creating an operation and maintenance data acquisition task and managing the operation and maintenance data acquisition task, wherein the management comprises the operations of starting, stopping, copying and deleting the operation and maintenance data acquisition task; and the data delivery module is used for delivering the operation and maintenance data collected by the collector to the ES cluster. The technical scheme of the invention improves the acquisition efficiency of the operation and maintenance data.
Description
Technical Field
The invention relates to the technical field of data aggregation, in particular to an operation and maintenance data aggregation system.
Background
The general operation and maintenance data aggregation is a general aggregation method of operation and maintenance data of a system related to cloud native, which is researched aiming at a use scene with the cloud native technology as a bottom-layer framework, and aims to solve the aggregation difficulty of data sources of various heterogeneous systems in the industries of medical treatment, agriculture, satellite application and the like on high-performance intercommunication of daily operation and maintenance data (logs, indexes and call chains). In the industry, in order to ensure the smooth operation of a software platform, three types of operation and maintenance data, namely a log, an index and a call chain, are definitely output in a digital software architecture to support the continuous iteration of the software architecture. Aiming at the integral construction of the operation and maintenance system, operation and maintenance developers need to make clear the conditions of the basic operation environment (including a single machine and a cluster) of an acquisition end, the data source type (including a data format and a development language), the data reporting form, the operation and maintenance data processing service, the operation and maintenance data storage mechanism, the storage type selection and the like, and then can complete the access of the operation and maintenance data source. The general scheme is that the collection service and the early warning service in different fields such as ELK, Monitoring System and APM are integrated and deployed, and the operation and maintenance data are stored in a non-relational database and a time sequence database by a Pull means. And finally, delivering to architects or operation and maintenance personnel, and referring to the operation and maintenance data through software interfaces in respective fields.
The existing operation and maintenance data aggregation system is based on a cloud native technology and a traditional IT architecture, data access is completed only in a kubernets mode or a virtual single machine mode, and a general reliable mass production mode cannot be solidified for an operation and maintenance system. On one hand, under the increasing data acquisition demand, operation and maintenance developers need to solve the problems of multiple dimensions such as source data burst growth, remote acquisition mode difference, remote basic operating environment difference, single storage throughput bottleneck and the like, and on the other hand, data generated in the whole operation and maintenance process are split on the data storage layer (for example, stored in a file system, a database, a search engine and the like) and cannot be continuous in operation and maintenance work. Due to the two-dimension problem, it is difficult for operation and maintenance developers, architects and operation and maintenance personnel to integrally stage operation and maintenance data to make upper-layer operation and maintenance data applications (for example, data watching discs), and thus the existing software exception problem cannot be found more conveniently. Under the prior art background, resources (manpower and machines) can be continuously input into each node of the whole operation and maintenance data transmission to solve various problems, and further the enterprise cost is increased.
Disclosure of Invention
The invention provides an operation and maintenance data aggregation system, which improves the acquisition efficiency of operation and maintenance data.
The embodiment of the invention provides an operation and maintenance data aggregation system, which comprises a nanotube center module, an acquisition configuration module, a task management module and a data delivery module, wherein the acquisition configuration module is used for acquiring a plurality of task management data;
the nano management center module is used for configuring voucher information, project information, equipment information and cluster information required by executing an operation and maintenance data acquisition task;
the acquisition configuration module is used for configuring containerized acquisition device information and acquisition script information required by executing the operation and maintenance data acquisition task;
the task management module is used for creating an operation and maintenance data acquisition task and managing the operation and maintenance data acquisition task, wherein the management comprises the operations of starting, stopping, copying and deleting the operation and maintenance data acquisition task;
and the data delivery module is used for delivering the operation and maintenance data collected by the collector to the ES cluster.
Furthermore, the nano-tube central module comprises a certificate management submodule, a project management submodule, an equipment management submodule and a cluster management submodule;
the certificate management submodule is used for configuring certificate information required for remote host authentication or remote service authentication when the operation and maintenance data acquisition task is executed, and the certificate information comprises an SSH (secure Shell), a TLS (transport layer service), a mirror warehouse key, an account number, a password and a key;
the project management submodule is used for configuring project information, and the project information comprises host project information and cluster project information;
the device management submodule is used for configuring host information, and the host information comprises a host name, a host IP, a host port, a host affiliated item, a host type and a host certificate;
the cluster management submodule is used for configuring cluster information, and the cluster information comprises a cluster name, a cluster IP, a cluster belonging project, a cluster architecture, a cluster service address, a cluster route and a cluster token.
Furthermore, the acquisition configuration module comprises an acquisition submodule and a script management submodule;
the collector submodule is used for configuring containerized collector information required by executing an operation and maintenance data collection task, and the collector information comprises a collector name, a project to which the collector belongs, a nanotube type, a nanotube object, a collection script name, a collection path and a collection rule;
the script management submodule is used for configuring collection rules of collection scripts required by execution of operation and maintenance data collection tasks and performing visual management on the collection scripts.
Further, configuring a data cleaning rule of the collector at the collector sub-module, where the data cleaning rule includes performing timing cleaning on the cached operation and maintenance data according to the configured data cleaning time, and performing cleaning on the cached operation and maintenance data containing the text information according to the configured text information.
The system further comprises an operation and maintenance data management module, wherein the operation and maintenance data management module is used for storing the collected operation and maintenance data and providing index and data management based on the index template.
The system further comprises a unified ES cluster storage module, wherein the unified ES cluster storage module is used for storing the collected operation and maintenance data into the ES cluster in a unified manner.
Further, the system comprises an index data Restful module, wherein the index data Restful module is used for transmitting the collected operation and maintenance data to other systems through a Restful interface.
The embodiment of the invention has the following beneficial effects:
the invention provides an operation and maintenance data aggregation system, which is characterized in that a containerized collector data acquisition mode is adopted, and a containerized collector-based acquisition task is correspondingly configured in a receiving management center module, an acquisition configuration module, a task management module and a data delivery module of the system so as to realize an intrusion-free data acquisition mode, so that the operation environment and the system architecture of a service system (namely an acquisition end) are not required to be relied on, the service system can be accessed conveniently, quickly and freely, and the acquisition efficiency of operation and maintenance data is improved. Meanwhile, because the invention adopts the data acquisition mode of the containerized collector, different operation and maintenance data aggregation systems can be designed without the difference of basic operation environment (comprising a single machine and a cluster), data source types (comprising data format and development language), data reporting form, operation and maintenance data processing service, operation and maintenance data storage mechanism and storage selection type of the service system, and the corresponding configuration is changed only in a nanotube central module, an acquisition configuration module, a task management module and a data delivery module of the system, so the invention improves the acquisition efficiency of the operation and maintenance data and reduces the acquisition cost of the operation and maintenance data.
Drawings
Fig. 1 is a structural diagram of an operation and maintenance data aggregation system according to an embodiment of the present invention;
fig. 2 is a flowchart of an operation and maintenance data aggregation system provided in an embodiment of the present invention for acquiring operation and maintenance data;
fig. 3 is a schematic diagram of operation and maintenance data collected by the operation and maintenance data aggregation system according to an embodiment of the present invention before formatting;
fig. 4 is a schematic diagram of the operation and maintenance data collected by the operation and maintenance data aggregation system according to an embodiment of the present invention after being formatted;
fig. 5 is a schematic diagram of operation and maintenance data collected by the operation and maintenance data aggregation system according to another formatted example of the present invention;
fig. 6 is a schematic diagram of the operation and maintenance data collected by the operation and maintenance data aggregation system after being formatted according to an embodiment of the present invention.
Detailed Description
The technical solutions in the present invention will be described clearly and completely with reference to the drawings in the present invention, and it should be apparent that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, an operation and maintenance data aggregation system provided in an embodiment of the present invention includes a nanotube center module, an acquisition and configuration module, a task management module, a data delivery module, an operation and maintenance data management module, and a unified ES cluster storage module. The operation and maintenance data management module of the embodiment of the invention corresponds to the data center storage module in fig. 1.
The management center module is used for configuring voucher information, project information, equipment information and cluster information required by executing the operation and maintenance data acquisition task. The operation and maintenance data acquisition task comprises an acquisition task for a host and an acquisition task for a cluster.
As one embodiment, the nanotube central module includes a credential management submodule, a project management submodule, an equipment management submodule, and a cluster management submodule.
The certificate management submodule is used for configuring certificate information required for remote host authentication or remote service authentication when the operation and maintenance data acquisition task is executed, and the certificate information comprises SSH, TLS, mirror image warehouse keys, account numbers, passwords and keys. The credential management sub-module is also used for managing the required credentials when executing the acquisition task, specifically, managing the credentials required for remote host authentication or remote service authentication.
The project management submodule is used for configuring project information, and the project information comprises host project information and cluster project information. Configuring the project information, specifically including adding, deleting and modifying the project information; the purpose of configuring project information is to manage and maintain a host or cluster from the project's dimensions. An item includes multiple hosts or multiple clusters for the management and maintenance of the item, or multiple hosts and clusters for the management and maintenance of the item.
The device management submodule is used for configuring host information, and the host information comprises a host name, a host IP, a host port, a host affiliated item, a host type and a host certificate. Specifically, the device management submodule is used for adding and importing host information needing to be managed.
The cluster management submodule is used for configuring cluster information, and the cluster information comprises a cluster name, a cluster IP, a cluster belonging project, a cluster architecture, a cluster service address, a cluster route and a cluster token. Specifically, the cluster management submodule is configured to add and import cluster information that needs to be managed.
The acquisition configuration module is used for configuring containerization acquisition device information and acquisition script information required by executing the operation and maintenance data acquisition task. The acquisition configuration module enables operation and maintenance personnel to perform configuration operation in an interface mode in a WEB mode, and enables the operation and maintenance personnel to perform execution content configuration of corresponding acquisition tasks aiming at different types of target data sources.
As one embodiment, the acquisition configuration module comprises an acquisition submodule and a script management submodule;
the collector submodule is used for configuring containerization collector information required by executing an operation and maintenance data collection task, and the collector information comprises a collector name, a project to which the collector belongs, a nanotube type, a nanotube object, a collection script name, a collection path and a collection rule. And configuring a data cleaning rule of the collector in the collector submodule, wherein the data cleaning rule comprises the steps of cleaning the cached operation and maintenance data at regular time according to the configured data cleaning time, and cleaning the cached operation and maintenance data containing the text information according to the configured text information.
The script management submodule is used for configuring collection rules of collection scripts required by execution of operation and maintenance data collection tasks and performing visual management on the collection scripts. The content of the collection script is a collection rule written in advance for different containers.
The task management module is used for creating an operation and maintenance data acquisition task and managing the operation and maintenance data acquisition task, wherein the management comprises the operations of starting, stopping, copying and deleting the operation and maintenance data acquisition task.
And the data delivery module is used for delivering the operation and maintenance data collected by the collector to the ES cluster. The ES cluster is an ES cluster of an extranet. Configuring ES cluster information of an external network in the module so as to deliver the collected operation and maintenance data to an ES cluster, wherein the configured ES cluster information of the external network comprises but is not limited to an address, a port, a certificate and a second index rule. Meanwhile, a default first index rule is arranged in the system, the first index rule is according to an index name consisting of an item name, an equipment type, an equipment name, an acquisition type, a task name, { date [ year/month/day ] } and { time [ time/time division/time minute/second ] }, after a plurality of acquired data are stored in the data center, different levels of data aggregation can be performed according to the index name, including but not limited to item dimension data aggregation and type dimension data aggregation, and application display is performed after scattered data are aggregated.
The operation and maintenance data management module is used for storing the collected operation and maintenance data and providing index and data management based on the index template. Specifically, the operation and maintenance data management module is configured to store the collected operation and maintenance data, and provide indexing and data management based on an index template (i.e., the default first index rule). The index management provides management of index storage strategies corresponding to data pushed from the data delivery module, and comprises index field mapping rule setting, index data regular parsing rule setting and conventional monitoring of index storage, wherein the conventional monitoring comprises but is not limited to monitoring of the number of fragments, the storage size, the copy fragments, the counting and the running condition. On the other hand, the data interaction mode can realize that index data management operations (including addition, inquiry, deletion and updating) are completed through single or combined multiple dimensions, wherein the dimensions include but are not limited to project names, equipment types, equipment names, collection types, task names and time intervals.
The unified ES cluster storage module is used for uniformly storing the collected operation and maintenance data into the ES cluster. The ES cluster is an intranet ES cluster. The collected operation and maintenance data are uniformly stored in the ES cluster, so that the reliability and the safety of the data are guaranteed.
The system comprises an index data Restful module, a Restful interface and a Restful data processing module, wherein the index data Restful module is used for transmitting the collected operation and maintenance data to other systems through the Restful interface so as to be used by the other systems for secondary development and application of the operation and maintenance data.
As shown in fig. 2, a core process of the operation and maintenance data acquisition of the system includes accessing an original data source of the operation and maintenance data, acquiring and formatting the operation and maintenance data by a containerization collector, uniformly storing the operation and maintenance data, and providing the stored operation and maintenance data to an operation and maintenance large disk. The original data source of the operation and maintenance data is unstructured log data storage generated in various services when the service system operates; the containerization collector is a universal collector container which is built by virtue of container technologies such as kubernets, dockers and the like, can realize original log data collection and structural operation, and has at least 10 log format collection capacities of common middleware, remote collection in various operating environments and the like; the unified storage is a structured operation and maintenance data center which is used as original operation and maintenance data after two data processing stages of platform acquisition and cleaning by means of an elastic search storage engine under a clustered deployment form; the operation and maintenance large disk is an operation and maintenance data application for carrying out secondary development on structured or unstructured data in cluster storage. The system has the following process of collecting operation and maintenance data:
step S001: and adding target equipment and accessing the credential information of the target equipment through the nanotube central module. For example: and under a Linux system, adding the account number and the key of the target equipment as an access certificate to remotely connect with the server through an SSH protocol.
And creating a log collection task in a designated server connection mode through a task management module, wherein the operation of creating the collection task comprises selecting the equipment type as a host, selecting a host name, selecting a collection type text log, inputting a target text file path and a target text file name, and selecting an index generation rule.
Through the configuration of step S001, the system will automatically create a set of containers (i.e., create containerized collectors), and access the target log text and collect the operation and maintenance data through the created set of containers, and locally cache the operation and maintenance data. For example: under a Linux system, a container is created through a command docker run or kubecect create, log files are synchronized into the container from a remote end through ssh and tail commands of the container, and then the log files in the container are collected and converted to a storage engine (namely stored to an ES cluster) through filehead in the container. The embodiment of the invention adopts the containerized collector, can realize the buffering effect on the source data in the data collection process, and can intercept specific information to ensure the data safety. Meanwhile, the cached data can be cleared regularly (for example, the cached data is cleared at 0 point and 5 minutes every day) by correspondingly setting the containerized collector (namely, the caching time and the text content are customized), so that the data is prevented from being increased too fast and the data volume is prevented from being too large.
Step S002: formatting the operation and maintenance data collected in step S001, specifically, taking the KEY: and splitting in a VALUE mode, and delivering the formatted data to the unified ES cluster module for storage. FIG. 3 is a schematic diagram of the operation and maintenance data before formatting; fig. 4 to 6 are schematic diagrams of the operation and maintenance data after formatting.
Step S003: and providing operation and maintenance data (including log data) stored by the unified ES cluster module in a Restful mode to an external program (or interface) call, namely providing the operation and maintenance data to a third-party visualization tool for information data application, wherein the third-party visualization tool comprises but is not limited to Grafana and DataEase.
The embodiment of the invention adopts an intrusion-free acquisition technology, realizes the key value pair formatting and unified storage of the source data, and provides the acquired operation and maintenance data for an external system through a Restful interface for aggregation query. Specifically, the intrusion-free operation and maintenance acquisition method of the system disclosed by the invention is characterized in that a container technology is utilized to package data pulling, data formatting, data pushing and data caching into one or more containerized collectors and operate outside target acquisition without modifying the acquisition target, so that the intrusion-free acquisition is realized. In order to facilitate data analysis and search, data formatting (such as nginx logs, OS logs, Docker logs and the like) is required after data source acquisition, and the source data is formatted according to a built-in formatting rule or a custom rule of an operation and maintenance system by using Key: value is delivered to the data center. Meanwhile, the operation and maintenance system provides interface management tools for task management, data management, resource monitoring and the like, complex underlying management is abstractly classified, the operation function is simplified, and the operation and maintenance management is facilitated.
The embodiment of the invention ensures the real-time acquisition of the operation and maintenance data, and simultaneously designs a cache mechanism to control the data growth. And designing multiple dimensions such as projects and types, automatically indexing, and realizing later-stage multi-dimensional data aggregation application. The embodiment of the invention is based on the non-invasive technology, does not need external application deployment on target equipment or a cluster, simplifies the operation difficulty of operation and maintenance personnel, and greatly reduces the unstable risk of operation and maintenance data acquisition caused by the operation environment improvement of a service system by the operation and maintenance personnel by an invasive data acquisition mode.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
It will be understood by those skilled in the art that all or part of the processes in the above embodiments may be implemented by hardware related to instructions of a computer program, where the computer program may be stored in a computer readable storage medium, and when executed, the computer program may include the processes in the above embodiments. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
Claims (7)
1. An operation and maintenance data aggregation system is characterized by comprising a nanotube center module, an acquisition configuration module, a task management module and a data delivery module;
the nano management center module is used for configuring voucher information, project information, equipment information and cluster information required by executing an operation and maintenance data acquisition task;
the acquisition configuration module is used for configuring containerized acquisition device information and acquisition script information required by executing the operation and maintenance data acquisition task;
the task management module is used for creating an operation and maintenance data acquisition task and managing the operation and maintenance data acquisition task, wherein the management comprises the operations of starting, stopping, copying and deleting the operation and maintenance data acquisition task;
and the data delivery module is used for delivering the operation and maintenance data collected by the collector to the ES cluster.
2. The operation and maintenance data aggregation method according to claim 1, wherein the nano-tube center module comprises a credential management submodule, a project management submodule, an equipment management submodule and a cluster management submodule;
the certificate management submodule is used for configuring certificate information required for remote host authentication or remote service authentication when the operation and maintenance data acquisition task is executed, and the certificate information comprises an SSH (secure Shell), a TLS (transport layer service), a mirror warehouse key, an account number, a password and a key;
the project management submodule is used for configuring project information, and the project information comprises host project information and cluster project information;
the device management submodule is used for configuring host information, and the host information comprises a host name, a host IP, a host port, a host affiliated item, a host type and a host certificate;
the cluster management submodule is used for configuring cluster information, and the cluster information comprises a cluster name, a cluster IP, a cluster belonging project, a cluster architecture, a cluster service address, a cluster route and a cluster token.
3. The operation and maintenance data aggregation system according to claim 2, wherein the collection configuration module includes a collector submodule and a script management submodule;
the collector submodule is used for configuring containerized collector information required by executing an operation and maintenance data collection task, and the collector information comprises a collector name, a project to which the collector belongs, a nanotube type, a nanotube object, a collection script name, a collection path and a collection rule;
the script management submodule is used for configuring collection rules of collection scripts required by execution of operation and maintenance data collection tasks and performing visual management on the collection scripts.
4. The operation and maintenance data aggregation system according to claim 3, wherein a data cleaning rule of a collector is configured in the collector submodule, and the data cleaning rule includes performing timing cleaning on the cached operation and maintenance data according to configured data cleaning time, and performing cleaning on the cached operation and maintenance data containing the text information according to configured text information.
5. The operation and maintenance data aggregation system according to claim 4, comprising an operation and maintenance data management module, wherein the operation and maintenance data management module is configured to store the collected operation and maintenance data and provide indexing and data management based on an index template.
6. The operation and maintenance data aggregation system according to claim 5, comprising a unified ES cluster storage module, wherein the unified ES cluster storage module is configured to store the collected operation and maintenance data into ES clusters in a unified manner.
7. The operation and maintenance data aggregation system according to any one of claims 1 to 6, comprising an index data Restful module, wherein the index data Restful module is configured to transmit the collected operation and maintenance data to other systems through a Restful interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111676136.0A CN114461490B (en) | 2021-12-31 | 2021-12-31 | Fortune dimension aggregation system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111676136.0A CN114461490B (en) | 2021-12-31 | 2021-12-31 | Fortune dimension aggregation system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114461490A true CN114461490A (en) | 2022-05-10 |
| CN114461490B CN114461490B (en) | 2023-05-30 |
Family
ID=81407796
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111676136.0A Active CN114461490B (en) | 2021-12-31 | 2021-12-31 | Fortune dimension aggregation system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114461490B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107220178A (en) * | 2017-05-26 | 2017-09-29 | 郑州云海信息技术有限公司 | A kind of method that server diagnostic test results quasi real time show |
| WO2017166644A1 (en) * | 2016-03-31 | 2017-10-05 | 乐视控股（北京）有限公司 | Data acquisition method and system |
| CN108133043A (en) * | 2018-01-12 | 2018-06-08 | 福建星瑞格软件有限公司 | A kind of server running log structured storage method based on big data |
| CN109660397A (en) * | 2018-12-21 | 2019-04-19 | 北京百度网讯科技有限公司 | For acquiring system, the method and apparatus of log |
| CN109726209A (en) * | 2018-09-07 | 2019-05-07 | 网联清算有限公司 | Log aggregation method and device |
| CN110704164A (en) * | 2019-09-30 | 2020-01-17 | 珠海市新德汇信息技术有限公司 | Cloud native application platform construction method based on Kubernetes technology |
| CN110851234A (en) * | 2019-10-25 | 2020-02-28 | 中信梧桐港供应链管理有限公司 | Log processing method and device based on docker container |
| CN111190875A (en) * | 2019-12-27 | 2020-05-22 | 航天信息股份有限公司 | Log aggregation method and device based on container platform |
-
2021
- 2021-12-31 CN CN202111676136.0A patent/CN114461490B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017166644A1 (en) * | 2016-03-31 | 2017-10-05 | 乐视控股（北京）有限公司 | Data acquisition method and system |
| CN107220178A (en) * | 2017-05-26 | 2017-09-29 | 郑州云海信息技术有限公司 | A kind of method that server diagnostic test results quasi real time show |
| CN108133043A (en) * | 2018-01-12 | 2018-06-08 | 福建星瑞格软件有限公司 | A kind of server running log structured storage method based on big data |
| CN109726209A (en) * | 2018-09-07 | 2019-05-07 | 网联清算有限公司 | Log aggregation method and device |
| CN109660397A (en) * | 2018-12-21 | 2019-04-19 | 北京百度网讯科技有限公司 | For acquiring system, the method and apparatus of log |
| CN110704164A (en) * | 2019-09-30 | 2020-01-17 | 珠海市新德汇信息技术有限公司 | Cloud native application platform construction method based on Kubernetes technology |
| CN110851234A (en) * | 2019-10-25 | 2020-02-28 | 中信梧桐港供应链管理有限公司 | Log processing method and device based on docker container |
| CN111190875A (en) * | 2019-12-27 | 2020-05-22 | 航天信息股份有限公司 | Log aggregation method and device based on container platform |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114461490B (en) | 2023-05-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12013852B1 (en) | Unified data processing across streaming and indexed data sets | |
| US11113353B1 (en) | Visual programming for iterative message processing system | |
| US11194552B1 (en) | Assisted visual programming for iterative message processing system | |
| US11474673B1 (en) | Handling modifications in programming of an iterative message processing system | |
| US11716260B2 (en) | Hybrid execution of playbooks including custom code | |
| US11614923B2 (en) | Dual textual/graphical programming interfaces for streaming data processing pipelines | |
| US12026155B2 (en) | Executing one query based on results of another query | |
| US11886440B1 (en) | Guided creation interface for streaming data processing pipelines | |
| US11113294B1 (en) | Recommending query templates during query formation | |
| US11263268B1 (en) | Recommending query parameters based on the results of automatically generated queries | |
| US12093318B2 (en) | Recommending query parameters based on tenant information | |
| US11216511B1 (en) | Executing a child query based on results of a parent query | |
| US11604799B1 (en) | Performing panel-related actions based on user interaction with a graphical user interface | |
| US20210326032A1 (en) | User role-based interface layout profiles in an information technology (it) and security operations application | |
| US11409756B1 (en) | Creating and communicating data analyses using data visualization pipelines | |
| US9817867B2 (en) | Dynamically processing an event using an extensible data model | |
| US11676072B1 (en) | Interface for incorporating user feedback into training of clustering model | |
| US11636128B1 (en) | Displaying query results from a previous query when accessing a panel | |
| US20220121708A1 (en) | Dynamic data enrichment | |
| US11644955B1 (en) | Assigning a global parameter to queries in a graphical user interface | |
| US11675816B1 (en) | Grouping evens into episodes using a streaming data processor | |
| US11799798B1 (en) | Generating infrastructure templates for facilitating the transmission of user data into a data intake and query system | |
| US11573971B1 (en) | Search and data analysis collaboration system | |
| US11516069B1 (en) | Aggregate notable events in an information technology and security operations application | |
| US11886844B1 (en) | Updating reusable custom functions across playbooks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |