CN116483471A - Data acquisition plug-in, method, equipment and storage medium - Google Patents
Data acquisition plug-in, method, equipment and storage medium Download PDFInfo
- Publication number
- CN116483471A CN116483471A CN202310477283.8A CN202310477283A CN116483471A CN 116483471 A CN116483471 A CN 116483471A CN 202310477283 A CN202310477283 A CN 202310477283A CN 116483471 A CN116483471 A CN 116483471A
- Authority
- CN
- China
- Prior art keywords
- data
- target object
- target
- data acquisition
- management end
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000005540 biological transmission Effects 0.000 claims abstract description 25
- 230000008569 process Effects 0.000 claims abstract description 23
- 238000004458 analytical method Methods 0.000 claims abstract description 11
- 238000007405 data analysis Methods 0.000 claims description 19
- 238000004891 communication Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 14
- 238000013480 data collection Methods 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 9
- 230000002776 aggregation Effects 0.000 claims description 7
- 238000004220 aggregation Methods 0.000 claims description 7
- 230000000007 visual effect Effects 0.000 claims description 6
- 230000004931 aggregating effect Effects 0.000 claims description 2
- 238000012800 visualization Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 6
- 238000012423 maintenance Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000013079 data visualisation Methods 0.000 description 2
- 230000002411 adverse Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
- G06F9/44526—Plug-ins; Add-ons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44594—Unloading
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
Abstract
The application discloses a data acquisition plug-in, a method, equipment and a storage medium, which relate to the field of computer science and comprise the following steps: a plurality of preset data collectors; the request receiving module is used for receiving a target data acquisition request sent by the management end; the request analysis module is used for determining a target object to be acquired corresponding to the target data acquisition request and determining a corresponding object type; the acquisition control module is used for determining a corresponding target data acquisition device according to the object type, and carrying out corresponding data acquisition operation on a target object to be acquired through the target data acquisition device so as to obtain corresponding target object data; and the data transmission module is used for transmitting the target object data to the management end so that the management end can process the target object data. Therefore, data acquisition of various objects can be realized by installing one plug-in, data of different objects can be prevented from being acquired by installing various plug-ins, the equipment load is effectively reduced, and the acquisition efficiency is improved.
Description
Technical Field
The present invention relates to the field of computer science, and in particular, to a data acquisition plug-in, a data acquisition method, a data acquisition device, and a data acquisition storage medium.
Background
With the rapid development of computer technology, operation and maintenance management personnel need to monitor and manage more and more resource objects (including computing terminals, storage devices, communication network devices, security devices and business software). However, as object types increase, conventional acquisition plug-ins have failed to meet the data acquisition requirements of the newly added devices. The data acquisition plug-ins required for different types of objects are also different. In the prior art, on a server device, middleware and a database acquisition plug-in are required to be deployed, and meanwhile, data acquisition is required to be carried out on the running condition of the server. The data protocols adopted by different resource objects are different, and an acquisition plug-in is independently operated for each type of resource object, so that the equipment load is increased, the data acquisition efficiency is reduced, and the operation of a service system is influenced.
Disclosure of Invention
Accordingly, the present invention is directed to a data acquisition plug-in, a method, a device and a storage medium, which can realize data acquisition of multiple objects by installing one plug-in, avoid data acquisition of different objects by installing multiple plug-ins, effectively reduce the load of the device, and improve the acquisition efficiency. The specific scheme is as follows:
in a first aspect, the present application discloses a data acquisition plug-in, the data acquisition plug-in is installed in waiting to monitor equipment, includes:
a plurality of preset data collectors for responding to data collection requests initiated for different object types;
the request receiving module is used for receiving a target data acquisition request sent by the management end;
the request analysis module is used for determining a target object to be acquired corresponding to the target data acquisition request from the equipment to be monitored and determining an object type corresponding to the target object to be acquired;
the acquisition control module is used for determining corresponding target data collectors from the plurality of data collectors according to the object types corresponding to the target object to be acquired, and performing data acquisition operation corresponding to the target data acquisition request on the target object to be acquired through the target data collectors so as to obtain corresponding target object data;
and the data transmission module is used for transmitting the target object data to the management end so that the management end can process the target object data.
Optionally, the data acquisition plug-in further includes:
and the collector generation module is used for configuring corresponding transmission protocols for different objects to be collected based on object types of different objects to be collected so as to obtain different data collectors corresponding to the different objects to be collected.
Optionally, the object to be acquired includes any one or a combination of a plurality of computing terminals, storage devices, communication devices, security devices and business software in the equipment to be monitored; the transmission protocol comprises any one or a combination of a plurality of simple network management protocol, secure shell protocol, telnet protocol, WMI protocol, JDBC-ODBC bridge, syslog protocol, SNMP Trap and NetFlow, IPFIX, sFLOW.
Optionally, the data transmission module includes:
a data encryption judging unit for judging whether the target object data is encrypted data;
the algorithm determining unit is used for determining a decryption algorithm corresponding to the encrypted data through the object to be acquired when the target object data is the encrypted data;
and the data decryption unit is used for decrypting the target object data by utilizing the decryption algorithm so as to obtain decrypted data corresponding to the target object data.
Optionally, the data acquisition plug-in further includes:
and the collector processing module is used for receiving the data collector upgrading data or the data collector unloading data sent by the management end so as to upgrade the corresponding data collector based on the data collector upgrading data or unload the corresponding data collector based on the data collector unloading data.
Optionally, the data transmission module includes:
the data aggregation unit is used for aggregating the collected target object data by calling a preset aggregation interface to obtain aggregated data;
and the data transmission unit is used for transmitting the converged data to the management end so that the management end can process the target object data.
Optionally, the data transmission module is configured to transmit the target object data to a data analysis module in the management end, so that the management end performs data analysis on the target object data through the data analysis module, and performs visual display on a data analysis result through a visualization module in the management end.
In a second aspect, the present application discloses a data acquisition method, comprising:
receiving a target data acquisition request sent by a management terminal;
determining a target object to be acquired corresponding to the target data acquisition request from the equipment to be monitored, and determining an object type corresponding to the target object to be acquired;
determining corresponding target data collectors from the plurality of data collectors according to the object types corresponding to the target object to be collected, and performing data collection operation corresponding to the target data collection request on the target object to be collected through the target data collectors to obtain corresponding target object data;
and transmitting the target object data to the management end so that the management end can process the target object data.
In a third aspect, the present application discloses an electronic device comprising:
a memory for storing a computer program;
and the processor is used for executing the computer program to realize the data acquisition method.
In a fourth aspect, the present application discloses a computer readable storage medium for storing a computer program which, when executed by a processor, implements a data acquisition method as described above.
In the application, the data acquisition plug-in comprises a plurality of preset data collectors for responding to data acquisition requests initiated for different object types; the request receiving module is used for receiving a target data acquisition request sent by the management end; the request analysis module is used for determining a target object to be acquired corresponding to the target data acquisition request from the equipment to be monitored and determining an object type corresponding to the target object to be acquired; the acquisition control module is used for determining corresponding target data collectors from the plurality of data collectors according to the object types corresponding to the target object to be acquired, and performing data acquisition operation corresponding to the target data acquisition request on the target object to be acquired through the target data collectors so as to obtain corresponding target object data; and the data transmission module is used for transmitting the target object data to the management end so that the management end can process the target object data. Therefore, after the data acquisition plug-in receives the acquisition request of the management end, the application can determine the object to be acquired, which needs to acquire data, and determine the corresponding object type, so that the corresponding target acquisition device is determined based on the object type, the data of the object to be acquired is acquired through the target acquisition device, and the acquired object data is sent to the management end for processing. Therefore, the data acquisition plug-in units can be integrated with multiple types of data collectors in advance, different protocols and acquisition modes are supported, the data acquisition of multiple objects can be realized by installing one plug-in unit, the data of different objects can be prevented from being acquired by installing multiple plug-in units, the equipment load is effectively reduced, and the acquisition efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present invention, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a data acquisition plug-in structure provided in the present application;
FIG. 2 is a flow chart of data collection provided herein;
FIG. 3 is a schematic diagram of a data collection interaction provided in the present application;
fig. 4 is a schematic structural diagram of a specific data acquisition plug-in unit provided in the present application
Fig. 5 is a flowchart of a data acquisition method provided in the present application
Fig. 6 is a block diagram of an electronic device provided in the present application.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In the prior art, on a server device, middleware and a database acquisition plug-in are required to be deployed, and meanwhile, data acquisition is required to be carried out on the running condition of the server. The data protocols adopted by different resource objects are different, and an acquisition plug-in is independently operated for each type of resource object, so that the equipment load is increased, the data acquisition efficiency is reduced, and the operation of a service system is influenced.
In order to overcome the technical problems, the application provides a data acquisition plug-in, a method, equipment and a storage medium, wherein various types of data collectors can be integrated in advance through the data acquisition plug-in, different protocols and acquisition modes are supported, the data acquisition of various objects can be realized through installing one plug-in, the data of different objects can be prevented from being acquired through installing various plug-ins, the equipment load is effectively reduced, and the acquisition efficiency is improved.
Referring to fig. 1, an embodiment of the present invention discloses a data acquisition plug-in, the data acquisition plug-in is installed in a device to be monitored, including:
the request receiving module 11 is configured to receive a target data acquisition request sent by the management end.
In this embodiment, as shown in fig. 2, after the acquisition plug-in is started, a target data acquisition request sent by the management end needs to be received, so as to determine a corresponding data collector based on the target data acquisition request.
It should be noted that the data acquisition plug-in further includes: and the collector generation module is used for configuring corresponding transmission protocols for different objects to be collected based on object types of different objects to be collected so as to obtain different data collectors corresponding to the different objects to be collected. That is, the data collection plug-in includes a plurality of data collectors, and the corresponding collectors may be selected to collect data of the object to be collected according to different collected objects, so that the corresponding collectors need to be generated according to different protocols to collect data of different objects, for example, one device to be collected may include a computing terminal, a storage device, a communication network device, a security device and service software, so that the data collection of different objects to be collected needs to be completed based on the corresponding data protocols, such as a simple network management protocol, a secure shell protocol, a Telnet protocol, a WMI protocol, a JDBC-ODBC bridge, a Syslog protocol, an SNMP Trap, a NetFlow, IPFIX, sFLOW protocol, and the like, to generate the corresponding data collectors, such as a computing terminal data collector, a storage device data collector, a communication network device data collector, a security device data collector and a service software data collector.
The request analysis module 12 is configured to determine a target object to be acquired corresponding to the target data acquisition request from the device to be monitored, and determine an object type corresponding to the target object to be acquired.
In this embodiment, a corresponding target object to be acquired needs to be determined according to a target data acquisition request sent by a management end, for example, the management end needs to obtain data of a computing terminal in equipment to be acquired, and then the management end needs to generate a target data acquisition request for acquiring data of the computing terminal and send the target data acquisition request to a data acquisition plug-in, so that after the data acquisition plug-in receives the target data acquisition request, the data acquisition plug-in determines that the type of the object to be acquired is the computing terminal through analysis of the target data acquisition request, and then performs data acquisition through a corresponding data acquisition device.
And the acquisition control module 13 is configured to determine a corresponding target data collector from the plurality of data collectors according to an object type corresponding to the target object to be acquired, and perform a data acquisition operation corresponding to the target data acquisition request on the target object to be acquired through the target data collector, so as to obtain corresponding target object data.
In this embodiment, according to the object type corresponding to the target object to be acquired, a corresponding target data acquirer is determined from the plurality of data acquirers, and a data acquisition operation corresponding to the target data acquisition request is performed on the target object to be acquired by the target data acquirer, so as to obtain corresponding target object data. That is, the data acquisition plug-in unit in the present invention includes a plurality of data collectors, each data collector can collect data of one type of object, when determining the object type of the object to be acquired, it is necessary to determine a corresponding target data collector according to the determined object type, and collect the data of the object to be acquired according to the target data collector and a corresponding transmission protocol in the target data collector, so as to obtain corresponding target object data. For example, when the object to be acquired is determined to be communication network equipment and service software, the target acquirer is determined to be a communication network equipment data acquirer and a service software data acquirer, so that data in the communication network equipment can be acquired through a corresponding transmission protocol in the communication network equipment data acquirer, and data in the service software can be acquired through a corresponding transmission protocol in the service software data acquirer.
And the data transmission module 14 is used for transmitting the target object data to the management end so that the management end can process the target object data.
In this embodiment, the target object data is transmitted to the management end, so that the management end processes the target object data. That is, as shown in fig. 3, the management end needs to interact with the data acquisition plug-in to obtain the required target object data, and the data acquisition plug-in acquires the target object data corresponding to the target data acquisition request sent by the management end, so that the management end needs to transmit the target object data to the data analysis module in the management end, so that the management end performs data analysis on the target object data through the data analysis module, and performs visual display on the data analysis result through the visual module in the management end.
It should be noted that, the data acquisition plug-in unit further includes: and the collector processing module is used for receiving the data collector upgrading data or the data collector unloading data sent by the management end so as to upgrade the corresponding data collector based on the data collector upgrading data or unload the corresponding data collector based on the data collector unloading data. That is, on the one hand, when the resource object in the device to be acquired is updated, the corresponding data acquisition plug-in unit also needs to be updated, and at this time, the corresponding update data needs to be transmitted to the data acquisition plug-in unit through the management end, so that the data acquisition plug-in unit updates the corresponding data acquisition unit based on the received upgrade data of the data acquisition unit; on the other hand, when a certain resource object in the equipment to be acquired is not required to be acquired, the management end can send the data acquisition unit unloading data to the data acquisition plug-in unit, so that the data acquisition plug-in unit deletes the corresponding data acquisition unit after receiving the data acquisition unit unloading data.
It can be seen that, in this embodiment, the data acquisition plug-in includes a plurality of preset data collectors for responding to data acquisition requests initiated for different object types; the request receiving module is used for receiving a target data acquisition request sent by the management end; the request analysis module is used for determining a target object to be acquired corresponding to the target data acquisition request from the equipment to be monitored and determining an object type corresponding to the target object to be acquired; the acquisition control module is used for determining corresponding target data collectors from the plurality of data collectors according to the object types corresponding to the target object to be acquired, and performing data acquisition operation corresponding to the target data acquisition request on the target object to be acquired through the target data collectors so as to obtain corresponding target object data; and the data transmission module is used for transmitting the target object data to the management end so that the management end can process the target object data. Therefore, after the data acquisition plug-in receives the acquisition request of the management end, the application can determine the object to be acquired, which needs to acquire data, and determine the corresponding object type, so that the corresponding target acquisition device is determined based on the object type, the data of the object to be acquired is acquired through the target acquisition device, and the acquired object data is sent to the management end for processing. Therefore, the data acquisition plug-in units can be integrated with the data acquisition devices of various types in advance, different protocols and acquisition modes can be supported, the data acquisition of various objects can be realized by installing one plug-in unit, the data of different objects can be prevented from being acquired by installing various plug-in units, the equipment load is effectively reduced, the acquisition efficiency is improved, and the comprehensive data display and analysis functions can be realized through the management end, so that the efficiency and the accuracy of operation and maintenance management can be improved.
Referring to FIG. 4, an embodiment of the present invention discloses a data acquisition plug-in comprising
A data encryption judging unit 21 for judging whether the target object data is encrypted data.
In this embodiment, it is determined whether the target object data is encrypted data. That is, as shown in fig. 2, after target data of a corresponding resource object is acquired by a target data collector in a data acquisition plug-in, it needs to be determined whether the target object data is encrypted data after encryption, if the target object data is encrypted data after encryption, a management end cannot directly perform data analysis and data processing on the encrypted data, and needs to decrypt the encrypted data and then transmit the encrypted data to the management end.
And the algorithm determining unit 22 is configured to determine, when the target object data is encrypted data, a decryption algorithm corresponding to the encrypted data according to the object to be acquired.
In this embodiment, when the target object data is encrypted data, a decryption algorithm corresponding to the encrypted data is determined by the object to be acquired. That is, if it is determined that the target object data acquired by the target data acquirer is encrypted data, an encryption algorithm for encrypting the target object data in an object to be acquired corresponding to the encrypted data needs to be determined, then a decryption algorithm corresponding to the encryption algorithm needs to be determined, for example, when the object to be acquired is security equipment, an encryption algorithm for encrypting self data by the security equipment needs to be determined, and then a corresponding decryption algorithm needs to be determined, so that the corresponding security equipment data acquirer decrypts the acquired target object data by using the decryption algorithm.
And a data decryption unit 23, configured to decrypt the target object data by using the decryption algorithm, so as to obtain decrypted data corresponding to the target object data.
In this embodiment, after the data collector determines the corresponding decryption algorithm, the target object data may be decrypted by the decryption algorithm, so as to obtain decrypted data corresponding to the target object data. It should be noted that, as shown in fig. 2, the data collected by the data collector is unencrypted data, and the collected target object data may be directly transmitted to the management end.
The data aggregation unit 24 is configured to aggregate the collected target object data by calling a preset aggregation interface, so as to obtain aggregated data.
In this embodiment, the collected target object data is collected by calling a preset collection interface, so as to obtain collected data. That is, as shown in fig. 2, the management end may need to analyze and process the data of multiple resource objects, and the sent target data acquisition request may need to call multiple data collectors in the data acquisition plug-in to acquire corresponding target object data through the multiple data collectors, and after acquiring target acquisition data of multiple resource objects, the management end needs to aggregate the acquired multiple resource object data through a preset aggregation interface to obtain aggregated data.
And the data transmission unit 25 is configured to transmit the aggregated data to the management end, so that the management end processes the target object data.
In this embodiment, the aggregated data is transmitted to the management end, so that the management end processes the target object data. The collected target object data is collected to the management end through the preset collecting interface, so that the management end can conduct data processing and data analysis on the collected data through the data processing module and the data analysis module, and conduct comprehensive data display on the processed data, and accurate and real-time monitoring data and analysis results are provided for operation and maintenance management staff. Therefore, the management end performs comprehensive data display and analysis, including data visualization, alarming, report monitoring and the like, can provide detailed equipment performance information and abnormal alarming, and is beneficial to improving the efficiency and accuracy of operation and maintenance management.
Therefore, in this embodiment, whether the target object data is encrypted data is first determined, and when the target object data is encrypted data, a decryption algorithm corresponding to the encrypted data is determined by the object to be collected, then the target object data is decrypted by using the decryption algorithm to obtain decrypted data corresponding to the target object data, and finally the collected target object data is collected by calling a preset collection interface to obtain collected data, and the collected data is transmitted to the management end, so that the management end processes the target object data. Therefore, by judging whether the data is encrypted or not, the encrypted data can be decrypted before the collected target object data is sent to the management end, the problem that the encrypted data cannot be used after the management end receives the encrypted data is effectively avoided, adverse effects on a service system are avoided, comprehensive data display and analysis including data visualization, alarming, monitoring report forms and the like are carried out through the management end, detailed equipment performance information and abnormal alarming can be provided, and the efficiency and the accuracy of operation and maintenance management are improved.
Referring to fig. 5, an embodiment of the present invention discloses a data acquisition method, including:
step S11, receiving a target data acquisition request sent by a management end.
And step S12, determining a target object to be acquired corresponding to the target data acquisition request from the equipment to be monitored, and determining an object type corresponding to the target object to be acquired.
And step S13, determining corresponding target data collectors from the plurality of data collectors according to the object types corresponding to the target object to be collected, and performing data collection operation corresponding to the target data collection request on the target object to be collected through the target data collectors so as to obtain corresponding target object data.
And step S14, transmitting the target object data to the management end so that the management end can process the target object data.
For more specific description of step S11 to step S14, reference may be made to the foregoing embodiments, and no further description is given here.
Therefore, in the application, a target data acquisition request sent by a management end is received first, then a target object to be acquired corresponding to the target data acquisition request is determined from the equipment to be monitored, an object type corresponding to the target object to be acquired is determined, corresponding target data collectors are determined from the plurality of data collectors according to the object type corresponding to the target object to be acquired, data acquisition operation corresponding to the target data acquisition request is carried out on the target object to be acquired through the target data collectors, corresponding target object data is obtained, and finally the target object data is transmitted to the management end so that the management end can process the target object data. Therefore, after the data acquisition plug-in receives the acquisition request of the management end, the application can determine the object to be acquired, which needs to acquire data, and determine the corresponding object type, so that the corresponding target acquisition device is determined based on the object type, the data of the object to be acquired is acquired through the target acquisition device, and the acquired object data is sent to the management end for processing. Therefore, the data acquisition plug-in units can be integrated with multiple types of data collectors in advance, different protocols and acquisition modes are supported, the data acquisition of multiple objects can be realized by installing one plug-in unit, the data of different objects can be prevented from being acquired by installing multiple plug-in units, the equipment load is effectively reduced, and the acquisition efficiency is improved.
In some embodiments, the data acquisition method may further include:
and configuring corresponding transmission protocols for different objects to be acquired based on object types of the different objects to be acquired so as to obtain different data collectors corresponding to the different objects to be acquired.
In some embodiments, the object to be acquired includes any one or a combination of several of a computing terminal, a storage device, a communication device, a security device and business software in the device to be monitored; the transmission protocol comprises any one or a combination of a plurality of simple network management protocol, secure shell protocol, telnet protocol, WMI protocol, JDBC-ODBC bridge, syslog protocol, SNMP Trap and NetFlow, IPFIX, sFLOW.
In some embodiments, the data acquisition method may further include:
judging whether the target object data is encrypted data or not;
when the target object data is encrypted data, determining a decryption algorithm corresponding to the encrypted data through the object to be acquired;
and decrypting the target object data by using the decryption algorithm to obtain decrypted data corresponding to the target object data.
In some embodiments, the data acquisition method may further include:
and receiving the data collector upgrading data or the data collector unloading data sent by the management end so as to upgrade the corresponding data collector based on the data collector upgrading data or unload the corresponding data collector based on the data collector unloading data.
In some embodiments, the transmitting the target object data to the management end, so that the management end processes the target object data, includes:
collecting the collected target object data by calling a preset collecting interface to obtain collected data;
and transmitting the converged data to the management end so that the management end can process the target object data.
In some embodiments, the transmitting the target object data to the management end, so that the management end processes the target object data, including
And transmitting the target object data to a data analysis module in the management end, so that the management end performs data analysis on the target object data through the data analysis module and performs visual display on a data analysis result through a visual module in the management end.
Further, the embodiment of the present application further discloses an electronic device, and fig. 6 is a block diagram of an electronic device 30 according to an exemplary embodiment, where the content of the figure is not to be considered as any limitation on the scope of use of the present application.
Fig. 6 is a schematic structural diagram of an electronic device 30 according to an embodiment of the present application. The electronic device 30 may specifically include: at least one processor 31, at least one memory 32, a power supply 33, a communication interface 34, an input-output interface 35, and a communication bus 36. The memory 32 is configured to store a computer program, which is loaded and executed by the processor 31 to implement the relevant steps in the data acquisition method disclosed in any of the foregoing embodiments. In addition, the electronic device 30 in the present embodiment may be specifically an electronic computer.
In this embodiment, the power supply 33 is configured to provide an operating voltage for each hardware device on the electronic device 30; the communication interface 34 can create a data transmission channel between the electronic device 30 and an external device, and the communication protocol to be followed is any communication protocol applicable to the technical solution of the present application, which is not specifically limited herein; the input/output interface 35 is used for acquiring external input data or outputting external output data, and the specific interface type thereof may be selected according to the specific application requirement, which is not limited herein.
The memory 32 may be a carrier for storing resources, such as a read-only memory, a random access memory, a magnetic disk, or an optical disk, and the resources stored thereon may include an operating system 321, a computer program 322, and the like, and the storage may be temporary storage or permanent storage.
The operating system 321 is used for managing and controlling various hardware devices on the electronic device 30 and the computer program 322, which may be Windows Server, netware, unix, linux, etc. The computer program 322 may further include a computer program that can be used to perform other specific tasks in addition to the computer program that can be used to perform the data acquisition method performed by the electronic device 30 as disclosed in any of the previous embodiments.
Further, the application also discloses a computer readable storage medium for storing a computer program; wherein the computer program when executed by a processor implements the data acquisition method disclosed previously. For specific steps of the method, reference may be made to the corresponding contents disclosed in the foregoing embodiments, and no further description is given here.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different point from other embodiments, so that the same or similar parts between the embodiments are referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant points refer to the description of the method section.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative elements and steps are described above generally in terms of functionality in order to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software modules may be disposed in Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing has outlined the detailed description of the preferred embodiment of the present application, and the detailed description of the principles and embodiments of the present application has been provided herein by way of example only to facilitate the understanding of the method and core concepts of the present application; meanwhile, as those skilled in the art will have modifications in the specific embodiments and application scope in accordance with the ideas of the present application, the present description should not be construed as limiting the present application in view of the above.
Claims (10)
1. A data acquisition plug-in, characterized in that the data acquisition plug-in is installed in a device to be monitored, comprising:
a plurality of preset data collectors for responding to data collection requests initiated for different object types;
the request receiving module is used for receiving a target data acquisition request sent by the management end;
the request analysis module is used for determining a target object to be acquired corresponding to the target data acquisition request from the equipment to be monitored and determining an object type corresponding to the target object to be acquired;
the acquisition control module is used for determining corresponding target data collectors from the plurality of data collectors according to the object types corresponding to the target object to be acquired, and performing data acquisition operation corresponding to the target data acquisition request on the target object to be acquired through the target data collectors so as to obtain corresponding target object data;
and the data transmission module is used for transmitting the target object data to the management end so that the management end can process the target object data.
2. The data acquisition plug-in of claim 1, wherein the data acquisition plug-in further comprises:
and the collector generation module is used for configuring corresponding transmission protocols for different objects to be collected based on object types of different objects to be collected so as to obtain different data collectors corresponding to the different objects to be collected.
3. The data acquisition plug-in of claim 2, wherein the object to be acquired comprises any one or a combination of several of a computing terminal, a storage device, a communication device, a security device and business software located in the device to be monitored; the transmission protocol comprises any one or a combination of a plurality of simple network management protocol, secure shell protocol, telnet protocol, WMI protocol, JDBC-ODBC bridge, syslog protocol, SNMP Trap and NetFlow, IPFIX, sFLOW.
4. The data acquisition plug-in of claim 1, wherein the data acquisition plug-in further comprises:
a data encryption judging unit for judging whether the target object data is encrypted data;
the algorithm determining unit is used for determining a decryption algorithm corresponding to the encrypted data through the object to be acquired when the target object data is the encrypted data;
and the data decryption unit is used for decrypting the target object data by utilizing the decryption algorithm so as to obtain decrypted data corresponding to the target object data.
5. The data acquisition plug-in of claim 1, wherein the data acquisition plug-in further comprises:
and the collector processing module is used for receiving the data collector upgrading data or the data collector unloading data sent by the management end so as to upgrade the corresponding data collector based on the data collector upgrading data or unload the corresponding data collector based on the data collector unloading data.
6. The data acquisition card of claim 1, wherein the data transmission module comprises:
the data aggregation unit is used for aggregating the collected target object data by calling a preset aggregation interface to obtain aggregated data;
and the data transmission unit is used for transmitting the converged data to the management end so that the management end can process the target object data.
7. The data acquisition plug-in according to any one of claims 1 to 6, wherein the data transmission module is configured to transmit the target object data to a data analysis module in the management end, so that the management end performs data analysis on the target object data through the data analysis module, and performs visual display on a data analysis result through a visualization module in the management end.
8. A method of data acquisition, comprising:
receiving a target data acquisition request sent by a management terminal;
determining a target object to be acquired corresponding to the target data acquisition request from the equipment to be monitored, and determining an object type corresponding to the target object to be acquired;
determining corresponding target data collectors from the plurality of data collectors according to the object types corresponding to the target object to be collected, and performing data collection operation corresponding to the target data collection request on the target object to be collected through the target data collectors to obtain corresponding target object data;
and transmitting the target object data to the management end so that the management end can process the target object data.
9. An electronic device, comprising:
a memory for storing a computer program;
a processor for executing the computer program to implement the data acquisition method of claim 8.
10. A computer readable storage medium for storing a computer program which, when executed by a processor, implements the data acquisition method of claim 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310477283.8A CN116483471A (en) | 2023-04-25 | 2023-04-25 | Data acquisition plug-in, method, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310477283.8A CN116483471A (en) | 2023-04-25 | 2023-04-25 | Data acquisition plug-in, method, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116483471A true CN116483471A (en) | 2023-07-25 |
Family
ID=87221213
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310477283.8A Pending CN116483471A (en) | 2023-04-25 | 2023-04-25 | Data acquisition plug-in, method, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116483471A (en) |
-
2023
- 2023-04-25 CN CN202310477283.8A patent/CN116483471A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10084681B2 (en) | Method and system for monitoring server cluster | |
| US11573878B1 (en) | Method and apparatus of establishing customized network monitoring criteria | |
| CN111917727A (en) | Electric power Internet of things safety intelligent image transmission system and method based on 5G and WiFi | |
| US20110066719A1 (en) | Automated Applicatin Dependency Mapping | |
| US20180074933A1 (en) | Management of log data in electronic systems | |
| CN113225339A (en) | Network security monitoring method and device, computer equipment and storage medium | |
| US9621438B2 (en) | Network traffic management | |
| CN117176802B (en) | Full-link monitoring method and device for service request, electronic equipment and medium | |
| CN117751567A (en) | Dynamic process distribution for utility communication networks | |
| US20200244773A1 (en) | Method and system for streaming management information base data using simple network management protocol | |
| CN116483471A (en) | Data acquisition plug-in, method, equipment and storage medium | |
| EP2747341B1 (en) | Connecting computer management systems via cellular digital telecommunication networks | |
| CN108933707B (en) | Safety monitoring system and method for industrial network | |
| CN110768870B (en) | Quality monitoring method and device for intelligent special line | |
| CN112491583A (en) | Data acquisition and analysis method and device | |
| CN112000540A (en) | Monitoring processing method, system, equipment and storage medium for distributed deployment products | |
| CN111756836A (en) | Information sending method and device based on event management model | |
| CN115524553A (en) | Method and device for electric energy quality on-line monitoring device | |
| CN110908886A (en) | Data sending method and device, electronic equipment and storage medium | |
| CN114726766B (en) | Fingerprint early warning implementation method, system, medium and equipment based on FTP service monitoring | |
| CN110852537A (en) | Service quality detection method and device | |
| US11762739B2 (en) | Method, device, and program product for backing up data in internet of things | |
| CN118101412A (en) | Cloud-edge collaboration-based Internet of things equipment management system and method | |
| CN113542069B (en) | Flow traction method and device, electronic equipment and storage medium | |
| Sulasno et al. | Developing Integrated Smartphones Notification of Server Resource Monitoring System Using Zabbix, Webhook, and Telegram |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |