CN110990237A - Information collection system, method and storage medium - Google Patents
Information collection system, method and storage medium Download PDFInfo
- Publication number
- CN110990237A CN110990237A CN201910996163.2A CN201910996163A CN110990237A CN 110990237 A CN110990237 A CN 110990237A CN 201910996163 A CN201910996163 A CN 201910996163A CN 110990237 A CN110990237 A CN 110990237A
- Authority
- CN
- China
- Prior art keywords
- module
- information
- information collection
- collection
- collected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000006978 adaptation Effects 0.000 claims abstract description 12
- 238000001514 detection method Methods 0.000 claims abstract description 11
- 239000000284 extract Substances 0.000 claims abstract description 3
- 238000012544 monitoring process Methods 0.000 claims description 9
- 238000004806 packaging method and process Methods 0.000 claims description 4
- 230000006870 function Effects 0.000 description 8
- 238000004590 computer program Methods 0.000 description 6
- 230000007613 environmental effect Effects 0.000 description 3
- 238000006467 substitution reaction Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013515 script Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/14—Details of searching files based on file metadata
- G06F16/148—File search processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
Abstract
The invention relates to an information collecting system, a method and a storage medium, comprising a login module, a setting and result display module; a server connection module which starts a thread to connect the server of the collected information according to the input IP address; a detection module; the adaptation module receives the system operation environment information detected by the detection module, extracts all corresponding module names meeting the information collection conditions and the corresponding module names of the system default collected information from the module library according to the received information, displays the module names in a tree structure on a user setting and result display interface according to the inheritance relationship of the module classes, and formulates the information collection setting meeting the actual requirements according to the specific requirements; the information collection module starts the thread concurrent calling module to collect corresponding configuration information and log information according to module information needing information collection transmitted by the adaptation module; and an information storage module.
Description
Technical Field
The invention belongs to the technical field of server information collection, and particularly relates to an information collection system, an information collection method and a storage medium.
Background
Whether operating systems or critical software business systems running thereon, administrators need a simple, easy-to-operate method to collect critical configuration information and log diagnostic information for the system.
At present, the administrator generally writes a shell script by himself according to own experience and business requirements to collect the information. The method has certain requirements on the ability and experience of the administrator, and cannot ensure that the collected information is comprehensive, complete and targeted.
Although some operating systems provide own unique information collection tools, such as red cap, sosreport used on CentOS, supportconfig used on SUSe system, vm-support used on VMware system, etc., these tools are not uniform, need to be memorized separately, the collected information content and structure are different, and the user cannot select which key information to collect, and in addition, these tools are only directed at the operating system itself, and cannot collect information of software system and service system. This is a drawback in the prior art.
In view of the above, the present application provides an information collecting system, method and storage medium; it is very necessary to solve the above-mentioned defects existing in the prior art.
Disclosure of Invention
In view of the above-mentioned shortcomings in the prior art, the present invention provides an information collecting system, method and storage medium to solve the above-mentioned technical problems.
In order to achieve the purpose, the invention provides the following technical scheme:
in a first aspect, the present invention provides an information collection system comprising:
a login module through which a server is logged in; the login mode of a user name and a password is supported;
a setting and result display module, which provides a setting and result display interface, and in the interface, an IP address input port is provided; inputting an IP address or an IP address segment through the port;
a server connection module which starts a thread to connect the server of the collected information according to the input IP address;
the detection module is used for acquiring system operation environment information of the collected information server;
the adaptation module receives the system operation environment information detected by the detection module, extracts all corresponding module names meeting the information collection conditions and the corresponding module names of the system default collected information from the module library according to the received information, displays the module names in a tree structure on a user setting and result display interface according to the inheritance relationship of the module classes, and formulates the information collection setting meeting the actual requirements according to the specific requirements;
a module library for storing all module names and module inheritance relations,
the information collection module starts the thread concurrent calling module to collect corresponding configuration information and log information according to module information needing information collection transmitted by the adaptation module; after the collection of the module log information is finished, a setstate () function is called to set the state of the module to 1(1 represents that all information of the module is collected). When the state () is executed for all modules to obtain that the state values are all 1, the collection of the log information is finished. And the information collection module calls the information storage module to store the magnetic disk.
And the information storage module converts the inheritance relationship between the module classes into the parent-child relationship between the folders according to the configured storage path of the collected information, establishes a file storage structure corresponding to the module names, respectively stores the information collected by the information collection module under the corresponding folders, and finally packs and compresses the information.
Preferably, the system further comprises:
and the monitoring module monitors the whole process of information collection and storage and displays the progress of information collection in a progress bar mode on a user setting and result display interface. Any error and warning information in the whole information collection and storage process is stored in a separate log file for a user to check and analyze.
Preferably, in the detection module, the acquired system operating environment information includes but is not limited to: the type and version of the operating system, the type and version of system software and the type and version of a service system; the environmental parameters of the operating system are acquired as detailed as possible, and sufficient choices are provided for personalized customization of users.
Preferably, in the information collection module, the configuration information and the log information corresponding to the collectinfo () function collection module of the multiple thread concurrent call modules are started; the acquired configuration information and log information are accurate and comprehensive, and the possibility of missing in information collection is reduced.
In a second aspect, the present invention provides an information collecting method, comprising the steps of:
s1: logging in the system, namely logging in a server;
s2: inputting an IP address or an IP address section to an IP address input port;
s3: starting a thread to connect to a server of the collected information according to the input IP address;
s4: acquiring system operation environment information of a collected information server;
s5: the step of collecting information adaptation specifically includes:
extracting all corresponding module names meeting the information collection conditions and the module names of the default collection information of the system according to the system operation environment information acquired in the step S4, displaying the module names in a tree structure according to the inheritance relationship of the module classes, and formulating information collection setting meeting actual requirements according to specific needs;
s6: the information collection step specifically comprises the following steps:
according to the information collection setting formulated in the step S5, starting a thread concurrent calling module to collect corresponding configuration information and log information; after the collection of the module log information is finished, a setstate () function is called to set the state of the module to 1(1 represents that all information of the module is collected). When the state () is executed for all modules to obtain that the state values are all 1, the collection of the log information is finished. And the information collection module calls the information storage module to store the magnetic disk.
S7: and information storage, namely converting inheritance relationships among module classes into parent-child relationships among folders according to the configured storage paths of the collected information, establishing a file storage structure corresponding to the module names, respectively storing the information collected by the information collection module under the corresponding folders, and finally packaging and compressing.
Preferably, the method further comprises the step of monitoring the whole process of information collection and storage, and showing the progress of information collection in the form of a progress bar.
Preferably, in step S4, the acquired system operating environment information includes, but is not limited to: the type and version of the operating system, the type and version of system software and the type and version of a service system; the environmental parameters of the operating system are acquired as detailed as possible, and sufficient choices are provided for personalized customization of users.
Preferably, in step S6, the method starts configuration information and log information corresponding to the collectinfo () function collection module of the multiple thread concurrent call modules; the acquired configuration information and log information are accurate and comprehensive, and the possibility of missing in information collection is reduced.
In a third aspect, there is provided a computer storage medium having stored therein instructions that, when run on a computer, cause the computer to perform the method of the second aspect described above.
In a fourth aspect, a terminal is provided, including:
a processor, a memory, wherein,
the memory is used for storing a computer program which,
the processor is configured to retrieve and execute the computer program from the memory, so that the terminal performs the method according to the second aspect.
In a fifth aspect, there is provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of the second aspect described above.
The method has the advantages that the method is suitable for collecting software and hardware configuration information and log information on all operating systems, an administrator does not need to write Shell scripts by himself or memorize different commands, configuration information related to any type of system of a plurality of servers can be automatically obtained only by inputting the IP address of the system through the system, the work of the administrator is simplified, and the working efficiency and the accuracy and the integrity of the information are improved.
The system provides information modules which are collected by corresponding operating systems, system software and business software in a default mode, and simultaneously supports user-defined setting of which information is collected, so that the information collection is simple and the actual requirements of customers are better met.
In addition, the invention has reliable design principle, simple structure and very wide application prospect.
Drawings
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
FIG. 1 is a functional block diagram of an information collection system provided by the present invention.
Fig. 2 is a flow chart of an information collection method provided by the present invention.
The system comprises a login module 1, a server connection module 2, a detection module 3, a server 4, an adaptation module 5, a module library 6, an information collection module 7, an information storage module 8, a monitoring module 9 and a setting and result display module 10.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1:
as shown in fig. 1, the information collection system provided in this embodiment includes:
a login module 1 through which a server is logged in; the login mode of a user name and a password is supported;
a setup and result display module 10 providing a setup and result display interface in which an IP address input port is provided; inputting an IP address or an IP address segment through the port;
a server connection module 2 which starts a thread to connect the server of the collected information according to the input IP address;
the detection module 3 acquires system operation environment information of the collected information server 4; the obtained system operating environment information includes but is not limited to: the type and version of the operating system, the type and version of system software and the type and version of a service system; the environmental parameters of the operating system are acquired as detailed as possible, and sufficient choices are provided for personalized customization of users.
The adaptation module 5 is used for receiving the system operation environment information detected by the detection module, extracting all corresponding module names meeting the information collection conditions and the corresponding module names of the default collected information of the system from the module library according to the received information, displaying the module names in a tree structure on a user setting and result display interface according to the inheritance relationship of the module classes, and formulating the information collection setting meeting the actual requirements according to the specific needs;
the module library 6 stores all module names and module inheritance relations which can need to collect information,
the information collection module 7 starts a thread concurrent calling module to collect corresponding configuration information and log information according to module information needing information collection transmitted by the adaptation module; after the collection of the module log information is finished, a setstate () function is called to set the state of the module to 1(1 represents that all information of the module is collected). When the state () is executed for all modules to obtain that the state values are all 1, the collection of the log information is finished. And the information collection module calls the information storage module to store the magnetic disk. Starting configuration information and log information corresponding to a collectinfo () function collection module of a plurality of thread concurrent calling modules; the acquired configuration information and log information are accurate and comprehensive, and the possibility of missing in information collection is reduced.
And the information storage module 8 is used for converting the inheritance relationship between the module classes into the parent-child relationship between the folders according to the configured storage path of the collected information, establishing a file storage structure corresponding to the module names, respectively storing the information collected by the information collection module under the corresponding folders, and finally packaging and compressing the information.
And the monitoring module 9 is used for monitoring the whole process of information collection and storage and displaying the progress of information collection in a progress bar mode on a user setting and result displaying interface. Any error and warning information in the whole information collection and storage process is stored in a separate log file for a user to check and analyze.
Example 2:
as shown in fig. 2, the information collecting method provided in this embodiment includes the following steps:
s1: logging in the system, namely logging in a server;
s2: inputting an IP address or an IP address section to an IP address input port;
s3: starting a thread to connect to a server of the collected information according to the input IP address;
s4: acquiring system operation environment information of a collected information server;
s5: the step of collecting information adaptation specifically includes:
extracting all corresponding module names meeting the information collection conditions and the module names of the default collection information of the system according to the system operation environment information acquired in the step S4, displaying the module names in a tree structure according to the inheritance relationship of the module classes, and formulating information collection setting meeting actual requirements according to specific needs;
s6: the information collection step specifically comprises the following steps:
according to the information collection setting formulated in the step S5, starting a thread concurrent calling module to collect corresponding configuration information and log information; after the collection of the module log information is finished, a setstate () function is called to set the state of the module to 1(1 represents that all information of the module is collected). When the state () is executed for all modules to obtain that the state values are all 1, the collection of the log information is finished. And the information collection module calls the information storage module to store the magnetic disk. Starting configuration information and log information corresponding to a collectinfo () function collection module of a plurality of thread concurrent calling modules; the acquired configuration information and log information are accurate and comprehensive, and the possibility of missing in information collection is reduced.
S7: and information storage, namely converting inheritance relationships among module classes into parent-child relationships among folders according to the configured storage paths of the collected information, establishing a file storage structure corresponding to the module names, respectively storing the information collected by the information collection module under the corresponding folders, and finally packaging and compressing.
And monitoring, namely monitoring the whole process of information collection and storage, and displaying the progress of information collection in a progress bar mode.
Example 3:
the present embodiment provides a computer storage medium having stored therein instructions that, when run on a computer, cause the computer to perform the method of embodiment 2 described above.
Example 4:
the present embodiment provides a terminal, including:
a processor, a memory, wherein,
the memory is used for storing a computer program which,
the processor is configured to call and run the computer program from the memory, so that the terminal executes the method described in embodiment 2 above.
Example 5:
the present embodiment provides a computer program product containing instructions, which when run on a computer, causes the computer to perform the method of embodiment 2 described above.
Although the present invention has been described in detail by referring to the drawings in connection with the preferred embodiments, the present invention is not limited thereto. Various equivalent modifications or substitutions can be made on the embodiments of the present invention by those skilled in the art without departing from the spirit and scope of the present invention, and these modifications or substitutions are within the scope of the present invention/any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (9)
1. An information collection system, comprising:
a login module through which a server is logged in;
a setting and result display module, which provides a setting and result display interface, and in the interface, an IP address input port is provided; inputting an IP address or an IP address segment through the port;
a server connection module which starts a thread to connect the server of the collected information according to the input IP address;
the detection module is used for acquiring system operation environment information of the collected information server;
the adaptation module receives the system operation environment information detected by the detection module, extracts all corresponding module names meeting the information collection conditions and the corresponding module names of the system default collected information from the module library according to the received information, displays the module names in a tree structure on a user setting and result display interface according to the inheritance relationship of the module classes, and formulates the information collection setting meeting the actual requirements according to the specific requirements;
a module library for storing all module names and module inheritance relations,
the information collection module starts the thread concurrent calling module to collect corresponding configuration information and log information according to module information needing information collection transmitted by the adaptation module;
and the information storage module converts the inheritance relationship between the module classes into the parent-child relationship between the folders according to the configured storage path of the collected information, establishes a file storage structure corresponding to the module names, respectively stores the information collected by the information collection module under the corresponding folders, and finally packs and compresses the information.
2. An information collection system according to claim 1, further comprising:
and the monitoring module monitors the whole process of information collection and storage and displays the progress of information collection in a progress bar mode on a user setting and result display interface.
3. The information collection system according to claim 2, wherein in the detection module, the acquired system operating environment information includes but is not limited to: the type and version of the operating system, the type and version of the system software and the type and version of the service system.
4. The information collection system of claim 3, wherein the information collection module starts configuration information and log information corresponding to a collectinfo () function collection module of the multiple thread concurrent call module.
5. An information collection method, comprising the steps of:
s1: logging in the system, namely logging in a server;
s2: inputting an IP address or an IP address section to an IP address input port;
s3: starting a thread to connect to a server of the collected information according to the input IP address;
s4: acquiring system operation environment information of a collected information server;
s5: the step of collecting information adaptation specifically includes:
extracting all corresponding module names meeting the information collection conditions and the module names of the default collection information of the system according to the system operation environment information acquired in the step S4, displaying the module names in a tree structure according to the inheritance relationship of the module classes, and formulating information collection setting meeting actual requirements according to specific needs;
s6: the information collection step specifically comprises the following steps:
according to the information collection setting formulated in the step S5, starting a thread concurrent calling module to collect corresponding configuration information and log information;
s7: and information storage, namely converting inheritance relationships among module classes into parent-child relationships among folders according to the configured storage paths of the collected information, establishing a file storage structure corresponding to the module names, respectively storing the information collected by the information collection module under the corresponding folders, and finally packaging and compressing.
6. An information collection method according to claim 5, further comprising the step of monitoring the whole process of information collection and storage and showing the progress of information collection in the form of progress bars.
7. The information collecting method according to claim 6, wherein in the step S4, the obtained system operation environment information includes but is not limited to: the type and version of the operating system, the type and version of the system software and the type and version of the service system.
8. The method of claim 7, wherein in step S4, in step S6, the configuration information and the log information corresponding to the collectinfo () function collection module of the multiple thread concurrent call module are started.
9. A computer storage medium having stored therein instructions that, when executed on a computer, cause the computer to perform the method of any one of claims 5-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910996163.2A CN110990237B (en) | 2019-10-18 | 2019-10-18 | Information collection system, method and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910996163.2A CN110990237B (en) | 2019-10-18 | 2019-10-18 | Information collection system, method and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110990237A true CN110990237A (en) | 2020-04-10 |
| CN110990237B CN110990237B (en) | 2022-05-31 |
Family
ID=70082170
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910996163.2A Active CN110990237B (en) | 2019-10-18 | 2019-10-18 | Information collection system, method and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110990237B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111858199A (en) * | 2020-06-19 | 2020-10-30 | 苏州浪潮智能科技有限公司 | Self-adaptive hard disk log collection method, system, terminal and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102123042A (en) * | 2010-12-30 | 2011-07-13 | 中国民航信息网络股份有限公司 | System configuration intelligent management system and management method thereof |
| CN103473636A (en) * | 2013-09-03 | 2013-12-25 | 沈效国 | System data components for collecting, analyzing and distributing internet business information |
| US20140214809A1 (en) * | 2004-09-17 | 2014-07-31 | First American Financial Corporation | Method and system for query transformation for managing information from multiple datasets |
| CN105117830A (en) * | 2015-08-11 | 2015-12-02 | 中节能港建（甘肃）风力发电有限公司 | Wind farm production operation and maintenance information collection application system and method |
| CN108874602A (en) * | 2018-06-15 | 2018-11-23 | 郑州云海信息技术有限公司 | It a kind of automatic setting and configures IMDT and collects the method and system of information |
-
2019
- 2019-10-18 CN CN201910996163.2A patent/CN110990237B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140214809A1 (en) * | 2004-09-17 | 2014-07-31 | First American Financial Corporation | Method and system for query transformation for managing information from multiple datasets |
| CN102123042A (en) * | 2010-12-30 | 2011-07-13 | 中国民航信息网络股份有限公司 | System configuration intelligent management system and management method thereof |
| CN103473636A (en) * | 2013-09-03 | 2013-12-25 | 沈效国 | System data components for collecting, analyzing and distributing internet business information |
| CN105117830A (en) * | 2015-08-11 | 2015-12-02 | 中节能港建（甘肃）风力发电有限公司 | Wind farm production operation and maintenance information collection application system and method |
| CN108874602A (en) * | 2018-06-15 | 2018-11-23 | 郑州云海信息技术有限公司 | It a kind of automatic setting and configures IMDT and collects the method and system of information |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111858199A (en) * | 2020-06-19 | 2020-10-30 | 苏州浪潮智能科技有限公司 | Self-adaptive hard disk log collection method, system, terminal and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110990237B (en) | 2022-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106656536B (en) | Method and equipment for processing service calling information | |
| CN110704277B (en) | Method for monitoring application performance, related equipment and storage medium | |
| CN113176978B (en) | Monitoring method, system, equipment and readable storage medium based on log file | |
| US20220050765A1 (en) | Method for processing logs in a computer system for events identified as abnormal and revealing solutions, electronic device, and cloud server | |
| CN109460343A (en) | System exception monitoring method, device, equipment and storage medium based on log | |
| CN114745295A (en) | Data acquisition method, device, equipment and readable storage medium | |
| CN110990237B (en) | Information collection system, method and storage medium | |
| CN108039956A (en) | Using monitoring method, system and computer-readable recording medium | |
| CN109409948B (en) | Transaction abnormity detection method, device, equipment and computer readable storage medium | |
| CN109828920A (en) | A kind of log analysis method, device and computer readable storage medium | |
| CN115705190A (en) | Method and device for determining dependence degree | |
| CN112256470A (en) | Fault server positioning method and device, storage medium and electronic equipment | |
| CN112187509A (en) | Multi-architecture cloud platform execution log management method, system, terminal and storage medium | |
| CN111158979A (en) | Service dial testing method, system, device and storage medium | |
| CN116136801B (en) | Cloud platform data processing method and device, electronic equipment and storage medium | |
| CN110543394A (en) | server sensor information consistency testing method, system, terminal and storage medium | |
| CN114500178B (en) | Self-operation intelligent Internet of things gateway | |
| CN114338347A (en) | Ampere platform-based fault information out-of-band acquisition method and device | |
| CN109684159A (en) | Method for monitoring state, device, equipment and the storage medium of distributed information system | |
| CN111625412A (en) | Flume-based data acquisition method, system, device and storage medium | |
| US10296967B1 (en) | System, method, and computer program for aggregating fallouts in an ordering system | |
| CN112416744A (en) | Test control system, method and equipment | |
| CN109684158A (en) | Method for monitoring state, device, equipment and the storage medium of distributed coordination system | |
| CN114090382B (en) | Health inspection method and device for super-converged cluster | |
| CN113961440A (en) | Method for discovering operation health degree of big data service module |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |