CN114338688B - Data management method and device - Google Patents
Data management method and device Download PDFInfo
- Publication number
- CN114338688B CN114338688B CN202111629845.3A CN202111629845A CN114338688B CN 114338688 B CN114338688 B CN 114338688B CN 202111629845 A CN202111629845 A CN 202111629845A CN 114338688 B CN114338688 B CN 114338688B
- Authority
- CN
- China
- Prior art keywords
- application server
- data
- main
- state
- load balancing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 62
- 238000013523 data management Methods 0.000 title claims abstract description 26
- 238000007726 management method Methods 0.000 claims abstract description 93
- 230000036541 health Effects 0.000 claims abstract description 78
- 238000012545 processing Methods 0.000 claims description 26
- 230000003862 health status Effects 0.000 claims description 10
- 230000002159 abnormal effect Effects 0.000 claims description 9
- 230000002776 aggregation Effects 0.000 claims description 8
- 238000004220 aggregation Methods 0.000 claims description 8
- 238000004458 analytical method Methods 0.000 claims description 8
- 238000007781 pre-processing Methods 0.000 claims description 7
- 238000004140 cleaning Methods 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 6
- 238000007689 inspection Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 description 19
- 230000005856 abnormality Effects 0.000 description 8
- 238000012423 maintenance Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 3
- 238000002474 experimental method Methods 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000008439 repair process Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000012528 membrane Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention provides a data management method and a data management device, which are applied to an F5 load balancing management system, wherein the F5 load balancing management system comprises an F5 equipment group formed by a plurality of main F5 load balancing equipment, and each main F5 load balancing equipment is connected with a plurality of application servers. According to the scheme, F5 equipment is managed uniformly through the F5 load balancing management system, when an application server switching management instruction is received, a main application server and a standby application server to be switched are determined, and when the health states of the standby application server and the main application server are determined to be available, the health states of the standby application server and the main application server are switched. Not only can the management efficiency be improved, but also the management operation can be simplified.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data management method and apparatus.
Background
At present, operation and maintenance personnel are required to monitor and manage the operation process of the F5 equipment in a manual mode, management of the F5 equipment in the mode can lead to lower management efficiency, and management personnel are required to have higher professional background knowledge, so that the management operation is very complicated.
Disclosure of Invention
In view of the above, the embodiments of the present invention provide a data management method and apparatus, so as to solve the problems of low management efficiency and very complicated management operation in the prior art.
In order to achieve the above object, the embodiment of the present invention provides the following technical solutions:
the first aspect of the embodiment of the present invention shows a data management method, which is applied to an F5 load balancing management system, where the F5 load balancing management system includes an F5 device group formed by a plurality of primary F5 load balancing devices, where each primary F5 load balancing device is connected to a plurality of application servers, and the method includes:
when an application server switching management instruction is received, determining a main application server and a standby application server to be switched, wherein the standby application server and the main application server belong to an application server;
detecting whether the health states of the standby application server and the main application server are available;
when the health states of the standby application server and the main application server are determined to be available, setting the application state of the standby application server to be a gradually-entering state, so that a user can access the application in the standby application server;
synchronizing configuration data of all the main F5 devices in the F5 device group;
after a first preset time, setting the application state of the main application server to be a fade-out state;
and when the check results of the standby application server and the main application server are determined to be passed, determining that the application server switching management is completed.
Optionally, the detecting whether the health states of the standby application server and the main application server are available includes:
sending a first health check instruction to a standby application server and a main application server so that the standby application server checks the health state of a connected application and feeds back the health state of the application, so that the main application server checks the health state of corresponding pool data and feeds back the health state of the pool data, and the standby application server and the main application server belong to an application server;
and judging whether the health state of the application fed back by the standby application server is available or not, and judging whether the health state of the pool data fed back by the main application server is available or not.
Optionally, the application server is connected to a plurality of proxy ends through a sub F5 device, where the proxy ends are connected to managed application devices, and the method further includes:
transmitting a data checking instruction to the managed application device through the sub F5 load balancing device according to a second preset time, so that the sub F5 load balancing device writes state data and configuration data corresponding to the managed application device into an associated configuration library;
and connecting an application server corresponding to the configuration data based on the association database.
Optionally, the method further comprises:
acquiring an operation log of each main F5 load balancing device in the F5 device group according to a third preset time;
and cleaning the operation log of each main F5 load balancing device, formatting the cleaned operation log, and storing the operation log.
Optionally, the method further comprises:
acquiring performance data of each main F5 load balancing device in the F5 device group according to fourth preset time, wherein the performance data comprises flow data, load data and connection data information;
preprocessing the performance data to obtain preprocessed performance data;
performing aggregation analysis processing on the preprocessed performance data to determine different types of performance data;
and when the performance data of a certain type is determined to be larger than a preset threshold value, determining that the performance data of the certain type is abnormal, and displaying.
A second aspect of the embodiment of the present invention shows a data management apparatus, which is applied to an F5 load balancing management system, where the F5 load balancing management system includes an F5 device group formed by a plurality of primary F5 load balancing devices, where each primary F5 load balancing device is connected to a plurality of application servers, and the apparatus includes: a switching module;
the switching module comprises a first determining unit, a detecting unit, a first setting unit, a processing unit, a second setting unit and a second determining unit;
the first determining unit is used for determining a main application server and a standby application server to be switched when an application server switching management instruction is received, wherein the standby application server and the main application server belong to an application server;
the detection unit is used for detecting whether the health states of the standby application server and the main application server are available;
the first setting unit is used for setting the application state of the standby application server to be a gradually-in state when the health states of the standby application server and the main application server are determined to be available, so that a user can access the application in the standby application server;
the processing unit is used for synchronizing the configuration data of all the main F5 devices in the F5 device group;
the second setting unit is used for setting the application state of the main application server to be a fade-out state after the first preset time;
and the second determining unit is used for determining that the application server switching management is completed when the checking result of the standby application server and the main application server is determined to pass.
Optionally, the detection unit is specifically configured to: sending a first health check instruction to a standby application server and a main application server so that the standby application server checks the health state of a connected application and feeds back the health state of the application, so that the main application server checks the health state of corresponding pool data and feeds back the health state of the pool data, and the standby application server and the main application server belong to an application server; and judging whether the health state of the application fed back by the standby application server is available or not, and judging whether the health state of the pool data fed back by the main application server is available or not.
Optionally, the application server is connected to a plurality of proxy ends through a sub F5 device, and the proxy ends are connected to managed application devices, and the apparatus further includes: an inspection module;
the checking module is used for sending a data checking instruction to the managed application device through the sub F5 load balancing device according to a second preset time, so that the sub F5 load balancing device writes the state data and the configuration data corresponding to the managed application device into an associated configuration library; and connecting an application server corresponding to the configuration data based on the association database.
Optionally, the method further comprises:
the log processing module is used for acquiring the operation log of each main F5 load balancing device in the F5 device group according to a third preset time; and cleaning the operation log of each main F5 load balancing device, formatting the cleaned operation log, and storing the operation log.
Optionally, the method further comprises:
the performance processing module is used for acquiring performance data of each main F5 load balancing device in the F5 device group according to fourth preset time, wherein the performance data comprises flow data, load data and connection data information; preprocessing the performance data to obtain preprocessed performance data; performing aggregation analysis processing on the preprocessed performance data to determine different types of performance data; and when the performance data of a certain type is determined to be larger than a preset threshold value, determining that the performance data of the certain type is abnormal, and displaying.
Based on the above-mentioned data management method and apparatus provided by the embodiment of the present invention, the data management method and apparatus are applied to an F5 load balancing management system, where the F5 load balancing management system includes an F5 device group formed by a plurality of primary F5 load balancing devices, and each primary F5 load balancing device is connected to a plurality of application servers, where the method includes: when an application server switching management instruction is received, determining a main application server and a standby application server to be switched, wherein the standby application server and the main application server belong to the application server; detecting whether the health states of the standby application server and the main application server are available; when the health states of the standby application server and the main application server are determined to be available, setting the application state of the standby application server to be a gradually-in state, so that a user can access the application in the standby application server; synchronizing configuration data of all the main F5 devices in the F5 device group; after a first preset time, setting the application state of the main application server to be a fade-out state; and when the check results of the standby application server and the main application server are determined to be passed, determining that the switching management of the application server is completed. In the embodiment of the invention, F5 equipment is uniformly managed through an F5 load balancing management system, a main application server and a standby application server to be switched are determined when an application server switching management instruction is received, and the health states of the standby application server and the main application server are switched when the health states of the standby application server and the main application server are determined to be available. Not only can the management efficiency be improved, but also the management operation can be simplified.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present invention, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic architecture diagram of an F5 load balancing management system according to an embodiment of the present invention;
FIG. 2 is a flow chart of a data management method according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of another data management device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In this application, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
As known from the background art, in the process of managing the F5 device, operation and maintenance personnel are often required to repeatedly log in a plurality of devices to perform complicated operation, and this situation is more obvious in a complicated emergency scene. In addition, the traditional operation method is not beneficial to auditing the operation log and monitoring the performance index, so that the problems can be quickly found and positioned. In summary, the operation and maintenance efficiency of the existing management mode of the F5 equipment can be determined to be low, and the management operation is very complicated.
In the embodiment of the invention, F5 equipment is uniformly managed through an F5 load balancing management system, a main application server and a standby application server to be switched are determined when an application server switching management instruction is received, and the health states of the standby application server and the main application server are switched when the health states of the standby application server and the main application server are determined to be available. Not only can the management efficiency be improved, but also the management operation can be simplified.
Referring to fig. 1, an architecture diagram of an F5 load balancing management system according to an embodiment of the present invention is shown. The F5 load balancing management system 10 includes an F5 device group 20 formed by a plurality of primary F5 load balancing devices, where each primary F5 load balancing device is connected to a plurality of application servers 30, that is, each primary F5 load balancing device is connected to all application servers 30.
And F5, the load balancing management system 10 is used for determining a main application server and a standby application server to be switched when receiving the application switching management instruction. When the health states of the standby application server and the main application server are determined to be available, setting the application state of the standby application server to be a gradually-entering state, so that a user can access the application in the standby application server; synchronizing configuration data of all the main F5 devices in the F5 device group; and setting the application state of the main application server to be a fade-out state after the first preset time. And when the check results of the standby application server and the main application server are determined to be passed, determining that the application server switching management is completed.
With continued reference to fig. 1, application server 30 is connected through sub-F5 device 40 to a plurality of proxy 50, which proxy 50 is connected to managed application device 60.
The F5 load balancing management system 10 is further configured to send a data checking instruction to the managed application device through the sub F5 load balancing device according to a second preset time, so that the sub F5 load balancing device writes the state data and the configuration data corresponding to the managed application device into an associated configuration library; and connecting an application server corresponding to the configuration data based on the association database.
The second preset time is empirically set, for example, as the first day of each month, that is, periodically.
The managed application device includes an application, a data store to which the application corresponds, and the like.
In the embodiment of the invention, F5 equipment is uniformly managed through an F5 load balancing management system, a main application server and a standby application server to be switched are determined when an application server switching management instruction is received, and the health states of the standby application server and the main application server are switched when the health states of the standby application server and the main application server are determined to be available. Not only can the management efficiency be improved, but also the management operation can be simplified.
Based on the F5 load balancing management system shown in the foregoing embodiment of the present invention, the embodiment of the present invention also corresponds to a data management method, as shown in fig. 2, which is a flow chart of the data management method shown in the embodiment of the present invention, where the method includes:
step S201: and when receiving an application switching management instruction, determining a main application server and a standby application server to be switched.
Optionally, if the operator finds that a local application is not available, based on the switching management instruction related to the main application server corresponding to the application sent by the client, the application flow package of the main application server with the exception is sent to the main F5 load balancing device for managing the application in the F5 load balancing management system.
In the specific implementation process of step S201, when receiving an application server switching management instruction sent by an operation and maintenance personnel based on a client, the main F5 load balancing device further determines that any application server capable of bearing the application flow is a standby application server.
It should be noted that the standby application server and the main application server belong to application servers.
The application server and the main application server are the same type of application server.
The number of backup application services is at least 1.
F5 devices are used for next generation wide area network link traffic management that maximizes link performance and availability.
Step S202: detecting whether the health states of the standby application server and the main application server are available, executing step S203 when the health states of the standby application server and the main application server are determined to be available, and returning to execute step S201 to redetermine a new standby application server if the health states of the standby application server are determined to be unavailable; or if it is determined that the health status of the primary application server is unavailable, it is indicated that there is an abnormality in the pool data, repair is required for the abnormal pool data, and after it is determined that there is no abnormality, step S203 is executed.
The specific content of S202: and F5, the load balancing management system sends a first health check instruction to the standby application server and the main application server so that the standby application server checks the health state of the connected application and feeds back the health state of the application, and the main application server checks the health state of the corresponding pool data and feeds back the health state of the pool data. Judging whether the health state of the application fed back by the standby application server is available or not, and whether the health state of the pool data fed back by the main application server is available or not, executing step S203 when the health states of the standby application server and the main application server are both determined to be available, and returning to execute step S201 to re-determine a new standby application server if the health state of the standby application server is determined to be unavailable; or if it is determined that the health status of the primary application server is unavailable, it is indicated that there is an abnormality in the pool data, repair is required for the abnormal pool data, and after it is determined that there is no abnormality, step S203 is executed.
It should be noted that Pool data refers to performance data corresponding to the sub F5 device or the application server.
Step S203: setting the application state of the standby application server to be a gradual-in state, so that a user can access the application in the standby application server.
The specific content of S203: setting the application state of the standby application server to be in a gradual-in state, that is, controlling the application traffic related to the main application server to flow to the standby application server by the main F5 load balancing device, so that a user can access the application in the standby application server.
The incoming state refers to a window for open transaction, session, or the like.
Step S204: and synchronizing the configuration data of all the main F5 devices in the F5 device group.
In the specific implementation process of step S204, the configuration data synchronization is performed on all the primary F5 load balancing devices in the F5 device primary, so that the configuration data of all the primary F5 devices in the F5 device group are kept consistent.
Step S205: and setting the application state of the main application server to be a fade-out state after the first preset time.
In the specific implementation process of step S205, a first preset time is waited, and the application state of the main application server is set to be a fade-out state, that is, the main F5 load balancing device controls the main application server to stop running, and at this time, the application flow will not flow to the main application server any more, so that the user can only access the application in the standby application server.
It should be noted that the first preset time is set by a technician according to multiple experiments, for example, may be set to 2s.
Step S206: and determining whether the checking results of the standby application server and the main application server pass or not, if so, executing step S207, and if not, indicating that the switching is wrong.
Optionally, the method further comprises: and if the backup application server and the main application server are determined to be in different main F5 load balancing equipment management, synchronizing the configuration data of all the main F5 equipment in the F5 equipment group again.
In the specific implementation process of step S206, the F5 load balancing management system sends a second health check instruction to the standby application server, so that the standby application server checks the connected application health status and the health status of the pool data, and feeds back the application health status and the health status of the pool data. Judging whether the health state of the application fed back by the standby application server and the health state of the pool data are available or not; when the health status of the application fed back by the standby application server and the health status of the pool data are both determined to be available, determining that the inspection results of the standby application server and the main application server are passed, and executing step S209; and when the health state of the application fed back by the standby application server and the health state of the pool data are determined to be unavailable, determining that the inspection results of the standby application server and the main application server are failed, and indicating that the standby application server possibly has an abnormality so as to be displayed to operation and maintenance personnel for processing.
Step S207: and determining that the application server switching management is completed.
Optionally, the workflow is executed and recorded by the flow management program in step S201 to step S207, and a visual flow progress display is provided, so that the operation and maintenance personnel can know the management process in real time.
In the embodiment of the invention, F5 equipment is uniformly managed through an F5 load balancing management system, a main application server and a standby application server to be switched are determined when an application server switching management instruction is received, and the health states of the standby application server and the main application server are switched when the health states of the standby application server and the main application server are determined to be available. Not only can the management efficiency be improved, but also the management operation can be simplified.
Based on the flow chart of the data management method shown in the embodiment of the invention, the method further comprises the following steps:
step S11: and sending a data checking instruction to the managed application device through the sub F5 load balancing device according to a second preset time, so that the sub F5 load balancing device writes the state data and the configuration data corresponding to the managed application device into an associated configuration library.
In step S11, the second preset time is empirically set, such as to be the first day of each month, i.e., periodically.
In the specific implementation process of step S11, the master F5 load balancing device periodically executes a checking script through the proxy end to check the state data and the configuration data of the managed application device, specifically may include VS and pool information of the managed application device, and writes the VS and the pool information into the configuration library.
Step S12: and connecting an application server corresponding to the configuration data based on the association database.
In the process of implementing step S12, the configuration data may associate the F5 device with a specific application server by associating address information of the application in the configuration library.
In the embodiment of the invention, F5 equipment is uniformly managed through an F5 load balancing management system, and a data checking instruction is sent to the managed application equipment through the sub F5 load balancing equipment according to a second preset time, so that the sub F5 load balancing equipment writes state data and configuration data corresponding to the managed application equipment into an associated configuration library; and connecting an application server corresponding to the configuration data based on the association database. Not only can the management efficiency be improved, but also the management operation can be simplified.
Based on the flow chart of the data management method shown in the embodiment of the invention, the method further comprises the following steps:
step S21: and acquiring an operation log of each main F5 load balancing device in the F5 device group according to a third preset time.
In the specific implementation process of step S21, the F5 operation log in the F5 load balancing management system is accessed through the log management platform ELK according to the third preset time.
It should be noted that the third preset time is set according to experience or multiple experiments.
Step S22: and cleaning the operation log of each main F5 load balancing device, formatting the cleaned operation log, and storing the operation log.
In the specific implementation process of step S22, the obtained data is analyzed and counted, specifically, the operation log is cleaned, and converted into the operation log with a fixed format, and stored.
Optionally, an index is established for the stored operation log according to the preset key field, and the executor and the execution operation of the configuration change of the specific period F5 can be rapidly located later.
In the embodiment of the invention, the F5 equipment is uniformly managed through the F5 load balancing management system, and the operation log of each main F5 load balancing equipment in the F5 equipment group is acquired according to the third preset time, so that the operation log of each main F5 load balancing equipment is cleaned, formatted and stored. Not only can the management efficiency be improved, but also the management operation can be simplified.
Based on the flow chart of the data management method shown in the embodiment of the invention, the method further comprises the following steps:
step S31: and acquiring performance data of each main F5 load balancing device in the F5 device group according to fourth preset time.
In step S31, the performance data includes traffic data, load data, and connection data information.
In the specific implementation process of step S31, the flow data, the load data and the connection data information of the F5 device are obtained through a simple network management protocol SNMP method.
It should be noted that the fourth preset time is set according to experience or multiple experiments.
Step S32: and preprocessing the performance data to obtain preprocessed performance data.
In the specific implementation process of step S32, the flow data, the load data and the connection data information are cleaned in real time by means of stream calculation, and are converted into data in a fixed format.
Step S33: and performing aggregation analysis processing on the preprocessed performance data to determine different types of performance data.
In the specific implementation process of step S33, for the data of different data centers, since the data size is relatively large, the preprocessed performance data may be subjected to aggregation analysis processing, so as to perform distributed operation storage.
Step S34: and judging whether the performance data of a certain type is larger than a preset threshold value, if so, executing the step S35, and if so, determining that the performance data of the certain type is not abnormal and displaying.
In the specific implementation process of step S34, the performance data of a certain type is compared with a preset threshold, when it is determined that the performance data of a certain type is greater than the preset threshold, step S35 is executed, and when it is determined that the performance data of a certain type is less than or equal to the preset threshold, it is determined that no abnormality exists in the performance data of the certain type, and the abnormality is displayed.
Step S35: and determining that the performance data of the type has abnormality and displaying.
Optionally, according to the configuration library, the application associated F5 device Pool data Pool membrane monitoring information can be queried, and real-time flow monitoring information of the actual application is calculated and displayed.
Optionally, the flow management tool is used for establishing the flow data of the F5 load balancing management system as a review, synchronization and other flows, and establishing a work order so as to leave a bottom.
In the embodiment of the invention, F5 equipment is uniformly managed through an F5 load balancing management system, and the performance data of each main F5 load balancing equipment in the F5 equipment group is acquired according to fourth preset time; preprocessing the performance data to obtain preprocessed performance data; performing aggregation analysis processing on the preprocessed performance data to determine different types of performance data; and when the performance data of a certain type is determined to be larger than a preset threshold value, determining that the performance data of the certain type is abnormal, and displaying. Not only can the management efficiency be improved, but also the management operation can be simplified.
Corresponding to the data management method shown in the above embodiment of the present invention, a data management device shown in the embodiment of the present invention is shown in fig. 3, which is a schematic flow chart of a data management device shown in the embodiment of the present invention, where the device includes a switching module 31.
The switching module 31 includes a first determination unit, a detection unit, a first setting unit, a processing unit, a second setting unit, and a second determination unit.
And the first determining unit is used for determining a main application server and a standby application server to be switched when receiving an application server switching management instruction, wherein the standby application server and the main application server belong to the application server.
And the detection unit is used for detecting whether the health states of the standby application server and the main application server are available.
Wherein, the detecting element is specifically configured to: sending a first health check instruction to a standby application server and a main application server so that the standby application server checks the health state of a connected application and feeds back the health state of the application, so that the main application server checks the health state of corresponding pool data and feeds back the health state of the pool data, and the standby application server and the main application server belong to an application server; and judging whether the health state of the application fed back by the standby application server is available or not, and judging whether the health state of the pool data fed back by the main application server is available or not.
And the first setting unit is used for setting the application state of the standby application server to be a gradually-in state when the health states of the standby application server and the main application server are determined to be available, so that a user can access the application in the standby application server.
And the processing unit is used for synchronizing the configuration data of all the main F5 devices in the F5 device group.
And the second setting unit is used for setting the application state of the main application server to be a fade-out state after the first preset time.
And the second determining unit is used for determining that the application server switching management is completed when the checking result of the standby application server and the main application server is determined to pass.
It should be noted that, the specific principle and execution process of each unit in the data management device disclosed in the above embodiment of the present invention are the same as those of the data management method implemented in the above embodiment of the present invention, and reference may be made to corresponding parts in the data management method disclosed in the above embodiment of the present invention, and no redundant description is given here.
In the embodiment of the invention, F5 equipment is uniformly managed through an F5 load balancing management system, a main application server and a standby application server to be switched are determined when an application server switching management instruction is received, and the health states of the standby application server and the main application server are switched when the health states of the standby application server and the main application server are determined to be available. Not only can the management efficiency be improved, but also the management operation can be simplified.
With continued reference to fig. 3, the data management apparatus according to the present invention further includes: a checking module 32, a log processing module 33, and a performance processing module 34.
The checking module 32 is configured to send a data checking instruction to the managed application device through the sub F5 load balancing device according to a second preset time, so that the sub F5 load balancing device writes state data and configuration data corresponding to the managed application device into an associated configuration library; and connecting an application server corresponding to the configuration data based on the association database.
A log processing module 33, configured to obtain an operation log of each primary F5 load balancing device in the F5 device group according to a third preset time; and cleaning the operation log of each main F5 load balancing device, formatting the cleaned operation log, and storing the operation log.
A performance processing module 34, configured to obtain performance data of each primary F5 load balancing device in the F5 device group according to a fourth preset time, where the performance data includes flow data, load data, and connection data information; preprocessing the performance data to obtain preprocessed performance data; performing aggregation analysis processing on the preprocessed performance data to determine different types of performance data; and when the performance data of a certain type is determined to be larger than a preset threshold value, determining that the performance data of the certain type is abnormal, and displaying.
In the embodiment of the invention, the F5 equipment is managed by the F5 load balancing management system in a unified way, so that the F5 equipment is managed by the checking module, the log processing module and the performance processing module, the management efficiency can be improved, and the management operation can be simplified.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for a system or system embodiment, since it is substantially similar to a method embodiment, the description is relatively simple, with reference to the description of the method embodiment being made in part. The systems and system embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative elements and steps are described above generally in terms of functionality in order to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. The data management method is characterized by being applied to an F5 load balancing management system, wherein the F5 load balancing management system comprises an F5 equipment group formed by a plurality of main F5 load balancing equipment, and each main F5 load balancing equipment is connected with a plurality of application servers, and the method comprises the following steps:
when an application server switching management instruction is received, determining a main application server and a standby application server to be switched, wherein the standby application server and the main application server belong to the application server;
detecting whether the health state of the application fed back by the standby application server is available or not, and whether the health state of the pool data fed back by the main application server is available or not;
when the health state of the application fed back by the standby application server and the health state of the pool data fed back by the main application server are both available, setting the application state of the standby application server to be a gradually-in state, wherein the gradually-in state is a state enabling a user to access the application in the standby application server;
synchronizing configuration data of all the main F5 devices in the F5 device group;
after a first preset time, setting the application state of the main application server to be a gradually-out state, wherein the gradually-out state is a state that the main application server stops running;
and when the check results of the standby application server and the main application server are determined to be passing, determining that the application server switching management is completed.
2. The method of claim 1, wherein detecting whether the application health status fed back by the standby application server is available and whether the health status of the pool data fed back by the primary application server is available comprises:
and sending a first health check instruction to a standby application server and a main application server so that the standby application server checks the health state of a connected application and feeds back the health state of the application, so that the main application server checks the health state of corresponding pool data and feeds back the health state of the pool data, and the standby application server and the main application server both belong to the application server.
3. The method of claim 1, wherein the application server is connected to a plurality of proxy terminals through sub-F5 devices, the proxy terminals being connected to managed application devices, the method further comprising:
transmitting a data checking instruction to the managed application device through the sub F5 device according to a second preset time, so that the sub F5 device writes the state data and the configuration data corresponding to the managed application device into an associated configuration library;
based on the association configuration library, the F5 load balancing management system is connected with an application server corresponding to the configuration data.
4. The method as recited in claim 1, further comprising:
acquiring an operation log of each main F5 load balancing device in the F5 device group according to a third preset time;
and cleaning the operation log of each main F5 load balancing device, formatting the cleaned operation log, and storing the operation log.
5. The method as recited in claim 1, further comprising:
acquiring performance data of each main F5 load balancing device in the F5 device group according to fourth preset time, wherein the performance data comprises flow data, load data and connection data information;
preprocessing the performance data to obtain preprocessed performance data;
performing aggregation analysis processing on the preprocessed performance data to determine different types of performance data;
and when the performance data of a certain type is determined to be larger than a preset threshold value, determining that the performance data of the certain type is abnormal, and displaying.
6. A data management apparatus, applied to an F5 load balancing management system, where the F5 load balancing management system includes an F5 device group formed by a plurality of primary F5 load balancing devices, and each primary F5 load balancing device is connected to a plurality of application servers, the apparatus includes: a switching module;
the switching module comprises a first determining unit, a detecting unit, a first setting unit, a processing unit, a second setting unit and a second determining unit;
the first determining unit is used for determining a main application server and a standby application server to be switched when an application server switching management instruction is received, wherein the standby application server and the main application server belong to the application server;
the detection unit is used for detecting whether the application health state fed back by the standby application server is available or not, and whether the health state of the pool data fed back by the main application server is available or not;
a first setting unit, configured to set an application state of the standby application server to a fade-in state when it is determined that an application health state fed back by the standby application server and a health state of pool data fed back by the main application server are both available, where the fade-in state is a state that enables a user to access an application in the standby application server;
the processing unit is used for synchronizing the configuration data of all the main F5 devices in the F5 device group;
the second setting unit is used for setting the application state of the main application server to be a fade-out state after the first preset time, wherein the fade-out state is a state that the main application server stops running;
and a second determining unit for determining that the application server switching management is completed when the checking results of the standby application server and the main application server are determined to pass.
7. The device according to claim 6, wherein the detection unit is specifically configured to: and sending a first health check instruction to a standby application server and a main application server so that the standby application server checks the health state of a connected application and feeds back the health state of the application, so that the main application server checks the health state of corresponding pool data and feeds back the health state of the pool data, and the standby application server and the main application server belong to an application server.
8. The apparatus of claim 6, wherein the application server is connected to a plurality of proxy terminals through sub-F5 devices, the proxy terminals being connected to managed application devices, the apparatus further comprising: an inspection module;
the checking module is used for sending a data checking instruction to the managed application device through the sub F5 device according to a second preset time so that the sub F5 device writes the state data and the configuration data corresponding to the managed application device into an associated configuration library; based on the association configuration library, the F5 load balancing management system is connected with an application server corresponding to the configuration data.
9. The apparatus as recited in claim 6, further comprising:
the log processing module is used for acquiring the operation log of each main F5 load balancing device in the F5 device group according to a third preset time; and cleaning the operation log of each main F5 load balancing device, formatting the cleaned operation log, and storing the operation log.
10. The apparatus as recited in claim 6, further comprising:
the performance processing module is used for acquiring performance data of each main F5 load balancing device in the F5 device group according to fourth preset time, wherein the performance data comprises flow data, load data and connection data information; preprocessing the performance data to obtain preprocessed performance data; performing aggregation analysis processing on the preprocessed performance data to determine different types of performance data; and when the performance data of a certain type is determined to be larger than a preset threshold value, determining that the performance data of the certain type is abnormal, and displaying.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111629845.3A CN114338688B (en) | 2021-12-28 | 2021-12-28 | Data management method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111629845.3A CN114338688B (en) | 2021-12-28 | 2021-12-28 | Data management method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114338688A CN114338688A (en) | 2022-04-12 |
| CN114338688B true CN114338688B (en) | 2024-02-23 |
Family
ID=81015664
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111629845.3A Active CN114338688B (en) | 2021-12-28 | 2021-12-28 | Data management method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114338688B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7197547B1 (en) * | 1999-05-11 | 2007-03-27 | Andrew Karl Miller | Load balancing technique implemented in a data network device utilizing a data cache |
| CN102984184A (en) * | 2011-09-05 | 2013-03-20 | 上海可鲁系统软件有限公司 | A method and a device for service load balancing for a distributed system |
| CN103795553A (en) * | 2012-10-29 | 2014-05-14 | 中国银联股份有限公司 | Switching of main and standby servers on the basis of monitoring |
| CN106656617A (en) * | 2016-12-29 | 2017-05-10 | 杭州迪普科技股份有限公司 | Master-slave switching method and device |
| CN106789246A (en) * | 2016-12-22 | 2017-05-31 | 广西防城港核电有限公司 | The changing method and device of a kind of active/standby server |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11295836B2 (en) * | 2017-12-28 | 2022-04-05 | Cerner Innovation, Inc. | Preservation of multi-server database fidelity |
-
2021
- 2021-12-28 CN CN202111629845.3A patent/CN114338688B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7197547B1 (en) * | 1999-05-11 | 2007-03-27 | Andrew Karl Miller | Load balancing technique implemented in a data network device utilizing a data cache |
| CN102984184A (en) * | 2011-09-05 | 2013-03-20 | 上海可鲁系统软件有限公司 | A method and a device for service load balancing for a distributed system |
| CN103795553A (en) * | 2012-10-29 | 2014-05-14 | 中国银联股份有限公司 | Switching of main and standby servers on the basis of monitoring |
| CN106789246A (en) * | 2016-12-22 | 2017-05-31 | 广西防城港核电有限公司 | The changing method and device of a kind of active/standby server |
| CN106656617A (en) * | 2016-12-29 | 2017-05-10 | 杭州迪普科技股份有限公司 | Master-slave switching method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114338688A (en) | 2022-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9369521B2 (en) | Naming of distributed business transactions | |
| US9900226B2 (en) | System for managing a remote data processing system | |
| US6357017B1 (en) | Method, system and computer program product for iterative distributed problem solving | |
| CN110704231A (en) | Fault processing method and device | |
| US20160294666A1 (en) | Method and system for monitoring server cluster | |
| US10545807B2 (en) | Method and system for acquiring parameter sets at a preset time interval and matching parameters to obtain a fault scenario type | |
| CN110535710A (en) | Remote diagnosis method and system, the network equipment and Cloud Server of the network equipment | |
| CN110088744A (en) | A kind of database maintenance method and its system | |
| CN104125085A (en) | EBS (Enterprise Service Bus) data management and control method and device | |
| CN111698121B (en) | SNMP trap alarm test method and related device | |
| CN115499302A (en) | Monitoring method and device of business system, readable storage medium and electronic equipment | |
| CN114422386B (en) | Monitoring method and device for micro-service gateway | |
| CN110750425A (en) | Database monitoring method, device and system and storage medium | |
| CN112671586B (en) | Automatic migration and guarantee method and device for service configuration | |
| CN114338688B (en) | Data management method and device | |
| CN113760634A (en) | Data processing method and device | |
| CN110474821A (en) | Node failure detection method and device | |
| US20220086034A1 (en) | Over the top networking monitoring system | |
| CN112134764B (en) | Method and device for determining connectivity of test environment | |
| CN113626288A (en) | Fault processing method, system, device, storage medium and electronic equipment | |
| CN111447329A (en) | Method, system, device and medium for monitoring state server in call center | |
| CN113179180A (en) | Basalt client disaster fault repairing method, basalt client disaster fault repairing device and basalt client disaster storage medium | |
| CN113938399A (en) | Special line opening method and device | |
| CN112433915B (en) | Data monitoring method and related device based on distributed performance monitoring tool | |
| US20220100594A1 (en) | Infrastructure monitoring system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |